Annual Meeting of the Association for Academic Surgery. Chicago, Illinois (USA), 1996/11/13.
Even in the era of the objective structured clinical examination (OSCE), the predominant method of resident evaluation is the faculty ward evaluation (WE), despite many concerns about its reliability.
The aim of this study was to determine the value of the WE as a measurement of clinical competence in terms of both reliability and validity.
In a one-year period, surgery faculty members evaluated 72 residents.
An average of 7 faculty members evaluated each resident.
The evaluation form contained 10 specific performance ratings and an overall evaluation.
Inter-rater reliability of the overall performance ratings was calculated by using the intraclass correlation.
Validity of the WE was evaluated in four ways.
Inter-rater reliability of the overall performance rating was 0.82 ; the reliability of a single overall rating was 0.39. (1) A discriminant function analysis indicated that residents at advanced levels of training received more positive evaluations than residents at less advanced levels (P<0.0001). (2) The overall rating was significantly correlated (r=0.55, P<0.0001) with the overall score of a concurrent OSCE. (3) A factor analysis showed high correlations among the items, indicating a lack of discrimination between the skills. (4) Overall ratings were insensitive to performance deficiencies.
Only 1.3% of the ratings were unsatisfactory or marginal.
The WE was sufficiently reliable to estimate the faculty's view of each resident. (...)
Mots-clés Pascal : Formation professionnelle, Médecin, Chirurgien, Evaluation professionnelle, Mesure, Expérience professionnelle, Echelle évaluation, Service hospitalier, Urgence, Intérêt, Spécificité, Etude statistique, Homme
Mots-clés Pascal anglais : Occupational training, Physician, Surgeon, Professional evaluation, Measurement, Professional experience, Evaluation scale, Hospital ward, Emergency, Interest, Specificity, Statistical study, Human
Notice produite par :
Inist-CNRS - Institut de l'Information Scientifique et Technique
Cote : 97-0407239
Code Inist : 002B30A09. Création : 19/12/1997.