Abstract
Context: Various research studies haveexamined the question of whether expert ornon-expert raters, faculty or students,evaluators or standardized patients, give morereliable and valid summative assessments ofperformance on Objective Structured ClinicalExaminations (OSCEs). Less studied has beenthe question of whether or not non-facultyraters can provide formative feedback thatallows students to take advantage of theeducational opportunity that OSCEs provide. This question is becoming increasinglyimportant, however, as the strain on facultyresources increases.Methods: A questionnaire was developed toassess the quality of feedback that medicalexaminers provide during OSCEs. It was pilottested for reliability using video recordingsof OSCE performances. The questionnaires werethen used to evaluate the feedback given duringan actual OSCE in which clinical clerks,residents, and faculty were used as examinerson two randomly selected test stations.Results: The inter-rater reliabilityof the 19-item feedback questionnaire was 0.69during the pilot test. The internalconsistency was found to be 0.90 during pilottesting and 0.95 in the real OSCE. Using thisform, the feedback ratings assigned to clinicalclerks were significantly greater than thoseassigned to faculty evaluators. Furthermore,performance on the same OSCE stations eightmonths later was not impaired by having beenevaluated by student examiners.Discussion: While evidence of markinflation within the clinical clerk examinersshould be addressed with examiner training, thecurrent results suggest that clerks are capableof giving adequate formative feedback to morejunior colleagues.
Similar content being viewed by others
References
Amiel, G. (1992). Feedback improves OSCE performance. Proceedings of the 5th Annual Ottawa Conference on Medical Education Dundee. Scotland.
Brown, M.G., Hodges, B. & Wakefield, J. (1995). Points for giving effective feedback. In S. Shannon & G.R. Norman (eds.), Evaluation Methods: A Resource Handbook. Ontario: Hamilton.
Hodder, R., Rivington, R. et al. (1989). The effectiveness of immediate feedback during the OSCE.Med Educ 23: 184–188.
Hodges, B., Brown, M., Norman, G.R., Richardson, D. & Turnbull, J. (1994). The effect of feedback on student self-assessment during an OSCE. Proceedings of the 6th Ottawa Conference on Medical Education. Toronto.
Martin, J., Reznick, R.K., Rothman, A., Tamblyn, R.M. & Regehr, G. (1996). Who should rate candidates in an Objective Structured Clinical Examination. Acad Med 71: 170–175.
Reznick, R.K., Smee, S., Baumber, J.S., Cohen, R., Rothman, A., Blackmore, D. & Berard, M. (1993). Guidelines for estimating the real cost of an objective structured clinical examination.Acad Med 68: 513–517.
van der Vleuten, C.P.M., van Luyk, S.J., van Ballegooijen, A.M.J. & Swanson, D.B. (1989). Training and experience of examiners. Med Educ 23: 290–296.
Westberg, J. & Jason, H. (1991). Providing Constructive Feedback. Boulder, CO: Centre for Instructional Support.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Reiter, H.I., Rosenfeld, J., Nandagopal, K. et al. Do Clinical Clerks Provide Candidates with Adequate Formative Assessment during Objective Structured Clinical Examinations?. Adv Health Sci Educ Theory Pract 9, 189–199 (2004). https://doi.org/10.1023/B:AHSE.0000038172.97337.d5
Issue Date:
DOI: https://doi.org/10.1023/B:AHSE.0000038172.97337.d5