Abstract
The purpose of the study was to develop a comprehensive program evaluation instrument. Following pilot work with residents, a 69-item instrument consisting of statements with 5-point strongly agree to strongly disagree response options was distributed to 107 residents; 104 responded. Psychometric analyses revealed no ceiling or floor effects; 9 items were deleted. There were three subscales: workload (19 items; α=.76); educational environment (29 items; α=.72) and lifestyle issues (12 items; α=.62). Mean item scores were significantly higher for educational environment (3.53; SD 0.28) than for workload (2.78; SD 0.39) and lifestyle (2.96; SD 0.42). Items with the lowest scores reflected issues that were largely fixable. The 60-item instrument appears to be psychometrically sound, comprehensive, and exportable.
This is a preview of subscription content, log in via an institution to check access.
References
1996–1977 Graduate Medical Education Directory. Chicago, Ill: American Medical Association: 1996.
Gray JD. Global rating scales in residency education. Acad Med. 1996:71(suppl):S55–63.
Butterfield PS. The stress of residency: a review of literature. Arch Intern Med. 1988:148:1428–35.
Norcini JJ, Grosso LJ, Shea JA, Webster GD. The relationship between features of residency training and ABIM certifying examination performance. J Gen Intern Med. 1987;2:330–6.
Norcini JJ, Webster GD, Grosso LJ, Blank LL, Benson JA. Ratings of residents’ clinical competence and performance on certifying examination. J Med Educ. 1987:62:457–62.
Grosso L, Norcini JJ. Does feedback on examination performance help directors of internal medicine residencies evaluate the medical knowledge of their residents against national norms? Acad Med. 1990:69:979–82.
McCue JD. The distress of internship: causes and prevention. N Engl J Med. 1985;312:449–52.
Small GW. House officer stress syndrome. Psychosomatics. 1981: 22:860–9.
Residency Services Committee, Association of Program Directors in Internal Medicine. Stress and impairment during residency training: strategies for reduction, identification, and management. Ann Intern Med. 1988;148:1428–35.
Schwartz AJ, Black ER, Goldstein MG. Jozefowicz RF, Emmings FG. Levels and causes of stress among residents. J Med Educ. 1987;62:744–53.
Trontell MC, Carson JL, Taragin MI, Duff A. The impact of the night float system on internal medicine residency programs. J Gen Intern Med. 1991;6:445–9.
Seelig CB. Quantifying qualitative issues in residency training: development and testing of a scaled program evaluation questionnaire. J Gen Intern Med. 1993;8:610–3.
Seelig CB, DuPre CT, Adelman HM. Development and validation of a scaled questionnaire for evaluation of residency programs. S Med J. 1995;88:745–9.
Guilford JP, Fruchter B. Fundamental Statistics in Psychology and Education. New York, NY: McGraw-Hill: 1978.
Author information
Authors and Affiliations
Additional information
Dr. Asch is the recipient of a Health Services Research and Development career development award from the Department of Veterans Affairs.
Rights and permissions
About this article
Cite this article
Bellini, L., Shead, J.A. & Asch, D.A. A new instrument for residency program evaluation. J GEN INTERN MED 12, 707–710 (1997). https://doi.org/10.1046/j.1525-1497.1997.07139.x
Issue Date:
DOI: https://doi.org/10.1046/j.1525-1497.1997.07139.x