Elsevier

Nurse Education Today

Volume 27, Issue 5, July 2007, Pages 481-490
Nurse Education Today

Objective structured clinical examination (OSCE): Review of literature and implications for nursing education

https://doi.org/10.1016/j.nedt.2006.08.009Get rights and content

Summary

Objective structured clinical examination (OSCE) has been used to assess medical students since the mid 1970s, and in more recent years has been increasingly utilised to assess students from nursing and the allied health professions. This growing utilisation has led to considerable debate within the literature pertaining to the optimal use of OSCE as an assessment process.

The purpose of this paper is to present a narrative review regarding some of the key issues affecting the utilisation of OSCE within the assessment of nursing students. The paper briefly reviews the historical development of OSCE within health professional assessment, and summarises some of its key strengths and limitations. It then offers a more ‘in depth’ consideration of the research literature pertaining to the reliability and validity of the OSCE process, which is then used as a basis for exploring some of the particular issues that need to be considered when OSCE is used to assess nursing students. Key issues identified include the need to carefully prepare and pilot new OSCE examinations and marking tools in order to ensure reliability and validity is optimised, and also the need to carefully consider the length, number and interdependence of OSCE stations to ensure that the potentially competing requirements of validity and reliability are balanced. The paper also recognises that whilst the evidence base regarding OSCE is extensive, the evidence base specific to nursing is more limited. There is therefore scope for further research in this area, as well as the need for careful debate regarding how national guidance may be a way of enhancing and standardising future OSCE examinations. The paper concludes that whilst caution must be applied in relying on OSCE as a sole means of practitioner assessment, used carefully it can make a helpful and meaningful contribution to health professional education.

Introduction

This paper explores the use of the objective structured clinical examination (OSCE) as a means of assessing students within both preregistration and postqualification/postgraduate nursing education. It identifies strengths and limitations of this approach to assessment, and offers a narrative literature review to explore a range of issues pertaining to the OSCE process, including consideration of its reliability and validity. These insights are then used to makes evidence based suggestions regarding ways in which OSCE can be most effectively utilised within nursing education.

My personal interest in the OSCE examination stems from using a modified version over the last 5 years to assess a postqualification (PQ) nursing module in ‘history taking and physical examination’. Our initial decision to use OSCE when the course commenced in 2000 was one we initially viewed as pragmatic; a transitional arrangement until there were enough trained nurses with these advanced health assessment skills available to assess students in the practice setting. It is only as we have worked with OSCE over the past 5 years, and explored the literature more closely, that we have come to realise that it may not be a ‘second best’ option after all. It is this debate that lies at the core of this review paper.

Section snippets

Definitions

The OSCE has been defined by various authors, perhaps most concisely by Watson et al. (2002) who describes it as an examination where

‘students demonstrate their competence under a variety of simulated conditions’ (p. 424)

OSCE was first described by Harden et al. (1975), designed to assess the clinical skills and competence of final year medical students. Prior to this the main mode of assessment for medical students’ practice competency was observing their clinical examination of a small number

Comparing OSCE to other modes of assessment

As the use of OSCE has grown, so health professionals have begun to debate many aspects of the process. In critically evaluating OSCE, much attention is given to its trustworthiness as a means of assessment; in other words whether or not the scores students achieve in an OSCE examination can be regarded as a valid and reliable measure of their competence. Most readers will be comfortable with the notion that validity is concerned with whether a test measures what it is supposed to measure

Interrater reliability

A key aspects of reliability explored in studies is the accuracy of judgements made by examiners. This is important since the number of OSCE stations in a typical OSCE means individual stations are frequently reliant on the judgements of single examiners. Accuracy is therefore tested experimentally using inter rater reliability (IRR), with selected stations being independently marked by two assessors whose marks are later compared. Most such studies use measures of correlation; whereby 0 shows

Challenges in nursing education

The evidence considered originates from a range of health care disciplines, but despite some exemplars of nursing focused research, the dominant evidence base is derived from medical practice. There are a number of potential reasons for this, not least the length of time OSCE has been in use in the different professions. But a key reason may also be that the nursing OSCE often looks very different to the traditional medical OSCE. In this respect, it is interesting to reflect on the findings of

Conclusion

In conclusion, it seems that OSCE examination offers an attractive option for assessment of practitioner competency. It seems to offer particular strengths in terms of assessor objectivity and parity of the assessment process for all students, especially when compared with other assessment of practice processes. However, it is not without limitations, not only in terms of student stress and its considerable demands on academia, but also in terms of the considerable challenges of ensuring the

Acknowledgements

The author gratefully acknowledges the 2005 Florence Nightingale Foundation Travel Scholarship which underpinned many of the insights contributing to the development of this paper. NB: This paper is based on a core paper presented at the ‘Nurse Education Tomorrow’ Conference, Durham, September 5, 2005.

References (51)

  • J. Biggs

    Teaching for Quality Learning at University, Buckingham

    (1999)
  • K. Bondy

    Criterion referenced definitions for rating scales in clinical evaluation

    Journal of Nursing Education

    (1983)
  • S. Borbasi et al.

    The objective structured clinical examination: its application in nursing education

    The Australian Journal of Advanced Nursing

    (1993)
  • L. Calman et al.

    Assessing practice of student nurses: methods, preparation of assessors and student views

    Journal of Advanced Nursing

    (2002)
  • C. Carraccio et al.

    The objective structured clinical examination

    Archives of Pediatric and Adolescent Medicine

    (2000)
  • S. Downing et al.

    Validity threats: overcoming interface with proposed interpretations of assessment data

    Medical Education

    (2004)
  • Eraut, M., 1994. Developing Professional Knowledge and Competence, Falmer Press, London cited in Watson, R., Stimpson,...
  • R. Harden et al.

    Assessment of clinical competence using an objective structured clinical examination

    Medical Education

    (1979)
  • R. Harden et al.

    Assessment of clinical competence using objective structured examination

    British Medical Journal

    (1975)
  • B. Hodges

    OSCE! Variations on a theme by Harden

    Medical Education

    (2003)
  • G. Humphris et al.

    Examiner fatigue in communication skills objective structured clinical examinations

    Medical Education

    (2001)
  • I. Hussain et al.

    Inter-rater variation and reliability of objective structured clinical examination

    Journal of the College of Physicians and Surgeons Pakistan

    (1999)
  • S. Jain et al.

    Further experience in development of an objective structured clinical examination for physical medicine and rehabilitation residents

    American Journal of Physical Medicine and Rehabilitation

    (1998)
  • A. Lankshear

    Failure to fail: the teachers dilemma

    Nursing Standard

    (1990)
  • I. Martin et al.

    Predictive validity and estimated cut score of an objective structured clinical examination (OSCE) used as an assessment of clinical skills at the end of a first clinical year

    Medical Education

    (2002)
  • Cited by (223)

    View all citing articles on Scopus
    View full text