Skip to main content

Advertisement

SpringerLink
Log in

The construct validity of HPAT-Ireland for the selection of medical students: unresolved issues and future research implications

  • Published:
Advances in Health Sciences Education Aims and scope Submit manuscript

Abstract

Aptitude tests are widely used in selection. However, despite certain advantages their use remains controversial. This paper aims to critically appraise five sources of evidence for the construct validity of the Health Professions Admission Test (HPAT)-Ireland, an aptitude test used for selecting undergraduate medical students. The objectives are to identify gaps in the evidence, draw comparisons with other aptitude tests and outline future research directions. Our appraisal of the literature found that stakeholder feedback indicates that there is reasonable evidence for test content validity for two of the three sections of HPAT-Ireland. By contrast the Non-Verbal Reasoning section is widely criticised as having limited relevance to medical school performance and future clinical practice. In terms of concurrent validity there is a significant small to medium, negative correlation with school exit examinations, but not consistently so across all studies (r = −0.18, −0.28, 0.017). Likewise predictive validity studies vary, from negative to moderate strength correlations with examination performance during early years at medical school. Five studies indicate that HPAT-Ireland is supported in principle by the majority of stakeholders. While one consequence of its introduction is that successful applicants are now coming from more diverse academic backgrounds, there is no evidence that the socio-economic background of medical school entrants has been altered significantly. Negative perceptions of unfairness relating to gender, coaching and socio-economics remain. The evidence to date suggests that while there are slight gender differences, initially favouring males, these vary year on year. In conclusion, the attitudes towards, and performance of, HPAT-Ireland is not unlike that of other aptitude tests widely used internationally. The main justifications for its introduction have been achieved, in that Ireland no longer relies exclusively on a single measure of academic record for selection to medical school. However a number of areas require further research and exploration.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  • Adam, J., Dowell, J., & Greatrix, R. (2011). Use of UKCAT scores in student selection by UK medical schools, 2006–2010. BMC Medical Education, 11(98), 1.

    Google Scholar 

  • Admissions Testing Service. (2016). About the biomedical admissions test. Cambridge: Admissions Testing Service. Retrieved April 04, 2016, from http://www.admissionstestingservice.org/for-test-takers/bmat/about-bmat/

  • Agrawal, J. R., Vlaicu, S., & Carrasquillo, O. (2005). Progress and pitfalls in underrepresented minority recruitment: Perspectives from the medical schools. Journal of the National Medical Association, 97(9), 1226–1231.

    Google Scholar 

  • American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. Washington, DC: American Education Research Association.

    Google Scholar 

  • Andriole, D. A., & Jeffe, D. B. (2010). Prematriculation variables associated with suboptimal outcomes for the 1994–1999 cohort of US medical school matriculants. Journal of the American Medical Association, 304(11), 1212–1220.

    Article  Google Scholar 

  • Association of American Medical Colleges. (2016). Medical college admission test. Washington: The Association of American Medical Colleges. Retrieved April 04, 2016, from https://www.aamc.org/students/applying/mcat/

  • Australian Council for Educational Research (ACER). (2016a). HPAT-Ireland-health professions admission test Ireland. Australia: Australian Council for Educational Research. Retrieved April 04, 2016, from https://hpat-ireland.acer.edu.au

  • Australian Council for Educational Research (ACER). (2016b). Undergraduate medicine and health sciences admission test. Australia: Australian Council for Educational Research. Retrieved April 04, 2016, from https://umat.acer.edu.au/

  • Australian Council for Educational Research (ACER). (2016c). Graduate Australian medical school admissions test. Australia: Australian Council for Educational Research. Retrieved April 04, 2016, from https://gamsat.acer.edu.au/gamsat-australia

  • Bore, M., Munro, D., & Powis, D. (2009). A comprehensive model for the selection of medical students. Medical Teacher, 31(12), 1066–1072.

    Article  Google Scholar 

  • Callahan, C. A., Hojat, M., Veloski, J., Erdmann, J. B., & Gonnella, J. S. (2010). The predictive validity of three versions of the MCAT in relation to performance in medical school, residency, and licensing examinations: A longitudinal study of 36 classes of Jefferson Medical College. Academic Medicine, 85(6), 980–987.

    Article  Google Scholar 

  • Central Applications Office (CAO). (2015) Selection criteria for undergraduate entry to medicine EU applicants. Dublin: CAO. Retrieved April 04, 2016, from http://www.cao.ie/downloads/documents/UGMedEntry2015.pdf

  • Cleland, J., Dowell, J., Mclachlan, J., Nicholson, S., & Patterson, F. (2012). Identifying best practice in the selection of medical students. London: General Medical Council. Retrieved April 04, 2016, from http://www.gmc-uk.org/Identifying_best_practice_in_the_selection_of_medical_students.pdf_51119804.pdf

  • Cleland, J. A., French, F. H., & Johnston, P. W. (2011). A mixed-methods study identifying and exploring medical students’ views of the UKCAT. Medical Teacher, 33(3), 244–249.

    Article  Google Scholar 

  • Coates, H. (2008). Establishing the criterion validity of the graduate medical school admissions test (GAMSAT). Medical Education, 42(10), 999–1006.

    Article  Google Scholar 

  • Collin, T. V., Violato, C., & Hecker, K. (2009). Aptitude, achievement and competence in medicine: A latent variable path model. Advances in Health Sciences Education, 14(3), 355–366.

    Article  Google Scholar 

  • Cook, D. A., & Beckman, T. J. (2006). Current concepts in validity and reliability for psychometric instruments: Theory and application. The American Journal of Medicine, 119(2), 166.e7.

    Article  Google Scholar 

  • Cotter, K. (2009). Gender balance in medicine. The Irish Times, Aug 25th. Retrieved April 04, 2016, from http://www.irishtimes.com/opinion/letters/gender-balance-in-medicine-1.725369

  • Council of Deans for Medical Schools of reland (CDFMSI). (2009). Letters to the editor—Gender balance in medicine. Council of Deans of Faculties with Medical Schools of Ireland. The Irish Times, Aug 28th. Retrieved April 04, 2016, from http://www.irishtimes.com/opinion/letters/gender-balance-in-medicine-1.727462

  • Cousans, F., Patterson, F., Greatrix, R., Nicholson, S., & Martin, S. (2015). Emerging evidence on widening access by assessment of non-cognitive attributes for selection to medical and dental training in the UK. Paper presented at AMEE Conference 2015, Glasgow, UK.

  • Crossley, J., Humphris, G., & Jolly, B. (2002). Assessing health professionals. Medical Education, 36(9), 800–804.

    Article  Google Scholar 

  • Cullen, M. J., Sackett, P. R., & Lievens, F. (2006). Threats to the operational use of situational judgment tests in the college admission process. International Journal of Selection and Assessment, 14(2), 142–155.

    Article  Google Scholar 

  • Davis, D., Dorsey, J. K., Franks, R. D., Sackett, P. R., Searcy, C. A., & Zhao, X. (2013). Do racial and ethnic group differences in performance on the MCAT exam reflect test bias? Academic Medicine, 88(5), 593–602.

    Article  Google Scholar 

  • Dennehy, T., Kelly, M., & O’Flynn, S. (2013). General practitioners’ perspectives on revised entry and selection methods to medicine and the HPAT. Irish Medical Journal, 106(4), 113–115.

    Google Scholar 

  • Dhar, D., Perry, W. R. G., & Poole, P. (2012). Students’ perceptions of the undergraduate medicine and health sciences admissions test (UMAT). New Zealand Medical Journal, 125(1361), 29–36.

    Google Scholar 

  • Donnon, T., Paolucci, E. O., & Violato, C. (2007). The predictive validity of the MCAT for medical school performance and medical board licensing examinations: A meta-analysis of the published research. Academic Medicine, 82(1), 100–106.

    Article  Google Scholar 

  • Downing, S. M. (2003). Validity: On meaningful interpretation of assessment data. Medical Education, 37(9), 830–837.

    Article  Google Scholar 

  • Downing, S. M. (2004). Reliability: On the reproducibility of assessment data. Medical Education, 38(9), 1006–1012.

    Article  Google Scholar 

  • Edwards, D., Friedman, T., & Pearce, J. (2013). Same admissions tools, different outcomes: A critical perspective on predictive validity in three undergraduate medical schools. BMC Medical Education, 13(1), 1.

    Article  Google Scholar 

  • Emery, J. L., & Bell, J. F. (2009). The predictive validity of the biomedical admissions test for pre-clinical examination performance. Medical Education, 43, 557–564.

    Article  Google Scholar 

  • Emery, J. L., Bell, J. F., & Vidal Rodeiro, C. L. (2011). The Biomedical admissions test for medical student selection: Issues of fairness and bias. Medical Teacher, 33, 62–71.

    Article  Google Scholar 

  • Ferguson, E., James, D., & Madeley, L. (2002). Factors associated with success in medical school: Systematic review of the literature. British Medical Journal, 324(7343), 952–957.

    Article  Google Scholar 

  • Fottrell, P. (2006). Medical education in Ireland: A new direction. Report of the Working Group on Undergraduate Education and Training (the Fottrell Report) Dublin, Ireland. Retrieved April 04, 2016, from https://www.education.ie/en/Publications/Policy-Reports/Medical-Education-in-Ireland-A-New-Direction-Report-of-the-Working-Group-on-Undergraduate-Medical-Education-and-Training.pdf

  • Griffin, B., & Wilson, I. (2012). Associations between the big five personality factors and multiple miniinterviews. Advances in Health Sciences Education, 17, 377–388.

    Article  Google Scholar 

  • Griffin, B., Harding, D. W., Wilson, I. G., & Yeomans, N. D. (2008). Does practice make perfect? The effect of coaching and retesting on selection tests used for admission to an Australian medical school. Medical Journal of Australia, 189, 270–273.

    Google Scholar 

  • Griffin, B., Carless, S., & Wilson, I. (2013). The effect of commercial coaching on selection test performance. Medical Teacher, 35(4), 295–300.

    Article  Google Scholar 

  • Groves, M. A., Gordon, J., & Ryan, G. (2007). Entry tests for graduate medical programs: Is it time to re-think? Medical Journal of Australia, 186(3), 120–123.

    Google Scholar 

  • Groves, M., O’Rourke, P., & Alexander, H. (2003). The association between student characteristics and the development of clinical reasoning in a graduate-entry, PBL medical programme. Medical Teacher, 25(6), 626–631.

    Article  Google Scholar 

  • Hausknecht, J. P., Halpert, J. A., Di Paolo, N. T., & Gerrard, M. O. M. (2007). Retesting in selection: A meta-analysis of coaching and practice effects for tests of cognitive ability. Journal of Applied Psychology, 92(2), 373–385.

    Article  Google Scholar 

  • Henry, P. (2006). Educational and career barriers to the medical profession: Perceptions of underrepresented minority students. College Student Journal, 40(2), 429–441.

    Google Scholar 

  • Hissbach, J. C., Klusmann, D., & Hampe, W. (2011). Dimensionality and predictive validity of the HAM-Nat, a test of natural sciences for medical school admission. BMC Medical Education, 11(1), 83.

    Article  Google Scholar 

  • Houston, M. (2009). Welcome for more men doing medicine: Medical schools pleased by return of gender balance. Irish Times 2009/8/18, p. 6.

  • Houses of the Oireachtas. (2010). Other questions—Health professional education. Dublin, Ireland: Office of the Houses of the Oireachtas. Retrieved April 04, 2016, from http://debates.oireachtas.ie/dail/2010/09/29/00012.asp

  • Houses of the Oireachtas. (2012). Health professions admission test administration. Dublin, Ireland: Office of the Houses of the Oireachtas. Retrieved April 04, 2016, from http://oireachtasdebates.oireachtas.ie/debates%20authoring/debateswebpack.nsf/takes/dail2012092000032?opendocument

  • Houses of the Oireachtas. (2014). Health professions admission test administration. Dublin, Ireland: Office of the House of the Oireachtas. Retrieved April 04, 2016, from http://oireachtasdebates.oireachtas.ie/debates%20authoring/debateswebpack.nsf/takes/seanad2014031200006?opendocument

  • Husbands, A., Mathieson, A., Dowell, J., Cleland, J., & Mackenzie, R. (2014). Predictive validity of the UK clinical aptitude test in the final years of medical school: A prospective cohort study. BMC Medical Education, 14(1), 88.

    Article  Google Scholar 

  • James, D., Yates, J., & Nicholson, S. (2010). Comparison of A level and UKCAT performance in students applying to UK medical and dental schools in 2006: Cohort study. British Medical Journal, 340, c478.

    Article  Google Scholar 

  • Julian, E. R. (2005). Validity of the medical college admission test for predicting medical school performance. Academic Medicine, 80(10), 910–917.

    Article  Google Scholar 

  • Kelly, M. E. (2015). Medical student selection: A mixed methods study. Doctorate of Philosophy, National University of Ireland, Galway.

  • Kelly, M. E., Arnett, R., Dennehy, T., Duggan, E., Dunne, F., Gallagher, N., Hennessy, M., Lapthorne, S., Last, J., Mc Grath, D., Murphy, A. W., Stevens, L., & O’Flynn, S. (2014a). Stakeholder views on selection to undergraduate medicine in Ireland. International Network for Researchers in Selection into Healthcare (INReSH), London, November 10–11.

  • Kelly, M. E., Dowell, J., Husbands, A., Newell, J., O’Flynn, S., Kropmans, T., et al. (2014b). The fairness, predictive validity and acceptability of Multiple Mini Interview in an internationally diverse student population—A mixed methods study. BMC Medical Education, 14(1), 1.

    Article  Google Scholar 

  • Kelly, M. E., Gallagher, N., Dunne, F. P., & Murphy, A. W. (2014c). Views of doctors of varying disciplines on HPAT-Ireland as a selection tool for medicine. Medical Teacher, 36(9), 775–782.

    Article  Google Scholar 

  • Kelly, M. E., Regan, D., Dunne, F. P., Henn, P., Newell, J., & O’Flynn, S. (2013). To what extent does the health professions admission test-Ireland predict performance in early undergraduate tests of communication and clinical skills?—An observational cohort study. BMC Medical Education, 13(1), 1.

    Article  Google Scholar 

  • Kreiter, C. D., & Axelson, R. D. (2013). A perspective on medical school admission research and practice over the last 25 years. Teaching and Learning in Medicine, 25(S1), S50–S56.

    Article  Google Scholar 

  • Kyei-Blankson, L. S. (2005). Predictive validity, differential validity, and differential prediction of the subtests of the Medical College Admission Test. Doctorate of Philosophy, Ohio University.

  • Lambe, P., Waters, C., & Bristow, D. (2012). The UK clinical aptitude test: Is it a fair test for selecting medical students? Medical Teacher, 34(8), e557–e565.

    Article  Google Scholar 

  • Lievens, F., Buyse, T., & Sackett, P. R. (2005). Retest effects in operational selection settings: Development and test of a framework. Personnel Psychology, 58(4), 981–1007.

    Article  Google Scholar 

  • Linn, R. L., & Gronlund, N. E. (2000). Measurement and assessment in teaching. Upper Saddle River, NJ: Merrill, Prentice-Hall.

    Google Scholar 

  • Lynch, B., Mackenzie, R., Dowell, J., Cleland, J., & Prescott, G. (2009). Does the UKCAT predict year 1 performance in medical school? Medical Education, 43(12), 1203–1209.

    Article  Google Scholar 

  • McGaghie, W. C., Downing, S. M., & Kubilius, R. (2004). What is the impact of commercial test preparation courses on medical examination performance? Teaching and Learning in Medicine, 16(2), 202–211.

    Article  Google Scholar 

  • McManus, I. C., Dewberry, C., Nicholson, S., & Dowell, J. S. (2013a). The UKCAT-12 study: Educational attainment, aptitude test performance, demographic and socio-economic contextual factors as predictors of first year outcome in a cross-sectional collaborative study of 12 UK medical schools. BMC Medicine, 11(1), 1.

    Article  Google Scholar 

  • McManus, I. C., Dewberry, C., Nicholson, S., Dowell, J. S., Woolf, K., & Potts, H. W. W. (2013b). Construct-level predictive validity of educational attainment and intellectual aptitude tests in medical student selection: Meta-regression of six UK longitudinal studies. BMC Medicine, 14(11), 1.

    Google Scholar 

  • McManus, I. C., Ferguson, E., Wakeford, R., Powis, D., & James, D. (2011). Response to comments by Emery and Bell, medical teacher 33(1). Medical Teacher, 33, 60–61.

    Article  Google Scholar 

  • McManus, I. C., Powis, D. A., Wakeford, R., Ferguson, E., James, D., & Richards, P. (2005). Intellectual aptitude tests and A levels for selecting UK school leaver entrants for medical school. British Medical Journal, 331(7516), 555–559.

    Article  Google Scholar 

  • Medical Schools Council. (2015). INReSH International Network for Researchers in Selection into Healthcare. London. Retrieved April 04, 2016, from http://www.medschools.ac.uk/AboutUs/Projects/INReSH/Pages/INReSH.aspx

  • Mercer, A., Crotty, B., Alldridge, L., Le, L., & Vale, V. (2015). GAMSAT: A 10-year retrospective overview, with detailed analysis of candidates’ performance in 2014. BMC Medical Education, 15(1), 31.

    Article  Google Scholar 

  • Mercer, A., & Puddey, I. B. (2011). Admission selection criteria as predictors of outcomes in an undergraduate medical course: A prospective study. Medical Teacher, 33(12), 997–1004.

    Article  Google Scholar 

  • Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13–103). New York: Macmillan Publishing Co.

    Google Scholar 

  • Milburn, A. (2009). Unleashing aspiration: The final report of the panel on fair access to the professions. London. Cabinet Office. Retrieved April 04, 2016, from http://webarchive.nationalarchives.gov.uk/+/http:/www.cabinetoffice.gov.uk/media/227102/fair-access.pdf

  • Mooney, B. (2009). Testing the gender balance. Irish Times Health Plus, Aug 25th. Dublin, Ireland: Irish Times Ltd. Retrieved April 04, 2016, from http://www.irishtimes.com/news/health/testing-the-gender-balance-1.725422

  • Mooney, B. (2012). Medicine entry test fails to level the playing field. The Irish Times, June 6, p. 14. Dublin, Ireland: Irish Times Ltd. Retrieved April 04, 2016, from http://www.irishtimes.com/opinion/medicine-entry-test-fails-to-level-the-playing-field-1.1064317

  • Norman, G. (2015). The negative consequences of consequential validity. Advances in Health Sciences Education, Theory and Practice, 20(3), 575–579.

    Article  Google Scholar 

  • O’Flynn, S., Mills, A., & Fitzgerald, A. (2013a). Entry to medical school the gender question. What has happened? Irish Medical Journal, 106, 230–232.

    Google Scholar 

  • O’Flynn, S., Fitzgerald, T., & Mills, A. (2013b). Modelling the impact of old and new mechanisms of entry and selection to medical school in Ireland: Who gets in? Irish Journal of Medical Science, 182, 421–427.

    Article  Google Scholar 

  • O’Flynn, S., Power, S., Hennessy, M., Mills, A., & Lapthorne, S. (2013c). Guidance Counsellors perspectives on revised entry and selection mechanisms to medicine and the HPAT. In Guideline. Dublin: Institute of Guidance Counsellors.

  • O’Flynn, S., Mills, A., & Fitzgerald, T. (2012). Interim report school leaver entrants Ireland. Report of the National Research Group Evaluating Revised Entry Mechanisms to Medicine. Dublin, Ireland: Irish Universities Association. Retrieved April 04, 2016, from http://www.iua.ie/wp-content/uploads/2013/06/HPAT-report-July2012.pdf

  • O’Regan, E. (2012). Minister wants to scrap test for medical schools. Ireland. Independent. ie Feb 18th. Retrieved April 04, 2016, from http://www.independent.ie/irish-news/minister-wants-to-scrap-test-for-medical-schools-26822872.html

  • Patterson, D. G., Baldwin, L. M., & Olsen, P. M. (2009). Supports and obstacles in the medical school application process for American Indians and Alaska Natives. Journal of Health Care for the Poor and Underserved, 20(2), 308–329.

    Article  Google Scholar 

  • Patterson, F. & Ferguson, E. (2007). Selection for medical education and training. In Understanding medical education. Edinburgh. Association for the Study of Medical Education.

  • Patterson, F., & Ferguson, E. (2010). Selection for medical education and training. In T. Swanwick (Ed.), Understanding medical education. Sussex: Wiley Online Library.

    Google Scholar 

  • Patterson, F., Knight, A., Dowell, J., Nicholson, S., Cousans, F., & Cleland, J. (2016a). How effective are selection methods in medical education? A systematic review. Medical Education, 50(1), 36–60.

    Article  Google Scholar 

  • Patterson, F., Zibarras, L., & Ashworth, V. (2016b). Situational judgement tests in medical education and training: Research, theory and practice: AMEE Guide No. 100. Medical Teacher, 38(1), 3–17.

    Article  Google Scholar 

  • Patterson, F., Lievens, F., Kerrin, M., Zibarras, L., & Carette, B. (2012). Designing selection systems for medicine: The importance of balancing predictive and political validity in high-stakes selection contexts. International Journal of Selection and Assessment, 20(4), 486–496.

    Article  Google Scholar 

  • Patterson, F., Zibarras, L., Carr, V., Irish, B., & Gregory, S. (2011). Evaluating candidate reactions to selection practices using organisational justice theory. Medical Education, 45(3), 289–297.

    Article  Google Scholar 

  • Plint, S., & Patterson, F. (2010). Identifying critical success factors for designing selection processes into postgraduate specialty training: The case of UK general practice. Postgraduate Medical Journal, 86(1016), 323–327.

    Article  Google Scholar 

  • Poole, P., Shulruf, B., Rudland, J., & Wilkinson, T. (2012). Comparison of UMAT scores and GPA in prediction of performance in medical school: A national study. Medical Education, 46(2), 163–171.

    Article  Google Scholar 

  • Powis, D.A. (1994). Selecting medical students. Medical Education, 28, 443–469.

    Article  Google Scholar 

  • Prideaux, D., Roberts, C., Eva, K., Centeno, A., Mccrorie, P., McManus, C., et al. (2011). Assessment for selection for the health care professions and specialty training: Consensus statement and recommendations from the Ottawa 2010 conference. Medical Teacher, 33(3), 215–223.

    Article  Google Scholar 

  • Puddey, I. B., & Mercer, A. (2013). Socio-economic predictors of performance in the Undergraduate Medicine and Health Sciences Admission Test (UMAT). BMC Medical Education, 13, 155.

    Article  Google Scholar 

  • Puddey, I. B., & Mercer, A. (2014). Predicting academic outcomes in an Australian graduate entry medical programme. BMC Medical Education, 14, 31.

    Article  Google Scholar 

  • Puddey, I. B., Mercer, A., Carr, S. E., & Louden, W. (2011). Potential influence of selection criteria on the demographic composition of students in an Australian medical school. BMC Medical Education, 11, 97.

    Article  Google Scholar 

  • Puddey, I. B., Mercer, A., Andrich, D., & Styles, I. (2014). Practice effects in medical school entrance testing with the undergraduate medicine and health sciences admission test (UMAT). BMC Medical Education, 14, 48.

    Article  Google Scholar 

  • Quinlivan, J. A., Lam, L. T., Wan, S., & Petersen, R. W. (2010). Selecting medical students for academic and attitudinal outcomes in a Catholic medical school. Medical Journal of Australia, 193(6), 347–350.

    Google Scholar 

  • Quinn, A., Corrigan, M. A., Broderick, J., Mcentee, G., & Hill, A. D. (2010). A comparison of performances of consultant surgeons, NCHDs and medical students in a modified HPAT examination. Irish Medical Journal, 103(6), 172–173.

    Google Scholar 

  • Regan, A. M. R. (2015). Validation of situational judgement tests in GP selection. Doctor of Psychological Science (D.Psych.Sc) in Clinical Psychology, NUI Galway.

  • Reiter, H. I., & Eva, K. W. (2005). Applied research: Reflecting the relative values of community, faculty, and students in the admissions tools of medical school. Teaching and Learning in Medicine, 17(1), 4–8.

    Article  Google Scholar 

  • Reiter, H. I., Lockyer, J., Ziola, B., Courneya, C. A., & Eva, K. (2012). Should efforts in favor of medical student diversity be focused during admissions or farther upstream? Academic Medicine, 87(4), 443–448.

    Article  Google Scholar 

  • Roberts, C., Zoanetti, N., & Rothnie, I. (2009). Validating a multiple mini-interview question bank assessing entry-level reasoning skills in candidates for graduate-entry medicine and dentistry programmes. Medical Education, 43(4), 350–359.

    Article  Google Scholar 

  • Royal, K. D., & Puffer, J. C. (2014). The consequential validity of ABFM examinations. The Journal of the American Board of Family Medicine, 27(3), 430–431.

    Article  Google Scholar 

  • Sackett, P. R., Borneman, M. J., & Connelly, B. S. (2008). High stakes testing in higher education and employment: Appraising the evidence for validity and fairness. American Psychologist, 63(4), 215–227.

    Article  Google Scholar 

  • Sartania, N., Mcclure, J. D., Sweeting, H., & Browitt, A. (2014). Predictive power of UKCAT and other pre-admission measures for performance in a medical school in Glasgow: A cohort study. BMC Medical Education, 14, 116.

    Article  Google Scholar 

  • Shulruf, B., Poole, P., Wang, G. Y., Rudland, J., & Wilkinson, T. (2012). How well do selection tools predict performance later in a medical programme? Advances in Health Sciences Education, 17(5), 615–626.

    Article  Google Scholar 

  • Simpson, P. L., Scicluna, H. A., Jones, P. D., Cole, A. M., O’Sullivan, A. J., Harris, P. G., et al. (2014). Predictive validity of a new integrated selection process for medical school admission. BMC Medical Education, 14, 86.

    Article  Google Scholar 

  • Stanley, J. (1970). Educational measurements (2nd ed., pp. 1356–2442). Washington: American Council on Education.

    Google Scholar 

  • Stevens, L., Kelly, M. E., Hennessy, M., Last, J., Dunne, F., & O’Flynn, S. (2014). Medical students’ views on selection tools for medical school—A mixed methods study. Irish Medical Journal, 107(8), 229–231.

    Google Scholar 

  • Streiner, D. L., & Norman, G. R. (2008). Health measurement scales. Oxford: Oxford University Press.

    Book  Google Scholar 

  • Tiffin, P. A., Dowell, J. S., & McLachlan, J. C. (2012). Widening access to UK medical education for under-represented socioeconomic groups: Modelling the impact of the UKCAT in the 2009 cohort. British Medical Journal (Online), 344, e1805.

    Article  Google Scholar 

  • Tiffin, P., McLachlan, J., Webster, L., & Nicholson, S. (2014). Comparison of the sensitivity of the UKCAT and A Levels to sociodemographic characteristics: A national study. BMC Medical Education, 14, 7.

    Article  Google Scholar 

  • Till, H., Myford, C., & Dowell, J. (2013). Improving student selection using multiple mini-interviews with multifaceted Rasch modeling. Academic Medicine, 88(2), 216–223.

    Article  Google Scholar 

  • UKCAT Consortium. (2007a). UKCAT 2006/07 Annual Report. Nottingham, UK: UKCAT. Retrieved April 04, 2016, from http://www.ukcat.ac.uk/App_Media/uploads/pdf/Annual%20Report%202006.pdf

  • UKCAT Consortium. (2007b). UKCAT 2007/08 Annual Report. Nottingham, UK: UKCAT. Retrieved April 04, 2016, from http://www.ukcat.ac.uk/App_Media/uploads/pdf/Annual%20Report%202007.pdf

  • UKCAT Consortium. (2008). UKCAT 2008 Annual Report. Nottingham, UK: UKCAT. Retrieved April 04, 2016, from http://www.ukcat.ac.uk/App_Media/uploads/pdf/Annual%20Report%202008.pdf

  • UKCAT Consortium. (2010). UKCAT Annual Report 2009/2010. Nottingham, UK: UKCAT. Retrieved April 04, 2016, from http://www.ukcat.ac.uk/App_Media/uploads/pdf/Annual%20report%202009.pdf

  • UKCAT Consortium. (2011). Annual report and financial statements for the year ended 31 March 2011. Nottingham, UK: UKCAT. Retrieved April 04, 2016, from http://www.ukcat.ac.uk/App_Media/uploads/pdf/Annual%20report%202010.pdf

  • UKCAT Consortium. (2012). Annual report and financial statements for the year ended 31 March 2012. Nottingham, UK: UKCAT. Retrieved April 04, 2016, from http://www.ukcat.ac.uk/App_Media/uploads/pdf/Annual%20report%202011%20Final%20version.pdf

  • UKCAT Consortium. (2013). Annual report and financial statements for the year ended 31 March 2013. Nottingham, UK: UKCAT. Retrieved April 04, 2016, from http://www.ukcat.ac.uk/App_Media/uploads/pdf/Annual%20report%202012%20Final%20version.pdf

  • UKCAT Consortium. (2014). Annual report and financial statements for the year ended 31 March 2014. Nottingham, UK: UKCAT. Retrieved April 04, 2016, from http://www.ukcat.ac.uk/App_Media/uploads/pdf/UKCAT%20Annual%20Report%20Final%20Low%20Res.pdf

  • UKCAT Consortium. (2016). The UK clinical aptitude test. Nottingham, UK: UKCAT. Retrieved April 04, 2016, from http://www.ukcat.ac.uk/

  • Wilkinson, T. M., & Wilkinson, T. J. (2013). Preparation courses for a medical admissions test: Effectiveness contrasts with opinion. Medical Education, 47, 417–424.

    Article  Google Scholar 

  • Wilkinson, D., Zhang, J., Byrne, G. J., Luke, H., Ozolins, I. Z., Parker, M. H., & Peterson, R. F. (2008). Medical school selection criteria and the prediction of academic performance. Medical Journal of Australia, 188, 349–354.

    Google Scholar 

  • Wilkinson, D., Zhang, J., & Parker, M. (2011). Predictive validity of the undergraduate medicine and health sciences admission test for medical students’ academic performance. Medical Journal of Australia, 194(7), 341–344.

    Google Scholar 

  • Wilkinson, D., Casey, M. G., & Eley, D. S. (2014). Removing the interview for medical school selection is associated with gender bias among enrolled students. Medical Journal of Australia, 200(2), 96–99.

    Article  Google Scholar 

  • Wright, S. R., & Bradley, P. M. (2010). Has the UK clinical aptitude test improved medical student selection? Medical Education, 44(11), 1069–1076.

    Article  Google Scholar 

  • Yates, J., & James, D. (2010). The value of the UK clinical aptitude test in predicting pre-clinical performance: A prospective cohort study at Nottingham Medical School. BMC Medical Education, 10, 55.

    Article  Google Scholar 

Download references

Acknowledgements

The authors wish to sincerely acknowledge the work of the National Research Group Evaluating Revised Entry Mechanisms to Medicine. This paper is based in part on a PhD thesis by M.K., and we acknowledge Professors Andrew Murphy (supervisor) and Fidelma Dunne (co-supervisor).

Author information

Authors and Affiliations

  1. Discipline of General Practice, School of Medicine, Clinical Science Institute, National University of Ireland Galway (NUI Galway), Galway, Ireland

    Maureen E. Kelly

  2. Medical Education Unit, Medical School, University College Cork (UCC), Cork, Ireland

    Siun O’Flynn

Authors
  1. Maureen E. Kelly
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Siun O’Flynn
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Maureen E. Kelly.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kelly, M.E., O’Flynn, S. The construct validity of HPAT-Ireland for the selection of medical students: unresolved issues and future research implications. Adv in Health Sci Educ 22, 267–286 (2017). https://doi.org/10.1007/s10459-016-9728-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10459-016-9728-z

Keywords

Search

Navigation