Abstract
Objectives
Podcasts have emerged as an efficient method for widespread delivery of educational clinical reasoning (CR) content. However, the impact of such podcasts on CR skills has not been established. We set out to determine whether exposure to expert reasoning in a podcast format leads to enhanced CR skills.
Methods
This is a pseudo-randomized study of third-year medical students (MS3) to either a control group (n=22) of pre-established online CR modules, or intervention group (n=26) with both the online modules and novel CR podcasts. The podcasts were developed from four “clinical unknown” cases presented to expert clinician educators. After completing these assignments in weeks 1–2, weekly history and physical (H&P) notes were collected and graded according to the validated IDEA rubric between weeks 3–7. A longitudinal regression model was used to compare the H&P IDEA scores over time. Usage and perception of the podcasts was also assessed via survey data.
Results
Ninety control and 128 intervention H&Ps were scored. There was no statistical difference in the change of average IDEA scores between intervention (0.92, p=0.35) and control groups (−0.33, p=0.83). Intervention participants positively received the podcasts and noted increased discussion of CR principles from both their ward (3.1 vs. 2.4, p=0.08) and teaching (3.2 vs. 2.5, p=0.05) attendings.
Conclusions
This is the first objective, pseudo-randomized assessment of CR podcasts in undergraduate medical education. While we did not demonstrate significant improvement in IDEA scores, our data show that podcasts are a well-received tool that can prime learners to recognize CR principles.
Funding source: Department of General Internal Medicine Educational Grant, University of Pittsburgh School of Medicine
Acknowledgments
Drs. Andrea Carter and Melissa McNeil for their expert contributions to the podcast production. Dr. Tom Painter for his role in facilitating clerkship logistics.
-
Research funding: University of Pittsburgh DGIM educational grant for funding support.
-
Author contributions: RA: research design, implementation, H&P grading, analysis, manuscript writing. MS: H&P grading. SR & CL: statistical analysis. EB, DJ, ST: research design, implementation, analysis, manuscript editing. All authors have accepted responsibility for the entire content of this manuscript and approved its submission.
-
Competing interests: Authors state no conflict of interest.
-
Informed consent: All participants were notified of the voluntary and anonymous nature of this study.
-
Ethical approval: The local Institutional Review Board and medical school curriculum committee deemed the study exempt from review.
References
1. Institute of Medicine (US) Committee on Quality of Health Care in America. In: Kohn, LT, Corrigan, JM, Donaldson, MS, editors. To err is human: building a safer Health System. Washington (DC): National Academies Press (US); 2000.Search in Google Scholar
2. Committee on Diagnostic Error in Health Care; Board on Health Care Services; Institute of Medicine; The National Academies of Sciences, Engineering, and Medicine. In: Balogh, EP, Miller, BT, Ball, JR, editors. Improving diagnosis in health care. Washington (DC): National Academies Press (US); 2015.Search in Google Scholar
3. Thampy, H, Willert, E, Ramani, S. Assessing clinical reasoning: targeting the higher levels of the pyramid. J Gen Intern Med 2019;34:1631–6. https://doi.org/10.1007/s11606-019-04953-4.Search in Google Scholar PubMed PubMed Central
4. Thammasitboon, S, Rencic, JJ, Trowbridge, RL, Olson, APJ, Sur, M, Dhaliwal, G. The Assessment of Reasoning Tool (ART): structuring the conversation between teachers and learners. Diagnosis (Berl) 2018;5:197–203. https://doi.org/10.1515/dx-2018-0052.Search in Google Scholar PubMed
5. Rencic, J, Trowbridge, RL, Fagan, M, Szauter, K, Durning, S. Clinical Reasoning Education at US Medical Schools: Results from a National Survey of Internal Medicine clerkship directors. J Gen Intern Med 2017;32:1242–6. https://doi.org/10.1007/s11606-017-4159-y.Search in Google Scholar PubMed PubMed Central
6. Mayer, RE, Alexander, PA, editors. Introduction to research on learning. In: Handbook of research on learning and instruction. London: Routledge; 2011:17–20 pp.10.4324/9780203839089-9Search in Google Scholar
7. Dyer, J-O, Hudon, A, Montpetit-Tourangeau, K, Charlin, B, Mamede, S, van Gog, T. Example-based learning: comparing the effects of additionally providing three different integrative learning activities on physiotherapy intervention knowledge. BMC Med Educ 2015;15:37. https://doi.org/10.1186/s12909-015-0308-3.Search in Google Scholar PubMed PubMed Central
8. Kassirer, JP. Teaching clinical reasoning: case-based and coached. Acad Med 2010;85:1118–24. https://doi.org/10.1097/acm.0b013e3181d5dd0d.Search in Google Scholar PubMed
9. Manesh, R, Dhaliwal, G. Digital tools to enhance clinical reasoning. Med Clin North Am 2018;102:559–65. https://doi.org/10.1016/j.mcna.2017.12.015.Search in Google Scholar PubMed
10. Cho, D, Cosimini, M, Espinoza, J. Podcasting in medical education: a review of the literature. Kor J Med Educ 2017;29:229–39. https://doi.org/10.3946/kjme.2017.69.Search in Google Scholar PubMed PubMed Central
11. Lomayesva, NL, Martin, AS, Dowley, PA, Davies, NW, Olyha, SJ, Wijesekera, TP. Five medical education podcasts you need to know. Yale J Biol Med 2020;93:461–6.Search in Google Scholar
12. Riddell, J, Swaminathan, A, Lee, M, Mohamed, A, Rogers, R, Rezaie, SR. A survey of emergency medicine residents’ use of educational podcasts. West J Emerg Med 2017;18:229–34. https://doi.org/10.5811/westjem.2016.12.32850.Search in Google Scholar PubMed PubMed Central
13. Chin, A, Helman, A, Chan, TM. Podcast use in undergraduate medical education. Cureus 2017;9:e1930. https://doi.org/10.7759/cureus.1930.Search in Google Scholar PubMed PubMed Central
14. Lien, K, Chin, A, Helman, A, Chan, TM. A randomized comparative trial of the knowledge retention and usage conditions in undergraduate medical students using podcasts and blog posts. Cureus 2018;10:e2065. https://doi.org/10.7759/cureus.2065.Search in Google Scholar PubMed PubMed Central
15. The Clinical Problem Solvers – Sharing expert opinion in diagnostic reasoning. https://clinicalproblemsolving.com/ [Accessed 18 Jul 2021].Search in Google Scholar
16. Morning Report – The Podcast. http://www.morningreport-podcast.com/ [Accessed 18 Jul 2021].Search in Google Scholar
17. Augustin, RC, Bonifacino, E, Tilstra, SA. Morning report for all: the use of podcasts to disseminate clinical reasoning tools. Med Educ 2019;53:1150. https://doi.org/10.1111/medu.13964.Search in Google Scholar PubMed
18. Ow, GM, Shipley, LC, Nematollahi, S, Stetson, GV. Morning report for all: a qualitative study of disseminating case conferences via podcasting. BMC Med Educ 2021;21:392. https://doi.org/10.1186/s12909-021-02799-1.Search in Google Scholar PubMed PubMed Central
19. Bonifacino, E, Follansbee, WP, Farkas, AH, Jeong, K, McNeil, MA, DiNardo, DJ. Implementation of a clinical reasoning curriculum for clerkship-level medical students: a pseudo-randomized and controlled study. Diagnosis (Berl) 2019;6:165–72. https://doi.org/10.1515/dx-2018-0063.Search in Google Scholar PubMed
20. Baker, EA, Ledford, CH, Fogg, L, Way, DP, Park, YS. The IDEA assessment tool: assessing the Reporting, diagnostic Reasoning, and decision-Making Skills demonstrated in Medical Students’ hospital admission Notes. Teach Learn Med 2015;27:163–73. https://doi.org/10.1080/10401334.2015.1011654.Search in Google Scholar PubMed
21. Trowbridge, RL, Dhaliwal, G, Cosby, KS. Educational agenda for diagnostic error reduction. BMJ Qual Saf 2013;22:ii28–ii32. https://doi.org/10.1136/bmjqs-2012-001622.Search in Google Scholar PubMed PubMed Central
22. Amey, L, Donald, KJ, Teodorczuk, A. Teaching clinical reasoning to medical students. Br J Hosp Med (Lond) 2017;78:399–401. https://doi.org/10.12968/hmed.2017.78.7.399.Search in Google Scholar PubMed
23. Graber, ML, Franklin, N, Gordon, R. Diagnostic error in internal medicine. Arch Intern Med 2005;165:1493–9. https://doi.org/10.1001/archinte.165.13.1493.Search in Google Scholar PubMed
24. Linn, A, Khaw, C, Kildea, H, Tonkin, A. Clinical reasoning - a guide to improving teaching and practice. Aust Fam Physician 2012;41:18–20.Search in Google Scholar
25. Roth, J, Chang, A, Ricci, B, Hall, M, Mehta, N. Why not a podcast? assessing narrative audio and written curricula in obstetrical neurology. J Grad Med Educ 2020;12:86–91. https://doi.org/10.4300/JGME-D-19-00505.1.Search in Google Scholar PubMed PubMed Central
26. Englander, R, Flynn, T, Call, S, Carraccio, C, Cleary, L, Fulton, TB, et al.. Toward defining the foundation of the MD degree: core entrustable professional activities for entering residency. Acad Med 2016;91:1352–8. https://doi.org/10.1097/ACM.0000000000001204.Search in Google Scholar PubMed
27. Daniel, M, Rencic, J, Durning, SJ, Holmboe, E, Santen, SA, Lang, V, et al.. Clinical reasoning assessment methods: a scoping review and practical guidance. Acad Med 2019;94:902–12. https://doi.org/10.1097/ACM.0000000000002618.Search in Google Scholar PubMed
28. Anderson, LW, Krathwohl, DR. A taxonomy for learning, teaching, and assessing: a revision of Bloom’s taxonomy of educational objectives, abridged edition. London: Pearson; 2000.Search in Google Scholar
29. Choudhury, B, Gouldsborough, I, Shaw, FL. The intelligent anatomy spotter: a new approach to incorporate higher levels of Bloom’s taxonomy. Anat Sci Educ 2016;9:440–5. https://doi.org/10.1002/ase.1588.Search in Google Scholar PubMed
30. Freeman, S, Eddy, SL, McDonough, M, Smith, MK, Okoroafor, N, Jordt, H, et al.. Active learning increases student performance in science, engineering, and mathematics. Proc Natl Acad Sci USA 2014;111:8410–5. https://doi.org/10.1073/pnas.1319030111.Search in Google Scholar PubMed PubMed Central
31. Thompson, BM, Schneider, VF, Haidet, P, Levine, RE, McMahon, KK, Perkowski, LC, et al.. Team-based learning at ten medical schools: two years later. Med Educ 2007;41:250–7. https://doi.org/10.1111/j.1365-2929.2006.02684.x.Search in Google Scholar PubMed
32. Koles, PG, Stolfi, A, Borges, NJ, Nelson, S, Parmelee, DX. The impact of team-based learning on medical students’ academic performance. Acad Med 2010;85:1739–45. https://doi.org/10.1097/ACM.0b013e3181f52bed.Search in Google Scholar PubMed
33. Renkl, A. Toward an instructionally oriented theory of example-based learning. Cogn Sci 2014;38:1–37. https://doi.org/10.1111/cogs.12086.Search in Google Scholar PubMed
34. Dhaliwal, G, Ilgen, J. Clinical reasoning: talk the talk or just walk the walk? J Grad Med Educ 2016;8:274–6. https://doi.org/10.4300/JGME-D-16-00073.1.Search in Google Scholar PubMed PubMed Central
35. Norman, GR, Monteiro, SD, Sherbino, J, Ilgen, JS, Schmidt, HG, Mamede, S. The causes of errors in clinical reasoning: cognitive biases, knowledge deficits, and dual process thinking. Acad Med 2017;92:23–30. https://doi.org/10.1097/ACM.0000000000001421.Search in Google Scholar PubMed
Supplementary Material
The online version of this article offers supplementary material (https://doi.org/10.1515/dx-2021-0136).
© 2022 Walter de Gruyter GmbH, Berlin/Boston