Skip to main content
SpringerLink
Log in

Comparing IM Residency Application Personal Statements Generated by GPT-4 and Authentic Applicants

  • Concise Research Report
  • Published:
Journal of General Internal Medicine Aims and scope Submit manuscript

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Data Availability

The data that support the findings of this study are available, but restrictions apply to the availability of these data as mandated by ERAS (Electronic Residency Application System), which involve individual residency applications and so are not publicly available. This confidential data is available from the authors upon reasonable request and release is contingent upon permission from the Stanford Internal Medicine residency program and Stanford Institutional Review Board.

References

  1. Boscardin CK, Gin B, Golde PB, Hauer KE. ChatGPT and Generative Artificial Intelligence for Medical Education: Potential Impact and Opportunity [published online ahead of print, 2023 Aug 31]. Acad Med. 2023; https://doi.org/10.1097/ACM.0000000000005439.

  2. Nayak A, Alkaitis MS, Nayak K, Nikolov M, Weinfurt KP, Schulman K. Comparison of History of Present Illness Summaries Generated by a Chatbot and Senior Internal Medicine Residents. JAMA Intern Med. Published online July 17, 2023. https://doi.org/10.1001/jamainternmed.2023.2561.

  3. Kung-Yee Liang; Scott Zeger. Longitudinal data analysis using generalized linear models. Biometrika. 1986;73 (1): 13–22., for generalized estimating equations.

    Article  Google Scholar 

  4. Johnstone RE, Neely G, Sizemore DC. Artificial intelligence software can generate residency application personal statements that program directors find acceptable and difficult to distinguish from applicant compositions. J Clin Anesth. 2023;89:111185. https://doi.org/10.1016/j.jclinane.2023.111185

    Article  PubMed  Google Scholar 

  5. Patel V, Deleonibus A, Wells MW, Bernard SL, Schwarz GS. Distinguishing Authentic Voices in the age of ChatGPT: Comparing AI-Generated and Applicant-Written Personal Statements for Plastic Surgery Residency Application. Ann Plast Surg. 2023;91(3):324-325. https://doi.org/10.1097/SAP.0000000000003653

    Article  CAS  PubMed  Google Scholar 

  6. Woodfin MW. The Personal Statement in the Age of Artificial Intelligence. Acad Med. 2023;98(8):869. https://doi.org/10.1097/ACM.0000000000005266

    Article  PubMed  Google Scholar 

  7. Omiye, J.A., Lester, J.C., Spichak, S., et al. Large language models propagate race-based medicine. npj Digit. Med. 6, 195 (2023). https://doi.org/10.1038/s41746-023-00939-z

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Medicine, Stanford University School of Medicine, Stanford, CA, USA

    Vishnu Nair MD

  2. Division of Hospital Medicine, Stanford University School of Medicine, Stanford, CA, USA

    Ashwin Nayak MD MS, Neera Ahuja MD, Kevin Keet MD, Poonam Hosamani MD & Jason Hom MD

  3. Quantitative Sciences Unit, Stanford University, Stanford, CA, USA

    Yingjie Weng MHS

Authors
  1. Vishnu Nair MD
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ashwin Nayak MD MS
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Neera Ahuja MD
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yingjie Weng MHS
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Kevin Keet MD
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Poonam Hosamani MD
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Jason Hom MD
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vishnu Nair MD.

Ethics declarations

Conflict of Interest

We confirm that all listed authors have no conflicts of interest to disclose.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nair, V., Nayak, A., Ahuja, N. et al. Comparing IM Residency Application Personal Statements Generated by GPT-4 and Authentic Applicants. J GEN INTERN MED (2024). https://doi.org/10.1007/s11606-024-08784-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11606-024-08784-w

Search

Navigation