Abstract
Introduction
The Substance Abuse and Mental Health Services Agency (SAMHSA) recognizes Screening, Brief Intervention, and Referral to Treatment (SBIRT) as a comprehensive approach to identify individuals with or at risk of developing substance use disorders. Few studies have explored tools for assessing medical student SBIRT competencies.
Methods
First-year medical students trained in SBIRT and Motivational Interviewing completed an Objective Structured Clinical Encounter (OSCE) with a standardized patient who presented with substance use. Six trained members of our research team reviewed 118 OSCE videos utilizing the Clinical SBIRT Proficiency Checklist (CSPC); additionally 30% (n = 37) were randomly selected for pair-review to examine interrater reliability.
Results
Interrater reliability was Cohen’s kappa of 0.89 for the presence of SBIRT skills and 0.39 agreement for the absence of skills. Across the videos, the most commonly observed skill was screening for alcohol use (75.4%, 95%CI 66.5, 84.3), while organizing referral for treatment was infrequently observed (36.4%, 95% CI 22.0, 50.8).
Conclusions
The CSPC is a reliable tool for assessing medical student SBIRT skills on an OSCE. These findings provide insights on medical student SBIRT knowledge and provides a practical tool for providing early clinically relevant feedback on these skills.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Gryczynski J, Schwartz RP, O'Grady KE, Restivo L, Mitchell SG, Jaffe JH. Understanding patterns of high-cost health care use across different substance user groups. Health Aff (Millwood). 2016;35(1):12–9.
Centers for Disease Control and Prevention (CDC). Alcohol and Public Health: Alcohol-Related Disease Impact (ARDI). Average for United States 2006–2010 Alcohol-Attributable Deaths Due to Excessive Alcohol Use. [Available from: https://nccd.cdc.gov/DPH_ARDI/Default/Report.aspx?T=AAM&P=f6d7eda7-036e-4553-9968-9b17ffad620e&R=d7a9b303-48e9-4440-bf47-070a4827e1fd&M=8E1C5233-5640-4EE8-9247-1ECA7DA325B9&F=&D=.
Aldridge A, Linford R, Bray J. Substance use outcomes of patients served by a large US implementation of Screening, Brief Intervention and Referral to Treatment (SBIRT). Addiction. 2017;112(Suppl 2):43–53.
Bray JW, Del Boca FK, McRee BG, Hayashi SW, Babor TF. Screening, Brief Intervention and Referral to Treatment (SBIRT): rationale, program overview and cross-site evaluation. Addiction. 2017;112(Suppl 2):3–11.
Babor TF, McRee BG, Kassebaum PA, Grimaldi PL, Ahmed K, Bray J. Screening, brief intervention, and referral to treatment (SBIRT): toward a public health approach to the management of substance abuse. Subst Abus. 2007;28(3):7–30.
Wamsley M, Satterfield JM, Curtis A, Lundgren L, Satre DD. Alcohol and drug screening, brief intervention, and referral to treatment (SBIRT) training and implementation: perspectives from 4 health professions. J Addict Med. 2018;12(4):262–72.
D'Onofrio G, Degutis LC. Preventive care in the emergency department: screening and brief intervention for alcohol problems in the emergency department: a systematic review. Acad Emerg Med. 2002;9(6):627–38.
Kaner EF, Beyer F, Dickinson HO, Pienaar E, Campbell F, Schlesinger C, et al. Effectiveness of brief alcohol interventions in primary care populations. Cochrane Database Syst Rev. 2007(2):CD004148.
Pringle JL, Seale JP, Shellenberger S, Grasso KM, Kowalchuk A, Laufman L, et al. Development and evaluation of two instruments for assessing screening, brief intervention, and referral to treatment (SBIRT) competency. Subst Abus. 2017;38(1):43–7.
Miller WR, Rose GS. Motivational interviewing in relational context. Am Psychol. 2010;65(4):298–9.
Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20:37–46.
Campiñez Navarro M, Pérula de Torres LÁ, Bosch Fontcuberta JM, Barragán Brun N, Arbonies Ortiz JC, Novo Rodríguez JM, et al. Measuring the quality of motivational interviewing in primary health care encounters: the development and validation of the motivational interviewing assessment scale (MIAS). Euro J GenPract. 2016;22(3):182–8.
Funding
This work was supported by SAMHSA grant funding (5H79TI025950).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no conflict of interest.
Ethical Approval
This work was determined by Brown University to not meet the regulatory definition of human subjects research according to the definition of Research provided in Title 45 CFR Part.46.102(f) because the primary purpose is program development/improvement. This work was carried out in accordance with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed Consent
Informed consent is not applicable in this type of study.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Rougas, S., Bromberg, J.R., Nimaja, E. et al. Reliability of the Clinical SBIRT Proficiency Checklist for Medical Students. Med.Sci.Educ. 29, 1013–1016 (2019). https://doi.org/10.1007/s40670-019-00795-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40670-019-00795-1