Abstract
Agency leaders and therapists are essential stakeholders in implementation of evidence-based practices (EBPs) within publicly-funded mental health services. Little is known about how these stakeholders differ in their perceptions of specific EBPs and which individual and organizational factors differentially influence these perceptions. Within the context of a system-driven implementation of multiple EBPs, survey data from 160 leaders and 720 therapists were examined to assess differences in perceptions of six EBPs. Findings indicated that leaders and therapists have unique perspectives and preferences regarding EBPs that are shaped by distinct sociodemographic and professional characteristics and aspects of organizational functioning.
Similar content being viewed by others
References
Aarons, G. A. (2004). Mental health provider attitudes toward adoption of evidence-based practice: The Evidence-Based Practice Attitude Scale (EBPAS). Mental Health Services Research, 6(2), 61–74. https://doi.org/10.1023/B:MHSR.0000024351.12294.65.
Aarons, G. A., Cafri, G., Lugo, L., & Sawitzky, A. (2012). Expanding the domains of attitudes towards evidence-based practice: The Evidence-Based Practice Attitude Scale-50. Administration and Policy in Mental Health and Mental Health Services Research, 39(5), 331–340. https://doi.org/10.1007/s10488-010-0302-3.
Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Hurlburt, M. S. (2015). Leadership and Organizational Change for Implementation (LOCI): A randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation. Implementation Science, 10(1), 1–11. https://doi.org/10.1186/s13012-014-0192-y.
Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Sklar, M. (2014). Aligning leadership across systems and organizations to develop a strategic climate for evidence-based practice implementation. Annual Review of Public Health, 35, 255–274. https://doi.org/10.1146/annurev-publhealth-032013-182447.
Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., Sklar, M., & Horowitz, J. (2017). Discrepancies in leader and follower ratings of transformational leadership: Relationship with organizational culture in mental health. Administration and Policy in Mental Health and Mental Health Services Research, 44(4), 480–491.
Aarons, G. A., Ehrhart, M. G., Torres, E. M., Finn, N. K., & Beidas, R. S. (2017). The humble leader: Association of discrepancies in leader and follower ratings of implementation leadership with organizational climate in mental health. Psychiatric Services, 68(2), 115–122. https://doi.org/10.1176/appi.ps.201600062.
Aarons, G. A., Fettes, D. L., Flores Jr, L. E., & Sommerfeld, D. H. (2009). Evidence-based practice implementation and staff emotional exhaustion in children’s services. Behaviour Research and Therapy, 47, 954–960. https://doi.org/10.1016/j.brat.2009.07.006.
Aarons, G. A., Glisson, C., Hoagwood, K., Kelleher, K., Landsverk, J., & Cafri, G. (2010). Psychometric properties and U.S. National norms of the Evidence-Based Practice Attitude Scale (EBPAS). Psychological Assessment, 22(2), 356–365. https://doi.org/10.1037/a0019188.
Aarons, G. A., Green, A. E., Trott, E., Willging, C. E., Torres, E. M., Ehrhart, M. G., & Roesch, S. C. (2016). The roles of system and organizational leadership in system-wide evidence-based intervention sustainment: A mixed-method study. Administration and Policy in Mental Health and Mental Health Services Research, 43, 991–1008. https://doi.org/10.1007/s10488-016-0751-4.
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38, 4–23. https://doi.org/10.1007/s10488-010-0327-7.
Aarons, G. A., & Palinkas, L. A. (2007). Implementation of evidence-based practice in child welfare: Service provider perspectives. Administration and Policy in Mental Health, 34(4), 411–419. https://doi.org/10.1007/s10488-007-0121-3.
Aarons, G. A., & Sawitzky, A. C. (2006). Organizational culture and climate and mental health provider attitudes toward evidence-based practice. Psychological Services, 3, 61–72. https://doi.org/10.1037/1541-1559.3.1.61.
Aarons, G. A., Wells, R. S., Zagursky, K., Fettes, D. L., & Palinkas, L. A. (2009). Implementing evidence-based practice in community mental health agencies: A multiple stakeholder analysis. American Journal of Public Health, 99, 2087–2095. https://doi.org/10.2105/AJPH.2009.161711.
Baker-Ericzen, M. J., Jenkins, M. M., & Haine-Schlagel, R. (2013). Therapist, parent, and youth perspectives of treatment barriers to family-focused community outpatient mental health services. Journal of Child and Family Studies, 22, 854–868. https://doi.org/10.1007/s10826-012-9644-7.
Barnett, M., Brookman-Frazee, L., Regan, J., Saifan, D., Stadnick, N., & Lau, A. (2017). How intervention and implementation characteristics relate to community therapists’ attitudes towards evidence-based practices: A mixed methods study. Administration and Policy in Mental Health and Mental Health Services Research. https://doi.org/10.1007/s10488-017-0795-0.
Beidas, R. S., Stewart, R. E., Adams, D. R., Fernandez, T., Lustbader, S., Powell, B. J., … Barg, F. K. (2016a). A multi-level examination of stakeholder perspectives of implementation of evidence-based practices in a large urban publicly-funded mental health system. Administration and Policy in Mental Health and Mental Health Services Research, 43, 893–908. https://doi.org/10.1007/s10488-015-0705-2.
Beidas, R. S., Williams, N. J., Green, P. D., Aarons, G. A., Becker-Haimes, E. M., Evans, A. C., … Marcus, S. C. (2016b). Concordance between administrator and clinician ratings of organizational culture and climate. Administration and Policy in Mental Health and Mental Health Services Research. https://doi.org/10.1007/s10488-016-0776-8.
Bonham, C. A., Sommerfeld, D., Willging, C., & Aarons, G. A. (2014). Organizational factors influencing implementation of evidence-based practices for integrated treatment in behavioral health agencies. Psychiatry Journal, 2014, 1–9. https://doi.org/10.1155/2014/802983.
Borntrager, C. F., Chorpita, B. F., Higa-McMillan, C., & Weisz, J. R. (2009). Provider attitudes toward evidence-based practices: Are the concerns with the evidence or with the manuals? Psychiatric Services, 60, 677–681. https://doi.org/10.1176/appi.ps.60.5.677.
Brimhall, K. C., Fenwick, K., Farahnak, L. R., Hurlburt, M. S., Roesch, S. C., & Aarons, G. A. (2015). Leadership, organizational climate, and perceived burden of evidence-based practice in mental health services. Administration and Policy in Mental Health and Mental Health Services Research, 43, 629–639. https://doi.org/10.1007/s10488-015-0670-9.
Brookman-Frazee, L., Drahota, A., Stadnick, N., & Palinkas, L. A. (2012). Therapist perspectives on community mental health services for children with autism spectrum disorders. Administration and Policy in Mental Health and Mental Health Services Research, 39, 365–373. https://doi.org/10.1007/s10488-011-0355-y.
Brookman-Frazee, L., Stadnick, N., Roesch, S., Regan, J., Barnett, M., Innes-Gomberg, D., Bando, L., & Lau, A. (2016). Measuring sustainment of multiple practices fiscally mandated in children’s mental health services. Administration and Policy in Mental Health and Mental Health Services Research, 43(6), 1009–1022. https://doi.org/10.1007/s10488-016-0731-8.
Brookman-Frazee, L., Taylor, R., & Garland, A. F. (2010). Characterizing community-based mental health services for children with autism spectrum disorders and disruptive behavior problems. Journal of Autism and Developmental Disorders, 40, 1188–1201. https://doi.org/10.1007/s10803-010-0976-0.
Cashel, M. L. (2002). Child and adolescent psychological assessment: Current clinical practices and the impact of managed care. Professional Psychology: Research and Practice, 33, 446–453.
Chorpita, B. F., Bernstein, A., & Daleiden, E. L. (2011). Empirically guided coordination of multiple evidence-based treatments: An illustration of relevance mapping in children’s mental health services. Journal of Consulting and Clinical Psychology, 79, 470–480. https://doi.org/10.1037/a0023982.
Chorpita, B. F., Daleiden, E. L., & Collins, K. S. (2014). Managing and adapting practice: A system for applying evidence in clinical care with youth and families. Clinical Social Work Journal, 42, 134–142. https://doi.org/10.1007/s10615-013-0460-3.
Cohen, J. A., Mannarino, A. P., & Deblinger, E. (2006). Treating trauma and traumatic grief in children and adolescents. New York: The Guilford Press.
Cook, J. M., Thompson, R., & Schnurr, P. P. (2015). Perceived Characteristics of Intervention Scale: Development and psychometric properties. Assessment, 22, 704–714. https://doi.org/10.1177/1073191114561254.
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4(50), 1–15. https://doi.org/10.1186/1748-5908-4-50.
Drahota, A., Stadnick, N., & Brookman-Frazee, L. (2014). Therapist perspectives on training in a package of evidence-based practice strategies for children with autism spectrum disorders served in community mental health clinics. Administration and Policy in Mental Health and Mental Health Services Research, 41, 114–125. https://doi.org/10.1007/s10488-012-0441-9.
Gibson, C. B., Cooper, C. D., & Conger, J. A. (2009). Do you see what we see? The complex effects of perceptual distance between leaders and teams. Journal of Applied Psychology, 94, 62–76. https://doi.org/10.1037/a0013073.
Glisson, C. (2002). The organizational context of children’s mental health services. Clinical Child and Family Psychology Review, 5(4), 233–253. https://doi.org/10.1023/A:1020972906177.
Glisson, C., Dukes, D., & Green, P. (2006). The effects of the ARC organizational intervention on caseworker turnover, climate, and culture in children’s service systems. Child Abuse and Neglect, 30, 855–880. https://doi.org/10.1016/j.chiabu.2005.12.010.
Glisson, C., & Green, P. (2011). Organizational climate, services, and outcomes in child welfare systems. Child Abuse and Neglect, 35, 582–591. https://doi.org/10.1016/j.chiabu.2011.04.009.
Glisson, C., Green, P., & Williams, N. J. (2012). Assessing the Organizational Social Context (OSC) of child welfare systems: Implications for research and practice. Child Abuse and Neglect, 36, 621–632. https://doi.org/10.1016/j.chiabu.2012.06.002.
Glisson, C., Landsverk, J., Schoenwald, S., Kelleher, K., Hoagwood, K. E., Mayberg, S., & Green, P. (2008). Assessing the organizational social context (OSC) of mental health services: Implications for research and practice. Administration and Policy in Mental Health, 35, 98–113. https://doi.org/10.1007/s10488-007-0148-5.
Gray, M. J., Elhai, J. D., & Schmidt, L. O. (2007). Trauma professionals’ attitudes toward and utilization of evidence-based practices. Behavior Modification, 31, 732–748. https://doi.org/10.1177/0145445507302877.
Greenhalgh, T., Robert, G., Macfarlane, F., Bate, P., & Kyriakidou, O. (2004). Diffusion of innovations in service organizations: Systematic review and recommendations. Milbank Quarterly, 82, 581–629. https://doi.org/10.1111/j.0887-378X.2004.00325.x.
Hasson, H., von Thiele Schwarz, U., Nielsen, K., & Tafvelin, S. (2016). Are we all in the same boat? The role of perceptual distance in organizational health interventions. Stress and Health, 32, 294–303. https://doi.org/10.1002/smi.2703.
Hawley, K. M., Cook, J. R., & Jensen-Doss, A. (2009). Do noncontingent incentives increase survey response rates among mental health providers? A randomized trial comparison. Administration and Policy in Mental Health and Mental Health Services Research, 36, 343–348. https://doi.org/10.1007/s10488-009-0225-z.
Health Service Psychology Education Collaborative. (2013). Professional psychology in health care services: A blueprint for education and training. The American Psychologist, 68(6), 411–426. https://doi.org/10.1037/a0033265.
Henggeler, S. W., Chapman, J. E., Rowland, M. D., Halliday-Boykins, C. A., Randall, J., Shackelford, J., & Schoenwald, S. K. (2008). Statewide adoption and initial implementation of contingency management for substance-abusing adolescents. Journal of Consulting and Clinical Psychology, 76(4), 556–567. https://doi.org/10.1037/0022-006x.76.4.556.
Hoagwood, K. E., Olin, S. S., Horwitz, S., McKay, M., Cleek, A., Gleacher, A., … Hogan, M. (2014). Scaling up evidence-based practices for children and families in New York State: Toward evidence-based policies on implementation for state mental health systems. Journal of Clinical Child and Adolescent Psychology, 43, 145–157. https://doi.org/10.1080/15374416.2013.869749.
Jaycox, L. H. (2003). CBITS: Cognitive behavioral intervention in schools. Dallas: Sopris West.
Klein, K. J., & Sorra, J. S. (1996). The challenge of innovation implementation. The Academy of Management Review, 21, 1055–1080. https://doi.org/10.2307/259164.
Lehman, W. E. K., Greener, J. M., & Simpson, D. D. (2002). Assessing organizational readiness for change. Journal of Substance Abuse Treatment, 22, 197–209. https://doi.org/10.1016/S0740-5472(02)00233-7.
Lieberman, A. F., & Van Horn, P. (2005). Don’t hit my mommy!: A manual for child-parent psychotherapy with young witnesses of family violence. Washington, DC: Zero to Three.
Los Angeles County Department of Mental Health. (2016). Training protocols for Prevention and Early Intervention practices. Retrieved from http://file.lacounty.gov/SDSInter/dmh/201947_PEITrainingProtocolsrevised4-1-16.pdf.
Martin, A. J., Jones, E. S., & Callan, V. J. (2006). Status differences in employee adjustment during organizational change. Journal of Managerial Psychology, 21(2), 145–162. https://doi.org/10.1108/02683940610650758.
McHugh, R. K., & Barlow, D. H. (2010). The dissemination and implementation of evidence-based psychological treatments. A review of current efforts. American Psychologist, 65, 73–84. https://doi.org/10.1037/a0018121.
Najavits, L. M. (2002). Seeking safety: A treatment manual for PTSD and substance abuse. New York: Guilford Press.
Nakamura, B. J., Mueller, C. W., Higa-McMillan, C., Okamura, K. H., Chang, J. P., Slavin, L., & Shimabukuro, S. (2014). Engineering youth service system infrastructure: Hawaii’s continued efforts at large-scale implementation through knowledge management strategies. Journal of Clinical Child and Adolescent Psychology, 43, 179–189. https://doi.org/10.1080/15374416.2013.812039.
Olin, S. S., Williams, N., Pollock, M., Armusewicz, K., Kutash, K., Glisson, C., & Hoagwood, K. E. (2014). Quality indicators for family support services and their relationship to organizational social context. Administration and Policy in Mental Health and Mental Health Services Research, 41(1), 43–54.
Ostroff, C., Atwater, L. E., & Feinberg, B. J. (2004). Understanding self-other agreement: A look at rater and rate characteristics, context, and outcomes. Personnel Psychology, 57(2), 333–375.
Palinkas, L. A., Aarons, G. A., Horwitz, S., Chamberlain, P., Hurlburt, M., & Landsverk, J. (2011). Mixed method designs in implementation research. Administration and Policy in Mental Health and Mental Health Services Research, 38, 44–53. https://doi.org/10.1007/s10488-010-0314-z.
Patterson, M. G., West, M. A., Shackleton, V. J., Dawson, J. F., Lawthom, R., Maitlis, S., … Wallace, A. M. (2005). Validating the organizational climate measure: Links to managerial practices, productivity and innovation. Journal of Organizational Behavior, 26, 379–408. https://doi.org/10.1002/job.312.
Peterson, A. E., Bond, G. R., Drake, R. E., McHugo, G. J., Jones, A. M., & Williams, J. R. (2014). Predicting the long-term sustainability of evidence-based practices in mental health care: An 8-year longitudinal analysis. Journal of Behavioral Health Services and Research, 41, 337–346. https://doi.org/10.1007/s11414-013-9347-x.
Piotrowski, C., & Keller, J. W. (1989). Psychological testing in outpatient mental health facilities: A national study. Professional Psychology: Research and Practice, 20, 423.
Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88, 879–903. https://doi.org/10.1037/0021-9010.88.5.879.
Proctor, E. K., Knudsen, K. J., Fedoravicius, N., Hovmand, P., Rosen, A., & Perron, B. (2007). Implementation of evidence-based practice in community behavioral health: Agency director perspectives. Administration and Policy in Mental Health and Mental Health Services Research, 34, 479–488. https://doi.org/10.1007/s10488-007-0129-8.
Proctor, E. K., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., … Hensley, M. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38, 65–76. https://doi.org/10.1007/s10488-010-0319-7.
Reding, M. E., Chorpita, B. F., Lau, A. S., & Innes-Gomberg, D. (2014). Providers’ attitudes toward evidence-based practices: Is it just about providers, or do practices matter, too? Administration and Policy in Mental Health and Mental Health Services Research, 41, 767–776. https://doi.org/10.1007/s10488-013-0525-1.
Rogers, E. M. (1962). Diffusion of innovations (5th edn.). New York: Free Press.
Rosenberg, R. P., & Beck, S. (1986). Preferred assessment methods and treatment modalities for hyperactive children among clinical child and school psychologists. Journal of Clinical Child Psychology, 15, 142–147.
Rotheram-Borus, M. J., Swendeman, D., & Becker, K. D. (2014). Adapting evidence-based interventions using a common theory, practices, and principles. Journal of Clinical Child and Adolescent Psychology, 43, 229–243. https://doi.org/10.1080/15374416.2013.836453.
Schein, E. H. (2010). Organizational culture and leadership (Vol. 2). San Francisco: Wiley.
Southam-Gerow, M. A., Daleiden, E. L., Chorpita, B. F., Bae, C., Mitchell, C., Faye, M., & Alba, M. (2014). MAPping Los Angeles County: Taking an evidence-informed model of mental health care to scale. Journal of Clinical Child and Adolescent Psychology, 43, 190–200. https://doi.org/10.1080/15374416.2013.833098.
Starin, A. C., Atkins, M. S., Wehrmann, K. C., Mehta, T., Hesson-McInnis, M. S., Marinez-Lora, A., & Mehlinger, R. (2014). Moving science into state child and adolescent mental health systems: Illinois’ evidence-informed practice initiative. Journal of Clinical Child and Adolescent Psychology, 43, 169–178. https://doi.org/10.1080/15374416.2013.848772.
Tabak, R. G., Khoong, E. C., Chambers, D. A., & Brownson, R. C. (2012). Bridging research and practice: Models for dissemination and implementation research. American Journal of Preventive Medicine, 43, 337–350. https://doi.org/10.1016/j.amepre.2012.05.024.
Thornton, G. C. (1980). Psychometric properties of self-appraisals of job performance. Personnel Psychology, 33(2), 263–271.
Trupin, E., & Kerns, S. (2015). Introduction to the special issue: Legislation related to children’s evidence-based practice. Administration and Policy in Mental Health and Mental Health Services Research. https://doi.org/10.1007/s10488-015-0666-5.
Turner, K. M., Markie-Dadds, C., & Sanders, M. R. (2002). Facilitator’s manual for group Triple P (Rev. Ed.). Brisbane, QLD: Triple P International.
Willenbring, M. L., Kivlahan, D., Kenny, M., Grillo, M., Hagedorn, H., & Postier, A. (2004). Beliefs about evidence-based practices in addiction treatment: A survey of Veterans Administration program leaders. Journal of Substance Abuse Treatment, 26, 79–85.
Williams, N. J., & Glisson, C. (2014). Testing a theory of organizational culture, climate and youth outcomes in child welfare systems: A United States national study. Child Abuse & Neglect, 38(4), 757–767.
Williams, N. J., Glisson, C., Hemmelgarn, A., & Green, P. (2017). Mechanisms of change in the ARC organizational strategy: Increasing mental health clinicians’ EBP adoption through improved organizational culture and capacity. Administration and Policy in Mental Health and Mental Health Services Research, 44(2), 269–283.
Wolf, D. A. P. S., Dulmus, C., Maguin, E., Keesler, J., & Powell, B. (2014). Organizational leaders’ and staf members’ appraisals of their work environment within a children’s social service system. Human Service Organizations Management Leadership & Governance, 38(3), 215–227. https://doi.org/10.1080/23303131.2014.884032.
Zyphur, M. J., Zammuto, R. F., & Zhang, Z. (2016). Multilevel latent polynomial regression for modeling (in)congruence across organizational groups: The case of organizational culture research. Organizational Research Methods, 19(1), 53–79. https://doi.org/10.1177/1094428115588570.
Funding
This study was funded by the National Institute of Mental Health (R01 MH100134).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors have no conflicts of interest to disclose.
Ethical Approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed Consent
Informed consent was obtained from all individual participants included in the study.
Rights and permissions
About this article
Cite this article
Stadnick, N.A., Lau, A.S., Barnett, M. et al. Comparing Agency Leader and Therapist Perspectives on Evidence-Based Practices: Associations with Individual and Organizational Factors in a Mental Health System-Driven Implementation Effort. Adm Policy Ment Health 45, 447–461 (2018). https://doi.org/10.1007/s10488-017-0835-9
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10488-017-0835-9