Skip to main content

Advertisement

SpringerLink
Log in

The Interaction Between General and Strategic Leadership and Climate on Their Multilevel Associations with Implementer Attitudes Toward Universal Prevention Programs for Youth Mental Health: A Cross-Sectional Study

  • Original Article
  • Published:
Administration and Policy in Mental Health and Mental Health Services Research Aims and scope Submit manuscript

Abstract

Emerging literature has highlighted the importance of discerning general and strategic organizational context (OC) factors (e.g., leadership and climate) and their interaction effect on individual implementation behaviors (e.g., attitudes toward evidence-based practices; EBPs) in youth mental healthcare. This study aimed to examine how leadership and climate (general and strategic) are associated with implementer attitudes toward EBPs across the individual and organizational levels and their interaction effect in schools. A series of multilevel models (MLMs) were fitted on a diverse sample of schools actively implementing universal prevention programs for youth mental health (441 implementers from 52 schools). The organization-level aggregates and individual educators’ perceptions of general and strategic leadership and climate, and their interaction terms, were entered as level-2 and level-1 predictors of four attitudinal dimensions (Requirement, Openness, Appeal, and Divergence) based on their level of measurement. At the organizational level, higher levels of strategic leadership and climate, but not their general counterparts, were consistently associated with more favorable attitudes in all four dimensions. At the individual/within-school level, higher levels of perceived general and strategic leadership and climate were associated with more favorable attitudes of Requirement and Openness. At the organizational/between-school level, general climate moderated the positive effect of strategic climate on implementers’ perception of appeal and divergence of EBPs. Our findings indicate that leaders should make data-based decisions to allocate resources on strategic and/or general leadership and climate to foster favorable staff attitudes toward EBPs based on the level of measurement, implementation-specificity, and attitudinal dimensions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Data Availability

The de-identified datasets generated and analyzed during the current study are available in the Open Science Framework [OSF.IO/9X4TE].

References

  • Aarons, G. A. (2004). Mental health provider attitudes toward adoption of evidence-based practice: The Evidence-Based Practice Attitude Scale (EBPAS). Mental Health Services Research, 6(2), 61–74.

    Article  PubMed  PubMed Central  Google Scholar 

  • Aarons, G. A., Cafri, G., Lugo, L., & Sawitzky, A. (2012a). Expanding the domains of attitudes towards evidence-based practice: The evidence-based practice attitude scale-50. Administration and Policy in Mental Health and Mental Health Services Research, 39(5), 331–340.

    Article  PubMed  Google Scholar 

  • Aarons, G. A., Glisson, C., Green, P. D., Hoagwood, K., Kelleher, K. J., & Landsverk, J. A. (2012b). The organizational social context of mental health services and clinician attitudes toward evidence-based practice: A United States study. Implementation Science, 7(1), 1–15.

    Article  Google Scholar 

  • Aarons, G. A., Ehrhart, M. G., & Farahnak, L. R. (2014a). The implementation leadership scale (ILS): Development of a brief measure of unit level implementation leadership. Implementation Science, 9(1), 1–10.

    Article  Google Scholar 

  • Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Sklar, M. (2014b). Aligning leadership across systems and organizations to develop a strategic climate for evidence-based practice implementation. Annual Review of Public Health, 35, 255–274.

    Article  PubMed  PubMed Central  Google Scholar 

  • Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Hurlburt, M. S. (2015). Leadership and organizational change for implementation (LOCI): A randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation. Implementation Science, 10(1), 1–12.

    Article  Google Scholar 

  • Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 4–23.

    Article  PubMed  Google Scholar 

  • Aarons, G. A., McDonald, E. J., Sheehan, A. K., & Walrath-Greene, C. M. (2007). Confirmatory factor analysis of the Evidence-Based Practice Attitude Scale (EBPAS) in a geographically diverse sample of community mental health providers. Administration and Policy in Mental Health and Mental Health Services Research, 34(5), 465–469.

    Article  PubMed  Google Scholar 

  • Aarons, G. A., & Sawitzky, A. C. (2006). Organizational culture and climate and mental health provider attitudes toward evidence-based practice. Psychological Services, 3(1), 61.

    Article  PubMed  PubMed Central  Google Scholar 

  • Ajzen, I. (1991). The theory of planned behavior. Organizational Behavior and Human Decision Processes, 50(2), 179–211.

    Article  Google Scholar 

  • Alin, A. (2010). Multicollinearity. Wiley Interdisciplinary Reviews: Computational Statistics, 2(3), 370–374.

    Article  Google Scholar 

  • Allen, P., Pilar, M., Walsh-Bailey, C., Hooley, C., Mazzucca, S., Lewis, C. C., & Brownson, R. C. (2020). Quantitative measures of health policy implementation determinants and outcomes: A systematic review. Implementation Science, 15(1), 1–17.

    Article  Google Scholar 

  • Avolio, B. J., & Bass, B. M. (1995). Individual consideration viewed at multiple levels of analysis: A multi-level framework for examining the diffusion of transformational leadership. The Leadership Quarterly, 6(2), 199–218.

    Article  Google Scholar 

  • Bandura, A. (1999). Social cognitive theory: An agentic perspective. Asian Journal of Social Psychology, 2(1), 21–41.

    Article  Google Scholar 

  • Bevans, K., Bradshaw, C., Miech, R., & Leaf, P. (2007). Staff-and school-Level predictors of school organizational health: A multilevel analysis. Journal of School Health, 77(6), 294.

    Article  PubMed  Google Scholar 

  • Birken, S. A., & Currie, G. (2021). Using organization theory to position middle-level managers as agents of evidence-based practice implementation. Implementation Science, 16(1), 1–6.

    Google Scholar 

  • Blasius, J., & Brandt, M. (2010). Representativeness in online surveys through stratified samples. Bulletin of Sociological Methodology/Bulletin de Méthodologie Sociologique, 107(1), 5–21.

    Article  Google Scholar 

  • Bliese, P. D. (2000). Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis.

  • Bowden, R. G., Lanning, B. A., Pippin, G., & Tanner, J. F. (2003). Teachers' attitudes towards abstinence-only sex education curricula. Education.

  • Bradshaw, C. P., Koth, C. W., Bevans, K. B., Ialongo, N., & Leaf, P. J. (2008). The impact of school-wide positive behavioral interventions and supports (PBIS) on the organizational health of elementary schools. School Psychology Quarterly, 23(4), 462.

    Article  Google Scholar 

  • Bruns, E. J., Duong, M. T., Lyon, A. R., Pullmann, M. D., Cook, C. R., Cheney, D., & McCauley, E. (2016). Fostering SMART partnerships to develop an effective continuum of behavioral health services and supports in schools. American Journal of Orthopsychiatry, 86(2), 156.

    Article  PubMed  Google Scholar 

  • Brysbaert, M., & Stevens, M. (2018). Power analysis and effect size in mixed effects models: A tutorial. Journal of Cognition, 1(1).

  • Calder, B. J., & Lutz, R. J. (1972). An investigation of some alternatives to the linear attitude model. ACR Special Volumes.

  • Carlson, M. A., Morris, S., Day, F., Dadich, A., Ryan, A., Fradgley, E. A., & Paul, C. (2021). Psychometric properties of leadership scales for health professionals: A systematic review. Implementation Science, 16(1), 1–22.

    Article  Google Scholar 

  • Chaudoir, S. R., Dugan, A. G., & Barr, C. H. (2013). Measuring factors affecting implementation of health innovations: A systematic review of structural, organizational, provider, patient, and innovation level measures. Implementation Science, 8(1), 1–20.

    Article  Google Scholar 

  • Cook, C. R., Davis, C., Brown, E. C., Locke, J., Ehrhart, M. G., Aarons, G. A., & Lyon, A. R. (2018). Confirmatory factor analysis of the Evidence-Based Practice Attitudes Scale with school-based behavioral health consultants. Implementation Science, 13(1), 1–8.

    Article  Google Scholar 

  • Damschroder, L., Hall, C., Gillon, L., Reardon, C., Kelley, C., Sparks, J., & Lowery, J. (2015). The Consolidated Framework for Implementation Research (CFIR): Progress to date, tools and resources, and plans for the future. In Implementation science (Vol. 10, No. 1, pp. 1–1). BioMed Central.

  • Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4(1), 1–15.

    Article  Google Scholar 

  • Damschroder, L. J., Reardon, C. M., Opra Widerquist, M. A., & Lowery, J. (2022). Conceptualizing outcomes for use with the Consolidated Framework for Implementation Research (CFIR): The CFIR Outcomes Addendum. Implementation Science, 17(1), 1–10.

    Article  Google Scholar 

  • de Kok, L. C., Oosting, D., & Spruit, M. (2020). The influence of knowledge and attitude on intention to adopt cybersecure behaviour. Information & Security, 46(3), 251–266.

    Google Scholar 

  • DeJoy, D. M., Wilson, M. G., Vandenberg, R. J., McGrath-Higgins, A. L., & Griffin-Blake, C. S. (2010). Assessing the impact of healthy work organization intervention. Journal of Occupational and Organizational Psychology, 83(1), 139–165.

    Article  Google Scholar 

  • Domitrovich, C. E., Cortes, R. C., & Greenberg, M. T. (2007). Improving young children’s social and emotional competence: A randomized trial of the preschool “PATHS” curriculum. The Journal of Primary Prevention, 28(2), 67–91.

    Article  PubMed  Google Scholar 

  • Domitrovich, C. E., Pas, E. T., Bradshaw, C. P., Becker, K. D., Keperling, J. P., Embry, D. D., & Ialongo, N. (2015). Individual and school organizational factors that influence implementation of the PAX good behavior game intervention. Prevention Science, 16(8), 1064–1074.

    Article  PubMed  Google Scholar 

  • Duong, M. T., Bruns, E. J., Lee, K., Cox, S., Coifman, J., Mayworm, A., & Lyon, A. R. (2021). Rates of mental health service utilization by children and adolescents in schools and other common service settings: A systematic review and meta-analysis. Administration and Policy in Mental Health and Mental Health Services Research, 48(3), 420–439.

    Article  PubMed  Google Scholar 

  • Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41(3), 327–350.

    Article  PubMed  Google Scholar 

  • Durlak, J. A., Weissberg, R. P., Dymnicki, A. B., Taylor, R. D., & Schellinger, K. B. (2011). The impact of enhancing students’ social and emotional learning: A meta-analysis of school-based universal interventions. Child Development, 82(1), 405–432.

    Article  PubMed  Google Scholar 

  • Ehrhart, M. G., Aarons, G. A., & Farahnak, L. R. (2014a). Assessing the organizational context for EBP implementation: The development and validity testing of the Implementation Climate Scale (ICS). Implementation Science, 9, 157.

    Article  PubMed  PubMed Central  Google Scholar 

  • Ehrhart, M. G., Schneider, B., & Macey, W. H. (2014b). Organizational climate and culture: An introduction to theory, research, and practice. Routledge.

    Google Scholar 

  • Fagan, A. A., Bumbarger, B. K., Barth, R. P., Bradshaw, C. P., Cooper, B. R., Supplee, L. H., & Walker, D. K. (2019). Scaling up evidence-based interventions in US public systems to prevent behavioral health problems: Challenges and opportunities. Prevention Science, 20(8), 1147–1168.

    Article  PubMed  PubMed Central  Google Scholar 

  • Farahnak, L. R., Ehrhart, M. G., Torres, E. M., & Aarons, G. A. (2020). The influence of transformational leadership and leader attitudes on subordinate attitudes and implementation success. Journal of Leadership & Organizational Studies, 27(1), 98–111.

    Article  Google Scholar 

  • Fishman, J., Yang, C., & Mandell, D. (2021). Attitude theory and measurement in implementation science: A secondary review of empirical studies and opportunities for advancement. Implementation Science, 16(1), 1–10.

    Article  Google Scholar 

  • Forman, S. G., Shapiro, E. S., Codding, R. S., Gonzales, J. E., Reddy, L. A., Rosenfield, S. A., & Stoiber, K. C. (2013). Implementation science and school psychology. School Psychology Quarterly, 28(2), 77.

    Article  PubMed  Google Scholar 

  • Fromme, K. (1997). Outcome expectancies and risk-taking behavior. Cognitive Therapy and Research, 21(4), 421–442. https://doi.org/10.1023/A:1021932326716

    Article  Google Scholar 

  • Galam, S., & Moscovici, S. (1991). Towards a theory of collective phenomena: Consensus and attitude changes in groups. European Journal of Social Psychology, 21(1), 49–74.

    Article  Google Scholar 

  • Glick, W. H. (1985). Conceptualizing and measuring organizational and psychological climate: Pitfalls in multilevel research. Academy of Management Review, 10(3), 601–616.

    Article  Google Scholar 

  • Godin, G., & Kok, G. (1996). The theory of planned behavior: A review of its applications to health-related behaviors. American Journal of Health Promotion, 11(2), 87–98.

    Article  CAS  PubMed  Google Scholar 

  • Greenberg, M. T., & Abenavoli, R. (2017). Universal interventions: Fully exploring their impacts and potential to produce population-level impacts. Journal of Research on Educational Effectiveness, 10(1), 40–67.

    Article  Google Scholar 

  • Gregory, A., Aarons, G., & Carmazzi, A. (2005). Organizational culture and climate and attitude toward innovation adoption. In 20th annual SIOP conference California.

  • Hamaker, E. L., & Muthén, B. (2020). The fixed versus random effects debate and how it relates to centering in multilevel modeling. Psychological Methods, 25(3), 365.

    Article  PubMed  Google Scholar 

  • Han, S. S., & Weiss, B. (2005). Sustainability of teacher implementation of school-based mental health programs. Journal of Abnormal Child Psychology, 33(6), 665–679.

    Article  PubMed  Google Scholar 

  • Heck, R. H., & Thomas, S. L. (2020). An introduction to multilevel modeling techniques: MLM and SEM approaches. Routledge.

    Book  Google Scholar 

  • Heisig, J. P., & Schaeffer, M. (2019). Why you should always include a random slope for the lower-level variable involved in a cross-level interaction. European Sociological Review, 35(2), 258–279.

    Article  Google Scholar 

  • Hoffman, L., & Walters, R. W. (2022). Catching up on multilevel modeling. Annual Review of Psychology, 73, 659–689.

    Article  PubMed  Google Scholar 

  • Horner, R. H., Sugai, G., Smolkowski, K., Eber, L., Nakasato, J., Todd, A. W., & Esperanza, J. (2009). A randomized, wait-list controlled effectiveness trial assessing school-wide positive behavior support in elementary schools. Journal of Positive Behavior Interventions, 11(3), 133–144.

    Article  Google Scholar 

  • Hoy, W. K., & Fedman, J. A. (1987). Organizational health: The concept and its measure. Journal of Research and Development in Education, 20(4), 30–37.

    Google Scholar 

  • Hoy, W. K., & Tarter, C. J. (1997). The road to open and healthy schools: A handbook for change (middle and secondary school ed.). Corwin.

    Google Scholar 

  • Hoy, W. K., & Woolfolk, A. E. (1993). Teachers’ sense of efficacy and the organizational health of schools. The Elementary School Journal, 93(4), 355–372.

    Article  Google Scholar 

  • James, L. R., Choi, C. C., Ko, C. H. E., McNeil, P. K., Minton, M. K., Wright, M. A., & Kim, K. I. (2008). Organizational and psychological climate: A review of theory and research. European Journal of Work and Organizational Psychology, 17(1), 5–32.

    Article  Google Scholar 

  • Kellam, S. G., Mackenzie, A. C., Brown, C. H., Poduska, J. M., Wang, W., Petras, H., & Wilcox, H. C. (2011). The good behavior game and the future of prevention and treatment. Addiction Science & clinical practice, 6(1), 73.

    Google Scholar 

  • Khosravi, A. A. (2020). The relationship between the authentic leadership self-rating of teachers and the organizational climate of elementary public schools. Our Lady of the Lake University.

    Google Scholar 

  • Klein, K. J., & Kozlowski, S. W. J. (Eds.). (2000). Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions. Jossey-Bass.

    Google Scholar 

  • Krosnick, J. A., Judd, C. M., & Wittenbrink, B. (2018). The measurement of attitudes. In The handbook of attitudes (pp. 45–105). Routledge.

  • Lance, C. E., Butts, M. M., & Michels, L. C. (2006). The sources of four commonly reported cutoff criteria: What did they really say? Organizational Research Methods, 9(2), 202.

    Article  Google Scholar 

  • Langley, A. K., Nadeem, E., Kataoka, S. H., Stein, B. D., & Jaycox, L. H. (2010). Evidence-based mental health programs in schools: Barriers and facilitators of successful implementation. School Mental Health, 2(3), 105–113.

    Article  PubMed  PubMed Central  Google Scholar 

  • Larson, M., Cook, C. R., Fiat, A., & Lyon, A. R. (2018). Stressed teachers don¡¯t make good implementers: Examining the interplay between stress reduction and intervention fidelity. School Mental Health, 10(1), 61–76.

    Article  Google Scholar 

  • List, C. (2014). Three kinds of collective attitudes. Erkenntnis, 79(9), 1601–1622.

    Article  Google Scholar 

  • Locke, J., Lawson, G. M., Beidas, R. S., Aarons, G. A., Xie, M., Lyon, A. R., & Mandell, D. S. (2019). Individual and organizational factors that affect implementation of evidence-based practices for children with autism in public schools: A cross-sectional observational study. Implementation Science, 14(1), 1–9.

    Article  Google Scholar 

  • Low, S., Smolkowski, K., & Cook, C. (2016). What constitutes high-quality implementation of SEL programs? A latent class analysis of Second Step® implementation. Prevention Science, 17(8), 981–991.

    Article  PubMed  Google Scholar 

  • Lucas, S. R. (2014). An inconvenient dataset: Bias and inappropriate inference with the multilevel model. Quality & Quantity, 48(3), 1619–1649.

    Article  Google Scholar 

  • Lui, J. H., Brookman-Frazee, L., Lind, T., Le, K., Roesch, S., Aarons, G. A., & Lau, A. S. (2021). Outer-context determinants in the sustainment phase of a reimbursement-driven implementation of evidence-based practices in children’s mental health services. Implementation Science, 16(1), 1–9.

    Article  Google Scholar 

  • Lyon, A. R., & Bruns, E. J. (2019). From evidence to impact: Joining our best school mental health practices with our best implementation strategies. School Mental Health, 11(1), 106–114.

    Article  PubMed  PubMed Central  Google Scholar 

  • Lyon, A. R., Cook, C. R., Brown, E. C., Locke, J., Davis, C., Ehrhart, M., & Aarons, G. A. (2018a). Assessing organizational implementation context in the education sector: Confirmatory factor analysis of measures of implementation leadership, climate, and citizenship. Implementation Science, 13(1), 1–14.

    Article  Google Scholar 

  • Lyon, A. R., Whitaker, K., Locke, J., Cook, C. R., King, K. M., Duong, M., & Aarons, G. A. (2018b). The impact of inter-organizational alignment (IOA) on implementation outcomes: Evaluating unique and shared organizational influences in education sector mental health. Implementation Science, 13(1), 1–11.

    Article  Google Scholar 

  • Lyon, A. R., Cook, C. R., Duong, M. T., Nicodimos, S., Pullmann, M. D., Brewer, S. K., & Cox, S. (2019). The influence of a blended, theoretically-informed pre-implementation strategy on school-based clinician implementation of an evidence-based trauma intervention. Implementation Science, 14(1), 1–16.

    Article  Google Scholar 

  • Lyon, A. R., Corbin, C. M., Brown, E. C., Ehrhart, M. G., Locke, J., Davis, C., & Cook, C. R. (2021). Leading the charge in the education sector: development and validation of the School Implementation Leadership Scale (SILS). Implementation Science

  • Mang, J., Küchenhoff, H., Meinck, S., & Prenzel, M. (2021). Sampling weights in multilevel modelling: An investigation using PISA sampling structures. Large-Scale Assessments in Education, 9(1), 1–39.

    Article  Google Scholar 

  • Melas, C. D., Zampetakis, L. A., Dimopoulou, A., & Moustakis, V. (2012). Evaluating the properties of the Evidence-Based Practice Attitude Scale (EBPAS) in health care. Psychological Assessment, 24(4), 867.

    Article  PubMed  Google Scholar 

  • Meza, R. D., Triplett, N. S., Woodard, G. S., Martin, P., Khairuzzaman, A. N., Jamora, G., & Dorsey, S. (2021). The relationship between first-level leadership and inner-context and implementation outcomes in behavioral health: A scoping review. Implementation Science, 16(1), 1–21.

    Article  Google Scholar 

  • Neal, A., West, M. A., & Patterson, M. G. (2005). Do organizational climate and competitive strategy moderate the relationship between human resource management and productivity? Journal of Management, 31(4), 492–512.

    Article  Google Scholar 

  • Nelson, M. M., Shanley, J. R., Funderburk, B. W., & Bard, E. (2012). Therapists’ attitudes toward evidence-based practices and implementation of parent–child interaction therapy. Child Maltreatment, 17(1), 47–55.

    Article  PubMed  Google Scholar 

  • Nese, R., McIntosh, K., Nese, J., Hoselton, R., Bloom, J., Johnson, N., & Ghemraoui, A. (2016). Predicting abandonment of school-wide positive behavioral interventions and supports. Behavioral Disorders, 42(1), 261–270.

    Article  Google Scholar 

  • Palinkas, L. A., Horwitz, S. M., Green, C. A., Wisdom, J. P., Duan, N., & Hoagwood, K. (2015). Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Administration and Policy in Mental Health and Mental Health Services Research, 42(5), 533–544.

    Article  PubMed  Google Scholar 

  • Park, R., Pituch, K. A., Kim, J., Chung, H., & Dodd, B. G. (2015). Comparing the performance of multivariate multilevel modeling to traditional analyses with complete and incomplete data. Methodology, 11(3), 100.

    Article  Google Scholar 

  • Pescosolido, B. A., Halpern-Manners, A., Luo, L., & Perry, B. (2021). Trends in public stigma of mental illness in the US, 1996–2018. JAMA Network Open, 4(12), e2140202–e2140202.

    Article  PubMed  PubMed Central  Google Scholar 

  • Powell, B. J., Mandell, D. S., Hadley, T. R., Rubin, R. M., Evans, A. C., Hurford, M. O., & Beidas, R. S. (2017). Are general and strategic measures of organizational context and leadership associated with knowledge and attitudes toward evidence-based practices in public behavioral health settings? A Cross-Sectional Observational Study. Implementation Science, 12(1), 1–13.

    Article  Google Scholar 

  • Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., & Kirchner, J. E. (2015). A refined compilation of implementation strategies: Results from the Expert Recommendations for Implementing Change (ERIC) project. Implementation Science, 10(1), 1–14.

    Article  Google Scholar 

  • Preacher, K. J., Curran, P. J., & Bauer, D. J. (2006). Computational tools for probing interactions in multiple linear regression, multilevel modeling, and latent curve analysis. Journal of Educational and Behavioral Statistics, 31(4), 437–448.

    Article  Google Scholar 

  • Preacher, K. J., Zyphur, M. J., & Zhang, Z. (2010). A general multilevel SEM framework for assessing multilevel mediation. Psychological Methods, 15(3), 209.

    Article  PubMed  Google Scholar 

  • Raudenbush, S. W. (2004). HLM 6: Hierarchical linear and nonlinear modeling. Scientific Software International.

    Google Scholar 

  • Raudenbush, S. W., Bryk, A. S., & Congdon, R. (2009). HLM 6.08 [computer software]. Scientific Software International.

    Google Scholar 

  • Rhoades, L., & Eisenberger, R. (2002). Perceived organizational support: A review of the literature. Journal of Applied Psychology, 87(4), 698.

    Article  PubMed  Google Scholar 

  • Rye, M., Torres, E. M., Friborg, O., Skre, I., & Aarons, G. A. (2017). The Evidence-based Practice Attitude Scale-36 (EBPAS-36): A brief and pragmatic measure of attitudes to evidence-based practice validated in US and Norwegian samples. Implementation Science, 12(1), 1–11.

    Article  Google Scholar 

  • Sanford DeRousie, R. M., & Bierman, K. L. (2012). Examining the sustainability of an evidence-based preschool curriculum: The REDI program. Early Childhood Research Quarterly, 27, 55–65.

    Article  PubMed  PubMed Central  Google Scholar 

  • Scherbaum, C. A., & Ferreter, J. M. (2009). Estimating statistical power and required sample sizes for organizational research using multilevel modeling. Organizational Research Methods, 12(2), 347–367.

    Article  Google Scholar 

  • Schneider, B., Ehrhart, M. G., & Macey, W. H. (2010). Organizational climate research: achievements and the road ahead. In N. M. Ashkanasy, C. P. M. Wilderom, & M. F. Peterson (Eds.), The handbook of organizational culture and climate (2nd ed., pp. 29–49). Sage.

    Chapter  Google Scholar 

  • Schwarzer, R., Lippke, S., & Luszczynska, A. (2011). Mechanisms of health behavior change in persons with chronic illness or disability: The Health Action Process Approach (HAPA). Rehabilitation Psychology, 56(3), 161.

    Article  PubMed  Google Scholar 

  • Shanock, L. R., Baran, B. E., Gentry, W. A., Pattison, S. C., & Heggestad, E. D. (2010). Polynomial regression with response surface analysis: A powerful approach for examining moderation and overcoming limitations of difference scores. Journal of Business and Psychology, 25(4), 543–554.

    Article  Google Scholar 

  • Silvia, P. J., & Christensen, A. P. (2020). Looking up at the curious personality: Individual differences in curiosity and openness to experience. Current Opinion in Behavioral Sciences, 35, 1–6.

    Article  Google Scholar 

  • Smith, B. D., & Manfredo, I. T. (2011). Frontline counselors in organizational contexts: A study of treatment practices in community settings. Journal of substance abuse treatment, 41(2), 124–136.

    Article  PubMed  Google Scholar 

  • Snijders, T. A. B., & Bosker, R. J. (2012). Multilevel analysis: An introduction to basic and advanced multilevel modelling (2nd ed.). Sage.

    Google Scholar 

  • Stauffer, J. M., & Mendoza, J. L. (2001). The proper sequence for correcting correlation coefficients for range restriction and unreliability. Psychometrika, 66(1), 63–68.

    Article  Google Scholar 

  • Thayer, A., Brown, E., Cook, C. R., Ehrhart, M. G., Locke, J., Davis, C., Aarons, G. A., Picozzi, E., & Lyon, A. R. (2022). Construct validity of the School-Implementation Climate Scale. Implementation Research and Practice, 3, 1–14.

    Article  Google Scholar 

  • Tipton, E., & Miller, K. (2022). The generalizer. Webtool hosted at https://www.thegeneralizer.org.

  • Urbaniak, G. C., & Plous, S. (2013). Research randomizer (Version 4.0) [Computer software]. Retrieved on June 22, 2022, from http://www.randomizer.org/

  • Vatcheva, K. P., Lee, M., McCormick, J. B., & Rahbar, M. H. (2016). Multicollinearity in regression analyses conducted in epidemiologic studies. Epidemiology

  • Waltz, T. J., Powell, B. J., Matthieu, M. M., Damschroder, L. J., Chinman, M. J., Smith, J. L., & Kirchner, J. E. (2015). Use of concept mapping to characterize relationships among implementation strategies and assess their feasibility and importance: Results from the Expert Recommendations for Implementing Change (ERIC) study. Implementation Science, 10(1), 1–8.

    Article  Google Scholar 

  • Wang, L., Zhang, Q., Maxwell, S. E., & Bergeman, C. S. (2019). On standardizing within-person effects: Potential problems of global standardization. Multivariate Behavioral Research, 54(3), 382–403.

    Article  PubMed  PubMed Central  Google Scholar 

  • Weiner, B. J. (2009). A theory of organizational readiness for change. Implementation Science, 4(1), 1–9.

    Article  Google Scholar 

  • Weiner, B. J., Belden, C. M., Bergmire, D. M., & Johnston, M. (2011). The meaning and measurement of implementation climate. Implementation Science, 6(1), 1–12.

    Article  Google Scholar 

  • Williams, N. J., & Beidas, R. S. (2019). Annual research review: The state of implementation science in child psychology and psychiatry: A review and suggestions to advance the field. Journal of Child Psychology and Psychiatry, 60(4), 430–450.

    Article  PubMed  Google Scholar 

  • Williams, N. J., Ehrhart, M. G., Aarons, G. A., Marcus, S. C., & Beidas, R. S. (2018). Linking molar organizational climate and strategic implementation climate to clinicians’ use of evidence-based psychotherapy techniques: Cross-sectional and lagged analyses from a 2-year observational study. Implementation Science, 13(1), 1–13.

    Article  Google Scholar 

  • Williams, N. J., & Glisson, C. (2014). The role of organizational culture and climate in the dissemination and implementation of empirically supported treatments for youth.

  • Williams, N. J., Wolk, C. B., Becker-Haimes, E. M., & Beidas, R. S. (2020). Testing a theory of strategic implementation leadership, implementation climate, and clinicians’ use of evidence-based practice: A 5-year panel analysis. Implementation Science, 15(1), 1–15.

    Article  Google Scholar 

  • Youth mental health reports and publications. (2021, December 7). Retrieved from https://www.hhs.gov/surgeongeneral/reports-and-publications/youth-mental-health/index.html

Download references

Funding

This study was part of a project funded by Grant R305A160114 (Lyon and Cook) awarded by the Institute of Education Sciences. The content is solely the responsibility of the authors and does not necessarily represent the official views of the Institute of Education Sciences.

Author information

Authors and Affiliations

  1. Department of Psychological & Quantitative Foundations, The University of Iowa, 361 Lindquist Center, Iowa City, IA, 52242, USA

    Yanchen Zhang

  2. Department of Educational Psychology, University of Minnesota, 341 Education Sciences Building, 56 East River Road, Minneapolis, MN, 55455, USA

    Clay Cook

  3. Department of Counseling and School Psychology, University of Massachusetts-Boston, 100 William T. Morrissey Blvd., Boston, MA, 02125, USA

    Lindsay Fallon

  4. Department of Psychiatry & Behavioral Sciences, University of Washington, 6200 NE 74th Street, Suite 110, Box 354920, Seattle, WA, 98115, USA

    Catherine Corbin, Jill Locke & Aaron Lyon

  5. Department of Industrial/Organizational Psychology, University of Central Florida, 4111 Pictor Lane, Orlando, FL, 32816, USA

    Mark Ehrhart

  6. Department of Public Health Sciences, University of Miami, Coral Gables, FL, 33124, USA

    Eric Brown

Authors
  1. Yanchen Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Clay Cook
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lindsay Fallon
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Catherine Corbin
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Mark Ehrhart
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Eric Brown
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Jill Locke
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Aaron Lyon
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

YZ developed and finalized the manuscript, analyzed, and interpreted the data, and created all materials for submission. CLC was a major contributor in writing the manuscript. LF, CC, ME, EB, JL, and AL all made contributions to reviewing and editing the drafts of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Yanchen Zhang.

Ethics declarations

Competing Interests

The authors declare that they have no competing interests.

Ethical Approval and Consent to Participate

This study was approved by the Institutional Review Board (IRB) at the University of Washington. Informed consent was obtained from all individual participants included in the study.

Consent for Publication

Not applicable.

Standards of Reporting

This is a cross-sectional observational study. Therefore, we adhered to the STROBE checklist in terms of analysis, reporting, and preparation of the manuscript. The completed STROBE checklist is provided as Supplementary Material 3.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, Y., Cook, C., Fallon, L. et al. The Interaction Between General and Strategic Leadership and Climate on Their Multilevel Associations with Implementer Attitudes Toward Universal Prevention Programs for Youth Mental Health: A Cross-Sectional Study. Adm Policy Ment Health 50, 427–449 (2023). https://doi.org/10.1007/s10488-022-01248-5

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10488-022-01248-5

Keywords

Search

Navigation