Abstract
A key issue for youth development programs is whether the learning they provide is transferred to participants’ daily lives. It is also important that they are effective for the diverse range of participants they attract. This study used a randomized controlled trial design to measure the impact of Project K, a New Zealand-based youth development program, on academic and social self-efficacy. Project K combines a 3-week wilderness adventure, a 10 day community service component, and 1 year of mentoring to promote positive growth in 14–15 year olds with low self-efficacy. At baseline, the evaluation included 600 Project K (46 % female) and 577 Control participants (48 % female) and revealed that Project K was effective in improving both social and academic self-efficacy from pre- to post-program with effects being sustained 1 year later. Parents’ perceptions of changes in the participants’ interpersonal skills supported these findings. Differential program effects were found across participant subgroups, particularly 1 year after program completion. The implications of these differences are discussed.
Similar content being viewed by others
Notes
The “European” and “Other” variables were not included as covariates in any analyses that incorporated ethnicity to avoid model multicollinearity.
The estimates for all of the simple slope analyses at Time 2 were based on the propensity matched sample because the sample size was similar to the original sample and because it provides a stronger counterfactual analysis of program effects.
References
Allen, J. P., Leadbeater, B. J., & Aber, J. L. (1990). The relationship of adolescents’ expectations and values to delinquency, hard drug use, and unprotected sexual intercourse. Development and Psychopathology, 2(01), 85–98. doi:10.1017/S0954579400000614.
Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84(2), 191–215.
Bandura, A. (1997). Self-efficacy. The exercise of control. New York, NY: W.H. Freeman and Company.
Bandura, A., Barbaranelli, C., Caprara, G. V., & Pastorelli, C. (1996). Multifaceted impact of self-efficacy beliefs on academic functioning. Child Development, 67(3), 1206–1222.
Bandura, A., Barbaranelli, C., Caprara, G. V., & Pastorelli, C. (2001). Self-efficacy beliefs as shapers of children’s aspirations and career trajectories. Child Development, 72(1), 187–206.
Bandura, A., Pastorelli, C., Barbaranelli, C., & Caprara, G. V. (1999). Self-efficacy pathways to childhood depression. Journal of Personality and Social Psychology, 76(2), 258–269.
Bauman, A. E., Reis, R. S., Sallis, J. F., Wells, J. C., Loos, R. J. F., & Martin, B. W. (2012). Correlates of physical activity: Why are some people physically active and others not? Lancet, 380, 258–271.
Benson, P. L. (2007). Developmental assets: An overview of theory, research, and practice. In R. K. Silbereisen & R. M. Lerner (Eds.), Approaches to positive youth development (pp. 33–58). London: Sage Publications.
Brooks-Gunn, J., & Roth, J. (2014). Invited commentary: Promotion and prevention in youth development: Two sides of the same coin? Journal of Youth and Adolescence, 43, 1004–1007. doi:10.1007/s10964-014-0122-y.
Caines, K., & Center, B. (2010). Differential effects of an outdoor community-based youth development program on adolescent boys and girls. Journal of Adolescent Health, 46(2), S73–S73. doi:10.1016/j.jadohealth.2009.11.176.
Caprara, G. V., Fida, R., Vecchione, M., Del Bove, G., Vecchio, G. M., Barbaranelli, C., & Bandura, A. (2008). Longitudinal analysis of the role of perceived self-efficacy for self-regulated learning in academic continuance and achievement. Journal of Educational Psychology, 100(3), 525–534. doi:10.1037/0022-0663.100.3.525.
Caprara, G. V., Gerbino, M., Paciello, M., Di Giunta, L., & Pastorelli, C. (2010). Counteracting depression and delinquency in late adolescence: The role of regulatory emotional and interpersonal self-efficacy beliefs. European Psychologist, 15(1), 34–48.
Carroll, A., Houghton, S., Wood, R., Unsworth, K., Hattie, J., Gordon, L., & Bower, J. (2009). Self-efficacy and academic achievement in Australian high school students: The mediating effects of academic aspirations and delinquency. Journal of Adolescence, 32(4), 797–817. doi:10.1016/j.adolescence.2008.10.009.
Catalano, R. F., Berglund, M. L., Ryan, J. A. M., Lonczak, H. S., & Hawkins, J. D. (2004). Positive youth development in the United States: Research findings on evaluations of positive youth development programs. The Annals of the American Academy of Political and Social Science, 591(1), 98–124. doi:10.1177/0002716203260102.
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indices for testing measurement invariance. Structural Equation Modeling, 9(2), 233–255. doi:10.1207/S15328007SEM0902_5.
Connolly, J. (1989). Social self-efficacy in adolescence: Relations with self-concept, social adjustment, and mental health. Canadian Journal of Behavioural Science, 21(3), 258–269.
Corrigan, A. (2002). Social Competence Scale—Parent version. Fast track project technical report. Retrieved from http://www.fasttrackproject.org/techrept/s/scp/scp2tech.pdf
Craig, S. L., McInroy, L., Austin, A., Smith, M., & Engle, B. (2012). Promoting Self-efficacy and self-esteem for multiethnic sexual minority youth: An evidence-informed intervention. Journal of Social Service Research, 38(5), 688–698.
Crockett, L. J., Schulenberg, J. E., & Petersen, A. (1987). Congruence between objective and self-report data in a sample of young adolescents. Journal of Adolescent Research, 2(4), 383–392.
Damon, W. (2004). What is positive youth development? The Annals of the American Academy of Political and Social Science, 591, 13–24. doi:10.1177/0002716203260092.
Deane, K. L., & Harré, N. (2014a). The youth adventure programming model. Journal of Research on Adolescence, 24(2), 293–408. doi:10.1111/jora.12069.
Deane, K. L., & Harré, N. (2014b). Program theory-driven evaluation science in a youth development context. Evaluation and Program Planning, 45, 61–70. doi:10.1016/j.evalproplan.2014.03.009.
Deane, K. L., & Harré, N. (in press). Developing a thoughtful approach to evaluation: Values-driven guidelines for novice evaluators. Evaluation Matters–He Take Tō Te Aromatawai, 2.
Desivilya, H. S., & Eizen, D. (2005). Conflict management in work teams: The role of social self-efficacy and group identification. The International Journal of Conflict Management, 16(2), 183–208.
Dicke, T., Marsh, H. W., Parker, P. D., Kunter, M., Schmeck, A., & Leutner, D. (2014). Self-efficacy in classroom management, classroom disturbances, and emotional exhaustion: A moderated mediation analysis of teacher candidates. Journal of Educational Psychology, 106(2), 569–583.
DuBois, D. L., Portillo, N., Rhodes, J. E., Silverthorn, N., & Valentine, J. C. (2011). How effective are mentoring programs for youth? A systematic assessment of the evidence. Psychological Science in the Public Interest, 12(2), 57–91. doi:10.1177/1529100611414806.
Durlak, J. A., & Weissberg, R. P. (2007). The impact of after-school programs that promote personal and social skills. Collaborative for Academic, Social, and Emotional Learning. Chicago, IL. Retrieved from www.casel.org
Durlak, J. A., Weissberg, R. P., & Pachan, M. (2010). A meta-analysis of after-school programs that seek to promote personal and social skills in children and adolescents. American Journal of Community Psychology, 45, 294–309. doi:10.1007/s10464-010-9300-6.
Fan, X., & Sivo, S. A. (2007). Sensitivity of fit indices to model misspecification and model types. Multivariate Behavioral Research, 42(3), 509–529. doi:10.1080/00273170701382864.
Field, A. (2009). Discovering statistics using SPSS. London: Sage Publications.
Glass, J. S., & Benshoff, J. M. (2002). Facilitating group cohesion among adolescents through challenge course experiences. The Journal of Experiential Education, 25(2), 268–276.
Glatz, T., & Buchanan, C. M. (2015). Change and predictors of change in parental self-efficacy from early to middle adolescence. Developmental Psychology, 51(10), 1367–1379.
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate data analysis (7th ed.). Upper Saddle River, NJ: Prentice Hall.
Hall, B. C., Stewart, D. G., Arger, C., Athenour, D. R., & Effinger, J. (2014). Modeling motivation three ways: Effects of MI metrics on treatment outcomes among adolescents. Psychology of Addictive Behaviors, 28(1), 307–312.
Hattie, J., Marsh, H. W., Neill, J. T., & Richards, G. E. (1997). Adventure education and outward bound: Out-of-class experiences that make a lasting difference. Review of Educational Research, 67(1), 43–87. doi:10.3102/00346543067001043.
Have, T., Normand, S. T., Marcus, S., Hendricks, B. C., & Lavori, P. (2008). Intent-to-treat vs. non-intent-to-treat analyses under treatment adherence in mental health randomized trials. Psychiatric Annals, 38(12), 772–783.
Hayhurst, J., Hunter, J. A., Kafka, S., & Boyes, M. (2015). Enhancing resilience in youth through a 10-day developmental voyage. Journal of Adventure Education and Outdoor Learning, 15(1), 40–52.
Hazenberg, R., Seddon, F., & Denny, S. (2015). Programme recruitment and evaluation: The effect of an employability enhancement programme on the general self-efficacy levels of unemployed graduates. Journal of Education and Work, 28(3), 273–300.
Hermann, K. S., & Betz, N. E. (2006). Path models of the relationships of instrumentality and expressiveness, social self-efficacy, and self-esteem to depressive symptoms in college students. Journal of Social and Clinical Psychology, 25(10), 1086–1106.
Høigaard, R., Kovač, V. B., Øverby, N. C., & Haugen, T. (2014). Self-Efficacy mediates the effects of school psychological climate on academic achievement. School Psychology Quarterly, Advance online publication. doi:10.1037/spq0000056.
Hollis, H., Deane, K., Moore, J., & Harré, N. (2011). Young Maori perceptions of a youth development program. Kōtuitui: New Zealand Journal of Social Sciences Online, 6(1–2), 50–61. doi:10.1080/1177083X.2011.615847.
Hox, J. (2002). Multilevel analysis. Techniques and applications. Mahwah, NJ: Lawrence Erlbaum Associates.
Jeličić, H., Bobek, D., Phelps, E., Bobek, D., Lerner, J. V., & Lerner, R. M. (2007). Using positive youth development to predict contribution and risk behaviors in early adolescence: Findings from the first two waves of the 4-H study of positive youth development. International Journal of Behavioral Development, 31(3), 263–273. doi:10.1177/0165025407076439.
Jungert, T., Hesser, H., & Traff, U. (2014). Contrasting two models of academic self-efficacy—Domain-specific versus cross-domain—In children receiving and not receiving special instruction in mathematics. Scandinavian Journal of Psychology, 55, 440–447.
Kim, J., & Cicchetti, D. (2003). Social self-efficacy and behavior problems in maltreated and nonmaltreated children. Journal of Clinical Child and Adolescent Psychology, 32(1), 106–117.
Lanza, S. T., Moore, J. E., & Butera, N. M. (2013). Drawing causal inferences using propensity scores: A practical guide for community psychologists. American Journal of Community Psychology, 52, 380–392. doi:10.1007/s10464-013-9604-4.
Lennings, C. J. (1994). An evaluation of a generalized self-efficacy scale. Personality and Individual Differences, 16(5), 745–750.
Litt, M. D., & Kadden, R. M. (2015). Willpower versus “Skillpower”: Examining how self-efficacy works in treatment for marijuana dependence. Psychology of Addictive Behaviors, 29(3), 532–540.
McArdle, J. J. (2007). Factor analysis of longitudinal data. In R. Cudeck & R. MacCallum (Eds.), Factor analysis at 100: Historical developments and future directions (pp. 99–130). Mahwah, NJ: Erlbaum.
McKenzie, M. (2003). Beyond “The Outward Bound Process:” Rethinking student learning. The Journal of Experiential Education, 26(1), 8–23.
Moore, J. (2005). Self-efficacy and health behaviours: A test of measures to assess the effectiveness of a positive youth development program. Unpublished master’s thesis. University of Auckland, Auckland.
Morton, M. H., & Montgomery, P. (2013). Youth empowerment programs for improving adolescents’ self-efficacy and self-esteem. A systematic review. Research on Social Work Practice, 23(1), 22–33. doi:10.1177/1049731512459967.
Muris, P. (2001). A brief questionnaire for measuring self-efficacy in youths. Journal of Psychopathology and Behavioral Assessment, 23(3), 145–149. doi:10.1023/A:1010961119608.
Muthén, L. K., & Muthén, B. O. (2015). Mplus user’s guide (7th ed.). Los Angeles, CA: Muthén & Muthén.
Nunns, H., Peace, R., & Witten, K. (2015). Evaluative reasoning in public-sector evaluation in Aotearoa New Zealand: How are we doing? Evaluation Matters—He Take To Te Aromatawai, 1, 137–163. doi:10.18296/em.0007.
Orren, P., & Werner, P. (2007). Effects of brief wilderness programs in relation to adolescents’ race. The Journal of Experiential Education, 30(2), 117–133.
Pajares, F. (2002). Gender and perceived self-efficacy in self-regulated learning. Theory Into Practice, 41(2), 116.
Parker, R., Bush, J., & Harris, D. (2014). Important methodological issues in evaluating community-based interventions. Evaluation Review, 38(4), 295–308. doi:10.1177/0193841X14542610.
Perry, C. K., Garside, H., Morones, S., & Hayman, L. L. (2012). Physical activity interventions for adolescents: An ecological perspective. Journal of Primary Prevention, 33, 111–135.
Raudenbush, S. W., Bryk, A. S., Cheong, Y. F., Congdon, R. T., & du Toit, M. (2011). HLM 7 for windows [Computer software]. Lincolnwood, IL: Scientific Software International.
Rodgers, W. M., Murray, T. C., Courneya, K. S., Bell, G. J., & Harber, V. J. (2009). The specificity of self-efficacy over the course of a progressive exercise programme. Applied Psychology: Health and Well-Being, 1(2), 211–232.
Roth, J. L., & Brooks-Gunn, J. (2003). Youth development programs: Risk, prevention and policy. Journal of Adolescent Health, 32(3), 170–182. doi:10.1016/s1054-139x(02)00421-4.
Scales, P. C., Benson, P. L., Leffert, N., & Blyth, D. A. (2000). Contribution of developmental assets to the prediction of thriving among adolescents. Applied Developmental Science, 4(1), 27–46. doi:10.1207/S1532480XADS0401_3.
Scales, P. C., Benson, P. L., Roehlkepartain, E. C., Sesma, A, Jr, & van Dulmen, M. (2006). The role of developmental assets in predicting academic achievement: A longitudinal study. Journal of Adolescence, 29(5), 691–708. doi:10.1016/j.adolescence.2005.09.001.
Schunk, D. H., & Meece, J. L. (2006). Self-Efficacy Development in Adolescence. In F. Pajares & T. Urdan (Eds.), Self-efficacy beliefs of adolescents (pp. 71–96). Greenwich, CT: Information Age Publishing.
Sibley, C. (2009). Utilities for examining interactions in multiple regression [Computer software]. Auckland: University of Auckland.
Snijders, T., & Bosker, R. (1999). Multilevel analysis. An introduction to basic and advanced multilevel modeling. London: Sage Publications.
Tipton, R. M., & Worthington, E. L. (1984). The measurement of generalized self-efficacy: A study of construct validity. Journal of Personality Assessment, 48, 545–548.
Voorhees, C. M., Brady, M. K., Calantone, R., & Ramirez, E. (2016). Discriminant validity testing in marketing: An analysis, causes for concern, and proposed remedies. Journal of the Academy of Marketing Sciences, 44(1), 119–134. doi:10.1007/s11747-015-0455-4.
Voskuil, V. R., & Robbins, L. B. (2015). Youth physical activity self-efficacy: A concept analysis. Journal of Advanced Nursing, 71(9), 2002–2019.
Warner, L. M., Wolff, J. K., Wurm, S., Schuz, B., Parschau, L., & Schwarzer, R. (2014). Sources of self-efficacy for physical activity. Health Psychology, 33(11), 1298–1308.
Wichmann, C., Coplan, R. J., & Daniels, T. (2004). The Social cognitions of socially withdrawn children. Social Development, 13(3), 377–392. doi:10.1111/j.1467-9507.2004.00273.x.
Widmer, M. A., Duerden, M. D., & Taniguchi, S. T. (2014). Increasing and generalizing self-efficacy. Journal of Leisure Research, 46(2), 165–183.
Wigfield, A., Eccles, J. S., Schiefele, U., Roeser, R. W., & Davis-Kean, P. (2006). Development of achievement motivation. In W. Damon & R. M. Lerner (Eds.), Handbook of child psychology: Vol 3, Social, emotional, and personality development (6th ed., pp. 933–1002). Hoboken, NJ: Wiley.
Wilson, S. J., & Lipsey, M. W. (2000). Wilderness challenge programs for delinquent youth: A meta-analysis of outcome evaluations. Evaluation and Program Planning, 23(1), 1–12. doi:10.1016/s0149-7189(99)00040-3.
Zimmerman, B. J., & Cleary, T. J. (2006). Adolescents’ development of personal agency The role of self-efficacy beliefs and self-regulatory skill. In F. Pajares & D. Miller (Eds.), Self-efficacy beliefs of adolescents (pp. 45–69). Greenwich, CT: Information Age Publishing.
Acknowledgments
This study formed a part of the first author’s PhD thesis that was supported by a New Zealand International Doctoral Research Scholarship from the New Zealand government and a University of Auckland International Doctoral Research Scholarship. We would also like to acknowledge the Foundation for Youth Development (now known as the Graeme Dingle Foundation) and their Community Partners for their part in implementing the evaluation and otherwise supporting the research, as well as the New Zealand Ministry of Social Development for funding eight of the program deliveries included in this evaluation and for auditing the data collection process for these deliveries. We would like to thank Drs Nickola Overall, Chris Sibley and Kane Meissel, Shannon Johnston, Larissa Isted, Jade LeGrice and Diane Osborne for assistance with various aspects of the project. Finally, we would like to thank the editor of the Journal of Youth and Adolescence and the three blind reviewers for their incredibly helpful feedback on earlier versions of this manuscript.
Author Contributions
NH and JM conceived of the study and all authors contributed to aspects of the research design. JM developed the measures under the supervision of NH. MC performed the statistical analysis for the measurement models and wrote the relevant section of the manuscript. KD took primary responsibility for the writing of the manuscript with NH and conducted the remainder of the statistical analyses. All authors reviewed and approved the final manuscript.
Funding
The New Zealand Ministry of Social Development (MSD) funded the Foundation for Youth Development (FYD) for the evaluation for eight program deliveries included in the evaluation presented here. The study was also funded in part from two scholarships to the first author, a New Zealand International Doctoral Research Scholarship from the New Zealand government and a University of Auckland International Doctoral Research Scholarship.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
JM is the Research and Evaluation Manager for the Graeme Dingle Foundation (previously Foundation for Youth Development or FYD), the organization that owns the Project K program. She was involved in the study design, data collection and editing of the method section; however, she had no involvement in the data analysis or reporting of the findings. KD, NH and MC report no conflicts of interest.
Ethical Approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional research committee and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed Consent
Informed consent was obtained from all individual participants included in the study.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Deane, K.L., Harré, N., Moore, J. et al. The Impact of the Project K Youth Development Program on Self-Efficacy: A Randomized Controlled Trial. J Youth Adolescence 46, 516–537 (2017). https://doi.org/10.1007/s10964-016-0463-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10964-016-0463-9