Abstract
This chapter focuses on the evaluation of career guidance programs, which is an important endeavour for practitioners as stakeholders often want information on the effectiveness of career guidance interventions. The authors first examine previous research related to the effects of career guidance programs or interventions with a discussion of the effectiveness of career guidance programs, which modalities are preferable in providing career guidance, which clients benefit from these interventions, and outcome measures that are typically used in the evaluation of career guidance programs. Second, the authors provide a summary of how to conduct an evaluation of a career guidance program. This overview utilizes the six-step process for evaluating career counselling programs proposed by Whiston and Brecheisen (Evaluating the effectiveness of adult career development programs. In: Niles SG (ed) Adult career development: concepts, issues, and practices, 3rd ed. National Career Development Association, Alexandria, pp 367–384, 2002). These six steps are (1) identify the focus of the evaluation; (2) formulate the evaluation design and procedures; (3) determine evaluation or outcome measures; (4) gather information; (5) data analyses and interpretation; and (6) methods for using the information.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Akkermans, J., Brenninkmeijer, V., Schaufeli, W. B., & Blonk, R. W. (2015). It’s all about career skills: Effectiveness of a career development intervention for young employees. Human Resource Management, 54(4), 533–551. https://doi.org/10.1002/hrm.21633.
Ali, S. R., Brown, S. D., & Loh, Y. (2017). Project HOPE: Evaluation of health science career education programming for rural Latino and European American youth. The Career Development Quarterly, 65(1), 57–71. https://doi.org/10.1002/cdq.12080.
American Evaluation Association. (2004). Guiding principles for evaluators. Washington, DC: Author.
Benkofske, M., & Heppner, C. C. (2008). Program evaluation. In P. P. Heppner, B. E. Wampold, & D. M. Kivlighan (Eds.), Research design in counselling (3rd ed., p. 511). Belmont: Thompson Higher Education.
Brown, S. D., Krane, N. E. R., Brecheisen, J., Castelino, P., Budisin, I., Miller, M., & Edens, L. (2003). Critical ingredients of career choice interventions: More analyses and new hypotheses. Journal of Vocational Behavior, 62(3), 411–428. https://doi.org/10.1016/s0001-8791(02)00052-0.
Brown, S. D., & Ryan Krane, N. E. (2000). Four (or five) sessions and a cloud of dust: Old assumptions and new observations about career counseling. In S. D. Brown & R. W. Lent (Eds.), Handbook of counseling psychology (3rd ed., pp. 740–766). New York: Wiley.
Bysshe, S., Hughes, D., & Bowes, L. (2002). The economic benefits of career guidance: A review of current evidence. Retrieved from https://www.researchgate.net/publication/238078155
Cardoso, P., Gonçalves, M. M., Duarte, M. E., Silva, J. R., & Alves, D. (2016). Life design counseling outcome and process: A case study with an adolescent. Journal of Vocational Behavior, 93, 58–66. https://doi.org/10.1016/j.jvb.2016.01.002.
Celen-Demirtas, S. (2017). The effects of career construction training on career adaptability, vocational identity achievement, and subjective well-being among first year college students (Order No. AAI10160210). Available from PsycINFO. (1925842877, 2017–05718-021).
Chauvin, I., Miller, M. J., & Byrd, M. D. (2011). Examining the relationship between the self-directed search and a work values inventory: An exploratory study with implications for career counselors. College Student Journal, 45(2), 407–413. Retrieved from http://proxyiub.uits.iu.edu/login?url=https://search.proquest.com/docview/885701076?accountid=11620
Chien, J. C., Fischer, J. M., & Biller, E. (2006). Evaluating a metacognitive and planned happenstance career training course for Taiwanese college students. Journal of Employment Counseling, 43(4), 146–153. https://doi.org/10.1002/j.2161-1920.2006.tb00014.x.
Chiesa, R., Massei, F., & Guglielmi, D. (2016). Career decision-making self-efficacy change in Italian high school students. Journal of Counseling & Development, 94(2), 210–224. https://doi.org/10.1002/jcad.12077.
Comer, J. S., & Kendall, P. C. (2013). Methodology, design, and evaluation in psychotherapy research. In M. J. Lambert (Ed.), Bergin and Garfield’s handbook of psychotherapy and behaviour change (6th ed., pp. 21–48). Hoboken: Wiley.
Dennehy, J. (2003, October). Closing remarks. Career guidance & public policy: Bridging the gap conference. Toronto, Canada.
Diener, E., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985). The satisfaction with life scale. Journal of Personality Assessment, 49(1), 71–75. https://doi.org/10.1207/s15327752jpa4901_13.
Di Fabio, A., & Kenny, M. E. (2010). Promoting emotional intelligence and career decision making among Italian high school students. Journal of Career Assessment, 19(1), 21–34. https://doi.org/10.1177/1069072710382530.
Di Fabio, A., & Maree, J. G. (2012). Group-based life design counseling in an Italian context. Journal of Vocational Behavior, 80(1), 100–107. https://doi.org/10.1016/j.jvb.2011.06.001.
Emmerling, R. J., & Cherniss, C. (2003). Emotional intelligence and the career choice process. Journal of Career Assessment, 11(2), 153–167. https://doi.org/10.1177/1069072703011002003.
Ferrari, L., Nota, L., & Soresi, S. (2012). Evaluation of an intervention to foster time perspective and career decidedness in a group of Italian adolescents. The Career Development Quarterly, 60(1), 82–96. https://doi.org/10.1002/j.2161-0045.2012.00007.x.
Fretz, B. R. (1981). Evaluating the effectiveness of career interventions. Journal of Counseling Psychology, 28, 77–90. https://doi.org/10.1037/0022-0167.28.1.77.
Frisch, M. B. (1994). Quality of life inventory. Upper Saddle River: Pearson.
Galliott, N. (2017). Online career guidance: Does knowledge equate to power for high school students? Journal of Psychologists and Counsellors in Schools. https://doi.org/10.1017/jgc.2017.7.
Gati, I., Gadassi, R., & Shemesh, N. (2006). The predictive validity of a computer-assisted career decision-making system: A six-year follow-up. Journal of Vocational Behavior, 68, 205–219. https://doi.org/10.1016/j.jvb.2005.08.002.
Gati, I., Krausz, M., & Osipow, S. H. (1996). A taxonomy of difficulties in career decision making. Journal of Counseling Psychology, 43, 510–526.
Guichard, J. (2003). Career counseling for human development: An international perspective. The Career Development Quarterly, 51(4), 306–321. https://doi.org/10.1002/j.2161-0045.2003.tb00612.x.
Guichard, J., & Lenz, J. (2005). Career theory from an international perspective. The Career Development Quarterly, 54(1), 17–28. https://doi.org/10.1002/j.2161-0045.2005.tb00137.x.
Hacker, J., Carr, A., Abrams, M., & Brown, S. D. (2013). Development of the career indecision profile: Factor structure, reliability, and validity. Journal of Career Assessment, 21(1), 32–41. https://doi.org/10.1177/1069072712453832.
Hammond, M. S., Lockman, J. D., & Boling, T. (2010). A test of the tripartite model of career indecision of Brown and Krane for African Americans incorporating emotional intelligence and positive affect. Journal of Career Assessment, 18(2), 161–176. https://doi.org/10.1177/1069072709354201.
Hansen, J. M., Jackson, A. P., & Pedersen, T. R. (2017). Career development courses and educational outcomes: Do career courses make a difference? Journal of Career Development, 44(3), 209–223. https://doi.org/10.1177/0894845316644984.
Hartung, P. J. (2005). Internationalizing career counseling: Emptying our cups and learning from each other. The Career Development Quarterly, 54, 12–16. https://doi.org/10.1002/j.2161-0045.2005.tb00136.x.
Henson, R. K. (2006). Effect-size measures and meta-analytic thinking in counseling psychology research. The Counseling Psychologist, 34(5), 601–629. https://doi.org/10.1177/0011000005283558.
Heppner, M. J., & Heppner, P. P. (2003). Identifying process variables in career counseling: A research agenda. Journal of Vocational Behavior, 62(3), 429–452. https://doi.org/10.1016/s0001-8791(02)00053-2.
Heppner, P. P., Wampold, B. E., & Kivlighan, D. M. (2008). Research design in counselling. Belmont: Thomson.
Hirschi, A., Freund, P. A., & Herrmann, A. (2014). The career engagement scale: Development and validation of a measure of proactive career behaviors. Journal of Career Assessment, 33(4), 575–594. https://doi.org/10.1177/1069072713514813.
Hooley, T., & Dodd, V. (2015). The economic benefits of career guidance. Retrieved from the careersEngland website: www.careersegland.org.uk/
Jones, L. K. (1989). Measuring a three-dimensional construct of career indecision among college students: A revision of the vocational decision scale: The career decision profile. Journal of Counseling Psychology, 36(4), 477–486. https://doi.org/10.1037/0022-0167.36.4.477.
Kazdin, A. E. (2010). Single-case research designs: Methods for clinical and applied settings (2nd ed.). New York: Oxford University Press.
Killeen, J., & White, M. (2000). The impact of careers guidance on adult employed people. DfEE Research report, Sheffield: Department for Education and Employment.
Lalande, V., Hiebert, B., Bezanson, L., Magnusson, K., Baudoin, R., Borgen, B., Goyer, L., Michaud, G., Renald, C., & Turcotte, M. (2005, September). Evidence based practice in career development services for Canadians. Paper presented at the International Association for Educational and Vocational Guidance Conference, Lisbon, Portugal.
Lent, R. W., Brown, S. D., & Hackett, G. (1994). Toward a unifying social cognitive theory of career and academic interest, choice, and performance. Journal of Vocational Behavior, 45(1), 79–122. https://doi.org/10.1006/jvbe.1994.1027.
Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks: Sage Publications.
Liu, S., Huang, J. L., & Wang, M. (2014). Effectiveness of job search interventions: A meta-analytic review. Psychological Bulletin, 140(4), 1009. https://doi.org/10.1037/a0035923.
Love, A., & Russon, C. (2004). Evaluation standards in an international context. In C. Russon & G. Russon (Eds.), International perspectives on evaluation. San Francisco: Jossey-Bass.
Magnusson, K., & Roest, A. (2004). The efficacy of career development interventions: A synthesis of research. Unpublished paper. Ottawa: Human Resources and Skill Development, Canada.
McLaren, M. R. (2013). Moderators of efficacy for a Computer-Assisted Career Guidance System (CACGS) intervention (doctoral dissertation). Retrieved from Colorado State University Theses and Dissertations.
Nassar-McMillan, S., & Conley, A. H. (2011). Programme evaluation toolbox: Effective evaluation principles and considerations in career practice. International Journal for Educational and Vocational Guidance, 11(3), 211–220. https://doi.org/10.1007/s10775-011-9206-3.
Nichols, G. C. (2009). Career interventions in context: A meta-analysis examining the influence of environmental factors on outcome (doctoral dissertation). Retrieved from ProQuest Information & Learning.
Ogles, B. M. (2013). Measuring change in psychotherapy research. In M. J. Lambert (Ed.), Bergin and Garfield’s handbook of psychotherapy and behavior change (6th ed., pp. 134–166). Hoboken: Wiley.
Oliveira, Í. M., Taveira, M. D. C., Cadime, I., & Porfeli, E. J. (2016). Psychometric properties of a career exploratory outcome expectations measure. Journal of Career Assessment, 24(2), 380–396. https://doi.org/10.1177/1069072715580577.
Oliver, L. W., & Spokane, A. R. (1988). Career-intervention outcome: What contributes to client gain? Journal of Counseling Psychology, 35, 447–462. https://doi.org/10.1037/0022-0167.35.4.447.
O’Neill, R. E., McDonnell, J. J., Billingsley, F. F., & Jenson, W. R. (2010). Single case research designs in educational and community settings. Upper Saddle River: Pearson.
Osipow, S. H., Carney, C. G., Winer, J. L., Yanico, B., & Koschler, M. (1987). The career decision scale (3rd ed.). Odessa: Psychological Assessment Resources.
Reardon, R. (1996). A program and cost analysis of a self-directed career decision-making program in a university career center. Journal of Counseling & Development, 74, 280–285. https://doi.org/10.1002/j.1556-6676.1996.tb01866.x.
Rossi, P. H., Lipsey, M. W., & Freeman, H. (2004). Evaluation: A systematic approach (7th ed.). Thousand Oaks: Sage.
Rottinghaus, P. J., Eshelman, A., Gore, J. S., Keller, K. J., Schneider, M., & Harris, K. L. (2017). Measuring change in career counseling: Validation of the career futures inventory-revised. International Journal for Educational and Vocational Guidance, 17(1), 61–75. https://doi.org/10.1007/s10775-016-9329-7.
Rottinghaus, P. J., Buelow, K. L., Matyja, A., & Schneider, M. R. (2012). The career futures inventory–revised: Measuring dimensions of career adaptability. Journal of Career Assessment, 20(2), 123–139. https://doi.org/10.1177/1069072711420849.
Royse, D., Thyer, B. A., & Padgett, D. K. (2016). Program evaluation: An introduction to an evidence-based approach (6th ed.). Boston: Cengage.
Sampson, J. P., McClain, M. C., Musch, E., & Reardon, R. C. (2013). Variables affecting readiness to benefit from career interventions. The Career Development Quarterly, 61(2), 98–109. https://doi.org/10.1002/j.2161-0045.2013.00040.x.
Sampson, J. P., Peterson, G. W., Lenz, J. G., Reardon, R. C., & Saunders, D. E. (1996). Career thoughts inventory. Odessa: Psychological Assessment Resources.
Savickas, M. L., & Porfeli, E. J. (2011). Revision of the career maturity inventory: The adaptability form. Journal of Career Assessment, 19(4), 355–374. https://doi.org/10.1177/1069072711409342.
Savickas, M. L., & Porfeli, E. J. (2012). Career adapt-abilities scale: Construction, reliability, and measurement equivalence across 13 countries. Journal of Vocational Behavior, 80(3), 661–673. https://doi.org/10.1016/j.jvb.2012.01.011.
Spokane, A. R. (1991). Career interventions. Englewood Cliffs: Prentice Hall.
Swanson, J. L., Daniels, K. K., & Tokar, D. M. (1996). Assessing perceptions of career-related barriers: The career barriers inventory. Journal of Career Assessment, 4(2), 219–244. https://doi.org/10.1177/106907279600400207.
Thrift, M. M., Ulloa-Heath, J., Reardon, R. C., & Peterson, G. W. (2012). Career intervention and the career thoughts of Pacific island college students. Journal of Counseling & Development, 90(2), 169–176. https://doi.org/10.1111/j.1556-6676.2012.00022.x.
Verbruggen, M., & Sels, L. (2010). Social-cognitive factors affecting clients’ career and life satisfaction after counseling. Journal of Career Assessment, 18(1), 3–15. https://doi.org/10.1177/1069072709340516.
Watts, A. G. (2005). Career guidance policy: An international review. The Career Development Quarterly, 54(1), 66–76. https://doi.org/10.1002/j.2161-0045.2005.tb00142.x.
Watts, A. G., & Sultana, R. G. (2004). Career guidance in 37 countries: Contrast and common themes. International Journal for Educational and Vocational Guidance, 4, 105–122. https://doi.org/10.1007/s10775-005-1025-y.
Whiston, S. C. (2002). Application of the principles: Career counseling and interventions. The Counseling Psychologist, 30(2), 218–237. https://doi.org/10.1177/0011000002302002.
Whiston, S. C., & Brecheisen, B. (2002). Evaluating the effectiveness of adult career development programs. In S. G. Niles (Ed.), Adult career development: Concepts, issues, and practices (3rd ed., pp. 367–384). Alexandria: National Career Development Association.
Whiston, S. C., Brecheisen, B. K., & Stephens, J. (2003). Does treatment modality affect career counseling effectiveness. Journal of Vocational Behavior, 62, 390–410. https://doi.org/10.1016/s0001-8791(02)00050-7.
Whiston, S. C., Li, Y., Mitts, N. G., & Wright, L. (2017). Effectiveness of career choice interventions: A meta-analytic replication and extension. Journal of Vocational Behavior, 100, 175–184. https://doi.org/10.1016/j.jvb.2017.03.010.
Whiston, S. C., Sexton, T. L., & Lasoff, D. L. (1998). Career-intervention outcome: A replication and extension of Oliver and Spokane (1988). Journal of Counseling Psychology, 45(2), 150–165. https://doi.org/10.1037/0022-0167.45.2.150.
Yates, B. T. (1996). Analyzing costs, procedures, processes, and outcomes in human services. Thousand Oaks: Sage.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Whiston, S.C., Mitts, N.G., Li, Y. (2019). Evaluation of Career Guidance Programs. In: Athanasou, J.A., Perera, H.N. (eds) International Handbook of Career Guidance. Springer, Cham. https://doi.org/10.1007/978-3-030-25153-6_38
Download citation
DOI: https://doi.org/10.1007/978-3-030-25153-6_38
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-25152-9
Online ISBN: 978-3-030-25153-6
eBook Packages: EducationEducation (R0)