Abstract
Globalisation, increase of migration flows, and the concurrent worldwide competitiveness impose rethinking of testing and assessment procedures and practices in an international and multicultural context. This chapter reviews the methodological and practical implications for psychological assessment in the field of career guidance. The methodological implications are numerous and several aspects have to be considered, such as cross-cultural equivalence or construct, method, and item bias. Moreover, the construct of culture by itself is difficult to define and difficult to measure. In order to provide non-discriminatory assessment, counsellors should develop their clinical cross-cultural competencies, develop more specific intervention strategies, and respect cultural differences. Several suggestions are given concerning translation and adaptation of psychological instruments, developing culture specific measures, and the use of these instruments. More research in this field should use mixed methods, multi-centric designs, and consider emic and etic psychological variables. A multidisciplinary approach might also allow identifying culture specific and ecological meaningful constructs. Non-discriminatory assessment implies considering the influence and interaction of personal characteristics and environmental factors.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
American Psychological Association. (1990). Guidelines for providers of psychological services to ethnic, linguistic and culturally diverse populations. Washington, DC: Author, Board of Ethnic Minority Affairs, Task Force on the Delivery of Service to Ethnic Minority Populations.
Arbona, C. (2014). Career assessment. In F. T. L. Leong, L. Comas-Diaz, G. C. Nagayama Hall, V. C. McLoyd, & J. E. Trimble (Eds.), APA handbook of multicultural psychology (Vol. 2: Applications and training, pp. 215–230). Washington, DC: American Psychological Association. https://doi.org/10.1037/14187-013.
Armstrong, P. I., Hubert, L., & Rounds, J. (2003). Circular unidimensional scaling: A new look at group differences in interest structure. Journal of Counseling Psychology, 50, 297–308. https://doi.org/10.1037/0022-0167.50.3.297.
Association for Assessment in Counseling (2003). Standards for multicultural assessment (2nd ed.). Retrieved September 20, 2006, from http://aac.ncat.edu/resources/documents
Atitsogbe, K. A., Moumoula, I. A., Rochat, S., Antonietti, J.-Ph., & Rossier, J. (2018). Vocational interests and career indecision in Switzerland and Burkina Faso using the personal globe nventory and the career decision-making difficultires questionnaire. Journal of Vocational Behavior, 107, 126–140. https://doi.org/10.1016/j.jvb.2018.04.002.
Baruth, L. G., & Manning, M. L. (1992). Multicultural education and children and adolescents. Needham Heights, MA: Allyn & Bacon.
Berry, J. (1969). On cross-cultural comparability. International Journal of Psychology, 4, 119–128. https://doi.org/10.1080/00207596908247261.
Blustein, D. (2006). The psychology of working. Mahwah, NJ: Lawrence Erlbaum Associates.
Busacca, L. A., & Rehfuss, M. C. (Eds.). (2017). Postmodern career counseling: A handbook of culture, context, and cases. Alexandria, VA: American Counseling Association.
Butcher, J. N. (1996). Translation and adaptation of the MMPI-2 for international use. In J. N. Butcher (Ed.), International adaptations of the MMPI-2 (pp. 26–43). Minneapolis, MN: University of Minnesota Press.
Byrne, B. M. (2016). Multigroup comparisons: Testing for measurement, strutural, and latent mean equivalence. In F. T. L. Leong, D. Bartram, F. M. Cheung, K. F. Geisinger, & D. Iliescu (Eds.), The ITC international handbook of testing and assessment (pp. 377–394). Oxford: Oxford University Press.
Cattell, R. (1940). A culture-free intelligence test, I. Journal of Educational Psychology, 31, 176–199. https://doi.org/10.1037/h0059043.
Cattell, R., & Cattell, A. (1963). Culture fair intelligence test. Champaing, IL: Institute for Personality and Ability Testing.
Collins, S., & Arthur, N. (2010). Culture-infused counselling: A model for developing multicultural competence. Counselling Psychology Quarterly, 23, 217–233. https://doi.org/10.1080/09515071003798212.
Cronbach, L. (1990). Essentials of psychological testing (5th ed.). New York: Harper Collins.
du Toit, R., & De Bruin, G. P. (2002). The structural validity of Holland’s model of vocational personality types for young Black South African men and women. Journal of Career Assessment, 10, 62–77. https://doi.org/10.1177/1069072702010001004.
Duarte, M. E. (1993). Preocupações de carreira, valores e saliência das actividades em adultos empregados [Career concerns, values and role salience in employed adults]. Doctoral dissertation, University of Lisbon, Portugal.
Duarte, M. E. (1995). Career concerns, values and role salience in employed men. The Career Development Quarterly, 43, 338–349. https://doi.org/10.1002/j.2161-0045.1995.tb00438.x.
Duarte, M. E. (2005). Assessment and “the global research village”: Adapting psychological instruments. International Journal for Educational and Vocational Guidance, 5, 163–173. https://doi.org/10.1007/s10775-005-8797-y.
Duarte, M. E. (2017). Career counseling research-practice disparities: What we know and what we need to know. South African Journal of Education, 37, 1–7. https://doi.org/10.15700/saje.v37n4a1486.
Duarte, M. E., & Rossier, J. (2008). Testing and assessment in an international context: Cross- and multi-cultural issues. In J. Athanasou & R. Van Esbroeck (Eds.), International handbook of career guidance (pp. 489–510). New York: Springer. https://doi.org/10.1007/978-1-4020-6230-8_24.
Einarsdóttir, S., Eyjólfsdóttir, K. Ó., & Rounds, J. (2013). Development of indigenous basic interest scales: Re-structuring the Icelandic interest space. Journal of Vocational Behavior, 82, 105–115. https://doi.org/10.1016/j.jvb.2013.01.001.
Fetvadjiev, V. H., Meiring, D., van de Vijver, F. J. R., Nel, J. A., & Hill, C. (2015). The South African personality inventory (SAPI): A culture-informed instrument for the country’s main ethnocultural groups. Psychological Assessment, 27, 827–837. https://doi.org/10.1037/pas0000078.
Flores, L. Y., & Bike, D. H. (2014). Multicultural career counseling. In F. T. L. Leong, L. Comas-Diaz, G. C. Nagayama Hall, V. C. McLoyd, & J. E. Trimble (Eds.), APA handbook of multicultural psychology (Vol. 2: Applications and training, pp. 403–417). Washington, DC: American Psychological Association. https://doi.org/10.1037/14187-023.
Fouad, N. A., & Byars-Winston, A. M. (2005). Cultural context of career choice: Meta-analysis of race/ethnicity differences. The Career Development Quarterly, 53, 223–233. https://doi.org/10.1002/j.2161-0045.2005.tb00992.x.
Gjersing, L., Caplehorn, J. R. M., & Clausen, T. (2010). Cross-cultural adaptation of research instruments: Language, setting, time and statistical considerations. BMC Medical Research Methodology, 10, 13. https://doi.org/10.1186/1471-2288-10-13.
Goldman, L. (1992). Qualitative assessment: An approach for counselors. Journal of Counseling & Development, 70, 616–621. https://doi.org/10.1002/j.1556-6676.1992.tb01671.x.
Gopaul-McNicol, S., & Armour-Thomas, E. (2002). Assessment and culture: Psychological tests with minority populations. San Diego, CA: Academic.
Guichard, J., & Lenz, J. (2005). Career theory from an international perspective. The Career Development Quarterly, 54, 17–28. https://doi.org/10.1002/j.2161-0045.2005.tb00137.x.
Hambleton, R. K. (1993). Translating achievement tests for use in cross-national studies. European Journal of Psychological Assessment, 9(1), 57–68.
Hambleton, R. K. (2001). The next generation of the ITC test translation and adaptation guidelines. European Journal of Psychological Assessment, 17, 164–172. https://doi.org/10.1027//1015-5759.17.3.164.
Hambleton, R. K. (2005). Issues, designs, and technical guidelines for adapting tests into multiple languages and cultures. In R. Hambleton, P. Merenda, & C. Spielberger (Eds.), Adapting educational and psychological tests for cross-cultural assessment (pp. 3–38). Mahwah, NJ: Lawrence Erlbaum Associates.
Hambleton, R. K., & Patsula, L. (1999). Increasing the validity of adapted tests: Myths to be avoided and guidelines for improving test adaptation practices. Journal of Applied Testing Technology, 1(2), 1–30. Retrived from http://www.jattjournal.com/index.php/atp/article/view/48345/39215.
Hambleton, R. K., Merenda, P., & Spielberger, C. (Eds.). (2005). Adapting educational and psychological tests for cross-cultural assessment. Mahwah, NJ: Lawrence Erlbaum Associates.
Hartung, P. (2005). Integrated career assessment and counseling. Mindsets, models, and methods. In W. B. Walsh & M. Savickas (Eds.), Handbook of vocational psychology (3rd ed., pp. 371–395). Mahwah, NJ: Lawrence Erlbaum Associates.
Hedrih, V., Stošić, M., Simić, I., & Ilieva, S. (2016). Evaluation of the hexagonal and spherical model of vocational interests in the young people in Serbia and Bulgaria. Psihologija, 49, 199–210. https://doi.org/10.2298/PSI1602199H.
Heim, E., Scholten, S., Maercker, A., Xiu, D., Cai, D., Gao, Z. H., … Margraf, J. (2017). Students’ value orientations in contemporary China: Analysis of measurement invariance and latent mean differences in comparison with students from Germany and Russia. Journal of Cross-Cultural Psychology, 48, 511–531. https://doi.org/10.1177/0022022117696800.
International Test Commission (2010). International test commission guidelines for translating and adapting tests. Retrived from http://www.intestcom.org
Jensen, A. (1980). Bias in mental testing. New York: Free Press.
Johnson, T. P., Shavitt, S., & Holbrook, A. L. (2011). Survey response style across cultures. In D. Matsumoto & F. J. R. van de Vijver (Eds.), Cross-cultural research methods in psychology (pp. 130–175). Cambridge: Cambridge University Press.
Kitayama, S. (2002). Culture and basic psychological processes—Toward a system view of culture: Comment on Oyserman et al. (2002). Psychological Bulletin, 128, 89–96. https://doi.org/10.1037//0033-2909.128.1.89.
Laher, S., & Cockcroft, K. (2017). Moving from culturally biased to culturally responsive assessment practices in low-resource, multicultural settings. Professional Psychology: Research and Practice, 48, 115–121. https://doi.org/10.1037/pro0000102.
Leong, F. T. L., & Brown, M. T. (1995). Theoretical issues in cross cultural career development: Cultural validity and cultural specificity. In W. B. Walsh & S. H. Osipow (Eds.), Handbook of vocational psychology (2nd ed., pp. 143–180). Hillsdale, NJ: Erlbaum.
Leong, F. T. L., & Pearce, M. (2014). Indigenous models of career development and vocational psychology. In G. Arulmani, A. J. Bakshi, F. T. L. Leong, & A. G. Watts (Eds.), Handbook of career development: International perspectives (pp. 67–79). New York: Springer. https://doi.org/10.1007/978-1-4614-9460-7_5.
Leong, F. T. L., & Walsh, W. B. (2012). Guest editors’ introduction to the special issue. Journal of Vocational Behavior, 80, 659–660. https://doi.org/10.1016/j.jvb.2012.03.003.
Leong, F. T. T., Bartram, D., Cheung, F., Geisinger, K. F., & Iliescu, D. (Eds.). (2016). The ITC international handbook of testing and assessment. Oxford: Oxford University Press.
Long, L., & Tracey, T. J. (2006). Structure of RIASEC scores in China: A structural meta-analysis. Journal of Vocational Behavior, 68, 39–51. https://doi.org/10.1016/j.jvb.2005.01.002.
Long, L., Watanabe, N., & Tracey, T. J. (2006). Structure of interests in Japan: Application of the personal globe inventory occupational scales. Measurement and Evaluation in Counseling and Development, 38, 222–235. https://doi.org/10.1080/07481756.2006.11909784.
Marsella, A. J., & Leong, F. T. L. (1995). Cross-cultural issues in personality and career assessment. Journal of Career Assessment, 3, 202–218. https://doi.org/10.1177/106907279500300207.
Masdonati, J., Schreiber, M., Marcionetti, J., & Rossier, J. (2019). Decent work in Switzerland: Context, conceptualization, and assessment. Journal of Vocational Behavior, 110, 12–27. https://doi.org/10.1016/j.jvb.2018.11.004.
Matsumoto, D., & Van de Vijver, F. J. R. (Eds.). (2011). Cross-cultural research methods in psychology. Cambridge: Cambridge University Press.
McCrae, R. R. (2017). The five-factor model across cultures. In A. T. Church (Ed.), The Praeger handbook of personality across cultures (Vol. 1, pp. 47–71). Santa Barbara, CA: Praeger Publisher.
Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58, 525–543. https://doi.org/10.1007/BF02294825.
Metz, A. J., Fouad, N., & Ihle-Helledy, K. (2009). Career aspirations and expectations of college students: Demographic and labor market comparisons. Journal of Career Assessment, 17, 155–171. https://doi.org/10.1177/1069072708328862.
Millsap, R. E. (2011). Statistical approaches to measurement invariance. New York: Routledge.
Munroe, R. H., Munroe, R. L., & Whiting, B. B. (Eds.). (1981). Handbook of cross-cultural human development. New York: Garland.
Naglieri, J. A. (2016). Naglieri nonverbal ability test (3rd ed.). San Antonio, TX: Pearson.
Oakland, T. (2004). Use of educational and psychological tests internationally. Applied Psychology: An International Review, 53, 157–172. https://doi.org/10.1111/j.1464-0597.2004.00166.x.
OECD. (2017). International migration outlook 2017. Paris: OECD Publishing. https://doi.org/10.1787/migr_outlook-2017-en.
Osborn, D. S. (2012). An international discussion about cross-cultural career assessment. International Journal for Educational and Vocational Guidance, 12, 5–16. https://doi.org/10.1007/s10775-012-9220-0.
Raykov, T., Marcoulides, G. A., & Li, C.-H. (2012). Measurement invariance for latent constructs in multiple populations: A critical view and refocus. Educational and Psychological Measurement, 72, 954–974. https://doi.org/10.1177/0013164412441607.
Ribeiro, M. A., Pereira Teixeira, M. A., & Ambiel, R. A. M. (2019). Decent work in Brazil: Context, conceptualization, and assessment. Journal of Vocational Behavior, 112, 229–240. https://doi.org/10.1016/j.jvb.2019.03.006.
Rossier, J. (2005). A review of cross-cultural equivalence of frequently used personality inventories. International Journal for Educational and Vocational Guidance, 5, 175–188. https://doi.org/10.1007/s10775-005-8798-x.
Rossier, J. (2015). Career adaptability and life designing. In L. Nota & J. Rossier (Eds.), Handbook of life design (pp. 153–167). Boston, MA: Hogrefe.
Rossier, J., & Fiori, M. (in press). Career assessment in Europe: Overview and current trends. In: K. B. Stoltz & S. R. Barclay (Eds.), A counselor’s guide to comprehensive career assessments (7th ed.). Broken Arrow: NCDA.
Rossier, J., Ouedraogo, A., Dahourou, D., Verardi, S., & Meyer de Stadelhofen, F. (2013). Personality and personality disorders in urban and rural Africa: Results from a field trial in Burkina Faso. Frontiers in Psychology, 4, 79. https://doi.org/10.3389/fpsyg.2013.00079.
Rossier, J., Aluja, A., Blanch, A., Barry, O., Hansenne, M., Carvalho, A., … Karagonlar, G., (2016). Cross-cultural generalizability of the alternative five-factor model using the Zuckerman-Kuhlman-Aluja personality questionnaire. European Journal of Personality, 30, 139–157.:https://doi.org/10.1002/per.2045.
Rossier, J., Ouedraogo, A., & Dahourou, D. (2017). Personality structure and assessment in French-speaking African cultures. In A. T. Church (Ed.), The Praeger handbook of personality across cultures (Vol. 1, pp. 73–103). Santa Barbara, CA: Praeger Publisher.
Rounds, J., & Tracey, T. J. (1996). Cross-cultural structural equivalence of RIASEC models and measures. Journal of Counseling Psychology, 43, 310–329. https://doi.org/10.1037/0022-0167.43.3.310.
Ryan, J. M., Tracey, T. J. G., & Rounds, J. (1996). Generalizability of Holland’s structure of vocational interest across ethnicity, gender, and socioeconomic status. Journal of Counseling Psychology, 43, 330–337. https://doi.org/10.1037/0022-0167.43.3.330.
Savickas, M. (1989). Career-style assessment and counseling. In T. Sweeney (Ed.), Adlerian counseling: A practical approach for a new decade (3rd ed., pp. 289–320). Muncie, IN: Accelerated Development Press.
Savickas, M. (2004). The theory and practice of career construction. In S. Brown & R. Lent (Eds.), Career development and counseling: Putting theory and research to work (pp. 42–70). Hoboken, NJ: Wiley.
Savickas, M. L., & Porfeli, E. (2012). Career adapt-abilities scale: Construction, reliability, and measurement equivalence across 13 countries. Journal of Vocational Behavior, 80, 661–673. https://doi.org/10.1016/j.jvb.2012.01.001.
Savickas, M., Van Esbroeck, R., & Herr, E. (2005). The internationalization of educational and vocational guidance. The Career Development Quarterly, 54, 77–85. https://doi.org/10.1002/j.2161-0045.2005.tb00143.x.
Savickas, M. L., Nota, L., Rossier, J., Dauwalder, J.-P., Duarte, E., Guichard, J., … van Vianen, A. E. M. (2009). Life designing: A paradigm for career construction in the 21st century. Journal of Vocational Behavior, 75, 239–250. https://doi.org/10.1016/j.jvb.2009.04.004.
Schwabe, F., von Davier, A. A., & Chalhoub-Deville, M. (2016). Language and culture in testing. In F. T. T. Leong, D. Bartram, F. Cheung, K. F. Geisinger, & D. Iliescu (Eds.), The ITC international handbook of testing and assessment (pp. 300–317). Oxford: Oxford University Press.
Schwartz, S. H. (1992). Universals in the content and structure of values: Theoretical advances and empirical tests in 20 countries. In M. P. Zanna (Ed.), Advances in experimental social psychology (Vol. 25, pp. 1–65). San Diego: Academic.
Schwartz, S. H. (2017). Individual values across cultures. In A. T. Church (Ed.), The Praeger handbook of personality across cultures (Vol. 2, pp. 121–152). Santa Barbara, CA: Praeger Publisher.
Schwartz, S. H., & Bilsky, W. (1990). Toward a theory of the universal content and structure of values: Extensions and cross-cultural replications. Journal of Personality and Social Psychology, 58, 878–891. https://doi.org/10.1037/0022-3514.58.5.878.
Schwartz, S. H., & Sagiv, L. (1995). Identifying culture-specifics in the content and structure of values. Journal of Cross-Cultural Psychology, 26, 92–116. https://doi.org/10.1177/0022022195261007.
Stoltz, K. B., & Barclay, S. R. (Eds.). (in press). A counselor’s guide to comprehensive career assessments (7th ed.). Broken Arrow, OK: NCDA.
Strauss, M. E., & Smith, G. T. (2009). Construct validity: Advances in theory and methodology. Annual Review of Clinical Psychology, 5, 1–25. https://doi.org/10.1146/annurev.clinpsy.032408.153639.
Super, D. (1990). A life-span, life-space approach to career development. In D. Brown & L. Brooks (Eds.), Career choice and development (2nd ed., pp. 197–261). San Francisco, CA: Jossey-Bass.
Super, D., & Šverko, B. (1995). Life roles, values and careers. San Francisco, CA: Jossey-Bass.
Super, D., Thompson, A., & Lindeman, R. (1985). The adult career concerns inventory. Palo Alto, CA: Consulting Psychologists Press.
Tracey, T. J. G. (2002). Personal globe inventory: Measurement of the spherical model of interests and competence beliefs. Journal of Vocational Behavior, 60, 113–172. https://doi.org/10.1006/jvbe.2001.1817.
Van de Vijver, F. J. R. (2000). The nature of bias. In R. H. Dana (Ed.), Handbook of cross-cultural and multicultural personality assessment (pp. 87–106). Mahwah, NJ: Lawrence Erlbaum Associates.
Van de Vijver, F. J. R. (2015). Methodological aspects of cross-cultural research. In M. Gelfand, C.-Y. Chiu, & Y.-Y. Hong (Eds.), Handbook of advances in culture and psychology (Vol. 5, pp. 101–160). New York: Oxford University Press.
Van de Vijver, F. J. R., & Hambleton, R. (1996). Translating tests: Some practical guidelines. European Psychologist, 1, 89–99. https://doi.org/10.1027/1016-9040.1.2.89.
Van de Vijver, F., & Leung, K. (1997). Methods and data analysis for cross-cultural research. Newbury Park, CA: Sage.
Van de Vijver, F. J. R., & Leung, K. (2011). Equivalence and bias: A review of concepts, models, and data analytic procedures. In D. Matsumoto & F. J. R. van de Vijver (Eds.), Cross-cultural research methods in psychology (pp. 17–45). Cambridge: Cambridge University Press.
Van de Vijver, F. J. R., & Matsumoto, D. (2011). Introduction to the methodological issues associated with cross-cultural research. In D. Matsumoto & F. J. R. van de Vijver (Eds.), Cross-cultural research methods in psychology (pp. 1–14). Cambridge: Cambridge University Press.
Van de Vijver, F. J. R., & Poortinga, Y. H. (2002). On the study of culture in developmental science. Human Development, 45, 246–256. https://doi.org/10.1159/000064985.
Vygotsky, L. (1987). The collected works of L. S. Vygotsky (Vol. 1). New York: Plenum.
Warner, O., & Campbell, D. T. (1970). Translating, working through interpreters, and the problem of decentering. In R. Naroll & R. Cohen (Eds.), A handbook of cultural anthropology (pp. 398–419). New York: American Museum of Natural History.
Watson, M., Duarte, M. E., & Glavin, K. (2005). Cross-cultural perspectives on career assessment. The Career Development Quarterly, 54, 29–35. https://doi.org/10.1002/j.2161-0045.2005.tb00138.x.
Wechsler, D., & Naglieri, J. A. (2006). Wechsler nonverbal scale of ability (WNV). San Antonio, TX: Pearson.
Wonderlic Inc. (1983). Wonderlic personnel test manual. Northfield, IL: Author.
Yasui, M. (2015). The cultural ecogram: A tool for enhancing culturally anchored shared understanding in the treatment of ethnic minority families. Journal of Ethnic & Cultural Diversity in Social Work, 24, 89–108. https://doi.org/10.1080/15313204.2014.991980.
Zercher, F., Schmidt, P., Cieciuch, J., & Davidov, E. (2015). The comparability of the universalism value over time and across countries in the European social survey: Exact vs. approximate measurement invariance. Frontiers in Psychology, 6, 733. https://doi.org/10.3389/fpsyg.2015.00733.
Acknowledgments
The contribution of Jérôme Rossier was made partly within the framework of the National Centre of Competence in Research-LIVES financed by the Swiss National Science Foundation (grant no 51NF40-160590).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Rossier, J., Duarte, M.E. (2019). Testing and Assessment in an International Context: Cross- and Multi-cultural Issues. In: Athanasou, J.A., Perera, H.N. (eds) International Handbook of Career Guidance. Springer, Cham. https://doi.org/10.1007/978-3-030-25153-6_28
Download citation
DOI: https://doi.org/10.1007/978-3-030-25153-6_28
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-25152-9
Online ISBN: 978-3-030-25153-6
eBook Packages: EducationEducation (R0)