Abstract
Measuring attitudes towards gender roles in comparative research is a challenging task. This paper aims at assessing the content validity and cross-cultural measurement invariance of the scales measuring attitudes towards gender roles in two large-scale comparative surveys, the International Social Survey Program 2002 and the World Values Survey 2005. The two scales are widely used in cross-cultural studies, they complement each other in measuring the complex concept of attitudes towards gender roles, and they cover an extensive number of European and non-European countries, allowing for the assessment of measurement invariance in different cultural settings. We assess the content by confronting the items included in the two surveys with the theoretical definitions employed by the literature, and we test for the cross-cultural measurement invariance by multigroup confirmatory factor analysis. According to our results, these scales are only partially valid in measuring the complex concept of attitudes towards gender roles. Moreover, the two scales are configural and metric invariant in all countries included in our analysis, but they are not scalar invariant. The two scales are suitable for testing relations between attitudes towards gender roles and other theoretically relevant concepts, but they are not useful for comparing the level of support for gender equality across countries.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Alesina, A., Giuliano, P., & Nunn, N. (2011). On the origins of gender roles: Women and the Plough. IZA Discussion Paper No. 5735.
Alwin, D. (2005). Attitudes, beliefs, and childbearing. In A. Booth & A. C. Crouter (Eds.), The new population problem: Why families in developed countries are shrinking and what it means (pp. 115–126). Mahwah, NJ: Erlbaum.
Alwin, D., Scott, J., et al. (1994). Sex-role attitude change in the United States, Britain, and Germany. Bielefeld, Germany: World Congress of Sociology.
Baxter, J., Hewitt, B. et al. (2004). Transitions Through the Life Course and Time Spent on Housework 99th Annual Meeting of the American Sociological Association. San Francisco.
Baxter, J., & Kane, Emily W. (1995). Dependence and independence: A cross-national analysis of gender inequality and gender attitudes. Gender and Society, 9, 193–215.
Beere, C. A., King, D. W., Beere, D. B., & King, L. A. (1984). The sex-role egalitarianism scale: a measure of attitudes toward equality between the sexes. Sex Roles, 10, 563–576.
Behr, D., Braun, M., Kaczmirek, L., & Bandilla, W. (2013). Testing the validity of gender ideology items by implementing probing questions in web surveys. Field Methods, 25(2), 124–141.
Bergh, J. (2006). Gender attitudes and modernization processes. International Journal of Public Opinion Research, 19, 5–23.
Bollen, K. A. (1989). Structural equations with latent variables. New York: Wiley.
Braun, M. (2008). Using egalitarian items to measure men's and women's family roles. Sex Roles, 59, 644–656.
Cunningham, M., et al. (2005). Reciprocal relationship between attitudes about gender and social context during young adulthood. Social Science Research, 34(4), 862–892.
Davidov, E. (2010). Testing for comparability of human values across countries and time with the third round of the European Social Survey. International Journal of Comparative Sociology, 51(3), 171–191.
Duncan, S. (1994). Theorizing difference in patriarchy. Environment and Planning A, 26, 1177–1194.
Halman, L., Sieben, I., & van Zundert, M. (2011). Atlas of European values. Brill: Trends and Traditions at the turn of the Century. Leiden.
Horn, J. L., & McArdle, J. J. (1992). A practical and theoretical guide to measurement invariance in aging research. Experimental Aging Research, 18, 117–144.
Hui, C. H., & Triandis, H. C. (1985). Measurement in cross-cultural psychology. A review and comparison of strategies. Journal of Cross-Cultural Psychology, 16, 131–152.
Inglehart, R., & Norris, P. (2003). Rising tide. gender equality and cultural change around the world. Cambridge, New York: Cambridge University Press.
Inglehart, R., Norris, P., & Welzel, C. (2002). Gender equality and democracy. Comparative Sociology, 1(3–4), 321–345.
Jakobsson, N., & Kotsadam, A. (2010). Do attitudes toward gender equality really differ between Norway and Sweden? Journal of European Social Policy, 20(2), 142–159.
Jelen, T. (1988). The effect of gender role stereotypes on political attitudes. Social Science Journal, 25(3), 353–365.
Joreskog, K. G. (1971). Simultaneous factor analysis in several populations. Psychometrika, 36, 409–426.
Kalmijn, M. (2005). Attitude alignment in marriage and cohabitation: The case of sex-role attitudes. Personal Relationships, 12, 521–535.
Kankaraš, M., Moors, G., & Vermunt, J. (2010). Testing for measurement invariance with latent class analysis. In E. Davidov, P. Schmidt, & J. Billiet (Eds.), Cross-cultural analysis: methods and applications (pp. 359–384). London: Routledge Academic.
Kroska, A., & Elman, C. (2009). Change in attitudes about employed mothers: Exposure, interests, and gender ideology discrepancies. Social Science Research, 38, 366–382.
Larsen, K. S., & Long, E. (1988). Attitudes toward sex-roles: traditional or egalitarian? Sex Roles, 19, 1–12.
Lu, Y. H. (1993). Sex-roles attitudes and the employment of married women—a detroit area study. Journal of Women and Gender Studies, 4, 137–174.
McInnes, J. (1998). Analyzing patriarchy capitalism and women’s employment in Europe. Innovation: The European Journal of Social Science Research, 11(2), 227–248.
Motiejunaite, A., & Kravchenko, Z. (2008). Family policy, employment and gender-role attitudes: a comparative analysis of Russia and Sweden. Journal of European Social Policy, 18(1), 38–49.
Panayatova, E., & Brayfield, A. (1997). National context and gender ideology: Attitudes towards women’s employment in Hungary and the United States. Gender & Society, 11, 627–655.
Pfau-Effinger, B. (1993). Modernization, culture part-time employment: The example of Finland and West Germany. Work, Employment & Society, 7(3), 383–410.
Pfau-Effinger, B. (2004). Development of culture, welfare states and women’s employment in Europe. Aldershot: Ashgate.
Poortinga, Y. H. (1989). Equivalence of cross cultural data: an overview of basic issues. International Journal of Psychology, 24, 737–756.
Poortinga, Y. H., & van de Vijver, F. J. R. (1987). Cultural bias and the interpretation of test scores. In C. Schwarzer & B. Seipp (Eds.), Trends in European educational research (pp. 13–21). Braunschweig: Blankenstein.
Schutz Lee, K., Tufis, P., & Alwin, D. (2010). Separate Sphere or Increasing Equality? Changing gender Beliefs in Postwar Japan. Journal of Marriage and Family, 72(1), 184–201.
Scott, J., & Braun, M. (2009). Changing public views of gender roles in seven nations 1988–2002. In M. Haller, R. Jowell, & T. Smith (Eds.), Charting the globe. The International Social Survey Programme 1984–2009. London: Routledge.
Sjöberg, O. (2004). the role of family policy institutions in explaining gender-role attitudes: A comparative multilevel analysis of thirteen industrialized countries. Journal of European Social Policy, 14(2), 107–123.
Sjöberg, O. (2010). Ambivalent attitudes, contradictory institutions: ambivalence in gender-role attitudes in comparative perspective. International Journal of Comparative Sociology, 51(1–2), 33–57.
Steenkamp, J. E. M., & Baumgartner, H. (1998). Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research, 25(1), 78–107. doi:10.1086/209528.
Van de Vijver, F. J. R. (1998). Towards a theory of Bias and equivalence. ZUMA-Nachrichten Spezial, 3, 41–65.
Van de Vijver, F. J. R., & Poortinga, Y. H. (1982). Cross-cultural generalization and universality. Journal of Cross-Cultural Psychology, 13(4), 387–408.
Walby, S. (1994). Methodological and theoretical issues in the comparative analysis of gender relations in Western Europe. Environment and Planning A, 26(9), 1339–1354.
Wilcox, C., & Jelen, T. (1991). The Effect of Employment and religion on Women’s feminist Attitudes. International Journal for the Psychology of Religion, 1(3), 161–171.
Wrigley, J. (2005). Education and gender equality. London: Taylor & Francis.
Yuchtman-Yaar, E., & Alkalay, Y. (2007). Religious zones, economic development and modern value orientations: Individual versus contextual effects. Social Science Research, 36, 789–807.
Zvonkovic, A. M., et al. (1996). The martial construction of gender through work and family decisions: A qualitative analysis. Journal of Marriage and Family, 58(1), 91–100.
Acknowledgments
An earlier version of this article was presented at The Second International Sociological Association Forum of Sociology, Buenos Aires, 01-04.08 2012. We are indebted to Professor Hans-Jürgen Andreß, Paula Tufiş, Bogdan Voicu, and to the Social Indicators Research’s anonymous reviewers for helpful comments on this paper. Both authors have equally contributed to this paper.
Author information
Authors and Affiliations
Corresponding author
Additional information
Andreea Constantin and Malina Voicu have contributed equally to this work.
Appendix
Appendix
Rights and permissions
About this article
Cite this article
Constantin, A., Voicu, M. Attitudes Towards Gender Roles in Cross-Cultural Surveys: Content Validity and Cross-Cultural Measurement Invariance. Soc Indic Res 123, 733–751 (2015). https://doi.org/10.1007/s11205-014-0758-8
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11205-014-0758-8