Abstract
The BFI-44 and BFI-10 are widely used, open-source measures of the Big Five Model of personality. Exploratory factor analyses and exploratory structural equation modeling produce models with non-negligible cross-loadings, creating unclear factor structures and confounded validity evidence. Further, no studies have independently confirmed the structural validity of the scale using confirmatory factor analyses. In Study 1, with a sample of community members (n = 345), we demonstrated that the BFI-44 and BFI-10 fail to demonstrate acceptable data-model fit and contain an excessive number of correlational residual statistics (i.e., BFI-44: 36%; BFI-10: 42%). In Study 2, with a sample of undergraduate students (n = 110), we created a version of the BFI-10 with strong structural and construct validity, the BFI-10-R. Using an EFA, we selected the top two items from the BFI-44 for each Big Five trait with the strongest loadings onto their factor and with the weakest cross-loadings. We then confirmed the new 10-item factor structure using a confirmatory factor analysis and found a model with strong global and local fit in both samples. This new model had few significant correlational residual statistics, strong convergent and divergent validity, and strong internal consistency. Researchers may consider using the BFI-10-R in place of the BFI-10 due to its preferable psychometric properties.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Availability of Data and Material
All data and materials are freely available on the Open Science Framework website (https://osf.io/zga69/?view_only=4047d9889a8847d4a5b35687f31cd6a8).
Code Availability
The CFA R code is freely available on the Open Science Framework website (https://osf.io/zga69/?view_only=4047d9889a8847d4a5b35687f31cd6a8).
References
Aichholzer, J. (2014). Random intercept EFA of personality scales. Journal of Research in Personality, 53, 1–4. https://doi.org/10.1016/j.jrp.2014.07.001
Arterberry, B. J., Martens, M. P., Cadigan, J. M., & Rohrer, D. (2014). Application of generalizability theory to the Big Five Inventory. Personality and Individual Differences, 69, 98–103. https://doi.org/10.1016/j.paid.2014.05.015
Ashton, M. C., & Lee, K. (2009). The HEXACO-60: A short measure of the major dimensions of personality. Journal of Personality Assessment, 91, 340–345.
Barlow, D. H. (2000). Unraveling the mysteries of anxiety and its disorders from the perspective of emotion theory. American Psychologist, 55, 1247–1263. https://doi.org/10.1037//0003-066x.55.11.1247
Barlow, D. H. (2002). Anxiety and its disorders: The nature and treatment of anxiety and panic. Guilford Press.
Barrick, M. R., & Mount, M. K. (1991). The big five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44(1), 1–26. https://doi.org/10.1111/j.1744-6570.1991.tb00688.x
Benet-Martínez, V., & John, O. P. (1998). Los Cinco Grandes across cultures and ethnic groups: Multitrait-multimethod analyses of the Big Five in Spanish and English. Journal of Personality and Social Psychology, 75(3), 729–750. https://doi.org/10.1037/0022-3514.75.3.729
Bentler, P. M., & Chou, C. P. (1987). Practical Issues in Structural Modeling. Sociological Methods & Research, 16(1), 78–117. https://doi.org/10.1177/0049124187016001004
Bollen, K. A. (1989). Structural equations with latent variables. John Wiley.
Boomsma, A. (1982). Robustness of LISREL against small sample sizes in factor analysis models. In K. G. Joreskog & H. Wold (Eds.), Systems under indirection observation: Causality, structure, prediction (Part I) (pp. 149–173). North Holland.
Booth, T., & Hughes, D. J. (2014). Exploratory structural equation modeling of personality data. Assessment, 21(3), 260–271. https://doi.org/10.1177/1073191114528029
Chiorri, C., Marsh, H. W., Ubbiali, A., & Donati, D. (2016). Testing the factor structure and measurement invariance across gender of the Big Five Inventory through exploratory structural equation modeling. Journal of Personality Assessment, 98(1), 88–99. https://doi.org/10.1080/00223891.2015.1035381
Church, T. A., & Burke, P. J. (1994). Exploratory and confirmatory tests of the big five and tellegen’s three- and four-dimensional models. Journal of Personality and Social Psychology, 66, 93–114. https://doi.org/10.1037//0022-3514.66.1.93
Costello, A. B., & Osborn, J. W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation, 10(7), 1–9.
Denissen, J. J. A., Geenen, R., van Aken, M. A. G., Gosling, S. D., & Potter, J. (2008). Development and validation of a Dutch translation of the Big Five Inventory (BFI). Journal of Personality Assessment, 90(2), 152–157. https://doi.org/10.1080/00223890701845229
DiStefano, C., & Morgan, G. B. (2014). A comparison of diagonal weighted least squares robust estimation techniques for ordinal data. Structural Equation Modeling: A Multidisciplinary Journal, 21(3), 425–438. https://doi.org/10.1080/10705511.2014.915373
Eisinga, R., te Grotenhuis, M., & Pelzer, B. (2012). The reliability of a two-item scale: Pearson, Cronbach, or Spearman-Brown? International Journal of Public Health, 58(4), 637–642. https://doi.org/10.1007/s00038-012-0416-3
Feher, A., & Vernon, P. A. (2020). Looking beyond the big five: A selective review of alternatives to the big five model of personality. Personality and Individual Differences. https://doi.org/10.1016/j.paid.2020.110002
Fossati, A., Borroni, S., Marchione, D., & Maffei, C. (2011). The [CAB1] Big Five Inventory (BFI): Reliability and validity of its Italian translation in three independent nonclinical samples. European Journal of Psychological Assessment, 27(1), 50–58. https://doi.org/10.1027/1015-5759/a000043.
Goldberg, L. R. (1990). An alternative “description of personality”: The big-five factor structure. Journal of Personality and Social Psychology, 59(6), 1216–1229. https://doi.org/10.1037//0022-3514.59.6.1216
Hettema, J. M., Neale, M. C., Myers, J. M., Prescott, C. A., & Kendler, K. S. (2006). A population-based twin study of the relationship between neuroticism and internalizing disorders. American Journal of Psychiatry, 163(5), 857–864. https://doi.org/10.1176/appi.ajp.163.5.857
Hirschfeld, G., Brachel, R. von, & Thielsch, M. (2014). Selecting items for Big Five questionnaires: At what sample size do factor loadings stabilize? Journal of Research in Personality, 53, 54–63. https://doi.org/10.1016/j.jrp.2014.08.003
Hřebíčková, M., Jelínek, M., Blatný, M., Brom, C., Burešová, I., Graf, S., Mejzlíková, T., Vazsonyi, A. T., & Zábrodská, K. (2016). Big Five Inventory: Basic psychometric properties of the Czech version of BFI-44 and BFI-10. Československá Psychologie: Časopis pro Psychologickou Teorii a Praxi, 60(6), 567–583.
Jerram, K. L., & Coleman, P. G. (1999). The big five personality traits and reporting of health problems and health behaviour in old age. British Journal of Health Psychology, 4(2), 181–192. https://doi.org/10.1348/135910799168560
John, O. P., & Srivastava, S. (1999). The Big Five trait taxonomy: History, measurement, and theoretical perspectives. In L. A. Pervin & O. P. John (Eds.), Handbook of personality: Theory and research (2nd ed., pp. 102–138). Guilford Press.
John, O. P., Donahue, E. M., & Kentle, R. L. (1991). The Big Five Inventory-Versions 4a and 54. University of California, Berkeley, Institute of Personality and Social Research.
Judge, T. A., & Bono, J. E. (2000). Five-factor model of personality and transformational leadership. Journal of Applied Psychology, 85(5), 751–765. https://doi.org/10.1037/0021-9010.85.5.751
Kendler, K. S., Gatz, M., Gardner, C. O., & Pedersen, N. L. (2006). Personality and major depression: A Swedish longitudinal, population-based twin study. Archive of General Psychiatry, 63(10), 1113–1120. https://doi.org/10.1001/archpsyc.63.10.1113
Kim, H. (2013). Statistical notes for clinical researchers: Assessing normal distribution using skewness and kurtosis. Restorative Dentistry & Endodontics, 38(1), 52–54. https://doi.org/10.5395/rde.2013.38.1.52
Kline, R. B. (2016). Principles and practice of structural equation modeling (4th ed.). Guilford Press.
Li, C.-H. (2015). Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares. Behavior Research Methods, 48(3), 936–949. https://doi.org/10.3758/s13428-015-0619-7
Malouff, J. M., Thorsteinsson, E. B., & Schutte, N. S. (2005). The Relationship Between the Five-Factor Model of Personality and Symptoms of Clinical Disorders: A Meta-Analysis. Journal of Psychopathology and Behavioral Assessment, 27(2), 101–114. https://doi-org.proxy.lib.siu.edu/10.1007/s10862-005-5384-y
Malouff, J. M., Thorsteinsson, E. B., Schutte, N. S., Bhullar, N., & Rooke, S. E. (2010). The Five-Factor Model of personality and relationship satisfaction of intimate partners: A meta-analysis. Journal of Research in Personality, 44(1), 124–127. https://doi.org/10.1016/j.jrp.2009.09.004
McCrae, R. R., & Costa, P. T., Jr. (2008). The five-factor theory of personality. In O. P. John, R. W. Robins, & L. A. Pervin (Eds.), Handbook of personality: Theory and research (pp. 159–181). The Guilford Press.
Noftle, E. E., & Robins, R. W. (2007). Personality predictors of academic outcomes: Big Five correlates of GPA and SAT scores. Journal of Personality and Social Psychology, 93(1), 116–130. https://doi.org/10.1037/0022-3514.93.1.116
Nunnally, J. C. (1967). Psychometric Theory. McGraw-Hill.
Orr, J. M., Sackett, P. R., & Dubois, C. L. (1991). Outlier detection and treatment in I/O psychology: A survey of researcher beliefs and an empirical illustration. Personnel Psychology, 44(3), 473–486. https://doi.org/10.1111/j.1744-6570.1991.tb02401.x
Ozer, D. J., & Benet-Martinez, V. (2006). Personality and the prediction of consequential outcomes. Annual Review of Psychology, 57, 401–421. https://doi.org/10.1146/annurev.psych.57.102904.190127
Rammstedt, B., & John, O. P. (2007). Measuring personality in one minute or less: A 10-item short version of the Big Five Inventory in English and German. Journal of Research in Personality, 41, 203–212. https://doi.org/10.1016/j.jrp.2006.02.001
Rosseel, Y. (2012). Lavaan: An R Package for Structural Equation Modeling. Journal of Statistical Software, 48(2), 1–36. https://doi.org/10.18637/jss.v048.i02
Steel, P., Schmidt, J., & Shultz, J. (2008). Refining the relationship between personality and subjective well-being. Psychological Bulletin, 134(1), 138–161. https://doi-org.proxy.lib.siu.edu/10.1037/0033-2909.134.1.138
Worrell, F. C., & Cross, W. E. (2004). The reliability and validity of Big Five Inventory scores with African American college students. Journal of Multicultural Counseling and Development, 32, 18–32. https://doi.org/10.1002/j.2161-1912.2004.tb00358.x
Yang-Wallentin, F., Joreskog, K., & Luo, H. (2010). Confirmatory factor analysis of ordinal variables with misspecified Models. Structural Equation Modeling: A Multidisciplinary Journal, 17(3), 392–423. https://doi.org/10.1080/10705511.2010.489003
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Ethics Approval
This study was approved by the Institutional Review Board at Southern Illinois University, Carbondale.
Consent for Publication
All authors have approved the submission and publication of the current manuscript.
Preregistration
This study and the data analysis plan were not preregistered.
Conflicts of Interest/Competing Interests
Bryant M. Stone, Emily M. Bartholomay, and Amanda B. Chamberlain declare that there are no conflicts of interest or competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Stone, B.M., Bartholomay, E.M. & Chamberlain, A.B. Validation of the BFI-10-R: A New BFI Scale with Strong Structural and Construct Validity. J Psychopathol Behav Assess 44, 1064–1076 (2022). https://doi.org/10.1007/s10862-022-09978-4
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10862-022-09978-4