Abstract
Mediation analysis helps explain how and why two variables are related, providing information for investigating causal processes useful for theoretical and applied research (MacKinnon 2008). Inference from mediation analysis typically applies to the population, but researchers and clinicians are often interested in making inference to individual clients or small sub-populations of people. Person-oriented approaches focus on the differences between people, or latent groups of people, to ask how individuals differ across variables. A recently proposed method allows for the analysis of person differences as part of mediation. The method from configural frequency analysis, which we call configural frequency mediation, is based on log-linear modeling of contingency tables. The complexity of configural frequency mediation and its use of a causal steps mediation method, may contribute to the lack of application and study of this promising method since its introduction in the literature a decade ago (von Eye et al. 2009, 2010) In this paper we clarify the steps used for configural frequency mediation and report the results of a large statistical simulation study evaluating the method and comparing it to the variable-oriented traditional method using logistic regression analysis. Overall, configural frequency mediation analysis tended to have excessive type I error rates but we describe an alternative approach to configural mediation analysis based on a joint significance test that had adequate performance. We also clarify the decision rules that define configural mediation analysis and develop a test for configural frequency mediation using a joint significance mediation method.
Similar content being viewed by others
References
Aiken, L. S., West, S. G., & Reno, R. R. (1991). Multiple regression: Testing and interpreting interactions. Sage.
Baron, R. M., & Kenny, D. A. (1986). The moderator–mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology, 51(6), 1173–1182.
Bergman, L. R. (2009). Mediation and causality at the individual level. Integrative Psychological and Behavioral Science, 43(3), 248–252. https://doi.org/10.1007/s12124-009-9102-2.
Bergman, L. R., & Magnusson, D. (1997). A person-oriented approach in research on developmental psychopathology. Development and Psychopathology, 9(2), 291–319.
Bergman, L. R., Eklund, G., & Magnusson, D. (1991). Studying individual development; problems and methods. In D. Magnusson, L. R. Bergman, G. Rudinger, & B. Törestad (Eds.), Problems and methods in longitudinal research: Stability and change (pp. 1–27). Cambridge: Cambridge University Press.
Block, J. (1995). A contrarian view of the five-factor approach to personality description. Psychological Bulletin, 117(2), 187–215.
Block, J. (2014). Lives through time. New York: Psychology Press (Original work published 1971).
Bogat, G. A., von Eye, A., & Bergman, L. R. (2016). Person-oriented approaches. In D. Cicchetti (Ed.), Developmental psychopathology volume one: Theory and method (Vol. 1, pp. 797–841). Hoboken: Wiley.
Bradley, J. V. (1978). Robustness? British Journal of Mathematical and Statistical Psychology, 31(2), 144–152.
Brook, R. H. (2011). Can the Patient-Centered Outcomes Research Institute become relevant to controlling medical costs and improving value? JAMA, 306(18), 2020–2021. https://doi.org/10.1001/jama.2011.1621.
Chen, H. T. (1990). Theory-driven evaluations. Newbury Park: Sage.
Clancy, C., & Collins, F. S. (2010). Patient-Centered Outcomes Research Institute: The intersection of science and health care. Science Translational Medicine, 2(37), 37cm18-37cm18. https://doi.org/10.1126/scitranslmed.3001235.
Cohen, J. (1983). The cost of dichotomization. Applied Psychological Measurement, 7(3), 249–253.
Cohen, J. (1988). Statistical power analyses for the social sciences. Hillsdale: Lawrence Erlbauni Associates.
Collins, L. M., & Lanza, S. T. (2010). Latent class and latent transition analysis: With applications in the social, behavioral, and health sciences (Vol. 718). Hoboken: Wiley.
Collins, L. M., Graham, J. J., & Flaherty, B. P. (1998). An alternative framework for defining mediation. Multivariate Behavioral Research, 33(2), 295–312.
Engel, G. L. (1977). The need for a new medical model: A challenge for biomedicine. Science, 196(4286), 129–136.
Eschiti, V., & Zahourek, R. (2012). Patient-Centered Outcomes Research Institute: a response to public outcry for better use of healthcare dollars (Vol. 32).
Fairchild, A. J., & MacKinnon, D. P. (2009). A general model for testing mediation and moderation effects. Prevention Science, 10(2), 87–99. https://doi.org/10.1007/s11121-008-0109-6.
Fonzo, G. A., Ramsawh, H. J., Flagan, T. M., Simmons, A. N., Sullivan, S. G., Allard, C. B., Paulus, M. P., & Stein, M. B. (2016). Early life stress and the anxious brain: Evidence for a neural mechanism linking childhood emotional maltreatment to anxiety in adulthood. Psychological Medicine, 46(5), 1037–1054. https://doi.org/10.1017/S0033291715002603.
Fritz, M. S., Taylor, A. B., & MacKinnon, D. P. (2012). Explanation of two anomalous results in statistical mediation analysis. Multivariate Behavioral Research, 47(1), 61–87.
Hafeman, D. M., & Schwartz, S. (2009). Opening the black box: A motivation for the assessment of mediation. International Journal of Epidemiology, 38(3), 838–845.
Holland, B. S., & Copenhaver, M. D. (1987). An improved sequentially rejective Bonferroni test procedure. Biometrics, 417–423.
Hommel, G. (1988). A stagewise rejective multiple test procedure based on a modified Bonferroni test. Biometrika, 75(2), 383–386.
Hommel, G. (1989). A comparison of two modified Bonferroni procedures. Biometrika, 76(3), 624–625.
Imai, K., Keele, L., & Tingley, D. (2010). A general approach to causal mediation analysis. Psychological Methods, 15(4), 309–334.
Institute of Medicine. (2001). Crossing the quality chasm: A new health system for the 21st century. Washington: The National Academies Press.
Kisbu-Sakarya, Y., MacKinnon, D. P., & O’Rourke, H. P. (2015). Statistical models of mediation for drug program evaluation. Handbook of adolescent drug use prevention: Research, intervention strategies, and practice, 459–478.
Kogan, J. N., Schuster, J., Nikolajski, C., Schake, P., Carney, T., Morton, S. C., et al. (2017). Challenges encountered in the conduct of optimal health: A patient-centered comparative effectiveness study of interventions for adults with serious mental illness. Clinical Trials, 14(1), 5–16. https://doi.org/10.1177/1740774516670895.
Krauth, J. (2003). Type structures in CFA. Psychology Science, 45(2), 330–338.
Lewin, K. (2013). A dynamic theory of personality: Selected papers. Worcestershire: Read Books Ltd. (Original work published 1935).
Lienert, G. A., & Krauth, J. (1975). Configural frequency analysis as a statistical tool for defining types. Educational and Psychological Measurement, 35, 231–238.
MacKinnon, D. P. (2008). Introduction to statistical mediation analysis. New York: Routledge.
MacKinnon, D. P., Johnson, C. A., Pentz, M. A., Dwyer, J. H., Hansen, W. B., Flay, B. R., & Wang, E. Y.-I. (1991). Mediating mechanisms in a school-based drug prevention program: First-year effects of the Midwestern prevention project. Health Psychology, 10(3), 164–172.
MacKinnon, D. P., Lockwood, C. M., Hoffman, J. M., West, S. G., & Sheets, V. (2002). A comparison of methods to test mediation and other intervening variable effects. Psychological Methods, 7(1), 83–104.
MacKinnon, D. P., Fritz, M. S., Williams, J., & Lockwood, C. M. (2007). Distribution of the product confidence limits for the indirect effect: Program PRODCLIN. Behavior Research Methods, 39(3), 384–389.
MacKinnon, D. P., Kisbu-Sakarya, Y., & Gottschall, A. C. (2013). 16 developments in mediation analysis. The Oxford Handbook of Quantitative Methods in Psychology: Vol 2: Statistical Analysis, 2, 338.
Magnusson, D. (1988). Individual development from and interactional perspective: A longitudinal study (Vol. 1). Hillsdale: Lawrence Erlbaum Associates, Inc..
Magnusson, D., & Bergman, L. R. (1988). Individual and variable-based approaches to longitudinal research on early risk factors. Cambridge University press.
Masyn, K. E. (2013). 25 latent class analysis and finite mixture modeling. In The Oxford handbook of quantitative methods (p. 551). Oxford: Oxford University press.
Molenaar, P. C. M. (2004). A manifesto on psychology as idiographic science: Bringing the person back into scientific psychology, this time forever. Measurement, 2(4), 201–218.
Molenaar, P. C. M., & Campbell, C. G. (2009). The new person-specific paradigm in psychology. Current Directions in Psychological Science, 18(2), 112–117.
Morgan-Lopez, A. A., & MacKinnon, D. P. (2006). Demonstration and evaluation of a method for assessing mediated moderation. Behavior Research Methods, 38(1), 77–87.
Nielsen, L., Riddle, M., King, J. W., Aklin, W. M., Chen, W., Clark, D., et al. (2018). The NIH science of behavior change program: Transforming the science through a focus on mechanisms of change. Behaviour Research and Therapy, 101, 3–11. https://doi.org/10.1016/j.brat.2017.07.002.
O’Rourke, H. P., & MacKinnon, D. P. (2018). Reasons for testing mediation in the absence of an intervention effect: A research imperative in prevention and intervention research. Journal of Studies on Alcohol and Drugs, 79(2), 171–181. https://doi.org/10.15288/jsad.2018.79.171.
O’Rourke, H. P., & MacKinnon, D. P. (2019). The importance of mediation analysis in substance-use prevention. In Prevention of Substance Use (pp. 233–246). Springer.
Pearl, J. (2012). The causal mediation formula: A guide to the assessment of pathways and mechanisms. Prevention Science, 13(4), 426–436.
Pentz, M. A., Dwyer, J. H., MacKinnon, D. P., Flay, B. R., Hansen, W. B., Wang, E. Y. I., & Johnson, C. A. (1989). A multicommunity trial for primary prevention of adolescent drug abuse: Effects on drug use prevalence. JAMA, 261(22), 3259–3266.
Perli, H. G., Hommel, G., & Lehmacher, W. (1985). Sequentially rejective test procedures for detecting outlying cells in one- and two-sample multinomial experiments. Biometrical Journal, 27(8), 885–893.
Perli, H. G., Hommel, G., & Lehmacher, W. (1987). Test procedures in configural frequency analysis (CFA) controlling the local and multiple level. Biometrical Journal, 29(3), 255–267.
Reeve, B. B., Thissen, D. M., Bann, C. M., Mack, N., Treiman, K., Sanoff, H. K., Roach, N., Magnus, B. E., He, J., Wagner, L. K., Moultrie, R., Jackson, K. D., Mann, C., & McCormack, L. A. (2017). Psychometric evaluation and design of patient-centered communication measures for cancer care settings. Patient Education and Counseling, 100(7), 1322–1328. https://doi.org/10.1016/j.pec.2017.02.011.
Richiardi, L., Bellocco, R., & Zugna, D. (2013). Mediation analysis in epidemiology: Methods, interpretation and bias. International Journal of Epidemiology, 42(5), 1511–1519. https://doi.org/10.1093/ije/dyt127.
Robinson, W. S. (1950). Ecological correlations and the behavior of individuals. American Sociological Review, 15(3), 351–357.
Schrepp, M. (2006). The use of configural frequency analysis for explorative data analysis. British Journal of Mathematical and Statistical Psychology, 59(1), 59–73. https://doi.org/10.1348/000711005x66761.
Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Belmont: Wadsworth Cengage Learning.
Sterba, S. K., & Bauer, D. J. (2010). Matching method with theory in person-oriented developmental psychopathology research. Development and Psychopathology, 22(2), 239–254.
Stern, W. (1923). Person und Sache: System des kritischen Personalismus (Vol. 2: Die menschliche Personlichkeit). Leipzig: Barth.
VanderWeele, T. J. (2014). A unification of mediation and interaction: A four-way decomposition. Epidemiology (Cambridge, Mass.), 25(5), 749–761.
von Eye, A. (1990). Introduction to configural frequency analysis: The search for types and antitypes in cross-classification: Cambridge University press.
von Eye, A. (2002a). Configural frequency analysis: Methods, models, and applications. Mahwah: Erlbaum.
von Eye, A. (2002b). The odds favor antitypes-a comparison of tests for the identification of configural types and antitypes. Methods of Psychological Research Online, 7, 1–29.
Von Eye, A. (2004). Base models for configural frequency analysis. Psychology Science, 46(1), 150–170.
von Eye, A. (2010). Developing the person-oriented approach: Theory and methods of analysis. Development and Psychopathology, 22(2), 277–285.
von Eye, A., & Bergman, L. R. (2003). Research strategies in developmental psychopathology: Dimensional identity and the person-oriented approach. Development and Psychopathology, 15(3), 553–580.
von Eye, A., & Mun, E. Y. (2016). Configural frequency analysis for research on developmental processes. Development and Psychopathology, 1–56.
von Eye, A., & Schuster, C. (1998). On the specification of models for Configural frequency analysis-sampling schemes in prediction CFA. Methods of Psychological Research Online, 3, 55–73.
von Eye, A., Mun, E. Y., & Mair, P. (2009). What carries a mediation process? Configural analysis of mediation. Integrative Psychological and Behavioral Science, 43(3), 228–247.
von Eye, A., Mair, P., & Mun, E.-Y. (2010). Advances in configural frequency analysis. New York: Guilford Press.
von Eye, A., Mun, E.-Y., Mair, P., & von Weber, S. (2013). Configural frequency analysis. The Oxford handbook of quantitative methods: Statistical analysis, 2, 74–105.
von Weber, S. (2000). A comparison of tests used in CFA by simulation. Psychologische Beitrge, 42, 260–272.
Funding
This study was funded by The National Institute of Drug Abuse (grant number R37DA09757).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare they have no conflict of interest.
Ethical Approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This research was supported in part by the National Institute on Drug Abuse (R37DA09757). Address correspondence to Heather Smyth, Department of Psychology, Arizona State University, PO Box 871104, Tempe, AZ 85287-1104
LOG-LINEAR MODELS USED FOR CFM AND JOINT SIGNIFICANCE TESTS
Appendix equations (17)-(20) are associated with Text equations (6)-(9) while Appendix equations (21)-(26) are associated with Text equations (11)-(16).
LOG-LINEAR MODELS USED FOR CFM AND JOINT SIGNIFICANCE TESTS
Rights and permissions
About this article
Cite this article
Smyth, H.L., MacKinnon, D.P. Statistical Evaluation of Person-Oriented Mediation Using Configural Frequency Analysis. Integr. psych. behav. 55, 593–636 (2021). https://doi.org/10.1007/s12124-020-09519-2
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12124-020-09519-2