Skip to main content
Log in

Statistical Evaluation of Person-Oriented Mediation Using Configural Frequency Analysis

  • Regular Article
  • Published:
Integrative Psychological and Behavioral Science Aims and scope Submit manuscript

Abstract

Mediation analysis helps explain how and why two variables are related, providing information for investigating causal processes useful for theoretical and applied research (MacKinnon 2008). Inference from mediation analysis typically applies to the population, but researchers and clinicians are often interested in making inference to individual clients or small sub-populations of people. Person-oriented approaches focus on the differences between people, or latent groups of people, to ask how individuals differ across variables. A recently proposed method allows for the analysis of person differences as part of mediation. The method from configural frequency analysis, which we call configural frequency mediation, is based on log-linear modeling of contingency tables. The complexity of configural frequency mediation and its use of a causal steps mediation method, may contribute to the lack of application and study of this promising method since its introduction in the literature a decade ago (von Eye et al. 2009, 2010) In this paper we clarify the steps used for configural frequency mediation and report the results of a large statistical simulation study evaluating the method and comparing it to the variable-oriented traditional method using logistic regression analysis. Overall, configural frequency mediation analysis tended to have excessive type I error rates but we describe an alternative approach to configural mediation analysis based on a joint significance test that had adequate performance. We also clarify the decision rules that define configural mediation analysis and develop a test for configural frequency mediation using a joint significance mediation method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Aiken, L. S., West, S. G., & Reno, R. R. (1991). Multiple regression: Testing and interpreting interactions. Sage.

  • Baron, R. M., & Kenny, D. A. (1986). The moderator–mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology, 51(6), 1173–1182.

    PubMed  Google Scholar 

  • Bergman, L. R. (2009). Mediation and causality at the individual level. Integrative Psychological and Behavioral Science, 43(3), 248–252. https://doi.org/10.1007/s12124-009-9102-2.

    Article  PubMed  Google Scholar 

  • Bergman, L. R., & Magnusson, D. (1997). A person-oriented approach in research on developmental psychopathology. Development and Psychopathology, 9(2), 291–319.

    PubMed  Google Scholar 

  • Bergman, L. R., Eklund, G., & Magnusson, D. (1991). Studying individual development; problems and methods. In D. Magnusson, L. R. Bergman, G. Rudinger, & B. Törestad (Eds.), Problems and methods in longitudinal research: Stability and change (pp. 1–27). Cambridge: Cambridge University Press.

    Google Scholar 

  • Block, J. (1995). A contrarian view of the five-factor approach to personality description. Psychological Bulletin, 117(2), 187–215.

    PubMed  Google Scholar 

  • Block, J. (2014). Lives through time. New York: Psychology Press (Original work published 1971).

    Google Scholar 

  • Bogat, G. A., von Eye, A., & Bergman, L. R. (2016). Person-oriented approaches. In D. Cicchetti (Ed.), Developmental psychopathology volume one: Theory and method (Vol. 1, pp. 797–841). Hoboken: Wiley.

    Google Scholar 

  • Bradley, J. V. (1978). Robustness? British Journal of Mathematical and Statistical Psychology, 31(2), 144–152.

    Google Scholar 

  • Brook, R. H. (2011). Can the Patient-Centered Outcomes Research Institute become relevant to controlling medical costs and improving value? JAMA, 306(18), 2020–2021. https://doi.org/10.1001/jama.2011.1621.

    Article  PubMed  Google Scholar 

  • Chen, H. T. (1990). Theory-driven evaluations. Newbury Park: Sage.

    Google Scholar 

  • Clancy, C., & Collins, F. S. (2010). Patient-Centered Outcomes Research Institute: The intersection of science and health care. Science Translational Medicine, 2(37), 37cm18-37cm18. https://doi.org/10.1126/scitranslmed.3001235.

    Article  Google Scholar 

  • Cohen, J. (1983). The cost of dichotomization. Applied Psychological Measurement, 7(3), 249–253.

    Google Scholar 

  • Cohen, J. (1988). Statistical power analyses for the social sciences. Hillsdale: Lawrence Erlbauni Associates.

    Google Scholar 

  • Collins, L. M., & Lanza, S. T. (2010). Latent class and latent transition analysis: With applications in the social, behavioral, and health sciences (Vol. 718). Hoboken: Wiley.

    Google Scholar 

  • Collins, L. M., Graham, J. J., & Flaherty, B. P. (1998). An alternative framework for defining mediation. Multivariate Behavioral Research, 33(2), 295–312.

    PubMed  Google Scholar 

  • Engel, G. L. (1977). The need for a new medical model: A challenge for biomedicine. Science, 196(4286), 129–136.

    Google Scholar 

  • Eschiti, V., & Zahourek, R. (2012). Patient-Centered Outcomes Research Institute: a response to public outcry for better use of healthcare dollars (Vol. 32).

    Google Scholar 

  • Fairchild, A. J., & MacKinnon, D. P. (2009). A general model for testing mediation and moderation effects. Prevention Science, 10(2), 87–99. https://doi.org/10.1007/s11121-008-0109-6.

    Article  PubMed  PubMed Central  Google Scholar 

  • Fonzo, G. A., Ramsawh, H. J., Flagan, T. M., Simmons, A. N., Sullivan, S. G., Allard, C. B., Paulus, M. P., & Stein, M. B. (2016). Early life stress and the anxious brain: Evidence for a neural mechanism linking childhood emotional maltreatment to anxiety in adulthood. Psychological Medicine, 46(5), 1037–1054. https://doi.org/10.1017/S0033291715002603.

    Article  PubMed  Google Scholar 

  • Fritz, M. S., Taylor, A. B., & MacKinnon, D. P. (2012). Explanation of two anomalous results in statistical mediation analysis. Multivariate Behavioral Research, 47(1), 61–87.

    PubMed  PubMed Central  Google Scholar 

  • Hafeman, D. M., & Schwartz, S. (2009). Opening the black box: A motivation for the assessment of mediation. International Journal of Epidemiology, 38(3), 838–845.

    PubMed  Google Scholar 

  • Holland, B. S., & Copenhaver, M. D. (1987). An improved sequentially rejective Bonferroni test procedure. Biometrics, 417–423.

  • Hommel, G. (1988). A stagewise rejective multiple test procedure based on a modified Bonferroni test. Biometrika, 75(2), 383–386.

    Google Scholar 

  • Hommel, G. (1989). A comparison of two modified Bonferroni procedures. Biometrika, 76(3), 624–625.

    Google Scholar 

  • Imai, K., Keele, L., & Tingley, D. (2010). A general approach to causal mediation analysis. Psychological Methods, 15(4), 309–334.

    PubMed  Google Scholar 

  • Institute of Medicine. (2001). Crossing the quality chasm: A new health system for the 21st century. Washington: The National Academies Press.

    Google Scholar 

  • Kisbu-Sakarya, Y., MacKinnon, D. P., & O’Rourke, H. P. (2015). Statistical models of mediation for drug program evaluation. Handbook of adolescent drug use prevention: Research, intervention strategies, and practice, 459–478.

  • Kogan, J. N., Schuster, J., Nikolajski, C., Schake, P., Carney, T., Morton, S. C., et al. (2017). Challenges encountered in the conduct of optimal health: A patient-centered comparative effectiveness study of interventions for adults with serious mental illness. Clinical Trials, 14(1), 5–16. https://doi.org/10.1177/1740774516670895.

    Article  PubMed  Google Scholar 

  • Krauth, J. (2003). Type structures in CFA. Psychology Science, 45(2), 330–338.

    Google Scholar 

  • Lewin, K. (2013). A dynamic theory of personality: Selected papers. Worcestershire: Read Books Ltd. (Original work published 1935).

    Google Scholar 

  • Lienert, G. A., & Krauth, J. (1975). Configural frequency analysis as a statistical tool for defining types. Educational and Psychological Measurement, 35, 231–238.

    Google Scholar 

  • MacKinnon, D. P. (2008). Introduction to statistical mediation analysis. New York: Routledge.

    Google Scholar 

  • MacKinnon, D. P., Johnson, C. A., Pentz, M. A., Dwyer, J. H., Hansen, W. B., Flay, B. R., & Wang, E. Y.-I. (1991). Mediating mechanisms in a school-based drug prevention program: First-year effects of the Midwestern prevention project. Health Psychology, 10(3), 164–172.

    PubMed  Google Scholar 

  • MacKinnon, D. P., Lockwood, C. M., Hoffman, J. M., West, S. G., & Sheets, V. (2002). A comparison of methods to test mediation and other intervening variable effects. Psychological Methods, 7(1), 83–104.

    PubMed  PubMed Central  Google Scholar 

  • MacKinnon, D. P., Fritz, M. S., Williams, J., & Lockwood, C. M. (2007). Distribution of the product confidence limits for the indirect effect: Program PRODCLIN. Behavior Research Methods, 39(3), 384–389.

    PubMed  PubMed Central  Google Scholar 

  • MacKinnon, D. P., Kisbu-Sakarya, Y., & Gottschall, A. C. (2013). 16 developments in mediation analysis. The Oxford Handbook of Quantitative Methods in Psychology: Vol 2: Statistical Analysis, 2, 338.

  • Magnusson, D. (1988). Individual development from and interactional perspective: A longitudinal study (Vol. 1). Hillsdale: Lawrence Erlbaum Associates, Inc..

    Google Scholar 

  • Magnusson, D., & Bergman, L. R. (1988). Individual and variable-based approaches to longitudinal research on early risk factors. Cambridge University press.

  • Masyn, K. E. (2013). 25 latent class analysis and finite mixture modeling. In The Oxford handbook of quantitative methods (p. 551). Oxford: Oxford University press.

    Google Scholar 

  • Molenaar, P. C. M. (2004). A manifesto on psychology as idiographic science: Bringing the person back into scientific psychology, this time forever. Measurement, 2(4), 201–218.

    Google Scholar 

  • Molenaar, P. C. M., & Campbell, C. G. (2009). The new person-specific paradigm in psychology. Current Directions in Psychological Science, 18(2), 112–117.

    Google Scholar 

  • Morgan-Lopez, A. A., & MacKinnon, D. P. (2006). Demonstration and evaluation of a method for assessing mediated moderation. Behavior Research Methods, 38(1), 77–87.

    PubMed  Google Scholar 

  • Nielsen, L., Riddle, M., King, J. W., Aklin, W. M., Chen, W., Clark, D., et al. (2018). The NIH science of behavior change program: Transforming the science through a focus on mechanisms of change. Behaviour Research and Therapy, 101, 3–11. https://doi.org/10.1016/j.brat.2017.07.002.

    Article  PubMed  Google Scholar 

  • O’Rourke, H. P., & MacKinnon, D. P. (2018). Reasons for testing mediation in the absence of an intervention effect: A research imperative in prevention and intervention research. Journal of Studies on Alcohol and Drugs, 79(2), 171–181. https://doi.org/10.15288/jsad.2018.79.171.

    Article  PubMed  PubMed Central  Google Scholar 

  • O’Rourke, H. P., & MacKinnon, D. P. (2019). The importance of mediation analysis in substance-use prevention. In Prevention of Substance Use (pp. 233–246). Springer.

  • Pearl, J. (2012). The causal mediation formula: A guide to the assessment of pathways and mechanisms. Prevention Science, 13(4), 426–436.

    PubMed  Google Scholar 

  • Pentz, M. A., Dwyer, J. H., MacKinnon, D. P., Flay, B. R., Hansen, W. B., Wang, E. Y. I., & Johnson, C. A. (1989). A multicommunity trial for primary prevention of adolescent drug abuse: Effects on drug use prevalence. JAMA, 261(22), 3259–3266.

    PubMed  Google Scholar 

  • Perli, H. G., Hommel, G., & Lehmacher, W. (1985). Sequentially rejective test procedures for detecting outlying cells in one- and two-sample multinomial experiments. Biometrical Journal, 27(8), 885–893.

    Google Scholar 

  • Perli, H. G., Hommel, G., & Lehmacher, W. (1987). Test procedures in configural frequency analysis (CFA) controlling the local and multiple level. Biometrical Journal, 29(3), 255–267.

    Google Scholar 

  • Reeve, B. B., Thissen, D. M., Bann, C. M., Mack, N., Treiman, K., Sanoff, H. K., Roach, N., Magnus, B. E., He, J., Wagner, L. K., Moultrie, R., Jackson, K. D., Mann, C., & McCormack, L. A. (2017). Psychometric evaluation and design of patient-centered communication measures for cancer care settings. Patient Education and Counseling, 100(7), 1322–1328. https://doi.org/10.1016/j.pec.2017.02.011.

    Article  PubMed  Google Scholar 

  • Richiardi, L., Bellocco, R., & Zugna, D. (2013). Mediation analysis in epidemiology: Methods, interpretation and bias. International Journal of Epidemiology, 42(5), 1511–1519. https://doi.org/10.1093/ije/dyt127.

    Article  PubMed  Google Scholar 

  • Robinson, W. S. (1950). Ecological correlations and the behavior of individuals. American Sociological Review, 15(3), 351–357.

    Google Scholar 

  • Schrepp, M. (2006). The use of configural frequency analysis for explorative data analysis. British Journal of Mathematical and Statistical Psychology, 59(1), 59–73. https://doi.org/10.1348/000711005x66761.

    Article  Google Scholar 

  • Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Belmont: Wadsworth Cengage Learning.

    Google Scholar 

  • Sterba, S. K., & Bauer, D. J. (2010). Matching method with theory in person-oriented developmental psychopathology research. Development and Psychopathology, 22(2), 239–254.

    PubMed  Google Scholar 

  • Stern, W. (1923). Person und Sache: System des kritischen Personalismus (Vol. 2: Die menschliche Personlichkeit). Leipzig: Barth.

  • VanderWeele, T. J. (2014). A unification of mediation and interaction: A four-way decomposition. Epidemiology (Cambridge, Mass.), 25(5), 749–761.

    Google Scholar 

  • von Eye, A. (1990). Introduction to configural frequency analysis: The search for types and antitypes in cross-classification: Cambridge University press.

  • von Eye, A. (2002a). Configural frequency analysis: Methods, models, and applications. Mahwah: Erlbaum.

    Google Scholar 

  • von Eye, A. (2002b). The odds favor antitypes-a comparison of tests for the identification of configural types and antitypes. Methods of Psychological Research Online, 7, 1–29.

    Google Scholar 

  • Von Eye, A. (2004). Base models for configural frequency analysis. Psychology Science, 46(1), 150–170.

    Google Scholar 

  • von Eye, A. (2010). Developing the person-oriented approach: Theory and methods of analysis. Development and Psychopathology, 22(2), 277–285.

    Google Scholar 

  • von Eye, A., & Bergman, L. R. (2003). Research strategies in developmental psychopathology: Dimensional identity and the person-oriented approach. Development and Psychopathology, 15(3), 553–580.

    Google Scholar 

  • von Eye, A., & Mun, E. Y. (2016). Configural frequency analysis for research on developmental processes. Development and Psychopathology, 1–56.

  • von Eye, A., & Schuster, C. (1998). On the specification of models for Configural frequency analysis-sampling schemes in prediction CFA. Methods of Psychological Research Online, 3, 55–73.

    Google Scholar 

  • von Eye, A., Mun, E. Y., & Mair, P. (2009). What carries a mediation process? Configural analysis of mediation. Integrative Psychological and Behavioral Science, 43(3), 228–247.

    Google Scholar 

  • von Eye, A., Mair, P., & Mun, E.-Y. (2010). Advances in configural frequency analysis. New York: Guilford Press.

    Google Scholar 

  • von Eye, A., Mun, E.-Y., Mair, P., & von Weber, S. (2013). Configural frequency analysis. The Oxford handbook of quantitative methods: Statistical analysis, 2, 74–105.

    Google Scholar 

  • von Weber, S. (2000). A comparison of tests used in CFA by simulation. Psychologische Beitrge, 42, 260–272.

    Google Scholar 

Download references

Funding

This study was funded by The National Institute of Drug Abuse (grant number R37DA09757).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Heather L. Smyth.

Ethics declarations

Conflict of Interest

The authors declare they have no conflict of interest.

Ethical Approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This research was supported in part by the National Institute on Drug Abuse (R37DA09757). Address correspondence to Heather Smyth, Department of Psychology, Arizona State University, PO Box 871104, Tempe, AZ 85287-1104

LOG-LINEAR MODELS USED FOR CFM AND JOINT SIGNIFICANCE TESTS

Appendix equations (17)-(20) are associated with Text equations (6)-(9) while Appendix equations (21)-(26) are associated with Text equations (11)-(16).

LOG-LINEAR MODELS USED FOR CFM AND JOINT SIGNIFICANCE TESTS

$$ \mathrm{Model}\ 1\kern0.5em \log \hat{o}=\lambda +{\lambda}^X+{\lambda}^M+{\lambda}^Y $$
(17)
$$ \mathrm{Model}\ 2\kern0.5em \log \hat{o}=\lambda +{\lambda}^X+{\lambda}^M+{\lambda}^Y+{\lambda}^{XM} $$
(18)
$$ \mathrm{Model}\ 3\kern0.5em \log \hat{o}=\lambda +{\lambda}^X+{\lambda}^M+{\lambda}^Y+{\lambda}^{XM}+{\lambda}^{XY} $$
(19)
$$ \mathrm{Model}\ 4\kern0.5em \log \hat{o}=\lambda +{\lambda}^X+{\lambda}^M+{\lambda}^Y+{\lambda}^{XM}+{\lambda}^{MY} $$
(20)
$$ \mathrm{Model}\ 5\kern0.5em \log \hat{o}=\lambda +{\lambda}^X+{\lambda}^M+{\lambda}^Y+{\lambda}^{XY}+{\lambda}^{XM}+{\lambda}^{MY} $$
(21)
$$ \mathrm{Model}\ 6\kern0.5em \log \hat{o}=\lambda +{\lambda}^X+{\lambda}^M+{\lambda}^Y+{\lambda}^{XY}+{\lambda}^{MY} $$
(22)
$$ \mathrm{Model}\ 7\kern0.5em \log \hat{o}=\lambda +{\lambda}^X+{\lambda}^M+{\lambda}^Y+{\lambda}^{XM}+{\lambda}^{XY}+{\lambda}^{XM Y} $$
(23)
$$ \mathrm{Model}\ 8\kern0.5em \log \hat{o}=\lambda +{\lambda}^X+{\lambda}^M+{\lambda}^Y+{\lambda}^{MY}+{\lambda}^{XY}+{\lambda}^{XMY} $$
(24)
$$ \mathrm{Model}\ 9\kern0.5em \log \hat{o}=\lambda +{\lambda}^X+{\lambda}^M+{\lambda}^Y+{\lambda}^{XY} $$
(25)
$$ \mathrm{Saturated}\ \mathrm{Model}\kern0.5em \log \hat{o}=\lambda +{\lambda}^X+{\lambda}^M+{\lambda}^Y+{\lambda}^{XM}+{\lambda}^{XY}+{\lambda}^{MY}+{\lambda}^{XM Y} $$
(26)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Smyth, H.L., MacKinnon, D.P. Statistical Evaluation of Person-Oriented Mediation Using Configural Frequency Analysis. Integr. psych. behav. 55, 593–636 (2021). https://doi.org/10.1007/s12124-020-09519-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12124-020-09519-2

Keywords

Navigation