Abstract
Two different approaches have been used to derive measures of effect size. One approach is based on the comparison of treatment means. The standardized mean difference is an appropriate measure of effect size when one is merely comparing two treatments, but there is no satisfactory analogue for comparing more than two treatments. The second approach is based on the proportion of variance in the dependent variable that is explained by the independent variable. Estimates have been proposed for both fixed-factor and random-factor designs, but their sampling properties are not well understood. Nevertheless, measures of effect size can allow quantitative comparisons to be made across different studies, and they can be a useful adjunct to more traditional outcome measures such as test statistics and significance levels.
Article PDF
Similar content being viewed by others
References
Chow, S. L. (1988). Significance test or effect size?Psychological Bulletin,103, 105–110.
Cohen, J. (1965). Some statistical issues in psychological research. In B. B. Wolman (Ed.),Handbook of clinical psychology (pp. 95–121). New York: McGraw-Hill.
Cohen, J. (1969).Statistical power analysis for the behavioral sciences. New York: Academic Press.
Cohen, J. (1977).Statistical power analysis for the behavioral sciences (rev. ed.). New York: Academic Press.
Cohen, J. (1988).Statistical power analysis for the behavioral sciences (2nd ed.). New York: Academic Press.
Craig, J. R., Eison, C. L., &Metze, L. P. (1976). Significance tests and their interpretation: An example utilizing published research and ω2.Bulletin of the Psychonomic Society,7, 280–282.
Cramér, H. (1946).Mathematical methods of statistics. Princeton, NJ: Princeton University Press.
Diamond, S. (1959).Information and error: An introduction to statistical analysis. New York: Basic Books.
Dodd, D. H., &Schultz, R. F., Jr. (1973). Computational procedures for estimating magnitude of effect for some analysis of variance designs.Psychological Bulletin,79, 391–395.
Eysenck, H. J. (1978). An exercise in mega-silliness.American Psychologist,33, 517.
Fisher, R. A. (1922). The goodness of fit of regression formulae, and the distribution of regression coefficients.Journal of the Royal Statistical Society,85, 597–612.
Fisher, R. A. (1925).Statistical methods for research workers. Edinburgh: Oliver & Boyd.
Fleiss, J. L. (1969). Estimating the magnitude of experimental effects.Psychological Bulletin,72, 273–276.
Gibbons, J. D., Olkin, I., &Sobel, M. (1977).Selecting and ordering populations: A new statistical methodology. New York: Wiley.
Glass, G. V. (1976). Primary, secondary, and meta-analysis of research.Educational Researcher,5 (10), 3–8.
Glass, G. V., &Hakstian, A. R. (1969). Measures of association in comparative experiments: Their development and interpretation.American Educational Research Journal,6, 403–414.
Glass, G. V., McGaw, B., &Smith, M. L. (1981).Meta-analysis in social research. Beverly Hills, CA: Sage.
Hays, W. L. (1963).Statistics. New York: Holt, Rinehart & Winston.
Hays, W. L. (1981).Statistics (3rd ed.). New York: Holt, Rinehart & Winston.
Hedges, L. V. (1981). Distribution theory for Glass’s estimator of effect size and related estimators.Journal of Educational Statistics,6, 107–128.
Hedges, L. V. (1982a). Estimation of effect size from a series of independent experiments.Psychological Bulletin,92, 490–499.
Hedges, L. V. (1982b). Fitting categorical models to effect sizes from a series of experiments.Journal of Educational Statistics,7, 119–137.
Hedges, L. V. (1982c). Fitting continuous models to effect size data.Journal of Educational Statistics,7, 245–270.
Hedges, L. V., &Becker, B. J. (1986). Statistical methods in the metaanalysis of research on gender differences. In J. S. Hyde & M. C. Linn (Eds.),The psychology of gender: Advances through metaanalysis (pp. 14–50). Baltimore: Johns Hopkins University Press.
Hedges, L. V., &Olkin, I. (1985).Statistical methods for meta-analysis. Orlando, FL: Academic Press.
Hyde, J. S. (1981). How large are cognitive gender differences? A meta-analysis using ω2 andd.American Psychologist,36, 892–901.
Hyde, J. S., Fennema, E., &Lamon, S. J. (1990). Gender differences in mathematics performance: A meta-analysis.Psychological Bulletin,107, 139–155.
Hyde, J. S., &Linn, M. C. (Eds.). (1986).The psychology of gender: Advances through meta-analysis. Baltimore: Johns Hopkins University Press.
Kelley, T. L. (1935). An unbiased correlation ratio measure.Proceedings of the National Academy of Sciences,21, 554–559.
Kendall, M., &Stuart, A. (1977).The advanced theory of statistics: Vol. 1. Distribution theory (4th ed.). London: Charles Griffin.
Kraemer, H. C. (1979). Tests of homogeneity of independent correlation coefficients.Psychometrika,44, 329–335.
Kraemer, H. C. (1983). Theory of estimation and testing of effect sizes: Use in meta-analysis.Journal of Educational Statistics,8, 93–101.
Kraemer, H. C., &Andrews, G. (1982). A nonparametric technique for meta-analysis effect size calculation.Psychological Bulletin,91, 404–412.
Levin, J. R. (1967). Misinterpreting the significance of “explained variation.”American Psychologist,22, 675–676.
Lindquist, E. F. (1953).Design and analysis of experiments in psychology and education. Boston: Houghton Mifflin.
Linn, M. C., &Petersen, A. C. (1986). A meta-analysis of gender differences in spatial ability: Implications for mathematics and science achievement. In J. S. Hyde & M. C. Linn (Eds.),The psychology of gender: Advances through meta-analysis (pp. 67–101). Baltimore: Johns Hopkins University Press.
McNemar, Q. (1962).Psychological statistics (3rd ed.). New York: Wiley.
Norton, D. W., &Lindquist, E. F. (1951). Applications of experimental design and analysis.Review of Educational Research,21, 350–367.
O’Grady, K. E. (1982). Measures of explained variance: Cautions and limitations.Psychological Bulletin,92, 766–777.
Pearson, K. (1905).Mathematical contributions to the theory of evolution: XIV. On the general theory of skew correlation and nonlinear regression (Drapers’ Company Research Memoirs, Biometric Series II). London: Dulau.
Pearson, K. (1923). On the correction necessary for the correlation ratio,η?.Biometrika,14, 412–417.
Peters, C. C., &Van Voorhis, W. R. (1940).Statistical procedures and their mathematical bases. New York: McGraw-Hill.
Presby, S. (1978). Overly broad categories obscure important differences between therapies.American Psychologist,33, 514–515.
Rosenthal, R. (1984).Meta-analytic procedures for social research. Beverly Hills, CA: Sage.
Rosenthal, R., &Rubin, D. B. (1982). Comparing effect sizes of independent studies.Psychological Bulletin,92, 500–504.
Shrout, P. E., &Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability.Psychological Bulletin,86, 420–428.
Smith, M. L., &Glass, G. V. (1977). Meta-analysis of psychotherapy outcome studies.American Psychologist,32, 752–760.
Vaughan, G. M., &Corballis, M. C. (1969). Beyond tests of significance: Estimating strength of effects in selected ANOVA designs.Psychological Bulletin,72, 204–213.
Wherry, R. J. (1931). A new formula for predicting the shrinkage of the coefficient of multiple correlation.Annals of Mathematical Statistics,2, 440–457.
Wilcox, R. R. (1987). New designs in analysis of variance.Annual Review of Psychology,38, 29–60.
Winer, B. J. (1962).Statistical principles in experimental design. New York: McGraw-Hill.
Winer, B. J. (1971).Statistical principles in experimental design (2nd ed.). New York: McGraw-Hill.
Winer, B. J., Brown, D. R., &Michels, K. M. (1991).Statistical principles in experimental design (3rd ed.). New York: McGraw-Hill.
Winkler, R. L., &Hays, W. L. (1975).Statistics: Probability, inference, and decision (2nd ed.). New York: Holt, Rinehart & Winston.
Wishart, J. (1932). A note on the distribution of the correlation ratio.Biometrika,24, 441–456.
Author information
Authors and Affiliations
Corresponding author
Additional information
The author is grateful to Jacob Cohen, Richard Schweickert, and two anonymous reviewers for their comments on previous versions of this paper.
Rights and permissions
About this article
Cite this article
Richardson, J.T.E. Measures of effect size. Behavior Research Methods, Instruments, & Computers 28, 12–22 (1996). https://doi.org/10.3758/BF03203631
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03203631