Christopher Brooks
Stephanie Teasley
ABSTRACT
In this paper we examine the issue of selection bias in quasi-experimental (non-randomly controlled) educational studies. We provide background about common sources of selection bias and the issues involved in evaluating the outcomes of quasi-experimental studies. We describe two methods, matched sampling and propensity score matching, that can be used to overcome this bias. Using these methods, we describe their application through one case study that leverages large educational datasets drawn from higher education institutional data warehouses. The contribution of this work is the recommendation of a methodology and case study that educational researchers can use to understand, measure, and reduce selection bias in real-world educational interventions.
- B. Hansen. The prognostic analogue of the propensity score. Biometrika, pages 1--17, 2008.Google Scholar
Cross Ref
- P. Rosenbaum and D. Rubin. The central role of the propensity score in observational studies for causal effects. Biometrika, 70(1): 41--55, 1983.Google ScholarCross Ref
- D. Rubin. Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of educational Psychology, 1974.Google Scholar
- W. R. Shadish, M. H. Clark, and P. M. Steiner. Can Nonrandomized Experiments Yield Accurate Answers? A Randomized Experiment Comparing Random and Nonrandom Assignments. Journal of the American Statistical Association, 103(484): 1334--1344, Dec. 2008.Google ScholarCross Ref
- P. M. Steiner, T. D. Cook, W. R. Shadish, and M. H. Clark. The importance of covariate selection in controlling for selection bias in observational studies. Psychological methods, 15(3): 250--67, Sept. 2010.Google Scholar
Index Terms
- Reducing selection bias in quasi-experimental educational studies
Recommendations
Are educational computer micro-games engaging and effective for knowledge acquisition at high-schools? A quasi-experimental study
Curricular schooling can benefit from the usage of educational computer games, but it is difficult to integrate them in the formal schooling system. Here, we investigate one possible approach to this integration, which capitalizes on using a micro-game ...
Educational innovation
TEEM '14: Proceedings of the Second International Conference on Technological Ecosystems for Enhancing MulticulturalityThe education sector needs evolution and changes. Evolution in order to apply student-centred learning paradigms in an effective and efficient manner; changes in terms of the approaches in order to allow the inclusion of new methods, such as the ...
Educational innovation
TEEM '15: Proceedings of the 3rd International Conference on Technological Ecosystems for Enhancing MulticulturalityAn effective way to understand, improve and apply educational innovation is through the analysis of good practices. Sharing the acquired knowledge in the development and application of good practices helps teachers to implement educational innovation. ...
Comments