The DOI matches its Crossref record; 54 of the 55 references it cites were found in a registry or an index.
The importance of covariate selection in controlling for selection bias in observational studies.
Abstract
The assumption of strongly ignorable treatment assignment is required for eliminating selection bias in observational studies. To meet this assumption, researchers often rely on a strategy of selecting covariates that they think will control for selection bias. Theory indicates that the most important covariates are those highly correlated with both the real selection process and the potential outcomes. However, when planning a study, it is rarely possible to identify such covariates with certainty. In this article, we report on an extensive reanalysis of a within-study comparison that contrasts a randomized experiment and a quasi-experiment. Various covariate sets were used to adjust for initial group differences in the quasi-experiment that was characterized by self-selection into treatment. The adjusted effect sizes were then compared with the experimental ones to identify which individual covariates, and which conceptually grouped sets of covariates, were responsible for the high degree of bias reduction achieved in the adjusted quasi-experiment. Such results provide strong clues about preferred strategies for identifying the covariates most likely to reduce bias when planning a study and when the true selection process is not known.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Empirical examples exist where controlling for pre-treatment variables demonstrably increases rather than decreases bias.”
From Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable (2014) · cites this paper as Steiner et al. 2010
In the citing paper
“For example, Steiner et al. (2010) report a within-study comparison between an observational study and an experimental benchmark of the effect of an educational intervention on student test scores. In the observational study, the bias in the estimated effect of treatment on math scores increased by about 30% when controlling only for pre-treatment psychological disposition or only for pre”
From Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable (2014) · cites this paper as Steiner et al. 2010
In the citing paper
“Furthermore, they found that although controlling for additional pre-treatment variables generally reduced bias, sometimes including additional controls increased bias.”
From Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable (2014) · cites this paper as Steiner et al. 2010
In the citing paper
“If the pre-treatment collider is also a confounder, then conditioning on it will generally, but not always, remove more bias than it induces (Greenland 2003), especially if the analysis further conditions on many other pre-treatment variables (Steiner et al. 2010).”
From Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable (2014) · cites this paper as Steiner et al. 2010
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
(2002) · Cited by 13,211
Self-citationCausality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Missing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436
The development of markers for the Big-Five factor structure
Goldberg, L. R. (1992) · Psychological Assessment · doi:10.1037/1040-3590.4.1.26 · Cited by 5,530
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293
Reducing Bias in Observational Studies Using Subclassification on the Propensity Score
Rosenbaum, P. R., & Rubin, D. B. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10478078 · Cited by 3,082
Causal effects in nonexperimental studies: Reevaluating the evaluation of training programs
Dehejia, R. H., & Wahba, S. (1999) · Journal of the American Statistical Association · doi:10.1080/01621459.1999.10473858 · Cited by 2,395
Using Propensity Scores to Help Design Observational Studies: Application to the Tobacco Litigation
Rubin, D. B. (2001) · Health Services and Outcomes Research Methodology · doi:10.1023/a:1020363010465 · Cited by 2,228 · cited 1×
“After PS-adjustment, standardized mean differences d should be close to zero, and variance ratios v should be close to one (Rubin, 2001).”
Background
Flagged first, then by citations
1 of the 55 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Items 101–200 of 483
Forbes, S. P., & Dahabreh, I. (2020) · Journal of general internal medicine · doi:10.1007/s11606-020-05713-5 · Cited by 35
(2013) · MDRC · Cited by 45
Kirchmann, H., Steyer, R., Mayer, A., Joraschky, P., Schreiber-Willnow, K., & Strauss, B. (2012) · Psychotherapy Research · doi:10.1080/10503307.2011.626807 · Cited by 44
Selecting Expertise in Context
Wilhelm, A. G., Chen, I., Smith, T. M., & Frank, K. A. (2016) · American Educational Research Journal · doi:10.3102/0002831216637351 · Cited by 45
Timing matters: Endogenous cortisol mediates benefits from early-day psychotherapy
Meuret, A. E., Rosenfield, D., Bhaskara, L., Auchus, R. J., Liberzon, I., Ritz, T., & Abelson, J. L. (2016) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2016.09.008 · Cited by 42
Racial/Cultural Awareness Workshops and Post-College Civic Engagement
Bowman, N. A., Denson, N., & Park, J. J. (2016) · American Educational Research Journal · doi:10.3102/0002831216670510 · Cited by 47
Left Behind But Doing Good? Civic Engagement in Two Post-Socialist Countries
Nikolova, M., Roman, M., & Zimmermann, K. F. (2015) · Journal of Comparative Economics · doi:10.1016/j.jce.2016.04.006 · Cited by 44
Hadley, P. A., Rispoli, M., Holt, J. K., Papastratakos, T., Hsu, N., Kubalanza, M. C., & McKenna, M. M. (2016) · Language Learning and Development · doi:10.1080/15475441.2016.1193020 · Cited by 41
Effectiveness of a “Grass Roots” Statewide Enrichment Program for Gifted Elementary School Children
Golle, J., Zettler, I., Rose, N., Trautwein, U., Hasselhorn, M., & Nagengast, B. (2017) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2017.1402396 · Cited by 49
Loh, W. W., & Ren, D. (2023) · Perspectives on Psychological Science · doi:10.1177/17456916221134573 · Cited by 44
Dahabreh, I. J., Matthews, A., Steingrimsson, J. A., Scharfstein, D. O., & Stuart, E. A. (2023) · Epidemiologic Reviews · doi:10.1093/epirev/mxac011 · Cited by 40
Hallberg, K., Cook, T. D., Steiner, P. M., & Clark, M. H. (2016) · Prevention Science · doi:10.1007/s11121-016-0732-6 · Cited by 40
Self-citationSteiner, P. M., & Wong, V. C. (2018) · Evaluation Review · doi:10.1177/0193841x18773807 · Cited by 40
Self-citationChinen, M., de Hoop, T., Alcázar, L., Balarin, M., & Sennett, J. (2017) · Campbell Systematic Reviews · doi:10.4073/csr.2017.16 · Cited by 40
Racial Differences in Caregiving: Variation by Relationship Type and Dementia Care Status
Badana, A. N. S., Marino, V., & Haley, W. E. (2019) · Journal of Aging and Health · doi:10.1177/0898264317743611 · Cited by 39
Single-case experimental research designs.
Kazdin, A. E. (2015) · Methodological issues and strategies in clinical research (4th ed.). · doi:10.1037/14805-029 · Cited by 39
Care Demands and Well-Being of Primary and Secondary Non-Spousal Caregivers of Aging Adults
Marino, V. R., Badana, A. N. S., & Haley, W. E. (2020) · Clinical Gerontologist · doi:10.1080/07317115.2020.1759748 · Cited by 39
van Kuijk, M. F., Deunk, M., Bosker, R., & Ritzema, E. S. (2015) · School Effectiveness and School Improvement · doi:10.1080/09243453.2015.1026268 · Cited by 56
Improving Causal Inferences in Meta-analyses of Longitudinal Studies: Spanking as an Illustration
Larzelere, R. E., Gunnoe, M. L., & Ferguson, C. J. (2018) · Child Development · doi:10.1111/cdev.13097 · Cited by 37
Chilenski, S. M., Frank, J. L., Summers, N., & Lew, D. (2019) · Prevention Science · doi:10.1007/s11121-019-01028-y · Cited by 37
Jacob, R. T., Somers, M., Zhu, P., & Bloom, H. (2016) · Evaluation Review · doi:10.1177/0193841x16663414 · Cited by 36
Leading in an unprecedented global crisis: The heightened importance of versatility.
Kaiser, R. B. (2020) · Consulting psychology journal · doi:10.1037/cpb0000186 · Cited by 36
R&D Programmes, Policy Mix, and the ‘European Paradox’: Evidence from European SMEs
Radičić, D., & Pugh, G. (2016) · Science and Public Policy · doi:10.1093/scipol/scw077 · Cited by 36
High School Environments, STEM Orientations, and the Gender Gap in Science and Engineering DegreesPreprint
Legewie, J., & DiPrete, T. A. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.2008733 · Cited by 36
Effect of retention in elementary grades on grade 9 motivation for educational attainment
Cham, H., Hughes, J. N., West, S. G., & Im, M. H. (2014) · Journal of School Psychology · doi:10.1016/j.jsp.2014.10.001 · Cited by 41
Time-of-Use Electricity Pricing and Residential Low-carbon Energy Technology Adoption
Liang, J. L., Liu, P., Qiu, Y. L., Wang, Y. D., & Xing, B. (2019) · The Energy Journal · doi:10.5547/01956574.41.2.jlia · Cited by 36
The Long-Term Effect of Health Insurance on Near-Elderly Health and Mortality
Black, B. S., Espín‐Sánchez, J., French, E., & Litvak, K. (2017) · American Journal of Health Economics · doi:10.1162/ajhe_a_00076 · Cited by 34
Personality traits and living arrangements in young adulthood: Selection and socialization.
Jonkmann, K., Thoemmes, F. J., Lüdtke, O., & Trautwein, U. (2013) · Developmental Psychology · doi:10.1037/a0034239 · Cited by 37
Bias and High-Dimensional Adjustment in Observational Studies of Peer EffectsPreprint
Eckles, D., & Bakshy, E. (2022) · DSpace@MIT (Massachusetts Institute of Technology) · doi:10.6084/m9.figshare.12851349.v6 · Cited by 34
Lecocq, A., Ammi, M., & Bellarbre, É. (2016) · Mesure et évaluation en éducation · doi:10.7202/1035914ar · Cited by 33
Okumura-Clark, A., Espinoza, M. D. C., Boudesseul, J., & Heimark, K. R. (2021) · Journal of International Migration and Integration / Revue de l integration et de la migration internationale · doi:10.1007/s12134-021-00889-z · Cited by 33
Drewelies, J., Agrigoroaei, S., Lachman, M. E., & Gerstorf, D. (2018) · Developmental Psychology · doi:10.1037/dev0000527 · Cited by 34
Dearing, E., & Zachrisson, H. D. (2019) · Child Development Perspectives · doi:10.1111/cdep.12343 · Cited by 32
Toward improved evidence standards and methods for rehabilitation: recommendations and challenges.
Johnston, M., & Dijkers, M. (2012) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2011.12.011 · Cited by 34
Reiter, C., & Wilz, G. (2015) · The Journal of Positive Psychology · doi:10.1080/17439760.2015.1025423 · Cited by 34
Heissel, J. A. (2016) · Economics of Education Review · doi:10.1016/j.econedurev.2016.05.001 · Cited by 31
Frank, K. A., Kim, J., Salloum, S. J., Bieda, K. N., & Youngs, P. A. (2020) · American Educational Research Journal · doi:10.3102/0002831220911065 · Cited by 40
The effect of WIC on breastfeeding: A new look at an established relationship
Jiang, M., Foster, E. M., & Gibson‐Davis, C. M. (2009) · Children and Youth Services Review · doi:10.1016/j.childyouth.2009.09.005 · Cited by 31
Bias Reduction in Quasi-Experiments With Little Selection Theory but Many Covariates
Steiner, P. M., Cook, T. D., Li, W., & Clark, M. H. (2014) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2014.978058 · Cited by 31
Self-citationBias and High-Dimensional Adjustment in Observational Studies of Peer Effects
Eckles, D., & Bakshy, E. (2020) · Journal of the American Statistical Association · doi:10.1080/01621459.2020.1796393 · Cited by 40
Mason, W. A., Fleming, C. B., Thompson, R. W., Haggerty, K. P., & Snyder, J. J. (2013) · Prevention Science · doi:10.1007/s11121-013-0409-3 · Cited by 32
The Counterfactual Self-Estimation of Program Participants
Mueller, C. E., Gaus, H., & Rech, J. (2013) · American Journal of Evaluation · doi:10.1177/1098214013503182 · Cited by 30
Inside school turnaround: What drives success?
Hill, K. L., Desimone, L. M., Wolford, T. E., Reitano, A., & Porter, A. C. (2022) · Journal of Educational Change · doi:10.1007/s10833-022-09450-w · Cited by 29
Dong, N., & Lipsey, M. W. (2018) · Evaluation Review · doi:10.1177/0193841x17749824 · Cited by 29
Cook, T. D., Zhu, N., Klein, A., Starkey, P., & Thomas, J. (2020) · Psychological Methods · doi:10.1037/met0000260 · Cited by 34
Self-citationBayesian Model Averaging for Propensity Score Analysis
Kaplan, D. E., & Chen, J. (2014) · Multivariate Behavioral Research · doi:10.1080/00273171.2014.928492 · Cited by 31
Sengewald, M.-A. D.-P., Steiner, P. M., & Pohl, S. (2018) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/bmsp.12146 · Cited by 33
Self-citationRandomized Experiments and Quasi-Experimental Designs in Educational Research
Steiner, P. M., Wroblewski, A., & Cook, T. D. (2009) · Sage eBooks · doi:10.4135/9781452226606.n5 · Cited by 27
Self-citationWhat Can Be Learned From Empirical Evaluations of Nonexperimental Methods?
Wong, V. C., Steiner, P. M., & Anglin, K. (2018) · Evaluation Review · doi:10.1177/0193841x18776870 · Cited by 27
Self-citationBalancing Treatment and Control Groups in Quasi‐Experiments: An Introduction to Propensity Scoring
Connelly, B. S., Sackett, P. R., & Waters, S. D. (2012) · Personnel Psychology · doi:10.1111/peps.12020 · Cited by 34
Lee, S. W., & Mamerow, G. (2019) · Journal of Research in Science Teaching · doi:10.1002/tea.21558 · Cited by 27
Estimating time-varying treatment effects in longitudinal studies.
Loh, W. W., & Ren, D. (2023) · Psychological Methods · doi:10.1037/met0000574 · Cited by 25
The effects of attending selective college tiers in China
Loyalka, P. K., Song, Y., & Wei, J. (2011) · Social Science Research · doi:10.1016/j.ssresearch.2011.11.015 · Cited by 26
Qian, H., Youngs, P. A., & Frank, K. A. (2013) · Journal of Educational Change · doi:10.1007/s10833-013-9210-0 · Cited by 25
Padgett, R. D., Salisbury, M. H., An, B. P., & Pascarella, E. T. (2010) · New Directions for Institutional Research · doi:10.1002/ir.370 · Cited by 25
Leite, W. L., Stapleton, L. M., & Bettini, E. A. (2018) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2018.1522591 · Cited by 28
Tirado, J. L. A., Martín, F. D. F., García, A. M. R., Littvay, L., Prieto, J. V., & Naranjo, J. A. (2018) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2018.02.013 · Cited by 26
Nishio, K., & Hoshino, T. (2024) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2024.103957 · Cited by 30
Covariate Selection in Propensity Scores Using Outcome Proxies
Kelcey, B. (2011) · Multivariate Behavioral Research · doi:10.1080/00273171.2011.570164 · Cited by 24
Collaboration Drives Individual Productivity
Murić, G., Abeliuk, A., Lerman, K., & Ferrara, E. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359176 · Cited by 24
Lin, J., & Lin, J. (2021) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2021.1882481 · Cited by 24
Tanner‐Smith, E. E., & Lipsey, M. W. (2014) · Peabody Journal of Education · doi:10.1080/0161956x.2014.895647 · Cited by 24
Tetzner, J., Becker, M., & Bihler, L.-M. (2022) · European Journal of Personality · doi:10.1177/08902070221121178 · Cited by 29
Malin, Y. (2023) · Mindfulness · doi:10.1007/s12671-023-02150-3 · Cited by 24
A Tutorial on Causal Inference in Longitudinal Data With Time-Varying Confounding Using G-Estimation
Loh, W. W., & Ren, D. (2023) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231174029 · Cited by 23
The Unfulfilled Promise of Longitudinal Designs for Causal Inference
Loh, W. W., & Ren, D. (2023) · Collabra Psychology · doi:10.1525/collabra.89142 · Cited by 23
Taylor, M. K. (2013) · Military Medicine · doi:10.7205/milmed-d-12-00296 · Cited by 23
The effect of Jewish–Palestinian mixed-model encounters on readiness for contact and policy support.
Shani, M., & Boehnke, K. (2017) · Peace and Conflict Journal of Peace Psychology · doi:10.1037/pac0000220 · Cited by 23
Review of head-to-head study designs in rheumatoid arthritis
Fleischmann, R., Landewé, R., & Smolen, J. S. (2016) · Seminars in Arthritis and Rheumatism · doi:10.1016/j.semarthrit.2016.07.006 · Cited by 23
Li, Z., Lu, F., & Feng, X. (2022) · Economic Research-Ekonomska Istraživanja · doi:10.1080/1331677x.2022.2094439 · Cited by 21
The value of informal learning within work‐based learning: The economic benefits of WBL
Plasman, J. S., & Thompson, C. B. (2023) · International Journal of Training and Development · doi:10.1111/ijtd.12299 · Cited by 21
Amaresha, A. C., Kalmady, S. V., Joseph, B., Agarwal, S. M., Narayanaswamy, J. C., Venkatasubramanian, G., Muralidhar, D., & Subbakrishna, D. K. (2017) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2017.11.030 · Cited by 21
Random Forests Approach for Causal Inference with Clustered Observational Data
Suk, Y., Kang, H., & Kim, J. (2020) · Multivariate Behavioral Research · doi:10.1080/00273171.2020.1808437 · Cited by 21
Joyal‐Desmarais, K., Stojanovic, J., Kennedy, E. B., Enticott, J., Boucher, V. G., Vo, H., Košir, U., Lavoie, K., Bacon, S., iCARE Study Team, et al. (2022) · European Journal of Epidemiology · doi:10.1007/s10654-022-00932-y · Cited by 21
Loh, W. W., Ren, D., & West, S. G. (2024) · Multivariate Behavioral Research · doi:10.1080/00273171.2024.2354228 · Cited by 20
Sørlie, M., & Ogden, T. (2014) · International Journal of School & Educational Psychology · doi:10.1080/21683603.2014.881309 · Cited by 20
Making Valid Causal Inferences About Corrective Actions by Parents From Longitudinal Data
Larzelere, R., & Cox, R. B. (2013) · Journal of Family Theory & Review · doi:10.1111/jftr.12020 · Cited by 23
Impact of public intervention on micro and small enterprises performance in Ethiopia
Yonis, M. B., Woldehanna, T., & Amha, W. (2018) · International Journal of Emerging Markets · doi:10.1108/ijoem-10-2016-0259 · Cited by 20
Valente, M. J., MacKinnon, D. P., & Mazza, G. L. (2019) · Multivariate Behavioral Research · doi:10.1080/00273171.2019.1614429 · Cited by 20
Tumlinson, S. E., Sass, D. A., & Cano, S. M. (2014) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jst143 · Cited by 19
Untereiner, X., Cagniet, A., Memeo, R., Cherkaoui, Z., Piardi, T., Séverac, F., Mutter, D., Kianmanesh, R., Wakabayashi, T., Sommacale, D., et al. (2018) · World Journal of Surgery · doi:10.1007/s00268-018-4827-z · Cited by 19
Villar, P. F., & Waddington, H. S. (2019) · Campbell Systematic Reviews · doi:10.1002/cl2.1027 · Cited by 19
Impact of deprescribing AChEIs on aggressive behaviors and antipsychotic prescribing
Niznik, J. D., Zhao, X., He, M., Aspinall, S. L., Hanlon, J. T., Nace, D. A., Thorpe, J. M., & Thorpe, C. T. (2020) · Alzheimer s & Dementia · doi:10.1002/alz.12054 · Cited by 19
Keller, B., & Branson, Z. (2024) · Asia Pacific Education Review · doi:10.1007/s12564-024-09957-2 · Cited by 20
Learning from friends: measuring influence in a dyadic computer instructional setting
DeLay, D., Hartl, A. C., Laursen, B. P., Denner, J., Werner, L., Campe, S., & Ortiz, E. (2013) · International Journal of Research & Method in Education · doi:10.1080/1743727x.2013.784961 · Cited by 18
Williams, A. I., Uchikoshi, Y., Bunge, S. A., & Zhou, Q. (2018) · Early Education and Development · doi:10.1080/10409289.2018.1544812 · Cited by 19
Outcome Studies of Social, Behavioral, and Educational Interventions
Fräser, M. W., Guo, S., Ellis, A. R., Thompson, A. M., Wike, T. L., & Li, J. (2011) · Research on Social Work Practice · doi:10.1177/1049731511406136 · Cited by 20
Study design elements for rigorous quasi-experimental comparative effectiveness research
Maciejewski, M. L., Curtis, L. H., & Dowd, B. E. (2013) · Journal of Comparative Effectiveness Research · doi:10.2217/cer.13.7 · Cited by 18
Research Designs for Program Evaluation
Wong, V. C., Wing, C., Steiner, P. M., Wong, M., & Cook, T. D. (2012) · Wiley eBooks · doi:10.1002/9781118133880.hop202011 · Cited by 18
Self-citationDoes the track matter? A comparison of students’ achievement in different tracks.
Dockx, J., Fraine, B. D., & Vandecandelaere, M. (2018) · Journal of Educational Psychology · doi:10.1037/edu0000305 · Cited by 24
Kretschmann, J., Vock, M., & Lüdtke, O. (2014) · Journal of Educational Psychology · doi:10.1037/a0036631 · Cited by 22
Ehrler, M., Latal, B., Polentarutti, S., von Rhein, M., Held, L., & Wehrle, F. M. (2019) · Pediatric Research · doi:10.1038/s41390-019-0667-2 · Cited by 17
Lamontagne, E., Leroy, V., Yakusik, A., Parker, W., Howell, S., & Ventelou, B. (2024) · BMC Public Health · doi:10.1186/s12889-023-17493-8 · Cited by 18
Untereiner, X., Cagnet, A., Memeo, R., Blasi, V. D., Tzedakis, S., Piardi, T., Séverac, F., Mutter, D., Kianmanesh, R., Marescaux, J., et al. (2016) · World Journal of Gastrointestinal Surgery · doi:10.4240/wjgs.v8.i9.643 · Cited by 16
Pósch, K. (2019) · Sociological Methods & Research · doi:10.1177/0049124119826159 · Cited by 16
R&D and innovation policy in the Western Balkans: Are there additionality effects?
Orlić, E., Radičić, D., & Balavac, M. (2019) · Science and Public Policy · doi:10.1093/scipol/scz036 · Cited by 16
Chen, Z., Friedline, T. L., & Lemieux, C. M. (2022) · Journal of Family and Economic Issues · doi:10.1007/s10834-022-09853-0 · Cited by 16
Reducing selection bias in quasi-experimental educational studies
Brooks, C. A., Chavez, O., Tritz, J., & Teasley, S. D. (2015) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2723576.2723614 · Cited by 16
Levy, J., Brunner, M., Keller, U., & Fischbach, A. (2022) · Educational Assessment Evaluation and Accountability · doi:10.1007/s11092-022-09386-y · Cited by 18
Duan, Y., Liang, W., Guo, L., Zhan, H., Xia, C., Ma, H., Shang, B., Wang, Y., Yang, M., & Cheng, S. (2025) · Journal of Medical Internet Research · doi:10.2196/66249 · Cited by 20
Metadata
- Authors
- Steiner, P. M., Cook, T. D., Shadish, W. R., & Clark, M. H.
- Affiliations
- Northwestern University (US)
- Venue
- Psychological Methods
- Published
- 2010
- Volume
- 15
- Issue
- 3
- Pages
- 250-267
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W2168206775
- Cited by
- 490
- References
- 55
- Citations by year
- 2026: 23 · 2025: 28 · 2024: 34 · 2023: 26 · 2022: 26 · 2021: 53 · 2020: 32 · 2019: 20 · 2018: 37 · 2017: 36 · 2016: 38 · 2015: 28 · 2014: 31 · 2013: 32 · 2012: 19
- FWCI
- 18.95
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Methods (publishedVersion)
- PubMed (publishedVersion)
- Funders
- US Department of Education (R305U070003)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- covariate selection, selection bias, observational studies, quasi-experiments, self-selection, randomized experiments, bias mitigation
- MeSH terms
- Data Interpretation, Statistical, Epidemiologic Methods, Humans, Mathematics, Random Allocation, Models, Statistical, Selection Bias, Causality, Patient Selection, Behavioral Research, Propensity Score
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
