The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Stepwise Regression and Stepwise Discriminant Analysis Need Not Apply here: A Guidelines Editorial
Abstract
Stepwise methods are frequently employed in educational and psychological research, both to select useful subsets of variables and to evaluate the order of importance of variables. Three problems with stepwise applications are explored in some detail. First, computer packages use incorrect degrees of freedom in their stepwise computations, resulting in artifactually greater likelihood of obtaining spurious statistical significance. Second, stepwise methods do not correctly identify the best variable set of a given size, as illustrated by a concrete heuristic example. Third, stepwise methods tend to capitalize on sampling error and thus tend to yield results that are not replicable.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Selecting on statistical associations is a data-driven approach which may lead to non-replicable results [44].”
From Students under lockdown: Comparisons of students’ social networks and mental health before and during the COVID-19 crisis in Switzerland (2020) · cites this paper as [44]
Citations
Cites
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
American Educational Research Journal, 1964-1968
Vesta, F. J. D., & Grinder, R. E. (1968) · American Educational Research Journal · doi:10.2307/1162008 · Cited by 2,606
An Inquiry concerning human understanding
Hume, D. (1955) · Cited by 1,774
Multiple regression as a general data-analytic system.
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026714 · Cited by 1,090
Applied Discriminant Analysis.
Hand, D. J., & Huberty, C. J. (1995) · Biometrics · doi:10.2307/2533021 · Cited by 990
The case against statistical significance testing
Carver, R. (1978) · Harvard Educational Review · doi:10.17763/haer.48.3.t490261645281841 · Cited by 931
Advances in Social Science Methodology
Thompson, B. (1994) · Cited by 426
Self-citationHeckler, C. E., & Huberty, C. J. (1995) · Technometrics · doi:10.2307/1269928 · Cited by 409
Maxwell, S. E., & Cliff, N. (1988) · Journal of the American Statistical Association · doi:10.2307/2290163 · Cited by 407
Canonical correlation analysis: A general parametric significance-testing system.
Knapp, T. R. (1978) · Psychological Bulletin · doi:10.1037/0033-2909.85.2.410 · Cited by 277
Research works printed but not linked: 3
- Craeger, J., 1969, American Educational Research Journal, 6, 706
- Thompson, B. (Ed.). (1993). Special issue on statistical significance testing, with comments from various journal editors. Journal of Experimental Education, 61(4).
- Thompson, B., 1994, Measurement Update, 4, 5
Cited by
Sorted by citations
Items 301–400 of 433
Pavlíková, I., Plášek, V., Hladký, D., Tomšejová, K., & Jančík, P. (2016) · Acta Musei Silesiae. Scientiae Naturales · doi:10.1515/cszma-2016-0030 · Cited by 4
Tadegew, G., Chane, T., & Bogale, E. K. (2024) · BMJ Public Health · doi:10.1136/bmjph-2023-000307 · Cited by 4
Mudali, D., Roerdink, J. B. T. M., Teune, L. K., Leenders, K. L., & Renken, R. J. (2016) · International Conference on Advanced Computational Intelligence (ICACI) · doi:10.1109/icaci.2016.7449841 · Cited by 4
The Missing Link: The Use of Link Words and Phrases as a Link to Manuscript Quality
Onwuegbuzie, A. J. (2016) · Journal of Educational Issues · doi:10.5296/jei.v2i2.9697 · Cited by 4
Structural Equation Modeling of Relative Desired Travel AmountsPreprint
Ory, D. T. (2007) · RePEc: Research Papers in Economics · Cited by 4
Theis, M., Hong, W., Lee, B., Nowak, S., Luetkens, J., Stuckey, S. L., Gibbs, P., Thomson, B., Michael, M., Sprinkart, A., et al. (2025) · Surgical oncology · doi:10.1016/j.suronc.2025.102251 · Cited by 5
Untadi, A., Li, L. D., Li, M. M., & Dodd, R. (2023) · Axioms · doi:10.3390/axioms12060524 · Cited by 5
Kim, S.-J., Jang, M.-K., Hwang, S.-J., Lee, W. S., & Nam, J.-S. (2024) · Agriculture · doi:10.3390/agriculture14111993 · Cited by 3
Latent growth curve model selection with Tabu search
Marcoulides, K. M. (2020) · International Journal of Behavioral Development · doi:10.1177/0165025420941170 · Cited by 3
Akinbinu, V. A. (2021) · Geotechnical and Geological Engineering · doi:10.1007/s10706-021-01907-8 · Cited by 3
Liang, G., Li, H., Huang, Y., Liu, L., Lin, J., Chen, X., & Qiu, W. (2022) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2022.109913 · Cited by 3
Chang, C.-T., Shaw, B. R., Solin, J., Gorby, T. A., & Robinson, P. (2023) · Journal of Forestry · doi:10.1093/jofore/fvad027 · Cited by 3
Rosky, J. W. (2015) · Journal of Interpersonal Violence · doi:10.1177/0886260515570752 · Cited by 3
Regionalization of flood magnitudes using the ecological attributes of watersheds
Amiri, B. J., Baheri, B., Fohrer, N., & Adamowski, J. (2018) · Geocarto International · doi:10.1080/10106049.2018.1552321 · Cited by 3
A RIGOROUS APPROACH TO PRIORITIZING CHALLENGES OF WEB-BASED APPLICATION SYSTEMS
Qadir, M., Farid, S., Nasir, M. H. N. B. M., & Akbar, A. (2021) · Malaysian Journal of Computer Science · doi:10.22452/mjcs.vol34no2.1 · Cited by 3
Variation modes of vehicle acceleration and development of ideal vehicle acceleration
Lee, S.-D., & Kim, S.-L. (2012) · Proceedings of the Institution of Mechanical Engineers Part D Journal of Automobile Engineering · doi:10.1177/0954407012442775 · Cited by 3
DEFENSE OR OFFENSE? WHICH IS THE BETTER PREDICTOR OF SUCCESS FOR PROFESSIONAL FOOTBALL TEAMS?
Onwuegbuzie, A. J. (1999) · Perceptual and Motor Skills · doi:10.2466/pms.1999.89.1.151 · Cited by 3
Njanja, L. W., Ogutu, R., & Ogutu, M. (2014) · Cited by 3
Immekus, J. C., & Atitya, B. (2016) · Educational Assessment · doi:10.1080/10627197.2016.1202108 · Cited by 2
Ahuja, K., & van der Schaar, M. (2019) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/ieeeconf44664.2019.9048941 · Cited by 3
French, B. F., Immekus, H. C., & Yen, H.-J. (2013) · SensePublishers eBooks · doi:10.1007/978-94-6209-404-8_7 · Cited by 3
Confounding, Mediation, Moderation, and General Considerations in Regression Modeling
Babyak, M. A., & Mortensen, L. H. (2022) · Springer eBooks · doi:10.1007/978-0-387-85960-6_61 · Cited by 3
Promise and Peril of the Data Deluge for Historians
Smith, G. (2022) · Journal of Cognitive Historiography · doi:10.1558/jch.21156 · Cited by 3
Estimating Poverty in the Absence of Consumption Data: The Case of Liberia
Graham, E. G., Dabalen, A., Himelein, K., & Mungai, R. (2014) · doi:10.1596/1813-9450-7024 · Cited by 3
Casais biculturais e monoculturais: diferenças e recursos
Lind, W. (2008) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) · Cited by 3
Statistical Fallacies: Misconceptions, and Myths
Sawilowsky, S. S. (2011) · International Encyclopedia of Statistical Science · doi:10.1007/978-3-642-04898-2_78 · Cited by 3
Untadi, A., Li, L. D., Li, M. M., & Dodd, R. (2023) · Preprints.org · doi:10.20944/preprints202302.0383.v1 · Cited by 3
Kreibig, S. D., Jung, S., Samson, A. C., & Gross, J. J. (2025) · Psychophysiology · doi:10.1111/psyp.70153 · Cited by 2
Predicting COVID-19 Infections in Eswatini Using the Maximum Likelihood Estimation Method
Dlamini, S. N., Dlamini, W. M. D., & Fall, I. S. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19159171 · Cited by 2
Building a better model: abandon kitchen sink regression
Kuhle, S., Brown, M. M., & Stanojevic, S. (2023) · Archives of Disease in Childhood Fetal & Neonatal · doi:10.1136/archdischild-2023-326340 · Cited by 2
Walk, D., & Dagan, N. (2023) · Punishment & Society · doi:10.1177/14624745231213859 · Cited by 2
Role of the Policy Environment in Shaping the Work of Professional Learning Partnerships
Hill, K. L., Desimone, L. M., Marianno, L., Polanco, C., & Bendel, T. (2025) · AERA Open · doi:10.1177/23328584251316465 · Cited by 2
Palmeiro-Silva, Y. K., Chandler, R. E., & Kelman, I. (2025) · The Lancet Regional Health - Americas · doi:10.1016/j.lana.2025.101151 · Cited by 2
A History of Threat in Europe and Belgium (1920–1993)
Hogenraad, R. L., & Grosbois, T. (1997) · Social Indicators Research · doi:10.1023/a:1006869517778 · Cited by 2
Using Latent Profile Analysis to Harness the Heterogeneity of Nonretained College Students
Sulak, T., Massey, J., & Thomson, D. (2015) · Journal of College Student Retention Research Theory & Practice · doi:10.1177/1521025115611385 · Cited by 2
Towards an Extended Typology of Research Errors.
Daniel, L. G., & Onwuegbuzie, A. J. (2000) · Cited by 2
STATISTICS AND THE ART OF MODEL CONSTRUCTION
Vickers, R. R. (2004) · Advances in human performance and cognitive engineering research · doi:10.1016/s1479-3601(04)05008-8 · Cited by 2
Lau, S. C. L., Drake, B. F., Thompson, V. L. S., & Baum, C. M. (2022) · Journal of Racial and Ethnic Health Disparities · doi:10.1007/s40615-022-01293-8 · Cited by 2
Bank, W. (2019) · World Bank, Washington, DC eBooks · doi:10.1596/36102 · Cited by 2
A New Hypothesis on Facial Beauty Perception
Zhang, D. D., Chen, F., & Xu, Y. (2016) · Springer eBooks · doi:10.1007/978-3-319-32598-9_9 · Cited by 2
Building and validating a predictive model for DVM academic performance
Karpen, S., & Brown, S. (2019) · Education in the Health Professions · doi:10.4103/ehp.ehp_20_19 · Cited by 2
Statistical Fallacies: Misconceptions, and Myths
(2012) · SpringerReference · doi:10.1007/springerreference_205166 · Cited by 2
Reston, J. (2016) · University of Hertfordshire Research Archive (University of Hertfordshire) · doi:10.18745/th.17108 · Cited by 2
Bain, C. M., Shi, D., Loeffelman, J. E., Norris, J. E., & Ethridge, L. E. (2024) · doi:10.31234/osf.io/j695a · Cited by 2
Psychological resilience in spousal caregivers of memory clinic patients with Alzheimer disease
Kupferschmidt, A. L. (2009) · Summit (Simon Fraser University) · Cited by 2
Jang, M.-K., Kim, S.-J., Cho, Y.-H., & Nam, J.-S. (2025) · Journal of Agricultural Engineering · doi:10.4081/jae.2025.1610 · Cited by 1
Hidaka, Y., Jo, N., Kikuchi, O., Fukahori, M., Sawada, T., Shimazu, Y., Yamamoto, M., Kometani, K., Nagao, M., Nakajima, T. E., et al. (2025) · International Immunology · doi:10.1093/intimm/dxaf013 · Cited by 1
Coxmos: interpretable survival models for high-dimensional and multi-omic data
Salguero, P., Galera, A. B., & Tarazona, S. (2026) · BioData Mining · doi:10.1186/s13040-026-00559-9 · Cited by 1
Fendereski, F., Creed, I. F., & Trick, C. G. (2025) · Journal of Geophysical Research Biogeosciences · doi:10.1029/2025jg008974 · Cited by 1
Tong, S. F. (2012) · UPT. Syiah Kuala University Library (Syiah Kuala University) · Cited by 1
A regression analysis of predictors on the productivity indices of Major League Baseball: 1985–2003
Stick, J. D. (2005) · Lincoln (University of Nebraska) · Cited by 1
All-Possible-Subsets for MANOVA and Factorial MANOVAs
Nimon, K., Zientek, L. R., & Kraha, A. (2016) · International Journal of Adult Vocational Education and Technology · doi:10.4018/ijavet.2016040107 · Cited by 1
Jiao, Q. G., Collins, K. M. T., & Onwuegbuzie, A. J. (2013) · The College Quarterly · Cited by 1
da Costa, R. F., Weigert-Dalagnol, G. R., Marcilio, D. C., de Medeiros, L., Silva, E. J., Jiayu, X., Curi, E. P., Juan, S. M., Polizel, R. T., & Fontoura, H. (2023) · Energies · doi:10.3390/en16197012 · Cited by 1
Investigating Variable Selection Techniques Under Missing Data: A Simulation Study
Bain, C. M., & Shi, D. (2024) · Springer proceedings in mathematics & statistics · doi:10.1007/978-3-031-55548-0_11 · Cited by 1
Leech, N. L. (2023) · Journal of Mixed Methods Studies · doi:10.59455/jomes.2023.7.2 · Cited by 1
Expectancies in Double-Blind Randomised Placebo-Controlled Trials and Placebo-Induced Side Effects
Colagiuri, B. (2012) · UPT. Syiah Kuala University Library (Syiah Kuala University) · Cited by 1
McCurtis, B. R. (2012) · ProQuest LLC eBooks · Cited by 1
Kawakami, M., Nakayama, C., & Liu, M. (2016) · Brain Impairment · doi:10.1017/brimp.2016.14 · Cited by 1
Physiological and anthropometric predictors of mountain ultra marathon performance
Rogers, M. (2017) · Summit (Simon Fraser University) · Cited by 1
Temperature Prediction of Combustion Layers for 660MW Ultra Supercritical Unit Through the VIP-SR
Li, X., Zhu, Y., Yang, G., & Liu, H. (2018) · IEEE International Conference on Information and Automation (ICIA) · doi:10.1109/icinfa.2018.8812432 · Cited by 1
Huang, Y. L. (2011) · doi:10.13140/rg.2.1.4924.5922 · Cited by 1
Stepwise Descriptive or Predictive Discriminant Analysis: Don't Even Think about Using It!.
Klemmer, C. D. (2000) · Cited by 1
Methodological issues & strategies in clinical research
Fagley, N. S. (2004) · Psychotherapy Research · doi:10.1093/ptr/kph012 · Cited by 1
Teachers’ Executive Functioning Abilities and Levels of Occupational Stress
Patrawala, N. M. (2018) · Scholarship & Creative Works - Digital UNC a service of University Libraries (University of Northern Colorado) · Cited by 1
Thompson, B. (1996) · Educational and Psychological Measurement · doi:10.1177/0013164496056001015 · Cited by 1
Self-citationPrédiction du risque de DMLA : identification de nouveaux biomarqueurs et modélisation du risque
Ajana, S. (2019) · theses.fr (ABES) · doi:10.70675/b0924b67ze4edz4545za9c7zf7fba3f23057 · Cited by 1
Grigg, K. (2017) · Figshare · doi:10.4225/03/58a65f877f3dd · Cited by 1
Yurka, L. N. (2014) · Aquila Digital Community (University of Southern Mississippi)
Gracia, S. (2000) · Digital Commons (Providence College)
Racial Profiling Policy and its Relation to Pro-Active Policing
Anders, B. R. (2011) · ScholarWorks (Walden University)
Beatty, A. S. (2013) · University of Minnesota Digital Conservancy (University of Minnesota)
Book Review: Common Errors in Statistics (and How to Avoid Them)
Thompson, B. (2006) · Applied Psychological Measurement · doi:10.1177/0146621605280145
Self-citationNOTE ON KORBANKA AND GAEDE'S MMPI-2 SCALE OF HISTORY OF EMOTIONAL ABUSE
Brophy, A. L. (2005) · Psychological Reports · doi:10.2466/pr0.97.1.291-296
Onwuegbuzie, A. J. (2000) · Perceptual and Motor Skills · doi:10.2466/pms.2000.90.2.640
Yu, C. H. (2010) · Dialnet (Universidad de la Rioja)
Computer-Intensive Methods in Traffic Safety Research
Harold Stanislaw, A. (2002) · International Journal of Occupational Safety and Ergonomics · doi:10.1080/10803548.2002.11076535
A survey of variable selection methods in two
Liao, H., & Lynn, H. (2010)
Neatt, K. (2016) · Saint Mary's University Institutional Repository (Saint Mary's University)
Salas, C., Ene, L. T., Ojeda, N., & Soto, H. (2010)
Tharenou, P., Donohue, R., & Cooper, B. K. (2007) · Cambridge University Press eBooks · doi:10.1017/cbo9780511810527.012
Eisenberg, M. M., Hennessy, M. H., Coviello, D., Hanrahan, N. P., & Blank, M. B. (2016) · AIDS and Behavior · doi:10.1007/s10461-016-1517-4
Prediction of neurodegenerative diseases from functional brain imaging data
Mudali, D. (2016) · University of Groningen research database (University of Groningen / Centre for Information Technology)
Angkurawaranon, C. (2013) · Biomedical Sciences and Clinical Medicine
Skin Color detection Using Stepwise Neural Network and Color Mapping Co-occurrence Matrix
Osman, G., & Hitam, M. S. (2014) · INTERNATIONAL JOURNAL OF COMPUTERS & TECHNOLOGY · doi:10.24297/ijct.v12i7.3076
Optimizing production and inventory decisions at all-you-care-to-eat facilities
Birişçi, E. (2016) · MOspace Institutional Repository (University of Missouri)
Conducting All-Possible-Subsets for MANOVA and Factorial MANOVA
Nimon, K., Zientek, L. R., & Kraha, A. (2018) · Advances in library and information science (ALIS) book series · doi:10.4018/978-1-5225-5164-5.ch019
Oswald, C. (2020) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/68ye-rt64
A Health Outcomes Resource Standard (HORSt) for Australian State Public Health Funding Distributions
Slater, J. G. (2019) · Research Online (University of Wollongong)
Brown, L. (2019) · SHAREOK (University of Oklahoma; Oklahoma State University; Central Oklahoma University)
Haridas, J. (2021) · Turkish Journal of Computer and Mathematics Education (TURCOMAT) · doi:10.17762/turcomat.v12i10.4636
A stochastic predictive model for Class II rocks post peak modulusPreprint
Akinbinu, V. A. (2021) · Research Square · doi:10.21203/rs.3.rs-331178/v1
Tharenou, P., Donohue, R., & Cooper, B. K. (2007)
Metadata
- Authors
- Thompson, B.
- Affiliations
- Baylor College of Medicine (US)
- Corresponding author
- Thompson, Bruce
- Venue
- Educational and Psychological Measurement
- Publisher
- SAGE Publications
- Published
- 1995-08
- Volume
- 55
- Issue
- 4
- Pages
- 525-534
- ISSN
- 0013-1644 (ISSN-L)
- 1552-3888
- OpenAlex
- W2088223830
- Cited by
- 434
- References
- 24
- Citations by year
- 2026: 12 · 2025: 13 · 2024: 16 · 2023: 21 · 2022: 32 · 2021: 26 · 2020: 22 · 2019: 21 · 2018: 16 · 2017: 13 · 2016: 21 · 2015: 10 · 2014: 16 · 2013: 24 · 2012: 16
- FWCI
- 8.47
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Educational and Psychological Measurement (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- stepwise regression, stepwise discriminant analysis, feature selection, degrees of freedom, sampling error, replicability, feature importance, statistical methodology critique
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review