The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Exact and Approximate Stepdown Methods for Multiple Hypothesis Testing
Open accessAbstract
Consider the problem of testing k hypotheses simultaneously. In this article we discuss finite- and large-sample theory of stepdown methods that provide control of the familywise error rate (FWE). To improve on the Bonferroni method or on Holm's stepdown method, Westfall and Young made effective use of resampling to construct stepdown methods that implicitly estimate the dependence structure of the test statistics. However, their methods depend on an assumption known as “subset pivotality.” Our goal here is to construct general stepdown methods that do not require such an assumption. To accomplish this, we take a close look at what makes stepdown procedures work; a key component is a monotonicity requirement of critical values. By imposing monotonicity on estimated critical values (which is not an assumption on the model but rather is an assumption on the method), we show how to construct stepdown tests that can be applied in a stagewise fashion so that at most k tests need to be computed. Moreover, at each stage, an intersection test that controls the usual probability of a type 1 error is calculated, which allows us to draw on an enormous resampling literature as a general means of test construction. In addition, it is possible to carry out this method using the same set of resamples (or subsamples) for each of the intersection tests.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Similar to traditional multiple-hypothesis testing procedures, such as the Bonferroni or Holm procedures (see, e.g., Lehmann and Romano (2005), for a discussion of these procedures), the stepdown algorithm of Romano and Wolf (2005) exhibits strong FWER control, in contrast with the classical tests like the F or χ2.”
From Analyzing social experiments as implemented: A reexamination of the evidence from the HighScope Perry Preschool Program (2010) · cites this paper as Romano and Wolf (2005)
The cited source says what the claim attributes to it.
In the citing paper
“The validity of this procedure follows from the analysis of Romano and Wolf (2005), who provide general results on the use of stepdown multiple-hypothesis testing procedures.”
From Analyzing social experiments as implemented: A reexamination of the evidence from the HighScope Perry Preschool Program (2010) · cites this paper as Romano and Wolf (2005)
The cited source says what the claim attributes to it.
In the citing paper
“Romano and Wolf (2005) show that their monotonicity assumption is weaker than the subset pivotality assumption.”
From Analyzing social experiments as implemented: A reexamination of the evidence from the HighScope Perry Preschool Program (2010) · cites this paper as Romano and Wolf (2005)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526
The control of the false discovery rate in multiple testing under dependency
Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490
Multiple Comparison Procedures
Hochberg, Y., & Tamhane, A. C. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316672 · Cited by 2,389
The Bootstrap and Edgeworth Expansion
Hall, P. (1992) · Springer series in statistics · doi:10.1007/978-1-4612-4384-7 · Cited by 2,102
On closed testing procedures with special reference to ordered analysis of variance
Marcus, R., Peritz, E., & Gabriel, K. R. (1976) · Biometrika · doi:10.1093/biomet/63.3.655 · Cited by 1,417
Multiple Hypothesis Testing in Microarray Experiments
Dudoit, S., Shaffer, J. P., & Boldrick, J. C. (2003) · Statistical Science · doi:10.1214/ss/1056397487 · Cited by 1,054
Politis, D. N., Romano, J. P., & Wolf, M. (1999) · Springer Series in Statistics · doi:10.1007/978-1-4612-1554-7 · Cited by 760
Self-citationJeankyung, K., & Pollard, D. (1990) · The Annals of Statistics · doi:10.1214/aos/1176347498 · Cited by 640
Two Guidelines for Bootstrap Hypothesis Testing
Hall, P., & Wilson, S. R. (1991) · Biometrics · doi:10.2307/2532163 · Cited by 471
Flagged first, then by citations
Research works printed but not linked: 9
- Ser. B, 57, 289
- Association, 94, 569
- The Annals, Statistics, 26, 505
- Scandinavian Journal, Statistics, 6, 65
- Statistics, 18, 191
- Tests, American Statistical Association, 78, 949
- Journal, 43, 617
- Tests, American Statistical Association, 83, 698
- Distributions, The American Statistician, 51, 3
Cited by
Sorted by citations
Items 101–200 of 613
Personality, Education, and Health-Related Outcomes of High-Ability Individuals
Savelyev, P. A., & Tan, K. T. K. (2014) · American Journal of Health Economics · doi:10.1162/ajhe_a_00116 · Cited by 33
Mokyr, J., Sarid, A., & van der Beek, K. (2022) · The Economic Journal · doi:10.1093/ej/ueab102 · Cited by 43
Estimating the Short-Term Effects of the Earned Income Tax Credit on Child Health
Hamad, R., Collin, D. F., & Rehkopf, D. H. (2018) · American Journal of Epidemiology · doi:10.1093/aje/kwy179 · Cited by 30
Feng, L., & Xiao, J. J. (2020) · China Economic Review · doi:10.1016/j.chieco.2020.101533 · Cited by 28
Alan, Ş., & Mumcu, I. (2024) · American Economic Review · doi:10.1257/aer.20230084 · Cited by 28
Rotation‐based multiple testing in the multivariate linear model
Solari, A., Finos, L., & Goeman, J. J. (2014) · Biometrics · doi:10.1111/biom.12238 · Cited by 28
Optimal testing of multiple hypotheses with common effect direction
Bittman, R. M., Romano, J. P., Vallarino, C. R., & Wolf, M. (2009) · Biometrika · doi:10.1093/biomet/asp006 · Cited by 27
Self-citationInference with Imperfect Randomization: The Case of the Perry Preschool Program
Heckman, J. J., Pinto, R. R., Shaikh, A. M., & Yavitz, A. (2011) · National Bureau of Economic Research · doi:10.3386/w16935 · Cited by 27
Conditional cash transfer programs and household labor supply
Boca, D. D., Pronzato, C., & Sorrenti, G. (2021) · European Economic Review · doi:10.1016/j.euroecorev.2021.103755 · Cited by 24
Partially observed functional data: The case of systematically missing parts
Liebl, D., & Rameseder, S. (2018) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2018.08.011 · Cited by 26
Valid simultaneous inference in high-dimensional settings (with the HDM package for R)
Bach, P., Chernozhukov, V., & Spindler, M. (2019) · doi:10.1920/wp.cem.2019.3019 · Cited by 26
von Haaren, P., & Klonner, S. (2021) · Health Economics · doi:10.1002/hec.4390 · Cited by 25
Fromont, M., Laurent, B., & Reynaud-Bouret, P. (2013) · The Annals of Statistics · doi:10.1214/13-aos1114 · Cited by 25
Multistage Tests of Multiple Hypotheses
Bartroff, J. L., & Lai, T. L. (2010) · Communication in Statistics- Theory and Methods · doi:10.1080/03610920802592852 · Cited by 25
Estimating Marginal Returns to Education
Carneiro, P., Heckman, J. J., & Vytlacil, E. (2010) · National Bureau of Economic Research · doi:10.3386/w16474 · Cited by 25
The effects of incentivizing early prenatal care on infant health
Cygan‐Rehm, K., & Karbownik, K. (2022) · Journal of Health Economics · doi:10.1016/j.jhealeco.2022.102612 · Cited by 26
Dimension-agnostic inference using cross U-statistics
Kim, I., & Ramdas, A. (2023) · Bernoulli · doi:10.3150/23-bej1613 · Cited by 24
Bootstrap and permutation tests of independence for point processes
Albert, M., Bouret, Y., Fromont, M., & Reynaud-Bouret, P. (2015) · The Annals of Statistics · doi:10.1214/15-aos1351 · Cited by 24
Doyle, O., Fitzpatrick, N., Lovett, J., & Rawdon, C. (2015) · Economics & Human Biology · doi:10.1016/j.ehb.2015.09.004 · Cited by 26
Learning, Hygiene and Traditional Medicine
Bennett, D., Naqvi, A., & Schmidt, W. (2018) · The Economic Journal · doi:10.1111/ecoj.12549 · Cited by 24
DoubleML -- An Object-Oriented Implementation of Double Machine Learning in PythonPreprint
Bach, P., Chernozhukov, V., Kurz, M. S., & Spindler, M. (2021) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.2104.03220 · Cited by 24
Gender differences in alternating-offer bargaining: an experimental study
Hernandez-Arenaz, I., & Iriberri, N. (2023) · Experimental Economics · doi:10.1007/s10683-023-09796-9 · Cited by 15
Chandir, S., Siddiqi, D. A., Abdullah, S., Duflo, E., Khan, A. J., & Glennerster, R. (2022) · EClinicalMedicine · doi:10.1016/j.eclinm.2022.101500 · Cited by 24
Park, S., Closser, S., Cooney, E. E., Atkins, K., Thrul, J., McDonald, K. M., Langhinrichsen‐Rohling, J., & Veenema, T. G. (2023) · Journal of Traumatic Stress · doi:10.1002/jts.22967 · Cited by 23
Closed Testing in Pharmaceutical Research: Historical and Recent Developments
Henning, K. S. S., & Westfall, P. H. (2015) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2015.1004270 · Cited by 23
Some nonasymptotic results on resampling in high dimension, II: Multiple tests
Arlot, S., Blanchard, G., & Roquain, É. (2009) · The Annals of Statistics · doi:10.1214/08-aos668 · Cited by 23
O’Sullivan, A. M., Fitzpatrick, N., & Doyle, O. (2016) · Public Health Nutrition · doi:10.1017/s1368980016001877 · Cited by 23
Hypothesis Testing in EconometricsPreprint
Romano, J. P., Shaikh, A. M., & Wolf, M. (2009) · SSRN Electronic Journal · doi:10.2139/ssrn.1477886 · Cited by 23
Self-citationGenerative Adversarial Networks for Financial Trading Strategies Fine-Tuning and CombinationPreprint
Koshiyama, A., Firoozye, N. B., & Treleaven, P. C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.01751 · Cited by 23
Contracting in the Dark: The rise of public-side lenders in the syndicated loan market
Amiraslani, H., Donovan, J. B., PHILLIPS, M. A., & Moerman, R. W. (2023) · Journal of Accounting and Economics · doi:10.1016/j.jacceco.2023.101586 · Cited by 22
Does Recognition versus Disclosure Affect Debt Contracting? Evidence from SFAS 158
Donovan, J. B., McMartin, A. S., & PHILLIPS, M. A. (2023) · The Accounting Review · doi:10.2308/tar-2019-1066 · Cited by 22
The Mixed vs the Integrated Approach to Style Investing: Much Ado About Nothing?
Leippold, M., & Rueegg, R. (2017) · European Financial Management · doi:10.1111/eufm.12139 · Cited by 22
Kelly, J. R., Proctor, H. C., & Volpe, J. P. (2007) · Hydrobiologia · doi:10.1007/s10750-007-9057-6 · Cited by 22
Self-control and unhealthy body weight: The role of impulsivity and restraint
Cobb‐Clark, D. A., Dahmann, S. C., Kamhöfer, D. A., & Schildberg-Hörisch, H. (2023) · Economics & Human Biology · doi:10.1016/j.ehb.2023.101263 · Cited by 21
Quantifying the human impact of Melbourne’s 111-day hard lockdown experiment on the adult population
Schurer, S., Atalay, K., Glozier, N., Vera‐Toscano, E., & Wooden, M. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01638-1 · Cited by 21
Romano, J. P., Shaikh, A. M., & Wolf, M. (2010) · Palgrave Macmillan UK eBooks · doi:10.1057/978-1-349-95121-5_2914-1 · Cited by 24
Self-citationThe impact of high temperatures on performance in work-related activities
Picchio, M., & OURS, J. C. V. (2024) · Labour Economics · doi:10.1016/j.labeco.2024.102509 · Cited by 23
Sturgeon, J. P., Tome, J., Dumbura, C., Majo, F. D., Ngosa, D., Mutasa, K., Zyambo, K., Besa, E. C., Chandwe, K., Kapoma, C., et al. (2024) · Science Translational Medicine · doi:10.1126/scitranslmed.adh0673 · Cited by 20
Gharbi, S., Khateri, S., Soroush, M. R., Shamsara, M., Naeli, P., Najafi, A., Korsching, E., & Mowla, S. J. (2018) · PLoS ONE · doi:10.1371/journal.pone.0194530 · Cited by 20
Model Selection confidence sets by likelihood ratio testing
Zheng, C., Ferrari, D., & Yang, Y. (2017) · Statistica Sinica · doi:10.5705/ss.202017.0006 · Cited by 20
Input Variable Selection in Neural Network Models
Giordano, F., Rocca, M. L., & Perna, C. (2014) · Communication in Statistics- Theory and Methods · doi:10.1080/03610926.2013.804567 · Cited by 20
García, J. L., Heckman, J. J., & Ronda, V. (2021) · National Bureau of Economic Research · doi:10.3386/w29057 · Cited by 21
Scared Straight? Threat and Assimilation of Refugees in Germany
Jaschke, P., Sardoschau, S., & Tabellini, M. (2022) · National Bureau of Economic Research · doi:10.3386/w30381 · Cited by 24
Attanasio, O. P., Meghir, K., Rubio‐Codina, M., Welch, K., & Quddus, S. (2016) · AEA Randomized Controlled Trials · doi:10.1257/rct.1071-1.0 · Cited by 20
Simultaneous Statistical Inference in Dynamic Factor Models
Dickhaus, T., & Pauly, M. (2016) · Contributions to statistics · doi:10.1007/978-3-319-28725-6_3 · Cited by 19
An Evaluation of the Educational Impact of College Campus Visits: A Randomized Experiment
Swanson, E., Kopotic, K., Zamarro, G., Mills, J. N., Greene, J. P., & Ritter, G. W. (2021) · AERA Open · doi:10.1177/2332858421989707 · Cited by 25
The Merging of Statistics Education, Consulting and Research: A Case Study
Jeske, D. R., Lesch, S. M., & Deng, H. (2007) · Journal of Statistics Education · doi:10.1080/10691898.2007.11889544 · Cited by 19
Type I error rate control for testing many hypotheses: a survey with proofsPreprint
Roquain, É. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1012.4078 · Cited by 19
Does Economics Make You Sexist?
Paredes, V., Paserman, M. D., & Pino, F. (2020) · National Bureau of Economic Research · doi:10.3386/w27070 · Cited by 20
Grácio, M., & Vicente, P. C. (2021) · Journal of Development Economics · doi:10.1016/j.jdeveco.2021.102665 · Cited by 18
Murder nature: Weather and violent crime in rural Brazil
Ishak, P. W. (2022) · World Development · doi:10.1016/j.worlddev.2022.105933 · Cited by 18
Bannenberg, N., Førland, O., Iversen, T., Karlsson, M., & Øien, H. (2021) · American Journal of Health Economics · doi:10.1086/714988 · Cited by 18
Combinatorial inference for graphical models
Neykov, M., Lu, J., & Liu, H. (2019) · The Annals of Statistics · doi:10.1214/17-aos1650 · Cited by 18
Simple Tests for Selection Bias: Learning More from Instrumental VariablesPreprint
Black, D. A., Joo, J., LaLonde, R. J., Smith, J. A., & Taylor, E. J. (2015) · SSRN Electronic Journal · doi:10.2139/ssrn.2663776 · Cited by 17
Ding, W., & Lehrer, S. (2005) · RePEc: Research Papers in Economics · doi:10.22004/ag.econ.273516 · Cited by 18
von Meyerinck, F., Niessen‐Ruenzi, A., Schmid, M., & Solomon, S. D. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3303798 · Cited by 18
The Impact of Paid Family Leave on Employers: Evidence from New York
Bartel, A. P., Rossin‐Slater, M., Ruhm, C. J., Slopen, M. E., & Waldfogel, J. (2021) · National Bureau of Economic Research · doi:10.3386/w28672 · Cited by 18
Happy Times: Measuring Happiness Using Response Times
Liu, S., & Netzer, N. (2023) · American Economic Review · doi:10.1257/aer.20211051 · Cited by 17
Albert, M., Bouret, Y., Fromont, M., & Reynaud-Bouret, P. (2016) · Neural Computation · doi:10.1162/neco_a_00839 · Cited by 11
Evaluation of the Reggio approach to early education
Biroli, P., Boca, D. D., Heckman, J. J., Heckman, L. P., Koh, Y. K., Kuperman, S., Moktan, S., Pronzato, C., & Ziff, A. L. (2017) · Research in Economics · doi:10.1016/j.rie.2017.05.006 · Cited by 20
Multiple Testing of One-Sided Hypotheses: Combining Bonferroni and the Bootstrap
Romano, J. P., & Wolf, M. (2017) · Studies in computational intelligence · doi:10.1007/978-3-319-70942-0_4 · Cited by 18
Self-citationWhen Dad Can Stay Home: Fathers' Workplace Flexibility and Maternal Health
Persson, P., & Rossin‐Slater, M. (2024) · American Economic Journal Applied Economics · doi:10.1257/app.20220400 · Cited by 16
Increasing production diversity and diet quality: Evidence from Bangladesh
Ahmed, A., Coleman, F. M., Ghostlaw, J., Hoddinott, J. F., Menon, P., Parvin, A., Pereira, A. V., Quisumbing, A. R., Roy, S., & Younus, M. (2023) · American Journal of Agricultural Economics · doi:10.1111/ajae.12427 · Cited by 18
Uncertainty in the Hot Hand Fallacy: Detecting Streaky Alternatives to Random Bernoulli Sequences
Ritzwoller, D. M., & Romano, J. P. (2021) · The Review of Economic Studies · doi:10.1093/restud/rdab020 · Cited by 16
Self-citationHeckman, J. J., & Karapakula, G. (2021) · Econometrics Journal · doi:10.1093/ectj/utab009 · Cited by 17
Salem, N. A., Mahnke, A. H., Wells, A., Tseng, A. M., Yevtushok, L., Zymak‐Zakutnya, N., Wertlecki, W., Chambers, C., Miranda, R. C., & (CIFASD), C. I. O. F. A. S. D. (2020) · Biology of Sex Differences · doi:10.1186/s13293-020-00327-2 · Cited by 17
A Two-Step Method for Testing Many Moment Inequalities
Bai, Y., Santos, A., & Shaikh, A. M. (2021) · Journal of Business and Economic Statistics · doi:10.1080/07350015.2021.1897016 · Cited by 16
Thiemann, P. (2021) · Management Science · doi:10.1287/mnsc.2021.3993 · Cited by 16
Spillover effects of financial education: The impact of school-based programs on parents
Frisancho, V. (2023) · Journal of Financial Literacy and Wellbeing · doi:10.1017/flw.2023.2 · Cited by 16
INCOME EFFECTS ON MATERNAL LABOR SUPPLY: EVIDENCE FROM CHILD-RELATED TAX BENEFITS
Wingender, P., & LaLumia, S. (2017) · National Tax Journal · doi:10.17310/ntj.2017.1.01 · Cited by 16
Appearance Discrimination in Grading? − Evidence from Migrant Schools in China
Chen, Q.-H., Wang, X.-B., & Zhao, Q.-R. (2019) · Economics Letters · doi:10.1016/j.econlet.2019.04.024 · Cited by 15
Recent developments towards optimality in multiple hypothesis testing
Shaffer, J. P. (2006) · Institute of Mathematical Statistics eBooks · doi:10.1214/074921706000000374 · Cited by 16
Primate Evidence on the Late Health Effects of Early Life Adversity
Conti, G., Hansman, C., Heckman, J. J., Novak, M. F. X., Ruggiero, A. M., & Suomi, S. J. (2012) · National Bureau of Economic Research · doi:10.3386/w18002 · Cited by 17
Facilitating healthy dietary habits: An experiment with a low income population
Belot, M., James, J., & Spiteri, J. (2020) · European Economic Review · doi:10.1016/j.euroecorev.2020.103550 · Cited by 13
The child education and health ethnic inequality consequences of climate shocks in Vietnam
Pham, T. (2022) · Economics of Education Review · doi:10.1016/j.econedurev.2022.102311 · Cited by 15
Statistical evaluation of HIV vaccines in early clinical trials
Moodie, Z., Rossini, A. J., Hudgens, M. G., Gilbert, P. B., Self, S. G., & Russell, N. D. (2006) · Contemporary Clinical Trials · doi:10.1016/j.cct.2005.11.008 · Cited by 15
Private health investments under competing risks: Evidence from malaria control in Senegal
Rossi, P., & Villar, P. (2020) · Journal of Health Economics · doi:10.1016/j.jhealeco.2020.102330 · Cited by 14
Krekel, C., Jan-emmanuel De Neve, A., Fancourt, D. E., & Layard, R. (2021) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2021.05.021 · Cited by 21
The impact of universal prekindergarten on family behavior and child outcomes
Chor, E., Andresen, M. E., & Kalil, A. (2016) · Economics of Education Review · doi:10.1016/j.econedurev.2016.10.002 · Cited by 15
Denisova–Schmidt, E., Huber, M., Leontyeva, E., & Solovyeva, A. (2020) · Empirical Economics · doi:10.1007/s00181-020-01827-1 · Cited by 16
Measuring Investment in Human Capital Formation: An Experimental Analysis of Early Life Outcomes
Doyle, O., Harmon, C. P., Heckman, J. J., Logue, C., & Moon, S. H. (2013) · National Bureau of Economic Research · doi:10.3386/w19316 · Cited by 14
Semi-supervised multiple testing
Mary, D. L., & Roquain, É. (2022) · Electronic Journal of Statistics · doi:10.1214/22-ejs2050 · Cited by 13
Sturt, J., Griffiths, F., Ajisola, M., Akinyemi, J. O., Chipwaza, B., Fayehun, O., Harris, B., Owoaje, E., Rogers, R., Pemba, S., et al. (2023) · The Lancet Global Health · doi:10.1016/s2214-109x(23)00411-4 · Cited by 13
Indirect Effects of Access to Finance
Cai, J., & Szeidl, Á. (2022) · American Economic Review · doi:10.1257/aer.20220711 · Cited by 15
Breaking the Cycle of Deprivation: An Experimental Evaluation of an Early Childhood Intervention
Doyle, O. (2012) · Arrow@dit (Dublin Institute of Technology) · Cited by 13
Are housing characteristics experienced by children associated with their outcomes as young adults?
Blau, D. M., Haskell, N. L., & Haurin, D. R. (2019) · Journal of Housing Economics · doi:10.1016/j.jhe.2019.04.003 · Cited by 13
The impact of free, universal pre-school education on maternal labour supply
Brewer, M., Cattan, S., Crawford, C., & Rabe, B. (2014) · doi:10.1920/re.ifs.2024.0467 · Cited by 13
A Practical Method for Testing Many Moment InequalitiesPreprint
Bai, Y., Santos, A., & Shaikh, A. M. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3454610 · Cited by 13
Long Term Effects of Cash Transfer Programs in Colombia
Attanasio, O. P., Cardona‐Sosa, L., Medina, C., Meghir, C., & Posso, C. (2021) · National Bureau of Economic Research · doi:10.3386/w29056 · Cited by 13
Inference on Optimal Treatment AssignmentsPreprint
Armstrong, T. B., & Shen, S. (2015) · SSRN Electronic Journal · doi:10.2139/ssrn.2592479 · Cited by 13
Police Violence, Student Protests, and Educational Performance
González, F., & Prem, M. (2022) · The Review of Economics and Statistics · doi:10.1162/rest_a_01186 · Cited by 12
Aygün, A., Kırdar, M., Koyuncu, M., & Stoeffler, Q. (2024) · Journal of Development Economics · doi:10.1016/j.jdeveco.2024.103266 · Cited by 8
Can Early Intervention Have a Sustained Effect on Human Capital?
Doyle, O. (2022) · The Journal of Human Resources · doi:10.3368/jhr.0321-11557r1 · Cited by 11
Effects of marriage equality legislation on sexual health of the US population
Nikolaou, D. (2022) · Health Economics · doi:10.1002/hec.4612 · Cited by 12
Tests of hypotheses arising in the correlated random coefficient model
Heckman, J. J., & Schmierer, D. (2010) · Economic Modelling · doi:10.1016/j.econmod.2010.07.019 · Cited by 12
Angelini, V., Bertoni, M., Stella, L., & Weiss, C. (2019) · European Economic Review · doi:10.1016/j.euroecorev.2019.07.002 · Cited by 13
Multiplicity- and dependency-adjusted p -values for control of the family-wise error rate
Stange, J., Dickhaus, T., Navarro, A., & Schunk, D. (2016) · Statistics & Probability Letters · doi:10.1016/j.spl.2016.01.005 · Cited by 12
Testing identifying assumptions in nonseparable panel data models
Ghanem, D. (2016) · Journal of Econometrics · doi:10.1016/j.jeconom.2016.11.005 · Cited by 12
Tests of Mutual or Serial Independence of Random Vectors with Applications
Bilodeau, M., & Nangue, A. G. (2017) · Journal of Machine Learning Research · Cited by 12
Testing the Correlated Random Coefficient Model
Heckman, J. J., Schmierer, D., & Urzúa, S. (2009) · National Bureau of Economic Research · doi:10.3386/w15463 · Cited by 12
Metadata
- Authors
- Romano, J. P., & Wolf, M.
- Affiliations
- Stanford University (US)
- Venue
- Journal of the American Statistical Association
- Publisher
- Informa UK Limited
- Published
- 2005-03
- Volume
- 100
- Issue
- 469
- Pages
- 94-108
- ISSN
- 0162-1459 (ISSN-L)
- 1537-274X
- OpenAlex
- W3124231044
- Cited by
- 609
- References
- 23
- Citations by year
- 2026: 44 · 2025: 63 · 2024: 51 · 2023: 52 · 2022: 60 · 2021: 47 · 2020: 38 · 2019: 33 · 2018: 38 · 2017: 29 · 2016: 25 · 2015: 15 · 2014: 22 · 2013: 11 · 2012: 14
- FWCI
- 10.03
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Locations
- Journal of the American Statistical Association (publishedVersion)
- SSRN Electronic Journal (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Repositori digital de la UPF (Universitat Pompeu Fabra) (submittedVersion, cc-by-nc-nd)
- RECERCAT (Consorci de Serveis Universitaris de Catalunya) (submittedVersion, other-oa)
- Funders
- National Science Foundation
- Ministerio de Ciencia y Tecnología
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- Physical Sciences › Mathematics › Statistics and Probability › Probability and Statistical Research
- Keywords
- multiple comparisons, family-wise error rate, resampling, Bonferroni correction, intersection tests, asymptotic theory
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review