The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Exact and Approximate Stepdown Methods for Multiple Hypothesis Testing
Open accessAbstract
Consider the problem of testing k hypotheses simultaneously. In this article we discuss finite- and large-sample theory of stepdown methods that provide control of the familywise error rate (FWE). To improve on the Bonferroni method or on Holm's stepdown method, Westfall and Young made effective use of resampling to construct stepdown methods that implicitly estimate the dependence structure of the test statistics. However, their methods depend on an assumption known as “subset pivotality.” Our goal here is to construct general stepdown methods that do not require such an assumption. To accomplish this, we take a close look at what makes stepdown procedures work; a key component is a monotonicity requirement of critical values. By imposing monotonicity on estimated critical values (which is not an assumption on the model but rather is an assumption on the method), we show how to construct stepdown tests that can be applied in a stagewise fashion so that at most k tests need to be computed. Moreover, at each stage, an intersection test that controls the usual probability of a type 1 error is calculated, which allows us to draw on an enormous resampling literature as a general means of test construction. In addition, it is possible to carry out this method using the same set of resamples (or subsamples) for each of the intersection tests.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Similar to traditional multiple-hypothesis testing procedures, such as the Bonferroni or Holm procedures (see, e.g., Lehmann and Romano (2005), for a discussion of these procedures), the stepdown algorithm of Romano and Wolf (2005) exhibits strong FWER control, in contrast with the classical tests like the F or χ2.”
From Analyzing social experiments as implemented: A reexamination of the evidence from the HighScope Perry Preschool Program (2010) · cites this paper as Romano and Wolf (2005)
The cited source says what the claim attributes to it.
In the citing paper
“The validity of this procedure follows from the analysis of Romano and Wolf (2005), who provide general results on the use of stepdown multiple-hypothesis testing procedures.”
From Analyzing social experiments as implemented: A reexamination of the evidence from the HighScope Perry Preschool Program (2010) · cites this paper as Romano and Wolf (2005)
The cited source says what the claim attributes to it.
In the citing paper
“Romano and Wolf (2005) show that their monotonicity assumption is weaker than the subset pivotality assumption.”
From Analyzing social experiments as implemented: A reexamination of the evidence from the HighScope Perry Preschool Program (2010) · cites this paper as Romano and Wolf (2005)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526
The control of the false discovery rate in multiple testing under dependency
Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490
Multiple Comparison Procedures
Hochberg, Y., & Tamhane, A. C. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316672 · Cited by 2,389
The Bootstrap and Edgeworth Expansion
Hall, P. (1992) · Springer series in statistics · doi:10.1007/978-1-4612-4384-7 · Cited by 2,102
On closed testing procedures with special reference to ordered analysis of variance
Marcus, R., Peritz, E., & Gabriel, K. R. (1976) · Biometrika · doi:10.1093/biomet/63.3.655 · Cited by 1,417
Multiple Hypothesis Testing in Microarray Experiments
Dudoit, S., Shaffer, J. P., & Boldrick, J. C. (2003) · Statistical Science · doi:10.1214/ss/1056397487 · Cited by 1,054
Politis, D. N., Romano, J. P., & Wolf, M. (1999) · Springer Series in Statistics · doi:10.1007/978-1-4612-1554-7 · Cited by 760
Self-citationJeankyung, K., & Pollard, D. (1990) · The Annals of Statistics · doi:10.1214/aos/1176347498 · Cited by 640
Two Guidelines for Bootstrap Hypothesis Testing
Hall, P., & Wilson, S. R. (1991) · Biometrics · doi:10.2307/2532163 · Cited by 471
Flagged first, then by citations
Research works printed but not linked: 9
- Ser. B, 57, 289
- Association, 94, 569
- The Annals, Statistics, 26, 505
- Scandinavian Journal, Statistics, 6, 65
- Statistics, 18, 191
- Tests, American Statistical Association, 78, 949
- Journal, 43, 617
- Tests, American Statistical Association, 83, 698
- Distributions, The American Statistician, 51, 3
Cited by
Sorted by citations
Items 401–500 of 613
Multiple Testing of One-Sided Hypotheses: Combining Bonferroni and the BootstrapPreprint
Romano, J. P., & Wolf, M. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3011365 · Cited by 2
Self-citationDimension-agnostic inferencePreprint
Kim, I., & Ramdas, A. (2020) · arXiv (Cornell University) · Cited by 2
Resampling-based confidence regions and multiple tests for a correlated random vector
Arlot, S., Blanchard, G., & Roquain, É. (2007) · Cited by 2
Own Motivation, Peer Motivation, and Educational SuccessPreprint
Bietenbeck, J. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3733270 · Cited by 2
Graphical Procedures for Multiple Comparisons Under General DependencePreprint
Bennett, C. J., & Thompson, B. S. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.2093600 · Cited by 2
Does Recognition versus Disclosure Affect Debt Contracting? Evidence from SFAS 158Preprint
Donovan, J. B., McMartin, A. S., & PHILLIPS, M. A. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3434732 · Cited by 2
New metrics for multiple testing with correlated outcomesPreprint
Mathur, M. B., & VanderWeele, T. J. (2018) · doi:10.31219/osf.io/k9g3b · Cited by 2
Analyzing the Agenda of the U.K. Parliament Over the Long RunPreprint
Hanlon, W. W. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4104007 · Cited by 2
Improving Workplace Climate in Large Corporations: A Clustered Randomized InterventionPreprint
Alan, Ş., Çörekçioğlu, G., & Sutter, M. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3934743 · Cited by 2
Targeting Policies: Multiple Testing and Distributional Treatment EffectsPreprint
Lehrer, S., Pohl, V., & Song, K. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.2895032 · Cited by 2
Higher Order Risk Preferences: New Experimental Measures, Determinants and Field BehaviorPreprint
Schneider, S. O., & Sutter, M. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3689466 · Cited by 2
State Capacity and Infrastructure CostsPreprint
Liscow, Z. D., Slattery, C. R., & Nober, W. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4522676 · Cited by 2
Can Grit be Taught? Learning from a field experiment with middle school students in FYR Macedonia
Boudet, A. M. M., Duckworth, A. L., Carneiro, P., Santos, I. V., Arias, O. S., Krekel, C., & Eskreis-Winkler, L. (2017) · AEA Randomized Controlled Trials · doi:10.1257/rct.2094-1.1 · Cited by 2
Kao, K., Fabbe, K., & Petersen, M. B. (2023) · Research Square · doi:10.21203/rs.3.rs-4170145/v1 · Cited by 2
Hedging by Giving: Spiritual Insurance and Religious DonationsPreprint
Liu, Y., Meng, J., Sheng, D., Yang, G., & Zhang, Y. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5347840 · Cited by 2
Backfitting tests in generalized structured models
Mammen, E., & Sperlich, S. (2020) · Biometrika · doi:10.1093/biomet/asaa108 · Cited by 1
Tax Compliance among Managers: Evidence from Randomized Audits 1
Lange, T., & Melsom, A. M. (2024) · Nordic Tax Journal · doi:10.2478/ntaxj-2024-0002 · Cited by 1
Right Time to Focus? Time of Day and Cognitive Performance
Staneva, A. V., Zhang, Q., & Zhu, R. (2025) · The B E Journal of Economic Analysis & Policy · doi:10.1515/bejeap-2024-0427 · Cited by 1
Son Preference and Its Impact on Family Size and Domestic Violence Against Mothers in South Asia
Kamei, A. (2025) · The Journal of Development Studies · doi:10.1080/00220388.2025.2493803 · Cited by 1
A unified test for regression discontinuity designs
Fusejima, K., Ishihara, T., & Sawada, M. (2025) · Journal of Econometrics · doi:10.1016/j.jeconom.2025.106074 · Cited by 1
Attitudes and behaviors in a fragile state. A list experiment in Mali
Bertelli, O., Calvo, T., Lavallée, E., Mercier, M., & Mesplé‐Somps, S. (2025) · World Development · doi:10.1016/j.worlddev.2025.107151 · Cited by 1
Interest-Based Negotiation over Natural Resources: Experimental Evidence from Liberia
Christensen, D., Hartman, A., Samii, C., & Toppeta, A. (2025) · Journal of the European Economic Association · doi:10.1093/jeea/jvaf047 · Cited by 1
Anukriti, S., Herrera‐Almanza, C., & Karra, M. (2025) · Journal of Development Economics · doi:10.1016/j.jdeveco.2025.103706 · Cited by 1
The empirical copula process in high dimensions: Stute’s representation and applications
Bücher, A., & Pakzad, C. (2025) · The Annals of Statistics · doi:10.1214/25-aos2548 · Cited by 1
Number one girl: Female top scorers and peer academic performance in junior high schools
Qin, X., Wang, Y., & Zhang, H. (2026) · Journal of Development Economics · doi:10.1016/j.jdeveco.2026.103801 · Cited by 2
Anger, S., Christoph, B., Galkiewicz, A., Margaryan, S., Sandner, M., & Siedler, T. (2026) · European Economic Review · doi:10.1016/j.euroecorev.2026.105362 · Cited by 1
School Breaks and Crime: Quasi-Experimental Evidence from Sweden
Jakobsson, N., Gerell, M., Kristensson, P., & Støre, S. J. (2026) · Journal of Quantitative Criminology · doi:10.1007/s10940-026-09681-7 · Cited by 1
Pinto, R. R. (2010) · Brazilian Review of Econometrics · doi:10.12660/bre.v30n22010.3671 · Cited by 1
Testing the Weak Form Market Efficiency: Empirical Evidence from the Italian Stock Exchange
Albano, G., Rocca, M. L., & Perna, C. (2012) · Smart innovation, systems and technologies · doi:10.1007/978-3-642-35467-0_24 · Cited by 1
Miecznikowski, J. C., & Gaile, D. P. (2014) · Statistical Applications in Genetics and Molecular Biology · doi:10.1515/sagmb-2013-0032 · Cited by 1
Selection in parametric models via some stepdown procedures
Furmańczyk, K. (2014) · Applicationes Mathematicae · doi:10.4064/am41-1-7 · Cited by 1
Multiplicity adjustment in clinical trials with multiple correlated testing
Zaslavsky, B. G., & Chen, F. (2016) · Model Assisted Statistics and Applications · doi:10.3233/mas-160375 · Cited by 1
Familywise error rate control with a lasso estimator
Tardivel, P. (2017) · HAL · Cited by 1
Simultaneous Inference for High-Dimensional Approximate Factor Model
Wang, Y., & Guo, X. (2020) · Entropy · doi:10.3390/e22111258 · Cited by 1
Berk, R. A. (2022) · Observational Studies · doi:10.1353/obs.2022.0000 · Cited by 1
Tropical forest environments provide insurance against COVID-19
Takasaki, Y., Coomes, O. T., & Abizaid, C. (2023) · Ecology and Society · doi:10.5751/es-14349-280308 · Cited by 1
A Note on Simultaneous Confidence Intervals for Direct, Indirect and Synthetic Estimators
Valvason, C. Q., & Sperlich, S. (2024) · Stats · doi:10.3390/stats7010020 · Cited by 1
Changing Dietary Habits Early in Life: A Field Experiment with Low-Income Families
Belot, M. V. K., Berlin, N., James, J., & Skafida, V. (2024) · Journal of Political Economy Microeconomics · doi:10.1086/732126 · Cited by 3
Conditional independence testing for discrete distributions: Beyond χ2- and G-tests
Kim, I., Neykov, M., Balakrishnan, S., & Wasserman, L. (2024) · Electronic Journal of Statistics · doi:10.1214/24-ejs2315 · Cited by 1
Heisig, K., & Zierow, L. (2025) · Labour Economics · doi:10.1016/j.labeco.2025.102740 · Cited by 1
Scalable geometric learning with correlation-based functional brain networks
You, K., Lee, Y., & Park, H. (2025) · Scientific Reports · doi:10.1038/s41598-025-07703-1 · Cited by 1
Expertise Overlap and Team Productivity: Evidence from the Hospital Industry
Branco, D. K. S., Carrillo, B., Fang, D., & Iglesias, W. J. (2025) · Journal of Political Economy Microeconomics · doi:10.1086/738881 · Cited by 1
The decision-makers we become: Early education and the decision-making of boys and girls
Carvalho, L., Cardim, J., Carneiro, P., & de Walque, D. (2025) · Journal of Development Economics · doi:10.1016/j.jdeveco.2025.103660 · Cited by 1
Closure properties of classes of multiple testing procedures
Hahn, G. (2017) · AStA Advances in Statistical Analysis · doi:10.1007/s10182-017-0297-0 · Cited by 1
Voting behavior and the terrestrial digital divide
Belloc, M. (2018) · Economics Letters · doi:10.1016/j.econlet.2018.02.027 · Cited by 2
Lee, D. (2019) · Economics Letters · doi:10.1016/j.econlet.2019.05.029 · Cited by 1
Cigarette prices and driving fatalities among youths
Shrestha, V. (2019) · Economics Letters · doi:10.1016/j.econlet.2019.108589 · Cited by 1
Closure properties of classes of multiple testing procedures
Hahn, G. (2018) · Lancaster EPrints (Lancaster University) · Cited by 1
Recent Developments in Inference: Practicalities for Applied Economics
Michler, J. D., & Josephson, A. (2021) · UA Campus Repository (The University of Arizona) · doi:10.48550/arxiv.2107.09736 · Cited by 1
Analyzing social experiments as implemented: evidence from the HighScope Perry Preschool Program
Yavitz, A., Moon, S. H., Heckman, J. J., Pinto, R. R., & Savelyev, P. A. (2010) · doi:10.1920/wp.cem.2010.2210 · Cited by 1
Resampling-Based Confidence Regions and Multiple Tests for a Correlated Random Vector
Arlot, S., Blanchard, G., & Roquain, É. (2007) · Springer eBooks · doi:10.1007/978-3-540-72927-3_11 · Cited by 1
p-Value Adjustments for Asymptotic Control of the Generalized Familywise Error RatePreprint
Bennett, C. J. (2009) · RePEc: Research Papers in Economics · Cited by 1
Optimality of the Westfall-Young permutation procedure for multiple testing under dependencePreprint
Meinshausen, N., & Maathuis, M. H. (2011) · arXiv (Cornell University) · Cited by 1
The Causal Impact of Alternative Parental Child Rearing Practices on Adolescent Outcomes
Lehrer, S., & Tremblay, R. E. (2007) · Cited by 1
Can Early Intervention Policies Improve Well-Being? Evidence from a Randomized Controlled Trial
Daly, M., Delaney, L. D., Doyle, O., Fitzpatrick, N., & O’Farrelly, C. (2014) · Arrow@dit (Dublin Institute of Technology) · Cited by 1
The Two Sample Problem for Multiple Categorical Variables
DiRienzo, A. G. (2006) · The International Journal of Biostatistics · doi:10.2202/1557-4679.1019 · Cited by 1
Attanasio, O. P., Meghir, K., Rubio‐Codina, M., Welch, K., & Quddus, S. (2016) · AEA Randomized Controlled Trials · doi:10.1257/rct.1071 · Cited by 1
Evaluation of an adolescent girl intervention in Rajasthan, India - Pre-analysis plan
Andrew, A., & Krutikova, S. (2018) · doi:10.1920/re.ifs.2017.0139 · Cited by 1
IPAD: Stable Interpretable Forecasting with Knockoffs InferencePreprint
Fan, Y., Lv, J., Sharifvaghefi, M., & Uematsu, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.05032 · Cited by 1
Multiple Testing and the Distributional Effects of Accountability Incentives in EducationPreprint
Lehrer, S., Pohl, R. V., & Song, K. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3266793 · Cited by 1
On agnostic post hoc approaches to false positive controlPreprint
Blanchard, G., Neuvial, P., & Roquain, É. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.11575 · Cited by 1
Asymptotic control of FWER under Gaussian assumption: application to correlation testsPreprint
Achard, S., Borgnat, P., & Gannaz, I. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.00909 · Cited by 1
Higher Order Risk Preferences: New Experimental Measures, Determinants and Field BehaviorPreprint
Schneider, S. O., & Sutter, M. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3683782 · Cited by 2
Financial Literacy and Academic OutcomesPreprint
Brent, D. A., & Wrenn, D. H. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4078004 · Cited by 1
Fifty Shades of Active and Index AlphaPreprint
Leippold, M., & Rüegg, R. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3190166 · Cited by 1
Simple Tests for Selection: Learning More from Instrumental VariablesPreprint
Black, D. A., Joo, J., LaLonde, R., Smith, J. A., & Taylor, E. J. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4171467 · Cited by 1
Avitabile, C., Angel‐Urdinola, D. F., & Chinen, M. (2023) · World Bank, Washington, DC eBooks · doi:10.1596/1813-9450-10483 · Cited by 2
Committing to Grow: Privatizations and Firm Dynamics in East Germany
Akcigit, U., Alp, H., Diegmann, A., & Serrano-Velarde, N. A. B. (2023) · National Bureau of Economic Research · doi:10.3386/w31645 · Cited by 1
How Credible is the Credibility Revolution?
Lang, K. (2023) · National Bureau of Economic Research · doi:10.3386/w31666 · Cited by 1
Dealing with Imperfect Randomization: Inference for the HighScope Perry Preschool Program
Heckman, J. J., Pinto, R. R., & Shaikh, A. M. (2023) · National Bureau of Economic Research · doi:10.3386/w31982 · Cited by 1
Early Childhood Intervention for the Poor: Long Term Outcomes
Jervis, P., Cardona‐Sosa, L., Giannola, M., Grantham‐McGregor, S., Meghir, C., Rubio‐Codina, M., Day, M., & Attanasio, O. P. (2024) · National Bureau of Economic Research · doi:10.3386/w32165 · Cited by 1
Income Composition and Peer Effects in EducationPreprint
Fongoni, M., Norris, J., Romiti, A., & Shi, Z. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5339512 · Cited by 1
Relational Frictions Along the Supply Chain: Evidence from Senegalese TradersPreprint
Wiles, E., & Houeix, D. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5397962 · Cited by 1
Statistical Methods for Multivariate and Complex Phenotypes
Agniel, D. M. (2014) · Digital Access to Scholarship at Harvard (DASH) (Harvard University)
Inference on Optimal Treatment AssignmentsPreprint
Armstrong, T. B., & Shen, S. (2014) · SSRN Electronic Journal · doi:10.2139/ssrn.2428925
Reinvestigating How Welfare Reform Inuences Labor Supply: A Multiple Testing Approach
Lehrer, S., Pohl, V., & Song, K. (2014)
Multiple Testing of Hypotheses in Biomedical Research
Bannerman-Thompson, H., Rao, M. B., & Chakraborty, R. (2012) · Handbook of statistics · doi:10.1016/b978-0-44-451875-0.00008-7
Simultaneous likelihood-based bootstrap confidence sets for a large number of modelsPreprint
Zhilova, M. (2015) · arXiv (Cornell University) · doi:10.18452/4583
Design for the Mother and Infant Home Visiting Program: Evaluation Strong Start
Michalopoulos, C., Lee, H., Snell, E. K., Crowne, S. S., Filene, J. H., Fox, M. K., Kranker, K., Mijanovich, T., Gill, L., & DUGGAN, A. K. (2015) · Mathematica Policy Research Reports
Weak Form Efficiency of Selected European Stock Markets: Alternative Testing Approaches
Albano, G., Rocca, M. L., & Perna, C. (2014) · Springer eBooks · doi:10.1007/978-3-319-02499-8_1
New methods for econometric inference
Chetverikov, D. N. (2013) · DSpace@MIT (Massachusetts Institute of Technology)
Exploring corporate governance and financial accounting in small Irish firms
Heneghan, J. (2015) · University of Limerick Institutional Repository (University of Limerick) · doi:10.34961/7
Human Capital and Economic Opportunity: A Global Working Group
Lochner, L., & Monge‐Naranjo, A. (2011) · Cited by 1
Arithmetics with multiple testing proceduresPreprint
Hahn, G. (2016) · arXiv (Cornell University)
Variable selection using stepdown procedures in high-dimensional linear models
Furmańczyk, K. (2016) · Applicationes Mathematicae · doi:10.4064/am2286-6-2016
The Weak Efficient Market Hypothesis in Light of Statistical LearningPreprint
Fiévet, L., & Sornette, D. (2016) · arXiv (Cornell University)
Optimal testing of multiple hypotheses with common effect direction
Bittman, R. M., Romano, J. P., Vallarino, C. R., & Wolf, M. (2008) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-52263
Self-citationBayesian Downscaling Methods for Aggregated Count Data
Michaud, C. P., & Sproul, T. W. (2017) · Agricultural and Resource Economics Review · doi:10.1017/age.2017.26
Multiple testing with close to equally correlated structure
Zaslavsky, B. G. (2017) · Journal of Statistical Theory and Practice · doi:10.1080/15598608.2017.1408508
Discrete Classification Problems in Agricultural and Behavioral Economics
Michaud, C. P. (2018) · Digital Commons - URI (University of Rhode Island) · doi:10.23860/diss-michaud-clayton-2018
Tests of Hypotheses Arising in the Correlated Random Coefficient Model
Heckman, J. J., & Schmierer, D. (2010) · National Bureau of Economic Research · doi:10.3386/w16421
Lin, K., Liu, H., & Roeder, K. (2020) · Figshare · doi:10.6084/m9.figshare.11944581
Can Better Peers Signal Less Success? The Disruptive Effect of Perceived Rank on Career InvestmentPreprint
Ribas, R. P., Sampaio, B. R., & Trevisan, G. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3135824
Aggregated kernel based tests for signal detection in a regression modelPreprint
Bui, T. T. T. (2019) · arXiv (Cornell University) · doi:10.13140/rg.2.2.22895.28325
Statistical methods for evidence synthesisPreprint
Mathur, M. B., & VanderWeele, T. J. (2018) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/kd6ja
Multistage tests of multiple hypothesesPreprint
Bartroff, J. L., & Lai, T. L. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1107.1919
Metadata
- Authors
- Romano, J. P., & Wolf, M.
- Affiliations
- Stanford University (US)
- Venue
- Journal of the American Statistical Association
- Publisher
- Informa UK Limited
- Published
- 2005-03
- Volume
- 100
- Issue
- 469
- Pages
- 94-108
- ISSN
- 0162-1459 (ISSN-L)
- 1537-274X
- OpenAlex
- W3124231044
- Cited by
- 609
- References
- 23
- Citations by year
- 2026: 44 · 2025: 63 · 2024: 51 · 2023: 52 · 2022: 60 · 2021: 47 · 2020: 38 · 2019: 33 · 2018: 38 · 2017: 29 · 2016: 25 · 2015: 15 · 2014: 22 · 2013: 11 · 2012: 14
- FWCI
- 10.03
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Locations
- Journal of the American Statistical Association (publishedVersion)
- SSRN Electronic Journal (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Repositori digital de la UPF (Universitat Pompeu Fabra) (submittedVersion, cc-by-nc-nd)
- RECERCAT (Consorci de Serveis Universitaris de Catalunya) (submittedVersion, other-oa)
- Funders
- National Science Foundation
- Ministerio de Ciencia y Tecnología
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- Physical Sciences › Mathematics › Statistics and Probability › Probability and Statistical Research
- Keywords
- multiple comparisons, family-wise error rate, resampling, Bonferroni correction, intersection tests, asymptotic theory
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
