The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Exact and Approximate Stepdown Methods for Multiple Hypothesis Testing
Open accessAbstract
Consider the problem of testing k hypotheses simultaneously. In this article we discuss finite- and large-sample theory of stepdown methods that provide control of the familywise error rate (FWE). To improve on the Bonferroni method or on Holm's stepdown method, Westfall and Young made effective use of resampling to construct stepdown methods that implicitly estimate the dependence structure of the test statistics. However, their methods depend on an assumption known as “subset pivotality.” Our goal here is to construct general stepdown methods that do not require such an assumption. To accomplish this, we take a close look at what makes stepdown procedures work; a key component is a monotonicity requirement of critical values. By imposing monotonicity on estimated critical values (which is not an assumption on the model but rather is an assumption on the method), we show how to construct stepdown tests that can be applied in a stagewise fashion so that at most k tests need to be computed. Moreover, at each stage, an intersection test that controls the usual probability of a type 1 error is calculated, which allows us to draw on an enormous resampling literature as a general means of test construction. In addition, it is possible to carry out this method using the same set of resamples (or subsamples) for each of the intersection tests.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Similar to traditional multiple-hypothesis testing procedures, such as the Bonferroni or Holm procedures (see, e.g., Lehmann and Romano (2005), for a discussion of these procedures), the stepdown algorithm of Romano and Wolf (2005) exhibits strong FWER control, in contrast with the classical tests like the F or χ2.”
From Analyzing social experiments as implemented: A reexamination of the evidence from the HighScope Perry Preschool Program (2010) · cites this paper as Romano and Wolf (2005)
The cited source says what the claim attributes to it.
In the citing paper
“The validity of this procedure follows from the analysis of Romano and Wolf (2005), who provide general results on the use of stepdown multiple-hypothesis testing procedures.”
From Analyzing social experiments as implemented: A reexamination of the evidence from the HighScope Perry Preschool Program (2010) · cites this paper as Romano and Wolf (2005)
The cited source says what the claim attributes to it.
In the citing paper
“Romano and Wolf (2005) show that their monotonicity assumption is weaker than the subset pivotality assumption.”
From Analyzing social experiments as implemented: A reexamination of the evidence from the HighScope Perry Preschool Program (2010) · cites this paper as Romano and Wolf (2005)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526
The control of the false discovery rate in multiple testing under dependency
Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490
Multiple Comparison Procedures
Hochberg, Y., & Tamhane, A. C. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316672 · Cited by 2,389
The Bootstrap and Edgeworth Expansion
Hall, P. (1992) · Springer series in statistics · doi:10.1007/978-1-4612-4384-7 · Cited by 2,102
On closed testing procedures with special reference to ordered analysis of variance
Marcus, R., Peritz, E., & Gabriel, K. R. (1976) · Biometrika · doi:10.1093/biomet/63.3.655 · Cited by 1,417
Multiple Hypothesis Testing in Microarray Experiments
Dudoit, S., Shaffer, J. P., & Boldrick, J. C. (2003) · Statistical Science · doi:10.1214/ss/1056397487 · Cited by 1,054
Politis, D. N., Romano, J. P., & Wolf, M. (1999) · Springer Series in Statistics · doi:10.1007/978-1-4612-1554-7 · Cited by 760
Self-citationJeankyung, K., & Pollard, D. (1990) · The Annals of Statistics · doi:10.1214/aos/1176347498 · Cited by 640
Two Guidelines for Bootstrap Hypothesis Testing
Hall, P., & Wilson, S. R. (1991) · Biometrics · doi:10.2307/2532163 · Cited by 471
Flagged first, then by citations
Research works printed but not linked: 9
- Ser. B, 57, 289
- Association, 94, 569
- The Annals, Statistics, 26, 505
- Scandinavian Journal, Statistics, 6, 65
- Statistics, 18, 191
- Tests, American Statistical Association, 78, 949
- Journal, 43, 617
- Tests, American Statistical Association, 83, 698
- Distributions, The American Statistician, 51, 3
Cited by
Sorted by citations
Items 301–400 of 613
Do earnings stripping rules hamper investment? Evidence from CIT reforms in European countries
Leszczyłowska, A., & Meier, J.-H. (2021) · Economics Letters · doi:10.1016/j.econlet.2021.109743 · Cited by 5
Belloni, A., Chen, M., & Chernozhukov, V. (2025) · Journal of Econometrics · doi:10.1016/j.jeconom.2025.106100 · Cited by 5
Classes of Multiple Test Procedures
Dickhaus, T. (2014) · Springer eBooks · doi:10.1007/978-3-642-45182-9_3 · Cited by 5
Bootstrapping binary GEV regressions for imbalanced datasets
Rocca, M. L., Niglio, M., & Restaino, M. (2023) · Computational Statistics · doi:10.1007/s00180-023-01330-y · Cited by 5
Chen, Q., Pei, C., & Zhao, Q. (2020) · Economics Letters · doi:10.1016/j.econlet.2020.109134 · Cited by 5
On Agnostic Post-Hoc Approaches to False Positive Control
Blanchard, G., Neuvial, P., & Roquain, É. (2021) · Chapman & Hall/CRC eBooks · doi:10.1201/9780429030888-9 · Cited by 5
On some stepdown procedures with application to consistent variable selection in linear regression
Furmańczyk, K. (2013) · Statistics · doi:10.1080/02331888.2013.866116 · Cited by 5
Inequality and the time structure of earnings: evidence from Germany
Schröder, C., Golan, Y., & Yitzhaki, S. (2013) · The Journal of Economic Inequality · doi:10.1007/s10888-013-9260-9 · Cited by 5
Improved power of familywise error rate procedures for discrete data under dependency
He, L., & Heyse, J. F. (2019) · Biometrical Journal · doi:10.1002/bimj.201700332 · Cited by 5
Optimal Testing of Multiple Hypotheses with Common Effect DirectionPreprint
Bittman, R. M., Romano, J. P., Vallarino, C. R., & Wolf, M. (2006) · SSRN Electronic Journal · doi:10.2139/ssrn.938950 · Cited by 5
Self-citationTargeting Policies: Multiple Testing and Distributional Treatment Effects
Lehrer, S., Pohl, R. V., & Song, K. (2016) · National Bureau of Economic Research · doi:10.3386/w22950 · Cited by 5
Own Motivation, Peer Motivation, and Educational SuccessPreprint
Bietenbeck, J. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3730470 · Cited by 5
Behavioral barriers to success in education
de Gendre, A. (2021) · Research Publications (Maastricht University) · doi:10.26481/dis.20210329ag · Cited by 4
Romano, J. P., Shaikh, A. M., & Wolf, M. (2018) · Palgrave Macmillan UK eBooks · doi:10.1057/978-1-349-95189-5_2914 · Cited by 5
Self-citationEffects of the COVID-19 crisis on household food consumption and child nutrition in Mozambique
Squarcina, M., & Egger, E. (2022) · Working Paper Series · doi:10.35188/unu-wider/2022/302-4 · Cited by 5
Perceived Ability and School Choices: Experimental Evidence and Scale-Up EffectsPreprint
Bobba, M., Frisancho, V., & Pariguana, M. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4458679 · Cited by 5
The Value of Communication for Mental Health
Annan, F., & Archibong, B. (2023) · National Bureau of Economic Research · doi:10.3386/w31638 · Cited by 5
Leighton, M., Martine, A., & Massaga, J. J. (2023) · World Development · doi:10.1016/j.worlddev.2023.106335 · Cited by 4
The effects of parental retirement on adult children's health: Evidence from China
Hao, Z., Cheng, H., Bärnighausen, T., & Chen, S. (2023) · Health Economics · doi:10.1002/hec.4767 · Cited by 4
Regularizing stock return covariance matrices via multiple testing of correlations
Luger, R. (2024) · Journal of Econometrics · doi:10.1016/j.jeconom.2024.105753 · Cited by 4
Selecting informative conformal prediction sets with false coverage rate control
Gazin, U., Heller, R., Marandon, A., & Roquain, É. (2025) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1093/jrsssb/qkae120 · Cited by 4
Maternal education and early childhood outcomes in China
Ding, X., & Song, Y. (2025) · Economics of Education Review · doi:10.1016/j.econedurev.2025.102660 · Cited by 5
Conti, G., & Giustinelli, P. (2025) · Health Economics · doi:10.1002/hec.4942 · Cited by 4
Dependence aliasing and the control of family-wise error rate in multiple hypothesis testing
Machado, A. M. C. (2014) · Statistics and Computing · doi:10.1007/s11222-014-9459-z · Cited by 4
Escobar, D., Lafortune, J., & Tessada, J. (2024) · Journal of Labor Economics · doi:10.1086/733488 · Cited by 4
Validation of credit default probabilities using multiple-testing procedures
Döhler, S. (2010) · The Journal of Risk Model Validation · doi:10.21314/jrmv.2010.062 · Cited by 4
Do Women Council Members Allocate More Public Goods? Evidence from Rural India
Mori, Y., Rajasekhar, D., Manjula, R., Kurosaki, T., & Goto, J. (2023) · Economic Development and Cultural Change · doi:10.1086/727799 · Cited by 4
Coy, D., & Doyle, O. (2023) · Journal of Human Capital · doi:10.1086/728055 · Cited by 4
Spectral regularized kernel two-sample tests
Hagrass, O., Sriperumbudur, B. K., & Li, B. (2024) · The Annals of Statistics · doi:10.1214/24-aos2383 · Cited by 4
Rosenblum, M. (2014) · Journal of Statistical Planning and Inference · doi:10.1016/j.jspi.2014.07.001 · Cited by 4
Neural Network Modelling with Applications to Euro Exchange Rates
Rocca, M. L., & Perna, C. (2008) · Springer eBooks · doi:10.1007/978-3-540-77958-2_9 · Cited by 4
Continuous testing for Poisson process intensities: a new perspective on scanning statistics
Picard, F., Reynaud-Bouret, P., & Roquain, É. (2018) · Biometrika · doi:10.1093/biomet/asy044 · Cited by 4
Testing the correlated random coefficient model
Heckman, J. J., Schmierer, D., & Urzúa, S. (2017) · doi:10.1920/wp.cem.2010.1010 · Cited by 4
Post hoc inference via joint family-wise error rate controlPreprint
Blanchard, G., Neuvial, P., & Roquain, É. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.02307 · Cited by 6
Adaptive Inferential Method for Monotone Graph InvariantsPreprint
Lu, J., Neykov, M., & Liu, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.09114 · Cited by 6
de Oliveira, M. F. (2021) · doi:10.11606/t.12.2021.tde-08122022-213753 · Cited by 4
Central limit theorems and multiplier bootstrap when p is much larger than n
Chernozhukov, V., Chetverikov, D., & Kato, K. (2012) · doi:10.1920/wp.cem.2012.4512 · Cited by 4
Appraising Model Complexity in Option Pricing
Cummins, M., & Esposito, F. (2025) · Journal of Futures Markets · doi:10.1002/fut.22575 · Cited by 3
Karaman, H. (2025) · Management Science · doi:10.1287/mnsc.2023.01951 · Cited by 3
“Cake causes herpes?” - promiscuous dichotomisation induces false positives
Grimes, D. R., & Heathers, J. A. J. (2025) · BMC Medical Research Methodology · doi:10.1186/s12874-025-02712-0 · Cited by 3
New metrics for multiple testing with correlated outcomes
Mathur, M. B., & VanderWeele, T. J. (2023) · Frontiers in Applied Mathematics and Statistics · doi:10.3389/fams.2023.1151314 · Cited by 3
A resource-rich neighbor is a misfortune: The spatial distribution of the resource curse in Brazil
Ishak, P. W., & Méon, P. (2022) · Dépôt institutionnel de l'Université libre de Bruxelles (Université Libre de Bruxelles) · Cited by 3
Language training, refugees' healthcare integration, and the next generation's health
Dang, T. (2025) · Journal of Development Economics · doi:10.1016/j.jdeveco.2025.103470 · Cited by 3
FDP control in mass-univariate linear models using the residual bootstrap
Davenport, S., Thirion, B., & Neuvial, P. (2025) · Electronic Journal of Statistics · doi:10.1214/25-ejs2354 · Cited by 3
Estimation and Testing for Multiple Regulation of Multivariate Mixed Outcomes
Agniel, D. M., Liao, K. P., & Cai, T. (2016) · Biometrics · doi:10.1111/biom.12495 · Cited by 3
Resampling‐based stepwise multiple testing procedures with applications to clinical trial data
He, J., Li, F., Gao, Y., & Rothmann, M. D. (2020) · Pharmaceutical Statistics · doi:10.1002/pst.2076 · Cited by 3
Reluga, K., Lombardía, M. J., & Sperlich, S. (2022) · International Statistical Review · doi:10.1111/insr.12519 · Cited by 3
The COVID-19 pandemic and birth outcomes in 2020: The role of prenatal care and other channels
Balsa, A. I., & Triunfo, P. (2022) · Economics & Human Biology · doi:10.1016/j.ehb.2022.101167 · Cited by 3
Financial incentives and delivery care: Evidence from the Safe Delivery Incentive Program in Nepal
Tiwari, M. (2023) · Health Economics · doi:10.1002/hec.4732 · Cited by 3
What’s Behind Her Smile? Health, Looks, and Self-Esteem
Gallego, F., Philippi, C. L., & Repetto, A. (2024) · American Economic Journal Applied Economics · doi:10.1257/app.20210248 · Cited by 3
Land ownership and nutrition in Nepal
Tiwari, M. (2024) · Review of Development Economics · doi:10.1111/rode.13124 · Cited by 3
Barros, H. P. (2025) · Journal of Development Economics · doi:10.1016/j.jdeveco.2025.103457 · Cited by 3
LASSO-Driven Inference in Time and Space
Chernozhukov, V., Härdle, W. K., Huang, C., & Wang, W. (2018) · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · doi:10.48550/arxiv.1806.05081 · Cited by 3
Participation of charity beneficiaries
Grieco, D., & Bripi, F. (2022) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2022.05.002 · Cited by 4
Bagging Multiple Comparisons from Microarray Data
Politis, D. N. (2008) · Springer eBooks · doi:10.1007/978-3-540-79450-9_46 · Cited by 3
Interpretable High-Dimensional Inference Via Score Projection With an Application in Neuroimaging
Vandekar, S., Reiss, P. T., & Shinohara, R. T. (2018) · Journal of the American Statistical Association · doi:10.1080/01621459.2018.1448826 · Cited by 3
Multiple Testing and the Distributional Effects of Accountability Incentives in Education
Lehrer, S., Pohl, R. V., & Song, K. (2021) · Journal of Business and Economic Statistics · doi:10.1080/07350015.2021.1941055 · Cited by 3
Recent developments in inference: practicalities for applied economics
Michler, J. D., & Josephson, A. (2022) · Edward Elgar Publishing eBooks · doi:10.4337/9781800372054.00019 · Cited by 5
Koike, Y. (2019) · Electronic Journal of Statistics · doi:10.1214/19-ejs1553 · Cited by 3
Belloni, A., Chen, M., & Chernozhukov, V. (2018) · doi:10.1920/wp.cem.2017.5417 · Cited by 3
Police Repression And Protest Behavior: Evidence From Student Protests In ChilePreprint
Prem, M., & GonzÔøΩlez, F. (n.d.) · RePEc: Research Papers in Economics · Cited by 3
Spillover Effects of Financial Education: The Impact of School-Based Programs on Parents
Frisancho, V. (2023) · doi:10.18235/0004736 · Cited by 3
An improved closed procedure for testing multiple hypotheses
Lu, Z. (2020) · Statistics in Medicine · doi:10.1002/sim.8692 · Cited by 2
The effect of prenatal exposure to Ramadan on human capital: evidence from Turkey
Aydilek, G., & Karaoğlan, D. (2024) · Journal of Population Economics · doi:10.1007/s00148-024-01042-7 · Cited by 2
Institutional shareholder distraction and workplace safety
Chowdhury, H., Han, H. D., Krishnamurti, C., & Zheng, J.-Y. (2025) · The British Accounting Review · doi:10.1016/j.bar.2025.101671 · Cited by 3
Trust, risk, and institutions: experimental evidence from a community of firms in Kenya
Porter, M., Nuhu, A. S., Nakasone, E., & Maredia, M. K. (2025) · Journal of Economic Psychology · doi:10.1016/j.joep.2025.102834 · Cited by 2
Old age allowances and cognitive function: A quasi-experimental study of China's oldest-old
Fang, G., & Tang, T. (2025) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2025.107344 · Cited by 2
Herrera‐Almanza, C., & McCarthy, A. S. (2025) · Journal of Population Economics · doi:10.1007/s00148-025-01142-y · Cited by 2
Barschkett, M., Spiess, C. K., & Ziege, E. (2025) · Health Economics · doi:10.1002/hec.70054 · Cited by 2
Risk Preferences and Field Behavior: The Relevance of Higher-Order Risk Preferences
Schneider, S. O., & Sutter, M. (2025) · American Economic Review · doi:10.1257/aer.20211217 · Cited by 2
Krekel, C., Goebel, J., & Katrin Rehdanz, A. (2026) · Journal of Health Economics · doi:10.1016/j.jhealeco.2026.103123 · Cited by 2
Zarkadis, I.-C., & Douligeris, C. (2026) · International Conference on Computer, Information and Telecommunication Systems · doi:10.1109/cits70307.2026.11637173 · Cited by 2
Graphical Procedures for Multiple Comparisons Under General Dependence
Bennett, C. J., & Thompson, B. S. (2015) · Journal of the American Statistical Association · doi:10.1080/01621459.2015.1093941 · Cited by 2
Time scale and fractionality in financial time series
Sproul, T. W. (2016) · Agricultural Finance Review · doi:10.1108/afr-01-2016-0008 · Cited by 2
Short-Term Impact of an Early Childhood Education Intervention in Rural Thailand
Chujan, W., & Kilenthong, W. (2020) · Journal of Human Capital · doi:10.1086/712727 · Cited by 3
Online multiple testing with super-uniformity reward
Döhler, S., Meah, I., & Roquain, É. (2024) · Electronic Journal of Statistics · doi:10.1214/24-ejs2230 · Cited by 2
Waldman, K. E. (2022) · Socius Sociological Research for a Dynamic World · doi:10.1177/23780231221113635 · Cited by 4
Leone, T. (2022) · Economic Development and Cultural Change · doi:10.1086/723559 · Cited by 2
MERIT: Controlling Monte‐Carlo error rate in large‐scale Monte‐Carlo hypothesis testing
Li, Y., Hu, Y., & Satten, G. A. (2023) · Statistics in Medicine · doi:10.1002/sim.9959 · Cited by 2
Kastner, D. B., Yokota, N. O., Lee, C. Y., Holobetz, C., Chaudhry, A., Williams, G., Ton, J. N., Mehra, M., Kharazia, V., Parkinson, D. Y., et al. (2026) · Nature Communications · doi:10.1038/s41467-026-76681-3 · Cited by 2
Self-citationFischer, L., Roig, M. B., & Brannath, W. (2024) · The Annals of Statistics · doi:10.1214/24-aos2370 · Cited by 2
Genetics and Socioeconomic Status: Some Preliminary Evidence on Mechanisms
Carvalho, L. (2024) · Journal of Political Economy Microeconomics · doi:10.1086/732835 · Cited by 2
Digital Twin Validation with Multi-Epoch, Multi-Variate Output Data
He, L., Rhodes-Leader, L. A., & Song, E. (2024) · Winter Simulation Conference · doi:10.1109/wsc63780.2024.10838742 · Cited by 2
Money Matters: Evidence from a Conditional Cash Transfer Scheme on Child Health
Mathur, A., & Sen, G. (2025) · Journal of Human Capital · doi:10.1086/734859 · Cited by 2
You’ll never walk alone: unemployment, social networks and leisure activities
Filomena, M., & Picchio, M. (2025) · Oxford Economic Papers · doi:10.1093/oep/gpaf015 · Cited by 2
Brokering Votes With Information Spread Via Social Networks
Duarte, R., Finan, F., Larreguy, H., & Schechter, L. (2025) · The Review of Economic Studies · doi:10.1093/restud/rdaf075 · Cited by 2
Health Risk Analysis for Risk-Management Decision-Making
Cox, A. (. (2007) · Cambridge University Press eBooks · doi:10.1017/cbo9780511611308.018 · Cited by 2
Dell’Anna, R., Canteri, R., Coppedé, N., Iannotta, S., & Bersani, M. (2013) · Surface and Interface Analysis · doi:10.1002/sia.5251 · Cited by 2
Eriksson, K., & Sovero, V. (2016) · Economics Letters · doi:10.1016/j.econlet.2016.10.017 · Cited by 2
Lu, Z., & Zuo, A. (2017) · Cogent Economics & Finance · doi:10.1080/23322039.2017.1339769 · Cited by 3
A class of two-sample nonparametric statistics for binary and time-to-event outcomes
Roig, M. B., & Melis, G. G. (2021) · Statistical Methods in Medical Research · doi:10.1177/09622802211048030 · Cited by 2
Comparing long-term educational effects of two early childhood health interventions
Cortes, D. F., Maldonado, D., Gallego, J. M., Charpak, N., Tessier, R., Ruíz, J. G., Hernández, J. T., Uriza, L. F., & Pico, J. (2022) · Journal of Health Economics · doi:10.1016/j.jhealeco.2022.102693 · Cited by 2
Alt, E. M., Psioda, M. A., & Ibrahim, J. G. (2023) · Statistics in Medicine · doi:10.1002/sim.9696 · Cited by 2
Simultaneous tests and confidence bands for Stata estimation commands
Drukker, D. M. (2023) · The Stata Journal Promoting communications on statistics and Stata · doi:10.1177/1536867x231175333 · Cited by 2
Dealing with imperfect randomization: Inference for the highscope perry preschool program
Heckman, J. J., Pinto, R. R., & Shaikh, A. M. (2024) · Journal of Econometrics · doi:10.1016/j.jeconom.2024.105683 · Cited by 4
Nudging healthy food choices through e‐messages in a supermarket
Balsa, A. I., Noboa, C., & Triunfo, P. (2024) · Health Economics · doi:10.1002/hec.4831 · Cited by 2
A simple, graphical approach to comparing multiple treatments
Thompson, B. S., & Webb, M. D. (2019) · Econometrics Journal · doi:10.1093/ectj/utz006 · Cited by 2
A new user specific multiple testing method for business applications: The SiMaFlex procedure
Bartenschlager, C. C., & Brunner, J. O. (2021) · Journal of Statistical Planning and Inference · doi:10.1016/j.jspi.2021.01.004 · Cited by 2
Pin, P., & Rotesi, T. (2023) · Journal of Economic Psychology · doi:10.1016/j.joep.2023.102666 · Cited by 2
Armand, A. (2015) · RePEc: Research Papers in Economics · Cited by 2
Metadata
- Authors
- Romano, J. P., & Wolf, M.
- Affiliations
- Stanford University (US)
- Venue
- Journal of the American Statistical Association
- Publisher
- Informa UK Limited
- Published
- 2005-03
- Volume
- 100
- Issue
- 469
- Pages
- 94-108
- ISSN
- 0162-1459 (ISSN-L)
- 1537-274X
- OpenAlex
- W3124231044
- Cited by
- 609
- References
- 23
- Citations by year
- 2026: 44 · 2025: 63 · 2024: 51 · 2023: 52 · 2022: 60 · 2021: 47 · 2020: 38 · 2019: 33 · 2018: 38 · 2017: 29 · 2016: 25 · 2015: 15 · 2014: 22 · 2013: 11 · 2012: 14
- FWCI
- 10.03
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Locations
- Journal of the American Statistical Association (publishedVersion)
- SSRN Electronic Journal (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Repositori digital de la UPF (Universitat Pompeu Fabra) (submittedVersion, cc-by-nc-nd)
- RECERCAT (Consorci de Serveis Universitaris de Catalunya) (submittedVersion, other-oa)
- Funders
- National Science Foundation
- Ministerio de Ciencia y Tecnología
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- Physical Sciences › Mathematics › Statistics and Probability › Probability and Statistical Research
- Keywords
- multiple comparisons, family-wise error rate, resampling, Bonferroni correction, intersection tests, asymptotic theory
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
