The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Exact and Approximate Stepdown Methods for Multiple Hypothesis Testing
Open accessAbstract
Consider the problem of testing k hypotheses simultaneously. In this article we discuss finite- and large-sample theory of stepdown methods that provide control of the familywise error rate (FWE). To improve on the Bonferroni method or on Holm's stepdown method, Westfall and Young made effective use of resampling to construct stepdown methods that implicitly estimate the dependence structure of the test statistics. However, their methods depend on an assumption known as “subset pivotality.” Our goal here is to construct general stepdown methods that do not require such an assumption. To accomplish this, we take a close look at what makes stepdown procedures work; a key component is a monotonicity requirement of critical values. By imposing monotonicity on estimated critical values (which is not an assumption on the model but rather is an assumption on the method), we show how to construct stepdown tests that can be applied in a stagewise fashion so that at most k tests need to be computed. Moreover, at each stage, an intersection test that controls the usual probability of a type 1 error is calculated, which allows us to draw on an enormous resampling literature as a general means of test construction. In addition, it is possible to carry out this method using the same set of resamples (or subsamples) for each of the intersection tests.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Similar to traditional multiple-hypothesis testing procedures, such as the Bonferroni or Holm procedures (see, e.g., Lehmann and Romano (2005), for a discussion of these procedures), the stepdown algorithm of Romano and Wolf (2005) exhibits strong FWER control, in contrast with the classical tests like the F or χ2.”
From Analyzing social experiments as implemented: A reexamination of the evidence from the HighScope Perry Preschool Program (2010) · cites this paper as Romano and Wolf (2005)
The cited source says what the claim attributes to it.
In the citing paper
“The validity of this procedure follows from the analysis of Romano and Wolf (2005), who provide general results on the use of stepdown multiple-hypothesis testing procedures.”
From Analyzing social experiments as implemented: A reexamination of the evidence from the HighScope Perry Preschool Program (2010) · cites this paper as Romano and Wolf (2005)
The cited source says what the claim attributes to it.
In the citing paper
“Romano and Wolf (2005) show that their monotonicity assumption is weaker than the subset pivotality assumption.”
From Analyzing social experiments as implemented: A reexamination of the evidence from the HighScope Perry Preschool Program (2010) · cites this paper as Romano and Wolf (2005)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526
The control of the false discovery rate in multiple testing under dependency
Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490
Multiple Comparison Procedures
Hochberg, Y., & Tamhane, A. C. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316672 · Cited by 2,389
The Bootstrap and Edgeworth Expansion
Hall, P. (1992) · Springer series in statistics · doi:10.1007/978-1-4612-4384-7 · Cited by 2,102
On closed testing procedures with special reference to ordered analysis of variance
Marcus, R., Peritz, E., & Gabriel, K. R. (1976) · Biometrika · doi:10.1093/biomet/63.3.655 · Cited by 1,417
Multiple Hypothesis Testing in Microarray Experiments
Dudoit, S., Shaffer, J. P., & Boldrick, J. C. (2003) · Statistical Science · doi:10.1214/ss/1056397487 · Cited by 1,054
Politis, D. N., Romano, J. P., & Wolf, M. (1999) · Springer Series in Statistics · doi:10.1007/978-1-4612-1554-7 · Cited by 760
Self-citationJeankyung, K., & Pollard, D. (1990) · The Annals of Statistics · doi:10.1214/aos/1176347498 · Cited by 640
Two Guidelines for Bootstrap Hypothesis Testing
Hall, P., & Wilson, S. R. (1991) · Biometrics · doi:10.2307/2532163 · Cited by 471
Research works printed but not linked: 9
- Ser. B, 57, 289
- Association, 94, 569
- The Annals, Statistics, 26, 505
- Scandinavian Journal, Statistics, 6, 65
- Statistics, 18, 191
- Tests, American Statistical Association, 78, 949
- Journal, 43, 617
- Tests, American Statistical Association, 83, 698
- Distributions, The American Statistician, 51, 3
Cited by
Sorted by citations
Items 501–600 of 613
Fogarty, C. B., & Small, D. S. (2015) · Figshare · doi:10.6084/m9.figshare.1627953
Fromont, M., Laurent, B., & Reynaud-Bouret, P. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1203.3572
Extended MinP Tests for Global and Multiple testingPreprint
Lu, Z. (2019) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.1911.04696
Modelling Complex Structures by Artificial Neural Networks
Rocca, M. L., & Perna, C. (2006)
A Resource-Rich Neighbor Is a Misfortune: The Spatial Distribution of the Resource Curse in Brazil
Ishak, P. W., & Méon, P. (2022) · Economic Development and Cultural Change · doi:10.1086/718554
Murder NaturePreprint
Ishak, P. W. (2021) · RePEc: Research Papers in Economics · doi:10.17169/refubium-29012
Measuring Investment in Human Capital Formation: An Experimental Analysis of Early Life Outcomes
Logue, C., Doyle, O., Harmon, C., Heckman, J. J., & Moon, S. H. (2012) · Nottingham Trent University's Institutional Repository (Nottingham Trent Repository)
Tests of Hypotheses Arising in the Correlated Random Coefficient ModelPreprint
Heckman, J. J., & Schmierer, D. (2010) · SSRN Electronic Journal · doi:10.2139/ssrn.1686496
Police Repression and Protest Behavior: Evidence from Student Protests in ChilePreprint
González, F., & Prem, M. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3705486
The Effects of Incentivizing Early Prenatal Care on Infant HealthPreprint
Cygan‐Rehm, K., & Karbownik, K. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4060522
SUPERCONSISTENCY OF TESTS IN HIGH DIMENSIONS
Kock, A., & Preinerstorfer, D. (2022) · Econometric Theory · doi:10.1017/s0266466622000482
MinP Score Tests with an Inequality Constrained Parameter SpacePreprint
Cavaliere, G., Lu, Z., Rahbek, A., & Yang, Y. (2021) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.2107.06089
Frequentist inference for cluster randomised trials with multiple primary outcomesPreprint
Watson, S., Akinyemi, J. O., & Hemming, K. (2021) · arXiv (Cornell University)
MMD Aggregated Two-Sample TestPreprint
Schrab, A., Kim, I., Albert, M., Laurent, B., Guedj, B., & Gretton, A. (2021) · arXiv (Cornell University)
The Value of Communication for Mental Health
Annan, F., & Archibong, B. (2026) · The Economic Journal · doi:10.1093/ej/ueag083
(2021) · Elsevier eBooks · doi:10.1016/b978-0-12-820098-8.00019-1
Does Economics Make You Sexist
Paserman, M. D., & Pino, F. (2020) · AEA Randomized Controlled Trials · doi:10.1257/rct.5715-1.1
Tang, L., & Li, J. (2022) · Journal of nonparametric statistics · doi:10.1080/10485252.2021.2025371
(2010) · Chapman & Hall/CRC eBooks · doi:10.1201/9781420010909-c5
Does Economics Make You Sexist
Paserman, M. D., & Pino, F. (2020) · AEA Randomized Controlled Trials · doi:10.1257/rct.5715-1.0
Impact Evaluation of Development Interventions:
Bank, A. D. (2018) · doi:10.22617/tim179188-2
Simple Tests for Selection: Learning More from Instrumental Variables
Black, D. A., Joo, J., LaLonde, R., Smith, J. W., & Taylor, E. J. (2022) · National Bureau of Economic Research · doi:10.3386/w30291
Denteh, A., Asare, S., & Senadza, B. (2022) · doi:10.31235/osf.io/jh9q6
Denteh, A., Asare, S., & Senadza, B. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4198682
Early Education, Preferences, and Decision-Making Abilities
Cardim, J., Carneiro, P., Carvalho, L., & de Walque, D. (2022) · World Bank, Washington, DC eBooks · doi:10.1596/1813-9450-10187
Improved Convergence Rates of Normal Extremes
Zhu, Y., & Han, X. (2022) · Springer eBooks · doi:10.1007/978-3-031-22687-8_21
Udo, S. O., Sunday, P. O., Tsaku, P. A., Oladejo, I. O., Meka, A., Ugwu, L. C., Ajisola, M. M., Akinyemi, J. O., Omigbodun, A. O., Choudhury, S., et al. (2023) · medRxiv · doi:10.1101/2023.07.14.23292603
Committing to Grow: Privatizations and Firm Dynamics in East GermanyPreprint
Akcigit, U., Alp, H., Diegmann, A., & Serrano-Velarde, N. A. B. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4610158
Political Entry Barriers and the Quality of DemocracyPreprint
Çakır, S. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4615995
On the Term “Randomization Test”
Hemerik, J. (2024) · The American Statistician · doi:10.1080/00031305.2024.2319182 · Cited by 1
Expanding access to identification cards and social programs: Experimental evidence from Panamá
Reyes, Á. M., Roseth, B., & Cossio, D. V. (2024) · Journal of Policy Analysis and Management · doi:10.1002/pam.22596
Arellano-Bover, J., Bussotti, C., Nunley, J. M., & Seals, A. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4852476
The Decision-Makers We Become: Early Education and the Decision-Making of Boys and GirlsPreprint
Carvalho, L., Dias, J. A. E. C. D. A. C., Carneiro, P., & de Walque, D. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4852478
Economic Empowerment and Mental Health: Evidence from IndiaPreprint
Keskar, A., & Mookerjee, S. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4893173
Immigrants and Native Flight: Geographic Extent and Heterogeneous Preferences 1Preprint
Bøje-Kovács, B., Mulalic, I., Sáiz, A., Sant’Anna, V. P., & Schultz-Nielsen, M. L. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4992813
A Permutation Test for Multiple Correlation Coefficient in High Dimensional Normal Data
Najarzadeh, D. (2023) · Journal of Statistical Sciences · doi:10.61186/jss.17.1.11
Ferreira, J. A. (2024) · Journal of Statistical Theory and Practice · doi:10.1007/s42519-024-00412-4
Testing for the Minimum Mean-Variance Spanning SetPreprint
Liao, Z., Wang, B., & Zhou, W. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5101662
Multiple testing with known effect directionsPreprint
Gong, W. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5250575
Arellano-Bover, J., Bussotti, C., Nunley, J. M., & Seals, A. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5257548
Moral Licensing: Prosocial Behavior in Public and Private SpheresPreprint
Hong, F., Jean Tirole, Z., & Zhang, C. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5257359 · Cited by 1
de Simone, F., Mejía, C. U., Martinez-Carrasco, J., Perez-Vincent, S. M., & Villalba, H. (2025) · Review of Economics of the Household · doi:10.1007/s11150-025-09776-3
May the Phone Be with You: Impact of Smartphone Ownership on Women's EmpowermentPreprint
Banerjee, A., Barnhardt, S., Mondal, D., & Mukherjee, S. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5269940
Three essays on development economics
Arciniegas, C. (2025) · doi:10.51363/unifr.eth.2025.027
Enhanced HSIC for independence test via projection integration
Li, Z., Ding, T., Zhou, T., & Yao-wu, Z. (2025) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2025.105485
Mentoring, educational preferences, and career choice: Evidence from two field experiments in Bhutan
Hayashi, R., Kim, H. B., Matsuda, N., & Pham, T. (2025) · Journal of Policy Analysis and Management · doi:10.1002/pam.70034
The Burden of Comparison: Relative Socioeconomic Position and Adolescent Socioemotional DevelopmentPreprint
Gambardella, G., Lenda, I. B., Mangiavacchi, L., & Piccoli, L. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5392717
Mine, Theirs or Ours? A Multi-Country Experiment on Citizens' Motivations to Invest in Mental HealthPreprint
Conzo, P., Giusta, M. D., Dubois, F., Rosso, G., & Razzu, G. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5392711
Delivery Overcrowding in January
Wi, S., & Lee, J. H. (2025) · Global Economic Review · doi:10.1080/1226508x.2025.2532456
The Medium Matters: Medical Decision-Making in Telemedicine versus In-person CarePreprint
Wellsjo, A., Gertler, P., Kwan, A. T., Remera, E., Irakiza, P. M., Condo, J. U., & Humuza, J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5426702
The Medium Matters: Medical Decision-Making in Telemedicine Versus In-Person CarePreprint
Wellsjo, A., Gertler, P., Kwan, A. T., Remera, E., Irakiza, P. M., Condo, J. U., & Humuza, J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5433654
Large Scale Partial Correlation Screening With Uncertainty Quantification
Neo, E., Radchenko, P., & Rajaratnam, B. (2025) · IEEE Transactions on Information Theory · doi:10.1109/tit.2025.3606207
Arellano-Bover, J., Bussotti, C., Nunley, J. M., & Seals, A. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5614470
The causal component in the intergenerational transmission of incomePreprint
de Haan, M., & Stubhaug, M. E. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5682041
The causal component in the intergenerational transmission of incomePreprint
de Haan, M., & Stubhaug, M. E. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5687989
A Stepwise Cauchy Combination Test for Multiple Testing Problems with Financial Applications
Bouamara, N., Laurent, S., & Shi, S. (2025) · Journal of Financial Econometrics · doi:10.1093/jjfinec/nbaf020
Si, Y., Zhang, Z., & Nadarajah, S. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5817224
Multiplier and empirical subsample bootstraps for maxima in high dimensional time series analysis
Ma, R., & Zhang, S. (2025) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2025.105579
A multiple testing procedure for input variable selection in neural networks
Rocca, M. L., & Perna, C. (2008) · The European Symposium on Artificial Neural Networks
Essays on intra-household resource control, subjective expectations and human capital investment
Armand, A. (2014) · UCL Discovery (University College London)
Simultane Inferenz in hochdimensionalen Regressionsmodellen
Bach, P., Chernozhukov, V., & Spindler, M. (2024) · Springer eBooks · doi:10.1007/978-3-662-63496-7_17-1
Hypothesis Testing for Subset Identification: A Linear Measurement Scheme
Cho, M., Xu, W., Lu, Z., & Lai, L. (2025) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2025.3622365
The impact of student aid eligibility on higher education applicationsPreprint
Schäper, C., & Remigereau, C. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5767922
Laaksonen, J., Kortelainen, M., & Salokangas, H. R. W. (2026) · The European Journal of Health Economics · doi:10.1007/s10198-025-01887-z
Order-Constrained Spectral Causality in Multivariate Time SeriesPreprint
Dominguez, A. R. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6035875
Arellano-Bover, J., Bussotti, C., Nunley, J. M., & Seals, R. A. (2026) · Labour Economics · doi:10.1016/j.labeco.2025.102846
Francesco, R. D. (2026) · Econometric Reviews · doi:10.1080/07474938.2025.2610309
Do voters hold the president’s party accountable for local economic conditions?
Song, B. K. (2026) · Electoral Studies · doi:10.1016/j.electstud.2026.103058
Spillover Effects of an Environmental Campaign on Policy Support: Within and between DomainsPreprint
Nie, Z., Ho, T., Alpízar, F., Carlsson, F., & Pham, K. N. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5342822
High-Dimensional Detection of Spatial Interference Effects
Zhang, W., Yang, Y., & Yao, F. (2026) · Journal of Business and Economic Statistics · doi:10.1080/07350015.2025.2581341
Hassene, B. M., & Sliti, H. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6412729
Parental mental health and the economic preferences of the next generation
Bertermann, A., & Schildberg-Hörisch, H. (2026) · Journal of Development Economics · doi:10.1016/j.jdeveco.2026.103785
The Power of Narratives in Transforming Ex-Combatants into Agents of Peace: Evidence from SomaliaPreprint
Tsuda, S., Goto, J., Hara, T., & Nagai, Y. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6446588
No payoff from time off? Mandated paid vacation and late-career employment
Bensnes, S. S., Hernæs, Ø., & King, M.-E. M. (2026) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2026.107526
The effects of induced emotions on punishment and reward
Drouvelis, M., & Brit Grosskopf, A. (2026) · Games and Economic Behavior · doi:10.1016/j.geb.2026.03.012
Information and data manipulation in political economy and household contexts
Barrera, Ó. (2020) · theses.fr (ABES) · doi:10.70675/9b70f46ez077dz458dz93c6z4724f6ae2864
Contributions to reliable machine learning via false discovery rate control
Marandon, A. (2023) · theses.fr (ABES) · doi:10.70675/5db12a75z0b64z45f3z9da1z975490fedc01
Post-selection inference for transcriptomic data analysis
Enjalbert-Courrech, N. (2024) · theses.fr (ABES) · doi:10.70675/c7a2bbf3z742az40fcza856z0f8d400c4ec7
Small target detection using deep learning
Ciocarlan, A. (2024) · theses.fr (ABES) · doi:10.70675/da286690za2ecz402dz9ac6zc73405ce751a
Scanning for Significance: False Discovery Control for Impulse ResponsesPreprint
Nikolaishvili, G. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6602958
Pashley, N. E., Libgober, B., & Dasgupta, T. (2026) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1093/jrsssa/qnag062
Stephan, G., Hetschko, C., Schmidtke, J., Eid, M., & Lawes, M. (2026) · Industrial and Labor Relations Review · doi:10.1177/00197939261444258
Kao, K., Fabbe, K., & Petersen, M. B. (2026) · Political Psychology · doi:10.1111/pops.70142
Making organization’s cost salient: A natural field experiment
Hong, F., Riyanto, Y. E., Yan, J., & Huo, Y. (2026) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2026.107634
Phylospect: a spectral operator framework for detecting episodic selection in codon evolution
Manjunath, M., S, R. V., Damini, C. S., & Shakunthala, V. (2026) · Molecular Phylogenetics and Evolution · doi:10.1016/j.ympev.2026.108653
When Insurers Predict Banks: Systemic Tail-Risk Predictability in an Emerging MarketPreprint
Mananga, P. N., Lin, S., & Zhang, H. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6910111
School feeding, maternal empowerment, and household consumption
Fang, G., Luo, T., & Qian, B. (2026) · American Journal of Agricultural Economics · doi:10.1002/ajae.70085
Spillover effects of an environmental campaign on policy support: Within and between domains
Nie, Z., Ho, T. Q., Alpízar, F., Carlsson, F., & Nam, P. K. (2026) · Resource and Energy Economics · doi:10.1016/j.reseneeco.2026.101584
Testing Narrative Models in the Field: Domestic Violence, Donations, and Cross-Cultural PersuasionPreprint
Adena, M., Hager, A., Hakimov, R., Mechtenberg, L., & Wang, S. W. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6996380
Maschinelles Lernen zur kausalen Inferenz mit Fokus auf DoubleML
Bach, P., Chernozhukov, V., Klaaßen, S., Kurz, M. S., & Spindler, M. (2026) · Springer eBooks · doi:10.1007/978-3-662-63496-7_15-1
Voting to Avoid Social Sanctions: Experimental Evidence from TanzaniaPreprint
Rosenzweig, L. R. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7173694
Extending MinP tests for global and multiple testing
Lu, Z. (2026) · Econometric Reviews · doi:10.1080/07474938.2026.2700307
Metadata
- Authors
- Romano, J. P., & Wolf, M.
- Affiliations
- Stanford University (US)
- Venue
- Journal of the American Statistical Association
- Publisher
- Informa UK Limited
- Published
- 2005-03
- Volume
- 100
- Issue
- 469
- Pages
- 94-108
- ISSN
- 0162-1459 (ISSN-L)
- 1537-274X
- OpenAlex
- W3124231044
- Cited by
- 609
- References
- 23
- Citations by year
- 2026: 44 · 2025: 63 · 2024: 51 · 2023: 52 · 2022: 60 · 2021: 47 · 2020: 38 · 2019: 33 · 2018: 38 · 2017: 29 · 2016: 25 · 2015: 15 · 2014: 22 · 2013: 11 · 2012: 14
- FWCI
- 10.03
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Locations
- Journal of the American Statistical Association (publishedVersion)
- SSRN Electronic Journal (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Repositori digital de la UPF (Universitat Pompeu Fabra) (submittedVersion, cc-by-nc-nd)
- RECERCAT (Consorci de Serveis Universitaris de Catalunya) (submittedVersion, other-oa)
- Funders
- National Science Foundation
- Ministerio de Ciencia y Tecnología
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- Physical Sciences › Mathematics › Statistics and Probability › Probability and Statistical Research
- Keywords
- multiple comparisons, family-wise error rate, resampling, Bonferroni correction, intersection tests, asymptotic theory
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
