Multiple—test Procedures and Smile Plots
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
multproc carries out multiple-test procedures, taking as input a list of p-values and an uncorrected critical p-value, and calculating a corrected overall critical p-value for rejection of null hypotheses. These procedures define a confidence region for a set-valued parameter, namely the set of null hypotheses that are true. They aim to control either the family-wise error rate (FWER) or the false discovery rate (FDR) at a level no greater than the uncorrected critical p-value. smileplot calls multproc and then creates a smile plot, with data points corresponding to estimated parameters, the p-values (on a reverse log scale) on the y-axis, and the parameter estimates (or another variable) on the x-axis. There are y-axis reference lines at the uncorrected and corrected overall critical p-values. The reference line for the corrected overall critical p-value, known as the parapet line, is an informal “upper confidence limit” for the set of null hypotheses that are true and defines a boundary between data mining and data dredging. A smile plot summarizes a set of multiple analyses just as a Cochrane forest plot summarizes a meta-analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
The control of the false discovery rate in multiple testing under dependency
Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490
An improved Bonferroni procedure for multiple tests of significance
SIMES, R. J. (1986) · Biometrika · doi:10.1093/biomet/73.3.751 · Cited by 2,396
Sterne, J. A. C. (2001) · BMJ · doi:10.1136/bmj.322.7280.226 · Cited by 1,466
Adjusted P-Values for Simultaneous Inference
Wright, S. P. (1992) · Biometrics · doi:10.2307/2532694 · Cited by 1,026
Parameters behind “Nonparametric” Statistics: Kendall's tau, Somers’ D and Median Differences
Newson, R. (2002) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0200200103 · Cited by 394
Self-citationBenjamini, Y., & Liu, W. (1999) · Journal of Statistical Planning and Inference · doi:10.1016/s0378-3758(99)00040-3 · Cited by 242
Cited by
Hibbeln, J. R., Davis, J. M., Steer, C., Emmett, P., Rogers, I., Williams, C., & Golding, J. (2007) · The Lancet · doi:10.1016/s0140-6736(07)60277-3 · Cited by 987
Harbord, R. M., & Higgins, J. P. T. (2008) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0800800403 · Cited by 897
“These data are taken from table 1 of Thompson and Sharp (1999). Data from 25 of these trials were also published in Thompson (1993).”
Association analyses based on false discovery rate implicate new loci for coronary artery disease
EPIC-CVD Consortium, Nelson, C. P., CARDIoGRAMplusC4D, The UK Biobank CardioMetabolic Consortium CHD working group, Goel, A., Butterworth, A. S., Kanoni, S., Webb, T. R., Marouli, E., Zeng, L., et al. (2017) · Nature Genetics · doi:10.1038/ng.3913 · Cited by 694
The Effect of the TseTse Fly on African Development
Alsan, M. (2015) · American Economic Review · doi:10.1257/aer.20130604 · Cited by 355
The Romano–Wolf multiple-hypothesis correction in Stata
Clarke, D., Romano, J. P., & Wolf, M. (2020) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x20976314 · Cited by 261
Metadata
- Authors
- Newson, R., & The ALSPAC Study Team
- Venue
- The Stata Journal: Promoting communications on statistics and Stata
- Publisher
- SAGE Publications
- Published
- 2003-06
- Volume
- 3
- Issue
- 2
- Pages
- 109-132
- ISSN
- 1536-867X (ISSN-L)
- 1536-8734
- OpenAlex
- W2126484671
- Cited by
- 115
- References
- 7
- FWCI
- 1.96
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Multiple—test Procedures and Smile Plots. https://app.cochat.ai/papers/10.1177/1536867x0300300202
- The paper
- Newson, R., & The ALSPAC Study Team. (2003). Multiple—test Procedures and Smile Plots. The Stata Journal: Promoting communications on statistics and Stata. https://doi.org/10.1177/1536867x0300300202
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.