The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
On the Estimation of Confidence Intervals for Binomial Population Proportions in Astronomy: The Simplicity and Superiority of the Bayesian Approach
Open accessAbstract
I present a critical review of techniques for estimating confidence intervals on binomial population proportions inferred from success counts in small to intermediate samples. Population proportions arise frequently as quantities of interest in astronomical research; for instance, in studies aiming to constrain the bar fraction, active galactic nucleus fraction, supermassive black hole fraction, merger fraction, or red sequence fraction from counts of galaxies exhibiting distinct morphological features or stellar populations. However, two of the most widely-used techniques for estimating binomial confidence intervals — the ‘normal approximation’ and the Clopper & Pearson approach — are liable to misrepresent the degree of statistical uncertainty present under sampling conditions routinely encountered in astronomical surveys, leading to an ineffective use of the experimental data (and, worse, an inefficient use of the resources expended in obtaining that data). Hence, I provide here an overview of the fundamentals of binomial statistics with two principal aims: (I) to reveal the ease with which (Bayesian) binomial confidence intervals with more satisfactory behaviour may be estimated from the quantiles of the beta distribution using modern mathematical software packages (e.g.r, matlab, mathematica, idl, python); and (ii) to demonstrate convincingly the major flaws of both the ‘normal approximation’ and the Clopper & Pearson approach for error estimation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
THE USE OF CONFIDENCE OR FIDUCIAL LIMITS ILLUSTRATED IN THE CASE OF THE BINOMIAL
CLOPPER, C. J., & PEARSON, E. S. (1934) · Biometrika · doi:10.1093/biomet/26.4.404 · Cited by 5,003
(1947) · The American Statistician · doi:10.1080/00031305.1947.10501534 · Cited by 3,660
Interval Estimation for a Binomial Proportion
Brown, L. D., Cai, T. T., & DasGupta, A. (2001) · Statistical Science · doi:10.1214/ss/1009213286 · Cited by 3,538
Approximate is Better than “Exact” for Interval Estimation of Binomial Proportions
Agresti, A., & Coull, B. A. (1998) · The American Statistician · doi:10.1080/00031305.1998.10480550 · Cited by 3,223
Confidence limits for small numbers of events in astrophysical data
Gehrels, N. (1986) · The Astrophysical Journal · doi:10.1086/164079 · Cited by 2,412
Mathematics and its applications
Yau, S. T. (2005) · The 2002 International Conference on Control and Automation, 2002. ICCA. Final Program and Book of Abstracts. · doi:10.1109/icca.2002.1229256 · Cited by 1,488
Galaxy bimodality versus stellar mass and environment
Baldry, I. K., Balogh, M. L., Bower, R. G., Glazebrook, K., Nichol, R. C., Bamford, S. P., & Budavari, T. (2006) · Monthly Notices of the Royal Astronomical Society · doi:10.1111/j.1365-2966.2006.11081.x · Cited by 888
GALAXY STELLAR MASS ASSEMBLY BETWEEN 0.2 <z< 2 FROM THE S-COSMOS SURVEY
Ilbert, O., Salvato, M., Le Floc'h, E., Aussel, H., Capak, P., McCracken, H. J., Mobasher, B., Kartaltepe, J., Scoville, N., Sanders, D. B., et al. (2010) · The Astrophysical Journal · doi:10.1088/0004-637x/709/2/644 · Cited by 687
Determination of confidence limits for experiments with low numbers of counts
Kraft, R. P., Burrows, D. N., & Nousek, J. A. (1991) · The Astrophysical Journal · doi:10.1086/170124 · Cited by 479
Confidence intervals for a binomial proportion
Vollset, S. E. (1993) · Statistics in Medicine · doi:10.1002/sim.4780120902 · Cited by 477
Burgasser, A. J., Kirkpatrick, J. D., Reid, I. N., Brown, M. E., Miskey, C. L., & Gizis, J. E. (2003) · The Astrophysical Journal · doi:10.1086/346263 · Cited by 420
Confidence Intervals for a binomial proportion and asymptotic expansions
Brown, L. D., Cai, T. T., & DasGupta, A. (2002) · The Annals of Statistics · doi:10.1214/aos/1015362189 · Cited by 318
Conselice, C. J., Rajgor, S., & Myers, R. (2008) · Monthly Notices of the Royal Astronomical Society · doi:10.1111/j.1365-2966.2008.13069.x · Cited by 233
ON THE FRACTION OF BARRED SPIRAL GALAXIES
Nair, P. B., & Abraham, R. G. (2010) · The Astrophysical Journal · doi:10.1088/2041-8205/714/2/l260 · Cited by 166
Confidence Limits for Continuous Distribution Functions
Wald, A., & Wolfowitz, J. (1939) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177732209 · Cited by 146
On the Problem of Confidence Intervals
Neyman, J. (1935) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177732585 · Cited by 122
Accurate confidence intervals for binomial proportion and Poisson rate estimation
Ross, T. D. (2003) · Computers in Biology and Medicine · doi:10.1016/s0010-4825(03)00019-2 · Cited by 109
The Millennium Galaxy Catalogue: Dynamically Close Pairs of Galaxies and the Global Merger Rate
Propris, R. D., Liske, J., Driver, S. P., Allen, P. D., & Cross, N. J. G. (2005) · The Astronomical Journal · doi:10.1086/433169 · Cited by 88
Teaching Large‐Sample Binomial Confidence Intervals
Santner, T. J. (1998) · Teaching Statistics · doi:10.1111/j.1467-9639.1998.tb00753.x · Cited by 48
Cousins, R. D., Hymes, K. E., & Tucker, J. (2009) · Nuclear Instruments and Methods in Physics Research Section A Accelerators Spectrometers Detectors and Associated Equipment · doi:10.1016/j.nima.2009.10.156 · Cited by 37
Spectro-photometric close pairs in GOODS-S: major and minor companions of intermediate-mass galaxies
López-Sanjuán, C., Balcells, M., Pérez‐González, P. G., Barro, G., Gallego, J., & Jaime Zamorano, G. (2010) · Astronomy and Astrophysics · doi:10.1051/0004-6361/201014236 · Cited by 32
Hester, J. A. (2010) · The Astrophysical Journal · doi:10.1088/0004-637x/720/1/191 · Cited by 7
Research works printed but not linked: 5
- 10.1086/169424 · doi:10.1086/169424
- 10.1111/j.1365-2966.2010.17314.x · doi:10.1111/j.1365-2966.2010.17314.x
- Quirin, 1978, Probability and Statistics
- López-Sanjuan, 2010, AandA, 518, 20
- 10.1086/341647 · doi:10.1086/341647
Cited by
Wetzel, A. R., Tinker, J. L., & Conroy, C. (2012) · Monthly Notices of the Royal Astronomical Society · doi:10.1111/j.1365-2966.2012.21188.x · Cited by 501
CANDELS: CONSTRAINING THE AGN-MERGER CONNECTION WITH HOST MORPHOLOGIES AT z∼ 2
Kocevski, D. D., Faber, S. M., Mozena, M., Koekemoer, A. M., Nandra, K., Rangel, C., Laird, E. S., Brusa, M., Wuyts, S., Trump, J. R., et al. (2012) · The Astrophysical Journal · doi:10.1088/0004-637x/744/2/148 · Cited by 402
The close environments of accreting massive black holes are shaped by radiative feedback
Ricci, C., Trakhtenbrot, B., Koss, M. J., Ueda, Y., Schawinski, K., Oh, K., Lamperti, I., Mushotzky, R., Treister, E., Ho, L. C., et al. (2017) · Nature · doi:10.1038/nature23906 · Cited by 326
Why does the environmental influence on group and cluster galaxies extend beyond the virial radius?
Bahé, Y. M., McCarthy, I. G., Balogh, M. L., & Font, A. S. (2013) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stt109 · Cited by 254
Grier, C. J., Trump, J. R., Shen, Y., Horne, K., Kinemuchi, K., McGreer, I. D., Starkey, D. A., Brandt, W. N., Hall, P. B., Kochanek, C. S., et al. (2017) · The Astrophysical Journal · doi:10.3847/1538-4357/aa98dc · Cited by 244
Metadata
- Authors
- Cameron, E.
- Venue
- Publications of the Astronomical Society of Australia
- Publisher
- Cambridge University Press (CUP)
- Published
- 2011
- Volume
- 28
- Issue
- 2
- Pages
- 128-139
- ISSN
- 1323-3580 (ISSN-L)
- 1448-6083
- OpenAlex
- W2131462587
- Cited by
- 455
- References
- 23
- FWCI
- 26.71
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.