The DOI matches its Crossref record.
Testing Statistical Hypotheses
Abstract
This chapter presents the basic concepts and results of the theory of testing statistical hypotheses. The generalized likelihood ratio tests that are discussed can be applied to testing in the presence of nuisance parameters. Besides the likelihood ratio tests, for testing in the presence of nuisance parameters one can use conditional tests. The chapter also presents the motivation for steps of the proof of the randomization principle theorem. It considers the case of a single observation, but the extension to the case of n observations will be obvious. The chapter presents an approach that requires unbiasedness and explains how the theory of testing statistical hypotheses is related to the theory of confidence intervals. It reviews the major testing procedures for parameters of normal distributions and is intended as a convenient reference for users rather than an exposition of new concepts or results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Statistical significance for genomewide studies
Storey, J. D., & Tibshirani, R. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1530509100 · Cited by 9,692
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436
(2012) · MPG.PuRe (Max Planck Society) · doi:10.5555/2188385.2188410 · Cited by 3,603
Practical Black-Box Attacks against Machine Learning
Papernot, N., McDaniel, P., Goodfellow, I., Jha, S., Celik, Z. B., & Swami, A. (2017) · Proceedings of the 2017 ACM on Asia Conference on Computer and Communications Security · doi:10.1145/3052973.3053009 · Cited by 3,495
Fleiss, J. L., & Cohen, J. (1973) · Educational and Psychological Measurement · doi:10.1177/001316447303300309 · Cited by 3,354
The positive false discovery rate: a Bayesian interpretation and the q-value
Storey, J. D. (2003) · The Annals of Statistics · doi:10.1214/aos/1074290335 · Cited by 2,204
Capturing Heterogeneity in Gene Expression Studies by Surrogate Variable Analysis
Leek, J. T., & Storey, J. D. (2007) · PLoS Genetics · doi:10.1371/journal.pgen.0030161 · Cited by 1,930
Quasi-likelihood functions, generalized linear models, and the Gauss—Newton method
WEDDERBURN, R. W. M. (1974) · Biometrika · doi:10.1093/biomet/61.3.439 · Cited by 2,122
Understanding and misunderstanding randomized controlled trials
Deaton, A., & Cartwright, N. (2018) · Social Science & Medicine · doi:10.1016/j.socscimed.2017.12.005 · Cited by 1,841
Bayesian statistical inference for psychological research.
Edwards, W., Lindman, H., & Savage, L. J. (1963) · Psychological Review · doi:10.1037/h0044139 · Cited by 1,734
FLUCTUATING ASYMMETRY: Measurement, Analysis, Patterns
Palmer, A. R., & Strobeck, C. (1986) · Annual Review of Ecology and Systematics · doi:10.1146/annurev.es.17.110186.002135 · Cited by 1,701
P-curve: A key to the file-drawer.
Simonsohn, U., Nelson, L. D., & Simmons, J. P. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0033242 · Cited by 1,500
A Test for Superior Predictive Ability
Hansen, P. R. (2005) · Journal of Business & Economic Statistics · doi:10.1198/073500105000000063 · Cited by 1,230
Early Childhood Investments Substantially Boost Adult Health
Campbell, F., Conti, G., Heckman, J. J., Moon, S. H., Pinto, R., Pungello, E., & Pan, Y. (2014) · Science · doi:10.1126/science.1248429 · Cited by 1,106
Pros and cons of GAN evaluation measures
Borji, A. (2019) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2018.10.009 · Cited by 963
A Confidence Interval for the Median Survival Time
Brookmeyer, R., & Crowley, J. (1982) · Biometrics · doi:10.2307/2530286 · Cited by 914
Principles of Statistical Inference
Cox, D. R. (2006) · doi:10.1017/cbo9780511813559 · Cited by 670
A tutorial on conformal prediction
Shafer, G., & Vovk, V. (2007) · arXiv · doi:10.48550/arxiv.0706.3188 · Cited by 655
The fallacy of placing confidence in confidence intervals
Morey, R. D., Hoekstra, R., Rouder, J. N., Lee, M. D., & Wagenmakers, E.-J. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-015-0947-8 · Cited by 577
Fluctuating asymmetry analyses: a primer
Palmer, A. R. (1994) · Contemporary Issues in Genetics and Evolution · doi:10.1007/978-94-011-0830-0_26 · Cited by 542
Does Professor Quality Matter? Evidence from Random Assignment of Students to Professors
Carrell, S. E., & West, J. E. (2010) · Journal of Political Economy · doi:10.1086/653808 · Cited by 508
GPLAG: detection of software plagiarism by program dependence graph analysis
Liu, C., Chen, C., Han, J., & Yu, P. S. (2006) · Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1150402.1150522 · Cited by 422
Prevalence of neural collapse during the terminal phase of deep learning training
Papyan, V., Han, X. Y., & Donoho, D. L. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2015509117 · Cited by 403
Randomization, Statistics, and Causal Inference
Greenland, S. (1990) · Epidemiology · doi:10.1097/00001648-199011000-00003 · Cited by 385
Confidence Distribution, the Frequentist Distribution Estimator of a Parameter: A Review
Xie, M., & Singh, K. (2013) · International Statistical Review · doi:10.1111/insr.12000 · Cited by 319
Teaching about Approximate Confidence Regions Based on Maximum Likelihood Estimation
Meeker, W. Q., & Escobar, L. A. (1995) · The American Statistician · doi:10.1080/00031305.1995.10476112 · Cited by 279
Hooker, G., Mentch, L., & Zhou, S. (2021) · Statistics and Computing · doi:10.1007/s11222-021-10057-z · Cited by 264
Ojaveer, H., Galil, B. S., Campbell, M. L., Carlton, J. T., Canning-Clode, J., Cook, E. J., Davidson, A. D., Hewitt, C. L., Jelmert, A., Marchini, A., et al. (2015) · PLOS Biology · doi:10.1371/journal.pbio.1002130 · Cited by 232
Transcriptional modulation of the developing immune system by early life social adversity
Cole, S. W., Conti, G., Arevalo, J. M. G., Ruggiero, A. M., Heckman, J. J., & Suomi, S. J. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1218253109 · Cited by 207
The Effects of Two Influential Early Childhood Interventions on Health and Healthy Behaviour
Conti, G., Heckman, J. J., & Pinto, R. (2016) · The Economic Journal · doi:10.1111/ecoj.12420 · Cited by 213
Data scientists in software teams: State of the art and challenges
Kim, M., Zimmermann, T., DeLine, R., & Begel, A. (2018) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2017.2754374 · Cited by 199
Customization of Pain Treatments: Single-Case Design and Analysis
Onghena, P., & Edgington, E. S. (2005) · The Clinical Journal of Pain · doi:10.1097/00002508-200501000-00007 · Cited by 188
A statistical framework for protein quantitation in bottom-up MS-based proteomics
Karpievitch, Y., Stanley, J., Taverner, T., Huang, J., Adkins, J. N., Ansong, C., Heffron, F., Metz, T. O., Qian, W.-J., Yoon, H., et al. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp362 · Cited by 176
Allefeld, C., Görgen, K., & Haynes, J.-D. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.07.040 · Cited by 157
The dynamics of choice among multiple alternatives
McMillen, T., & Holmes, P. (2006) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2005.10.003 · Cited by 153
Hwang, J., & Sun, Y. (2018) · Journal of Econometrics · doi:10.1016/j.jeconom.2018.07.006 · Cited by 136
Randomization Tests Under an Approximate Symmetry Assumption
Canay, I. A., Romano, J. P., & Shaikh, A. M. (2017) · Econometrica · doi:10.3982/ecta13081 · Cited by 125
A Test for Superior Predictive Ability
Hansen, P. R. (2004) · doi:10.2139/ssrn.264569 · Cited by 99
Initial skill assessment of the California harmful algae risk mapping (C-HARM) System.
Anderson, C. R., Kudela, R. M., Kahru, M., Chao, Y., Rosenfeld, L. K., Bahr, F. L., Anderson, D. M., & Norris, T. A. (2016) · Harmful Algae · doi:10.1016/j.hal.2016.08.006 · Cited by 92
Valid Post-clustering Differential Analysis for Single-Cell RNA-Seq
Zhang, J. M., Kamath, G. M., & Tse, D. N. (2019) · Cell Systems · doi:10.1016/j.cels.2019.07.012 · Cited by 72
Testing for deterministic trend and seasonal components in time series models
FRANZINI, L., & HARVEY, A. C. (1983) · Biometrika · doi:10.1093/biomet/70.3.673 · Cited by 66
Choice of test for association in small sample unordered r × c tables
Lydersen, S., Pradhan, V., Senchaudhuri, P., & Laake, P. (2007) · Statistics in Medicine · doi:10.1002/sim.2839 · Cited by 48
(2010) · Cited by 48
Power Law Distributions in Information Retrieval
Petersen, C., Simonsen, J. G., & Lioma, C. (2016) · ACM Transactions on Information Systems · doi:10.1145/2816815 · Cited by 46
Covariate-adjusted Fisher randomization tests for the average treatment effect
Zhao, A., & Ding, P. (2021) · Journal of Econometrics · doi:10.1016/j.jeconom.2021.04.007 · Cited by 40
Towards Probabilistic Verification of Machine Unlearning
Sommer, D. M., Song, L., Wagh, S., & Mittal, P. (2020) · arXiv · doi:10.48550/arxiv.2003.04247 · Cited by 38
Efficient Tests Under a Weak Convergence Assumption
(2011) · Econometrica · doi:10.3982/ecta7793 · Cited by 30
Optimal photonic indistinguishability tests in multimode networks
Viggianiello, N., Flamini, F., Bentivegna, M., Spagnolo, N., Crespi, A., Brod, D. J., Galvão, E. F., Osellame, R., & Sciarrino, F. (2018) · Science Bulletin · doi:10.1016/j.scib.2018.10.009 · Cited by 18
Theobald, D. L. (2011) · Biology Direct · doi:10.1186/1745-6150-6-60 · Cited by 16
Hudes, M. L., McCann, J. C., & Ames, B. N. (2009) · The FASEB Journal · doi:10.1096/fj.08-108910 · Cited by 12
Metadata
- Venue
- Wiley Series in Probability and Statistics
- Publisher
- Wiley
- Published
- 2021-01-07
- Pages
- 373-428
- ISSN
- 1940-6347 (ISSN-L)
- OpenAlex
- W2045638068
- Cited by
- 5,106
- References
- 0
- Type
- other
- Language
- en
- Open access
- closed
- Licence
- doi.wiley.com/10.1002/tdm_license_1.1 (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
