400: A Method for Combining Non-Independent, One-Sided Tests of Significance
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Littell and Folks [.1971, 1973] show that Fisher's method of combining independenlt tests of significance is asymptotically optimal among essentially all methods of combining independent tests. By assuming a joint multivariate normal density for the variables, we approximate the distribultion of Fisher's statistic in order to combiine one-sided tests of location when all the variables are not jointly inidependent. The probability associated with this test is simpler to evaluate than that of the equivalent likelihood ratio test.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The gene-wide analysis was performed based on the summary P-values while controlling for linkage disequilibrium and different numbers of SNPs per gene using a statistical approach by Brown (1975), and adopted for set-based analysis of genetic data by Moskvina et al. (2011) and de Leeuw et al. (2015).”
From Genetic variability in response to amyloid beta deposition influences Alzheimer’s disease risk (2019) · cites this paper as Brown (1975)
Citations
Cites
Approximate Calculation of Integrals
Haber, S., & Krylov, V. I. (1964) · Mathematics of Computation · doi:10.2307/2003796 · Cited by 828
Asymptotic Optimality of Fisher's Method of Combining Independent Tests
Littell, R. C., & Folks, J. L. (1971) · Journal of the American Statistical Association · doi:10.1080/01621459.1971.10482347 · Cited by 257
On the Problem of Testing Location in Multivariate Populations for Restricted Alternatives
Nuesch, P. E. (1966) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177699602 · Cited by 78
Detection of Adulteration of Fruit Juice. I. Characterization of Israel Lemon Juice
Lifshitz, A., & Stepak, Y. (1971) · Journal of AOAC INTERNATIONAL · doi:10.1093/jaoac/54.6.1262 · Cited by 5
Cited by
Items 401–489 of 489
Complementary and Alternative Techniques to Controlled Experiments
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.013
Experimentation Platform and Culture
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.006
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.025
Institutional Memory and Meta-Analysis
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.011
Measuring Long-Term Treatment Effects
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.029
Running and Analyzing Experiments: An End-to-End Example
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.004
Cinar, O. (2021) · Research Publications (Maastricht University) · doi:10.26481/dis.20210519oc
Variance Estimation and Improved Sensitivity: Pitfalls and Solutions
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.024
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.019
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.017
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.007
Advanced Topics for Building an Experimentation Platform
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.016
Triggering for Improved Sensitivity
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.026
Did the Reform Work? Evidence from VIX Settlement AnomaliesPreprint
Baumgartner, T., & Guettler, A. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3874249
Leakage and Interference between Variants
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.028
Ramping Experiment Exposure: Trading Off Speed, Quality, and Risk
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.020
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.030
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.001
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.018
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.021
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.009
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.014
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.003
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.031
(2013) · Elsevier eBooks · doi:10.1016/b978-0-12-397194-4.00016-8
Califano, A., Bild, A., Sims, P. A., & Stolovitzky, G. A. (2022) · Elsevier eBooks · doi:10.1016/b978-0-12-821618-7.00260-1
Latto, R. (2023) · doi:10.5194/egusphere-2023-1340-ac1
Latto, R. (2023) · doi:10.5194/egusphere-2023-1340-ac2
Prediction of Non-coding Driver Mutations Using Ensemble Learning
Basharat, S., Hüseynov, R., Kılınç, H. H., & Otlu, B. (2023) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm58861.2023.10386056
“They combined the resulting p-values of 13 driver discovery algorithms from existing literature using a previously published statistical method [7] and filtered the results to identify positively selected driver mutations.”
MethodFrequent host-switch and gene exchange shape the evolution of Staphylococcus aureus ST398Preprint
Malhotra‐Kumar, S., Lin, Q., Timbermont, L., Vlaeminck, J., Nguyen, M. N., van der Schalk, T. E., Tabor, D. E., Raafat, D., Lammens, C., Holtfreter, S., et al. (2024) · Research Square · doi:10.21203/rs.3.rs-4103684/v1
MVs and FVs for Planck 2015 and 2018 temperature maps obtained by polyMV
de Oliveira, R. A., Pereira, T. S., & Quartin, M. (2020) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.3857932
Mason, K., Sathe, A., Hess, P. R., Rong, J., Wu, C.-Y., Furth, E. E., Suszták, K., Levinsohn, J. L., Ji, H. P., & Zhang, N. R. (2024) · Figshare · doi:10.6084/m9.figshare.24993682
Wang, Z., Gu, H., Qin, P., & Wang, J. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e33582
Predição de escolhas de baixa capacidade cognitiva baseada na variabilidade da frequência cardíaca
Júnior, M. M. (2024) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.45.2024.tde-19082024-140041
Wang, Z., Luo, J., Jiang, L., Tang, C., Chen, Y., Yang, K., Wang, Z., Dong, J., Chen, X., Yin, Z., et al. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.109665
Cyber Risk, ChatGPT and Firm ValuePreprint
Kearney, F., Ma, T., Movaghari, H., & Sermpinis, G. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5068625
The Nonparametric Combination Methodology
Salmaso, L., & Pesarin, F. (2020) · Wiley series in probability and statistics · doi:10.1002/9781119438199.ch4
Salmaso, L., & Pesarin, F. (2020) · Wiley series in probability and statistics · doi:10.1002/9781119438199.ref
Evaluating the Cauchy combination test for count data
Alsulami, H., & Liverani, S. (2025) · PLoS ONE · doi:10.1371/journal.pone.0334663
“The purpose of the p -value combination test is testing:”
A Global Test for Systematic SuperiorityPreprint
Zakamulin, V. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5667859
Methods of Combining P-values for Multiple Endpoints of Various Data Types
(2008) · Korean Journal of Applied Statistics · doi:10.5351/kjas.2008.21.1.035
“ܼ , © 'a$í s e H P°úכ_ #î ½+Ë~½Ó ZO Ér Brown (1975)õ Zaykin 1px (2002)\ Ô ¦õ . s [þt_ ~½ÓZO õ Ér, e © r +«>_ â ĺ \ ½+Ë{© ô Ç P°úכ_ #î ½+Ë~½ÓZO ̀¦ [O "î ½+É כ s .”
InfluentialLyte, J. M., Keane, J., Eckenberger, J., Anthony, N. B., Shrestha, S., Marasini, D. N., Daniels, K. M., Caputi, V., Donoghue, A. M., & Lyte, M. (2021) · Figshare · doi:10.6084/m9.figshare.14432462
Mason, K., Sathe, A., Hess, P. R., Rong, J., Wu, C.-Y., Furth, E. E., Suszták, K., Levinsohn, J., Ji, H. P., & Zhang, N. R. (2024) · Figshare · doi:10.6084/m9.figshare.26666965
Mason, K., Sathe, A., Hess, P. R., Rong, J., Wu, C.-Y., Furth, E. E., Suszták, K., Levinsohn, J., Ji, H. P., & Zhang, N. R. (2024) · Figshare · doi:10.6084/m9.figshare.26666950
Höger, A.-L. (2023) · EPub Bayreuth (University of Bayreuth) · doi:10.15495/epub_ubt_00007072
Lyte, J. M., Keane, J., Eckenberger, J., Anthony, N. B., Shrestha, S., Marasini, D. N., Daniels, K. M., Caputi, V., Donoghue, A. M., & Lyte, M. (2021) · Figshare · doi:10.6084/m9.figshare.14432480
Mason, K., Sathe, A., Hess, P. R., Rong, J., Wu, C.-Y., Furth, E. E., Suszták, K., Levinsohn, J., Ji, H. P., & Zhang, N. R. (2024) · Figshare · doi:10.6084/m9.figshare.26666959
Mason, K., Sathe, A., Hess, P. R., Rong, J., Wu, C.-Y., Furth, E. E., Suszták, K., Levinsohn, J. L., Ji, H. P., & Zhang, N. R. (2024) · Figshare · doi:10.6084/m9.figshare.26666956
Grassi, M., & Tarantino, B. (2022) · Figshare · doi:10.6084/m9.figshare.20508659
Tissier, R., van Schie, J. J. M., Wolthuis, R. M. F., de Lange, J., & Menezes, R. D. (2024) · Figshare · doi:10.6084/m9.figshare.26565938
Lyte, J. M., Keane, J., Eckenberger, J., Anthony, N. B., Shrestha, S., Marasini, D. N., Daniels, K. M., Caputi, V., Donoghue, A. M., & Lyte, M. (2021) · Figshare · doi:10.6084/m9.figshare.14432516
Lyte, J. M., Keane, J., Eckenberger, J., Anthony, N. B., Shrestha, S., Marasini, D. N., Daniels, K. M., Caputi, V., Donoghue, A. M., & Lyte, M. (2021) · Figshare · doi:10.6084/m9.figshare.14432522
Mason, K., Sathe, A., Hess, P. R., Rong, J., Wu, C.-Y., Furth, E. E., Suszták, K., Levinsohn, J., Ji, H. P., & Zhang, N. R. (2024) · Figshare · doi:10.6084/m9.figshare.26666953
Lyte, J. M., Keane, J., Eckenberger, J., Anthony, N. B., Shrestha, S., Marasini, D. N., Daniels, K. M., Caputi, V., Donoghue, A. M., & Lyte, M. (2021) · Figshare · doi:10.6084/m9.figshare.14432486
Mason, K., Sathe, A., Hess, P. R., Rong, J., Wu, C.-Y., Furth, E. E., Suszták, K., Levinsohn, J. L., Ji, H. P., & Zhang, N. R. (2024) · Figshare · doi:10.6084/m9.figshare.26666962
Mason, K., Sathe, A., Hess, P. R., Rong, J., Wu, C.-Y., Furth, E. E., Suszták, K., Levinsohn, J., Ji, H. P., & Zhang, N. R. (2024) · Figshare · doi:10.6084/m9.figshare.26666947
Lyte, J. M., Keane, J., Eckenberger, J., Anthony, N. B., Shrestha, S., Marasini, D. N., Daniels, K. M., Caputi, V., Donoghue, A. M., & Lyte, M. (2021) · Figshare · doi:10.6084/m9.figshare.14432483
Mason, K., Sathe, A., Hess, P. R., Rong, J., Wu, C.-Y., Furth, E. E., Suszták, K., Levinsohn, J. L., Ji, H. P., & Zhang, N. R. (2024) · Figshare · doi:10.6084/m9.figshare.26666968
Ramiro, L., Faura, J., Simats, A., García‐Rodríguez, P., Ma, F., Martín, L., Canals, F., Rosell, A., & Montaner, J. (2024) · Figshare · doi:10.6084/m9.figshare.26564607
Mason, K., Sathe, A., Hess, P. R., Rong, J., Wu, C.-Y., Furth, E. E., Suszták, K., Levinsohn, J., Ji, H. P., & Zhang, N. R. (2024) · Figshare · doi:10.6084/m9.figshare.24993806
Mason, K., Sathe, A., Hess, P. R., Rong, J., Wu, C.-Y., Furth, E. E., Suszták, K., Levinsohn, J. L., Ji, H. P., & Zhang, N. R. (2024) · Figshare · doi:10.6084/m9.figshare.26666971
Lyte, J. M., Keane, J., Eckenberger, J., Anthony, N. B., Shrestha, S., Marasini, D. N., Daniels, K. M., Caputi, V., Donoghue, A. M., & Lyte, M. (2021) · Figshare · doi:10.6084/m9.figshare.14432519
Bleys, D. (2018) · Lirias (KU Leuven)
Tools and strategies for RNA-sequencing data analysis
Mehmood, A. (2023) · UTUPub (University of Turku)
A Global Test for Systematic SuperiorityPreprint
Zakamulin, V. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5519958
Vilà-Quintana, L. (2025) · DUGiDocs (Universitat de Girona)
Zhao, C., Chang, X. M., Fan, L., Jiang, L., & Zhong, R. (2025) · Applied and Environmental Microbiology · doi:10.1128/aem.01208-25
“The P values derived from these distributions were combined using Brown’s method (47).”
Ramirez-Luzuriaga, M. J., Sinha, M., & Hanson, R. L. (2026) · American Journal of Clinical Nutrition · doi:10.1016/j.ajcnut.2026.101208
“…type I error, accounting for correlations among adolescent growth parameters, we also applied the Brown – Kost test, a method which combines nonindependent P values into a single aggregated test of the global null hypothesis of no association between breastfeeding and any of the 8 outcomes [35,36].”
The Generalized Harmonic Mean for p‐Values: Combining Dependent and Independent Tests
Zhengbang, L. I., & Zhou, X. (2026) · Statistics in Medicine · doi:10.1002/sim.70439
Statistical methods to account for different sources of bias in Genome-Wide association studies
Bouaziz, M. (2012) · theses.fr (ABES) · doi:10.70675/be99b4c3z9317z4e96z9c53z0b50d31baef6 · Cited by 1
Delafont, V. (2015) · theses.fr (ABES) · doi:10.70675/fa8bfc54z54b2z4354zaef9z8a1bfd8beb7c · Cited by 2
Gomes, E. D. C. (2024) · theses.fr (ABES) · doi:10.70675/016822ffzf521z4408zb481z2e410d5446bb · Cited by 1
Tsai, T., Aghayev, M., Ilchenko, S., Sabir, U., McMullen, M. R., Ghaju, S., Chen, X. L., Zhang, G., Chung, W. C. J., Nagy, L. E., et al. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.05.28.728507
Chang, H.-J., Çatal, Y., Wolman, A., Ibáñez, A. M., Smith, D., Su, I.-W., Cheng, K.-Y., & Northoff, G. (2026) · Computer Speech & Language · doi:10.1016/j.csl.2026.102013
“To combine p-values across subjects while accounting for possible covariances among subjects introduced by shared processing pipelines, we used the Empirical Brown’s Method (EBM) (Brown, 1975; Poole et al., 2016), which provides more reliable Type I errors.”
Kushima, I., Wei, R., Natsukari, I., Kato, H., Kimura, H., Nawa, Y., Torii, Y., Yamamoto, M., Hayashi, Y., Mori, D., et al. (2026) · Research Square · doi:10.21203/rs.3.rs-9869940/v1
Plasma proteomics analysis of vitamin C supplementation in people with type 2 diabetes
Grunsven, T. V., Wadley, G. D., & Mason, S. A. (2026) · Nutrition and Diabetes · doi:10.1038/s41387-026-00447-5
“As a result of sample preparation complications causing substantial sample loss, data from one participant were excluded from the current analysis, resulting in a fi nal sample of 26 participants for paired analyses.”
A Unified Statistical and Geometric Scoring Method for Zero Day Malware Open Set Recognition
Liu, S., Zhang, W., & Yang, T. (2026) · International Conference on Computing, Networks and Internet of Things (CNIOT) · doi:10.1109/cniot69547.2026.11582257
“Compared with Brown’s scaled χ 2 approximation [18] and the empirical Brown method of Poole et al. [19], our strategy avoids estimating a dependent null distribution.”
McCammon, S. D., See, J. R. C., Wright, J. R., Anderson, S. L. C., Russell, T. J., Lamendella, R., & Firneno, T. J. (2026) · Frontiers in Microbiology · doi:10.3389/fmicb.2026.1860796
“The corresponding p -values were combined using CoNet with the Brown method (Brown, 1975), and a Benjamini-Hochberg correction (Benjamini and Hochberg, 1995) was applied before the resulting corrected p -values were assessed for significance ( α = 0.05), with only significant correlations retained.”
InfluentialFochtman, D., Marczak, Ł., Pietrowska, M., Polańska, J., & Wojakowska, A. (2026) · Molecular & Cellular Proteomics · doi:10.1016/j.mcpro.2026.101631
“Thus, p -value integration is performed using Brown’s method (44).”
Cheung, N., Cheung, H. K., Yu, Y.-W., Wu, T.-T., & Tsang, Y. C. Y. (2026) · Cureus · doi:10.7759/cureus.113917
“Methods such as Brown's and Kost's approaches can incorporate dependence among component statistics [29,30].”
Marsh, A. G., & Doane, A. S. (2026) · Current Issues in Molecular Biology · doi:10.3390/cimb48090915
Distributive Effects of AI Support: A Framework for Analyzing Performance Shifts Within Groups
Campagner, A., Natali, C., Fregosi, C., & Cabitza, F. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37976-4_16
Rank-based integration identifies convergent disease mechanisms across omicsPreprint
Qiu, Z., Palmer, D., Jostins-Dean, L., Lewis, A. J., Bull, K. R., Nanchahal, J., & Luo, Y. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.09.25.754380
Xu, Z., Zhang, L., & Elliott, L. T. (2026) · doi:10.64898/2026.10.14.759234
Chen, B., Zhang, X., Yu, K., Bao, Z., Liang, X., Li, X., Liang, L., Wu, Q., Li, H., & Xu, L. (2026) · Deep Sea Research Part II Topical Studies in Oceanography · doi:10.1016/j.dsr2.2026.105718
Noise-Tolerant Multi-View Concept Drift Detection Based on Statistical Fusion
Dadzie, B. M., & Porwik, P. (2026) · Procedia Computer Science · doi:10.1016/j.procs.2026.09.121
Assessment of algorithmic performance in PET-CT segmentation of solitary lung tumors
Le, D. T., Szabó, D., Aranyi, C., Mikó, M., Képes, Z., Mihovk, I., Kovács, A. R., Nagy, I., Farkas, B., Hajdu, I., et al. (2026) · PLoS ONE · doi:10.1371/journal.pone.0360849
Metadata
- Authors
- Brown, M. B.
- Corresponding author
- Brown, Morton B.
- Venue
- Biometrics
- Publisher
- JSTOR
- Published
- 1975-12
- Volume
- 31
- Issue
- 4
- Pages
- 987
- ISSN
- 0006-341X (ISSN-L)
- OpenAlex
- W2330978860
- Cited by
- 473
- References
- 4
- Citations by year
- 2026: 17 · 2025: 29 · 2024: 27 · 2023: 36 · 2022: 37 · 2021: 46 · 2020: 81 · 2019: 25 · 2018: 23 · 2017: 28 · 2016: 25 · 2015: 18 · 2014: 21 · 2013: 24 · 2012: 8
- FWCI
- 0.00
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrics (publishedVersion)
- Funders
- National Institutes of Health
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Probability and Statistical Research
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Keywords
- Fisher's method, one-sided tests, multivariate normal distribution, asymptotic distribution, likelihood ratio test
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.