400: A Method for Combining Non-Independent, One-Sided Tests of Significance
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Littell and Folks [.1971, 1973] show that Fisher's method of combining independenlt tests of significance is asymptotically optimal among essentially all methods of combining independent tests. By assuming a joint multivariate normal density for the variables, we approximate the distribultion of Fisher's statistic in order to combiine one-sided tests of location when all the variables are not jointly inidependent. The probability associated with this test is simpler to evaluate than that of the equivalent likelihood ratio test.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The gene-wide analysis was performed based on the summary P-values while controlling for linkage disequilibrium and different numbers of SNPs per gene using a statistical approach by Brown (1975), and adopted for set-based analysis of genetic data by Moskvina et al. (2011) and de Leeuw et al. (2015).”
From Genetic variability in response to amyloid beta deposition influences Alzheimer’s disease risk (2019) · cites this paper as Brown (1975)
Citations
Cites
Approximate Calculation of Integrals
Haber, S., & Krylov, V. I. (1964) · Mathematics of Computation · doi:10.2307/2003796 · Cited by 828
Asymptotic Optimality of Fisher's Method of Combining Independent Tests
Littell, R. C., & Folks, J. L. (1971) · Journal of the American Statistical Association · doi:10.1080/01621459.1971.10482347 · Cited by 257
On the Problem of Testing Location in Multivariate Populations for Restricted Alternatives
Nuesch, P. E. (1966) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177699602 · Cited by 78
Detection of Adulteration of Fruit Juice. I. Characterization of Israel Lemon Juice
Lifshitz, A., & Stepak, Y. (1971) · Journal of AOAC INTERNATIONAL · doi:10.1093/jaoac/54.6.1262 · Cited by 5
Cited by
MAGMA: Generalized Gene-Set Analysis of GWAS Data
de Leeuw, C. A., Mooij, J. M., Heskes, T., & Posthuma, D. (2015) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004219 · Cited by 3,653
“For the mean χ 2 statistic, a gene p-value is then obtained by using a known approximation of the sampling distribution [20,21].”
Gene-Wide Analysis Detects Two New Susceptibility Genes for Alzheimer's Disease
Escott-Price, V., Bellenguez, C., Wang, L.-S., Choi, S.-H., Harold, D., Jones, L., Holmans, P., Gerrish, A., Vedernikov, A., Richards, A., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0094661 · Cited by 1,398
Gene expression elucidates functional impact of polygenic risk for schizophrenia
Fromer, M., Roussos, P., Sieberts, S. K., Johnson, J. S., Kavanagh, D. H., Perumal, T. M., Ruderfer, D. M., Oh, E. C., Topol, A., Shah, H. R., et al. (2016) · Nature Neuroscience · doi:10.1038/nn.4399 · Cited by 1,091
Determinants of community structure in the global plankton interactome
Lima-Mendez, G., Faust, K., Henry, N., Decelle, J., Colin, S., Carcillo, F., Chaffron, S., Ignacio-Espinosa, J. C., Roux, S., Vincent, F., et al. (2015) · Science · doi:10.1126/science.1262073 · Cited by 983
“Measure-specific P values were merged by using Brown’s method (79) and multiple-testing-corrected with BenjaminiHochberg (74).”
MethodLonsdorf, T. B., Menz, M. M., Andreatta, M., Fullana, M. A., Golkar, A., Haaker, J., Heitland, I., Hermann, A., Kuhn, M., Kruse, O., et al. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.02.026 · Cited by 837
“Fisher’s or Brown’s method (Brown, 1975), representational similarity analysis (Cichy et al.”
Psychiatric genome-wide association study analyses implicate neuronal, immune and histone pathways
The Network and Pathway Analysis Subgroup of the Psychiatric Genomics Consortium (2015) · Nature Neuroscience · doi:10.1038/nn.3922 · Cited by 755
Identification of Genetic Factors that Modify Clinical Onset of Huntington’s Disease
Lee, J.-M., Wheeler, V. C., Chao, M. J., Vonsattel, J. P. G., Pinto, R. M., Lucente, D., Abu-Elneel, K., Ramos, E. M., Mysore, J. S., Gillis, T., et al. (2015) · Cell · doi:10.1016/j.cell.2015.07.003 · Cited by 655
Genetic identification of brain cell types underlying schizophrenia
Major Depressive Disorder Working Group of the Psychiatric Genomics Consortium, Skene, N. G., Bryois, J., Bakken, T. E., Breen, G., Crowley, J. J., Gaspar, H. A., Giusti-Rodriguez, P., Hodge, R. D., Miller, J. A., et al. (2018) · Nature Genetics · doi:10.1038/s41588-018-0129-5 · Cited by 651
Analyses of non-coding somatic drivers in 2,658 cancer whole genomes
Rheinbay, E., Nielsen, M. M., Abascal, F., Wala, J. A., Shapira, O., Tiao, G., Hornshøj, H., Hess, J. M., Juul, R. I., Lin, Z., et al. (2020) · Nature · doi:10.1038/s41586-020-1965-x · Cited by 602
CoNet app: inference of biological association networks using Cytoscape
Faust, K., & Raes, J. (2016) · F1000Research · doi:10.12688/f1000research.9050.1 · Cited by 615
“The referenced “Brown 1975” does not appear in the references.”
InfluentialAnalysing and interpreting DNA methylation data
Bock, C. (2012) · Nature Reviews Genetics · doi:10.1038/nrg3273 · Cited by 574
“For the tiling region analysis (in c ), the locus is segmented into equally spaced regions, and the statistical significance for each of these regions is assessed using a generalization of Fisher’s method 151 .”
MethodGenome-wide association study of Arabidopsis thaliana leaf microbial community
Horton, M. W., Bodenhausen, N., Beilsmith, K., Meng, D., Muegge, B. D., Subramanian, S., Vetter, M. M., Vilhjálmsson, B. J., Nordborg, M., Gordon, J. I., et al. (2014) · Nature Communications · doi:10.1038/ncomms6320 · Cited by 431
Sequence Kernel Association Tests for the Combined Effect of Rare and Common Variants
Ionita-Laza, I., Lee, S., Makarov, V., Buxbaum, J. D., & Lin, X. (2013) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2013.04.015 · Cited by 433
Plastics in the North Atlantic garbage patch: A boat-microbe for hitchhikers and plastic degraders
Debroas, D., Mone, A., & Ter Halle, A. (2017) · Science of The Total Environment · doi:10.1016/j.scitotenv.2017.05.059 · Cited by 424
Co-occurrence patterns of soybean rhizosphere microbiome at a continental scale
Zhang, B., Zhang, J., Liu, Y., Shi, P., & Wei, G. (2018) · Soil Biology and Biochemistry · doi:10.1016/j.soilbio.2017.12.011 · Cited by 417
Elucidating Compound Mechanism of Action by Network Perturbation Analysis
Woo, J. H., Shimoni, Y., Yang, W. S., Subramaniam, P., Iyer, A., Nicoletti, P., Rodríguez Martínez, M., López, G., Mattioli, M., Realubit, R., et al. (2015) · Cell · doi:10.1016/j.cell.2015.05.056 · Cited by 351
“To avoid overestimating such integrative significance, due to interaction dependencies, we use a modification of Brown’s method that compensates for the integration of correlated evidence (Brown, 1975).”
Hannon, E., Dempster, E., Viana, J., Burrage, J., Smith, A. R., Macdonald, R., St Clair, D., Mustard, C., Breen, G., Therman, S., et al. (2016) · Genome Biology · doi:10.1186/s13059-016-1041-x · Cited by 349
“Because these regions were larger than those considered for the sliding window approach, we generated empirical P values (see Methods) to confirm significant associations across 25 of the 27 schizophrenia-associated regions and four of nine PRS-associated regions.”
InfluentialCompetitive interaction with keystone taxa induced negative priming under biochar amendments
Chen, L., Jiang, Y., Liang, C., Luo, Y., Xu, Q., Han, C., Zhao, Q., & Sun, B. (2019) · Microbiome · doi:10.1186/s40168-019-0693-7 · Cited by 343
Trustworthy Online Controlled Experiments: A Practical Guide to A/B Testing
Kohavi, R., Tang, D., & Xu, Y. (2020) · doi:10.1017/9781108653985 · Cited by 297
Mutant U2AF1 Expression Alters Hematopoiesis and Pre-mRNA Splicing In Vivo
Shirai, C. L., Ley, J. N., White, B. S., Kim, S., Tibbitts, J., Shao, J., Ndonwi, M., Wadugu, B., Duncavage, E. J., Okeyo-Owuor, T., et al. (2015) · Cancer Cell · doi:10.1016/j.ccell.2015.04.008 · Cited by 287
“…of potentially concordant changes across species, we performed a meta-analysis of the three independent datasets using Fisher’s combined probability test (Brown, 1975) and identified 555 significantly dysregulated homologous junctions in 415 genes across all three datasets (FDR 0.1) (Table S5).”
InfluentialYaari, G., Bolen, C. R., Thakar, J., & Kleinstein, S. H. (2013) · Nucleic Acids Research · doi:10.1093/nar/gkt660 · Cited by 261
Controlling false discoveries in genome scans for selection
François, O., Martins, H., Caye, K., & Schoville, S. D. (2016) · Molecular Ecology · doi:10.1111/mec.13513 · Cited by 244
“The z -scores at each locus were combined according to a robust variant of the Stouffer method (Brown 1975; Whitlock 2005).”
MethodNon‐parametric combination and related permutation tests for neuroimaging
Winkler, A. M., Webster, M. A., Brooks, J. C., Tracey, I., Smith, S. M., & Nichols, T. E. (2016) · Human Brain Mapping · doi:10.1002/hbm.23115 · Cited by 245
“In fact, modifications to these procedures to account for nonindependence [e.g., Brown, 1975; Kost and McDermott, 2002 for the Fisher method] are made redundant.”
MethodBhargava, A., Clabaugh, I., To, J. P., Maxwell, B. B., Chiang, Y.-H., Schaller, G. E., Loraine, A., & Kieber, J. J. (2013) · Plant Physiology · doi:10.1104/pp.113.217026 · Cited by 244
“A Fisher’s combined probability test (Brown, 1975; Kippola and Santorico, 2010) was used to analyze the microarray data and identified 4,485 differentially regulated genes (P # 0.01; Supplemental Table S2).”
MethodInfluentialKeller, C. J., Bickel, S., Honey, C. J., Groppe, D. M., Entz, L., Craddock, R. C., Lado, F. A., Kelly, C., Milham, M., & Mehta, A. D. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.4837-12.2013 · Cited by 245
“Then, we performed a group analysis using Fisher’s combined probability test, which combines independent tests from each subject that evaluates the same hypothesis (Fisher, 1925; Brown, 1975).”
MethodWang, X., Bian, Q., Jiang, Y., Zhu, L., Chen, Y., Liang, Y., & Sun, B. (2021) · Soil Biology and Biochemistry · doi:10.1016/j.soilbio.2020.108062 · Cited by 231
Exploring nucleo-cytoplasmic large DNA viruses in Tara Oceans microbial metagenomes
Hingamp, P., Grimsley, N., Acinas, S. G., Clerissi, C., Subirana, L., Poulain, J., Ferrera, I., Sarmento, H., Villar, E., Lima-Mendez, G., et al. (2013) · The ISME Journal · doi:10.1038/ismej.2013.59 · Cited by 236
Integrative pathway enrichment analysis of multivariate omics data
Paczkowska, M., Barenboim, J., Sintupisut, N., Fox, N. S., Zhu, H., Abd-Rabbo, D., Mee, M. W., Boutros, P. C., PCAWG Drivers and Functional Interpretation Working Group, Abascal, F., et al. (2020) · Nature Communications · doi:10.1038/s41467-019-13983-9 · Cited by 221
Tito, R. Y., Chaffron, S., Caenepeel, C., Lima-Mendez, G., Wang, J., Vieira-Silva, S., Falony, G., Hildebrand, F., Darzi, Y., Rymenans, L., et al. (2019) · Gut · doi:10.1136/gutjnl-2018-316106 · Cited by 227
“P values were then merged using Brown's method 38 and corrected for multiple testing using Benjamini-Hochberg's procedure.”
DNA repair pathways underlie a common genetic mechanism modulating onset in polyglutamine diseases
Bettencourt, C., Hensman‐Moss, D., Flower, M., Wiethoff, S., Brice, A., Goizet, C., Stevanin, G., Koutsis, G., Karadima, G., Panas, M., et al. (2016) · Annals of Neurology · doi:10.1002/ana.24656 · Cited by 227
“This was done by combining the association p values for each SNP using Brown’s method.(21) Essentially, this is Fisher’s method for combining p values corrected for linkage disequilibrium between SNPs.”
MethodCross-biome comparison of microbial association networks
Faust, K., Lima-Mendez, G., Lerat, J.-S., Sathirapongsasuti, J. F., Knight, R., Huttenhower, C., Lenaerts, T., & Raes, J. (2015) · Frontiers in Microbiology · doi:10.3389/fmicb.2015.01200 · Cited by 204
Debroas, D., Domaizon, I., Humbert, J.-F., Jardillier, L., Lepère, C., Oudart, A., & Taïb, N. (2017) · FEMS Microbiology Ecology · doi:10.1093/femsec/fix023 · Cited by 201
“In the permutation step, edge-specific P-values were computed; however, for the final network, P-values of an edge were merged into one Pvalue following Brown’s method (Brown 1975).”
MethodAbbatiello, S. E., Mani, D. R., Keshishian, H., & Carr, S. A. (2010) · Clinical Chemistry · doi:10.1373/clinchem.2009.138420 · Cited by 198
Convergent genetic and expression data implicate immunity in Alzheimer's disease
International Genomics of Alzheimer's Disease Consortium (IGAP), Jones, L., Lambert, J., Wang, L., Choi, S., Harold, D., Vedernikov, A., Escott‐Price, V., Stone, T., Richards, A., et al. (2015) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2014.05.1757 · Cited by 199
“Brown’s method [15] was used to test pathway enrichment in the replication data.”
Soil microbiome responses to the short‐term effects of Amazonian deforestation
Navarrete, A. A., Tsai, S. M., Mendes, L. W., Faust, K., de Hollander, M., Cassman, N. A., Raes, J., van Veen, J. A., & Kuramae, E. E. (2015) · Molecular Ecology · doi:10.1111/mec.13172 · Cited by 190
“Next, measure-specific P-values were merged using Brown’s method (Brown 1975), which takes correlations among measures into account (i.”
MethodCoupling Bacterial Community Assembly to Microbial Metabolism across Soil Profiles
Luan, L., Liang, C., Chen, L., Wang, H., Xu, Q., Jiang, Y., & Sun, B. (2020) · mSystems · doi:10.1128/msystems.00298-20 · Cited by 176
“Weighted voting with Brown P values (51) was used for the four measurements, as this method accounts for the dependency among measures.”
Combining p-values via averaging
Vovk, V., & Wang, R. (2020) · Biometrika · doi:10.1093/biomet/asaa027 · Cited by 266
Sheng, X., Guan, Y., Ma, Z., Wu, J., Liu, H., Qiu, C., Vitale, S., Miao, Z., Seasock, M. J., Palmer, M., et al. (2021) · Nature Genetics · doi:10.1038/s41588-021-00909-9 · Cited by 157
Kost, J. T., & McDermott, M. P. (2002) · Statistics & Probability Letters · doi:10.1016/s0167-7152(02)00310-3 · Cited by 166
Testing for outliers with conformal p-values
Bates, S., Candès, E. J., Lei, L., Romano, Y., & Sesia, M. (2023) · The Annals of Statistics · doi:10.1214/22-aos2244 · Cited by 323
“2, we also confirm the validity of (6) via Monte-Carlo simulations and show this is asymptotically equivalent to the correction proposed by [68, 69] to address p-value dependence in more general contexts.”
MethodThe RNA Atlas expands the catalog of human non-coding RNAs
Lorenzi, L., Chiu, H.-S., Avila Cobos, F., Gross, S., Volders, P.-J., Cannoodt, R., Nuytens, J., Vanderheyden, K., Anckaert, J., Lefever, S., et al. (2021) · Nature Biotechnology · doi:10.1038/s41587-021-00936-1 · Cited by 163
Combining dependent P- values with an empirical adaptation of Brown’s method
Poole, W., Gibbs, D. L., Shmulevich, I., Bernard, B., & Knijnenburg, T. A. (2016) · Bioinformatics · doi:10.1093/bioinformatics/btw438 · Cited by 157
Xiao, X., Liang, Y., Sai, Z., Zhuang, S., & Sun, B. (2017) · Molecular Ecology · doi:10.1111/mec.14428 · Cited by 166
DiBattista, J. D., Reimer, J. D., Stat, M., Masucci, G. D., Biondi, P., Brauwer, M. D., Wilkinson, S., Chariton, A. A., & Bunce, M. (2020) · Scientific Reports · doi:10.1038/s41598-020-64858-9 · Cited by 156
Wang, J. L., Liu, K. L., Zhao, X. Q., Zhang, H. Q., Li, D. W., Li, J. J., & Shen, R. F. (2021) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2021.148664 · Cited by 156
Pandit, R., & Infield, D. G. (2018) · IET Renewable Power Generation · doi:10.1049/iet-rpg.2018.0156 · Cited by 134
“Apart from Fisher method, other methods for combining p-values are briefly discussed in [40, 41,42].”
MethodDistinct Physiological Maturation of Parvalbumin-Positive Neuron Subtypes in Mouse Prefrontal Cortex
Miyamae, T., Chen, K., Lewis, D. A., & Gonzalez-Burgos, G. (2017) · The Journal of Neuroscience · doi:10.1523/jneurosci.3325-16.2017 · Cited by 127
Hannon, E., Dempster, E. L., Mansell, G., Burrage, J., Bass, N., Bohlken, M. M., Corvin, A., Curtis, C. J., Dempster, D., Di Forti, M., et al. (2021) · eLife · doi:10.7554/elife.58430 · Cited by 132
“Using the set of 158 schizophrenia-associated genomic loci, we used Brown’s method ( Brown, 1975 ) to calculate a combined p-value across all probes located within each region (based on hg19) using the probe-level p-values and correlation coefficients between all pairs of probes calculated from the…”
Watershed Urbanization Linked to Differences in Stream Bacterial Community Composition
Hosen, J. D., Febria, C. M., Crump, B. C., & Palmer, M. A. (2017) · Frontiers in Microbiology · doi:10.3389/fmicb.2017.01452 · Cited by 137
“Brown’s method (Brown, 1975) was applied to merge p-values from each of the four measures and corrections for multiple tests were applied following Benjamini andHochberg (1995) with a threshold p-value of 0.05.”
MethodInfluentialMani, D. R., Abbatiello, S. E., & Carr, S. A. (2012) · BMC Bioinformatics · doi:10.1186/1471-2105-13-s16-s9 · Cited by 117
“These dependent p-values are combined by means of a previously outlined methodology [49,50].”
MethodZheng, M. M., Wang, C., Li, W. X., Guo, L. J., Cai, Z. J., Wang, B. R., Chen, J., & Shen, R. F. (2021) · European Journal of Soil Biology · doi:10.1016/j.ejsobi.2021.103312 · Cited by 125
The poolr Package for Combining Independent and Dependent p Values
Cinar, O., & Viechtbauer, W. (2022) · Journal of Statistical Software · doi:10.18637/jss.v101.i01 · Cited by 133
“The first method is based on Brown (1975), who described a modification of Fisher’s method for pooling the results of k one-sided one-sample z tests of the null hypotheses H0i : µi ≤ µ0i for the random variables X1, X2, . . . , Xk that are assumed to have a joint multivariate normal distribution.”
MethodInfluentialGenetic variability in response to amyloid beta deposition influences Alzheimer’s disease risk
Salih, D. A., Bayram, S., Guelfi, S., Reynolds, R. H., Shoai, M., Ryten, M., Brenton, J. W., Zhang, D., Matarin, M., Botia, J. A., et al. (2019) · Brain Communications · doi:10.1093/braincomms/fcz022 · Cited by 110
“The significance of the association to Alzheimer’s disease of human genes was assessed using a gene-based approach as introduced in Brown (1975 (Kunkle et al. , 2019) summary statistics calculated for each SNP in a sample of 21 982 Alzheimer’s disease cases and 41 944 controls were used to derive…”
InfluentialGenome-wide analysis of somatic noncoding mutation patterns in cancer
Dietlein, F., Wang, A. B., Fagre, C. R., Tang, A., Besselink, N. J. M., Cuppen, E. P. J. G., Li, C., Sunyaev, S. R., Neal, J. T., & Allen, E. M. V. (2022) · Science · doi:10.1126/science.abg5601 · Cited by 123
“We then combined them using Brown’s method (11), which was also used in previous cancer genomics studies, including PCAWG (9), and then adjusted them using weighted multiple hypothesis correction (12).”
Murphy, T. M., Crawford, B., Dempster, E. L., Hannon, E., Burrage, J., Turecki, G., Kaminsky, Z., & Mill, J. (2017) · Translational Psychiatry · doi:10.1038/tp.2016.249 · Cited by 92
Nonparametric Analysis of Thermal Proteome Profiles Reveals Novel Drug-binding Proteins*
Childs, D., Bach, K., Franken, H., Anders, S., Kurzawa, N., Bantscheff, M., Savitski, M. M., & Huber, W. (2019) · Molecular & Cellular Proteomics · doi:10.1074/mcp.tir119.001481 · Cited by 102
Delafont, V., Bouchon, D., Héchard, Y., & Moulin, L. (2016) · Water Research · doi:10.1016/j.watres.2016.05.044 · Cited by 94
Li, M., Kwan, J. S. H., & Sham, P. C. (2012) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2012.08.004 · Cited by 100
Wang, H., Wei, Z., Mei, L., Gu, J., Yin, S., Faust, K., Raes, J., Deng, Y., Wang, Y., Shen, Q., et al. (2016) · Soil Biology and Biochemistry · doi:10.1016/j.soilbio.2016.11.029 · Cited by 95
Derakhshani, H., Plaizier, J. C., Buck, J. D., Barkema, H. W., & Khafipour, E. (2018) · Microbiome · doi:10.1186/s40168-018-0586-1 · Cited by 102
“Measure-specific p values were then merged using Brown’s method [88] and subjected to Benjamini-Hochberg’s FDR correction.”
MethodComputational methods for identifying miRNA sponge interactions
Le, T. D., Zhang, J., Liu, L., & Li, J. (2016) · Briefings in Bioinformatics · doi:10.1093/bib/bbw042 · Cited by 95
Detecting adaptive evolution based on association with ecological gradients: Orientation matters!
Frichot, É., Schoville, S. D., de Villemereuil, P., Gaggiotti, O. E., & François, O. (2015) · Heredity · doi:10.1038/hdy.2015.7 · Cited by 95
“More speci fi cally, we ran LFMM fi ve times for each value of K with run-lengths of 10 000 cycles and burn-in periods of 5000 cycles, and we combined the P -values and the z -scores resulting from each run using the Fisher-Stouffer method (Brown, 1975).”
MethodTrpchevska, N., Freidin, M. B., Broer, L., Oosterloo, B. C., Yao, S., Zhou, Y., Vona, B., Bishop, C. E., Bizaki-Vallaskangas, A. J., Canlon, B., et al. (2022) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2022.04.010 · Cited by 84
PathNet: a tool for pathway analysis using topological information
Dutta, B., Wallqvist, A., & Reifman, J. (2012) · Source Code for Biology and Medicine · doi:10.1186/1751-0473-7-10 · Cited by 549
“Note that, even if the p D - and p I -values were correlated, they could still be combined using a modified version of Fisher ’ s method [19].”
Examining Sex-Differentiated Genetic Effects Across Neuropsychiatric and Behavioral Traits
Martin, J., Khramtsova, E. A., Goleva, S. B., Blokland, G. A. M., Traglia, M., Walters, R. K., Hübel, C., Coleman, J. R. I., Breen, G., Børglum, A. D., et al. (2021) · Biological Psychiatry · doi:10.1016/j.biopsych.2020.12.024 · Cited by 79
“In this analysis, the mean of the chi2 statistic for the SNPs in a gene is calculated and the p-value is obtained from a known approximation of the sampling distribution [27,28].”
MethodGrunert, M., Dorn, C., Cui, H., Dunkel, I., Schulz, K., Schoenhals, S., Sun, W., Berger, F. F., Chen, W., & Sperling, S. (2016) · Cardiovascular Research · doi:10.1093/cvr/cvw195 · Cited by 79
Yao, Z., Yang, K., Huang, L., Huang, X., Qiuqian, L., Wang, K., & Zhang, D. (2018) · AMB Express · doi:10.1186/s13568-018-0644-x · Cited by 81
“The p-values were then merged using Brown’s method (Brown 1975) and corrected for multiple testing with the Benjamini–Hochberg (1995) procedure.”
MethodCraddock, T. J. A., Fritsch, P., Rice, M. A., del Rosario, R. M., Miller, D. B., Fletcher, M. A., Klimas, N. G., & Broderick, G. (2014) · PLoS ONE · doi:10.1371/journal.pone.0084839 · Cited by 75
Microbial Communities in the East and West Fram Strait During Sea Ice Melting Season
Fadeev, E., Salter, I., Schourup‐Kristensen, V., Nöthig, E., Metfies, K., Engel, A., Piontek, J., Boëtius, A., & Bienhold, C. (2018) · Frontiers in Marine Science · doi:10.3389/fmars.2018.00429 · Cited by 79
“The measure-specific p-values were merged using Brown’s method (Brown, 1975) and correction for multiple-testing was performed according to Benjamini and Hochberg (1995).”
MethodFire modifies the phylogenetic structure of soil bacterial co‐occurrence networks
Pérez‐Valera, E., Goberna, M., Faust, K., Raes, J., García, C. P., & Verdú, M. (2016) · Environmental Microbiology · doi:10.1111/1462-2920.13609 · Cited by 79
“P-values of different correlation/dissimilarity measures supporting the same link were merged using Brown’s method and corrected for multiple testing using Benjamini–Hochberg’s procedure (Brown, 1975; Benjamini and Hochberg, 1995).”
MethodAnderson, S. R., & Harvey, E. L. (2020) · mSphere · doi:10.1128/msphere.00209-20 · Cited by 77
Sex differences in the genetic architecture of obsessive–compulsive disorder
Khramtsova, E. A., Heldman, R., Derks, E. M., Yu, D., Tourette Syndrome/Obsessive‐Compulsive Disorder Working Group of the Psychiatric Genomics Consortium, Davis, L. K., & Stranger, B. E. (2019) · American Journal of Medical Genetics Part B: Neuropsychiatric Genetics · doi:10.1002/ajmg.b.32687 · Cited by 66
“In this analysis the mean of the chi2-statistic for the SNPs in a gene is calculated and the p-value is obtained from a known approximation of the sampling distribution (Brown, 1975; Hou, 2005).”
MethodWang, J. L., Liu, K. L., Zhao, X. Q., Gao, G., Wu, Y., & Shen, R. F. (2021) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2021.152342 · Cited by 75
Liu, H., Huang, X., Tan, W., Di, H., Xu, J. M., & Li, Y. (2020) · Soil Ecology Letters · doi:10.1007/s42832-020-0032-8 · Cited by 71
“The P values were merged using Brown’s method (Brown, 1975) and then adjusted by Benjamini-Hochberg multiple-test corrections (Benjamini and Hochberg, 1995).”
MethodA comprehensive survey of the approaches for pathway analysis using multi-omics data integration
Maghsoudi, Z., Nguyen, H., Tavakkoli, A., & Nguyen, T. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac435 · Cited by 74
“A possible solution is considering the meth-ods that can combine dependent P -values (e.g. Brown’s [99] and Liptak’s [138]).”
de Pretis, S., Kress, T., Morelli, M. J., Melloni, G. E. M., Riva, L., Amati, B., & Pelizzola, M. (2015) · Bioinformatics · doi:10.1093/bioinformatics/btv288 · Cited by 64
“…nested models where at least one model is successfully evaluated by v2 test are considered, and resulting P-values are combined using Brown’s method (Brown, 1975) The same procedure is thus applied for the evaluation of synthesis rate (comparing nested models as indicated by the solid arrows in…”
MethodHuang, R., Zhang, Z., Xiao, X., Zhang, N., Wang, X., Yang, Z.-P., Xu, K., & Liang, Y. (2019) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2019.07.262 · Cited by 70
Mason, K., Sathe, A., Hess, P. R., Rong, J., Wu, C.-Y., Furth, E. E., Suszták, K., Levinsohn, J. L., Ji, H. P., & Zhang, N. R. (2024) · Genome biology · doi:10.1186/s13059-023-03159-6 · Cited by 71
Proteomics for systems toxicology
Titz, B., Elamin, A., Martin, F. P., Schneider, T. L., Dijon, S., Ivanov, N. V., Hoeng, J., & Peitsch, M. C. (2014) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2014.08.004 · Cited by 68
“Traditional approaches for the integration of p-values (or z-scores) are Fisher's [166] and Stouffer's [167] method and Brown's method for the integration of dependent p-values [168].”
MethodSteiner, K., Laroche, O., Walker, S. P., & Symonds, J. E. (2022) · Aquaculture · doi:10.1016/j.aquaculture.2022.738529 · Cited by 64
Virtual Populations for Quantitative Systems Pharmacology Models
Cheng, Y., Straube, R., Alnaif, A. E., Huang, L., Leil, T. A., & Schmidt, B. J. (2022) · Methods in Molecular Biology · doi:10.1007/978-1-0716-2265-0_8 · Cited by 54
Directional integration and pathway enrichment analysis for multi-omics data
Slobodyanyuk, M., Bahcheli, A. T., Klein, Z. P., Bayati, M., Strug, L. J., & Reimand, J. (2024) · Nature Communications · doi:10.1038/s41467-024-49986-4 · Cited by 62
“…a directionally weighted score X DPM is computed across k datasets as X DPM = (cid:1) 2 ð(cid:1)j Σ =1 ln ð P i Þ o i e i j + Σ = j +1 ln ð P i ÞÞ : ð 1 Þ To incorporate directionality to P-value merging, we compute sums of log-transformed P-values P i that are weighted by directional…”
OPATs: OmnibusP-value association tests
Chen, C., & Yang, H. (2017) · Briefings in Bioinformatics · doi:10.1093/bib/bbx068 · Cited by 60
Mitochondrial respiration contributes to the interferon gamma response in antigen-presenting cells
Kiritsy, M. C., McCann, K. J., Mott, D., Holland, S. M., Behar, S. M., Sassetti, C. M., & Olive, A. J. (2021) · eLife · doi:10.7554/elife.65109 · Cited by 59
Li, J. J., & Tong, X. (2020) · Patterns · doi:10.1016/j.patter.2020.100115 · Cited by 67
“Although there are methods for combining dependent p -values [47, 48, 49, 50], they cannot address the most fundamental question—what is the population behind each hypothesis test?”
Revealing Cues for Fungal Interplay in the Plant–Air Interface in Vineyards
Abdelfattah, A., Sanzani, S. M., Wisniewski, M., Berg, G., Cacciola, S. O., & Schena, L. (2019) · Frontiers in Plant Science · doi:10.3389/fpls.2019.00922 · Cited by 58
“All the calculated method-specific p values of an edge were merged into one p value using Brown’s method (Brown, 1975), and Benjamini–Hochberg multiple 2https://github.com/biota/sourcetracker2 Frontiers in Plant Science | www.frontiersin.org 3 July 2019 | Volume 10 | Article 922 testing correction…”
MethodPseudomonas spp. are key players in agricultural biogas substrate degradation
Buettner, C., von Bergen�, M., Jehmlich, N., & Noll, M. (2019) · Scientific Reports · doi:10.1038/s41598-019-49313-8 · Cited by 62
Earth as a transducer for axion dark-matter detection
Arza, A., Fedderke, M. A., Graham, P. W., Kimball, D. F. J., & Kalia, S. (2022) · Physical review. D/Physical review. D. · doi:10.1103/physrevd.105.095007 · Cited by 59
Johnke, J., Dirksen, P., & Schulenburg, H. (2020) · Environmental Microbiology · doi:10.1111/1462-2920.14932 · Cited by 59
“P-values were merged with Brown’s method (Brown, 1975).”
Meta-Analysis of Pathway Enrichment: Combining Independent and Dependent Omics Data Sets
Kaever, A., Landesfeind, M., Feussner, K., Morgenstern, B., Feußner, I., & Meinicke, P. (2014) · PLoS ONE · doi:10.1371/journal.pone.0089297 · Cited by 57
“For dependent p-values, a powerful approach is Brown’s method [30], which is an extension of Fisher’s method based on a scaled chi-squared distribution and modified degrees of freedom utilizing a known covariance matrix for standard normal deviates.”
MethodAuger, L., Deschamps, M., Vandenberg, G. W., & Derôme, N. (2023) · Frontiers in Microbiology · doi:10.3389/fmicb.2023.1221728 · Cited by 55
“The compositional bias of the data was mitigated by computing final p-values with Brown’s p-value merge method (100 iterations; Brown, 1975).”
MethodChen, B., Yu, K., Liao, Z., Yu, X., Qin, Z., Liang, J., Wang, G., Wu, Q., & Jiang, L. (2020) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2020.142690 · Cited by 55
“Brown's method was used to merge and calculate the measure-specific p-value (Brown, 1975).”
MethodON THE RELIABILITY OF MICROVARIABILITY TESTS IN QUASARS
de Diego, J. A. (2014) · The Astronomical Journal · doi:10.1088/0004-6256/148/5/93 · Cited by 53
“Based on Fisher’s method of combining probabilities through the χ2 statistics, Brown (1975) and 2 Kost & McDermott (2002) developed covariance based tests to prove the distribution of a sample of probability values.”
MethodELMO1 variants and susceptibility to diabetic nephropathy in American Indians
Hanson, R. L., Millis, M. P., Young, N. J., Kobes, S., Nelson, R. G., Knowler, W. C., & DiStefano, J. K. (2010) · Molecular Genetics and Metabolism · doi:10.1016/j.ymgme.2010.08.014 · Cited by 52
“P-values were combined using the method of Brown, which is analogous to Fisher’s method for combining p-values except that it accounts for correlation among SNPs (22; 23).”
MethodYang, J. J., Li, J., Williams, L. K., & Buu, A. (2016) · BMC Bioinformatics · doi:10.1186/s12859-015-0868-6 · Cited by 57
Chen, B., Yu, K., Qin, Z., Liang, J., Wang, G., Huang, X., Wu, Q., & Jiang, L. (2020) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2020.138026 · Cited by 55
THE DETECTION OF A SN IIn IN OPTICAL FOLLOW-UP OBSERVATIONS OF ICECUBE NEUTRINO EVENTS
Aartsen, M. G., Abraham, K., Ackermann, M., Adams, J., Aguilar, J. A., Ahlers, M., Ahrens, M., Altmann, D., Anderson, T., Archinger, M., et al. (2015) · The Astrophysical Journal · doi:10.1088/0004-637x/811/1/52 · Cited by 66
“Combining this probability with the probability of 12.7% for the neutrino alert, Fisherʼs method (Fisher 1950, 1990; Littell & Folks 1971; Brown 1975) delivers a combined p-value of 1.4%, corresponding to a significance of 2.2σ.”
MethodInfluentialHakim, J. A., Schram, J. B., Galloway, A. W. E., Morrow, C. D., Crowley, M. R., Watts, S. A., & Bej, A. K. (2019) · Microorganisms · doi:10.3390/microorganisms7020035 · Cited by 53
“The p-values of the multi-edges assigned to node pairs were merged using the Brown method [83], with unstable edges filtered out, and the corrected significance value (q-value) was determined with a threshold set at p < 0.”
MethodEpigenetic and integrative cross-omics analyses of cerebral white matter hyperintensities on MRI
Yang, Y., Knol, M. J., Wang, R., Mishra, A., Liu, D., Luciano, M., Teumer, A., Armstrong, N. J., Bis, J. C., Jhun, M. A., et al. (2022) · Brain · doi:10.1093/brain/awac290 · Cited by 58
“All subsequent analyses focus on these 12 CpGs, which are referred to as ‘target CpGs’.”
InfluentialGeneralizing Moving Averages for Tiling Arrays Using Combined P-Value Statistics
Kechris, K. J., Biehs, B., & Kornberg, T. B. (2010) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1434 · Cited by 56
“Dependence Adjustment to Fisher’s Combined Probability Test When the pi’s are dependent, the distribution of Fisher’s Combined Probability test statistic CP can be approximated by a scaled χ2 distribution, cχ2f , with scaling factor c and degrees of freedom f , such that CP/c∼ χ2f (Brown, 1975).”
Method
Metadata
- Authors
- Brown, M. B.
- Corresponding author
- Brown, Morton B.
- Venue
- Biometrics
- Publisher
- JSTOR
- Published
- 1975-12
- Volume
- 31
- Issue
- 4
- Pages
- 987
- ISSN
- 0006-341X (ISSN-L)
- OpenAlex
- W2330978860
- Cited by
- 473
- References
- 4
- Citations by year
- 2026: 17 · 2025: 29 · 2024: 27 · 2023: 36 · 2022: 37 · 2021: 46 · 2020: 81 · 2019: 25 · 2018: 23 · 2017: 28 · 2016: 25 · 2015: 18 · 2014: 21 · 2013: 24 · 2012: 8
- FWCI
- 0.00
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrics (publishedVersion)
- Funders
- National Institutes of Health
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Probability and Statistical Research
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Keywords
- Fisher's method, one-sided tests, multivariate normal distribution, asymptotic distribution, likelihood ratio test
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.