The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Controlling the False Discovery Rate: A New Application to Account for Multiple and Dependent Tests in Local Statistics of Spatial Association
Abstract
Assessing the significance of multiple and dependent comparisons is an important, and often ignored, issue that becomes more critical as the size of data sets increases. If not accounted for, false‐positive differences are very likely to be identified. The need to address this issue has led to the development of a myriad of procedures to account for multiple testing. The simplest and most widely used technique is the Bonferroni method, which controls the probability that a true null hypothesis is incorrectly rejected. However, it is a very conservative procedure. As a result, the larger the data set the greater the chances that truly significant differences will be missed. In 1995, a new criterion, the false discovery rate (FDR), was proposed to control the proportion of false declarations of significance among those individual deviations from null hypotheses considered to be significant. It is more powerful than all previously proposed methods. Multiple and dependent comparisons are also fundamental in spatial analysis. As the number of locations increases, assessing the significance of local statistics of spatial association becomes a complex matter. In this article we use empirical and simulated data to evaluate the use of the FDR approach in appraising the occurrence of clusters detected by local indicators of spatial association. Results show a significant gain in identification of meaningful clusters when controlling the FDR, in comparison to more conservative approaches. When no control is adopted, false clusters are likely to be identified. If a conservative approach is used, clusters are only partially identified and true clusters are largely missed. In contrast, when the FDR approach is adopted, clusters are fully identified. Incorporating a correction for spatial dependence to conservative methods improves the results, but not enough to match those obtained by the FDR approach.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526
Local Indicators of Spatial Association—LISA
Anselin, L. (1995) · Geographical Analysis · doi:10.1111/j.1538-4632.1995.tb00338.x · Cited by 12,919
The control of the false discovery rate in multiple testing under dependency
Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490
Statistical significance for genomewide studies
Storey, J. D., & Tibshirani, R. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1530509100 · Cited by 9,692
The Analysis of Spatial Association by Use of Distance Statistics
Getis, A., & Ord, J. K. (1992) · Geographical Analysis · doi:10.1111/j.1538-4632.1992.tb00261.x · Cited by 6,276
Simultaneous Statistical Inference
Miller, R. G. (1981) · Springer Series in Statistics · doi:10.1007/978-1-4613-8122-8 · Cited by 5,604
A Direct Approach to False Discovery Rates
Storey, J. D. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00346 · Cited by 5,603
Thresholding of statistical maps in functional neuroimaging using the false discovery rate
Genovese, C. R., Lazar, N. A., & Nichols, T. (2002) · NeuroImage · doi:10.1006/nimg.2001.1037 · Cited by 4,923
A sharper Bonferroni procedure for multiple tests of significance
HOCHBERG, Y. (1988) · Biometrika · doi:10.1093/biomet/75.4.800 · Cited by 4,829
Local Spatial Autocorrelation Statistics: Distributional Issues and an Application
Ord, J. K., & Getis, A. (1995) · Geographical Analysis · doi:10.1111/j.1538-4632.1995.tb00912.x · Cited by 3,650
Rectangular Confidence Regions for the Means of Multivariate Normal Distributions
Šidák, Z. (1967) · Journal of the American Statistical Association · doi:10.1080/01621459.1967.10482935 · Cited by 2,639
An improved Bonferroni procedure for multiple tests of significance
SIMES, R. J. (1986) · Biometrika · doi:10.1093/biomet/73.3.751 · Cited by 2,396
The positive false discovery rate: a Bayesian interpretation and the q-value
Storey, J. D. (2003) · The Annals of Statistics · doi:10.1214/aos/1074290335 · Cited by 2,204
On the adaptive control of the false discovery rate in multiple testing with independent statistics
Benjamini, Y., & Hochberg, Y. (2000) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986025001060 · Cited by 2,015
Interactive Spatial Data Analysis
Bailey, T., & Gatrell, A. C. (1995) · Medical Entomology and Zoology · Cited by 1,945
Storey, J. D., Taylor, J. E., & Siegmund, D. (2004) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2004.00439.x · Cited by 1,388
A stagewise rejective multiple test procedure based on a modified Bonferroni test
HOMMEL, G. (1988) · Biometrika · doi:10.1093/biomet/75.2.383 · Cited by 1,367
Interactive spatial data analysis
Agterberg, F. P. (1996) · Computers & Geosciences · doi:10.1016/s0098-3004(96)80468-7 · Cited by 1,349
Some comments on frequently used multiple endpoint adjustment methods in clinical trials
Sankoh, A. J., Huque, M. F., & Dubey, S. D. (1997) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19971130)16:22<2529::aid-sim692>3.0.co;2-j · Cited by 805
The Philosophy of Multiple Comparisons
Tukey, J. W. (1991) · Statistical Science · doi:10.1214/ss/1177011945 · Cited by 773
Yekutieli, D., & Benjamini, Y. (1999) · Journal of Statistical Planning and Inference · doi:10.1016/s0378-3758(99)00041-5 · Cited by 753
Empirical Bayes methods and false discovery rates for microarrays
Efron, B., & Tibshirani, R. (2002) · Genetic Epidemiology · doi:10.1002/gepi.1124 · Cited by 684
Spatial analysis: Modelling in a GIS environment
Longley, P., & Batty, M. (1996) · Bristol Research (University of Bristol) · Cited by 555
New Directions in Spatial Econometrics
(1995) · Advances in spatial science · doi:10.1007/978-3-642-79877-1 · Cited by 527
Robust Estimates of Location: Survey and Advances.
Hinkley, D. V., Andrews, D. F., Bickel, P. J., Hampel, F. R., Huber, P. J., Rogers, W. H., & Tukey, J. W. (1973) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2345006 · Cited by 520
Testing the Statistical Certainty of a Response to Increasing Doses of a Drug
Tukey, J. W., Ciminera, J. L., & Heyse, J. F. (1985) · Biometrics · doi:10.2307/2530666 · Cited by 486
Robust Estimates of Location: Survey and Advances.
Prescott, P., Andrews, D. R., Bickel, P. J., Hampei, F. R., Huber, P. J., Rogers, W. H., & Tukey, J. W. (1975) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.2307/2987928 · Cited by 454
Tobler, W. R. (1979) · Philosophy in Geography · doi:10.1007/978-94-009-9394-5_18 · Cited by 405
A Proof of the Conjecture that the Tukey-Kramer Multiple Comparisons Procedure is Conservative
Hayter, A. J. (1984) · The Annals of Statistics · doi:10.1214/aos/1176346392 · Cited by 390
Simulation of polymer dynamics. I. General theory
Fixman, M. (1978) · The Journal of Chemical Physics · doi:10.1063/1.436725 · Cited by 388
A Step-Up Multiple Test Procedure
Dunnett, C. W., & Tamhane, A. C. (1992) · Journal of the American Statistical Association · doi:10.1080/01621459.1992.10475188 · Cited by 280
Spatial Analysis of Employment and Population Density: The Case of the Agglomeration of Dijon 1999
Baumont, C., Ertur, C., & Gallo, J. L. (2004) · Geographical Analysis · doi:10.1111/j.1538-4632.2004.tb01130.x · Cited by 262
Ecological Change, Group Territoriality, and Population Dynamics in Serengeti Lions
Packer, C., Hilborn, R., Mosser, A., Kissui, B., Borner, M., Hopcraft, G., Wilmshurst, J., Mduma, S., & Sinclair, A. R. E. (2005) · Science · doi:10.1126/science.1105122 · Cited by 242
On Multivariate Normal Probabilities of Rectangles: Their Dependence on Correlations
Sidak, Z. (1968) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177698122 · Cited by 210
Páez, A., Uchida, T., & Miyamoto, K. (2002) · Environment and Planning A: Economy and Space · doi:10.1068/a34110 · Cited by 192
Williams, V. S. L., Jones, L. V., & Tukey, J. W. (1999) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986024001042 · Cited by 187
A Comparison of Two Modified Bonferroni Procedures
Hommel, G. (1989) · Biometrika · doi:10.1093/biomet/76.3.624 · Cited by 151
John W. Tukey's contributions to multiple comparisons
Benjamini, Y., & Braun, H. I. (2002) · The Annals of Statistics · doi:10.1214/aos/1043351247 · Cited by 118
Methods correcting for multiple testing: operating characteristics
Brown, B. W., & Russell, K. E. (1997) · Statistics in Medicine · Cited by 118
Šidák, Z. (1971) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177693504 · Cited by 102
On the size and shape of self-assembled micelles
Nelson, P. H., Rutledge, G. C., & Hatton, T. A. (1997) · The Journal of Chemical Physics · doi:10.1063/1.474193 · Cited by 100
A Statistical Method for the Detection of Geographic Clustering
Rogerson, P. A. (2001) · Geographical Analysis · doi:10.1111/j.1538-4632.2001.tb00445.x · Cited by 85
Malaria on the Amazon frontier: economic and social aspects of transmission and control.
Dr, S. (1986) · PubMed · Cited by 63
Multiple Tests of a Non-Hierarchical Finite Family of Hypotheses
Liu, W. (1996) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1996.tb02093.x · Cited by 61
Short-Cut Multiple Comparisons for Balanced Single and Double Classifications: Part 1, Results
Kurtz, T., Link, R. F., Tukey, J. W., & Wallace, D. L. (1965) · Technometrics · doi:10.1080/00401706.1965.10490245 · Cited by 53
Doi, M. (2003) · Pure and Applied Chemistry · doi:10.1351/pac200375101395 · Cited by 13
Cited by
Rapid and highly variable warming of lake surface waters around the globe
O'Reilly, C. M., Sharma, S., Gray, D. K., Hampton, S. E., Read, J. S., Rowley, R. J., Schneider, P., Lenters, J. D., McIntyre, P. B., Kraemer, B. M., et al. (2015) · Geophysical Research Letters · doi:10.1002/2015gl066235 · Cited by 1,303
Comparing implementations of global and local indicators of spatial association
Bivand, R. S., & Wong, D. W. S. (2018) · TEST · doi:10.1007/s11749-018-0599-x · Cited by 1,126
Inference in Multiscale Geographically Weighted Regression
Yu, H., Fotheringham, A. S., Li, Z., Oshan, T., Kang, W., & Wolf, L. J. (2020) · Geographical Analysis · doi:10.1111/gean.12189 · Cited by 409
Getis, A. (2010) · Handbook of Applied Spatial Analysis · doi:10.1007/978-3-642-03647-7_14 · Cited by 315
Mapping vulnerability to extreme heat events: Lessons from metropolitan Chicago
Wilson, B., & Chakraborty, A. (2019) · Journal of Environmental Planning and Management · doi:10.1080/09640568.2018.1462475 · Cited by 71
“These calculations were performed in ArcGISTM 10.5 using an inverse distance weighting approach and with the False Discovery Rate correction (Caldas de Castro and Singer 2006) applied.”
MethodInfluential
Metadata
- Authors
- Caldas de Castro, M., & Singer, B. H.
- Venue
- Geographical Analysis
- Publisher
- Wiley
- Published
- 2006-03-24
- Volume
- 38
- Issue
- 2
- Pages
- 180-208
- ISSN
- 0016-7363 (ISSN-L)
- 1538-4632
- OpenAlex
- W2002110589
- Cited by
- 330
- References
- 47
- FWCI
- 14.33
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.