The DOI matches its Crossref record; 63 of the 64 references it cites were found in a registry or an index.
Replication across space and time must be weak in the social and environmental sciences
Open accessAbstract
Replicability takes on special meaning when researching phenomena that are embedded in space and time, including phenomena distributed on the surface and near surface of the Earth. Two principles, spatial dependence and spatial heterogeneity, are generally characteristic of such phenomena. Various practices have evolved in dealing with spatial heterogeneity, including the use of place-based models. We review the rapidly emerging applications of artificial intelligence to phenomena distributed in space and time and speculate on how the principle of spatial heterogeneity might be addressed. We introduce a concept of weak replicability and discuss possible approaches to its measurement.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This is attributed to the model's pretraining on huge amounts of data to achieve good generalizability and, therefore, transferability compared to models learned from and (over)fitted on a small dataset.”
From Assessment of a new GeoAI foundation model for flood inundation mapping (2023) · cites this paper as [11]
Citations
Cites
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,887
A Computer Movie Simulating Urban Growth in the Detroit Region
Tobler, W. R. (1970) · Economic Geography · doi:10.2307/143141 · Cited by 9,719
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Random forest in remote sensing: A review of applications and future directions
Belgiu, M., & Drăguţ, L. (2016) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2016.01.011 · Cited by 7,142
Deep learning and process understanding for data-driven Earth system science
Reichstein, M., Camps-Valls, G., Stevens, B., Jung, M., Denzler, J., Carvalhais, N., & Prabhat (2019) · Nature · doi:10.1038/s41586-019-0912-1 · Cited by 5,673
Geostatistics for Natural Resources Evaluation
Goovaerts, P. (1997) · doi:10.1093/oso/9780195115383.001.0001 · Cited by 4,449
1,500 scientists lift the lid on reproducibility
Baker, M. (2016) · Nature · doi:10.1038/533452a · Cited by 4,209
Dynamic Routing Between Capsules
Sabour, S., Frosst, N., & Hinton, G. E. (2017) · arXiv · doi:10.48550/arxiv.1710.09829 · Cited by 4,167
Geostatistics for Natural Resources Evaluation
Coburn, T. C. (2000) · Technometrics · doi:10.1080/00401706.2000.10485733 · Cited by 4,131
Geographically Weighted Regression: The Analysis of Spatially Varying Relationships
Fotheringham, A. S., Brunsdon, C., & Charlton, M. E. (2002) · doi:10.25405/ncl.34562610 · Cited by 3,938
Research works printed but not linked: 3
- R. L. Church, “Location modelling and GIS” in Geographical Information Systems, P. A. Longley, M. F. Goodchild, D. J. Maguire, D. W. Rhind, Eds. (Wiley, New York, 1999), pp. 293–303.
- B. Varenius, Geographia Generalis (Elsevier, Amsterdam, 1650).
- W. Bunge, Theoretical Geography. Second Edition. Lund Studies in Geography Series C: General and Mathematical Geography, No. 1. (Gleerup, Lund, Sweden, 1966).
Cited by
Li, W., & Hsu, C.-Y. (2022) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi11070385 · Cited by 147
Self-citationOn the Opportunities and Challenges of Foundation Models for GeoAI (Vision Paper)
Mai, G., Huang, W., Sun, J., Song, S., Mishra, D. R., Liu, N., Gao, S., Liu, T., Cong, G., Hu, Y., et al. (2024) · ACM Transactions on Spatial Algorithms and Systems · doi:10.1145/3653070 · Cited by 440
“Similar to geographic bias, FMs also suffer from temporal bias, which also can be attributed to four causes: temporal representation bias, temporal aggregation bias, algorithm bias, and evaluation bias.”
BackgroundInfluentialUrban Visual Intelligence: Studying Cities with Artificial Intelligence and Street-Level Imagery
Zhang, F., Miranda, A. S., Duarte, F., Vale, L. J., Hack, G. A., Chen, M., Liu, Y., Batty, M., & Ratti, C. (2024) · Annals of the American Association of Geographers · doi:10.1080/24694452.2024.2313515 · Cited by 193
“Such spatial variability often limits the ability of models to make consistent predictions across different locations (Goodchild et al. 2020; Goodchild and Li 2021; Kedron et al. 2021; W. Li, Hsu, and Hu 2021).”
Towards the next generation of Geospatial Artificial Intelligence
Mai, G., Xie, Y., Jia, X., Lao, N., Rao, J., Zhu, Q., Liu, Z., Chiang, Y., & Jiao, J. (2025) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2025.104368 · Cited by 147
Hsu, C.-Y., & Li, W. (2023) · International Journal of Geographical Information Science · doi:10.1080/13658816.2023.2191256 · Cited by 75
“The lack of model explainability may further hinder the replicability of research using GeoAI (Goodchild and Li 2021).”
MethodInfluentialSelf-citation
Metadata
- Authors
- Goodchild, M. F., & Li, W.
- Affiliations
- University of California, Santa Barbara (US)
- Arizona State University (US)
- Corresponding author
- Goodchild, Michael F.
- Li, Wenwen
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2021-08-20
- Volume
- 118
- Issue
- 35
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC8536326
- OpenAlex
- W3194059001
- Semantic Scholar
- 8d95d9e41dc13ce437bbeb80c3e06f19fdb71e5e
- Cited by
- 157
- References
- 64
- Citations by year
- 2026: 36 · 2025: 38 · 2024: 32 · 2023: 19 · 2022: 29 · 2021: 3
- FWCI
- 15.84
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- Topics
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Spatial and Panel Data Analysis
- Life Sciences › Agricultural and Biological Sciences › Soil Science › Soil Geostatistics and Mapping
- Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
- Keywords
- spatial heterogeneity, spatial dependence, artificial intelligence
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Replication across space and time must be weak in the social and environmental sciences. https://app.cochat.ai/papers/10.1073/pnas.2015759118
- The paper
- Goodchild, M. F., & Li, W. (2021). Replication across space and time must be weak in the social and environmental sciences. Proceedings of the National Academy of Sciences. https://doi.org/10.1073/pnas.2015759118
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.