The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
A systematic review and scientific critique of methodology in modern urban heat island literature
Abstract
In the modern era of urban climatology, much emphasis has been placed on observing and documenting heat island magnitudes in cities around the world. Urban climate literature consequently boasts a remarkable accumulation of observational heat island studies. Through time, however, methodologists have raised concerns about the authenticity of these studies, especially regarding the measurement, definition and reporting of heat island magnitudes. This paper substantiates these concerns through a systematic review and scientific critique of heat island literature from the period 1950–2007. The review uses nine criteria of experimental design and communication to critically assess methodological quality in a sample of 190 heat island studies. Results of this assessment are discouraging: the mean quality score of the sample is just 50 percent, and nearly half of all urban heat island magnitudes reported in the sample are judged to be scientifically indefensible. Two areas of universal weakness in the literature sample are controlled measurement and openness of method: one‐half of the sample studies fail to sufficiently control the confounding effects of weather, relief or time on reported ‘urban’ heat island magnitudes, and three‐quarters fail to communicate basic metadata regarding instrumentation and field site characteristics. A large proportion of observational heat island literature is therefore compromised by poor scientific practice. This paper concludes with recommendations for improving method and communication in heat island studies through better scrutiny of findings and more rigorous reporting of primary research. Copyright © 2010 Royal Meteorological Society
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Primary, Secondary, and Meta-Analysis of Research
GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890 · cited 1×
“Each sample report was graded and ranked by a conventional ‘vote count’ procedure in which points were awarded for passing a criterion and no points for failing a criterion (Glass, 1976).”
MethodThe energetic basis of the urban heat island
Oke, T. R. (1982) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49710845502 · Cited by 4,670
Arnfield, A. J. (2003) · International Journal of Climatology · doi:10.1002/joc.859 · Cited by 3,543
Hempel, C. G. (1966) · Medical Entomology and Zoology · Cited by 2,517
Landsberg, H. E. (2011) · Cited by 1,118
Oke, T. R. (1988) · Progress in Physical Geography: Earth and Environment · doi:10.1177/030913338801200401 · Cited by 959
The Handbook of Research Synthesis
Ziegel, E. R., Cooper, H., & Hedges, L. (1995) · Technometrics · doi:10.2307/1269651 · Cited by 927
The distinction between canopy and boundary‐layer urban heat islands
Oke, T. R. (1976) · Atmosphere · doi:10.1080/00046973.1976.9648422 · Cited by 626
Review of urban climate research in (sub)tropical regions
Roth, M. (2007) · International Journal of Climatology · doi:10.1002/joc.1591 · Cited by 402
KIM, H. H. (1992) · International Journal of Remote Sensing · doi:10.1080/01431169208904271 · Cited by 402
Towards better scientific communication in urban climate
Oke, T. R. (2006) · Theoretical and Applied Climatology · doi:10.1007/s00704-005-0153-0 · Cited by 401
Empirical Estimation of Urban Effects on Climate: A Problem Analysis
Lowry, W. P. (1977) · Journal of Applied Meteorology · doi:10.1175/1520-0450(1977)016<0129:eeoueo>2.0.co;2 · Cited by 281
Urban heat island dynamics in Montreal and Vancouver
Oke, T. R., & Maxwell, G. B. (1975) · Atmospheric Environment (1967) · doi:10.1016/0004-6981(75)90067-0 · Cited by 279
How Science Takes Stock: The Story of Meta-Analysis
Hunt, M. M. (1997) · Project Muse (Johns Hopkins University) · Cited by 248
How Science Takes Stock: The Story of Meta-Analysis.
Greenberg, R. P. (1998) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-199810000-00013 · Cited by 104
McBoyle, G. (1968) · Research Commons (University of Waikato) · Cited by 102
Methods for handling missing data in research synthesis.
Pigott, T. (1994) · Cited by 83
Runnalls, K. E., & Oke, T. R. (2006) · Journal of Climate · doi:10.1175/jcli3663.1 · Cited by 70
CITY GROWTH AND URBAN CLIMATES
Chandler, T. J. (1964) · Weather · doi:10.1002/j.1477-8696.1964.tb02116.x · Cited by 33
Local temperature variations in the Reading area
Parry, M. (1956) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49708235105 · Cited by 29
Cited by
Local Climate Zones for Urban Temperature Studies
Stewart, I. D., & Oke, T. R. (2012) · Bulletin of the American Meteorological Society · doi:10.1175/bams-d-11-00019.1 · Cited by 4,419
Self-citationSantamouris, M. (2014) · Solar Energy · doi:10.1016/j.solener.2012.07.003 · Cited by 1,893
Satellite Remote Sensing of Surface Urban Heat Islands: Progress, Challenges, and Perspectives
Zhou, D., Xiao, J., Bonafoni, S., Berger, C., Deilami, K., Zhou, Y., Frolking, S., Yao, R., Qiao, Z., & Sobrino, J. A. (2018) · Remote Sensing · doi:10.3390/rs11010048 · Cited by 1,059
Lai, D., Liu, W., Gan, T., Liu, K., & Chen, Q. (2019) · Science of The Total Environment · doi:10.1016/j.scitotenv.2019.01.062 · Cited by 851
The Urban Heat Island: Implications for Health in a Changing Environment
Heaviside, C., Macintyre, H., & Vardoulakis, S. (2017) · Current Environmental Health Reports · doi:10.1007/s40572-017-0150-3 · Cited by 849
Metadata
- Authors
- Stewart, I. D.
- Venue
- International Journal of Climatology
- Publisher
- Wiley
- Published
- 2011-01-20
- Volume
- 31
- Issue
- 2
- Pages
- 200-217
- ISSN
- 0899-8418 (ISSN-L)
- 1097-0088
- OpenAlex
- W2075784877
- Cited by
- 752
- References
- 20
- FWCI
- 1.97
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.