The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
A systematic review and scientific critique of methodology in modern urban heat island literature
Abstract
In the modern era of urban climatology, much emphasis has been placed on observing and documenting heat island magnitudes in cities around the world. Urban climate literature consequently boasts a remarkable accumulation of observational heat island studies. Through time, however, methodologists have raised concerns about the authenticity of these studies, especially regarding the measurement, definition and reporting of heat island magnitudes. This paper substantiates these concerns through a systematic review and scientific critique of heat island literature from the period 1950–2007. The review uses nine criteria of experimental design and communication to critically assess methodological quality in a sample of 190 heat island studies. Results of this assessment are discouraging: the mean quality score of the sample is just 50 percent, and nearly half of all urban heat island magnitudes reported in the sample are judged to be scientifically indefensible. Two areas of universal weakness in the literature sample are controlled measurement and openness of method: one‐half of the sample studies fail to sufficiently control the confounding effects of weather, relief or time on reported ‘urban’ heat island magnitudes, and three‐quarters fail to communicate basic metadata regarding instrumentation and field site characteristics. A large proportion of observational heat island literature is therefore compromised by poor scientific practice. This paper concludes with recommendations for improving method and communication in heat island studies through better scrutiny of findings and more rigorous reporting of primary research. Copyright © 2010 Royal Meteorological Society
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Primary, Secondary, and Meta-Analysis of Research
GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890 · cited 1×
“Each sample report was graded and ranked by a conventional ‘vote count’ procedure in which points were awarded for passing a criterion and no points for failing a criterion (Glass, 1976).”
MethodThe energetic basis of the urban heat island
Oke, T. R. (1982) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49710845502 · Cited by 4,670
Arnfield, A. J. (2003) · International Journal of Climatology · doi:10.1002/joc.859 · Cited by 3,543
Hempel, C. G. (1966) · Medical Entomology and Zoology · Cited by 2,922
Landsberg, H. E. (2011) · Cited by 1,118
Oke, T. R. (1988) · Progress in Physical Geography: Earth and Environment · doi:10.1177/030913338801200401 · Cited by 959
The Handbook of Research Synthesis
Ziegel, E. R., Cooper, H., & Hedges, L. (1995) · Technometrics · doi:10.2307/1269651 · Cited by 927
The distinction between canopy and boundary‐layer urban heat islands
Oke, T. R. (1976) · Atmosphere · doi:10.1080/00046973.1976.9648422 · Cited by 626
Review of urban climate research in (sub)tropical regions
Roth, M. (2007) · International Journal of Climatology · doi:10.1002/joc.1591 · Cited by 402
KIM, H. H. (1992) · International Journal of Remote Sensing · doi:10.1080/01431169208904271 · Cited by 402
Cited by
Local Climate Zones for Urban Temperature Studies
Stewart, I. D., & Oke, T. R. (2012) · Bulletin of the American Meteorological Society · doi:10.1175/bams-d-11-00019.1 · Cited by 4,419
Self-citationSantamouris, M. (2014) · Solar Energy · doi:10.1016/j.solener.2012.07.003 · Cited by 1,893
Satellite Remote Sensing of Surface Urban Heat Islands: Progress, Challenges, and Perspectives
Zhou, D., Xiao, J., Bonafoni, S., Berger, C., Deilami, K., Zhou, Y., Frolking, S., Yao, R., Qiao, Z., & Sobrino, J. A. (2018) · Remote Sensing · doi:10.3390/rs11010048 · Cited by 1,059
Lai, D., Liu, W., Gan, T., Liu, K., & Chen, Q. (2019) · Science of The Total Environment · doi:10.1016/j.scitotenv.2019.01.062 · Cited by 851
The Urban Heat Island: Implications for Health in a Changing Environment
Heaviside, C., Macintyre, H., & Vardoulakis, S. (2017) · Current Environmental Health Reports · doi:10.1007/s40572-017-0150-3 · Cited by 849
Deilami, K., Kamruzzaman, M., & Liu, Y. (2018) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2017.12.009 · Cited by 835
Mapping Local Climate Zones for a Worldwide Database of the Form and Function of Cities
Bechtel, B., Alexander, P., Böhner, J., Ching, J., Conrad, O., Feddema, J., Mills, G., See, L., & Stewart, I. (2015) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi4010199 · Cited by 709
Self-citationCritical review on the cooling effect of urban blue-green space: A threshold-size perspective
Yu, Z., Yang, G., Zuo, S., Jørgensen, G., Koga, M., & Vejre, H. (2020) · Urban Forestry & Urban Greening · doi:10.1016/j.ufug.2020.126630 · Cited by 700
Santamouris, M. (2015) · Science of The Total Environment · doi:10.1016/j.scitotenv.2015.01.060 · Cited by 633
The domestic garden – Its contribution to urban green infrastructure
Cameron, R. W. F., Blanuša, T., Taylor, J. E., Salisbury, A., Halstead, A. J., Henricot, B., & Thompson, K. (2012) · Urban Forestry & Urban Greening · doi:10.1016/j.ufug.2012.01.002 · Cited by 593
MODIS detected surface urban heat islands and sinks: Global locations and controls
Clinton, N., & Gong, P. (2013) · Remote Sensing of Environment · doi:10.1016/j.rse.2013.03.008 · Cited by 521
Chakraborty, T., & Lee, X. (2019) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2018.09.015 · Cited by 507
Schwarz, N., Lautenbach, S., & Seppelt, R. (2011) · Remote Sensing of Environment · doi:10.1016/j.rse.2011.07.003 · Cited by 488
The future of urban agriculture and biodiversity-ecosystem services: Challenges and next steps
Lin, B. B., Philpott, S. M., & Jha, S. (2015) · Basic and Applied Ecology · doi:10.1016/j.baae.2015.01.005 · Cited by 488
Traits of trees for cooling urban heat islands: A meta-analysis
Rahman, M. A., Stratopoulos, L. M. F., Moser-Reischl, A., Zölch, T., Häberle, K.-H., Rötzer, T., Pretzsch, H., & Pauleit, S. (2020) · Building and Environment · doi:10.1016/j.buildenv.2019.106606 · Cited by 471
Remote sensing land surface temperature for meteorology and climatology: a review
Tomlinson, C. J., Chapman, L., Thornes, J. E., & Baker, C. (2011) · Meteorological Applications · doi:10.1002/met.287 · Cited by 439
The urban heat island effect and city contiguity
Debbage, N., & Shepherd, J. M. (2015) · Computers, Environment and Urban Systems · doi:10.1016/j.compenvurbsys.2015.08.002 · Cited by 438
Aflaki, A., Mirnezhad, M., Ghaffarianhoseini, A., Ghaffarianhoseini, A., Omrany, H., Wang, Z.-H., & Akbari, H. (2017) · Cities · doi:10.1016/j.cities.2016.09.003 · Cited by 432
Tomlinson, C. J., Chapman, L., Thornes, J. E., & Baker, C. J. (2011) · International Journal of Health Geographics · doi:10.1186/1476-072x-10-42 · Cited by 403
Schwarz, N., Schlink, U., Franck, U., & Großmann, K. (2012) · Ecological Indicators · doi:10.1016/j.ecolind.2012.01.001 · Cited by 391
Demuzere, M., Kittner, J., Martilli, A., Mills, G., Moede, C., Stewart, I. D., van Vliet, J., & Bechtel, B. (2022) · Earth System Science Data · doi:10.5194/essd-14-3835-2022 · Cited by 388
Self-citationQian, Y., Chakraborty, T. C., Li, J., Li, D., He, C., Sarangi, C., Chen, F., Yang, X., & Leung, L. R. (2022) · Advances in Atmospheric Sciences · doi:10.1007/s00376-021-1371-9 · Cited by 362
Haase, D., Schwarz, N., Strohbach, M., Kroll, F., & Seppelt, R. (2012) · Ecology and Society · doi:10.5751/es-04853-170322 · Cited by 354
Coseo, P., & Larsen, L. (2014) · Landscape and Urban Planning · doi:10.1016/j.landurbplan.2014.02.019 · Cited by 352
SUHI analysis using Local Climate Zones—A comparison of 50 cities
Bechtel, B., Demuzere, M., Mills, G., Zhan, W., Sismanidis, P., Small, C., & Voogt, J. (2019) · Urban Climate · doi:10.1016/j.uclim.2019.01.005 · Cited by 346
Steeneveld, G. J., Koopmans, S., Heusinkveld, B. G., van Hove, L. W. A., & Holtslag, A. A. M. (2011) · Journal of Geophysical Research · doi:10.1029/2011jd015988 · Cited by 330
Changes in Impacts of Climate Extremes: Human Systems and Ecosystems
Handmer, J., Honda, Y., Kundzewicz, Z. W., Arnell, N., Benito, G., Hatfield, J., Mohamed, I. F., Peduzzi, P., Wu, S., Sherstyukov, B., et al. (2012) · Managing the Risks of Extreme Events and Disasters to Advance Climate Change Adaptation · doi:10.1017/cbo9781139177245.007 · Cited by 321
Venter, Z. S., Chakraborty, T., & Lee, X. (2021) · Science Advances · doi:10.1126/sciadv.abb9569 · Cited by 317
Berger, C., Rosentreter, J., Voltersen, M., Baumgart, C., Schmullius, C., & Hese, S. (2017) · Remote Sensing of Environment · doi:10.1016/j.rse.2017.02.020 · Cited by 312
A new method to quantify surface urban heat island intensity
Li, H., Zhou, Y., Li, X., Meng, L., Wang, X., Wu, S., & Sodoudi, S. (2018) · Science of The Total Environment · doi:10.1016/j.scitotenv.2017.11.360 · Cited by 307
Regulating the damaged thermostat of the cities—Status, impacts and mitigation challenges
Santamouris, M. (2015) · Energy and Buildings · doi:10.1016/j.enbuild.2015.01.027 · Cited by 298
Increased heat risk in wet climate induced by urban humid heat
Zhang, K., Cao, C., Chu, H., Zhao, L., Zhao, J., & Lee, X. (2023) · Nature · doi:10.1038/s41586-023-05911-1 · Cited by 295
Park, J., Kim, J.-H., Lee, D. K., Park, C. Y., & Jeong, S. G. (2017) · Urban Forestry & Urban Greening · doi:10.1016/j.ufug.2016.12.005 · Cited by 276
Saaroni, H., Amorim, J. H., Hiemstra, J. A., & Pearlmutter, D. (2018) · Urban Climate · doi:10.1016/j.uclim.2018.02.001 · Cited by 276
Cai, Z., Han, G., & Chen, M. (2018) · Sustainable Cities and Society · doi:10.1016/j.scs.2018.02.033 · Cited by 269
Vujovic, S., Haddad, B., Karaky, H., Sebaibi, N., & Boutouil, M. (2021) · CivilEng · doi:10.3390/civileng2020026 · Cited by 263
Chakraborty, T., Hsu, A., Manya, D., & Sheriff, G. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.07.021 · Cited by 201
Weber, N., Haase, D., & Franck, U. (2014) · Science of The Total Environment · doi:10.1016/j.scitotenv.2014.06.144 · Cited by 69
Beele, E., Reyniers, M., Aerts, R., & Somers, B. (2022) · Earth System Science Data Discussions · doi:10.5194/essd-2022-113 · Cited by 44
Conceptualising a resilient cooling system: A socio-technical approach
Miller, W., Machard, A., Bozonnet, E., Yoon, N., Qi, D., Zhang, C., Liu, A., Sengupta, A., Akander, J., Hayati, A., et al. (2021) · City and Environment Interactions · doi:10.1016/j.cacint.2021.100065 · Cited by 28
Metadata
- Authors
- Stewart, I. D.
- Venue
- International Journal of Climatology
- Publisher
- Wiley
- Published
- 2011-01-20
- Volume
- 31
- Issue
- 2
- Pages
- 200-217
- ISSN
- 0899-8418 (ISSN-L)
- 1097-0088
- OpenAlex
- W2075784877
- Cited by
- 752
- References
- 20
- FWCI
- 1.97
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.