The DOI matches its Crossref record; 136 of the 136 references it cites were found in a registry or an index.
Key issues in rigorous accuracy assessment of land cover products
Open accessAbstract
Abstract Accuracy assessment and land cover mapping have been inexorably linked throughout the first 50 years of publication of Remote Sensing of Environment. The earliest developers of land-cover maps recognized the importance of evaluating the quality of their maps, and the methods and reporting format of these early accuracy assessments included features that would be familiar to practitioners today. Specifically, practitioners have consistently recognized the importance of obtaining high quality reference data to which the map is compared, the need for sampling to collect these reference data, and the role of an error matrix and accuracy measures derived from the error matrix to summarize the accuracy information. Over the past half century these techniques have undergone refinements to place accuracy assessment on a more scientifically credible footing. We describe the current status of accuracy assessment that has emerged from nearly 50 years of practice and identify opportunities for future advances. The article is organized by the three major components of accuracy assessment, the sampling design, response design, and analysis, focusing on good practice methodology that contributes to a rigorous, informative, and honest assessment. The long history of research and applications underlying the current practice of accuracy assessment has advanced the field to a mature state. However, documentation of accuracy assessment methods needs to be improved to enhance reproducibility and transparency, and improved methods are required to address new challenges created by advanced technology that has expanded the capacity to map land cover extensively in space and intensively in time.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The value of the world's ecosystem services and natural capital
Costanza, R., d'Arge, R., de Groot, R., Farber, S., Grasso, M., Hannon, B., Limburg, K., Naeem, S., O'Neill, R. V., Paruelo, J., et al. (1997) · Nature · doi:10.1038/387253a0 · Cited by 22,585
Statistical Methods for Rates and Proportions
Fleiss, J. L., Levin, B., & Paik, M. C. (2003) · Wiley Series in Probability and Statistics · doi:10.1002/0471445428 · Cited by 18,646
Google Earth Engine: Planetary-scale geospatial analysis for everyone
Gorelick, N., Hancher, M., Dixon, M., Ilyushchenko, S., Thau, D., & Moore, R. (2017) · Remote Sensing of Environment · doi:10.1016/j.rse.2017.06.031 · Cited by 14,719
Global Consequences of Land Use
Foley, J. A., DeFries, R., Asner, G. P., Barford, C., Bonan, G., Carpenter, S. R., Chapin, F. S., Coe, M. T., Daily, G. C., Gibbs, H. K., et al. (2005) · Science · doi:10.1126/science.1111772 · Cited by 13,272
Human domination of Earth’s ecosystems
Vitousek, P. M., Mooney, H. A., Lubchenco, J., & Melillo, J. M. (1997) · Science · doi:10.1126/science.277.5325.494 · Cited by 9,086
A review of assessing the accuracy of classifications of remotely sensed data
Congalton, R. G. (1991) · Remote Sensing of Environment · doi:10.1016/0034-4257(91)90048-b · Cited by 7,724
Status of land cover classification accuracy assessment
Foody, G. M. (2002) · Remote Sensing of Environment · doi:10.1016/s0034-4257(01)00295-4 · Cited by 4,580
Self-citationConsequences of changing biodiversity
Chapin III, F. S., Zavaleta, E. S., Eviner, V. T., Naylor, R. L., Vitousek, P. M., Reynolds, H. L., Hooper, D. U., Lavorel, S., Sala, O. E., Hobbie, S. E., et al. (2000) · Nature · doi:10.1038/35012241 · Cited by 4,282
Review Article Digital change detection techniques using remotely-sensed data
SINGH, A. (1989) · International Journal of Remote Sensing · doi:10.1080/01431168908903939 · Cited by 3,849
Assessing the Accuracy of Remotely Sensed Data: Principles and Practices
Congalton, R., & Green, K. (1998) · Mapping Science · doi:10.1201/9781420048568 · Cited by 3,424
A survey of image classification methods and techniques for improving classification performance
Lu, D., & Weng, Q. (2007) · International Journal of Remote Sensing · doi:10.1080/01431160600746456 · Cited by 3,402
A manifesto for reproducible science
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0021 · Cited by 3,397
Model Assisted Survey Sampling
Särndal, C.-E., Swensson, B., & Wretman, J. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-4378-6 · Cited by 3,386
Good practices for estimating area and assessing accuracy of land change
Olofsson, P., Foody, G. M., Herold, M., Stehman, S. V., Woodcock, C. E., & Wulder, M. A. (2014) · Remote Sensing of Environment · doi:10.1016/j.rse.2014.02.015 · Cited by 3,078
Self-citationAssessing the Accuracy of Remotely Sensed Data: Principles and Practices
Foody, G. (2010) · The Photogrammetric Record · doi:10.1111/j.1477-9730.2010.00574_2.x · Cited by 2,806
Self-citationDevelopment of a global land cover characteristics database and IGBP DISCover from 1 km AVHRR data
Loveland, T. R., Reed, B. C., Brown, J. F., Ohlen, D. O., Zhu, Z., Yang, L., & Merchant, J. W. (2000) · International Journal of Remote Sensing · doi:10.1080/014311600210191 · Cited by 2,580
The emergence of land change science for global environmental change and sustainability
Turner, B. L., Lambin, E. F., & Reenberg, A. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0704119104 · Cited by 2,216
Death to Kappa: birth of quantity disagreement and allocation disagreement for accuracy assessment
Pontius, R. G., & Millones, M. (2011) · International Journal of Remote Sensing · doi:10.1080/01431161.2011.552923 · Cited by 2,046
Farming the planet: 1. Geographic distribution of global agricultural lands in the year 2000
Ramankutty, N., Evan, A. T., Monfreda, C., & Foley, J. A. (2008) · Global Biogeochemical Cycles · doi:10.1029/2007gb002952 · Cited by 1,942
Discrete Multivariate Analysis
(1977) · Technometrics · doi:10.1080/00401706.1977.10489605 · Cited by 1,757
Selecting and interpreting measures of thematic classification accuracy
Stehman, S. V. (1997) · Remote Sensing of Environment · doi:10.1016/s0034-4257(97)00083-7 · Cited by 1,729
Self-citationGong, P., Wang, J., Yu, L., Zhao, Y., Zhao, Y., Liang, L., Niu, Z., Huang, X., Fu, H., Liu, S., et al. (2013) · International Journal of Remote Sensing · doi:10.1080/01431161.2012.748992 · Cited by 1,687
Geographic Object-Based Image Analysis – Towards a new paradigm
Blaschke, T., Hay, G. J., Kelly, M., Lang, S., Hofmann, P., Addink, E., Queiroz Feitosa, R., van der Meer, F., van der Werff, H., van Coillie, F., et al. (2014) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2013.09.014 · Cited by 1,647
Spatially Balanced Sampling of Natural Resources
Stevens, D. L., & Olsen, A. R. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000000250 · Cited by 1,294
Discrete Multivariate Analysis.
Gokhale, D. V., Bishop, Y. M. M., Fienberg, S. E., & Holland, P. W. (1976) · Biometrics · doi:10.2307/2529528 · Cited by 1,287
Monitoring land-cover changes: A comparison of change detection techniques
Mas, J.-F. (1999) · International Journal of Remote Sensing · doi:10.1080/014311699213659 · Cited by 1,065
Foody, G. M. (2004) · Photogrammetric Engineering & Remote Sensing · doi:10.14358/pers.70.5.627 · Cited by 1,065
Self-citationOlofsson, P., Foody, G. M., Stehman, S. V., & Woodcock, C. E. (2013) · Remote Sensing of Environment · doi:10.1016/j.rse.2012.10.031 · Cited by 1,029
Self-citationGeospatial big data handling theory and methods: A review and research challenges
Li, S., Dragicevic, S., Castro, F. A., Sester, M., Winter, S., Coltekin, A., Pettit, C., Jiang, B., Haworth, J., Stein, A., et al. (2016) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2015.10.012 · Cited by 749
Classification Methods for Remotely Sensed Data
Mather, P., & Tso, B. (2001) · CRC Press eBooks · doi:10.1201/b12554 · Cited by 719
Design and Analysis for Thematic Map Accuracy Assessment
Stehman, S. V., & Czaplewski, R. L. (1998) · Remote Sensing of Environment · doi:10.1016/s0034-4257(98)00010-8 · Cited by 710
Self-citationCongalton, R. G., Oderwald, R. G., & Mead, R. A. (1983) · University of New Hampshire Scholars Repository (University of New Hampshire at Manchester) · Cited by 680
Khatami, R., Mountrakis, G., & Stehman, S. V. (2016) · Remote Sensing of Environment · doi:10.1016/j.rse.2016.02.028 · Cited by 599
Self-citationHerold, M., Mayaux, P., Woodcock, C. E., Baccini, A., & Schmullius, C. (2008) · Remote Sensing of Environment · doi:10.1016/j.rse.2007.11.013 · Cited by 569
Cohen, W. B., Yang, Z., & Kennedy, R. (2010) · Remote Sensing of Environment · doi:10.1016/j.rse.2010.07.010 · Cited by 569
Fuzzy set approach to assessing similarity of categorical maps
Hagen, A. (2003) · International Journal of Geographical Information Science · doi:10.1080/13658810210157822 · Cited by 501
FOODY, G. M. (1996) · International Journal of Remote Sensing · doi:10.1080/01431169608948706 · Cited by 491
Self-citationThe ESA Climate Change Initiative: Satellite Data Records for Essential Climate Variables
Hollmann, R., Merchant, C. J., Saunders, R., Downy, C., Buchwitz, M., Cazenave, A., Chuvieco, E., Defourny, P., de Leeuw, G., Forsberg, R., et al. (2013) · Bulletin of the American Meteorological Society · doi:10.1175/bams-d-11-00254.1 · Cited by 481
Comparative assessment of the measures of thematic classification accuracy
Liu, C., Frazier, P., & Kumar, L. (2007) · Remote Sensing of Environment · doi:10.1016/j.rse.2006.10.010 · Cited by 465
See, L., Mooney, P., Foody, G., Bastin, L., Comber, A., Estima, J., Fritz, S., Kerle, N., Jiang, B., Laakso, M., et al. (2016) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi5050055 · Cited by 433
Self-citationWulder, M. A., Coops, N. C., Roy, D. P., White, J. C., & Hermosilla, T. (2018) · International Journal of Remote Sensing · doi:10.1080/01431161.2018.1452075 · Cited by 418
Sampling for validation of digital soil maps
Brus, D. J., Kempen, B., & Heuvelink, G. B. M. (2011) · European Journal of Soil Science · doi:10.1111/j.1365-2389.2011.01364.x · Cited by 415
Foody, G. M., & Mathur, A. (2006) · Remote Sensing of Environment · doi:10.1016/j.rse.2006.04.001 · Cited by 410
Self-citationSampling designs for accuracy assessment of land cover
Stehman, S. V. (2009) · International Journal of Remote Sensing · doi:10.1080/01431160903131000 · Cited by 407
Self-citationHarshness in image classification accuracy assessment
Foody, G. M. (2008) · International Journal of Remote Sensing · doi:10.1080/01431160701442120 · Cited by 357
Self-citationAccuracy assessment of NLCD 2006 land cover and impervious surface
Wickham, J. D., Stehman, S. V., Gass, L., Dewitz, J., Fry, J. A., & Wade, T. G. (2013) · Remote Sensing of Environment · doi:10.1016/j.rse.2012.12.001 · Cited by 343
Self-citationGeo-Wiki.Org: The Use of Crowdsourcing to Improve Global Land Cover
Fritz, S., McCallum, I., Schill, C., Perger, C., Grillmayer, R., Achard, F., Kraxner, F., & Obersteiner, M. (2009) · Remote Sensing · doi:10.3390/rs1030345 · Cited by 342
Assessing the accuracy of land cover change with imperfect ground reference data
Foody, G. M. (2010) · Remote Sensing of Environment · doi:10.1016/j.rse.2010.05.003 · Cited by 333
Self-citationA solution to the single-question crowd wisdom problem
Prelec, D., Seung, H. S., & McCoy, J. (2017) · Nature · doi:10.1038/nature21054 · Cited by 314
Theory and methods for accuracy assessment of thematic maps using fuzzy sets
Gopal, S., & Woodcock, C. E. (1994) · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · Cited by 312
Validation of the global land cover 2000 map
Mayaux, P., Eva, H., Gallego, J., Strahler, A. H., Herold, M., Agrawal, S., Naumov, S., De Miranda, E. E., Di Bella, C. M., Ordoyne, C., et al. (2006) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2006.864370 · Cited by 299
Remote sensing and land cover area estimation
Gallego, F. J. (2004) · International Journal of Remote Sensing · doi:10.1080/01431160310001619607 · Cited by 297
Mapping forest change using stacked generalization: An ensemble approach
Healey, S. P., Cohen, W. B., Yang, Z., Kenneth Brewer, C., Brooks, E. B., Gorelick, N., Hernandez, A. J., Huang, C., Joseph Hughes, M., Kennedy, R. E., et al. (2018) · Remote Sensing of Environment · doi:10.1016/j.rse.2017.09.029 · Cited by 287
Self-citationSong, X.-P., Potapov, P. V., Krylov, A., King, L., Di Bella, C. M., Hudson, A., Khan, A., Adusei, B., Stehman, S. V., & Hansen, M. C. (2017) · Remote Sensing of Environment · doi:10.1016/j.rse.2017.01.008 · Cited by 277
Self-citationA comparison of resampling methods for remote sensing classification and accuracy assessment
Lyons, M. B., Keith, D. A., Phinn, S. R., Mason, T. J., & Elith, J. (2018) · Remote Sensing of Environment · doi:10.1016/j.rse.2018.02.026 · Cited by 275
Collect Earth: Land Use and Land Cover Assessment through Augmented Visual Interpretation
Bey, A., Sánchez-Paus Díaz, A., Maniatis, D., Marchi, G., Mollicone, D., Ricci, S., Bastin, J.-F., Moore, R., Federici, S., Rezende, M., et al. (2016) · Remote Sensing · doi:10.3390/rs8100807 · Cited by 268
Stehman, S. V. (2014) · International Journal of Remote Sensing · doi:10.1080/01431161.2014.930207 · Cited by 255
Self-citationSample size determination for image classification accuracy assessment and comparison
Foody, G. M. (2009) · International Journal of Remote Sensing · doi:10.1080/01431160903130937 · Cited by 248
The SAGE Handbook of Remote Sensing
Warner, T. A., Nellis, M. D., & Foody, G. M. (2009) · Sage eBooks · doi:10.4135/9780857021052 · Cited by 239
Self-citationSpatial analysis of remote sensing image classification accuracy
Comber, A., Fisher, P., Brunsdon, C., & Khmag, A. (2012) · Remote Sensing of Environment · doi:10.1016/j.rse.2012.09.005 · Cited by 237
A generalized confusion matrix for assessing area estimates from remotely sensed data
Lewis, H. G., & Brown, M. (2001) · International Journal of Remote Sensing · doi:10.1080/01431160152558332 · Cited by 236
Foody, G. M. (2009) · Remote Sensing of Environment · doi:10.1016/j.rse.2009.03.014 · Cited by 231
Self-citationThematic accuracy assessment of the 2011 National Land Cover Database (NLCD)
Wickham, J., Stehman, S. V., Gass, L., Dewitz, J. A., Sorenson, D. G., Granneman, B. J., Poss, R. V., & Baer, L. A. (2017) · Remote Sensing of Environment · doi:10.1016/j.rse.2016.12.026 · Cited by 225
Self-citationFuzzy set theory and thematic maps: accuracy assessment and area estimation
Woodcock, C. E., & Gopal, S. (2000) · International Journal of Geographical Information Science · doi:10.1080/136588100240895 · Cited by 223
Towards a common validation sample set for global land-cover mapping
Zhao, Y., Gong, P., Yu, L., Hu, L., Li, X., Li, C., Zhang, H., Zheng, Y., Wang, J., Zhao, Y., et al. (2014) · International Journal of Remote Sensing · doi:10.1080/01431161.2014.930202 · Cited by 212
Sources of error in accuracy assessment of thematic land-cover maps in the Brazilian Amazon
Powell, R. L., Matzke, N., de Souza, C., Clark, M., Numata, I., Hess, L. L., & Roberts, D. A. (2004) · Remote Sensing of Environment · doi:10.1016/j.rse.2003.12.007 · Cited by 212
Thematic accuracy of the NLCD 2001 land cover for the conterminous United States
Wickham, J. D., Stehman, S. V., Fry, J. A., Smith, J. H., & Homer, C. G. (2010) · Remote Sensing of Environment · doi:10.1016/j.rse.2010.01.018 · Cited by 209
Self-citationYe, S., Pontius, R. G., & Rakshit, R. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2018.04.002 · Cited by 198
Aggregated knowledge from a small number of debates outperforms the wisdom of large crowds
Navajas, J., Niella, T., Garbulsky, G., Bahrami, B., & Sigman, M. (2018) · Nature Human Behaviour · doi:10.1038/s41562-017-0273-4 · Cited by 183
A global dataset of crowdsourced land cover and land use reference data
Fritz, S., See, L., Perger, C., McCallum, I., Schill, C., Schepaschenko, D., Duerauer, M., Karner, M., Dresel, C., Laso-Bayas, J.-C., et al. (2017) · Scientific Data · doi:10.1038/sdata.2017.75 · Cited by 177
Kaptué Tchuenté, A. T., Roujean, J.-L., & De Jong, S. M. (2011) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2010.11.005 · Cited by 175
A global land-cover validation data set, part I: fundamental design principles
Olofsson, P., Stehman, S. V., Woodcock, C. E., Sulla‐Menashe, D., Sibley, A. M., Newell, J. D., Friedl, M. A., & Herold, M. (2012) · International Journal of Remote Sensing · doi:10.1080/01431161.2012.674230 · Cited by 170
Self-citationPixels, blocks of pixels, and polygons: Choosing a spatial unit for thematic accuracy assessment
Stehman, S. V., & Wickham, J. D. (2011) · Remote Sensing of Environment · doi:10.1016/j.rse.2011.06.007 · Cited by 166
Self-citationMethodology for the assessment of new dichotomous diagnostic tests
Staquet, M., Rozencweig, M., Lee, Y. J., & Muggia, F. M. (1981) · Journal of Chronic Diseases · doi:10.1016/0021-9681(81)90059-x · Cited by 163
Estimating area from an accuracy assessment error matrix
Stehman, S. V. (2013) · Remote Sensing of Environment · doi:10.1016/j.rse.2013.01.016 · Cited by 163
Self-citationBasic probability sampling designs for thematic map accuracy assessment
Stehman, S. V. (1999) · International Journal of Remote Sensing · doi:10.1080/014311699212100 · Cited by 161
Self-citationEstimation and Mapping of Misclassification Probabilities for Thematic Land Cover Maps
Steele, B. M., Winne, J. C., & Redmond, R. L. (1998) · Remote Sensing of Environment · doi:10.1016/s0034-4257(98)00061-3 · Cited by 159
Model-free estimation from spatial samples: A reappraisal of classical sampling theory
de Gruijter, J. J., & ter Braak, C. J. F. (1990) · Mathematical Geology · doi:10.1007/bf00890327 · Cited by 156
Comber, A., Fisher, P., & Wadsworth, R. A. (2005) · Environment and Planning B Planning and Design · doi:10.1068/b31135 · Cited by 153
Statistical Rigor and Practical Utility in Thematic Map Accuracy Assessment
Stehman, S. V. (2001) · Photogrammetric Engineering & Remote Sensing · Cited by 152
Self-citationEvaluation of SVM, RVM and SMLR for Accurate Image Classification With Limited Ground Data
Pal, M., & Foody, G. M. (2012) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2012.2215310 · Cited by 142
Self-citationComber, A., See, L., Fritz, S., van der Velde, M., Perger, C., & Foody, G. M. (2013) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2012.11.002 · Cited by 141
Self-citationDorn, H., Törnros, T., & Zipf, A. (2015) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi4031657 · Cited by 139
Practical Implications of Design-Based Sampling Inference for Thematic Map Accuracy Assessment
Stehman, S. V. (2000) · Remote Sensing of Environment · doi:10.1016/s0034-4257(99)00090-5 · Cited by 135
Self-citationSatellite image-based maps: Scientific inference or pretty pictures?
McRoberts, R. E. (2010) · Remote Sensing of Environment · doi:10.1016/j.rse.2010.10.013 · Cited by 133
Usability of VGI for validation of land cover maps
Fonte, C. C., Bastin, L., See, L., Foody, G. M., & Lupia, F. (2015) · International Journal of Geographical Information Systems · doi:10.1080/13658816.2015.1018266 · Cited by 132
Self-citationBoschetti, L., Stehman, S. V., & Roy, D. P. (2016) · Remote Sensing of Environment · doi:10.1016/j.rse.2016.09.016 · Cited by 131
Self-citationArévalo, P., Olofsson, P., & Woodcock, C. E. (2019) · Remote Sensing of Environment · doi:10.1016/j.rse.2019.01.013 · Cited by 130
Sampling designs to test land-use map accuracy
HAY, A. M. (1979) · Cited by 128
Spatial uncertainty in ecology : implications for remote sensing and GIS applications
Hunsaker, C. T. (2001) · Cited by 124
Wulder, M. A., Franklin, S. E., White, J. C., Linke, J., & Magnussen, S. (2005) · International Journal of Remote Sensing · doi:10.1080/01431160500185284 · Cited by 123
A model-based approach to estimating forest area
McRoberts, R. E. (2006) · Remote Sensing of Environment · doi:10.1016/j.rse.2006.03.005 · Cited by 118
Good Practices for Object-Based Accuracy Assessment
Radoux, J., & Bogaert, P. (2017) · Remote Sensing · doi:10.3390/rs9070646 · Cited by 114
Stehman, S. V., Olofsson, P., Woodcock, C. E., Herold, M., & Friedl, M. A. (2012) · International Journal of Remote Sensing · doi:10.1080/01431161.2012.695092 · Cited by 112
Self-citationMeasures of spatio-temporal accuracy for time series land cover data
Tsutsumida, N., & Comber, A. (2015) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2015.04.018 · Cited by 105
Foody, G. M., Pal, M., Rocchini, D., Garzón‐López, C. X., & Bastin, L. (2016) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi5110199 · Cited by 105
Self-citationPotapov, P. V., Dempewolf, J., Talero, Y., Hansen, M. C., Stehman, S. V., Vargas, C., Rojas, E., Castillo, D. C., Mendoza, E., Calderón, A., et al. (2014) · Environmental Research Letters · doi:10.1088/1748-9326/9/12/124012 · Cited by 103
Self-citationLesiv, M., See, L., Bayas, J. C. L., Sturn, T., Schepaschenko, D. G., Karner, M., Moorthy, I., McCallum, I., & Fritz, S. (2018) · Land · doi:10.3390/land7040118 · Cited by 97
Assessing fitness for use: the expected value of spatial data sets
de Bruin, S., Bregt, A. K., & van de Ven, M. (2001) · International Journal of Geographical Information Systems · doi:10.1080/13658810110053116 · Cited by 93
McRoberts, R. E., Stehman, S. V., Liknes, G. C., Næsset, E., Sannier, C., & Walters, B. F. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2018.06.002 · Cited by 89
Self-citationInterpreting the change detection error matrix
van Oort, P. A. J. (2006) · Remote Sensing of Environment · doi:10.1016/j.rse.2006.10.012 · Cited by 85
Mapping per-pixel predicted accuracy of classified remote sensing images
Khatami, R., Mountrakis, G., & Stehman, S. V. (2017) · Remote Sensing of Environment · doi:10.1016/j.rse.2017.01.025 · Cited by 85
Self-citationFoody, G. M., See, L., Fritz, S., van der Velde, M., Perger, C., Schill, C., Boyd, D. S., & Comber, A. (2014) · The Cartographic Journal · doi:10.1080/00087041.2015.1108658 · Cited by 82
Self-citationDeveloping and applying a multi-purpose land cover validation dataset for Africa
Tsendbazar, N., Herold, M., de Bruin, S., Lesiv, M., Fritz, S., Kerchove, R. V. D., Buchhorn, M., Duerauer, M., Szantoi, Z., & Pekel, J. (2018) · Remote Sensing of Environment · doi:10.1016/j.rse.2018.10.025 · Cited by 79
Validating land cover maps with Degree Confluence Project information
Iwao, K., Nishida, K., Kinoshita, T., & Yamagata, Y. (2006) · Geophysical Research Letters · doi:10.1029/2006gl027768 · Cited by 76
Stratification and sample allocation for reference burned area data
Padilla, M., Olofsson, P., Stehman, S. V., Tansey, K. J., & Chuvieco, E. (2017) · Remote Sensing of Environment · doi:10.1016/j.rse.2017.06.041 · Cited by 75
Self-citationStehman, S. V. (2009) · Remote Sensing of Environment · doi:10.1016/j.rse.2009.07.006 · Cited by 73
Self-citationTsendbazar, N., de Bruin, S., Mora, B., Schouten, L., & Herold, M. (2015) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2015.08.009 · Cited by 72
Crowdsourcing In-Situ Data on Land Cover and Land Use Using Gamification and Mobile Technology
Bayas, J. C. L., See, L., Fritz, S., Sturn, T., Perger, C., Dürauer, M., Karner, M., Moorthy, I., Schepaschenko, D. G., Domian, D., et al. (2016) · Remote Sensing · doi:10.3390/rs8110905 · Cited by 72
Foody, G. M. (2015) · Ecological Economics · doi:10.1016/j.ecolecon.2015.01.003 · Cited by 69
Self-citationUsing Volunteered Data in Land Cover Map Validation: Mapping West African Forests
Foody, G. M., & Boyd, D. S. (2013) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2013.2250257 · Cited by 66
Self-citationThe impact of imperfect ground reference data on the accuracy of land cover change estimation
Foody, G. M. (2009) · International Journal of Remote Sensing · doi:10.1080/01431160902755346 · Cited by 61
Self-citationStehman, S. V. (2005) · Remote Sensing of Environment · doi:10.1016/j.rse.2005.04.002 · Cited by 59
Self-citationComparing thematic maps based on map value
Stehman, S. V. (1999) · International Journal of Remote Sensing · doi:10.1080/014311699212065 · Cited by 59
Self-citationSpatially Balanced Sampling: A Review and A Reappraisal
Benedetti, R., Piersimoni, F., & Postiglione, P. (2017) · International Statistical Review · doi:10.1111/insr.12216 · Cited by 58
Estes, L. D., Chen, P., Debats, S. R., Evans, T. P., Ferreira, S., Kuemmerle, T., Ragazzo, G., Sheffield, J., Wolf, A., Wood, E. F., et al. (2017) · Global Change Biology · doi:10.1111/gcb.13904 · Cited by 57
Statistical inference for remote sensing-based estimates of net deforestation
McRoberts, R. E., & Walters, B. F. (2012) · Remote Sensing of Environment · doi:10.1016/j.rse.2012.05.011 · Cited by 54
Stehman, S. V., Fonte, C. C., Foody, G. M., & See, L. (2018) · Remote Sensing of Environment · doi:10.1016/j.rse.2018.04.014 · Cited by 51
Self-citationA Critical Evaluation of the Normalized Error Matrix in Map Accuracy Assessment
Stehman, S. V. (2004) · Photogrammetric Engineering & Remote Sensing · doi:10.14358/pers.70.6.743 · Cited by 46
Self-citationLACO-Wiki: A New Online Land Cover Validation Tool Demonstrated Using GlobeLand30 for Kenya
See, L., Bayas, J. C. L., Schepaschenko, D. G., Perger, C., Dresel, C., MAUS, V. W., Salk, C. F., Weichselbaum, J., Lesiv, M., McCallum, I., et al. (2017) · Remote Sensing · doi:10.3390/rs9070754 · Cited by 45
Conflation of expert and crowd reference data to validate global binary thematic maps
Waldner, F., Schucknecht, A., Lesiv, M., Gallego, J., See, L., Pérez-Hoyos, A., d’Andrimont, R., Maet, T. D., Bayas, J. C. L., Fritz, S., et al. (2018) · Remote Sensing of Environment · doi:10.1016/j.rse.2018.10.039 · Cited by 45
Olofsson, P., Stephen, V. S., Curtis, E. W., et al. (2012) · International Journal of Remote Sensing · Cited by 44
Linke, J., Fortin, M., Courtenay, S. C., & Cormier, R. (2016) · Remote Sensing of Environment · doi:10.1016/j.rse.2016.10.040 · Cited by 37
Fattorini, L., Corona, P., Chirici, G., & Pagliarella, M. C. (2015) · Environmetrics · doi:10.1002/env.2332 · Cited by 33
Foody, G. M. (2011) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2011.2174156 · Cited by 30
Self-citationStehman, S. V., & Selkowitz, D. J. (2010) · International Journal of Remote Sensing · doi:10.1080/01431160902927945 · Cited by 30
Self-citationAn accuracy assessment of forest disturbance mapping in the western Great Lakes
Zimmerman, P. L., Housman, I. W., Perry, C. H., Chastain, R. A., Webb, J., & Finco, M. V. (2012) · Remote Sensing of Environment · doi:10.1016/j.rse.2012.09.017 · Cited by 28
Foody, G. M., See, L., Fritz, S., Moorthy, I., Perger, C., Schill, C., & Boyd, D. S. (2018) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi7030080 · Cited by 28
Self-citationToward estimation of map accuracy without a probability test sample
Steele, B. M., Patterson, D. A., & Redmond, R. L. (2003) · Environmental and Ecological Statistics · doi:10.1023/a:1025111108050 · Cited by 23
Pla, M., Duane, A., & Brotons, L. (2017) · Revista de teledetección: Revista de la Asociación Española de Teledetección · doi:10.4995/raet.2017.7140 · Cited by 21
Fine Spatial Resolution Optical Sensors
Toutin, T. (2013) · Sage eBooks · doi:10.4135/9780857021052.n8 · Cited by 20
Stehman, S. V. (2006) · Journal of Geographical Systems · doi:10.1007/s10109-006-0022-0 · Cited by 19
Self-citationThe efficiency of sampling very high resolution images for area estimation in the European Union
Gallego, F. J. (2011) · International Journal of Remote Sensing · doi:10.1080/01431161.2011.602993 · Cited by 19
Gallego, F. J., & Stibig, H. J. (2012) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2012.03.003 · Cited by 18
Badjana, H. M., Olofsson, P., Woodcock, C. E., Helmschrot, J., Wala, K., & Akpagana, K. (2017) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2017.07.006 · Cited by 18
Validation of GIS layers in the EU: getting adapted to available reference data
Gallego, F. J. (2011) · International Journal of Digital Earth · doi:10.1080/17538947.2010.512746 · Cited by 15
Cited by
Dynamic world, near real-time global 10 m land use land cover mapping
Brown, C. F., Brumby, S. P., Guzder-Williams, B., Birch, T., Hyde, S. B., Mazzariello, J., Czerwinski, W., Pasquarella, V. J., Haertel, R., Ilyushchenko, S., et al. (2022) · Scientific Data · doi:10.1038/s41597-022-01307-4 · Cited by 1,154
Foody, G. M. (2020) · Remote Sensing of Environment · doi:10.1016/j.rse.2019.111630 · Cited by 665
Self-citationVenter, Z. S., Barton, D. N., Chakraborty, T., Simensen, T., & Singh, G. (2022) · Remote Sensing · doi:10.3390/rs14164101 · Cited by 380
Maxwell, A. E., Warner, T. A., & Guillén, L. A. (2021) · Remote Sensing · doi:10.3390/rs13132450 · Cited by 327
Global validation of the collection 6 MODIS burned area product
Boschetti, L., Roy, D. P., Giglio, L., Huang, H., Zubkova, M., & Humber, M. L. (2019) · Remote Sensing of Environment · doi:10.1016/j.rse.2019.111490 · Cited by 260
Metadata
- Authors
- Stehman, S. V., & Foody, G. M.
- Venue
- Remote Sensing of Environment
- Publisher
- Elsevier BV
- Published
- 2019-09
- Volume
- 231
- Pages
- 111199
- ISSN
- 0034-4257 (ISSN-L)
- OpenAlex
- W2953011380
- Cited by
- 651
- References
- 136
- FWCI
- 40.39
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.