The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Crowdsourcing, Citizen Science or Volunteered Geographic Information? The Current State of Crowdsourced Geographic Information
Open accessAbstract
Citizens are increasingly becoming an important source of geographic information, sometimes entering domains that had until recently been the exclusive realm of authoritative agencies. This activity has a very diverse character as it can, amongst other things, be active or passive, involve spatial or aspatial data and the data provided can be variable in terms of key attributes such as format, description and quality. Unsurprisingly, therefore, there are a variety of terms used to describe data arising from citizens. In this article, the expressions used to describe citizen sensing of geographic information are reviewed and their use over time explored, prior to categorizing them and highlighting key issues in the current state of the subject. The latter involved a review of ~100 Internet sites with particular focus on their thematic topic, the nature of the data and issues such as incentives for contributors. This review suggests that most sites involve active rather than passive contribution, with citizens typically motivated by the desire to aid a worthy cause, often receiving little training. As such, this article provides a snapshot of the role of citizens in crowdsourcing geographic information and a guide to the current status of this rapidly emerging and evolving subject.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mining association rules between sets of items in large databases
Agrawal, R., Imieliński, T., & Swami, A. (1993) · Proceedings of the 1993 ACM SIGMOD international conference on Management of data · doi:10.1145/170035.170072 · Cited by 14,907
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687
Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996
Citizens as sensors: the world of volunteered geography
Goodchild, M. F. (2007) · GeoJournal · doi:10.1007/s10708-007-9111-y · Cited by 4,522
Big data: a revolution that will transform how we live, work, and think
(2013) · Choice Reviews Online · doi:10.5860/choice.50-6804 · Cited by 3,630
Citizen Science: A Developing Tool for Expanding Science Knowledge and Scientific Literacy
Bonney, R., Cooper, C. B., Dickinson, J., Kelling, S., Phillips, T., Rosenberg, K. V., & Shirk, J. (2009) · BioScience · doi:10.1525/bio.2009.59.11.9 · Cited by 2,529
A new dawn for citizen science
Silvertown, J. (2009) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2009.03.017 · Cited by 2,183
Towards an integrated crowdsourcing definition
Estellés-Arolas, E., & González-Ladrón-de-Guevara, F. (2012) · Journal of Information Science · doi:10.1177/0165551512437638 · Cited by 1,858
Public Participation Geographic Information Systems: A Literature Review and Framework
Sieber, R. (2006) · Annals of the Association of American Geographers · doi:10.1111/j.1467-8306.2006.00702.x · Cited by 1,210
Citizen Science and Volunteered Geographic Information: Overview and Typology of Participation
Haklay, M. (2013) · Crowdsourcing Geographic Knowledge · doi:10.1007/978-94-007-4587-2_7 · Cited by 1,071
Elwood, S., Goodchild, M. F., & Sui, D. Z. (2012) · Annals of the Association of American Geographers · doi:10.1080/00045608.2011.595657 · Cited by 863
Assuring the quality of volunteered geographic information
Goodchild, M. F., & Li, L. (2012) · Spatial Statistics · doi:10.1016/j.spasta.2012.03.002 · Cited by 771
The history of public participation in ecological research
Miller-Rushing, A., Primack, R., & Bonney, R. (2012) · Frontiers in Ecology and the Environment · doi:10.1890/110278 · Cited by 589
Crowdsourcing Geographic Knowledge: Volunteered Geographic Information (VGI) in Theory and Practice
(2013) · Springer eBooks · doi:10.1007/978-94-007-4587-2 · Cited by 575
Harvesting ambient geospatial information from social media feeds
Stefanidis, A., Crooks, A., & Radzikowski, J. (2013) · GeoJournal · doi:10.1007/s10708-011-9438-2 · Cited by 565
Whittaker, J., McLennan, B., & Handmer, J. (2015) · International Journal of Disaster Risk Reduction · doi:10.1016/j.ijdrr.2015.07.010 · Cited by 542
Turner, A. (2006) · CERN Document Server (European Organization for Nuclear Research) · Cited by 539
#Earthquake: Twitter as a Distributed Sensor System
Crooks, A., Croitoru, A., Stefanidis, A., & Radzikowski, J. (2013) · Transactions in GIS · doi:10.1111/j.1467-9671.2012.01359.x · Cited by 469
Heipke, C. (2010) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2010.06.005 · Cited by 461
Bonney, R. E., Ballard, H. L., Jordan, R., McCallie, E., Phillips, T., Shirk, J., & Wilderman, C. C. (2009) · Cited by 448
A Comprehensive Framework for Intrinsic OpenStreetMap Quality Analysis
Barron, C., Neis, P., & Zipf, A. (2014) · Transactions in GIS · doi:10.1111/tgis.12073 · Cited by 411
Haklay, M. (., Basiouka, S., Antoniou, V., & Ather, A. (2010) · The Cartographic Journal · doi:10.1179/000870410x12911304958827 · Cited by 403
Quality Control in Crowdsourcing Systems: Issues and Directions
Allahbakhsh, M., Benatallah, B., Ignjatovic, A., Motahari-Nezhad, H. R., Bertino, E., & Dustdar, S. (2013) · IEEE Internet Computing · doi:10.1109/mic.2013.20 · Cited by 385
Crowdsourcing for climate and atmospheric sciences: current status and future potential
Muller, C. L., Chapman, L., Johnston, S., Kidd, C., Illingworth, S., Foody, G., Overeem, A., & Leigh, R. R. (2015) · International Journal of Climatology · doi:10.1002/joc.4210 · Cited by 372
Self-citationRules of Crowdsourcing: Models, Issues, and Systems of Control
Saxton, G. D., Oh, O., & Kishore, R. (2013) · Information Systems Management · doi:10.1080/10580530.2013.739883 · Cited by 340
Krumm, J., Davies, N., & Narayanaswami, C. (2008) · IEEE Pervasive Computing · doi:10.1109/mprv.2008.85 · Cited by 333
Neis, P., & Zielstra, D. (2014) · Future Internet · doi:10.3390/fi6010076 · Cited by 288
Neogeography and the Delusion of Democratisation
Haklay, M. (. (2013) · Environment and Planning A: Economy and Space · doi:10.1068/a45184 · Cited by 267
Developing a conceptual framework for visually-enabled geocollaboration
Maceachren, A. M., & Brewer, I. (2004) · International Journal of Geographical Information Science · doi:10.1080/13658810310001596094 · Cited by 207
Comparing the Quality of Crowdsourced Data Contributed by Expert and Non-Experts
See, L., Comber, A., Salk, C., Fritz, S., van der Velde, M., Perger, C., Schill, C., McCallum, I., Kraxner, F., & Obersteiner, M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0069958 · Cited by 191
Self-citationEuropean Handbook of Crowdsourced Geographic Information
Capineri, C. (2016) · Ubiquity Press eBooks · doi:10.5334/bax · Cited by 181
Citizen science on a smartphone: Participants’ motivations and learning
Land-Zandstra, A. M., Devilee, J. L. A., Snik, F., Buurmeijer, F., & van den Broek, J. M. (2016) · Public Understanding of Science · doi:10.1177/0963662515602406 · Cited by 180
Shneiderman, B. (2008) · Science · doi:10.1126/science.1153539 · Cited by 178
MEASURES AND INDICATORS OF VGI QUALITY: AN OVERVIEW
Antoniou, V., & Skopeliti, A. (2015) · ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences · doi:10.5194/isprsannals-ii-3-w5-345-2015 · Cited by 173
Neis, P., Zielstra, D., & Zipf, A. (2013) · Future Internet · doi:10.3390/fi5020282 · Cited by 164
Jiang, B., & Liu, X. (2011) · International Journal of Geographical Information Systems · doi:10.1080/13658816.2011.575074 · Cited by 153
Self-citationDorn, H., Törnros, T., & Zipf, A. (2015) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi4031657 · Cited by 139
A trust and reputation model for filtering and classifying knowledge about urban growth
Bishr, M., & Mantelas, L. A. (2008) · GeoJournal · doi:10.1007/s10708-008-9182-4 · Cited by 126
Harvey, F. (2012) · Springer eBooks · doi:10.1007/978-94-007-4587-2_3 · Cited by 105
Reed, J. T., Raddick, M. J., Lardner, A., & Carney, K. (2013) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2013.85 · Cited by 105
Usability of VGI for validation of land cover maps
Fonte, C. C., Bastin, L., See, L., Foody, G. M., & Lupia, F. (2015) · International Journal of Geographical Information Systems · doi:10.1080/13658816.2015.1018266 · Cited by 103
Self-citationGeospatial Information Bottom-Up: A Matter of Trust and Semantics
Bishr, M., & Kühn, W. (2007) · Lecture notes in geoinformation and cartography · doi:10.1007/978-3-540-72385-1_22 · Cited by 92
The Scale of VGI in Map Production: A Perspective on European National Mapping Agencies
Olteanu‐Raimond, A., Hart, G., Foody, G. M., Touya, G., Kellenberger, T., & Demetriou, D. (2016) · Transactions in GIS · doi:10.1111/tgis.12189 · Cited by 91
Self-citationCollaborative damage mapping for emergency response: the role of Cognitive Systems Engineering
Kerle, N., & Hoffman, R. R. (2013) · Natural hazards and earth system sciences · doi:10.5194/nhess-13-97-2013 · Cited by 90
Self-citationFoody, G. M., See, L., Fritz, S., van der Velde, M., Perger, C., Schill, C., Boyd, D. S., & Comber, A. (2014) · The Cartographic Journal · doi:10.1080/00087041.2015.1108658 · Cited by 82
Self-citationRevisiting Web Cartography in the United States: the Rise of User-Centered Design
Tsou, M. (2011) · Cartography and Geographic Information Science · doi:10.1559/15230406382250 · Cited by 82
Confronting the data-divide in a time of spatial turns and volunteered geographic information
Cinnamon, J., & Schuurman, N. (2012) · GeoJournal · doi:10.1007/s10708-012-9458-6 · Cited by 76
Towards Ubiquitous Cartography
Gärtner, G., Bennett, D. A., & Morita, T. (2007) · Cartography and Geographic Information Science · doi:10.1559/152304007782382963 · Cited by 73
Legal issues with volunteered geographic information
Scassa, T. (2012) · Canadian Geographies / Géographies canadiennes · doi:10.1111/j.1541-0064.2012.00444.x · Cited by 72
Understanding Science 2.0: Crowdsourcing and Open Innovation in the Scientific Method
Bücheler, T., & Sieg, J. H. (2011) · Procedia Computer Science · doi:10.1016/j.procs.2011.09.014 · Cited by 70
Bottom-Up Gazetteers: Learning from the Implicit Semantics of Geotags
Keßler, C., Maué, P., Heuer, J. T., et al. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-10436-7_6 · Cited by 64
Volunteered Geographic Information: Towards the establishment of a new paradigm
Jiang, B., & Thill, J. (2015) · Computers Environment and Urban Systems · doi:10.1016/j.compenvurbsys.2015.09.011 · Cited by 61
Self-citationOn predicting and improving the quality of Volunteer Geographic Information projects
Bordogna, G., Carrara, P., Criscuolo, L., Pepe, M., & Rampini, A. (2014) · International Journal of Digital Earth · doi:10.1080/17538947.2014.976774 · Cited by 55
Yang, A., Fan, H., & Jing, N. (2016) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi5020021 · Cited by 40
Yang, A., Fan, H., Jing, N., Sun, Y., & Zipf, A. (2016) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi5010005 · Cited by 35
Geospatial Metadata 2.0 – An approach for Volunteered Geographic Information
Kalantari, M., Rajabifard, A., Olfat, H., & WILLIAMSON, I. P. (2014) · Computers Environment and Urban Systems · doi:10.1016/j.compenvurbsys.2014.06.005 · Cited by 32
Hacker Cartography: Crowdsourced Geography, OpenStreetMap, and the Hacker Political Imaginary
McConchie, A. (2015) · ACME · doi:10.14288/acme.v14i3.1237 · Cited by 29
Semantic Interoperability of Sensor Data with Volunteered Geographic Information: A Unified Model
Bakillah, M., Liang, S. H. L., Zipf, A., & Arsanjani, J. J. (2013) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi2030766 · Cited by 25
Geographical Information as ‘Personal Information’
Scassa, T. (2010) · Oxford University Commonwealth Law Journal · doi:10.5235/147293410794895322 · Cited by 13
Action and interaction in volunteered geographic information: a workshop review
Mooney, P., Rehrl, K., & Hochmair, H. H. (2013) · Journal of Location Based Services · doi:10.1080/17489725.2013.859310 · Cited by 11
Self-citationLegal Issues in Maps Built on Third Party Base Layers
Saunders, A., Scassa, T., & Lauriault, T. P. (2012) · GEOMATICA · doi:10.5623/cig2012-054 · Cited by 10
The 1996 Geographical Association Land Use-UK Survey: A 'Geographical Commitment'
Walford, R. (1999) · International Research in Geographical and Environmental Education · doi:10.1080/10382049908667621 · Cited by 4
Cited by
Remote sensing for agricultural applications: A meta-review
Weiss, M., Jacob, F., & Duveiller, G. (2020) · Remote Sensing of Environment · doi:10.1016/j.rse.2019.111402 · Cited by 1,877
Key issues in rigorous accuracy assessment of land cover products
Stehman, S. V., & Foody, G. M. (2019) · Remote Sensing of Environment · doi:10.1016/j.rse.2019.05.018 · Cited by 651
Self-citationSocial media data for conservation science: A methodological overview
Toivonen, T., Heikinheimo, V., Fink, C., Hausmann, A., Hiippala, T., Järv, O., Tenkanen, H., & Di Minin, E. (2019) · Biological Conservation · doi:10.1016/j.biocon.2019.01.023 · Cited by 468
Earth observation in service of the 2030 Agenda for Sustainable Development
Anderson, K., Ryan, B., Sonntag, W., Kavvada, A., & Friedl, L. (2017) · Geo-spatial Information Science · doi:10.1080/10095020.2017.1333230 · Cited by 410
Flood Risk in Urban Areas: Modelling, Management and Adaptation to Climate Change. A Review
Cea, L., & Costabile, P. (2022) · Hydrology · doi:10.3390/hydrology9030050 · Cited by 317
Metadata
- Authors
- See, L., Mooney, P., Foody, G., Bastin, L., Comber, A., Estima, J., Fritz, S., Kerle, N., Jiang, B., Laakso, M., Liu, H.-Y., Milčinski, G., Nikšič, M., Painho, M., Pődör, A., Olteanu-Raimond, A.-M., & Rutzinger, M.
- Venue
- ISPRS International Journal of Geo-Information
- Publisher
- MDPI AG
- Published
- 2016-04-27
- Volume
- 5
- Issue
- 5
- Pages
- 55
- ISSN
- 2220-9964 (ISSN-L)
- OpenAlex
- W3102725001
- Cited by
- 433
- References
- 62
- FWCI
- 348.09
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.