The DOI matches its Crossref record; 90 of the 90 references it cites were found in a registry or an index.
A Framework for Articulating and Measuring Individual Learning Outcomes from Participation in Citizen Science
Open accessAbstract
Since first being introduced in the mid 1990s, the term “citizen science”—the intentional engagement of the public in scientific research—has seen phenomenal growth as measured by the number of projects developed, people involved, and articles published. In addition to contributing to scientific knowledge, many citizen science projects attempt to achieve learning outcomes among their participants, however, little guidance is available for practitioners regarding the types of learning that can be supported through citizen science or the measuring of learning outcomes. This study provides empirical data to understand how intended learning outcomes first described by the informal science education field have been employed and measured within the citizen science field. We also present a framework for describing learning outcomes that should help citizen science practitioners, researchers, and evaluators in designing projects and in studying and evaluating their impacts. This is a first step in building evaluation capacity across the field of citizen science.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The theory of planned behavior
Ajzen, I. (1991) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(91)90020-t · Cited by 90,587
Ryan, R. M., & Deci, E. L. (2000) · American Psychologist · doi:10.1037//0003-066x.55.1.68 · Cited by 54,599
Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions
Ryan, R. M., & Deci, E. L. (2000) · Contemporary Educational Psychology · doi:10.1006/ceps.1999.1020 · Cited by 18,666 · cited 1×
“…Self-Determination Theory (SDT), which treats motivation as an explanatory variable for meeting basic psychological needs (i.e., competency, relatedness, and autonomy) and describes different types of motivations as falling on a continuum from intrinsic to extrinsic (Ryan and Deci 2000a, 2000b).”
BackgroundSelf-efficacy mechanism in human agency
Bandura, A. (1982) · American Psychologist · doi:10.1037/0003-066x.37.2.122 · Cited by 15,975
Kollmuss, A., & Agyeman, J. (2002) · Environmental Education Research · doi:10.1080/13504620220145401 · Cited by 8,866
New Environmental Theories: Toward a Coherent Theory of Environmentally Significant Behavior
Stern, P. C. (2000) · Journal of Social Issues · doi:10.1111/0022-4537.00175 · Cited by 8,682
The restorative benefits of nature: toward an integrative framework
Kaplan, S. (1995) · Journal of Environmental Psychology · doi:10.1016/0272-4944(95)90001-2 · Cited by 6,923
(2013) · Cited by 6,708
The four-phase model of interest development
Hidi, S., & Renninger, K. A. (2006) · Educational Psychologist · doi:10.1207/s15326985ep4102_4 · Cited by 4,702
Self-Efficacy and Academic Motivation
Schunk, D. H. (1991) · Educational Psychologist · doi:10.1080/00461520.1991.9653133 · Cited by 4,292
Attitudes towards science: A review of the literature and its implications
Osborne, J., Simon, S., & Collins, S. (2003) · International Journal of Science Education · doi:10.1080/0950069032000032199 · Cited by 3,143
Understanding and assessing the motivations of volunteers: A functional approach.
Clary, E. G., Snyder, M., Ridge, R. D., Copeland, J., Stukas, A. A., Haugen, J., & Miene, P. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.74.6.1516 · Cited by 2,994
Exercise of Human Agency Through Collective Efficacy
Bandura, A. (2000) · Current Directions in Psychological Science · doi:10.1111/1467-8721.00064 · Cited by 2,948
Citizen Science: A Developing Tool for Expanding Science Knowledge and Scientific Literacy
Bonney, R., Cooper, C. B., Dickinson, J., Kelling, S., Phillips, T., Rosenberg, K. V., & Shirk, J. (2009) · BioScience · doi:10.1525/bio.2009.59.11.9 · Cited by 2,529
Self-citationStudents' and teachers' conceptions of the nature of science: A review of the research
Lederman, N. G. (1992) · Journal of Research in Science Teaching · doi:10.1002/tea.3660290404 · Cited by 2,169
Changing Learner Behavior Through Environmental Education
Hungerford, H. R., & Volk, T. L. (1990) · The Journal of Environmental Education · doi:10.1080/00958964.1990.10753743 · Cited by 2,122
eBird: A citizen-based bird observation network in the biological sciences
Sullivan, B. L., Wood, C. L., Iliff, M. J., Bonney, R. E., Fink, D., & Kelling, S. (2009) · Biological Conservation · doi:10.1016/j.biocon.2009.05.006 · Cited by 2,017
Self-citationLederman, N. G., Abd‐El‐Khalick, F., Bell, R. L., & Schwartz, R. S. (2002) · Journal of Research in Science Teaching · doi:10.1002/tea.10034 · Cited by 1,908
Benchmarks for Science Literacy
McComas, W. F. (2014) · The Language of Science Education · doi:10.1007/978-94-6209-497-0_11 · Cited by 1,702
Public Participation in Scientific Research: a Framework for Deliberate Design
Shirk, J. L., Ballard, H. L., Wilderman, C. C., Phillips, T., Wiggins, A., Jordan, R., McCallie, E., Minarchek, M., Lewenstein, B. V., Krasny, M. E., et al. (2012) · Ecology and Society · doi:10.5751/es-04705-170229 · Cited by 1,471
Self-citationCognitive processes mediating behavioral change.
Bandura, A., Adams, N. E., & Beyer, J. (1977) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.35.3.125 · Cited by 1,392
Science and Engineering Indicators 1998
Wink, D. J. (1998) · Journal of Chemical Education · doi:10.1021/ed075p1078 · Cited by 1,327
Learning Science in Informal Environments: People, Places, and Pursuits
Hein, G. (2009) · Museums & Social Issues · doi:10.1179/msi.2009.4.1.113 · Cited by 1,263
Science in Society: Re-Evaluating the Deficit Model of Public Attitudes
Sturgis, P., & Allum, N. (2004) · Public Understanding of Science · doi:10.1177/0963662504042690 · Cited by 1,236
McKinley, D. C., Miller-Rushing, A. J., Ballard, H. L., Bonney, R., Brown, H., Cook-Patton, S. C., Evans, D. M., French, R. A., Parrish, J. K., Phillips, T. B., et al. (2017) · Biological Conservation · doi:10.1016/j.biocon.2016.05.015 · Cited by 1,142
Self-citationThe Motivations to Volunteer: Theoretical and Practical Considerations
Clary, E. G., & Snyder, M. (1999) · Current Directions in Psychological Science · doi:10.1111/1467-8721.00037 · Cited by 1,136
Planning Early for Careers in Science
Tai, R. H., Qi Liu, C., Maltese, A. V., & Fan, X. (2006) · Science · doi:10.1126/science.1128690 · Cited by 1,095
Can citizen science enhance public understanding of science?
Bonney, R., Phillips, T. B., Ballard, H. L., & Enck, J. W. (2016) · Public Understanding of Science · doi:10.1177/0963662515607406 · Cited by 994
Self-citationAssessing data quality in citizen science
Kosmala, M., Wiggins, A., Swanson, A., & Simmons, B. (2016) · Frontiers in Ecology and the Environment · doi:10.1002/fee.1436 · Cited by 985
Theobald, E. J., Ettinger, A. K., Burgess, H. K., DeBey, L. B., Schmidt, N. R., Froehlich, H. E., Wagner, C., HilleRisLambers, J., Tewksbury, J., Harsch, M. A., et al. (2015) · Biological Conservation · doi:10.1016/j.biocon.2014.10.021 · Cited by 770
National Science Education Standards
Lagowski, J. J. (1995) · Journal of Chemical Education · doi:10.1021/ed072p287 · Cited by 770
Osbaldiston, R., & Schott, J. P. (2012) · Environment and Behavior · doi:10.1177/0013916511402673 · Cited by 754
Citizen Science as a Tool for Conservation in Residential Ecosystems
Cooper, C. B., Dickinson, J., Phillips, T., & Bonney, R. (2007) · Ecology and Society · doi:10.5751/es-02197-120211 · Cited by 746
Self-citationScientific knowledge and attitude change: The impact of a citizen science project
Brossard, D., Lewenstein, B., & Bonney, R. (2005) · International Journal of Science Education · doi:10.1080/09500690500069483 · Cited by 687
Self-citationUnderstanding behavior to understand behavior change: a literature review
Heimlich, J. E., & Ardoin, N. M. (2008) · Environmental Education Research · doi:10.1080/13504620802148881 · Cited by 649
Eyeballs in the Fridge: Sources of early interest in science
Maltese, A. V., & Tai, R. H. (2010) · International Journal of Science Education · doi:10.1080/09500690902792385 · Cited by 621
The history of public participation in ecological research
Miller-Rushing, A., Primack, R., & Bonney, R. (2012) · Frontiers in Ecology and the Environment · doi:10.1890/110278 · Cited by 589
Self-citationSCHULTZ, P. W. (2011) · Conservation Biology · doi:10.1111/j.1523-1739.2011.01766.x · Cited by 557
Beyond scarcity: citizen science programmes as useful tools for conservation biogeography
Devictor, V., Whittaker, R. J., & Beltrame, C. (2010) · Diversity and Distributions · doi:10.1111/j.1472-4642.2009.00615.x · Cited by 530
Local Participation in Natural Resource Monitoring: a Characterization of Approaches
DANIELSEN, F., BURGESS, N. D., BALMFORD, A., DONALD, P. F., FUNDER, M., JONES, J. P. G., ALVIOLA, P., BALETE, D. S., BLOMLEY, T., BRASHARES, J., et al. (2009) · Conservation Biology · doi:10.1111/j.1523-1739.2008.01063.x · Cited by 522
Dynamic changes in motivation in collaborative citizen-science projects
Rotman, D., Preece, J., Hammock, J., Procita, K., Hansen, D., Parr, C., Lewis, D., & Jacobs, D. (2012) · Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work · doi:10.1145/2145204.2145238 · Cited by 492
Science education as/for participation in the community
Roth, W., & Lee, S. (2004) · Science Education · doi:10.1002/sce.10113 · Cited by 478
Galaxy Zoo: Exploring the Motivations of Citizen Science Volunteers
Raddick, M. J., Bracey, G., Gay, P. L., Lintott, C. J., Murray, P., Schawinski, K., Szalay, A. S., & Vandenberg, J. (2010) · Astronomy Education Review · doi:10.3847/aer2009036 · Cited by 473
Thinking scientifically during participation in a citizen-science project
Trumbull, D. J., Bonney, R., Bascom, D., & Cabral, A. (2000) · Science Education · doi:10.1002/(sici)1098-237x(200003)84:2<265::aid-sce7>3.0.co;2-5 · Cited by 407
Self-citationKnowledge Gain and Behavioral Change in Citizen-Science Programs: Citizen-Scientist Knowledge Gain
JORDAN, R. C., GRAY, S. A., HOWE, D. V., BROOKS, W. R., & EHRENFELD, J. G. (2011) · Conservation Biology · doi:10.1111/j.1523-1739.2011.01745.x · Cited by 400
Changing Behavior and Making it Stick: The Conceptualization and Management of Conservation Behavior
De Young, R. (1993) · Environment and Behavior · doi:10.1177/0013916593253003 · Cited by 390
Advantages of Volunteer‐Based Biodiversity Monitoring in Europe
SCHMELLER, D. S., HENRY, P., JULLIARD, R., GRUBER, B., CLOBERT, J., DZIOCK, F., LENGYEL, S., NOWICKI, P., DÉRI, E., BUDRYS, E., et al. (2009) · Conservation Biology · doi:10.1111/j.1523-1739.2008.01125.x · Cited by 389
Assessing citizen science data quality: an invasive species case study
Crall, A. W., Newman, G. J., Stohlgren, T. J., Holfelder, K. A., Graham, J., & Waller, D. M. (2011) · Conservation Letters · doi:10.1111/j.1755-263x.2011.00196.x · Cited by 386
Fernandez-Gimenez, M. E., Ballard, H. L., & Sturtevant, V. E. (2008) · Ecology and Society · doi:10.5751/es-02400-130204 · Cited by 368
Evans, C., Abrams, E., Reitsma, R., Roux, K., Salmonsen, L., & Marra, P. P. (2005) · Conservation Biology · doi:10.1111/j.1523-1739.2005.00s01.x · Cited by 356
Falk, J. H., Storksdieck, M., & Dierking, L. D. (2007) · Public Understanding of Science · doi:10.1177/0963662506064240 · Cited by 334
Expectations and Performance: An Empirical Test of Bandura's Self-efficacy Theory
Weinberg, R., Gould, D., & Jackson, A. (1979) · Journal of Sport Psychology · doi:10.1123/jsp.1.4.320 · Cited by 315
Crall, A. W., Jordan, R., Holfelder, K., Newman, G. J., Graham, J., & Waller, D. M. (2013) · Public Understanding of Science · doi:10.1177/0963662511434894 · Cited by 312
Key issues and new approaches for evaluating citizen‐science learning outcomes
Jordan, R., Ballard, H. L., & Phillips, T. (2012) · Frontiers in Ecology and the Environment · doi:10.1890/110280 · Cited by 273
Self-citationScientists@Home: What Drives the Quantity and Quality of Online Citizen Science Participation?
Nov, O., Arazy, O., & Anderson, D. (2014) · PLoS ONE · doi:10.1371/journal.pone.0090375 · Cited by 254
Learning and the transformative potential of citizen science
Bela, G., Peltola, T., Young, J. C., Balázs, B., Arpin, I., Pataki, G., Hauck, J., Kelemen, E., Kopperoinen, L., Van Herzele, A., et al. (2016) · Conservation Biology · doi:10.1111/cobi.12762 · Cited by 236
Stern, M. J., Powell, R. B., & Ardoin, N. M. (2008) · The Journal of Environmental Education · doi:10.3200/joee.39.4.31-43 · Cited by 226
What counts? Volunteers and their organisations in the recording and monitoring of biodiversity
Bell, S., Marzano, M., Cent, J., Kobierska, H., Podjed, D., Vandzinskaite, D., Reinert, H., Armaitiene, A., Grodzińska-Jurczak, M., & Muršič, R. (2008) · Biodiversity and Conservation · doi:10.1007/s10531-008-9357-9 · Cited by 218
Roth, W., & Roychoudhury, A. (1993) · Journal of Research in Science Teaching · doi:10.1002/tea.3660300508 · Cited by 218
Scientific literacy as collective praxis
Roth, W.-M., & Lee, S. (2002) · Public Understanding of Science · doi:10.1088/0963-6625/11/1/302 · Cited by 201
Motivations and barriers in relation to community participation in biodiversity recording
Hobbs, S. J., & White, P. C. L. (2012) · Journal for Nature Conservation · doi:10.1016/j.jnc.2012.08.002 · Cited by 188
Air Pollution and Odor in Communities Near Industrial Swine Operations
Wing, S., Horton, R. A., Marshall, S. W., Thu, K., Tajik, M., Schinasi, L., & Schiffman, S. S. (2008) · Environmental Health Perspectives · doi:10.1289/ehp.11250 · Cited by 178
Wright, D. R., Underhill, L. G., Keene, M., & Knight, A. T. (2015) · Society & Natural Resources · doi:10.1080/08941920.2015.1054976 · Cited by 166
A Multicountry Assessment of Tropical Resource Monitoring by Local Communities
Danielsen, F., Jensen, P. M., Burgess, N. D., Altamirano, R., Alviola, P. A., Andrianandrasana, H., Brashares, J. S., Burton, A. C., Coronado, I., Corpuz, N., et al. (2014) · BioScience · doi:10.1093/biosci/biu001 · Cited by 166
Price, C. A., & Lee, H. (2013) · Journal of Research in Science Teaching · doi:10.1002/tea.21090 · Cited by 165
Citizen Science: A Tool for Integrating Studies of Human and Natural Systems
Crain, R. L., Cooper, C. B., & Dickinson, J. L. (2014) · Annual Review of Environment and Resources · doi:10.1146/annurev-environ-030713-154609 · Cited by 160
Ballard, H., Fernández-Giménez, M., & Sturtevant, V. (2008) · Ecology and Society · doi:10.5751/es-02594-130237 · Cited by 152
Observations of Everyday Biodiversity: a New Perspective for Conservation?
Cosquer, A., Raymond, R., & Prévot, A. (2012) · Ecology and Society · doi:10.5751/es-04955-170402 · Cited by 149
Ballard, H. L., & Belsky, J. M. (2010) · Environmental Education Research · doi:10.1080/13504622.2010.505440 · Cited by 148
Volunteer Stream Monitoring and Local Participation in Natural Resource Issues
Overdevest, C., Orr, C. H., & Stepenuck, K. F. (2004) · Cited by 147
Pre‐service teachers’ understanding and teaching of nature of science: An intervention study
Lederman, N. G., Schwartz, R., Abd‐El‐Khalick, F., & Bell, R. L. (2001) · Canadian Journal of Science Mathematics and Technology Education · doi:10.1080/14926150109556458 · Cited by 140
Butterfly citizen scientists in the United States increase their engagement in conservation
Lewandowski, E. J., & Oberhauser, K. S. (2015) · Biological Conservation · doi:10.1016/j.biocon.2015.07.029 · Cited by 133
Public Knowledge of and Attitudes to Science: Alternative Measures That May End the “Science War”
Bauer, M. W., Petkova, K. G., & Boyadjieva, P. (2000) · Science Technology & Human Values · doi:10.1177/016224390002500102 · Cited by 122
Reed, J. T., Raddick, M. J., Lardner, A., & Carney, K. (2013) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2013.85 · Cited by 105
Co-producing conservation and knowledge: Citizen-based sea turtle monitoring in North Carolina, USA
Cornwell, M. L., & Campbell, L. (2012) · Social Studies of Science · doi:10.1177/0306312711430440 · Cited by 96
Brewer, C. (2002) · Conservation Biology · doi:10.1046/j.1523-1739.2002.01613.x · Cited by 93
Mejlgaard, N., & Stares, S. (2009) · Public Understanding of Science · doi:10.1177/0963662509335456 · Cited by 81
Bodzin, A. M. (2008) · The Journal of Environmental Education · doi:10.3200/joee.39.2.47-58 · Cited by 79
Ballard, H. L., & Huntsinger, L. (2006) · Human Ecology · doi:10.1007/s10745-006-9048-7 · Cited by 72
Developing and using a program theory matrix for program evaluation and performance monitoring
Funnell, S. (2000) · New Directions for Evaluation · doi:10.1002/ev.1185 · Cited by 63
Citizen Science and Youth Audiences: Educational Outcomes of the Monarch Larva Monitoring Project
Kountoupes, D. L., & Oberhauser, K. S. (2008) · Journal of Community Engagement and Scholarship · doi:10.54656/cgnr5551 · Cited by 62
Jackson, C. B., Østerlund, C. S., Mugar, G., Hassman, K., & Crowston, K. (2015) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2015.196 · Cited by 61
Bickman, L. (2000) · New Directions for Evaluation · doi:10.1002/ev.1186 · Cited by 49
Braschler, B., Mahood, K., Karenyi, N., Gaston, K. J., & Chown, S. L. (2009) · Journal of Insect Conservation · doi:10.1007/s10841-009-9221-6 · Cited by 40
Sickler, J., Cherry, T. M., Allee, L. L., Smyth, R. R., & Losey, J. E. (2014) · Applied Environmental Education & Communication · doi:10.1080/1533015x.2014.947051 · Cited by 34
Phillips, T., Bonney, R. E., & Shirk, J. (2012) · Cornell University Press eBooks · doi:10.7591/cornell/9780801449116.003.0006 · Cited by 31
Self-citationEmbedded Assessment as an Essential Method for Understanding Public Engagement in Citizen Science
Becker-Klein, R., Peterman, K., & Stylinski, C. D. (2016) · Citizen Science Theory and Practice · doi:10.5334/cstp.15 · Cited by 30
Wells, N. M., & Lekies, K. S. (2012) · Cornell University Press eBooks · doi:10.7591/cornell/9780801449116.003.0015 · Cited by 28
Contribution of Multimedia to Girls’ Experience of Citizen Science
Flagg, B. N. (2016) · Citizen Science Theory and Practice · doi:10.5334/cstp.51 · Cited by 25
Hiller, S. E. (2012) · doi:10.13021/mars/4357 · Cited by 8
Cited by
Engagement in science through citizen science: Moving beyond data collection
Phillips, T. B., Ballard, H. L., Lewenstein, B. V., & Bonney, R. (2019) · Science Education · doi:10.1002/sce.21501 · Cited by 302
Self-citationCitizen Science, Education, and Learning: Challenges and Opportunities
Roche, J., Bell, L., Galvão, C., Golumbic, Y. N., Kloetzer, L., Knoben, N., Laakso, M., Lorke, J., Mannion, G., Massetti, L., et al. (2020) · Frontiers in Sociology · doi:10.3389/fsoc.2020.613814 · Cited by 290
Allf, B. C., Cooper, C. B., Larson, L. R., Dunn, R. R., Futch, S. E., Sharova, M., & CAVALIER, D. (2022) · BioScience · doi:10.1093/biosci/biac035 · Cited by 74
Metadata
- Authors
- Phillips, T., Porticella, N., Constas, M., & Bonney, R.
- Venue
- Citizen Science: Theory and Practice
- Publisher
- Ubiquity Press, Ltd.
- Published
- 2018-08-28
- Volume
- 3
- Issue
- 2
- Pages
- 3
- ISSN
- 2057-4991 (ISSN-L)
- OpenAlex
- W2889496369
- Cited by
- 264
- References
- 90
- FWCI
- 263.61
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.