The DOI matches its Crossref record; 111 of the 111 references it cites were found in a registry or an index.
The effects of feedback on energy conservation: A meta-analysis.
Abstract
Feedback has been studied as a strategy for promoting energy conservation for more than 30 years, with studies reporting widely varying results. Literature reviews have suggested that the effectiveness of feedback depends on both how and to whom it is provided; yet variations in both the type of feedback provided and the study methodology have made it difficult for conclusions to be drawn. The current article analyzes past theoretical and empirical research on both feedback and proenvironmental behavior to identify unresolved issues, and utilizes a meta-analysis of 42 feedback studies published between 1976 and 2010 to test a set of hypotheses about when and how feedback about energy usage is most effective. Results indicate that feedback is effective overall, r = .071, p < .001, but with significant variation in effects (r varied from -.080 to .480). Several treatment variables were found to moderate this relationship, including frequency, medium, comparison message, duration, and combination with other interventions (e.g., goal, incentive). Overall, results provide further evidence of feedback as a promising strategy to promote energy conservation and suggest areas in which future research should focus to explore how and for whom feedback is most effective.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
The theory of planned behavior
Ajzen, I. (1991) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(91)90020-t · Cited by 90,587
Hardin, G. (1968) · Science · doi:10.1126/science.162.3859.1243 · Cited by 25,167
A theory of social comparison processes
Festinger, L. (1954) · Human Relations · doi:10.1177/001872675400700202 · Cited by 20,926
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464
A BEHAVIORAL MODEL OF RATIONAL CHOICE
Simon, H. A. (1955) · The Quarterly Journal of Economics · doi:10.2307/1884852 · Cited by 15,877
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
Attitude-behavior relations: A theoretical analysis and review of empirical research
Ajzen, I., & Fishbein, M. (1977) · Psychological Bulletin · doi:10.1037/0033-2909.84.5.888 · Cited by 7,611 · cited 1×
“The principle of compatibility (Ajzen & Fishbein, 1977) suggests behaviors and their influences should be measured at the same level of specificity.”
BackgroundKluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882
Normative Influences on Altruism
Schwartz, S. H. (1977) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(08)60358-5 · Cited by 5,364
Encouraging pro-environmental behaviour: An integrative review and research agenda
Steg, L., & Vlek, C. (2009) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2008.10.004 · Cited by 5,089
Principles of behavior modification
Bandura, A. (1969) · Medical Entomology and Zoology · Cited by 4,631
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
The Behavior of Organisms: An Experimental Analysis
Jones, F. N., & Skinner, B. F. (1939) · The American Journal of Psychology · doi:10.2307/1416495 · Cited by 4,398
Meta-Analytic Procedures for Social Research.
Metcalfe, A., & Rosenthal, R. (1994) · The Statistician · doi:10.2307/2348600 · Cited by 4,249
Tosi, H. L. (1991) · Academy of Management Review · doi:10.5465/amr.1991.4278976 · Cited by 4,145
Bamberg, S., & Möser, G. (2007) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2006.12.002 · Cited by 4,140
The Constructive, Destructive, and Reconstructive Power of Social Norms
Schultz, P. W., Nolan, J. M., Cialdini, R. B., Goldstein, N. J., & Griskevicius, V. (2007) · Psychological Science · doi:10.1111/j.1467-9280.2007.01917.x · Cited by 3,643
The Handbook of Research Synthesis.
Howel, D., Cooper, H., & Hedges, L. V. (1995) · Biometrics · doi:10.2307/2533295 · Cited by 3,642
Fixed-and random-effects models in meta-analysis.
Hedges, L. V., & Vevea, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.486 · Cited by 2,977
Social norms and energy conservation
Allcott, H. (2011) · Journal of Public Economics · doi:10.1016/j.jpubeco.2011.03.003 · Cited by 2,802 · cited 1×
“as such, consumers’ attention can drop away in the interim (Allcott, 2011).”
BackgroundA review of intervention studies aimed at household energy conservation
Abrahamse, W., Steg, L., Vlek, C., & Rothengatter, T. (2005) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2005.08.002 · Cited by 2,668
Attention and Self-Regulation : A Control-Theory Approach to Human Behavior
Carver, C. S., & Scheier, M. F. (1981) · Medical Entomology and Zoology · Cited by 2,580
A behavior model for persuasive design
Fogg, B. (2009) · Proceedings of the 4th International Conference on Persuasive Technology · doi:10.1145/1541948.1541999 · Cited by 2,328
A theory of goal setting & task performance
Locke, E. A., & Latham, G. P. (1990) · Medical Entomology and Zoology · Cited by 2,022
What do people think they're doing? Action identification and human behavior.
Vallacher, R. R., & Wegner, D. M. (1987) · Psychological Review · doi:10.1037/0033-295x.94.1.3 · Cited by 1,802
Meta-Analysis: Recent Developments in Quantitative Methods for Literature Reviews
Rosenthal, R., & DiMatteo, M. R. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.59 · Cited by 1,780
Normative social influence is underdetected
Nolan, J. M., Schultz, P. W., Cialdini, R. B., Goldstein, N. J., & Griskevicius, V. (2008) · Personality and Social Psychology Bulletin · doi:10.1177/0146167208316691 · Cited by 1,772
Influences on Attitude-Behavior Relationships: A Natural Experiment with Curbside Recycling
Guagnano, G. A., Stern, P. C., & Dietz, T. (1995) · Environment and Behavior · doi:10.1177/0013916595275005 · Cited by 1,457
Household actions can provide a behavioral wedge to rapidly reduce US carbon emissions
Dietz, T., Gardner, G. T., Gilligan, J., Stern, P. C., & Vandenbergh, M. P. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0908738106 · Cited by 1,450
Self-regulation through goal setting
Latham, G. P., & Locke, E. A. (1991) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(91)90021-k · Cited by 1,370
Feedback on household electricity consumption: a tool for saving energy?
Fischer, C. (2008) · Energy Efficiency · doi:10.1007/s12053-008-9009-7 · Cited by 1,335
Using Internet technology to deliver a behavioral weight loss program
Tate, D. F. (2001) · JAMA · doi:10.1001/jama.285.9.1172 · Cited by 925
Allcott, H., & Mullainathan, S. (2010) · Science · doi:10.1126/science.1180775 · Cited by 851
Hunter, J. E., & Schmidt, F. L. (2000) · International Journal of Selection and Assessment · doi:10.1111/1468-2389.00156 · Cited by 833
Models of Decision Making and Residential Energy Use
Wilson, C., & Dowlatabadi, H. (2007) · Annual Review of Environment and Resources · doi:10.1146/annurev.energy.32.053006.141137 · Cited by 818
The design of eco-feedback technology
Froehlich, J., Findlater, L., & Landay, J. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753629 · Cited by 813
Hargreaves, T., Nye, M., & Burgess, J. (2010) · Energy Policy · doi:10.1016/j.enpol.2010.05.068 · Cited by 801
Field, A. P. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.2.161 · Cited by 725
Public perceptions of energy consumption and savings
Attari, S. Z., DeKay, M. L., Davidson, C. I., & Bruine de Bruin, W. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1001509107 · Cited by 690
Personal and contextual influences on househould energy adaptations.
Black, J. S., Stern, P. C., & Elworth, J. T. (1985) · Journal of Applied Psychology · doi:10.1037//0021-9010.70.1.3 · Cited by 678
Thorndike, E. L. (1927) · The American Journal of Psychology · doi:10.2307/1415413 · Cited by 602
Energy cultures: A framework for understanding energy behaviours
Stephenson, J., Barton, B., Carrington, G., Gnoth, D., Lawson, R., & Thorsnes, P. (2010) · Energy Policy · doi:10.1016/j.enpol.2010.05.069 · Cited by 560
Climate change and moral judgement
Markowitz, E. M., & Shariff, A. F. (2012) · Nature Climate Change · doi:10.1038/nclimate1378 · Cited by 542
Ayres, I., Raseman, S., & Shih, A. (2013) · Journal of Law, Economics, and Organization · doi:10.1093/jleo/ews020 · Cited by 542
The Short List: The Most Effective Actions U.S. Households Can Take to Curb Climate Change
Gardner, G. T., & Stern, P. C. (2008) · Environment: Science and Policy for Sustainable Development · doi:10.3200/envt.50.5.12-25 · Cited by 529
THE EFFECTS OF PSYCHOLOGICALLY BASED INTERVENTION PROGRAMS ON WORKER PRODUCTIVITY: A META‐ANALYSIS
GUZZO, R. A., JETTE, R. D., & KATZELL, R. A. (1985) · Personnel Psychology · doi:10.1111/j.1744-6570.1985.tb00547.x · Cited by 518
Household preferences for energy-saving measures: A conjoint analysis
Poortinga, W., Steg, L., Vlek, C., & Wiersma, G. (2003) · Journal of Economic Psychology · doi:10.1016/s0167-4870(02)00154-x · Cited by 518
REDUCING HOUSEHOLD ENERGY CONSUMPTION: A QUALITATIVE AND QUANTITATIVE FIELD STUDY
Brandon, G., & Lewis, A. (1999) · Journal of Environmental Psychology · doi:10.1006/jevp.1998.0105 · Cited by 514
A control systems conceptualization of the goal-setting and changing process
Campion, M. A., & Lord, R. G. (1982) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(82)90221-5 · Cited by 481
Becker, L. J. (1978) · Journal of Applied Psychology · doi:10.1037//0021-9010.63.4.428 · Cited by 463
Brodsky, S. L. (2011) · Therapy with coerced and reluctant clients. · doi:10.1037/12305-007 · Cited by 445
Using normative social influence to promote conservation among hotel guests
Schultz, W. P., Khazian, A. M., & Zaleski, A. C. (2008) · Social Influence · doi:10.1080/15534510701755614 · Cited by 405
(2004) · Fuel and Energy Abstracts · doi:10.1016/s0140-6701(04)93374-7 · Cited by 391
Factors influencing energy efficiency investments in existing Swedish residential buildings
Nair, G., Gustavsson, L., & Mahapatra, K. (2010) · Energy Policy · doi:10.1016/j.enpol.2010.01.033 · Cited by 382
requivalent: A simple effect size indicator.
Rosenthal, R., & Rubin, D. B. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.4.492 · Cited by 380
Pro‐environmental behavior: Rational choice meets moral motivation
Turaga, R. M. R., Howarth, R. B., & Borsuk, M. E. (2010) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2009.05163.x · Cited by 356
Contributions of psychology to limiting climate change.
Stern, P. C. (2011) · American Psychologist · doi:10.1037/a0023235 · Cited by 336
Effects of feedback sign and credibility on goal setting and task performance
Podsakoff, P. M., & Farh, J.-L. (1989) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(89)90034-4 · Cited by 304
The Effect of Goal-Setting and Daily Electronic Feedback on In-Home Energy Use
van Houwelingen, J. H., & van Raaij, W. F. (1989) · Journal of Consumer Research · doi:10.1086/209197 · Cited by 288
(2005) · Fuel and Energy Abstracts · doi:10.1016/s0140-6701(06)80500-x · Cited by 283
Measured energy savings from a more informative energy bill
Wilhite, H., & Ling, R. (1995) · Energy and Buildings · doi:10.1016/0378-7788(94)00912-4 · Cited by 282
Employee responses to formal performance appraisal feedback.
Pearce, J. L., & Porter, L. W. (1986) · Journal of Applied Psychology · doi:10.1037//0021-9010.71.2.211 · Cited by 278
Van Liere, K. D., & Dunlap, R. E. (1978) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.1978.tb00775.x · Cited by 264
Feedback as a means of decreasing residential energy consumption.
Seligman, C., & Darley, J. M. (1977) · Journal of Applied Psychology · doi:10.1037//0021-9010.62.4.363 · Cited by 234
Making it Obvious: Designing Feedback into Energy Consumption
Darby, S. (2001) · Energy Efficiency in Household Appliances and Lighting · doi:10.1007/978-3-642-56531-1_73 · Cited by 230
Publication bias and meta-analysis
Smith, M. L. (1980) · Evaluation in Education · doi:10.1016/0191-765x(80)90004-x · Cited by 214
Commitment and voluntary energy conservation
Pallak, M. S., & Cummings, W. (1976) · Personality and Social Psychology Bulletin · doi:10.1177/014616727600200105 · Cited by 200
Residential Water Use: Predicting and Reducing Consumption1
Aitken, C. K., Mcmahon, T. A., Wearing, A. J., & Finlayson, B. L. (1994) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.1994.tb00562.x · Cited by 196
Behavioral approaches to residential energy conservation
Seligman, C., Darley, J. M., & Becker, L. J. (1978) · Energy and Buildings · doi:10.1016/0378-7788(78)90012-9 · Cited by 182
Household Behavior and the Use of Natural Gas for Home Heating
Verhallen, T. M. M., & van Raaij, W. F. (1981) · Journal of Consumer Research · doi:10.1086/208862 · Cited by 179
Midden, C. J. H., Meter, J. F., Weenig, M. W. H., & Zieverink, H. J. A. (1983) · Journal of Economic Psychology · doi:10.1016/0167-4870(83)90058-2 · Cited by 178
Cooper, H. M., & Hedges, L. V. (1994) · Journal of International Crisis and Risk Communication Research · Cited by 170
Research Synthesis and Meta-Analysis
Valentine, J. C., & Cooper, H. (2008) · doi:10.4324/9780203887882-10 · Cited by 168
Kurz, T., Donaghue, N., & Walker, I. (2005) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.2005.tb02171.x · Cited by 165
Dimensions of Conservation: Exploring Differences Among Energy Behaviors
Karlin, B., Davis, N., Sanguinetti, A., Gamble, K., Kirkby, D., & Stokols, D. (2014) · Environment and Behavior · doi:10.1177/0013916512467532 · Cited by 165
Self-citationEffects of monetary rebates, feedback, and information on residential electricity conservation.
Winett, R. A., Kagel, J. H., Battalio, R. C., & Winkler, R. C. (1978) · Journal of Applied Psychology · doi:10.1037/0021-9010.63.1.73 · Cited by 121
REDUCTION OF RESIDENTIAL CONSUMPTION OF ELECTRICITY THROUGH SIMPLE MONTHLY FEEDBACK
Hayes, S. C., & Cone, J. D. (1981) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1981.14-81 · Cited by 118
Winett, R. A., Hatcher, J. W., Fort, T. R., Leckliter, I. N., Love, S. Q., Riley, A. W., & Fishback, J. F. (1982) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1982.15-381 · Cited by 115
Hutton, R. B., Mauser, G. A., Filiatrault, P., & Ahtola, O. T. (1986) · Journal of Consumer Research · doi:10.1086/209072 · Cited by 110
Promoting energy conservation: An analysis of behavioral research
Katzev, R. D., & Johnson, T. R. (1987) · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · Cited by 101
The Effects of Information on Residential Demand for Electricity
Matsukawa, I. (2004) · The Energy Journal · doi:10.5547/issn0195-6574-ej-vol25-no1-1 · Cited by 97
Energy Conservation Effects of Continuous In-Home Feedback in All-Electric Homes
McClelland, L., & Cook, S. W. (1979) · Journal of Environmental Systems · doi:10.2190/l8bu-eclk-pec5-kktw · Cited by 96
Pigott, T. (2009) · Cited by 93
Sexton, R. J., Johnson, N. B., & Konakayama, A. (1987) · Journal of Consumer Research · doi:10.1086/209092 · Cited by 83
Attitudes Toward Energy Conservation: A Confirmatory Factor Analysis1
Samuelson, C. D., & Biek, M. (1991) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.1991.tb00536.x · Cited by 82
Residential Electricity Demand: An Experimental Study
Battalio, R. C., Kagel, J. H., Winkler, R. C., & Winett, R. A. (1979) · The Review of Economics and Statistics · doi:10.2307/1924585 · Cited by 75
Pilot Evaluation of Energy Savings from Residential Energy Demand Feedback Devices
Energy Efficiency Office. Building Technologies Office USDOE Office of Energy Efficiency and Renewable Energy (EERE), Parker, D., Hoak, D., & Cummings, J. (2008) · doi:10.2172/1219080 · Cited by 67
Unlocking Energy Efficiency in the U.S. Economy
USDOE Office of Energy Efficiency and Renewable Energy (EERE), E. A. (.-3. (. A. C., Granade, H. C., Creyts, J., Derkach., A., Farese, P., Nyquist., S., & Ostrowski, K. (2009) · doi:10.2172/1219302 · Cited by 65
A Congruence Analysis of Human Stress
Stokols, D. (1985) · Issues in Mental Health Nursing · doi:10.3109/01612848509009449 · Cited by 63
Energy feedback technology: a review and taxonomy of products and platforms
Karlin, B., Ford, R., & Squiers, C. (2013) · Energy Efficiency · doi:10.1007/s12053-013-9227-5 · Cited by 61
Self-citationHam, J., & Midden, C. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-13226-1_14 · Cited by 60
The Effects of Daily Cost Feedback on Residential Electricity Consumption
Bittle, R. G., Valesano, R. M., & Thaler, G. A. (1979) · Behavior Modification · doi:10.1177/014544557932004 · Cited by 60
The Feasibility of Changing Electricity Consumption Patterns
Kasulis, J. J., Huettner, D. A., & Dikeman, N. (1981) · Journal of Consumer Research · doi:10.1086/208866 · Cited by 58
Is Bad News Always Bad?: Cue and Feedback Effects on Intrinsic Motivation
Anderson, S., & Rodin, J. (1989) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.1989.tb00067.x · Cited by 57
Behavioral Assumptions Underlying California Residential Sector Energy Efficiency Programs
Lutzenhiser, L., Cesafsky, L., State, W., Peters, J. S., Stern, P. C., & Simmons, E. (2009) · eScholarship (California Digital Library) · Cited by 47
Ueno, T., Inada, R., Saeki, O., & Tsuji, K. (2005) · Cited by 46
Becoña, E., & Vázquez, F. L. (2001) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.69.1.33 · Cited by 44
Reducing Air Conditioning Waste by Signalling it is Cool Outside
Becker, L. J., & Seligman, C. (1978) · Personality and Social Psychology Bulletin · doi:10.1177/014616727800400310 · Cited by 44
Bittle, R. G., Valesano, R. M., & Thaler, G. A. (1979) · Journal of Environmental Systems · doi:10.2190/91aa-p97g-jf92-t7ej · Cited by 43
Effects of Total and Partial Feedback in Multiple-Choice Testing Upon Learning
Hanna, G. S. (1976) · The Journal of Educational Research · doi:10.1080/00220671.1976.10884873 · Cited by 42
The Effect of Feedback and Social Reinforcement on Residential Electricity Consumption
Katzev, R. D., Cooper, L., & Fisher, P. (1980) · Journal of Environmental Systems · doi:10.2190/m8w4-juyv-nb03-cufl · Cited by 41
The effect of feedback and focused advice on household energy consumption
Haakana, M., Sillanpaeae, L., & Talsi, M. (1997) · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · Cited by 41
Advertising and the Department of Energy's Campaign for Energy Conservation
Hutton, R. B. (1982) · Journal of Advertising · doi:10.1080/00913367.1982.10672801 · Cited by 29
Practice without knowledge of results.
Judd, C. H. (1905) · Cited by 29
Some effects of incentives on work and fatigue.
Wright, W. (1906) · Psychological Review · doi:10.1037/h0076041 · Cited by 19
Effects of test score feedback on immediately subsequent test performance.
Bridgeman, B. (1974) · Journal of Educational Psychology · doi:10.1037/h0035803 · Cited by 19
Robinson, J. G. (2007) · UWSpace (University of Waterloo) · Cited by 11
Graphical Displays in Eco-Feedback: A Cognitive Approach
Ford, R., & Karlin, B. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39253-5_54 · Cited by 9
Self-citationJones, G. M. (1910) · Psychological Review · doi:10.1037/h0074504 · Cited by 8
Karlin, B. (2011) · doi:10.1145/2467803.2467813 · Cited by 5
Self-citation
Cited by
Review of 50 years of EU energy efficiency policies for buildings
Economidou, M., Todeschi, V., Bertoldi, P., D'Agostino, D., Zangheri, P., & Castellazzi, L. (2020) · Energy and Buildings · doi:10.1016/j.enbuild.2020.110322 · Cited by 640
A Social Identity Model of Pro-Environmental Action (SIMPEA).
Fritsche, I., Barth, M., Jugert, P., Masson, T., & Reese, G. (2018) · Psychological Review · doi:10.1037/rev0000090 · Cited by 632
Financial Education Affects Financial Knowledge and Downstream Behaviors
Kaiser, T., Lusardi, A., Menkhoff, L., & Urban, C. (2022) · Journal of Financial Economics · doi:10.1016/j.jfineco.2021.09.022 · Cited by 508
Values, Norms, and Intrinsic Motivation to Act Proenvironmentally
Steg, L. (2016) · Annual Review of Environment and Resources · doi:10.1146/annurev-environ-110615-085947 · Cited by 440
Meta-analysis of pro-environmental behaviour spillover
Maki, A., Carrico, A. R., Raimi, K. T., Truelove, H. B., Araujo, B., & Yeung, K. L. (2019) · Nature Sustainability · doi:10.1038/s41893-019-0263-9 · Cited by 377
Metadata
- Authors
- Karlin, B., Zinger, J. F., & Ford, R.
- Venue
- Psychological Bulletin
- Published
- 2015
- Volume
- 141
- Issue
- 6
- Pages
- 1205-1227
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2413028598
- Cited by
- 361
- References
- 111
- FWCI
- 62.37
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.