Motivating Energy-Efficient Behavior with Green IS: An Investigation of Goal Setting and the Role of Defaults1
The DOI matches its Crossref record; 105 of the 105 references it cites were found in a registry or an index.
Abstract
This study investigates the role of information systems in stimulating energy-efficient behavior in private households. We present the example of Velix, a web portal designed to motivate customers of a utility company to reduce their electricity consumption. In particular, we consider the effectiveness of goal setting functionality and defaults in influencing energy conservation behavior. For this purpose, we use the web portal as a test of the theoretical propositions underlying its design. Based on data collected from a field experiment with 1,791 electricity consumers, we test hypotheses regarding the structural relations between defaults and goals, the impact of defaults and goals on consumption behavior, and the moderating role of feedback on goal choice. Our results confirm the positive impact of goal setting on energy conservation. We show that default goals lead to statistically significant savings by affecting goal choice. However, if the default goals are set too low or too high with respect to a self-set goal, the defaults will detrimentally affect behavior. We also show that feedback on goal attainment moderates the effect of default goals on goal choice. The results extend the knowledge on goal setting and defaults and have implications for the design of effective energy feedback systems. The study’s approach, which combines hypothesis-driven work and design-oriented IS research, could serve as a blueprint for further research endeavors of this kind, particularly with regard to feedback systems based on future smart metering infrastructures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532
The theory of planned behavior
Ajzen, I. (1991) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(91)90020-t · Cited by 90,587
The Framing of Decisions and the Psychology of Choice
Tversky, A., & Kahneman, D. (1981) · Science · doi:10.1126/science.7455683 · Cited by 18,497
A BEHAVIORAL MODEL OF RATIONAL CHOICE
Simon, H. A. (1955) · The Quarterly Journal of Economics · doi:10.2307/1884852 · Cited by 15,877
Nudge: improving decisions about health, wealth, and happiness
(2008) · Choice Reviews Online · doi:10.5860/choice.46-0977 · Cited by 11,572
Design Science in Information Systems Research1
Hevner, A. R., March, S. T., Park, J., & Ram, S. (2004) · MIS Quarterly · doi:10.2307/25148625 · Cited by 10,707 · cited 4×
“To investigate how Green IS needs to be implemented in order to change residential energy consumption, we follow the design science research paradigm, which is increasingly accepted as a viable IS research approach (Fischer 2011; Hevner et al. 2004; Iivari 2007).”
BackgroundMethodInfluentialBeyond Baron and Kenny: Statistical Mediation Analysis in the New Millennium
Hayes, A. F. (2009) · Communication Monographs · doi:10.1080/03637750903310360 · Cited by 9,757 · cited 2×
“Moreover, the non-parametric test does not require the normality of the sampling distribution (Hayes 2009) and has been shown to perform better in terms of statistical power and Type I errors in small-to moderate-sized samples (Fritz and MacKinnon 2007).”
MethodDesign science in information systems research
(2004) · Journal of the Association for Information Systems · doi:10.5555/2017212.2017217 · Cited by 8,254
A Design Science Research Methodology for Information Systems Research
Peffers, K., Tuunanen, T., Rothenberger, M. A., & Chatterjee, S. (2007) · Journal of Management Information Systems · doi:10.2753/mis0742-1222240302 · Cited by 7,832
Building a practically useful theory of goal setting and task motivation: A 35-year odyssey.
Locke, E. A., & Latham, G. P. (2002) · American Psychologist · doi:10.1037/0003-066x.57.9.705 · Cited by 7,766 · cited 6×
“However, the impact of defaults may be small if the recommended goal is not perceived as “one’s own goal” (Locke and Latham 2002, p. 708).”
BackgroundMethodInfluentialPerceived Behavioral Control, Self‐Efficacy, Locus of Control, and the Theory of Planned Behavior 1
Ajzen, I. (2002) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.2002.tb00236.x · Cited by 7,629
Self-discrepancy: A theory relating self and affect.
Higgins, E. T. (1987) · Psychological Review · doi:10.1037/0033-295x.94.3.319 · Cited by 7,219
Kluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882
Normative Influences on Altruism
Schwartz, S. H. (1977) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(08)60358-5 · Cited by 5,364
Bem, D. J. (1972) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(08)60024-6 · Cited by 5,241
Encouraging pro-environmental behaviour: An integrative review and research agenda
Steg, L., & Vlek, C. (2009) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2008.10.004 · Cited by 5,089
Required sample size to detect the mediated effect
Fritz, M. S., & MacKinnon, D. P. (2007) · Psychological Science · doi:10.1111/j.1467-9280.2007.01882.x · Cited by 4,810
Social Behavior: Its Elementary Forms
Hollander, E. P., & Homans, G. C. (1963) · The American Journal of Psychology · doi:10.2307/1419191 · Cited by 4,692
Procedures for Detecting Outlying Observations in Samples
Grubbs, F. E. (1969) · Technometrics · doi:10.1080/00401706.1969.10490657 · Cited by 4,105 · cited 1×
“To sort out such outliers, we applied Grubbs’ (1969) test from the outliers package for R to the data in two subsequent steps.”
MethodThe Constructive, Destructive, and Reconstructive Power of Social Norms
Schultz, P. W., Nolan, J. M., Cialdini, R. B., Goldstein, N. J., & Griskevicius, V. (2007) · Psychological Science · doi:10.1111/j.1467-9280.2007.01917.x · Cited by 3,643
The Nature of Theory in Information Systems1
Gregor, S. (2006) · MIS Quarterly · doi:10.2307/25148742 · Cited by 3,306 · cited 1×
“TPB, NAM, and similar models take the role of meta-theories (Gregor 2006) in that they provide a conceptual framework for understanding human behavior across disciplines and for guiding the design of effective intervention strategies (Stern 2011).”
MethodA review of intervention studies aimed at household energy conservation
Abrahamse, W., Steg, L., Vlek, C., & Rothengatter, T. (2005) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2005.08.002 · Cited by 2,668
Attention and Self-Regulation : A Control-Theory Approach to Human Behavior
Carver, C. S., & Scheier, M. F. (1981) · Medical Entomology and Zoology · Cited by 2,580
New Directions in Goal-Setting Theory
Locke, E. A., & Latham, G. P. (2006) · Current Directions in Psychological Science · doi:10.1111/j.1467-8721.2006.00449.x · Cited by 2,039
Carver, C. S., & Scheier, M. F. (1981) · Springer eBooks · doi:10.1007/978-1-4612-5887-2 · Cited by 2,035
Perugini, M., & Bagozzi, R. P. (2001) · British Journal of Social Psychology · doi:10.1348/014466601164704 · Cited by 1,802
Persuasive Systems Design: Key Issues, Process Model, and System Features
Oinas-Kukkonen, H., & Harjumaa, M. (2009) · Communications of the Association for Information Systems · doi:10.17705/1cais.02428 · Cited by 1,663 · cited 1×
“Although the potential of IT for implementing the previously mentioned modes of providing feedback on energy consumption in a cost-efficient and scalable way is evident, only a small number of studies on feedback interventions make use of information systems (Oinas-Kukkonen and Harjumaa 2009).”
BackgroundBuilding an Information System Design Theory for Vigilant EIS
Walls, J. G., Widmeyer, G. R., & El Sawy, O. A. (1992) · Information Systems Research · doi:10.1287/isre.3.1.36 · Cited by 1,604
Communications of the Association for Information Systems
(2017) · Communications of the Association for Information Systems · doi:10.17705/1cais · Cited by 1,603
Persuasion theory and research
O’Keefe, D. J. (1990) · Cited by 1,555
Systems Development in Information Systems Research
Nunamaker, J. F., Chen, M., & Purdin, T. D. M. (1990) · Journal of Management Information Systems · doi:10.1080/07421222.1990.11517898 · Cited by 1,215
Harnessing Green IT: Principles and Practices
Murugesan, S. (2008) · IT Professional · doi:10.1109/mitp.2008.10 · Cited by 1,184
Hayes, A. F., & Preacher, K. J. (2010) · Multivariate Behavioral Research · doi:10.1080/00273171.2010.498290 · Cited by 1,160
Watson, R. T., Boudreau, M.-C., & Chen, A. J. (2010) · MIS Quarterly · doi:10.2307/20721413 · Cited by 1,101
Building a Practically Useful Theory of Goal Setting and Task Motivation
Locke, E. A., & Latham, G. P. (2002) · American Psychologist · Cited by 1,070
Abrahamse, W., Steg, L., Vlek, C., & Rothengatter, T. (2007) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2007.08.002 · Cited by 880
Information Systems Innovation for Environmental Sustainability1
Melville, N. P. (2010) · MIS Quarterly · doi:10.2307/20721412 · Cited by 868
Information systems innovation for environmental sustainability
Melville, N. P. (2010) · MIS Quarterly · doi:10.5555/2017447.2017449 · Cited by 790
Abrahamse, W., & Steg, L. (2009) · Journal of Economic Psychology · doi:10.1016/j.joep.2009.05.006 · Cited by 784
A Paradigmatic Analysis of Information Systems As a Design Science
Iivari, J. (2007) · Scandinavian Journal of Information Systems · Cited by 724
FIRO, A Three-Dimensional Theory of Interpersonal Behavior
Schutz, W. C. (1958) · Journal of Symbolic Logic · Cited by 720
Use, E. (1984) · Medical Entomology and Zoology · Cited by 718
On theory development in design science research: anatomy of a research project
Kuechler, B., & Vaishnavi, V. (2008) · European Journal of Information Systems · doi:10.1057/ejis.2008.40 · Cited by 631
Social and Behavioral Aspects of Energy use
Lutzenhiser, L. (1993) · Annual Review of Energy and the Environment · doi:10.1146/annurev.eg.18.110193.001335 · Cited by 621
Armitage, C. J., & Conner, M. (1999) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.1999.tb01375.x · Cited by 601 · cited 1×
“Feedback has been commonly used in behavioral intervention design, especially in the health context (Ajzen 2002; Armitage and Conner 1999).”
MethodAnchoring, Activation, and the Construction of Values
Chapman, G. B., & Johnson, E. J. (1999) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1999.2841 · Cited by 598
Promoting household energy conservation
Steg, L. (2008) · Energy Policy · doi:10.1016/j.enpol.2008.09.027 · Cited by 592
A meta-analytic study of the effects of goal setting on task performance: 1966–1984
Mento, A. J., Steel, R. P., & Karren, R. J. (1987) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(87)90045-8 · Cited by 578
Green defaults: Information presentation and pro-environmental behaviour
Pichert, D., & Katsikopoulos, K. V. (2008) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2007.09.004 · Cited by 575
Froehlich (2009) · doi:10.1145/1518701.1518861 · Cited by 563
Household preferences for energy-saving measures: A conjoint analysis
Poortinga, W., Steg, L., Vlek, C., & Wiersma, G. (2003) · Journal of Economic Psychology · doi:10.1016/s0167-4870(02)00154-x · Cited by 518
Pro-Social Consumer Influence Strategies: When and how do they Work?
Osterhus, T. L. (1997) · Journal of Marketing · doi:10.1177/002224299706100402 · Cited by 464
Becker, L. J. (1978) · Journal of Applied Psychology · doi:10.1037//0021-9010.63.4.428 · Cited by 463
An agenda for ‘Green’ information technology and systems research
Jenkin, T. A., Webster, J., & McShane, L. (2011) · Information and Organization · doi:10.1016/j.infoandorg.2010.09.003 · Cited by 431
Behavioral dimensions of climate change: drivers, responses, barriers, and interventions
Gifford, R., Kormos, C., & McIntyre, A. (2011) · WIREs Climate Change · doi:10.1002/wcc.143 · Cited by 408
Bose, R., & Luo, X. (2011) · The Journal of Strategic Information Systems · doi:10.1016/j.jsis.2011.01.003 · Cited by 383
The Skeptical Shopper: A Metacognitive Account for the Effects of Default Options on Choice
Brown, C. L., & Krishna, A. (2004) · Journal of Consumer Research · doi:10.1086/425087 · Cited by 353
McCalley, L. T., & Midden, C. J. H. (2002) · Journal of Economic Psychology · doi:10.1016/s0167-4870(02)00119-8 · Cited by 353
Effecting Durable Change: A Team Approach to Improve Environmental Behavior in the Household
Staats, H., Harland, P., & Wilke, H. A. M. (2004) · Environment and Behavior · doi:10.1177/0013916503260163 · Cited by 342
Contributions of psychology to limiting climate change.
Stern, P. C. (2011) · American Psychologist · doi:10.1037/a0023235 · Cited by 336
One size does not fit all: applying the transtheoretical model to energy feedback technology design
He, H. A., Greenberg, S., & Huang, E. M. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753464 · Cited by 312
Changing organizational energy consumption behaviour through comparative feedback
SIERO, F. W., BAKKER, A. B., DEKKER, G. B., & VAN DEN BURG, M. T. C. (1996) · Journal of Environmental Psychology · doi:10.1006/jevp.1996.0019 · Cited by 306
Ueno, T., Sano, F., Saeki, O., & Tsuji, K. (2006) · Applied Energy · doi:10.1016/j.apenergy.2005.02.002 · Cited by 300
The Effect of Goal-Setting and Daily Electronic Feedback on In-Home Energy Use
van Houwelingen, J. H., & van Raaij, W. F. (1989) · Journal of Consumer Research · doi:10.1086/209197 · Cited by 288
Green IS: Building sustainable business practices
Watson, R. T. (2008) · Cited by 287
Predicting and understanding behavioral volitions: the interplay between goals and behaviors
Perugini, M., & Conner, M. (2000) · European Journal of Social Psychology · doi:10.1002/1099-0992(200009/10)30:5<705::aid-ejsp18>3.0.co;2-# · Cited by 286
The use of category and exemplar knowledge in the solution of anchoring tasks.
Mussweiler, T., & Strack, F. (2000) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.78.6.1038 · Cited by 265
Nudge Your Customers Toward Better Choices
Goldstein, D. G., Johnson, E. J., Herrmann, A. P., & Heitmann, M. (2008) · Alexandria (UniSG) (University of St.Gallen) · Cited by 239
Feedback as a means of decreasing residential energy consumption.
Seligman, C., & Darley, J. M. (1977) · Journal of Applied Psychology · doi:10.1037//0021-9010.62.4.363 · Cited by 234
Holmes (2007) · doi:10.1145/1254960.1254982 · Cited by 225
Goal-setting considerations for persuasive technologies that encourage physical activity
Consolvo, S., Klasnja, P., McDonald, D. W., & Landay, J. A. (2009) · Proceedings of the 4th International Conference on Persuasive Technology · doi:10.1145/1541948.1541960 · Cited by 217
Baskerville, R. (2008) · European Journal of Information Systems · doi:10.1057/ejis.2008.45 · Cited by 215
Factors Affecting Software Developers’ Performance: An Integrated Approach1
Rasch, R. H., & Tosi, H. L. (1992) · MIS Quarterly · doi:10.2307/249535 · Cited by 203
Determinants of Responsible Environmental Behavior
McKenzie‐Mohr, D., Nemiroff, L. S., Beers, L., & Desmarais, S. (1995) · Journal of Social Issues · doi:10.1111/j.1540-4560.1995.tb01352.x · Cited by 199
Neubert, M. J. (1998) · Human Performance · doi:10.1207/s15327043hup1104_2 · Cited by 196
Colette, A., Koelemeijer, R. B. A., Mellios, G., Schucht, S., Kouridis, C., Bessagnet, B., Eerens, H., van Velze, K., & Rouïl, L. (2012) · Cited by 187
Toward an Understanding of Satisfaction with the Process and Outcomes of Teamwork
Reinig, B. A. (2003) · Journal of Management Information Systems · doi:10.1080/07421222.2003.11045750 · Cited by 185
Energy productivity improvements and the rebound effect: An overview of the state of knowledge
Dimitropoulos, J. (2007) · Energy Policy · doi:10.1016/j.enpol.2007.07.028 · Cited by 179
Role of performance goals in prose learning.
LaPorte, R. E., & Nath, R. (1976) · Journal of Educational Psychology · doi:10.1037/0022-0663.68.3.260 · Cited by 176
Supporting virtual team-building with a GSS: an empirical investigation
Huang, W. W., Wei, K., Watson, R. T., & Tan, B. C. Y. (2003) · Decision Support Systems · doi:10.1016/s0167-9236(02)00009-x · Cited by 170
Donovan, J. J., & Williams, K. J. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.3.379 · Cited by 169
Assessing Communication Effects on Energy Conservation
Craig, C. S., & McCann, J. M. (1978) · Journal of Consumer Research · doi:10.1086/208718 · Cited by 156
The Impact of Goals on Software Project Management: An Experimental Investigation1
Abdel-Hamid, T. K., Sengupta, K. C., & Swett, C. (1999) · MIS Quarterly · doi:10.2307/249488 · Cited by 150
Chen, J., Taylor, J. E., & Wei, H.-H. (2011) · Energy and Buildings · doi:10.1016/j.enbuild.2011.12.026 · Cited by 141
Meyer, J. P., & Gellatly, I. R. (1988) · Journal of Applied Psychology · doi:10.1037//0021-9010.73.3.410 · Cited by 133
Peschiera, G., & Taylor, J. E. (2012) · Energy and Buildings · doi:10.1016/j.enbuild.2012.03.011 · Cited by 131
Green Information Technologies and Systems: Employees’ Perceptions of Organizational Practices
Jenkin, T. A., McShane, L., & Webster, J. (2011) · Business & Society · doi:10.1177/0007650311398640 · Cited by 124
Self-Perception Based Strategies for Stimulating Energy Conservation
Allen, C. T. (1982) · Journal of Consumer Research · doi:10.1086/208878 · Cited by 106
Hutton, R. B., Mauser, G. A., Filiatrault, P., & Ahtola, O. T. (1986) · Journal of Consumer Research · doi:10.1086/209072 · Cited by 104
Self-Regulation of Performance: Goal Establishment and Goal Revision Processes in Athletes
Williams, K. J., Donovan, J. J., & Dodge, T. L. (2000) · Human Performance · doi:10.1207/s15327043hup1302_3 · Cited by 103
Hong Kong, Singapore, and “Asian Values”: An Alternative View
Chan, J. (1997) · Journal of democracy · doi:10.1353/jod.1997.0018 · Cited by 97
Design and Evaluation of a Social Visualization Aimed at Encouraging Sustainable Behavior
Grevet, C., Mankoff, J. C., & Anderson, S. D. (2010) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2010.135 · Cited by 72
Biswas, D., & Grau, S. L. (2008) · Psychology and Marketing · doi:10.1002/mar.20217 · Cited by 69
Shiraishi, M., Washio, Y., Takayama, C., Lehdonvirta, V., Kimura, H., & Nakajima, T. (2009) · International Conference on Persuasive Technology · doi:10.1145/1541948.1541967 · Cited by 67
Promoting Energy Conservation in Master‐Metered Apartments through Group Financial Incentives1
McClelland, L., & Cook, S. W. (1980) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.1980.tb00690.x · Cited by 58
Ilieș, R., Judge, T. A., & Wagner, D. T. (2010) · European Psychologist · doi:10.1027/1016-9040/a000011 · Cited by 57
Green IS Design and Energy Conservation: An Empirical Investigation of Social Normative Feedback
Loock, C.-M., Staake, T., & Landwehr, J. R. (2011) · AIS Electronic Library (AISeL) · Cited by 48
Self-citationUBIGreen: Investigating a Mobile Tool for Tracking and Supporting Green Transportation Habits
Froehlich, J. E., Dillahunt, T. R., Klasnja, P., Mankoff, J., Consolvo, S., Harrison, B. L., & Landay, J. A. (2018) · KiltHub Repository · doi:10.1184/r1/6470591 · Cited by 46
Cao, J., Crews, J. M., Lin, M., Deokar, A. V., Burgoon, J. K., & Nunamaker, J. F. (2006) · Journal of Management Information Systems · doi:10.2753/mis0742-1222220408 · Cited by 43
Conserving Energy by Inducing People to Drive Less
Graham, J., Koo, M., & Wilson, T. D. (2011) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.2010.00704.x · Cited by 43
The effect of feedback and focused advice on household energy consumption
Haakana, M., Sillanpaeae, L., & Talsi, M. (1997) · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · Cited by 41
Thambusamy, R., & Salam, A. F. (2010) · BearWorks (Missouri State University) · Cited by 38
Johnson, E. J., & Goldstein, D. (2003) · Science · doi:10.1126/science.1091721 · Cited by 35
Perugini, M. (2004) · doi:10.4324/9780203645031-14 · Cited by 31
Fischer, C. (2011) · Journal of the Association for Information Systems · Cited by 13
Cited by
Understanding household energy consumption behavior: The contribution of energy big data analytics
Zhou, K., & Yang, S. (2016) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2015.12.001 · Cited by 398
Encouraging pro-environmental behaviours: A review of methods and approaches
Grilli, G., & Curtis, J. (2021) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.110039 · Cited by 279
Information systems solutions for environmental sustainability: How can we do more?
University of Illinois Springfield, Gholami, R., Watson, R., University of Georgia, Hasan, H., University of Wollongong, Molla, A., RMIT University, Bjorn-Andersen, N., & School, C. B. (2016) · Journal of the Association for Information Systems · doi:10.17705/1jais.00435 · Cited by 185
Sustainable Electric Vehicle Charging using Adaptive Pricing
Valogianni, K., Ketter, W., Collins, J., & Zhdanov, D. (2020) · Production and Operations Management · doi:10.1111/poms.13179 · Cited by 103
Filler, A., Kowatsch, T., Haug, S., Wahle, F., Staake, T., & Fleisch, E. (2015) · 2015 Wireless Telecommunications Symposium (WTS) · doi:10.1109/wts.2015.7117255 · Cited by 63
“As a consequence, the design of effective and efficient behavioral interventions based upon theories on behavior change has been investigated for several decades in various application domains such as health [1], education [2], criminology [3] or energy [4].”
BackgroundSelf-citation
Metadata
- Authors
- Loock, C.-M., Staake, T., & Thiesse, F.
- Venue
- MIS Quarterly
- Publisher
- MIS Quarterly
- Published
- 2013-12-01
- Volume
- 37
- Issue
- 4
- Pages
- 1313-1332
- ISSN
- 0276-7783 (ISSN-L)
- 2162-9730
- OpenAlex
- W87560683
- Cited by
- 254
- References
- 105
- FWCI
- 59.25
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.