The DOI matches its Crossref record; 103 of the 103 references it cites were found in a registry or an index.
Experience-Driven Procedural Content Generation
Abstract
Procedural content generation (PCG) is an increasingly important area of technology within modern human-computer interaction (HCI) design. Personalization of user experience via affective and cognitive modeling, coupled with real-time adjustment of the content according to user needs and preferences are important steps toward effective and meaningful PCG. Games, Web 2.0, interface, and software design are among the most popular applications of automated content generation. The paper provides a taxonomy of PCG algorithms and introduces a framework for PCG driven by computational models of user experience. This approach, which we call Experience-Driven Procedural Content Generation (EDPCG), is generic and applicable to various subareas of HCI. We employ games as an example indicative of rich HCI and complex affect elicitation, and demonstrate the approach's effectiveness via dissimilar successful studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Flow: the psychology of optimal experience
(1990) · Choice Reviews Online · doi:10.5860/choice.28-0597 · Cited by 12,637
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
The Cognitive Structure of Emotions
Ortony, A., Clore, G. L., & Collins, A. (1988) · doi:10.1017/cbo9780511571299 · Cited by 6,208
Core affect and the psychological construction of emotion.
Russell, J. A. (2003) · Psychological Review · doi:10.1037/0033-295x.110.1.145 · Cited by 6,113 · cited 1×
“Modelbased refers to models derived from emotion theories such as the popular emotional dimensions of arousal and valence [19] in which bodily responses are mapped to specific emotional”
MethodThe Behavior of Organisms: An Experimental Analysis
Jones, F. N., & Skinner, B. F. (1939) · The American Journal of Psychology · doi:10.2307/1416495 · Cited by 4,398
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
Toward machine emotional intelligence: analysis of affective physiological state
Picard, R. W., Vyzas, E., & Healey, J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.954607 · Cited by 2,334
Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications
Calvo, R. A., & D'Mello, S. (2010) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2010.1 · Cited by 1,893 · cited 1×
“Attempts at generating game content procedurally have a fairly long history as PCG aspects appear in games such as Rogue (Toy and Wichman, 1980), Diablo (Blizzard Entertainment, 1996) and Elite (Acornsoft, 1984).”
BackgroundMathematical models for cellular interactions in development I. Filaments with one-sided inputs
Lindenmayer, A. (1968) · Journal of Theoretical Biology · doi:10.1016/0022-5193(68)90079-9 · Cited by 1,620
Takagi, H. (2001) · Proceedings of the IEEE · doi:10.1109/5.949485 · Cited by 1,327
A Theory of Fun for Game Design
Koster, R., & Wright, W. (2004) · Cited by 1,110
Flow: The Psychology of Optimal Experience
Amada, G. (1991) · American Journal of Psychotherapy · doi:10.1176/appi.psychotherapy.1991.45.1.142 · Cited by 1,018
Play between worlds: exploring online game culture
(2007) · Choice Reviews Online · doi:10.5860/choice.44-2540 · Cited by 909
A casual revolution: reinventing video games and their players
(2010) · Choice Reviews Online · doi:10.5860/choice.47-6689 · Cited by 884
Mimesis as Make-Believe: On the Foundations of the Representational Arts
Howard, V. A., & Binghamton University State University of New York (1993) · International Studies in Philosophy · doi:10.5840/intstudphil1993251117 · Cited by 861
Pupil size variation as an indication of affective processing
Partala, T., & Surakka, V. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00017-x · Cited by 836
What makes things fun to learn? heuristics for designing instructional computer games
Malone, T. W. (1980) · Proceedings of the 3rd ACM SIGSMALL symposium and the first SIGPC symposium on Small systems - SIGSMALL '80 · doi:10.1145/800088.802839 · Cited by 758
Play Between Worlds: Exploring Online Game Culture
Taylor, T. L. (2006) · The MIT Press eBooks · doi:10.7551/mitpress/5418.001.0001 · Cited by 722
Compositional pattern producing networks: A novel abstraction of development
Stanley, K. O. (2007) · Genetic Programming and Evolvable Machines · doi:10.1007/s10710-007-9028-8 · Cited by 713
Search-Based Procedural Content Generation: A Taxonomy and Survey
Togelius, J., Yannakakis, G. N., Stanley, K. O., & Browne, C. (2011) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2011.2148116 · Cited by 706
Self-citationFundamentals of physiological computing
Fairclough, S. H. (2009) · Interacting with Computers · doi:10.1016/j.intcom.2008.10.011 · Cited by 608
Mandryk, R. L., & Atkins, M. S. (2007) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2006.11.011 · Cited by 538
Using psychophysiological techniques to measure user experience with entertainment technologies
Mandryk, R. L., Inkpen, K. M., & Calvert, T. W. (2006) · Behaviour & Information Technology · doi:10.1080/01449290500331156 · Cited by 518
Probabilistic assessment of user's emotions in educational games
Conati, C. (2002) · Applied Artificial Intelligence · doi:10.1080/08839510290030390 · Cited by 498
Carroll, N., & Walton, K. L. (1995) · The Philosophical Quarterly · doi:10.2307/2219853 · Cited by 486
Representations for Genetic and Evolutionary Algorithms
(2006) · Springer eBooks · doi:10.1007/3-540-32444-5 · Cited by 470
Valence focus and arousal focus: Individual differences in the structure of affective experience.
Feldman, L. A. (1995) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.69.1.153 · Cited by 465
A Taxonomy for Artificial Embryogeny
Stanley, K. O., & Miikkulainen, R. (2003) · Artificial Life · doi:10.1162/106454603322221487 · Cited by 425
Studying the emotion-antecedent appraisal process: An expert system approach
Scherer, K. R. (1993) · Cognition & Emotion · doi:10.1080/02699939308409192 · Cited by 415
Drachen, A., Nacke, L. E., Yannakakis, G., & Pedersen, A. L. (2010) · Proceedings of the 5th ACM SIGGRAPH Symposium on Video Games · doi:10.1145/1836135.1836143 · Cited by 372
Self-citationSpatial Presence and Emotions during Video Game Playing: Does It Matter with Whom You Play?
Ravaja, N., Saari, T., Turpeinen, M., Laarni, J., Salminen, M., & Kivikangas, M. (2006) · Presence: Teleoperators and Virtual Environments · doi:10.1162/pres.15.4.381 · Cited by 322
An empirical study of machine learning techniques for affect recognition in human–robot interaction
Rani, P., Liu, C., Sarkar, N., & Vanman, E. (2006) · Pattern Analysis and Applications · doi:10.1007/s10044-006-0025-y · Cited by 313
Player modeling using self-organization in Tomb Raider: Underworld
Drachen, A., Canossa, A., & Yannakakis, G. N. (2009) · 2009 IEEE Symposium on Computational Intelligence and Games · doi:10.1109/cig.2009.5286500 · Cited by 285
Self-citationTowards automatic personalised content creation for racing games
Togelius, J., De Nardi, R., & Lucas, S. M. (2007) · 2007 IEEE Symposium on Computational Intelligence and Games · doi:10.1109/cig.2007.368106 · Cited by 283
Self-citationF�rnkranz, J., & Hllermeier, E. (2010) · Cited by 259
Representations for Genetic and Evolutionary Algorithms
Rothlauf, F. (2006) · Representations for Genetic and Evolutionary Algorithms · doi:10.1007/3-540-32444-5_2 · Cited by 257
Kessous, L., Castellano, G., & Caridakis, G. (2010) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-009-0025-5 · Cited by 256
An experiment in automatic game design
Togelius, J., & Schmidhuber, J. (2008) · 2008 IEEE Symposium On Computational Intelligence and Games · doi:10.1109/cig.2008.5035629 · Cited by 246
Self-citationThree ways to grow designs: a comparison of embryogenies for an evolutionary design problem
Bentley, P. J., & Kumar, S. (1999) · Cited by 238
Graphical applications of L-systems
Prusinkiewicz, P. (1986) · doi:10.20380/gi1986.44 · Cited by 236
The definition and rendering of terrain maps
Miller, G. S. P. (1986) · ACM SIGGRAPH Computer Graphics · doi:10.1145/15886.15890 · Cited by 234
Modeling Player Experience for Content Creation
Pedersen, C., Togelius, J., & Yannakakis, G. N. (2010) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2010.2043950 · Cited by 231
Self-citationBoredom, engagement and anxiety as indicators for adaptation to difficulty in games
Chanel, G., Rebetez, C., Bétrancourt, M., & Pun, T. (2008) · Proceedings of the 12th international conference on Entertainment and media in the ubiquitous era · doi:10.1145/1457199.1457203 · Cited by 229
Towards Automatic Personalized Content Generation for Platform Games
Shaker, N., Yannakakis, G., & Togelius, J. (2010) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v6i1.12399 · Cited by 224
Self-citationA data mining approach to strategy prediction
Weber, B. G., & Mateas, M. (2009) · 2009 IEEE Symposium on Computational Intelligence and Games · doi:10.1109/cig.2009.5286483 · Cited by 223
Interactive Storytelling: A Player Modelling Approach
Thue, D., Bulitko, V., Spetch, M., & Wasylishen, E. (2007) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v3i1.18780 · Cited by 205
Real-Time Game Adaptation for Optimizing Player Satisfaction
Yannakakis, G. N., & Hallam, J. (2009) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2009.2024533 · Cited by 199
Self-citationPhysiological indicators for the evaluation of co-located collaborative play
Mandryk, R. L., & Inkpen, K. M. (2004) · Proceedings of the 2004 ACM conference on Computer supported cooperative work · doi:10.1145/1031607.1031625 · Cited by 191
Game Usability: Advancing the Player Experience
Isbister, K., & Schaffer, N. (2008) · Cited by 178
The advantages of generative grammatical encodings for physical design
Hornby, G. S., & Pollack, J. B. (2002) · Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546) · doi:10.1109/cec.2001.934446 · Cited by 176
Isbister, K., & Schaffer, N. (2008) · CRC Press eBooks · doi:10.1201/b14580 · Cited by 169
Modeling player experience in Super Mario Bros
Pedersen, C., Togelius, J., & Yannakakis, G. N. (2009) · 2009 IEEE Symposium on Computational Intelligence and Games · doi:10.1109/cig.2009.5286482 · Cited by 166
Self-citationEvaluating a Computational Model of Emotion
Gratch, J., & Marsella, S. (2005) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-005-1081-1 · Cited by 161
Search-Based Procedural Content Generation
Togelius, J., Yannakakis, G. N., Stanley, K. O., & Browne, C. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-12239-2_15 · Cited by 156
Self-citationEvolving content in the Galactic Arms Race video game
Hastings, E. J., Guha, R. K., & Stanley, K. O. (2009) · IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2009.5286468 · Cited by 146
Bateman, C. M., & Boon, R. T. (2005) · UBIR (University of Greater Manchester) · Cited by 140
Fürnkranz, J., & Hüllermeier, E. (2010) · Springer eBooks · doi:10.1007/978-3-642-14125-6 · Cited by 132
BCI for Games: A ‘State of the Art’ Survey
Nijholt, A. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-89222-9_29 · Cited by 129
TOWARDS OPTIMIZING ENTERTAINMENT IN COMPUTER GAMES
Yannakakis, G. N., & Hallam, J. C. T. (2007) · Applied Artificial Intelligence · doi:10.1080/08839510701527580 · Cited by 123
Self-citationTowards gameplay analysis via gameplay metrics
Drachen, A., & Canossa, A. (2009) · International Academic Mindtrek Conference (Mindtrek) · doi:10.1145/1621841.1621878 · Cited by 118
Towards multiobjective procedural map generation
Togelius, J., Preuß, M., & Yannakakis, G. N. (2010) · doi:10.1145/1814256.1814259 · Cited by 113
Self-citationTowards affective camera control in games
Yannakakis, G. N., Martínez, H. P., & Jhala, A. H. (2010) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-010-9078-0 · Cited by 113
Self-citationNon-intrusive Physiological Monitoring for Automated Stress Detection in Human-Computer Interaction
Barreto, A. B., Zhai, J., & Adjouadi, M. (2007) · Springer eBooks · doi:10.1007/978-3-540-75773-3_4 · Cited by 112
Multiobjective exploration of the StarCraft map space
Togelius, J., Preuß, M., Beume, N., Wessing, S., Hagelbäck, J., & Yannakakis, G. N. (2010) · IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/itw.2010.5593346 · Cited by 111
Self-citationTowards a Generic Framework for Automated Video Game Level Creation
Sorenson, N., & Pasquier, P. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-12239-2_14 · Cited by 110
Maintaining Optimal Challenge in Computer Games through Real-Time Physiological Feedback
Rani, P., Sarkar, N., & Liu, C. (2005) · Cited by 108
Doyle, J. (2004) · Computational Intelligence · doi:10.1111/j.0824-7935.2004.00233.x · Cited by 107
Entertainment capture through heart rate activity in physical interactive playgrounds
Yannakakis, G. N., Hallam, J. C. T., & Lund, H. H. (2007) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-007-9036-7 · Cited by 106
Self-citationAffective game engines: motivation and requirements
Hudlická, E. (2009) · International Conference on the Foundations of Digital Games (FDG) · doi:10.1145/1536513.1536565 · Cited by 101
A Metric for Entertainment of Boardgames: Its Implication for Evolution of Chess Variants
Iida, H., Takeshita, N., & Yoshimura, J. (2003) · IFIP advances in information and communication technology · doi:10.1007/978-0-387-35660-0_8 · Cited by 100
An affectively driven planner for synthetic characters
Aylett, R. S., Dias, J., & Paiva, A. (2006) · Cited by 99
Variations Forever: Flexibly generating rulesets from a sculptable design space of mini-games
Smith, A. M., & Mateas, M. (2010) · IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/itw.2010.5593343 · Cited by 94
Player Modeling for Intelligent Difficulty Adjustment
Missura, O., & Gärtner, T. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-04747-3_17 · Cited by 92
Automatic generation and evaluation of recombination games
Browne, C. (2008) · Cited by 92
In situ informants exploring an emotional mobile messaging system in their everyday practice
Sundström, P., Ståhl, A., & Höök, K. (2007) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2006.11.013 · Cited by 89
Extending Reinforcement Learning to Provide Dynamic Game Balancing
de Andrade, G. D., Ramalho, G. L., Santana, H., & Corruble, V. (2005) · HAL · Cited by 89
Learning Human-like Movement Behavior for Computer Games
Thurau, C., Bauckage, C., & Sagerer, G. (2004) · The MIT Press eBooks · doi:10.7551/mitpress/3122.003.0040 · Cited by 83
Integrating procedural generation and manual editing of virtual worlds
Smelik, R. M., Tutenel, T., de Kraker, K. J., & Rafael Bidarra, E. (2010) · doi:10.1145/1814256.1814258 · Cited by 80
Automatic Design of Balanced Board Games
Hom, V., & Marks, J. (2007) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v3i1.18777 · Cited by 79
Modeling enjoyment preference from physiological responses in a car racing game
Tognetti, S., Garbarino, M., Bonarini, A., & Matteucci, M. (2010) · IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/itw.2010.5593337 · Cited by 75
Real-time challenge balance in an RTS game using rtNEAT
Olesen, J. K., Yannakakis, G. N., & Hallam, J. C. T. (2008) · IEEE Symposium on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2008.5035625 · Cited by 75
Self-citationPreference Learning for Cognitive Modeling: A Case Study on Entertainment Preferences
Yannakakis, G. N., Μaragoudakis, M., & Hallam, J. C. T. (2009) · IEEE Transactions on Systems Man and Cybernetics - Part A Systems and Humans · doi:10.1109/tsmca.2009.2028152 · Cited by 69
Self-citationA computational model of narrative generation for suspense
Cheong, Y.-G. (2006) · NCSU Libraries Repository (North Carolina State University Libraries) · Cited by 67
Bateman, C., & Nacke, L. E. (2010) · International Academic Conference on the Future of Game Design and Technology (Futureplay) · doi:10.1145/1920778.1920780 · Cited by 66
Creativity and Artificial Intelligence: A Conceptual Blending Approach
Pereira, F. C., & Francisco (2007) · Cited by 62
Player Modeling Impact on Player’s Entertainment in Computer Games
Yannakakis, G. N., & Μaragoudakis, M. (2005) · Lecture notes in computer science · doi:10.1007/11527886_11 · Cited by 60
Self-citationTowards Capturing and Enhancing Entertainment in Computer Games
Yannakakis, G. N., & Hallam, J. C. T. (2006) · Lecture notes in computer science · doi:10.1007/11752912_43 · Cited by 58
Self-citationEmotion Recognition Using Physiological and Speech Signal in Short-Term Observation
Kim, J., & André, E. (2006) · Lecture notes in computer science · doi:10.1007/11768029_6 · Cited by 51
Automatic generation of game elements via evolution
Ashlock, D. (2010) · IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/itw.2010.5593341 · Cited by 49
Predicting User Physiological Response for Interactive Environments: An Inductive Approach
McQuiggan, S. W., Lee, S., & Lester, J. C. (2006) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v2i1.18747 · Cited by 48
Preference learning for affective modeling
Yannakakis, G. N. (2009) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2009.5349491 · Cited by 46
Self-citationSundström, P. (2005) · Cited by 38
Siren: Towards adaptive serious games for teaching conflict resolution
Yannakakis, G. N., Togelius, J., Khaled, R., Jhala, A. H., Karpouzis, K. C., Paiva, A., & Vasalou, A. (2010) · OAR@UM (University of Malta) · Cited by 35
Self-citationClosing the loop: from affect recognition to empathic interaction
Leite, I., Pereira, A., Mascarenhas, S. F., Castellano, G., Martinho, C., Prada, R., & Paiva, A. (2010) · International Workshop on Affective Interaction in Natural Environments (AFFINE) · doi:10.1145/1877826.1877839 · Cited by 27
Story Planning with Vignettes: Toward Overcoming the Content Production Bottleneck
Riedl, M., & Sugandh, N. (2006) · Lecture notes in computer science · doi:10.1007/978-3-540-89454-4_23 · Cited by 25
Evolving 3D Buildings for the Prototype Video Game Subversion
Martin, A., Lim, A. E. B., Colton, S., et al. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-12239-2_12 · Cited by 22
Genetic search feature selection for affective modeling
Martínez, H. P., & Yannakakis, G. N. (2010) · International Workshop on Affective Interaction in Natural Environments (AFFINE) · doi:10.1145/1877826.1877832 · Cited by 21
Self-citationDifficulty Scaling through Incongruity
van Lankveld, G., Spronck, P. H. M., & Rauterberg, M. (2008) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v4i1.18706 · Cited by 20
A Neuro-fuzzy Approach to User Attention Recognition
Asteriadis, S., Karpouzis, K., & Kollias, S. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-87536-9_95 · Cited by 15
Preparing for the aftermath: Using emotional agents in game-based training for disaster response
Djordjevich, D. D., Xavier, P. G., Bernard, M. L., et al. (2008) · IEEE Symposium on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2008.5035649 · Cited by 15
Authoring an Interactive Narrative with Declarative Optimization-Based Drama Management
Nelson, M., Ashmore, C., & Mateas, M. (2006) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v2i1.18761 · Cited by 13
Image and Video Processing for Affective Applications
Pantić, M., & Caridakis, G. (2010) · Cognitive technologies · doi:10.1007/978-3-642-15184-2_7 · Cited by 6
Cited by
Search-Based Procedural Content Generation: A Taxonomy and Survey
Togelius, J., Yannakakis, G. N., Stanley, K. O., & Browne, C. (2011) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2011.2148116 · Cited by 706
Self-citationContext-Aware Emotion Recognition Networks
Lee, J., Kim, S., Kim, S., Park, J., & Sohn, K. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.01024 · Cited by 323
Deep learning for human affect recognition: Insights and new developments
Rouast, P. V., Adam, M. T. P., & Chiong, R. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2890471 · Cited by 243
Yannakakis, G. N. (2012) · Proceedings of the 9th conference on Computing Frontiers · doi:10.1145/2212908.2212954 · Cited by 179
Self-citationUnderstanding procedural content generation: a design-centric analysis of the role of PCG in games
Smith, G. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557341 · Cited by 56
Metadata
- Authors
- Yannakakis, G. N., & Togelius, J.
- Venue
- IEEE Transactions on Affective Computing
- Published
- 2011-07
- Volume
- 2
- Issue
- 3
- Pages
- 147-161
- ISSN
- 1949-3045 (ISSN-L)
- OpenAlex
- W2113410615
- Cited by
- 470
- References
- 103
- FWCI
- 36.96
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
