The DOI matches its DataCite record; 45 of the 45 references it cites were found in a registry or an index; none of the 57 sources its claims cite is checked for support yet.
Working with AI: Measuring the Applicability of Generative AI to Occupations
Open accessAbstract
With generative AI emerging as a general-purpose technology, understanding its economic effects is among society's most pressing questions. Earlier work on AI impact largely relied on predictions of AI capabilities or focused narrowly on individual firms. Drawing instead on real-world AI usage, we analyze a dataset of 200k anonymized conversations with Microsoft Bing Copilot to measure AI applicability to occupations. We use an LLM-based pipeline to classify the O*NET work activities assisted or performed by AI in each conversation. We find that the most common and successful AI-assisted work activities involve information work--the creation, processing, and communication of information. At the occupation level, we find widespread AI applicability cutting across sectors, as most occupations have information work components. Our methodology also allows us to predict which occupations are more likely to delegate tasks to AI and which are more likely to use AI to assist existing workflows. Finally, we see an increase in occupation-level AI applicability over our 9-month data period, driven primarily by people using AI for more varied tasks. AI applicability scores and component usage and success metrics are available at https://github.com/microsoft/working-with-ai.
Overview
CoChat Summary
TL;DR
Analyzing 200k anonymized Microsoft Bing Copilot conversations from January–September 2024, the paper maps real-world generative AI usage to O*NET work activities and computes occupation-level AI applicability scores. It finds AI is most often and most successfully used for information work, with broad but uneven applicability across occupations and increasing task variety over the nine-month period.
Key findings
- Information work dominates: the most common and successful AI-assisted activities involve creating, gathering, and disseminating information. Top occupations by AI applicability score include Interpreters and Translators (0.492), Historians (0.462), Writers and Authors (0.454), Sales Representatives of Services (0.449), and Customer Service Representatives (0.408); top SOC major groups are Computer & Mathematical (0.29), Sales & Related (0.29), and Office & Administrative Support (0.26).
- AI applicability is widespread but weakly related to wage: most occupations have at least some AI applicability, and the employment-weighted correlation between AI applicability and occupational wage is r = 0.13. The score correlates with Eloundou et al.’s exposure predictions at employment-weighted r = 0.73, but the authors suggest prior work underestimated relevance to some information work occupations like proofreaders and software developers.
- User goals and AI actions differ: in 40% of conversations the user-goal and AI-action IWA sets are disjoint, and in 96% there are more IWAs unique to one side than in common; for every work activity matched to a user goal, the AI performs an average of two work activities in service of the request. Media and financial operations occupations are relatively likelier to delegate tasks to AI, while physical occupations like food preparation are likelier to use AI assistively.
- Over the 9-month period, the number of user goals covering 75% of activity increases from 20 to 28, and IWA distribution entropy increases by about 0.5 bits (≈40% increase in perplexity). Coverage is the primary contributor to AI applicability scores: a coverage-only ranking has Kendall tau 0.88 with the full score, adding scope raises it to 0.95, and completion provides the last 0.05.
Methods
- Data: 200k anonymized, privacy-scrubbed U.S. Bing Copilot conversations from January 1 to September 30, 2024, split into COPILOT-UNIFORM (~100k uniform sample) and COPILOT-THUMBS (100k conversations with at least one thumbs up/down). The analysis uses O*NET 29.0, 2023 BLS OEWS data, and 2024 CPS data, covering 785 SOC codes and 149.8 million workers.
- Classification pipeline: two-stage GPT-4o prompts summarize each conversation’s user goal and AI action in the style of O*NET Intermediate Work Activities (IWAs), generate four rewordings, rank all 332 IWAs by embedding cosine similarity, then binary-classify each IWA as matching the user goal and/or AI action. Validation against human annotations on 195 conversations found human-human κ ≈ 0.51 and human-LLM pipeline κ ≈ 0.40 on a held-out test set, with overall agreement well over 90%.
- Metrics: activity share is computed with a 0.05% coverage threshold; success is measured via thumbs positive feedback share, an LLM completion classifier, and a six-point scope rating. These are aggregated into occupation-level AI applicability scores using O*NET importance weights, separately for user goals and AI actions, then averaged.
Limitations
- Paper-stated: the data are from 2024 and models have improved since; the data represent only one AI platform (Bing Copilot), while other platforms differ (e.g., ChatGPT skews toward writing, Claude toward coding and mathematics); completion and scope measure AI utility toward an IWA, not productivity impact on workers; O*NET is U.S.-centric, may lag current workplace activities, and does not capture non-occupational work or the “connecting glue” between tasks.
- Paper-stated: the 0.05% coverage threshold means absolute scores depend strongly on the threshold, so relative comparisons are more meaningful; thumbs feedback may suffer selection bias; IWA classification has moderate κ values due to unclear boundaries between IWAs; scope validation shows substantial variance and a larger human-human vs. human-LLM gap than IWA classification.
- Evident from the text: the study is observational and usage-based, so it does not establish causal effects of AI on employment or wages; the authors explicitly caution that automation vs. augmentation conclusions are hard to predict. Reproducibility is limited because raw conversations cannot be released, though aggregated metrics are public; employment weighting materially affects wage/education correlations (unweighted r = 0.17 for user goals and 0.32 for AI actions vs. weighted r = 0.13).
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures

















![Figure K.18: AI applicability scores by predicted exposure AI applicability score versus E1 exposure from Eloundou et al. [3], the fraction of an occupation's tasks for which human raters predicted LLMs could reduce completion time by 50%. Occupations are colored by their distance from the employment-weighted regression line: blue points have higher AI applicability scores than would be expected from their E1 exposure.](https://figures.cochat.ai/paper-figures/82c3370c93a24ad2ba049bb62f6251b9/working-with-ai-measuring-the-applicability-of-generative-ai-to-occupations-figure-18.png)














Verification
Claims the paper makes
0 Valid · 4 Not valid · 32 Not checked · 156 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We find that the most common and successful AI-assisted work activities involve information work-the creation, processing, and communication of information.”
§ Working with AI: Measuring the Applicability of Generative AI to Occupations > Abstract
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“At the occupation level, we find widespread AI applicability cutting across sectors, as most occupations have information work components.”
§ Working with AI: Measuring the Applicability of Generative AI to Occupations > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In most conversations, there are multiple IWA matches on both sides (on average, about 3 user goal IWAs and 6 AI action IWAs out of 332 total; see Figure K.6).”
§ Working with AI: Measuring the Applicability of Generative AI to Occupations > 4.1 Work activity classification
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“GWAs focused on learning and communication are most prevalent, echoing the results in Figure 1A,B.”
§ Working with AI: Measuring the Applicability of Generative AI to Occupations > 5.1 Work activities
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Conversely, to the extent that AI is used for more physical occupations like those in the food preparation and serving category, it is likely to be in a more assistive role.”
§ Working with AI: Measuring the Applicability of Generative AI to Occupations > 5.2 AI applicability to occupations
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
73 more claims
Create a free account to see all 192 claims and every source verdict.
- It may state two separate claims as one. 78
- Probably not a substantial claim. 51
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“AI exposure should thus be thought of as the potential rather than realized substitution of AI for human tasks, though recent work has shown a high correlation between our chosen AI exposure measures and real task usage using Microsoft Bing Copilot (Tomlinson et al. (2025)).”
From How Retrainable are AI-Exposed Workers? (2025) · cites this paper as Tomlinson et al. (2025)
Citations
Cites
The future of employment: How susceptible are jobs to computerisation?
Frey, C. B., & Osborne, M. A. (2017) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2016.08.019 · Cited by 8,727
The Skill Content of Recent Technological Change: An Empirical Exploration
Autor, D. H., Levy, F., & Murnane, R. J. (2003) · The Quarterly Journal of Economics · doi:10.1162/003355303322552801 · Cited by 6,205
Estimating within-group interrater reliability with and without response bias
James, L. R., Demaree, R. G., & Wolf, G. (1984) · Journal of Applied Psychology · doi:10.1037/0021-9010.69.1.85 · Cited by 4,774 · cited 1×
“The test set user goal and AI action r wg scores [58] (where 1 indicates perfect agreement and 0 only agreement due to chance) between the human rater pairs were 0.48 ( n = 55 ), 0.32 ( n = 66 ), 0.55 ( n = 51 ) and 0.66 ( n = 74 ), 0.12 ( n = 89 ), 0.30 ( n = 88 ), respectively.”
InfluentialWhy Are There Still So Many Jobs? The History and Future of Workplace Automation
Autor, D. H. (2015) · Journal of Economic Perspectives · doi:10.1257/jep.29.3.3 · Cited by 3,917
General purpose technologies ‘Engines of growth’?
Bresnahan, T. F., & Trajtenberg, M. (1995) · Journal of Econometrics · doi:10.1016/0304-4076(94)01598-t · Cited by 2,879
Automation and New Tasks: How Technology Displaces and Reinstates Labor
Acemoglu, D., & Restrepo, P. (2019) · Journal of Economic Perspectives · doi:10.1257/jep.33.2.3 · Cited by 2,612
GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models
Eloundou, T., Manning, S., Mishkin, P., & Rock, D. (2023) · arXiv · doi:10.48550/arxiv.2303.10130 · Cited by 2,330
What can machine learning do? Workforce implications
Brynjolfsson, E., & Mitchell, T. (2017) · Science · doi:10.1126/science.aap8062 · Cited by 1,131
A future that works: automation, employment, and productivity
Manyika, J., Chui, M., Miremadi, M., Bughin, J., George, K. F., Willmott, P., & Dewhurst, M. (2017) · Cited by 897
What Can Machines Learn and What Does It Mean for Occupations and the Economy?
Brynjolfsson, E., Mitchell, T., & Rock, D. (2018) · AEA Papers and Proceedings · doi:10.1257/pandp.20181019 · Cited by 695
Felten, E., Raj, M., & Seamans, R. (2021) · Strategic Management Journal · doi:10.1002/smj.3286 · Cited by 574
The Impact of Artificial Intelligence on the Labor Market
Webb, M. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3482150 · Cited by 531
Towards accurate differential diagnosis with large language models
McDuff, D., Schaekermann, M., Tu, T., Palepu, A., Wang, A., Garrison, J., Singhal, K., Sharma, Y., Azizi, S., Kulkarni, K., et al. (2025) · Nature · doi:10.1038/s41586-025-08869-4 · Cited by 311 · cited 1×
“In the last several years, generative artificial intelligence (AI) has come to the fore as the next general purpose technology [2, 3], capable of improving or speeding up tasks as varied as medical diagnosis [4] and software development [5].”
Knowledge Worker Roles and Actions—Results of Two Empirical Studies
Reinhardt, W., Schmidt, B., Sloep, P., & Drachsler, H. (2011) · Knowledge and Process Management · doi:10.1002/kpm.378 · Cited by 267
A Method to Link Advances in Artificial Intelligence to Occupational Abilities
Felten, E. W., Raj, M., & Seamans, R. (2018) · AEA Papers and Proceedings · doi:10.1257/pandp.20181021 · Cited by 239
Chatterji, A., Cunningham, T., Deming, D., Hitzig, Z., Ong, C., Shan, C. Y., & Wadman, K. (2025) · doi:10.3386/w34255 · Cited by 233
The concept of knowledge work revisited
Pyöriä, P. (2005) · Journal of Knowledge Management · doi:10.1108/13673270510602818 · Cited by 228
Goldfarb, A., Taska, B., & Teodoridis, F. (2023) · Research Policy · doi:10.1016/j.respol.2022.104653 · Cited by 209
The Rapid Adoption of Generative AI
Bick, A., Blandin, A., & Deming, D. (2024) · NBER Working Paper · doi:10.3386/w32966 · Cited by 200
GDPval: Evaluating AI Model Performance on Real-World Economically Valuable Tasks
Patwardhan, T., Dias, R., Proehl, E., Kim, G., Wang, M., Watkins, O., Fishman, S. P., Aljubeh, M., Thacker, P., Fauconnet, L., et al. (2025) · arXiv · doi:10.48550/arxiv.2510.04374 · Cited by 189
How will Language Modelers like ChatGPT Affect Occupations and Industries?
Felten, E. W., Raj, M., & Seamans, R. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4375268 · Cited by 187
New Frontiers: The Origins and Content of New Work, 1940–2018
Autor, D., Chin, C., Salomons, A., & Seegmiller, B. (2024) · The Quarterly Journal of Economics · doi:10.1093/qje/qjae008 · Cited by 174
Measuring the Occupational Impact of AI: Tasks, Cognitive Abilities and AI Benchmarks
Tolan, S., Pesole, A., Martínez-Plumed, F., Fernández-Macías, E., Hernández-Orallo, J., & Gómez, E. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12647 · Cited by 165
Shao, Y., Zope, H., Jiang, Y., Pei, J., Nguyen, D. L., Brynjolfsson, E., & Yang, D. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.06576 · Cited by 141
Anthropic Economic Index report: Uneven geographic and enterprise AI adoptionPreprint
Appel, R. E., McCrory, P., Tamkin, A., McCain, R. M., Neylon, T., & Stern, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.15080 · Cited by 93
Cui, Z., Demirer, M., Jaffe, S., Musolff, L., Peng, S., & Salz, T. (2024) · doi:10.2139/ssrn.4945566 · Cited by 73
Self-citationStill Waters, Rapid Currents: Early Labor Market Transformation under Generative AI
Humlum, A., & Vestergaard, E. (2025) · doi:10.3386/w33777 · Cited by 68
The Use of Generative Search Engines for Knowledge Work and Complex TasksPreprint
Suri, S., Counts, S., Wang, L., Chen, C., Wan, M., Safavi, T., Neville, J., Shah, C., White, R. W., Andersen, R., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2404.04268 · Cited by 53
Self-citationEcological framework of information interactions and information infrastructures
Huvila, I. (2009) · Journal of Information Science · doi:10.1177/0165551509336705 · Cited by 49
The potential impact of AI innovations on US occupations
Septiandri, A. A., Constantinides, M., & Quercia, D. (2024) · PNAS Nexus · doi:10.1093/pnasnexus/pgae320 · Cited by 47
Bessen, J. (2015) · bepress Legal Repository · doi:10.5089/9781498351942.022.a007 · Cited by 38
In-Context Learning for Extreme Multi-Label ClassificationPreprint
D’Oosterlinck, K., Khattab, O., Remy, F., Demeester, T., Develder, C., & Potts, C. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2401.12178 · Cited by 36
Cui, K. Z., Demirer, M., Jaffe, S., Musolff, L., Peng, S., & Salz, T. (2026) · Management Science · doi:10.1287/mnsc.2025.00535 · Cited by 28
Self-citationHow will Language Modelers like ChatGPT Affect Occupations and Industries?Preprint
Felten, E. W., Raj, M., & Seamans, R. (2023) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.2303.01157 · Cited by 28
How Well Does Agent Development Reflect Real-World Work?Preprint
Wang, Z. Z., Vijayvargiya, S., Chen, A., Zhang, H., Arangarajan, V. A., Chen, J., Chen, V., Yang, D., Fried, D., & Neubig, G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.01203 · Cited by 18
TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks
Xu, F. F., Song, Y., Li, B., Tang, Y., Jain, K., Bao, M., Wang, Z. Z., Zhou, X., Guo, Z., Cao, M., et al. (2024) · arXiv · doi:10.48550/arxiv.2412.14161 · Cited by 17
Can LLMs Help You at Work? A Sandbox for Evaluating LLM Agents in Enterprise Environments
Vishwakarma, H., Agarwal, A., Patil, O., Devaguptapu, C., & Chandran, M. (2025) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2025.emnlp-main.466 · Cited by 14
Achananuparp, P., & Lim, E. (2026) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v20i1.42622 · Cited by 12
Which Economic Tasks are Performed with AI? Evidence from Millions of Claude Conversations
Handa, K., Tamkin, A., McCain, M., Huang, S., Durmus, E., Heck, S., Mueller, J., Hong, J., Ritchie, S., Belonax, T., et al. (2025) · arXiv · doi:10.48550/arxiv.2503.04761 · Cited by 11
How Organizations Use AI: Evidence from ChatGPTPreprint
Chatterji, A., Holtz, D., Rakholia, N., Tambe, P. B., & Weeratunga, G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.12236 · Cited by 11
Adopt ≠ Adapt: Longitudinal Analyses of LLM Conversations in the Wild
Hicke, R. M. M., & Tomlinson, K. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-main.2699 · Cited by 9
Self-citationInformation work in information science research and practice
Huvila, I., Lloyd, A., Budd, J. M., Palmer, C. L., & Toms, E. G. (2016) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.2016.14505301004 · Cited by 8
Google's AI & Economy ATLAS v1.0: Mapping Gemini Usage in the EconomyPreprint
Iscenko, Z., Strand, S., Chen, Y., Aimard, G., Codreanu, M. A., Sampathkumar, V., Imas, A., Jacobs, J., Muiruri, E., Mateos-Garcia, J. C., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.00038 · Cited by 8
WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?
Drouin, A., Gasse, M., Caccia, M., Laradji, I. H., Del Verme, M., Marty, T., Boisvert, L., Thakkar, M., Cappart, Q., Vazquez, D., et al. (2024) · arXiv · doi:10.48550/arxiv.2403.07718 · Cited by 3
Adopt $\neq$ Adapt: Longitudinal Analyses of LLM Conversations in the Wild
Hicke, R. M. M., & Tomlinson, K. (2026) · arXiv · doi:10.48550/arxiv.2605.29018
Self-citation
Research works printed but not linked: 5
- Carlos E Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik R Narasimhan. SWE-bench: Can language models resolve real-world GitHub issues? In The Twelfth International Conference on Learning Representations, 2024. URL https: //openreview.net/forum?id=VTF8yNQM66.
- Samuel Miserendino, Michele Wang, Tejal Patwardhan, and Johannes Heidecke. SWE-Lancer: Can frontier LLMs earn $1 million from real-world freelance software engineering? In Forty- second International Conference on Machine Learning, 2025. URL https://openreview.net/ forum?id=xZXhFg43EI.
- Wenting Zhao, Xiang Ren, Jack Hessel, Claire Cardie, Yejin Choi, and Yuntian Deng. WildChat: 1M ChatGPT interaction logs in the wild. In International Conference on Learning Representa- tions, pages 34590-34605, 2024. URL https://proceedings.iclr.cc/paper_files/paper/ 2024/file/9421261e06f1a63a352b068f1ac90609-Paper-Conference.pdf.
- Peter Ferdinand Drucker. Landmarks of tomorrow: a report on the new "post-modern" world. Harper, New York, 1st edition, 1959.
- Scott Counts, Yan Chen, Jing Dong, Himanshu Sharma, Andrey Zaikin, Rui Hu, Alperen Kok, Gorkem Ozer Yilmaz, Siddharth Suri, Kiran Tomlinson, Sonia Jaffe, and Will Wang. AI in the enterprise: How people use M365 Copilot Chat, 2026. URL https://arxiv.org/abs/2605. 23958.
Cited by
Chatterji, A., Cunningham, T., Deming, D., Hitzig, Z., Ong, C., Shan, C. Y., & Wadman, K. (2025) · doi:10.3386/w34255 · Cited by 233
Still Waters, Rapid Currents: Early Labor Market Transformation under Generative AI
Humlum, A., & Vestergaard, E. (2025) · doi:10.3386/w33777 · Cited by 68
Flipping the Dialogue: Training and Evaluating User Language Models
Naous, T., Laban, P., Xu, W. H., & Neville, J. (2025) · International Conference on Learning Representations · doi:10.48550/arxiv.2510.06552 · Cited by 58
Measuring AI "Slop" in TextPreprint
Shaib, C., Chakrabarty, T., García-Olano, D., & Wallace, B. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.19163 · Cited by 33
Shifting Work Patterns with Generative AI
Dillon, E., Jaffe, S., Immorlica, N., & Stanton, C. (2025) · doi:10.3386/w33795 · Cited by 31
Self-citation
Metadata
- Authors
- Tomlinson, K., Jaffe, S., Wang, W., Counts, S., & Suri, S.
- Affiliations
- Microsoft (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2025
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2507.07935
- OpenAlex
- W4417063314
- Semantic Scholar
- ac610777f9990294d91d2be88e41867a4eabb939
- Cited by
- 152
- References
- 40
- Citations by year
- 2026: 127 · 2025: 25
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University)
- Funders
- Microsoft Research
- Topics
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Labor market dynamics and wage inequality
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- generative AI, occupation, information work, AI-assisted workflows, large language models, economic impact of AI, general purpose technologies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-17, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-17 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.