The AI Index 2021 Annual Report
Open accessAbstract
Welcome to the fourth edition of the AI Index Report. This year we significantly expanded the amount of data available in the report, worked with a broader set of external organizations to calibrate our data, and deepened our connections with the Stanford Institute for Human-Centered Artificial Intelligence (HAI). The AI Index Report tracks, collates, distills, and visualizes data related to artificial intelligence. Its mission is to provide unbiased, rigorously vetted, and globally sourced data for policymakers, researchers, executives, journalists, and the general public to develop intuitions about the complex field of AI. The report aims to be the most credible and authoritative source for data and insights about AI in the world.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
AI-related job postings in the UK more than doubled from 2016 to 2021, resulting in a talent shortage.
“For example, the AI Index 2022 Annual Report [17] notes a more than double increase in AI-related job postings in the UK from 2016 to 2021, resulting in a talent shortage.”
From Integrating AI in engineering education: A comprehensive review and student-informed module design for U.K. students (2025) · cites this paper as [17]
The Economy, §3.1, Global AI Labor Demand (p. 86) says AI labor demand grew significantly in six countries including the UK, but its job-postings data end in 2020 and do not establish a more-than-doubling from 2016 to 2021. The AI Hiring section (p. 84) says attracting and retaining AI talent is challenging, but does not say the UK posting growth resulted in a talent shortage. The cited source is the 2021 report, not the 2022 report named in the citing sentence. (LLM, conf=0.85)
Experimental — accuracy not yet measuredTransformer-based language models have reached human-like language understanding abilities.
“They not only reached human-like language understanding abilities (Zhang et al., 2021)”
From Augmenting human innovation teams with artificial intelligence: Exploring transformer-based language models (2023) · cites this paper as Zhang et al., 2021
Section 2.3, Language (p. 62), reports that DeBERTa scored 90.3 on SuperGLUE, compared with a human baseline of 89.8. But the report limits this comparison to the average across that language-understanding benchmark and explicitly says it does not establish human-level performance on every task. The broader claim of human-like language understanding abilities is therefore overstated. (LLM, conf=0.86)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cited by
Sorted by citations
Bouschery, S. G., Blazevic, V., & Piller, F. T. (2023) · Journal of Product Innovation Management · doi:10.1111/jpim.12656 · Cited by 444 · see citing works
Lewicki, K., Lee, M. S. A., Cobbe, J., & Singh, J. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581463 · Cited by 30 · see citing works
Ethics dumping in artificial intelligence
Bélisle-Pipon, J.-C., & Victor, G. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1426761 · Cited by 26 · see citing works
Hao, Y., Liu, Y., Liu, B., Amarantidis, G., & Ghannam, R. (2025) · IEEE Transactions on Education · doi:10.1109/te.2025.3536105 · Cited by 22 · see citing works
Ecosystem Graphs: The Social Footprint of Foundation Models
Bommasani, R., Soylu, D., Liao, T., Creel, K., & Liang, P. (2023) · doi:10.21203/rs.3.rs-2961271/v1 · Cited by 14 · see citing works
Marey, A., Serdysnki, K. C., Killeen, B. D., Unberath, M., & Umair, M. (2024) · BJR|Artificial Intelligence · doi:10.1093/bjrai/ubae008 · Cited by 7 · see citing works
- Authors
- Zhang, D., Mishra, S., Brynjolfsson, E., Etchemendy, J., Ganguli, D., Grosz, B., Lyons, T., Manyika, J., Niebles, J. C., Sellitto, M., Shoham, Y., Clark, J., & Perrault, R.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2103.06312
- OpenAlex
- W3135482977
- Cited by
- 48
- References
- 0
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 8 · 2023: 16 · 2022: 10 · 2021: 7
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Social Sciences › Decision Sciences › Management Science and Operations Research › Impact of AI and Big Data on Business and Society
- Keywords
- artificial intelligence, artificial intelligence industry, AI policy, AI workforce, AI research funding, AI regulation, artificial intelligence adoption
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
