Large language models at work in China’s labor market
Open accessAbstract
This paper explores the potential impacts of large language models (LLMs) on the Chinese labor market. We analyze occupational exposure to LLM capabilities by incorporating human expertise and LLM classifications, following the methodology of Eloundou et al. (2023). The results indicate a positive correlation between occupational exposure and both wage levels and experience premiums at the occupation level. This suggests that higher-paying and experience-intensive jobs may face greater exposure risks from LLM-powered software. We then aggregate occupational exposure at the industry level to obtain industrial exposure scores. Both occupational and industrial exposure scores align with expert assessments. Our empirical analysis also demonstrates a distinct impact of LLMs, which deviates from the routinization hypothesis. We present a stylized theoretical framework to better understand this deviation from previous digital technologies. By incorporating entropy-based information theory into the task-based framework, we propose an AI learning theory that reveals a different pattern of LLM impacts compared to the routinization hypothesis.
AI snapshot
Written from the paper’s full text.
TL;DR
The paper estimates occupational and industrial exposure to LLMs in China using GPT-4, GLM, InternLM, and expert scores, finding exposure is positively correlated with wages and experience premiums and is highest for non-routine cognitive analytical tasks. It argues this pattern deviates from the routinization hypothesis and develops an entropy/KL-divergence task model in which LLMs have a comparative advantage in complex, data-intensive tasks.
Key findings
- Occupational exposure is positively correlated with wage levels and experience premiums; more educated, higher-paid, white-collar occupations are the most exposed.
- LLM scoring: fine-category means are GLM 0.44, InternLM 0.18, GPT-4 0.24; medium-category means are GLM 0.40, InternLM 0.14, GPT-4 0.22. Model scores are positively correlated and align with expert scores (Figure 1 corr.=0.65).
- Composite occupations: non-routine cognitive analytical tasks are most affected; routine manual tasks are also substantially influenced; interpersonal and non-routine manual physical tasks are less affected. Industry exposure is higher in education and healthcare and lower in manufacturing, agriculture, mining, and construction. Younger workers are disproportionately affected; in 2020, 42.5% of ages 16–19 and 34.9% of ages 20–24 were in consumer service industries.
- Vacancy shares and the growth rate of vacancy shares are positively correlated with occupational exposure. The theoretical model predicts LLMs erode skilled expertise and flatten wage distribution, unlike traditional AI’s routine-task automation.
Methods
- Exposure scoring uses the Occupational Classification Dictionary of China 2022; GPT-4, InternLM, and GLM classify occupations, each occupation is labeled 8 times and averaged, and expert annotators provide comparison scores. Scores E0–E3 are mapped as E1=1, E2/E3=0.5, E0=0; three categories are excluded, leaving 1606 fine-category occupations.
- Data include online job postings from City Data Group, January 2017–December 2022, covering over 800 million job openings, nearly 400 cities, and 5.2 million employers; CLDS 2016 for industry occupational intensity; and 2020 census data for demographic distribution.
- Analysis aggregates occupational exposure to industry via occupational intensity, compares LLM scores with expert scores, correlates exposure with wages, experience premiums, and vacancy shares/growth, and develops a task-based model incorporating entropy and KL-divergence.
Limitations
- Paper-stated: the task-based framework’s validity, relative versus absolute measures, and the forward-looking/changing nature of scores are concerns; LLM scoring is random, as the same prompt can yield different results even at higher temperature, addressed by averaging 8 labels per occupation.
- Paper-stated: the Occupational Classification Dictionary provides only detailed work content and descriptions, so task-level exposure as in Eloundou et al. is infeasible; exposure is calculated at the occupation level.
- Paper-stated: the online recruitment labor market does not equal the whole labor market, and China lacks a representative recruitment dataset like JOLTS, so representativeness cannot be fully assessed; the authors argue exposure elicitation does not use postings and average wage/experience premium are robust to sectoral reliance. Evident from the text: industry and demographic exposure rely on CLDS 2016 and 2020 census distributions, which may not match the 2017–2022 posting period.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
10 of 21 cited sources checked · 4 supported · 1 flagged · accuracy not yet measured
- Findingcitation§ 5 The Model
Occupations with higher wage and experience premiums are more vulnerable to LLMs.
“Additionally, our findings indicate a correlation between occupations with higher wage and experience premiums and their increased vulnerability to LLMs. This aligns with the recent research by Eloundou et al. (2023) and Eisfeldt et al. (2023), who have identified that technological advancements disproportionately affect workers in the higher echelons of the wage spectrum.”
Quote in the paperSubstantial claim1 of 2 sources checked- cites Eloundou et al. (2023) source
Section 4.2 (Wages and Employment) finds that higher wages are generally associated with greater occupational exposure to LLMs. Section 4.4 (Barriers to Entry) finds that exposure generally rises across job-preparation zones, which include related experience, but it does not establish a relationship with experience premiums. The paper measures potential exposure, not realized harm to workers. (LLM, conf=0.85)
Experimental — accuracy not yet measured - cites Eisfeldt et al. (2023) source
- Premisecitation§ 5.2.2 The Comparative Advantage of Deep Learning AI and LLMs AI Technology
Deep learning AI and LLMs AI models exhibit similar power scaling laws.
“Given that deep learning AI and LLMs AI models exhibit similar power scaling laws, our focus can be directed specifically towards LLMs AI without a significant loss of generality.”
Quote in the paperSubstantial claim2 of 3 sources checked- cites Kaplan et al., 2020
The Summary of Scaling Laws (p. 4) establishes power-law scaling for Transformer language models, and Related Work (p. 18) notes an approximate power-law relationship for EfficientNet image models. Those passages support a resemblance in some scaling behavior, but not the broad claim that deep-learning models and LLMs generally exhibit similar scaling laws. (LLM, conf=0.85)
Experimental — accuracy not yet measured - cites Hoffmann et al., 2022 source
The Introduction (p. 1) describes a power-law relationship between language-model size and performance, and the Discussion (p. 15) discusses power-law scaling for large language models. The paper does not compare those laws with deep-learning models generally, so it does not establish the claimed similarity or justify treating LLMs as representative of all deep learning AI. (LLM, conf=0.83)
Experimental — accuracy not yet measured - cites Barnett and Besiroglu, 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation§ 5.3.1 Discussions With AI Applications
A controlled experiment by Peng et al. (2023) found that GitHub Copilot significantly boosted productivity: the group using Copilot completed programming tasks approximately 56% faster than the control group without access to the tool.
“For example, a controlled experiment by Peng et al. (2023) found that GitHub Copilot, a generative AI programming aid, significantly boosted productivity: the group using Copilot completed programming tasks approximately 56% faster than the control group without access to the tool.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Peng et al. (2023) source
- Findingown data§ Abstract
Occupational exposure to LLMs is positively correlated with wage levels at the occupation level in China.
“The results indicate a positive correlation between occupational exposure and both wage levels and experience premiums at the occupation level.”
Quote in the paperSubstantial claim - Findingown data§ 1 Introduction
There is a positive correlation between the growth rate of vacancy shares and occupational exposure scores.
“The positive correlation between the growth rate of vacancy shares and exposure scores further indicates a potential reversal in labor demand trends.”
- Also stated in: § 4.5 Vacancies · hedged
“The positive correlation between occupational exposure and growth rate of vacancy share implies that the advancements of LLMs could unexpectedly reverse the prevailing labor demand trend”
Quote in the paperSubstantial claim - Also stated in: § 4.5 Vacancies · hedged
- Findingown data§ 1 Introduction
Routine manual skills are substantially influenced by LLMs.
“Routine manual skills are also substantially influenced”
- Also stated in: § 4.3 Composite Occupational Exposure · hedged
“Routine manual tasks are also expected to experience considerable influence”
Quote in the paperSubstantial claim - Also stated in: § 4.3 Composite Occupational Exposure · hedged
- Findingown data§ 1 Introduction
Non-routine cognitive skills, particularly analytical ones, are most significantly affected by LLMs.
“The results indicate that non-routine cognitive skills, particularly analytical ones, are most significantly affected by LLMs.”
- Also stated in: § 4.3 Composite Occupational Exposure · plain
“cognitive tasks, particularly those of a non-routine nature, are the most significantly impacted by large language models (LLMs).”
Quote in the paperSubstantial claim - Also stated in: § 4.3 Composite Occupational Exposure · plain
- Findingown data§ 1 Introduction
Interpersonal and non-routine manual physical skills remain relatively unaffected by LLMs.
“whereas interpersonal and non-routine manual physical skills remain relatively unaffected.”
- Also stated in: § 4.3 Composite Occupational Exposure · plain
“tasks classified as Interpersonal and Non-routine Manual Physical are less affected by these advanced models.”
Quote in the paperSubstantial claim - Also stated in: § 4.3 Composite Occupational Exposure · plain
- Findingown data§ 1 Introduction
There is a positive correlation between occupational vacancy shares and occupational exposure scores.
“A positive correlation between vacancy shares and occupational exposure scores suggests that labor demand structures may exacerbate the disruptive impacts of LLMs on China's labor market.”
- Also stated in: § 4.5 Vacancies · hedged
“The presence of a positive correlation between occupational exposure and vacancy share, as depicted in Figure 18, suggests that occupations with a higher vacancy share may potentially experience more pronounced disruptive effects from LLMs in the future.”
Quote in the paperSubstantial claim - Also stated in: § 4.5 Vacancies · hedged
- Findingown data§ 1 Introduction
More educated, higher paid, white-collar occupations are the most exposed to LLMs in China.
“The analysis reveals significant heterogeneity in occupational exposure, with more educated, higher paid, white-collar occupations being the most exposed to LLMs.”
Quote in the paperSubstantial claim - Findingown data§ 1 Introduction
In China, the uneven age distribution across industries amplifies demographic exposure to LLMs, disproportionately affecting younger workers.
“In contrast to other developed countries, the uneven age distribution across industries in China amplifies the demographic exposure to LLMs, disproportionately affecting younger workers.”
- Also stated in: § 4.4 Industrial and Demographic Exposure · boosted
“Figure 7 showcases our demographic exposure scores, revealing that LLMs wield a more pronounced influence on the employment prospects of young individuals.”
Quote in the paperSubstantial claim - Also stated in: § 4.4 Industrial and Demographic Exposure · boosted
- Findingown data§ 1 Introduction
There is significant heterogeneity in occupational exposure to LLMs in China.
“The analysis reveals significant heterogeneity in occupational exposure, with more educated, higher paid, white-collar occupations being the most exposed to LLMs.”
Quote in the paperSubstantial claim- Rests on an assumption: Countries differ in labor market structures such as occupation and industry composition, and even for the same occupation the detailed task composition or work content may exhibit great discrepancies across countries.
- Findingown data§ Abstract
Occupational exposure to LLMs is positively correlated with experience premiums at the occupation level in China.
“The results indicate a positive correlation between occupational exposure and both wage levels and experience premiums at the occupation level.”
- Also stated in: § 1 Introduction · hedged
“Beyond the positive correlation between wage, education, and occupational exposure, our findings indicate a positive correlation between experience premiums and exposure to LLMs”
Quote in the paperSubstantial claim - Also stated in: § 1 Introduction · hedged
- Findingreasoning§ 4.4 Industrial and Demographic Exposure
LLMs wield a more pronounced influence on the employment prospects of young individuals.
“Figure 7 showcases our demographic exposure scores, revealing that LLMs wield a more pronounced influence on the employment prospects of young individuals.”
Quote in the paperSubstantial claim - Findingown data§ 4.1 Summary Statistics
There are substantial positive correlations between model scores and human expert scores.
“we observed substantial positive correlations between the model scores and human expert scores.”
- Also stated in: § 3 Methodology of Exposure Scoring and Data Collection · plain
“Exposure Score of LLMs and Expert: corr.=0.65.”
Quote in the paperSubstantial claim - Also stated in: § 3 Methodology of Exposure Scoring and Data Collection · plain
- Findingown data§ 4.1 Summary Statistics
The scoring outcomes from the three models exhibited positive correlations across fine-category, small-category, and medium-category occupations.
“Despite variations in the models' scoring and comprehension of occupations, the scoring outcomes from three models exhibited noteworthy positive correlations. This held true across fine-category, small-category, and medium-category occupations.”
Quote in the paperNot a substantial claim - Findingown data§ 4.4 Industrial and Demographic Exposure
There is a notable concentration of youth employment within the tertiary sector in China.
“we observe a notable concentration of youth employment within the tertiary sector.”
Quote in the paperSubstantial claim - Findingreasoning§ 4.2 Occupational Exposure
Within the highest exposure occupations, such as Teachers, Economic and financial professionals, and Press, publishing and cultural professionals, there is a strong resonance with recent technological advancements in LLMs.
“within the highest exposure occupations, such as 'Teachers', 'Economic and financial professionals', and 'Press, publishing and cultural professionals', a strong resonance emerges with recent technological advancements in LLMs”
Quote in the paperNot a substantial claim - Findingown data§ Appendix D Appendix Tables
For GLM2, 64.4% of occupations have more than 50% consistent scores.
“GLM2 | 64.4%”
Quote in the paperNot a substantial claim - Findingreasoning§ A.1 Proof of the Model with Traditional AI
In the model with traditional AI, the threshold task I2 is greater than I.
“By contradiction, we know that ˜ I 2 > I .”
Quote in the paperSubstantial claim - Findingreasoning§ 4. Labor market clearing condition:
In the model with deep learning AI and LLMs, the threshold task I1 is less than I.
“By contradiction, we know that ˆ I 1 < I .”
Quote in the paperSubstantial claim - Findingown data§ Appendix D Appendix Tables
For GPT, 83.0% of occupations have more than 50% consistent scores.
“GPT 83.0%”
Quote in the paperNot a substantial claim - Findingown data§ Appendix D Appendix Tables
For InternLM, 83.2% of occupations have more than 50% consistent scores.
“InternLM | 83.2%”
Quote in the paperNot a substantial claim - Interpretationown data§ 1 Introduction
The predominant impact on non-routine cognitive tasks deviates from the routinization hypothesis, which posited that ICT primarily automates routine, codifiable tasks performed by middle-wage workers.
“This predominant impact on non-routine cognitive tasks deviates from the 'routinization hypothesis' (Autor et al., 2003), which posited that ICT primarily automates routine, codifiable tasks performed by middle-wage workers.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Autor et al., 2003 source
- Interpretationown data§ Abstract
Higher-paying and experience-intensive jobs may face greater exposure risks from LLM-powered software.
“This suggests that higher-paying and experience-intensive jobs may face greater exposure risks from LLM-powered software.”
Quote in the paperSubstantial claim - Interpretationown data§ Abstract
The empirical analysis shows a distinct impact of LLMs that deviates from the routinization hypothesis.
“Our empirical analysis also demonstrates a distinct impact of LLMs, which deviates from the routinization hypothesis.”
Quote in the paperSubstantial claim - Interpretationown data§ 1 Introduction
Labor demand structures may exacerbate the disruptive impacts of LLMs on China's labor market.
“A positive correlation between vacancy shares and occupational exposure scores suggests that labor demand structures may exacerbate the disruptive impacts of LLMs on China's labor market.”
Quote in the paperSubstantial claim - Interpretationreasoning§ Abstract
The paper proposes an AI learning theory that reveals a different pattern of LLM impacts compared to the routinization hypothesis.
“By incorporating entropy-based information theory into the task-based framework, we propose an AI learning theory that reveals a different pattern of LLM impacts compared to the routinization hypothesis.”
Quote in the paperSubstantial claim - Interpretationreasoning§ 1 Introduction
The findings suggest potential diminishing returns to 'learning by doing' in the future.
“suggesting potential diminishing returns to 'learning by doing' in the future.”
Quote in the paperSubstantial claim - Interpretationown data§ 1 Introduction
LLMs significantly impact labor demand.
“Furthermore, LLMs significantly impact labor demand.”
Quote in the paperSubstantial claim - Premisenone given§ 5 The Model
Occupations involving interpersonal tasks have a moderate degree of susceptibility to LLMs, positioned between cognitive and manual tasks in terms of exposure.
“Occupations involving interpersonal tasks demonstrate a moderate degree of susceptibility to LLMs, positioned between cognitive and manual tasks in terms of exposure.”
Quote in the paperSubstantial claim - Premisecitation§ 4.2 Occupational Exposure
LLMs have the capacity to learn tasks requiring tacit knowledge, which was once attainable only through experiential learning or learning by doing.
“LLMs have the capacity to learn tasks equiring tacit knowledge, knowledge that was once attainable only through experiential learning or learning by doing.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Brynjolfsson et al. (2023)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Study design and conductnone given§ 3.2 Data on Wages and Vacancies
The calculation of the average wage rate and experience premium for each occupation is robust to heterogeneous sectoral reliance on online recruitment.
“However, the calculation of the average wage rate and experience premium for each occupation are robust to heterogeneous sectoral reliance on online recruitment.”
Quote in the paperNot a substantial claim - Interpretationown data§ 4.2 Occupational Exposure
This wave of technological change distinguishes itself from earlier waves by potentially substituting numerous tasks within non-routine cognitive analytical jobs that were previously considered immune to automation.
“this wave of technological change distinguishes itself from earlier waves by potentially substituting numerous tasks within non-routine cognitive analytical jobs that were previously considered immune to automation.”
Quote in the paperSubstantial claim - Interpretationown data§ 1 Introduction
China's economic and labor market structure intensifies rather than mitigates the disruptive effects of LLMs.
“Contrary to expectations, China's economic and labor market structure intensifies rather than mitigates the disruptive effects of LLMs.”
- Also stated in: § 4.5 Vacancies · hedged
“the occupational structure in China tends to exacerbates rather than ameliorate the disruption caused by LLMs.”
Quote in the paperSubstantial claim - Also stated in: § 4.5 Vacancies · hedged
- Premisereasoning§ 5 The Model
Traditional AI technologies are predominantly applied to routine tasks, as asserted by the routinization hypothesis.
“This integration is instrumental in reexamining and substantiating the routinization hypothesis, which asserts that traditional AI technologies are predominantly applied to routine tasks.”
- Also stated in: § 5.2.1 The Comparative Advantage of Traditional AI · hedged
“our analysis reaffirms the routinization hypothesis, indicating a tendency for models based on traditional AI to predominantly automate routine tasks.”
Quote in the paperSubstantial claim - Also stated in: § 5.2.1 The Comparative Advantage of Traditional AI · hedged
- Interpretationreasoning§ 6 Discussions and Conclusions
The theoretical model predicts that artificial intelligence could enable a broad range of workers equipped with foundational training to perform high-stakes decision-making tasks traditionally monopolized by elite experts such as doctors, lawyers, software engineers, and college professors.
“Our theoretical model predicts that artificial intelligence, by leveraging vast datasets and computational power to synthesize information and rules, could enable a broad range of workers equipped with foundational training to perform high-stakes decision-making tasks. These tasks, traditionally monopolized by elite experts-such as doctors, lawyers, software engineers, and college professors-may”
Quote in the paperSubstantial claim - Interpretationreasoning§ 6 Discussions and Conclusions
LLMs represent a noteworthy shock to the Chinese labor market.
“LLMs indeed represent a noteworthy shock to the Chinese labor market.”
Quote in the paperNot a substantial claim - Interpretationreasoning§ 5.3.2 Theoretical and Policy Implications
LLMs, powered by neural scaling laws and vast amounts of data and computational resources, exhibit a comparative advantage in data-intensive and complex tasks usually performed by skilled workers.
“In contrast, LLMs, powered by neural scaling laws and vast amounts of data and computational resources, exhibit a comparative advantage in data-intensive and complex tasks, usually performed by skilled workers.”
Quote in the paperSubstantial claim- The authors state this as an assumption: All markets are competitive.
- The authors state this as an assumption: There exists a distribution function Pi characterizing the relevant information in task i, and the complexity of task i is defined by entropy Hi(P).
- The authors state this as an assumption: Skilled workers have a comparative advantage in more complex tasks.
- The authors state this as an assumption: The inability to distinguish between a model's output and the theoretically perfect execution of a task denotes competence.
- The authors state this as an assumption: The accuracy of a model's performance is directly proportional to its productivity in automated tasks.
- The authors state this as an assumption: KL-divergence is a measurement of productivity loss.
- The authors state this as an assumption: Deep learning AI and LLMs AI models represent a distinct technological logic.
- The authors state this as an assumption: For each task, there is a productivity upper bound A_bar.
- Interpretationreasoning§ A.1 Proof of the Model with Traditional AI
In the model with traditional AI, the threshold shifts.
“In sum, we have proved that a shift of threshold and an increase in wage premium.”
Quote in the paperSubstantial claim - Interpretationreasoning§ A.1 Proof of the Model with Traditional AI
In the model with traditional AI, the wage premium increases.
“In sum, we have proved that a shift of threshold and an increase in wage premium.”
Quote in the paperSubstantial claim - Interpretationreasoning§ A.1 Proof of the Model with Traditional AI
Wage premium is determined by the productivity difference at the threshold.
“Wage premium is determined by the productivity difference at the threshold”
- Also stated in: § 4. Labor market clearing condition: · plain
“Wage premium is determined by the productivity difference at the threshold”
Quote in the paperSubstantial claim - Also stated in: § 4. Labor market clearing condition: · plain
- Study design and conductown data§ Appendix E.3 Errors Checking and Missing Information
Missing values in the recruitment data are almost entirely due to lack of information, not poor feature extraction.
“By our double checking, missing values are almost entirely due to lack of information, and not poor feature extraction.”
Quote in the paperNot a substantial claim
- Classified as probably not a substantial claim. 26
- May combine two claims. 32
- The quote only partly states this claim. 2
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Premisecitation§ 6 Discussions and ConclusionsLabor income inequality has widened significantly, with computerization facilitating the unprecedented concentration of decision-making power among elite experts, who now have access to abundant and inexpensive information.
“Labor income inequality has widened significantly, with computerization facilitating the unprecedented concentration of decision-making power among elite experts, who now have access to abundant and inexpensive information (Deming, 2021).”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Deming, 2021 source
In the discussion accompanying Figure 2 (page unavailable), Deming says ICT produces large amounts of data and decentralizes firm-level decision-making, contrary to the claimed concentration of power among elite experts. The paper reports rising returns to decision-intensive work, but that does not establish the sentence’s claim about widening labor-income inequality. (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing).
Premisecitation§ 1 IntroductionRecent studies on the US labor market found that technological advancements disproportionately impact workers at the higher end of the wage spectrum.
“These results align with recent studies on the US labor market (Eloundou et al., 2023; Eisfeldt et al., 2023), which also found that technological advancements disproportionately impact workers at the higher end of the wage spectrum.”
Quote in the paperNot a substantial claim1 of 2 sources checked- cites Eloundou et al., 2023 source
Section 4.2, “Wages and Employment” (page unavailable), finds that higher-wage US occupations tend to have greater exposure to LLMs. That supports the wage pattern, but the paper measures potential exposure to LLMs, not the realized impact of technological advancements generally on workers. (LLM, conf=0.87)
Experimental — accuracy not yet measured - cites Eisfeldt et al., 2023 source
Classified as probably not a substantial claim.
Premisecitation§ 4.2 Occupational ExposurePrior research on computer-based automation posited that routine work was most susceptible to replacement by computers.
“Prior research on computer-based automation posited that routine work was most susceptible to replacement by computers (Autor et al., 2006; Acemoglu and Autor, 2011).”
Quote in the paperSubstantial claim1 of 2 sources checkedClassified as probably not a substantial claim. May combine two claims.
Premisecitation§ 3.3 Methodology of Exposure ScoringThe exposure scoring methods of Eloundou et al. (2023) conceive an occupation as a collection of tasks and assess whether a given occupation can be executed more efficiently using ChatGPT or analogous LLMs.
“Building upon the exposure scoring methods proposed by (Eloundou et al., 2023) which conceive an occupation as a collection of tasks, assess whether a given occupation can be executed more efficiently using ChatGPT or analogous LLMs.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Eloundou et al., 2023 source
May combine two claims.
Premisecitation§ 6 Discussions and ConclusionsDoctors often overrode AI predictions, highlighting their lack of understanding of how to use the tools effectively.
“This outcome occurred because doctors often overrode AI predictions, highlighting their lack of understanding of how to use the tools effectively.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Agarwal et al., 2023 source
Section 5.4 reports that radiologists underweighted AI information and made errors when combining it with their own assessments, limiting the gains from AI assistance. But Section 4.2.1 finds that their predictions moved closer to the AI’s when it was available; the paper does not establish that they often overrode AI predictions. It identifies biased use of AI, not a demonstrated lack of understanding of how to use the tool. (LLM, conf=0.84)
Experimental — accuracy not yet measured
May combine two claims.
Premisecitation§ 6 Discussions and ConclusionsA recent experiment found that providing AI assistance to radiologists did not improve diagnostic quality, even though AI predictions were at least as accurate as those of two-thirds of the doctors studied.
“For example, a recent experiment found that providing AI assistance to radiologists did not improve diagnostic quality, even though AI predictions were at least as accurate as those of two-thirds of the doctors studied (Agarwal et al., 2023).”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Agarwal et al., 2023 source
May combine two claims.
Findingown data§ 1 IntroductionIndustry-level exposure to LLMs is higher in education and healthcare and lower in manufacturing, agriculture, mining, and construction.
“Industry-level analyzes reveal that education and healthcare have a higher level of exposure, while manufacturing, agriculture, mining, and construction show lower exposure.”
- Also stated in: § 4.4 Industrial and Demographic Exposure · plain
“sectors with the highest scores, including education, culture and arts, radio, film and television, exhibit heightened susceptibility.”
Quote in the paperSubstantial claim- Also stated in: § 4.4 Industrial and Demographic Exposure · plain
May combine two claims.
Findingown data§ AbstractOccupational and industrial exposure scores align with expert assessments.
“Both occupational and industrial exposure scores align with expert assessments.”
- Also stated in: § 4.1 Summary Statistics · plain
“we observed substantial positive correlations between the model scores and human expert scores.”
Quote in the paperNot a substantial claim- Also stated in: § 4.1 Summary Statistics · plain
May combine two claims.
Findingown data§ 4.4 Industrial and Demographic ExposureDuring 2020, 42.5% of individuals aged 16-19 and 34.9% of those aged 20-24 in China were engaged in consumer service industries.
“during 2020, 42.5% of individuals aged 16-19 and 34.9% of those aged 20-24 were engaged in consumer service industries.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ 4.1 Summary StatisticsAcross fine-category occupations, GLM had an average exposure score of 0.44, InternLM 0.18, and GPT-4 0.24.
“GLM demonstrated an average of 0.44, while InternLM and GPT-4 yielded averages of 0.18 and 0.24 respectively.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown data§ 6 Discussions and ConclusionsThe potential effect of the release of LLMs could have a substantial effect on the Chinese labor market, potentially altering previous labor demand trends.
“Our findings suggest that the potential effect of the release of LLMs could have a substantial effect on the Chinese labor market, potentially altering previous labor demand trends.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown data§ Appendix E.3 Errors Checking and Missing InformationIn a very small number of cases, the plain text includes parts of the website other than the job description.
“In a very small number of cases we observe that the plain text includes some parts of the website other than the job description.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown data§ Appendix E.3 Errors Checking and Missing InformationIn some cases, a recruitment advertisement is duplicated within the same platform or across platforms.
“In some cases, a recruitment advertisement will be released duplicated within the same platform or across platform.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown data§ 1 IntroductionThe advancements of LLMs could reverse the prevailing labor demand trend and intensify structural unemployment in the future.
“The positive correlation between the growth rate of vacancy shares and exposure scores further indicates a potential reversal in labor demand trends.”
- Also stated in: § 4.5 Vacancies · hedged
“could unexpectedly reverse the prevailing labor demand trend, thereby intensifying the structural unemployment predicament in the future.”
Quote in the paperSubstantial claim- Also stated in: § 4.5 Vacancies · hedged
May combine two claims.
Interpretationreasoning§ 4.2 Occupational ExposureLLMs could potentially alter the experience premium and the profile of returns from learning.
“LLMs could potentially alter the experience premium and the profile of returns from learning.”
Quote in the paperSubstantial claimMay combine two claims.
Premiseown data§ 5 The ModelAutomation predominantly affects occupations involving non-routine cognitive tasks, departing from earlier conclusions that automation primarily affects occupations characterized by routine tasks.
“Drawing on prior empirical findings, we have discerned a predominant impact of automation on occupations involving non-routine cognitive tasks. This observation marks a departure from earlier conclusions, such as those posited by Autor et al. (2003), which suggested that automation primarily affects occupations characterized by routine tasks.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Autor et al. (2003) source
May combine two claims.
Premiseown data§ 5 The ModelAutomation has a pronounced effect on occupations heavily reliant on non-routine cognitive analytical tasks, in contrast to a relatively minimal impact on manual physical tasks.
“A key insight from our analysis is the pronounced effect of automation on occupations heavily reliant on non-routine cognitive analytical tasks, in contrast to the relatively minimal impact on manual physical tasks.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown data§ 1 IntroductionThe impacts of LLMs on China's labor market are pervasive and diverse.
“Our analysis further indicates that the impacts of LLMs on China's labor market are pervasive and diverse.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductown data§ 3.3 Methodology of Exposure ScoringExperts in economics and artificial intelligence scored medium-category occupations according to rating criteria, and their average score was used as the final human score.
“we invited a group of experts in economics and artificial intelligence to serve as judges. We provided them with descriptions of medium-category occupations in China and asked them to score each occupation according to the rating criteria. After collecting the scores from all of the experts, we calculated the average score for each occupation as the final human score.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductreasoning§ 3.3 Methodology of Exposure ScoringEach LLM model labeled each occupation 8 times and the average was taken as the final scoring result for each LLM model for each occupation.
“we first had each LLM model label each occupation 8 times and calculated the scores. We then took the average as the final scoring result for each LLM model for each occupation.”
Quote in the paperSubstantial claim- Rests on an assumption: The same prompt can still yield different results from large language models, even with a higher temperature setting.
Probably not a substantial claim: may not pass S4 (based). May combine two claims.
Premisenone given§ 4.2 Occupational ExposureThe routinization hypothesis assumed that computers and computer-controlled equipment are highly productive and reliable at performing scriptable tasks and relatively inept at everything else.
“'routinization' hypothesis assumed that 'computers and computer-controlled equipment are highly productive and reliable at performing the tasks that programmers can script - and relatively inept at everything else'.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.
Premisereasoning§ 5.3.2 Theoretical and Policy ImplicationsCognitive tasks at their core involve making predictions, and the productivity of cognitive tasks is determined by prediction accuracy, represented through KL-divergence.
“The central idea is that cognitive tasks, at their core, involve making predictions-such as forecasting GDP growth, predicting stock prices, or generating responses in the case of LLMs. Intuitively, the productivity of cognitive tasks is determined by prediction accuracy, which we represent through KL- divergence.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Premisenone given§ 5.3.2 Theoretical and Policy ImplicationsTraditional AI depends on pre-programmed rules to perform tasks, while LLMs leverage neural scaling laws and data-driven methods.
“In our theoretical model, the key distinction between traditional AI and LLMs as automation technologies lies in their operational logic: traditional AI depends on pre-programmed rules to perform tasks, while LLMs leverage neural scaling laws and data-driven methods.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
Interpretationnone given§ 5 The ModelThe unique patterns of occupational exposure observed are directly attributable to the underlying technological principles governing automation processes.
“Essentially, our theoretical model posits that the unique patterns of occupational exposure observed are directly attributable to the underlying technological principles governing automation processes.”
Quote in the paperNot a substantial claimMay combine two claims.
Premisecitation§ 5.3.1 Discussions With AI ApplicationsChatGPT allowed the most capable writers to work faster and enabled the less capable to write faster and improve output quality, narrowing the productivity gap.
“Moreover, ChatGPT allowed the most capable writers to work faster and enabled the less capable to not only write faster but also to improve the quality of their output. This narrowing of the productivity gap underscores the potential of LLMs to democratize expertise.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Noy and Zhang (2023) source
Probably not a substantial claim: may not pass S3 (load-bearing).
Interpretationreasoning§ 5.3.1 Discussions With AI ApplicationsLLMs are more suited to automating tasks traditionally performed by skilled workers, rather than simple, rule-based jobs.
“Consequently, LLMs are more suited to automating tasks traditionally performed by skilled workers, rather than simple, rule-based jobs.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Interpretationreasoning§ 5.3.1 Discussions With AI ApplicationsLLMs are showing the potential to empower a broader group of workers to perform expert tasks such as medical diagnosis and report generation.
“While these applications confirm that both medical diagnosis and report generation require highly skilled expertise, LLMs are showing the potential to empower a broader group of workers to perform these expert tasks.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Premisenone given§ 5.3.1 Discussions With AI ApplicationsDeep learning AI and LLMs follow a data-driven methodology where developers feed vast datasets into an algorithm that learns to perform tasks.
“In contrast, deep learning AI and LLMs follow a data-driven methodology. Developers no longer need to predefine the rules; instead, they feed vast datasets into an algorithm, which then learns to perform tasks.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Premisenone given§ 5.3.2 Theoretical and Policy ImplicationsKL-divergence is used in the neural scaling laws to measure an AI model's prediction accuracy.
“KL-divergence is also used in the 'neural scaling laws' to measure an AI model's prediction accuracy, which gives task performance a solid foundation by directly borrowing well-established AI technological principles and bridging them with information theory.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationreasoning§ 5.2.1 The Comparative Advantage of Traditional AITraditional AI models replace routine tasks typically executed by unskilled workers, reducing the task domain available to unskilled workers and widening the wage disparity between skilled and unskilled labor.
“Proposition 2 in our study reveals that models leveraging traditional AI technology are inclined to replace routine tasks, typically executed by unskilled workers. This leads to a reduction in the task domain available to unskilled workers, subsequently widening the wage disparity between skilled and unskilled labor.”
Quote in the paperSubstantial claim- The authors state this as an assumption: All markets are competitive.
- The authors state this as an assumption: There exists a distribution function Pi characterizing the relevant information in task i, and the complexity of task i is defined by entropy Hi(P).
- The authors state this as an assumption: Skilled workers have a comparative advantage in more complex tasks.
- The authors state this as an assumption: The inability to distinguish between a model's output and the theoretically perfect execution of a task denotes competence.
- The authors state this as an assumption: The accuracy of a model's performance is directly proportional to its productivity in automated tasks.
- The authors state this as an assumption: KL-divergence is a measurement of productivity loss.
- The authors state this as an assumption: Deep learning AI and LLMs AI models represent a distinct technological logic.
- The authors state this as an assumption: For each task, there is a productivity upper bound A_bar.
Classified as probably not a substantial claim. May combine two claims.
Premisereasoning§ 5.3.1 Discussions With AI ApplicationsTraditional AI code follows a rule-based structure where developers must explicitly define each step, making routine, less complex tasks more susceptible to automation.
“In traditional AI, this code follows a rule-based structure: developers must explicitly define each step in the process, particularly for tasks that are repetitive or relatively simple. This makes routine, less complex tasks more susceptible to automation.”
Quote in the paperSubstantial claimMay combine two claims.
Premisecitation§ 5.3.1 Discussions With AI ApplicationsA study by Noy and Zhang (2023) found that access to ChatGPT improved the speed and quality of writing tasks among professionals, reducing time spent on tasks by 40%, and the least skilled writers in the ChatGPT group performed as well as the median writer in the control group.
“Similarly, a study by Noy and Zhang (2023) found that access to ChatGPT improved the speed and quality of writing tasks among professionals such as marketers, grant writers, consultants, and managers. The ChatGPT group reduced the time spent on tasks by 40%, and even the least skilled writers in this group performed as well as the median writer in the control group-highlighting a significant boost”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Noy and Zhang (2023) source
May combine two claims.
Interpretationreasoning§ 5.2.1 The Comparative Advantage of Traditional AIIn competitive equilibrium with traditional AI, there exist two thresholds such that low-skill workers, high-skill workers, and models are allocated to different task intervals, and the wage premium increases.
“Proposition 2 : In competitive equilibrium, there exists two threshold ˜ I 1 and ˜ I 2 such that 0 < ˜ I 1 < ˜ I 2 < 1 and for any ≤ i < ˜ I 1, ˜ l ( i ) = ˜ h ( i ) = 0, for any ˜ I 1 < i < ˜ I 1, ˜ h ( i ) = ˜ m ( i ) = 0, for any ˜ I 2 < i ≤ 1, ˜ l ( i ) = ˜ m ( i ) = 0. Furthermore, the wage premium increases.”
Quote in the paperSubstantial claim- The authors state this as an assumption: All markets are competitive.
- The authors state this as an assumption: There exists a distribution function Pi characterizing the relevant information in task i, and the complexity of task i is defined by entropy Hi(P).
- The authors state this as an assumption: Skilled workers have a comparative advantage in more complex tasks.
- The authors state this as an assumption: The inability to distinguish between a model's output and the theoretically perfect execution of a task denotes competence.
- The authors state this as an assumption: The accuracy of a model's performance is directly proportional to its productivity in automated tasks.
- The authors state this as an assumption: KL-divergence is a measurement of productivity loss.
- The authors state this as an assumption: Deep learning AI and LLMs AI models represent a distinct technological logic.
- The authors state this as an assumption: For each task, there is a productivity upper bound A_bar.
May combine two claims.
Interpretationcitation§ 5.3.1 Discussions With AI ApplicationsThe theoretical model predicts that LLMs will reshape the value and nature of human expertise, helping to narrow the income inequality between skill levels.
“Our theoretical model aligns with this vision. We predict that LLMs will reshape the value and nature of human expertise, helping to narrow the income inequality between skill levels.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Interpretationreasoning§ 6 Discussions and ConclusionsArtificial intelligence has the potential to reduce income inequality, contrary to the trends observed with earlier technologies.
“In this regard, our theoretical perspective suggests that artificial intelligence has the potential to reduce income inequality, contrary to the trends observed with earlier technologies.”
Quote in the paperSubstantial claimMay combine two claims.
Premisecitation§ 6 Discussions and ConclusionsWhile job polarization did not occur in China, the wages of elite experts rose dramatically, indicating that information technology has played a significant role in exacerbating income inequality.
“While job polarization did not occur in China, the wages of elite experts rose dramatically, indicating that information technology has played a significant role in exacerbating income inequality.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Ge and Yang (2014) source
May combine two claims.
Interpretationreasoning§ 5.3.2 Theoretical and Policy ImplicationsThe shift to LLMs erodes the expertise position of skilled workers and leads to a more flattened wage distribution between skill levels.
“This shift erodes the expertise position of skilled workers and leads to a more flattened wage distribution between skill levels.”
Quote in the paperSubstantial claim- The authors state this as an assumption: All markets are competitive.
- The authors state this as an assumption: There exists a distribution function Pi characterizing the relevant information in task i, and the complexity of task i is defined by entropy Hi(P).
- The authors state this as an assumption: Skilled workers have a comparative advantage in more complex tasks.
- The authors state this as an assumption: The inability to distinguish between a model's output and the theoretically perfect execution of a task denotes competence.
- The authors state this as an assumption: The accuracy of a model's performance is directly proportional to its productivity in automated tasks.
- The authors state this as an assumption: KL-divergence is a measurement of productivity loss.
- The authors state this as an assumption: Deep learning AI and LLMs AI models represent a distinct technological logic.
- The authors state this as an assumption: For each task, there is a productivity upper bound A_bar.
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
Interpretationreasoning§ 6 Discussions and ConclusionsThe theoretical model captures at least part of the momentum shaping labor market demand in China.
“In this sense, we believe the model captures at least part of the momentum shaping labor market demand in China.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.
Interpretationreasoning§ 5.3.2 Theoretical and Policy ImplicationsAlgorithms based on distinct technological logic are predisposed to disrupt different types of tasks, and variances in technological underpinnings will inevitably result in divergent outcomes in productivity and income distribution.
“The overarching insight from our theoretical model is that algorithms, based on distinct technological logic, are predisposed to disrupt different types of tasks. These variances in technological underpinnings will inevitably result in divergent outcomes in terms of productivity and income distribution.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: All markets are competitive.
- The authors state this as an assumption: There exists a distribution function Pi characterizing the relevant information in task i, and the complexity of task i is defined by entropy Hi(P).
- The authors state this as an assumption: Skilled workers have a comparative advantage in more complex tasks.
- The authors state this as an assumption: The inability to distinguish between a model's output and the theoretically perfect execution of a task denotes competence.
- The authors state this as an assumption: The accuracy of a model's performance is directly proportional to its productivity in automated tasks.
- The authors state this as an assumption: KL-divergence is a measurement of productivity loss.
- The authors state this as an assumption: Deep learning AI and LLMs AI models represent a distinct technological logic.
- The authors state this as an assumption: For each task, there is a productivity upper bound A_bar.
Probably not a substantial claim: may not pass S4 (based).
Interpretationnone given§ 6 Discussions and ConclusionsThe theoretical model provides a deeper understanding of the reasons behind occupational exposure to LLMs, which diverges from the prediction of the routinization hypothesis.
“Furthermore, we develop a theoretical model to provide a deeper understanding of the reasons behind occupational exposure to LLMs, which diverges from the prediction of the routinization hypothesis.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: All markets are competitive.
- The authors state this as an assumption: There exists a distribution function Pi characterizing the relevant information in task i, and the complexity of task i is defined by entropy Hi(P).
- The authors state this as an assumption: Skilled workers have a comparative advantage in more complex tasks.
- The authors state this as an assumption: The inability to distinguish between a model's output and the theoretically perfect execution of a task denotes competence.
- The authors state this as an assumption: The accuracy of a model's performance is directly proportional to its productivity in automated tasks.
- The authors state this as an assumption: KL-divergence is a measurement of productivity loss.
- The authors state this as an assumption: Deep learning AI and LLMs AI models represent a distinct technological logic.
- The authors state this as an assumption: For each task, there is a productivity upper bound A_bar.
Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.
Interpretationreasoning§ 5.3.2 Theoretical and Policy ImplicationsThe progression of LLMs AI technology will generate outcomes that deviate from those predicted by the routinization hypothesis, and its influence on labor markets is anticipated to be distinctly different from that of traditional AI.
“This distinction is why the progression of LLMs AI technology will generate outcomes that deviate from those predicted by the routinization hypothesis. Fundamentally, the influence of LLMs AI technology on labor markets is anticipated to be distinctly different from that of traditional AI.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: All markets are competitive.
- The authors state this as an assumption: There exists a distribution function Pi characterizing the relevant information in task i, and the complexity of task i is defined by entropy Hi(P).
- The authors state this as an assumption: Skilled workers have a comparative advantage in more complex tasks.
- The authors state this as an assumption: The inability to distinguish between a model's output and the theoretically perfect execution of a task denotes competence.
- The authors state this as an assumption: The accuracy of a model's performance is directly proportional to its productivity in automated tasks.
- The authors state this as an assumption: KL-divergence is a measurement of productivity loss.
- The authors state this as an assumption: Deep learning AI and LLMs AI models represent a distinct technological logic.
- The authors state this as an assumption: For each task, there is a productivity upper bound A_bar.
May combine two claims.
Interpretationreasoning§ 5.3.2 Theoretical and Policy ImplicationsTraditional AI excels at performing less complex tasks typically carried out by unskilled workers, and automation of such tasks increases wage premiums between skilled and unskilled workers by eroding the position of unskilled workers.
“Traditional AI excels at performing less complex tasks typically carried out by unskilled workers. The automation of such tasks increases wage premiums between skilled and unskilled workers by eroding the position of unskilled workers.”
Quote in the paperSubstantial claim- The authors state this as an assumption: All markets are competitive.
- The authors state this as an assumption: There exists a distribution function Pi characterizing the relevant information in task i, and the complexity of task i is defined by entropy Hi(P).
- The authors state this as an assumption: Skilled workers have a comparative advantage in more complex tasks.
- The authors state this as an assumption: The inability to distinguish between a model's output and the theoretically perfect execution of a task denotes competence.
- The authors state this as an assumption: The accuracy of a model's performance is directly proportional to its productivity in automated tasks.
- The authors state this as an assumption: KL-divergence is a measurement of productivity loss.
- The authors state this as an assumption: Deep learning AI and LLMs AI models represent a distinct technological logic.
- The authors state this as an assumption: For each task, there is a productivity upper bound A_bar.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Premisecitation§ 6 Discussions and ConclusionsGe and Yang (2014) documented that between 1992 and 2007, during rapid economic growth in China, the average real wage increased by 202%, accompanied by a sharp rise in wage inequality.
“Ge and Yang (2014) documented that between 1992 and 2007, during a period of rapid economic growth in China, the average real wage increased by 202%, accompanied by a sharp rise in wage inequality.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Ge and Yang (2014) source
The quote only partly states this claim.
Interpretationreasoning§ 4. Labor market clearing condition:In the model with deep learning AI and LLMs, the threshold shifts.
“In sum, we have proved that a shift of threshold and a decrease in wage premium.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
Interpretationnone given§ Appendix E.4 Representativeness of Online Job Vacancy PostingsThe online recruitment labor market does not equal the whole labor market.
“Obviously, the online recruitment labor market does not equal to the whole labor market”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown data§ Appendix E.3 Errors Checking and Missing InformationDuplicate recruitment ads were adjusted in the empirical analysis, especially when counting vacancy numbers.
“In our empirical analysis, esp. counting vacancy number, we consider this concern by adjusting duplicate recruitment ads.”
Quote in the paperNot a substantial claimThe quote only partly states this claim.
Interpretationreasoning§ 4. Labor market clearing condition:In the model with deep learning AI and LLMs, the wage premium decreases.
“In sum, we have proved that a shift of threshold and a decrease in wage premium.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Interpretationreasoning§ Appendix E.4 Representativeness of Online Job Vacancy PostingsThe study cannot address the issue of representativeness of online job recruitment.
“therefore, we cannot address the issue of representative of online job recruitment.”
Quote in the paperNot a substantial claim- Rests on an assumption: In China there is no representative recruitment dataset such as JOLTS in the United States.
The paper relies on this without support.
Countries differ in labor market structures such as occupation and industry composition, and even for the same occupation the detailed task composition or work content may exhibit great discrepancies across countries.
“Nevertheless, countries differ in their labor market structures such as occupation and industry composition. Even for the same occupation, the detailed task composition or work content may exhibit great discrepancies across countries.”
The paper relies on this without support.
The same prompt can still yield different results from large language models, even with a higher temperature setting.
“The same prompt can still yields different results from large language models, even with a higher temperature setting.”
The authors state this as an assumption.
All markets are competitive.
“We assume all markets to be competitive.”
The authors state this as an assumption.
There exists a distribution function Pi characterizing the relevant information in task i, and the complexity of task i is defined by entropy Hi(P).
“Let us assume that there exists a distribution function Pi which characterize the relevant information in task i . Therefore, the complexity of a task i is defined by entropy Hi ( P ) .”
The authors state this as an assumption.
Skilled workers have a comparative advantage in more complex tasks.
“Furthermore, we assume that skilled worker has a comparative advantage in the more complex tasks.”
The authors state this as an assumption.
The inability to distinguish between a model's output and the theoretically perfect execution of a task denotes competence.
“A fundamental postulate of this research is that the inability to distinguish between a model's output and the theoretically perfect execution of a task denotes competence.”
The authors state this as an assumption.
The accuracy of a model's performance is directly proportional to its productivity in automated tasks.
“Consequently, the accuracy of a model's performance is directly proportional to its productivity in automated tasks.”
The authors state this as an assumption.
KL-divergence is a measurement of productivity loss.
“Still we assume that KL-divergence is a measurement of productivity loss.”
The authors state this as an assumption.
Deep learning AI and LLMs AI models represent a distinct technological logic.
“Nowlet us assume that deep learning AI and LLMs AI models represent a distinct technological logic.”
The authors state this as an assumption.
For each task, there is a productivity upper bound A_bar.
“Let assume that for each task, we have a productivity upper bound ¯ A”
The authors state this as an assumption.
The price of models M is exogenous and equal to F.
“We also impose a exogenous price of models M as F .”
The paper relies on this without support.
In China there is no representative recruitment dataset such as JOLTS in the United States.
“Since in China there is no representative recruitment dataset such as JOLTS in United States”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Figure 16 is cited as the model-expert comparison
MinorThe text directs readers to Figure 16 for a comparison of model scores with human expert scores, but Figure 16 is captioned as a comparison of weighted assignments.
“Upon comparing the model scores with the results of human expert scoring in Figure 16, we observed substantial positive correlations between the model scores and human expert scores.”
“Figure 16: Exposure Scores with Different Weighted Assignments”
Figure 4 is cited for experience premiums but shows wage growth
MinorThe discussion cites Figure 4 as depicting experience premiums and returns from learning. Its caption instead identifies the plotted outcome as the annual wage growth rate.
“As depicted in Figure 4, LLMs could potentially alter the experience premium and the profile of returns from learning.”
“Figure 4: Annual Wage Growth Rate and Exposure Score (Medium-category): LLMs.”
Proposition 2 defines its middle task interval with identical endpoints
MinorProposition 2 specifies two ordered thresholds but states the middle allocation condition only for tasks between the first threshold and itself, an empty interval. The proof describes the second threshold as the boundary between unskilled and skilled work, which requires the middle interval to extend to that second threshold.
“for any ˜ I 1 < i < ˜ I 1, ˜ h ( i ) = ˜ m ( i ) = 0”
“the threshold task ˜ I 2 can be profitably produced using either skilled or unskilled workers,”
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · see citing works
Jakubův, J., Chvalovský, K., Goertzel, Z., et al. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,648 · see citing works
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb00917.x · Cited by 49,574 · see citing works
A mathematical theory of communication
Hockett, C. F., Shannon, C., & Weaver, W. (1948) · MOCO · doi:10.1145/584091.584093 · Cited by 30,529
The future of employment: How susceptible are jobs to computerisation?
Frey, C. B., & Osborne, M. A. (2017) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2016.08.019 · Cited by 8,727 · cited 1× · see citing works
“…2019; Meindl, Frank, and Mendonc¸a 2021), employing machine learning classifiers to estimate the potential for automation across all occupations (Frey and Osborne 2017), devising innovative rubric the suitability of worker activities by machine learning (Brynjolfsson, Mitchell, and Rock 2018),…”
The Skill Content of Recent Technological Change: An Empirical Exploration
Autor, D. H., Levy, F., & Murnane, R. J. (2003) · The Quarterly Journal of Economics · doi:10.1162/003355303322552801 · Cited by 6,205 · see citing works
Information Theory, Inference, and Learning Algorithms
(2004) · Kybernetes · doi:10.1108/03684920410534506 · Cited by 4,937 · see citing works
Changes in Relative Wages, 1963-1987: Supply and Demand Factors
Katz, L. F., & Murphy, K. M. (1992) · The Quarterly Journal of Economics · doi:10.2307/2118323 · Cited by 4,793 · see citing works
Skills, Tasks and Technologies: Implications for Employment and Earnings
Acemoglu, D., & Autor, D. (2011) · Handbook of Labor Economics · doi:10.1016/s0169-7218(11)02410-5 · Cited by 3,799 · see citing works
Implications of rational inattention
Sims, C. (2003) · Journal of Monetary Economics · doi:10.1016/s0304-3932(03)00029-1 · Cited by 3,582 · see citing works
Acemoglu, D., & Restrepo, P. (2018) · American Economic Review · doi:10.1257/aer.20160696 · Cited by 3,121 · cited 1× · see citing works
“Recent studies have made distinctions between task-displacement and task-reinstatement effects of technology, whereby new technology introduces novel occupations that bolster labor demand (Acemoglu and Restrepo 2018, 2019).”
The Skill Content of Recent Technological Change: An Empirical Exploration
Autor, D., Levy, F. S., & Murnane, R. J. (2001) · National Bureau of Economic Research · doi:10.3386/w8337 · Cited by 2,633 · see citing works
The information bottleneck method
Tishby, N., Pereira, F. C., & Bialek, W. (2000) · arXiv · doi:10.48550/arxiv.physics/0004057 · Cited by 2,626 · see citing works
Automation and New Tasks: How Technology Displaces and Reinstates Labor
Acemoglu, D., & Restrepo, P. (2019) · Journal of Economic Perspectives · doi:10.1257/jep.33.2.3 · Cited by 2,612 · see citing works
Skills, Tasks and Technologies: Implications for Employment and Earnings
Acemoglu, D., & Autor, D. (2010) · doi:10.3386/w16082 · Cited by 2,180 · see citing works
Deep learning and the information bottleneck principle
Tishby, N., & Zaslavsky, N. (2015) · Information Theory Workshop · doi:10.1109/itw.2015.7133169 · Cited by 2,170 · see citing works
Experimental Evidence on the Productivity Effects of Generative Artificial Intelligence
Noy, S., & Zhang, W. (2023) · doi:10.2139/ssrn.4375283 · Cited by 2,157 · see citing works
Experimental evidence on the productivity effects of generative artificial intelligence
Noy, S., & Zhang, W. (2023) · Science · doi:10.1126/science.adh2586 · Cited by 2,150 · see citing works
A Survey of Large Language Models
Zhao, W. X., Zhou, K., Li, J., Tang, T., Dong, Z., Hou, Y., Zhang, B., Min, Y., Zhang, J., Liu, P., et al. (2026) · Frontiers of Computer Science · doi:10.1007/s11704-026-60308-3 · Cited by 2,093 · cited 1× · see citing works
“The recent remarkable progress in the field of generative AI and large language models (LLMs) (Bubeck et al. 2023; Zhao et al. 2023) has provoke many pressing questions about the effects of these powerful technologies on the economy.”
A Survey of Large Language Models
Zhao, W. X., Zhou, K., Li, J., Tang, T., Wang, X., Hou, Y., Min, Y., Zhang, B., Zhang, J., Dong, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.18223 · Cited by 2,090
Technical change, inequality, and the labor market
Acemoglu, D. (2002) · Journal of Economic Literature · doi:10.1257/jel.40.1.7 · Cited by 1,767 · see citing works
Scaling Laws for Neural Language Models
Kaplan, J., McCandlish, S., Henighan, T., Brown, T. B., Chess, B., Child, R., Gray, S., Radford, A., Wu, J., & Amodei, D. (2020) · arXiv · Cited by 1,749 · see citing works
The polarization of the U.S. labor market
Autor, D. H., Katz, L. F., & Kearney, M. S. (2006) · American Economic Review · doi:10.1257/000282806777212620 · Cited by 1,594 · cited 2× · see citing works
“Upon comparing the model scores with the results of hu-Figure (Autor, Katz, and Kearney 2006; Acemoglu and Autor 2011).”
Sparks of Artificial General Intelligence: Early experiments with GPT-4
Bubeck, S., Chandrasekaran, V., Eldan, R., Gehrke, J., Horvitz, E., Kamar, E., Lee, P., Lee, Y. T., Li, Y., Lundberg, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.12712 · Cited by 1,526 · cited 1× · see citing works
“The recent remarkable progress in the field of generative AI and large language models (LLMs) (Bubeck et al. 2023; Zhao et al. 2023) has provoke many pressing questions about the effects of these powerful technologies on the economy.”
Deep Variational Information BottleneckPreprint
Alemi, A. A., Fischer, I., Dillon, J. V., & Murphy, K. P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.00410 · Cited by 1,291 · see citing works
Brynjolfsson, E., Li, D., & Raymond, L. (2025) · The Quarterly Journal of Economics · doi:10.1093/qje/qjae044 · Cited by 1,083 · see citing works
GLM: General Language Model Pretraining with Autoregressive Blank Infilling
Du, Z., Qian, Y., Liu, X., Ding, M., Qiu, J., Yang, Z., & Tang, J. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.26 · Cited by 1,028 · cited 7× · see citing works
“Specifically, we utilize Open AI’s GPT-4 model (OpenAI 2023), the InternLM model developed by Shanghai AI Laboratory and Sense Time (InternLM-Team 2023), and the GLM (Zeng et al. 2022; Du et al. 2022) to categorize occupations based on their complete set of occupational descriptions.”
InfluentialTraining Compute-Optimal Large Language Models
Hoffmann, J., Borgeaud, S., Mensch, A., Buchatskaya, E., Cai, T., Rutherford, E., Casas, D. D. L., Hendricks, L. A., Welbl, J., Clark, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.15556 · Cited by 929 · see citing works
(2018) · AEA Papers and Proceedings · doi:10.1257/pandp · Cited by 852 · see citing works
Tasks, automation, and the rise in U.S. wage inequality
Acemoglu, D., & Restrepo, P. (2022) · Econometrica · doi:10.3982/ecta19815 · Cited by 715 · see citing works
Changes in Relative Wages, 1963-1987: Supply and Demand Factors
Katz, L. F., & Murphy, K. (1991) · National Bureau of Economic Research · doi:10.3386/w3927 · Cited by 700 · see citing works
What Can Machines Learn and What Does It Mean for Occupations and the Economy?
Brynjolfsson, E., Mitchell, T., & Rock, D. (2018) · AEA Papers and Proceedings · doi:10.1257/pandp.20181019 · Cited by 695 · see citing works
Viewpoint: when will AI exceed human performance? evidence from AI experts
Grace, K., Salvatier, J., Dafoe, A., Zhang, B., & Evans, O. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11222 · Cited by 579 · see citing works
GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models
Eloundou, T., Manning, S., Mishkin, P., & Rock, D. (2023) · arXiv · doi:10.48550/arxiv.2303.10130 · Cited by 545 · cited 5× · see citing works
“Building upon the exposure scoring methods proposed by Eloundou et al. (2023) which conceive an occupation as a collection of tasks, assess whether a given occupation can be executed more efficiently using ChatGPT or analogous LLMs.”
InfluentialThe Impact of Artificial Intelligence on the Labor Market
Webb, M. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3482150 · Cited by 531 · cited 2× · see citing works
“…demanded by distinct occupations (Felten, Raj, and Seamans 2018; Tolan et al. 2021), mapping AI patent descriptions to worker task descriptions (Webb 2019; Meindl, Frank, and Mendonc¸a 2021), employing machine learning classifiers to estimate the potential for automation across all occupations…”
Furman, J., & Seamans, R. (2018) · Innovation Policy and the Economy · doi:10.1086/699936 · Cited by 512 · cited 1× · see citing works
“Artificial Intelligence, like previous technologies, is poised to impact the economy in various ways, potentially fostering economic growth and reshaping the labor market structure (Furman and Seamans 2019; Goldfarb, Taska, and Teodoridis 2023).”
The Polarization of the U.S. Labor Market
Autor, D., Katz, L. F., & Kearney, M. S. (2006) · National Bureau of Economic Research · doi:10.3386/w11986 · Cited by 434 · see citing works
Rational Inattention: A Review
Maćkowiak, B., Matějka, F., & Wiederholt, M. (2023) · Journal of Economic Literature · doi:10.1257/jel.20211524 · Cited by 362 · see citing works
Elements of Information Theory
Yang, Y. (2008) · Journal of the American Statistical Association · doi:10.1198/jasa.2008.s218 · Cited by 342 · see citing works
Self-citationThe Impact of AI on Developer Productivity: Evidence from GitHub Copilot
Peng, S., Kalliamvakou, E., Cihon, P., & Demirer, M. (2023) · arXiv · doi:10.48550/arxiv.2302.06590 · Cited by 287 · cited 2× · see citing works
“…disruptive labor market impacts of LLMs is emerging quickly, however, it predominantly focuses attention on the labor market in developed economy, in particularly U.S. (Eloundou et al. 2023; Peng et al. 2023; Noy and Zhang 2023; Brynjolfsson, Li, and Raymond 2023; Felten, Raj, and Seamans 2023).”
When Will AI Exceed Human Performance? Evidence from AI Experts
Grace, K., Salvatier, J., Dafoe, A., Zhang, B., & Evans, O. (2017) · arXiv · doi:10.48550/arxiv.1705.08807 · Cited by 285 · see citing works
GLM-130B: An Open Bilingual Pre-trained Model
Zeng, A., Liu, X., Du, Z., Wang, Z., Lai, H., Ding, M., Yang, Z., Xu, Y., Zheng, W., Xia, X., et al. (2022) · arXiv · doi:10.48550/arxiv.2210.02414 · Cited by 281 · cited 7× · see citing works
“Specifically, we utilize Open AI’s GPT-4 model (OpenAI 2023), the InternLM model developed by Shanghai AI Laboratory and Sense Time (InternLM-Team 2023), and the GLM (Zeng et al. 2022; Du et al. 2022) to categorize occupations based on their complete set of occupational descriptions.”
InfluentialA Method to Link Advances in Artificial Intelligence to Occupational Abilities
Felten, E. W., Raj, M., & Seamans, R. (2018) · AEA Papers and Proceedings · doi:10.1257/pandp.20181021 · Cited by 252 · see citing works
Wage inequality, technology and trade: 21st century evidence
Reenen, J. M. V. (2011) · Labour Economics · doi:10.1016/j.labeco.2011.05.006 · Cited by 235 · cited 2× · see citing works
“…studies have demonstrated that automation technologies have contributed to both income inequality and job polarization, driven by declines in relative wages and employment for workers specializing in routine tasks (Autor, Katz, and Kearney 2006; Van Reenen 2011; Acemoglu and Re-strepo 2022).”
Information-theoretic analysis of generalization capability of learning algorithmsPreprint
Xu, A., & Raginsky, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.07809 · Cited by 226 · see citing works
Avi Goldfarb, B., Taska, B., & Teodoridis, F. (2022) · Research Policy · doi:10.1016/j.respol.2022.104653 · Cited by 222 · see citing works
Measuring the Occupational Impact of AI: Tasks, Cognitive Abilities and AI Benchmarks
Tolan, S., Pesole, A., Martínez‐Plumed, F., Fernández‐Macías, E., Hernández‐Orallo, J., & Gómez, E. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12647 · Cited by 181 · cited 1× · see citing works
“…methodologies encompass aligning AI capabilities with diverse skills and abilities demanded by distinct occupations (Felten, Raj, and Seamans 2018; Tolan et al. 2021), mapping AI patent descriptions to worker task descriptions (Webb 2019; Meindl, Frank, and Mendonc¸a 2021), employing machine…”
Changes in China’s wage structure
Ge, S., & Yang, D. T. (2014) · Journal of the European Economic Association · doi:10.1111/jeea.12072 · Cited by 177 · see citing works
Eisfeldt, A., Schubert, G., & Zhang, M. B. (2023) · doi:10.3386/w31222 · Cited by 165 · see citing works
Combining Human Expertise with Artificial Intelligence: Experimental Evidence from Radiology
Agarwal, N., Moehring, A., Rajpurkar, P., & Salz, T. (2023) · doi:10.2139/ssrn.4505053 · Cited by 161 · see citing works
Combining Human Expertise with Artificial Intelligence: Experimental Evidence from Radiology
Agarwal, N., Moehring, A., Rajpurkar, P., & Salz, T. (2023) · doi:10.3386/w31422 · Cited by 161 · see citing works
Applying AI to Rebuild Middle Class Jobs
Autor, D. (2024) · doi:10.3386/w32140 · Cited by 157 · see citing works
Occupational Heterogeneity in Exposure to Generative AI
Felten, E. W., Raj, M., & Seamans, R. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4414065 · Cited by 113 · cited 2× · see citing works
“Pertinent to this paper, Felten, Raj, and Seamans (2023) explored the heterogeneity in occupational exposure, while Eloundou et al. (2023) introduced a novel rubric to assess the impacts of LLMs on labor forces.”
Automation and New Tasks: How Technology Displaces and Reinstates Labor
Acemoğlu, D., & Restrepo, P. (2019) · National Bureau of Economic Research · doi:10.3386/w25684 · Cited by 112
Tasks, Automation, and the Rise in US Wage Inequality
Acemoğlu, D., & Restrepo, P. (2021) · National Bureau of Economic Research · doi:10.3386/w28920 · Cited by 103 · see citing works
To Compress or Not to Compress—Self-Supervised Learning and Information Theory: A Review
Shwartz-Ziv, R., & LeCun, Y. (2024) · Entropy · doi:10.3390/e26030252 · Cited by 93 · see citing works
Goldfarb, A., Taska, B., & Teodoridis, F. (2022) · National Bureau of Economic Research · doi:10.3386/w29767 · Cited by 78 · see citing works
2015 IEEE Information Theory Workshop (ITW)
(2015) · doi:10.1109/itw33791.2015 · Cited by 62 · see citing works
The Growing Importance of Decision-Making on the Job
Deming, D. (2021) · doi:10.3386/w28733 · Cited by 52 · see citing works
Furman, J., & Seamans, R. (2018) · National Bureau of Economic Research · doi:10.3386/w24689 · Cited by 32 · see citing works
Eisfeldt, A. L., Schubert, G., Zhang, M. B., & Taska, B. (2023) · doi:10.2139/ssrn.4436627 · Cited by 17 · see citing works
Exposure of occupations to technologies of the fourth industrial revolutionPreprint
Meindl, B., Frank, M. R., & Mendonça, J. (2021) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.2110.13317 · Cited by 10 · see citing works
Acemoğlu, D., & Restrepo, P. (2018) · ICPSR Data Holdings · doi:10.3886/e113138v1 · Cited by 3
OpenAI, Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Aleman, F. L., Almeida, D., Altenschmidt, J., Altman, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.08774
Cover, F. M. (1999) · Cartographic Perspectives · doi:10.14714/cp33.1015
Flagged first, then by citations
Cited by
Sorted by citations
Chen, X., Yang, J., & Wu, B. (2025) · Telecommunications Policy · doi:10.1016/j.telpol.2025.103055 · Cited by 14 · see citing works
AI Delphi: Machine-Machine Collaboration for Exploring the Future of WorkPreprint
Nóbrega, L., Marchhausen, L., Martinez, L. F., et al. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4660589 · Cited by 5 · see citing works
Bergougui, B., Sulimany, H. G. H., & Alharbi, A. A. (2026) · Corporate Social Responsibility and Environmental Management · doi:10.1002/csr.70689 · Cited by 4 · see citing works
Wu, Z., Gan, H., Zhang, L., Hussain, W. M. H. W., & Ali, S. H. M. (2026) · Scientific Reports · doi:10.1038/s41598-026-41586-0 · Cited by 4 · see citing works
“Participants were recruited from various industries to enhance the generalizability of findings, given that AI tools have been widely adopted across diverse sectors 110 .”
Ji, Y., Chen, L., Wang, L., Hou, J., Chen, X., & Zhu, H. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4862800 · Cited by 3 · see citing works
Li, Y., Li, R., & Wang, Q. (2026) · Sustainable Development · doi:10.1002/sd.71238 · Cited by 1 · see citing works
Mohamud, A. J., Rage, A. N., Mohamed, A. D., & Mohamud, A. M. (2026) · Cogent Business & Management · doi:10.1080/23311975.2026.2706234
Shakhovska, N. (2025) · Mathematical Modeling and Computing · doi:10.23939/mmc2025.03.993
Generative AI and Potential for Augmentation: A Data-Driven Analysis of Labor Market in RussiaPreprint
Elisov, M., Pshinnik, K., Bordunos, A., et al. (2025) · Research Square · doi:10.21203/rs.3.rs-7173895/v1
Work Design and Compensation Strategies in a Post‐ COVID World: Evidence From Online Job Postings
Ge, C., Deng, H., Wu, D., Huang, H., & Dulebohn, J. H. (2026) · Human Resource Management · doi:10.1002/hrm.70057
Situating Technologies and Work in the Asia Pacific: An Institutional Perspective
Liu, M., 张, H. P. 华. Z., & Lansbury, R. D. (2026) · Asia Pacific Journal of Human Resources · doi:10.1111/1744-7941.70083
Da, X. (2026) · Journal of Economic Surveys · doi:10.1111/joes.70134
Gao, H., Yao, F., Zhang, Z. D., et al. (2026) · International Annual Conference on Complex Systems and Intelligent Science (CSIS-IAC) · doi:10.1109/csis-iac70275.2026.11585161
“For example, Chen et al. (2025) demonstrate that LLM-based automation risk assessments in China reveal institutionally mediated patterns that challenge the routinization hypothesis [9].”
The impact of artificial intelligence exposure on delayed retirement behavior: Evidence from China
Wei, X., Zhou, J., Zeng, C., et al. (2026) · China Economic Review · doi:10.1016/j.chieco.2026.102758
Task-Based Exposure to Large Language Models and Occupational Heterogeneity in ChinaPreprint
Hu, Q., Qin, X., & Li, X. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7285434
Task-based AI exposure and industrial carbon emissions: evidence from China
Xiao, P., He, Y., Huang, K., et al. (2026) · Frontiers in Environmental Science · doi:10.3389/fenvs.2026.1898743
Qiu, B., Wang, T., Shen, D., Zhang, Z., Li, S., & Lu, Y. (2026) · International Conference on Big Data and Information Analytics (BigDIA) · doi:10.1109/bigdia71496.2026.11684667
“Another line of research uses patent data as a proxy for technological capabilities[13-15, 24 ,25].”
- Authors
- Chen, Q., Ge, J., Xie, H., Xu, X., & Yang, Y.
- Affiliations
- Shanghai Maritime University (CN)
- Shanghai Artificial Intelligence Laboratory (CN)
- Fudan University (CN)
- Corresponding author
- Ge, Jinfeng
- Xu, Xingcheng
- Yang, Yanqing
- Venue
- China Economic Review
- Publisher
- Elsevier BV
- Published
- 2025-08
- Volume
- 92
- Pages
- 102413
- ISSN
- 1043-951X (ISSN-L)
- OpenAlex
- W4410015324
- Semantic Scholar
- 7d8cfda875f855b69ce5a8cf659a4ca105a34605
- Cited by
- 17
- References
- 52
- Citations by year
- 2026: 12 · 2025: 3 · 2024: 1 · 2023: 1
- FWCI
- 14.59
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- China Economic Review (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- National Natural Science Foundation of China (71933001)
- Ministry of Human Resources and Social Security
- Shanghai Artificial Intelligence Laboratory
- Topics
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Labor market dynamics and wage inequality
- Social Sciences › Sociology and Political Science › Digital Economy and Work Transformation
- Social Sciences › Decision Sciences › Management Science and Operations Research › Impact of AI and Big Data on Business and Society
- Keywords
- large language models, labor market, occupational exposure, wage premium, Shannon entropy, human expertise, automation risk, Chinese labor market
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-12.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-12.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review