Cited by 32Impact of Technology on AdolescentsInnovative Human-Technology InteractionSocial Robot Interaction and HRI

LLM-D12: A Dual-Dimensional Scale of Instrumental and Relational Dependencies on Large Language Models

Open access
Yankouskaya, Ala, Babiker, Areej, Rizvi, Syeda, Alshakhsi, Sameha, Liebherr, Magnus, Ali, Raian·2025·ACM Transactions on the Web

Abstract

There is growing interest in understanding how people interact with large language models (LLMs) and whether such models elicit dependency or even addictive behaviour. Validated tools to assess the extent to which individuals may become dependent on LLMs are scarce and primarily build on classic behavioral addiction symptoms, adapted to the context of LLM use. We view this as a conceptual limitation, as the LLM-human relationship is more nuanced and warrants a fresh and distinct perspective. To address this gap, we developed and validated a new 12-item questionnaire to measure LLM dependency, referred to as LLM-D12. The scale was based on the authors' prior theoretical work, with items developed accordingly and responses collected from 526 participants in the UK. Exploratory and confirmatory factor analyses, performed on separate halves of the total sample using a split-sample approach, supported a two-factor structure: Instrumental Dependency (six items) and Relationship Dependency (six items). Instrumental Dependency reflects the extent to which individuals rely on LLMs to support or collaborate in decision-making and cognitive tasks. Relationship Dependency captures the tendency to perceive LLMs as socially meaningful, sentient, or companion-like entities. The two-factor structure demonstrated excellent internal consistency and clear discriminant validity. External validation confirmed both the conceptual foundation and the distinction between the two subscales. The psychometric properties and structure of our LLM-D12 scale were interpreted in light of the emerging view that dependency on LLMs does not necessarily indicate dysfunction but may still reflect reliance levels that could become problematic in certain contexts.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3765895

Cites

91 of 100 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Self-developed measures may focus on relational aspects or aspects associated with strong emotional attachment but not measuring indicators of dependence, supported by theoretical considerations regarding the adoption of cognitive tools.

    “or on relational aspects or aspects associated with strong emotional attachment105, but not measuring indicators of dependence, supported by theoretical considerations regarding the adoption of cognitive tools.”

    From A scoping review on the mental health harms of LLM-based chatbots (2026) · cites this paper as [105]

    The Design section explicitly says LLM-D12 was developed to measure dependency on LLMs and that its items reflect symptoms of dependency. Its relational subscale does address social and emotional bonds, but the claim that it does not measure indicators of dependence is contrary to the paper’s stated purpose (page unavailable in our copy). (LLM, conf=0.86)

    Checked by a reasoning model — may be wrong.

    Experimental — accuracy not yet measured
  • Some scales do not differentiate between functional and relational overreliance, potentially confounding different constructs.

    “some scales do not differentiate between functional and relational overreliance, potentially confounding different constructs105.”

    From A scoping review on the mental health harms of LLM-based chatbots (2026) · cites this paper as [105]

    Section 4.3 finds that instrumental and relationship dependency are distinct constructs, and Section 3.5.2 reports that a one-factor model fit significantly worse than a two-factor model. This supports the concern about combining the constructs, but the passages do not establish that some existing scales fail to differentiate them. (LLM, conf=0.82)

    Experimental — accuracy not yet measured
  • Measures of AI dependence consist either of adaptations from other scales of behavioral addiction to technologies (e.g., social media, smartphone, or internet addiction) or self-developed measures.

    “Measures of “AI dependence” consist either of adaptations from other scales of behavioral addiction to technologies (e.g., social media, smartphone, or internet addiction)100–102, or self-developed measures103–106.”
  • Dependence on LLM-CBs can be classified into an instrumental component (cognitive overreliance) and a relational component (pseudosocial dependence).

    “Dependence on LLM-CBs can be classified into an instrumental component (cognitive overreliance) and a relational component (pseudosocial dependence)105.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 13

  1. R. Heersmink, "Use of large language models might affect our cognitive skills," Nat Hum Behav, vol. 8, no. 5, pp. 805-806, May 2024, doi: 10.1038/S41562-024-01859-Y;SUBJMETA=179,4007,438;KWRD=ETHICS,PHILOSOPHY. · DOI
  2. Z. Elyoseph, D. Hadar-Shoval, K. Asraf, and M. Lvovsky, "ChatGPT outperforms humans in emotional awareness evaluations," Front Psychol, vol. 14, p. 1199058, May 2023, doi: 10.3389/FPSYG.2023.1199058/BIBTEX. · DOI
  3. M. Chandra et al., "Longitudinal Study on Social and Emotional Use of AI Conversational Agent," arXiv preprint arXiv:2504.14112, Apr. 2025, Accessed: May 05, 2025. [Online]. Available: https://arxiv.org/pdf/2504.14112 · arXiv
  4. J. Coda-Forno et al., "Inducing anxiety in large language models can induce bias," Apr. 2023, Accessed: May 05, 2025. [Online]. Available: https://arxiv.org/pdf/2304.11111 · arXiv
  5. M. Kosinski, "Evaluating large language models in theory of mind tasks," Proc Natl Acad Sci U S A, vol. 121, no. 45, p. e2405460121, Nov. 2024, doi: 10.1073/PNAS.2405460121/SUPPL_FILE/PNAS.2405460121.SAPP.PDF. · DOI
  6. S. C. Yu, H. R. Chen, and Y. W. Yang, "Development and validation the Problematic ChatGPT Use Scale: a preliminary report," Current Psychology, vol. 43, no. 31, pp. 26080-26092, Aug. 2024, doi: 10.1007/S12144-024-06259-Z/TABLES/4. · DOI
  7. B. Waber and N. J. Fast, "Is GenAI"s Impact on Productivity Overblown?," Harvard Business Review .
  8. G. Northoff, "Is the self a higher-order or fundamental function of the brain? The "basis model of self-specificity" and its encoding by the brain"s spontaneous activity," Cogn Neurosci, vol. 7, no. 1-4, pp. 203-222, Oct. 2016, doi: 10.1080/17588928.2015.1111868. · DOI
  9. C. Sindermann et al., "Assessing the Attitude Towards Artificial Intelligence: Introduction of a Short Measure in German, Chinese, and English Language," KI -Kunstliche Intelligenz, vol. 35, no. 1, pp. 109-118, Mar. 2021, doi: 10.1007/S13218-020-00689- 0/TABLES/5. · DOI
  10. G. W. Cheung, H. D. Cooper-Thomas, R. S. Lau, and L. C. Wang, "Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations," Asia Pacific Journal of Management, vol. 41, no. 2, pp. 745- 783, Jun. 2024, doi: 10.1007/S10490-023-09871-Y/TABLES/7. · DOI
  11. J. C. Nunnally and I. H. Bernstein, "Psychometric theory," Published in 1994 in New York by McGraw-Hill, pp. 9-11, 1994, Accessed: Apr. 30, 2025. [Online]. Available: https://lib.ugent.be/catalog/rug01:000331515
  12. J. Henseler, C. M. Ringle, and M. Sarstedt, "A new criterion for assessing discriminant validity in variance-based structural equation modeling," J Acad Mark Sci, vol. 43, no. 1, pp. 115-135, Jan. 2015, doi: 10.1007/S11747-014-0403-8/FIGURES/8. · DOI
  13. R. Heersmink, "The Internet, Cognitive Enhancement, and the Values of Cognition," Minds Mach (Dordr), vol. 26, no. 4, pp. 389-407, Dec. 2016, doi: 10.1007/S11023-016-9404-3/METRICS. · DOI

Cited by

Sorted by citations

Authors
Yankouskaya, A., Babiker, A., Rizvi, S., Alshakhsi, S., Liebherr, M., & Ali, R.
Affiliations
  • Bournemouth University (GB)
  • Hamad bin Khalifa University (QA)
  • University of Duisburg-Essen (DE)
Venue
ACM Transactions on the Web
Published
2025-09-03
ISSN
  • 1559-1131 (ISSN-L)
  • 1559-114X
OpenAlex
W4413955382
Cited by
32
References
89
Citations by year
2026: 28 · 2025: 4
FWCI
55.62
Type
journal article
Language
en
Open access
Licence
other-oa
Locations
  • ACM Transactions on the Web (publishedVersion, other-oa)
  • Bournemouth University Research Online (Bournemouth University) (acceptedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • Qatar Foundation
  • Fonds National de la Recherche Luxembourg
  • Qatar National Research Fund
  • Qatar National Library
Topics
  • Social Sciences › Sociology and Political Science › Impact of Technology on Adolescents
  • Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
Keywords
large language models, scale development, psychometric validation, two-factor structure, behavioral addiction, AI companionship

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review