PreprintCited by 1Library Science and Information SystemsWeb and Library ServicesLibrary Science and Information

Better Recommendations: Validating AI-generated Subject Terms Through LOC Linked Data Service

Open access
Tang, Kwok Leong, Jiang, Yi·2025·arXiv

Abstract

This article explores the integration of AI-generated subject terms into library cataloging, focusing on validation through the Library of Congress Linked Data Service. It examines the challenges of traditional subject cataloging under the Library of Congress Subject Headings system, including inefficiencies and cataloging backlogs. While generative AI shows promise in expediting cataloging workflows, studies reveal significant limitations in the accuracy of AI-assigned subject headings. The article proposes a hybrid approach combining AI technology with human validation through LOC Linked Data Service, aiming to enhance the precision, efficiency, and overall quality of metadata creation in library cataloging practices.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2508.00867

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Unlike the validation-only approach of Tang & Jiang (2025), the system decomposes the entire subject indexing workflow from conceptual analysis through MARC field construction into auditable, policy-grounded stages.

    “And unlike the validation-only approach of Tang & Jiang (2025), it decomposes the entire subject indexing workflowfrom conceptual analysis through MARC field constructioninto auditable, policy-grounded stages.”

    From A Skill-Based AI Agentic Pipeline for Library of Congress Subject Indexing (2026) · cites this paper as Tang & Jiang (2025)

    The Solution and Core Idea sections (p. 12) center Tang and Jiang’s approach on validating and refining LCSH suggestions through the LOC Linked Data Service, rather than constructing MARC fields. But “validation-only” is too narrow: the First Stage (p. 12) also has an LLM generate candidate subject terms from bibliographic input. The cited paper cannot establish the separate claim about what the citing authors’ system does. (LLM, conf=0.86)

    Experimental — accuracy not yet measured
  • The accuracy failures documented by Chow et al. (2024), Brzustowicz (2023), and Tang & Jiang (2025) are not primarily failures of topic identification; they are failures of rule application.

    “The accuracy failures documented by Chow et al. (2024), Brzustowicz (2023), and Tang & Jiang (2025) are not primarily failures of topic identification-they are failures of rule application.”

    From A Skill-Based AI Agentic Pipeline for Library of Congress Subject Indexing (2026) · cites this paper as Tang & Jiang (2025)

    Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.

    Experimental — accuracy not yet measured
  • Prior work has shown that single-prompt LLM approaches achieve only 26-35% alignment with human-assigned LCSH.

    “Where prior work has shown that single-prompt LLM approaches achieve only 26-35% alignment with human-assigned LCSH (Tang & Jiang, 2025) and struggle with subdivision construction (Chow et al., 2024)”

    From A Skill-Based AI Agentic Pipeline for Library of Congress Subject Indexing (2026) · cites this paper as Tang & Jiang, 2025

    The 'Accuracy of AI-Generated Subject Terms' section (p. 5) reports 26–35% alignment with human-assigned LCSH in one evaluation. It does not identify that result as coming from a single-prompt LLM approach, so the claim's methodological qualifier is unsupported. (LLM, conf=0.86)

    Experimental — accuracy not yet measured
  • One evaluation found only 26-35% alignment between AI-generated and human-assigned LCSH.

    “Tang & Jiang (2025) synthesized findings across multiple studies and reported overall poor performance for AI chatbots on LCSH assignment, with precision or F1 scores far below professional cataloging levels-one evaluation found only 2635% alignment between AI-generated and human-assigned LCSH.”

    From A Skill-Based AI Agentic Pipeline for Library of Congress Subject Indexing (2026) · cites this paper as Tang & Jiang (2025)

  • Tang & Jiang (2025) reported overall poor performance for AI chatbots on LCSH assignment, with precision or F1 scores far below professional cataloging levels.

    “Tang & Jiang (2025) synthesized findings across multiple studies and reported overall poor performance for AI chatbots on LCSH assignment, with precision or F1 scores far below professional cataloging levels-one evaluation found only 2635% alignment between AI-generated and human-assigned LCSH.”

    From A Skill-Based AI Agentic Pipeline for Library of Congress Subject Indexing (2026) · cites this paper as Tang & Jiang (2025)

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cited by

Sorted by citations

Authors
Tang, K. L., & Jiang, Y.
Venue
arXiv
Publisher
arXiv
Published
2025
ISSN
2331-8422 (ISSN-L)
OpenAlex
W4417161960
Cited by
0
References
0
Type
posted content
Language
en
Open access
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Information Systems › Library Science and Information Systems
  • Physical Sciences › Computer Science › Information Systems › Web and Library Services
  • Physical Sciences › Computer Science › Information Systems › Library Science and Information
Keywords
Library of Congress Subject Headings, library cataloging, subject cataloging, generative AI, human validation, metadata quality

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review