Cited by 3Artificial Intelligence in LawEthics and Social Impacts of AIDigitalization, Law, and Regulation

From Human Oversight to Cognitive Sovereignty: A Process-Based Governance Standard for AI-Assisted Legal Reasoning

Open access
Shukla, Shivam·2026·AI, Law, Politics

Abstract

This article argues that generative AI in legal reasoning exposes a process-governance gap rather than merely a technology-risk problem. Professional conduct rules, ethical guidance and risk-based regulation, including the EU Artificial Intelligence Act, increasingly require competence, verification and human oversight. They do not, however, sufficiently operationalise the cognitive sequence by which legal professionals should frame a question, use AI output, reconstruct doctrine, verify sources and exercise final judgment. Drawing on Mata v. Avianca in the United States, Gummadi Usha Rani v. Sure Mallikarjuna Rao in India and human-AI interaction research on automation bias and cognitive offloading, the article proposes two instruments: the Supervised Intelligence Methodology (SIM), a five-stage process standard for AI-assisted legal reasoning, and the AI Reliance Test (ART), an ex post accountability mechanism for courts, regulators and professional bodies. The core contribution is the doctrine of Cognitive Sovereignty, understood as a non-delegable obligation to preserve independent professional judgment. The framework connects legal ethics with institutional legitimacy, rule-of-law accountability and democratic trust in AI-mediated adjudication.

AI snapshot

Written from the paper’s full text.

TL;DR

This conceptual article argues that generative AI in legal reasoning exposes a process-governance gap: existing conduct rules and risk-based regulation (including the EU AI Act) require human oversight but do not specify the cognitive sequence through which a professional must integrate AI output into legal reasoning. It proposes two instruments — the five-stage Supervised Intelligence Methodology (SIM) and the ex post AI Reliance Test (ART) — grounded in a doctrine of "Cognitive Sovereignty," the non-delegable obligation to preserve independent professional judgment.

Key findings

  • The decisive failure in AI-assisted legal work is not hallucination itself but "the unverified acceptance of AI-generated legal authority as if it were professional knowledge"; in *Mata v. Avianca* (678 F. Supp. 3d 443, S.D.N.Y. 2023) the researching attorney used ChatGPT as his sole research source, failed to locate a generated case, and let the submission proceed, while the attorney of record reviewed only for flow and grammar; in *Gummadi Usha Rani v. Sure Mallikarjuna Rao* (SLP(C) No. 7575/2026, Supreme Court of India, 27 February 2026) a trial court order relied on four alleged judicial authorities that did not exist, which the Court treated as misconduct with legal consequences (para. 7).
  • Existing frameworks operate at three mismatched levels — conduct-based governance (what the professional must do), system-based governance (how AI systems are designed and deployed), and the underspecified process level (the sequence of cognitive operations connecting AI output to professional judgment). Article 14 of the EU AI Act requires effective human oversight and awareness of automation bias, and Article 26 requires competent, authorised deployer-side oversight, but neither prescribes a step-by-step cognitive protocol; a superficial reviewer and a source-grounded reconstructor can both appear to be "in the loop."
  • SIM specifies five stages with compliance evidence: (1) Legal Framing (human only), (2) Pattern Expansion (AI-assisted, human-directed), (3) Doctrinal Reconstruction (human-dominant), (4) Verification (human only), and (5) Strategic Judgment (human only). ART audits these ex post through four steps — Framing Diligence, Supervisory Adequacy, Verification Completeness, and Judgment Independence — where a negative answer identifies the corresponding SIM stage and a prima facie procedural breach, without itself determining intent, recklessness, negligence, or sanction.
  • The article frames the cognitive mechanism via Kahneman's dual-process account, coining "System 1 Lawyering" for the regression from deliberate legal analysis to automatic pattern acceptance when AI output mimics legal work product, and links the doctrine to public-reason and accountability concerns (algocracy, legitimacy deficit).

Methods

  • Conceptual and doctrinal analysis rather than empirical: the article states it uses two documented legal failures, *Gummadi Usha Rani* and *Mata v. Avianca*, as diagnostic case studies, "not presented as a comprehensive dataset," selected because each exposes the same cognitive failure in different institutional settings (a judicial order in India and a lawyer-filed submission in the United States).
  • The analysis translates human-AI interaction theory (automation bias, trust calibration, out-of-the-loop performance) and public-law/algorithmic-accountability scholarship into a proposed legal governance standard, structured around three objectives: diagnosing the gap, proposing SIM, and introducing ART.
  • No new empirical data were generated or analysed; the study draws on publicly available scholarly literature, legal materials, policy documents, regulatory instruments, and judicial decisions. Ethical review and informed consent were not required (no human participants or personal data).

Limitations

  • Stated by the paper: SIM and ART do not regulate model design, training data, cybersecurity, privacy, or provider liability — they address only the professional reasoning layer and are complements to, not substitutes for, system-level regulation; the article does not claim all legal uses of AI fall within the EU AI Act's high-risk categories; the framework is not yet empirically validated, and future research should test whether SIM reduces erroneous reliance in simulated legal research tasks, law firm pilots, and judicial training environments; ART is not an automatic disciplinary machine — institutions must still assess causation, harm, intent, proportionality, and sanction; and the framework does not claim to eliminate all inappropriate reliance, since trust calibration, automation bias, and out-of-the-loop problems are persistent human-factors risks.
  • Evident from the text: the two case studies are explicitly diagnostic rather than representative, so the empirical basis for the claimed failure pattern is illustrative; the article also notes that SIM "is not claimed to be positive law" and is offered as a minimum procedural architecture for adoption or adaptation, leaving its institutional uptake untested.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.5709/alp-02.01.2026-04

Cites

23 of 24 references verified1 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

17 of 68 cited sources checked · 11 supported · 1 flagged · accuracy not yet measured

  • Premisecitation

    De Bruijn, Warnier and Janssen (2022) show that explainable AI is not a simple cure for public-sector algorithmic decisionmaking because explanations operate within contested legal and administrative contexts.

    “De Bruijn, Warnier and Janssen (2022) show that explainable AI is not a simple cure for public-sector algorithmic decisionmaking because explanations operate within contested legal and administrative contexts.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites De Bruijn, Warnier and Janssen (2022) source
  • Premisecitation

    Public-law scholarship shows that algorithmic decision-making raises problems of accountability, public reason, judicial review and rule-of-law legitimacy.

    “Public-law scholarship shows that algorithmic decision-making raises problems of accountability, public reason, judicial review and rule-of-law legitimacy (Binns, 2018;Cobbe, 2019;Busuioc, 2021;Zalnieriute et al., 2019).”
    Quote in the paperSubstantial claim3 of 3 sources checked
    • cites Binns, 2018 source

      The Introduction and the section on public reason support the claim that algorithmic decision-making raises accountability and public-reason concerns. The section on substantive laws also discusses legal constraints and potential violations, but the passages do not address judicial review or specifically frame the issue as rule-of-law legitimacy. (LLM, conf=0.85)

      Experimental — accuracy not yet measured
    • cites Cobbe, 2019 source
    • cites Busuioc, 2021 source

      The “Debate and Justification” section describes obstacles to explaining and challenging algorithmic decisions, while “Consequences for Algorithmic Decision-Making” discusses difficulties obtaining redress and gives an example involving a court. The conclusion links these problems to bureaucratic legitimacy. The paper thus supports the broad accountability and justification concerns, but does not specifically frame them as problems of judicial review or rule-of-law legitimacy (page numbers unavailable). (LLM, conf=0.82)

      Experimental — accuracy not yet measured
  • Premisecitation

    In complex public-law settings, explanations are embedded in contested legal standards, institutional purposes and discretionary judgments.

    “In complex public-law settings, explanations are embedded in contested legal standards, institutional purposes and discretionary judgments (de Bruijn et al., 2022;Oswald, 2018).”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites de Bruijn et al., 2022 source

      Section 7 (page unavailable) says government AI explanations can be contested and that the problems they address are ambiguous. Section 6.4 (page unavailable) says transparency also requires institutional rules and oversight. These passages support the claim’s broader point, but they do not specifically describe explanations as embedded in contested legal standards, institutional purposes, and discretionary judgments. (LLM, conf=0.82)

      Experimental — accuracy not yet measured
    • cites Oswald, 2018 source
  • Findingcitation

    In Mata v. Avianca, the court described the conduct as conscious avoidance.

    “The court described the conduct as conscious avoidance.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Mata v. Avianca, Inc.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Findingcitation

    In Gummadi Usha Rani, the High Court had already recognised that the alleged judgments were AI-generated.

    “The High Court had already recognised that the alleged judgments were AI-generated.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Gummadi Usha Rani v. Sure Mallikarjuna Rao

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim. 95
  • May combine two claims. 45
  • The quote only partly states this claim. 1
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Smuha (2021) treats the risk-based model as substantially system-centric.

    “Smuha (2021) treats the risk-based model as substantially system-centric.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Smuha (2021) source

      Section 2.2 (‘Regulating AI—Not a walk in the park’; page unavailable) makes the contrary point: requirements for trustworthy AI concern human behaviour rather than AI systems themselves, and must account for actors, processes and the wider context of use. The paper does not describe its approach as a ‘risk-based model,’ but its stated framing is not substantially system-centric. (LLM, conf=0.76)

      Checked by a reasoning model — may be wrong.

      Experimental — accuracy not yet measured
  • Classified as probably not a substantial claim.

    Premisecitation

    Mittelstadt (2019) argues that high-level AI principles cannot guarantee ethical AI because they lack institutional translation, professional norms and robust accountability mechanisms.

    “Mittelstadt (2019) argues that high-level AI principles cannot guarantee ethical AI because they lack institutional translation, professional norms and robust accountability mechanisms.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Mittelstadt (2019) source
  • Classified as probably not a substantial claim.

    Premisecitation

    Veale and Zuiderveen Borgesius (2021) argue that conformity-assessment architecture can overemphasise provider-side obligations while leaving downstream use practices under-specified.

    “Veale and Zuiderveen Borgesius (2021) argue that conformityassessment architecture can overemphasise providerside obligations while leaving downstream use practices under-specified.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Veale and Zuiderveen Borgesius (2021) source
  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationcitation

    The concern is not only whether AI improves efficiency but also whether algorithmic assistance remains compatible with accountable justification, discretionary control, and rule-of-law legitimacy.

    “In public-law terms, the concern is not only whether AI improves efficiency but also whether algorithmic assistance remains compatible with accountable justification, discretionary control, and rule-of-law legitimacy (Danaher, 2016;Binns, 2018;Busuioc, 2021).”
    Quote in the paperNot a substantial claim3 of 3 sources checked
    • cites Danaher, 2016 source
    • cites Binns, 2018 source

      The Introduction and Conclusion argue that algorithmic decisions require accountable justification, while the section on substantive laws connects that accountability to legal constraints. The cited passages do not address preserving discretionary control over algorithmic assistance, so Binns supports only part of the attributed concern. The indexed passages provide section labels but no page numbers. (LLM, conf=0.83)

      Experimental — accuracy not yet measured
    • cites Busuioc, 2021 source
  • Classified as probably not a substantial claim.

    Premisecitation

    Lazcoz and de Hert (2023) warn that human intervention can become a mechanism for responsibility absorption when the human is present formally but does not exercise meaningful control.

    “Lazcoz and de Hert (2023) warn that human intervention can become a mechanism for responsibility absorption when the human is present formally but does not exercise meaningful control.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Lazcoz and de Hert (2023) source

      Section 7 warns that adding a human to the loop can let controllers avoid safeguards, while insisting that intervention must be meaningful rather than token. Section 12 describes human agents who routinely apply algorithmic outputs without improving decisions. These passages support the warning about merely formal human involvement, but the paper does not describe that involvement as a mechanism for absorbing responsibility; Section 9 places accountability with controllers. (LLM, conf=0.81)

      Experimental — accuracy not yet measured
  • Classified as probably not a substantial claim.

    Premisecitation

    Cobbe (2019) extends the point to judicial review, showing that courts need legally intelligible criteria for examining automated public-sector decisionmaking.

    “Cobbe (2019) extends the point to judicial review, showing that courts need legally intelligible criteria for examining automated public-sector decisionmaking.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Cobbe (2019) source
  • Classified as probably not a substantial claim.

    Interpretationcitation

    Cognitive Sovereignty responds to the threat of algocracy: the risk that governance becomes dependent on decision systems whose operation is not meaningfully contestable by the persons subject to them.

    “In this sense, Cognitive Sovereignty responds to the threat of algocracy: the risk that governance becomes dependent on decision systems whose operation is not meaningfully contestable by the persons subject to them (Danaher, 2016).”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Danaher, 2016 source
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationcitation

    Cognitive Sovereignty reflects the public-reason requirement that exercises of authority be justified through reasons that can be inspected, contested and institutionally attributed.

    “It also reflects the public-reason requirement that exercises of authority be justified through reasons that can be inspected, contested and institutionally attributed (Binns, 2018).”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Binns, 2018 source
  • Classified as probably not a substantial claim.

    Premisecitation

    Binns (2018) frames algorithmic accountability as a matter of public reason: affected persons and institutions require intelligible justifications, not merely correct outputs.

    “Binns (2018) frames algorithmic accountability as a matter of public reason: affected persons and institutions require intelligible justifications, not merely correct outputs.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Binns (2018) source
  • Classified as probably not a substantial claim.

    Premisecitation

    Busuioc (2021) argues that AI systems generate distinct accountability challenges because responsibility can become distributed across technical systems, organisations and human officials.

    “Busuioc (2021) argues that AI systems generate distinct accountability challenges because responsibility can become distributed across technical systems, organisations and human officials.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Busuioc (2021) source
  • Classified as probably not a substantial claim.

    Findingcitation

    Gummadi Usha Rani illustrates the governance problem on the judicial side.

    “Gummadi Usha Rani illustrates the problem on the judicial side.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Gummadi Usha Rani v. Sure Mallikarjuna Rao

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Findingcitation

    In Mata v. Avianca, the researching attorney used ChatGPT as his sole research source, attempted to locate at least one of the generated cases, failed to find it and nevertheless allowed the submission to proceed.

    “The researching attorney used ChatGPT as his sole research source, attempted to locate at least one of the generated cases, failed to find it and nevertheless allowed the submission to proceed.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Mata v. Avianca, Inc.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim.

    Premisecitation

    ABA Formal Opinion 512 warns that uncritical reliance, without appropriate independent verification, may breach the duty of competence.

    “and warns that uncritical reliance, without appropriate independent verification, may breach the duty of competence.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites American Bar Association's Formal Opinion 512 (2024)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    A false precedent inserted into a judgment or pleading affects more than the lawyer's competence; it threatens the legitimacy of the institutional process through which law is publicly justified.

    “A false precedent inserted into a judgment or pleading therefore affects more than the lawyer's competence.It threatens the legitimacy of the institutional process through which law is publicly justified.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    AI-assisted legal reasoning should consequently be analysed as a problem of governance, not only as a problem of ethics or legal technology.

    “AI-assisted legal reasoning should consequently be analysed as a problem of governance, not only as a problem of ethics or legal technology.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationreasoning

    In that setting, AI does not merely supply information; it can structure the professional's cognition.

    “In that setting, AI does not merely supply information; it can structure the professional's cognition.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationcitation

    The arguments from AI ethics and explainability literature reinforce the need for SIM and ART.

    “These arguments reinforce the need for SIM and ART.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Wachter, Mittelstadt and Russell (2021) make the parallel point in EU nondiscrimination law: legal standards often require contextual and interpretive judgment that cannot be reduced to static technical metrics.

    “Wachter, Mittelstadt and Russell (2021) make the parallel point in EU nondiscrimination law: legal standards often require contextual and interpretive judgment that cannot be reduced to static technical metrics.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Wachter, Mittelstadt and Russell (2021) source
  • Classified as probably not a substantial claim.

    Premisecitation

    Fink (2025) argues that Article 14's effectiveness depends on implementation that accounts for cognitive constraints and automation bias.

    “Fink (2025) similarly argues that Article 14's effectiveness depends on implementation that accounts for cognitive constraints and automation bias.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Fink (2025)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Yeung (2018) conceptualises algorithmic regulation as a mode of governance that uses computational systems to monitor, evaluate and shape behaviour.

    “Yeung (2018) conceptualises algorithmic regulation as a mode of governance that uses computational systems to monitor, evaluate and shape behaviour.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Yeung (2018) source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Alarie, Niblett and Yoon (2018) show that AI is already reshaping the organisation and delivery of legal services.

    “Alarie, Niblett and Yoon (2018) show that AI is already reshaping the organisation and delivery of legal services”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Alarie, Niblett and Yoon (2018) source
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    Generative AI has entered legal work faster than the legal profession has developed institutional rules for its responsible use.

    “Generative artificial intelligence has entered legal work faster than the legal profession has developed institutional rules for its responsible use.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    ABA Formal Opinion 512 requires a reasonable understanding of the specific tool's capabilities and limitations.

    “It requires a reasonable understanding of the specific tool's capabilities and limitations”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites American Bar Association's Formal Opinion 512 (2024)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationcitation

    Human oversight must be operationalised as a reviewable process rather than left as a mere formal label.

    “These works support the article's claim that human oversight must be operationalised as a reviewable process rather than left as a mere formal label.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Zalnieriute, Moses, and Williams (2019) show that automation in government decisionmaking creates rule-of-law tensions in which legal decisions affecting rights and entitlements become difficult to contest or explain.

    “Zalnieriute, Moses, and Williams (2019) show that automation in government decisionmaking creates rule-of-law tensions in which legal decisions affecting rights and entitlements become difficult to contest or explain.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Zalnieriute, Moses, and Williams (2019) source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The Supreme Court of India stated that reliance on nonexistent and fake alleged judgments was not merely an error in decision-making but misconduct with legal consequences.

    “It stated that reliance on nonexistent and fake alleged judgments was not merely an error in decision-making but misconduct with legal consequences (Gummadi Usha Rani, 2026, para. 7).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Gummadi Usha Rani, 2026

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationreasoning

    The most visible failures have involved fabricated authorities, but the deeper problem is not confined to hallucinated citations.

    “The most visible failures have involved fabricated authorities, but the deeper problem is not confined to hallucinated citations.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Chesterman (2021) identifies opacity as a central regulatory problem in AI systems.

    “Chesterman (2021) identifies opacity as a central regulatory problem in AI systems.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Chesterman (2021) source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Oswald (2018) argues that algorithm-assisted public-sector decisionmaking must be assessed through administrative-law concepts such as discretion, procedural fairness and reviewability.

    “Oswald (2018) similarly argues that algorithm-assisted public-sector decisionmaking must be assessed through administrative-law concepts such as discretion, procedural fairness and reviewability.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Oswald (2018) source
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationreasoning

    Legal reasoning shapes the exercise of coercive public power, the allocation of rights and duties, and public trust in courts and regulatory institutions.

    “It shapes the exercise of coercive public power, the allocation of rights and duties, and public trust in courts and regulatory institutions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Interpretationreasoning

    SIM and ART can be implemented without waiting for new legislation, because they can operate through judicial practice directions, bar guidance, procurement conditions, professional training and internal compliance rules.

    “Both can be implemented without waiting for new legislation, because they can operate through judicial practice directions, bar guidance, procurement conditions, professional training and internal compliance rules.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Interpretationnone given

    A lawyer may certify that authorities have been checked while relying on AI-generated summaries, or may read a fluent AI draft for style while leaving its doctrinal structure intact.

    “A lawyer may certify that authorities have been checked while relying on AI-generated summaries, or may read a fluent AI draft for style while leaving its doctrinal structure intact.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    Competence assesses whether the final work product satisfies professional obligations.

    “Competence assesses whether the final work product satisfies professional obligations.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    The framework is transferable beyond law, but transfer should be cautious.

    “The framework is also transferable beyond law, but transfer should be cautious.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    In Mata, the initial prompt effectively asked ChatGPT to produce support for a desired tolling argument; the legal viability of that argument was not first established through independent legal analysis.

    “In Mata, the initial prompt effectively asked ChatGPT to produce support for a desired tolling argument; the legal viability of that argument was not first established through independent legal analysis.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Mata v. Avianca, Inc. (678 F. Supp.3d 443, S.D.N.Y. 2023)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Stage 4 is the evidentiary gate through which AI-generated material must pass before it can be used in legal reasoning.

    “It is the evidentiary gate through which AI-generated material must pass before it can be used in legal reasoning.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Generative AI failures in legal practice are often described as hallucination problems, but that description is incomplete.

    “Generative AI failures in legal practice are often described as hallucination problems.”
    • Also stated in: § 9. Conclusions and Policy Implications · plain
      “That description is incomplete.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Generative AI failures in legal practice are often described as hallucination problems.
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Explanation alone is not enough.

    “This is also why explanation alone is not enough.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    The EU AI Act's value here is distinct: it is the most developed legislative example of human oversight as a requirement of AI governance.

    “Its value here is distinct: it is the most developed legislative example of human oversight as a requirement of AI governance.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    Stage 3 directly counters System 1 Lawyering by forcing the professional to engage System 2.

    “This stage directly counters System 1 Lawyering by forcing the professional to engage System 2.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationnone given

    The conventional inquiry asks whether the final document contains a false citation or a misleading proposition.

    “The conventional inquiry asks whether the final document contains a false citation or a misleading proposition.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationreasoning

    The same general sequence - frame, expand, reconstruct, verify and judge - may be useful in medicine, financial auditing and public administration.

    “The same general sequence -frame, expand, reconstruct, verify and judge -may be useful in those domains.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    AI tools are likely to affect legal research, prediction, drafting, billing models and access to justice, thereby changing the ordinary infrastructure of legal service delivery.

    “AI tools are likely to affect legal research, prediction, drafting, billing models and access to justice, thereby changing the ordinary infrastructure of legal service delivery (Alarie et al., 2018).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Alarie et al., 2018 source
  • Classified as probably not a substantial claim.

    Interpretationcitation

    ART translates accountability concerns into the legal-professional context by requiring a record of framing, supervision, verification and independent judgment.

    “ART translates those concerns into the legal-professional context by requiring a record of framing, supervision, verification and independent judgment.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    For Central and Eastern European regulatory contexts, the framework is especially practical.

    “For Central and Eastern European regulatory contexts, the framework is especially practical.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Premisenone given

    Medicine, financial auditing and public administration all involve professional reliance on AI-generated recommendations.

    “Medicine, financial auditing and public administration all involve professional reliance on AI-generated recommendations.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Interpretationnone given

    Current legal and regulatory frameworks increasingly require a human presence; they less often define the cognitive operations that make that presence meaningful.

    “Current legal and regulatory frameworks increasingly require a human presence; they less often define the cognitive operations that make that presence meaningful.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Explainability may assist governance, but explanation does not itself prove that independent legal judgment occurred.

    “and explainability may assist governance, but explanation does not itself prove that independent legal judgment occurred.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    ART asks how the document came to contain a false citation or misleading proposition, and at which point the reasoning chain failed.

    “ART asks how the document came to contain it, and at which point the reasoning chain failed.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    In England and Wales, the Solicitors Regulation Authority's risk outlook on AI emphasises that firms remain responsible for outcomes, that AI systems may generate inaccurate material and that firms should not trust an AI system to judge its own accuracy.

    “In England and Wales, the Solicitors Regulation Authority's risk outlook on AI emphasises that firms remain responsible for outcomes, that AI systems may generate inaccurate material and that firms should not trust an AI system to judge its own accuracy.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Solicitors Regulation Authority's risk outlook on AI

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premisecitation

    Parasuraman and Riley (1997) distinguished automation use, misuse, disuse and abuse, showing that human reliance on automated systems is not a simple matter of rational tool adoption.

    “Parasuraman and Riley (1997) distinguished automation use, misuse, disuse and abuse, showing that human reliance on automated systems is not a simple matter of rational tool adoption.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Parasuraman and Riley (1997) source
  • May combine two claims.

    Interpretationreasoning

    Professional conduct rules identify breaches only after the failure has occurred; they rarely provide the procedural architecture to prevent the failure.

    “Professional conduct rules identify breaches only after the failure has occurred; they rarely provide the procedural architecture to prevent the failure.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    ART shifts institutional review from a narrow outcome question to a process question.

    “ART shifts institutional review from a narrow outcome question to a process question.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    The transformation of legal work by AI makes general competence duties necessary but insufficient: the more AI becomes embedded in ordinary legal work, the more professional responsibility needs a concrete process standard for reliance, verification and judgment.

    “That transformation makes general competence duties necessary but insufficient: the more AI becomes embedded in ordinary legal work, the more professional responsibility needs a concrete process standard for reliance, verification and judgment.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Stage 1, Legal Framing, prevents algorithmic anchoring.

    “This prevents algorithmic anchoring.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Interpretationnone given

    Outcome standards identify violations after they become visible.

    “Outcome standards identify violations after they become visible.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Professional conduct rules govern competence, candour, diligence and confidentiality.

    “Professional conduct rules govern competence, candour, diligence and confidentiality.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    The missing object is not another warning that hallucinations are dangerous; it is a reviewable standard for how a legal professional must move from AI output to legally accountable judgment.

    “The missing object is not another warning that hallucinations are dangerous.It is a reviewable standard for how a legal professional must move from AI output to legally accountable judgment.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationnone given

    Editing preserves the machine's argumentative architecture; reconstruction makes the AI output only raw material.

    “Editing preserves the machine's argumentative architecture; reconstruction makes the AI output only raw material.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Editing an AI draft preserves the machine's argumentative architecture, while reconstruction makes the AI output only raw material.
  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    Risk-based AI regulation governs systems, providers' duties, and deployers' obligations.

    “Risk-based AI regulation governs systems, providers' duties, and deployers' obligations.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    Lee and See (2004) argue that appropriate reliance depends on calibrated trust: users may misuse automation when trust exceeds system capability and disuse it when trust falls below capability.

    “Lee and See (2004) argue that appropriate reliance depends on calibrated trust: users may misuse automation when trust exceeds system capability and disuse it when trust falls below capability.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Lee and See (2004) source
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    The EU AI Act is not complete code for all AI use by lawyers.

    “It is not complete code for all AI use by lawyers”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationnone given

    Legal reasoning has distinctive rule-of-law stakes: it authorises public coercion and must be justified through traceable sources.

    “However, legal reasoning has distinctive rule-of-law stakes: it authorises public coercion and must be justified through traceable sources.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    In legal reasoning, AI assistance is legitimate only when the professional can reconstruct and defend the legal pathway independently of the system that suggested it.

    “In legal reasoning, this means that AI assistance is legitimate only when the professional can reconstruct and defend the legal pathway independently of the system that suggested it.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Endsley (2017) adds that highly automated environments create out-of-the-loop performance problems, weakening the human operator's situation awareness and ability to intervene.

    “Endsley (2017) adds that highly automated environments create out-of-the-loop performance problems, weakening the human operator's situation awareness and ability to intervene.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Endsley (2017) source
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    Where Stage 4 verification is not satisfied, the proper conclusion is that a prima facie procedural breach exists.

    “Where Stage 4 verification is not satisfied, the proper conclusion is that a prima facie procedural breach exists.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationnone given

    SIM and ART do not regulate model design, training data, cybersecurity, privacy or provider liability.

    “First, SIM and ART do not regulate model design, training data, cybersecurity, privacy or provider liability.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    Intent, recklessness, negligence, and good faith remain relevant to sanctions, remedies, and the severity of disciplinary action.

    “Intent, recklessness, negligence, and good faith remain relevant to sanctions, remedies, and the severity of disciplinary action.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    In such cases, professional responsibility exists in the abstract but lacks an operational test for whether independent legal cognition occurred.

    “In such cases, professional responsibility exists in the abstract but lacks an operational test for whether independent legal cognition occurred.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Law is the appropriate domain in which to formulate the doctrine first.

    “That is why law is the appropriate domain in which to formulate the doctrine first.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    The literature converges on a precise gap.

    “The literature converges on a precise gap.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Both Gummadi Usha Rani and Mata would have failed at Stage 4.

    “Both Gummadi Usha Rani and Mata would have failed at this point.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    A negative answer to any ART step identifies the corresponding SIM stage and enables targeted findings: failure of framing, supervision, verification, or judgment.

    “A negative answer to any step identifies the corresponding SIM stage and enables targeted findings: failure of framing, supervision, verification, or judgment.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    Verification duties require that material be accurate.

    “Verification duties require that material be accurate.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationnone given

    Member States and professional bodies will need guidance, training protocols, and audit standards for the use of AI in courts, legal aid, public administration, and regulated professions.

    “Member States and professional bodies will need guidance, training protocols, and audit standards for the use of AI in courts, legal aid, public administration, and regulated professions.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    The EU AI Act's weakness for present purposes is that it does not translate oversight into a professional reasoning protocol.

    “The Act's weakness for present purposes is that it does not translate oversight into a professional reasoning protocol.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    AI is a search accelerator at Stage 2, not a legal reasoner whose outputs carry authority.

    “AI is a search accelerator at this stage, not a legal reasoner whose outputs carry authority.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: AI is a search accelerator, not a legal reasoner whose outputs carry authority.
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Stage 4 is not ordinary proofreading.

    “This stage is not ordinary proofreading.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    The key distinction in Stage 3 is between editing an AI draft and rebuilding the legal analysis.

    “The key distinction is between editing an AI draft and rebuilding the legal analysis.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    SIM and ART address the professional reasoning layer.

    “They address the professional reasoning layer.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    Existing frameworks do important work: professional conduct rules impose duties of competence, diligence and candour; ethical guidance alerts lawyers to hallucination and confidentiality risks; and the EU AI Act creates system-level human-oversight duties for high-risk AI systems.

    “Existing frameworks do important work: professional conduct rules impose duties of competence, diligence and candour; ethical guidance alerts lawyers to hallucination and confidentiality risks; and the EU Artificial Intelligence Act creates system-level humanoversight duties for high-risk AI systems.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Regulation (EU) 2024/1689

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    The five operational elements of Cognitive Sovereignty are not optional virtues but the minimum conditions under which human oversight can be more than symbolic.

    “These are not optional virtues.They are the minimum conditions under which human oversight can be more than symbolic.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    Without the distinction between supervised intelligence and delegated judgment, human oversight risks becoming a ritual of responsibility without actual cognitive control.

    “Without that distinction, human oversight risks becoming a ritual of responsibility without actual cognitive control.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Conduct-based and system-based governance are increasingly developed, while process-based governance of the cognitive operations connecting AI output to professional judgment remains underspecified.

    “The first two levels are increasingly developed.The third remains underspecified.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Study design and conductnone given

    All substantive claims, legal interpretations, case references, citations, references, arguments and final wording were reviewed, verified and approved by the author before submission.

    “All substantive claims, legal interpretations, case references, citations, references, arguments and final wording were reviewed, verified and approved by the author before submission.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    A judge who signs an AI-drafted order without reconstructing the authorities is in the loop formally but not cognitively.

    “A judge who signs an AI-drafted order without reconstructing the authorities is in the loop formally but not cognitively.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Responsibility appears to remain with the human actor, but the actual structure of reasoning has been partly delegated to a system that cannot bear legal or democratic responsibility.

    “Responsibility appears to remain with the human actor, but the actual structure of reasoning has been partly delegated to a system that cannot bear legal or democratic responsibility.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductreasoning

    Ethical review and approval were not required for this study because it did not involve human participants, interviews, surveys, experiments, recordings, classroom data, institutional data, personal data, vulnerable groups or sensitive material.

    “Ethical review and approval were not required for this study because it did not involve human participants, interviews, surveys, experiments, recordings, classroom data, institutional data, personal data, vulnerable groups or sensitive material.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationnone given

    A human can be in the loop while performing no meaningful cognitive function.

    “A human can be in the loop while performing no meaningful cognitive function.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Study design and conductnone given

    Gummadi Usha Rani and Mata v. Avianca are diagnostic cases, not a representative sample of all AI failures in legal practice.

    “Gummadi Usha Rani and Mata v. Avianca are diagnostic cases, not a representative sample of all AI failures in legal practice.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationnone given

    Cognitive Sovereignty requires that the human actor remain the source of legal authority within the reasoning process.

    “Cognitive Sovereignty requires that the human actor remain the source of legal authority within the reasoning process.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The dominant public-law model of AI governance is risk-based regulation.

    “The dominant public-law model of AI governance is risk-based regulation.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Regulation (EU) 2024/1689

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationreasoning

    With that distinction, AI can augment legal work without displacing the human authority on which legal accountability and democratic legitimacy depend.

    “With it, AI can augment legal work without displacing the human authority on which legal accountability and democratic legitimacy depend.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    The author used ChatGPT to support language editing, stylistic refinement, Polish translation assistance, structural polishing, APA-style formatting, reference list preparation and editorial revision suggestions, and the tool was not treated as an authoritative source of law, policy, evidence, data or bibliography.

    “The author used ChatGPT (OpenAI) to support language editing, stylistic refinement, Polish translation assistance, structural polishing, APA-style formatting, reference list preparation, and the preparation of editorial revision suggestions.The tool was not treated as an authoritative source of law, policy, evidence, data or bibliography.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductnone given

    The EU AI Act is used as a governance benchmark for human oversight, not as proof that every legal use of a general-purpose model is directly regulated as high-risk.

    “The Act is used as a governance benchmark for human oversight, not as proof that every legal use of a general-purpose model is directly regulated as high-risk.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Cognitive Sovereignty differs from a generic duty to remain in the loop.

    “Cognitive Sovereignty differs from a generic duty to remain “in the loop”.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductreasoning

    The article uses two documented legal failures, Gummadi Usha Rani and Mata v. Avianca, as diagnostic case studies, selected because each exposes the same cognitive failure in different institutional settings.

    “It uses two documented legal failures, Gummadi Usha Rani and Mata v. Avianca, as diagnostic case studies.They are not presented as a comprehensive dataset; they are selected because each exposes the same cognitive failure in different institutional settings: a judicial order in India and a lawyer-filed submission in the United States.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    System 1 processing is fast, automatic and pattern-driven, while System 2 processing is slower, effortful and analytic.

    “System 1 processing is fast, automatic and pattern-driven; System 2 processing is slower, effortful and analytic.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Kahneman, D. (2011)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    Courts and legal professionals participate in the production of public reasons.

    “Courts and legal professionals participate in the production of public reasons.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning

    The article does not claim that all legal uses of AI fall within the high-risk categories of the EU AI Act.

    “Second, the article does not claim that all legal uses of AI fall within the high-risk categories of the EU AI Act.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    Generative AI produces material with the surface form of professional authority: plausible case names, citation formats, statutory references and coherent argumentative structure.

    “Generative AI produces material with the surface form of professional authority: plausible case names, citation formats, statutory references and coherent argumentative structure.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    No new empirical data were generated or analysed in this study; the article is based on conceptual and doctrinal analysis of publicly available scholarly literature, legal materials, policy documents, regulatory instruments and judicial decisions.

    “No new empirical data were generated or analysed during this study.The article is based on conceptual and doctrinal analysis of publicly available scholarly literature, legal materials, policy documents, regulatory instruments and judicial decisions cited in the References section.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductnone given

    The proposed framework is not claimed to be positive law; it is proposed as a minimum procedural architecture that courts, regulators, bar associations and legal organisations can adopt or adapt.

    “is not claimed to be positive law.It is proposed as a minimum procedural architecture that courts, regulators, bar associations and legal organisations can adopt or adapt.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    Where generative AI is used in legal reasoning, institutions need a process-level standard to preserve human cognitive authority and to audit reliance.

    “The more defensible claim is narrower: where generative AI is used in legal reasoning, institutions need a process-level standard to preserve human cognitive authority and to audit reliance.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Trust calibration, automation bias, and out-of-the-loop performance problems are persistent human factors risks.

    “Trust calibration, automation bias, and out-of-the-loop performance problems are persistent human factors risks (Lee & See, 2004;Hoff & Bashir, 2015;Endsley, 2017).”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Lee & See, 2004 source
    • cites Hoff & Bashir, 2015 source
    • cites Endsley, 2017 source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    The framework does not claim to eliminate all forms of inappropriate reliance.

    “A further limitation is that the framework does not claim to eliminate all forms of inappropriate reliance.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    The proposed framework is not yet empirically validated.

    “Third, the framework is not yet empirically validated.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Article 14 of the EU AI Act requires that overseers of high-risk AI systems be enabled to understand system capacities and limitations, remain aware of automation bias, correctly interpret outputs, disregard or override outputs where necessary, and intervene in system operation.

    “It also requires that overseers be enabled to understand system capacities and limitations, remain aware of automation bias, correctly interpret outputs, disregard or override outputs where necessary, and intervene in system operation.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Regulation (EU) 2024/1689

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Cognitive Sovereignty addresses the legitimacy deficit by insisting that the human actor's role be substantively auditable.

    “Cognitive Sovereignty addresses that deficit by insisting that the human actor's role be substantively auditable.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductnone given

    ART is not an automatic disciplinary machine; it identifies procedural failure, and institutions must still assess causation, harm, intent, proportionality and appropriate sanction.

    “Fourth, ART is not an automatic disciplinary machine.It identifies procedural failure; institutions must still assess causation, harm, intent, proportionality and appropriate sanction.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationreasoning

    Cognitive Sovereignty specifies what the competent person must do when oversight concerns legal reasoning: frame independently, evaluate AI output critically, reconstruct from sources, verify and decide.

    “Cognitive Sovereignty specifies what the competent person must do when oversight concerns legal reasoning: frame independently, evaluate AI output critically, reconstruct from sources, verify and decide.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Existing governance frameworks (professional conduct rules, ethical guidance and the EU AI Act) do not sufficiently specify the cognitive process through which a professional must integrate AI output into legal reasoning, and do not provide institutions with a reviewable standard for the reasoning sequence itself.

    “The gap is that these frameworks do not sufficiently specify the cognitive process through which a professional must integrate AI output into legal reasoning.”
    • Also stated in: § 9. Conclusions and Policy Implications · plain
      “They regulate systems, conduct, and outcomes; they do not yet provide institutions with a reviewable standard for the reasoning sequence itself.”
    Quote in the paperSubstantial claim
  • The quote only partly states this claim.

    Interpretationnone given

    The governance failure can be stated as a three-level mismatch between conduct-based, system-based and process-based governance.

    “The governance failure can be stated as a three-level mismatch.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    The EU Artificial Intelligence Act, Regulation (EU) 2024/1689, classifies AI systems according to risk and imposes graduated duties on providers and deployers.

    “The EU Artificial Intelligence Act, Regulation (EU) 2024/1689, 2024, classifies AI systems according to risk and imposes graduated duties on providers and deployers.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Regulation (EU) 2024/1689

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

114 of 114
  • The paper relies on this without support.

    AI cannot assess the institutional setting, client risk tolerance, public-law consequences, litigation strategy or the legitimacy costs of an argument in the same way that a legally responsible human actor must.

    “AI cannot assess the institutional setting, client risk tolerance, public-law consequences, litigation strategy or the legitimacy costs of an argument in the same way that a legally responsible human actor must.”
  • The paper relies on this without support.

    AI is a search accelerator, not a legal reasoner whose outputs carry authority.

    “AI is a search accelerator at this stage, not a legal reasoner whose outputs carry authority.”
  • The paper relies on this without support.

    Editing an AI draft preserves the machine's argumentative architecture, while reconstruction makes the AI output only raw material.

    “Editing preserves the machine's argumentative architecture; reconstruction makes the AI output only raw material.”
  • The paper relies on this without support.

    Legal professionals already use AI.

    “They already do, and prohibition would be both”
  • The paper relies on this without support.

    Generative AI failures in legal practice are often described as hallucination problems.

    “Generative AI failures in legal practice are often described as hallucination problems.”
5 of 5

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Cites

Flagged first, then by citations

Research works printed but not linked: 1

  1. (EU) 2024/1689 of the European Parliament and of the Council of 13 June 2024 laying down harmonised rules on artificial intelligence (Artificial Intelligence Act). Official Journal of the European Union, L 2024/1689. https://eur-lex.europa.eu/eli/reg/2024/1689/oj

Authors
Shukla, S.
Corresponding author
Shukla, Shivam
Venue
AI, Law, Politics
Published
2026-07-07
Volume
2
Issue
1
Pages
52-66
ISSN
3072-1229 (ISSN-L)
OpenAlex
W7167590464
Cited by
2
References
22
Citations by year
2026: 2
FWCI
47.30
Type
journal article
Open access
Locations
AI Law Politics (publishedVersion, cc-by-nc-sa)
Topics
  • Social Sciences › Political Science and International Relations › Artificial Intelligence in Law
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
  • Social Sciences › Law › Digitalization, Law, and Regulation
Keywords
human oversight, cognitive sovereignty, professional codes of conduct, EU AI Act, automation bias, cognitive offloading, legal ethics, judicial accountability, rule of law, human-AI interaction

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-09.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-09.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review