Deterministic Integrity Gates for LLM-Assisted Clinical Manuscript Preparation: An Auditable Biomedical Informatics Architecture

Classified as probably not a substantial claim. May combine two claims.

The architecture is a pipeline of named skills coordinated by a single orchestrator, with a verification gate interposed at every transition between skills.

“The architecture treats manuscript preparation as a pipeline of named skills coordinated by a single orchestrator, with a verification gate interposed at every transition between skills”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The offline test set contains 27 injection instances drawn from 17 separate injectors, some used across all three demonstration manuscripts; two additional citation injectors depend on live PubMed or CrossRef queries and are marked not-run, yielding 19 distinct injectors overall.

“The 27 offline injection instances come from 17 distinct injectors, several applied across all three demonstration manuscripts; two further citation injectors need a live PubMed or CrossRef lookup (a fabricated DOI and a wrong author list) and are recorded as not-run, for 19 distinct injectors in total.”

May combine two claims.

A demonstration that verifies clean re-verifies its archived tables byte for byte, and re-executing it reproduces the hash-locked derived values up to documented toolchain-version tolerance, so a manuscript built on it inherits a checkable chain from raw data to reported number.

“A demonstration that verifies clean re-verifies its archived tables byte for byte, and re-executing it reproduces the hash-locked derived values up to documented toolchain-version tolerance, so a manuscript built on it inherits a checkable chain from raw data to reported number”

May combine two claims.

The three demonstrations were generated on the v3.7.0 snapshot and carried into v3.8.0 byte-unchanged; v3.8.0 adds only the evaluation harness and its committed canonical run on top of those frozen demonstration artifacts.

“The three demonstrations were generated on the v3.7.0 snapshot (version DOI 10.5281/zenodo.20577997,commit 5adda7c) and carried into v3.8.0 byte-unchanged; v3.8.0 adds only the evaluation harness and its committed canonical run on top of those frozen demonstration artifacts.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

The deterministic detectors return the same verdict on every run and leave a trace a reviewer can re-execute.

“These are settled by deterministic detectors that return the same verdict on every run and leave a trace a reviewer can re-execute.”

Classified as probably not a substantial claim. May combine two claims.

MedSci Skills is an open-source toolkit of 43 skills with a deterministic tier of 21 standard-library detectors.

“It is realized as MedSci Skills, an opensource toolkit of 43 skills with a deterministic tier of 21 standard-library detectors.”

Classified as probably not a substantial claim.

The architecture is implemented as MedSci Skills, an open-source toolkit of 43 skills spanning the medical-research lifecycle.

“We implement the architecture as MedSci Skills, an open-source toolkit of 43 skills spanning the medical-research lifecycle”

May combine two claims.

The deterministic tier is realized as 21 detectors that use only the Python standard library, with no third-party dependencies, most accompanied by synthetic fixtures and a regression test wired into continuous integration.

“The deterministic tier of the taxonomy is realized as 21 detectors that use only the Python standard library, living inside the skills with no third-party dependencies, most accompanied by privacyfree synthetic fixtures and a regression test wired into continuous integration”

Probably not a substantial claim: may not pass S3 (load-bearing).

The demonstration bibliographies are deliberately empty placeholders.

“because the demonstration bibliographies are deliberately empty placeholders”

Probably not a substantial claim: may not pass S3 (load-bearing).

No pairwise difference was detected among the three machine-learning index tests on the Wisconsin Breast Cancer dataset (all three DeLong comparisons p > 0.5).

“with no pairwise difference detected (all three DeLong comparisons p > 0.5)”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

MedSci Skills is MIT-licensed and archived at version 3.8.0.

“MedSci Skills is MIT-licensed and archived (version 3.8.0).”

May combine two claims.

The five families of detectors were distilled empirically from recurring integrity defects observed across prior medical-writing projects and then implemented as detectors.

“they were distilled empirically from recurring integrity defects observed across prior medical-writing projects and then implemented as detectors”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

The architecture rests on three principles: decomposition into self-contained skills, gating at every stage with halt-on-failure, and deterministic verification where possible.

“It rests on three principles: decomposition of the workflow into self-contained skills, gating at every stage with halt-on-failure, and the use of deterministic verification wherever a deterministic procedure suffices, falling back to a prose-level probe only where interpretation is genuinely required.”

May combine two claims.

The skills are model- and host-portable: the same skills are documented to run under Claude Code, OpenAI Codex, Cursor, and GitHub Copilot, with portability checked by an installer self-test and a path-contract scan rather than by live execution inside each host.

“The skills are modeland host-portable: the same skills are documented to run under Claude Code, OpenAI Codex, Cursor, and GitHub Copilot, with portability checked by an installer self-test and a path-contract scan rather than by live execution inside each host”

May combine two claims.

The model missed both bibliography-internal citation defects (a placeholder pagination and a duplicated entry in the reference file), neither of which appears in the prose.

“it missed both bibliography-internal citation defects (a placeholder pagination and a duplicated entry in the reference file), neither of which appears in the prose.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The heuristic of the confounding-completeness check presumes an exposure-stratified baseline table.

“its heuristic assumes an exposure-stratified baseline table”

May combine two claims.

The model did reasonably on prose-visible semantic issues: a conclusion overreaching a cross-sectional design, an AI-extension framework named without its base, an in-prose arithmetic contradiction, a promised-but-absent analysis, and a visibly undefined citation key.

“The model did reasonably on prose-visible semantic issues: a conclusion overreaching a cross-sectional design, an AI-extension framework named without its base, an in-prose arithmetic contradiction, a promisedbut-absent analysis, and a visibly undefined citation key.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The Demonstration 3 study tabulated by outcome.

“whereas this study tabulated by outcome”

May combine two claims.

Among the 136 numerical claims, 74 (54%) matched a manifest-locked analysis table value exactly, 48 (35%) were partial matches, and 14 (10%) did not trace to a locked table value.

“of those, 74 (54%) resolved by exact match to a value in a manifest-locked analysis table, 48 (35%) were partial matches (a rounded or derived restatement, which is still a trace), and 14 (10%) did not trace to a locked table value.”

• Also stated in: § 3/3 demonstration manifests verify clean on an independent checkout · plain

  “74 (54%) exact-match a manifest-locked analysis table, 48 (35%) partial, 14 (10%) untraced”

May combine two claims.

The audit-trail probe extracted 249 candidate claims from the three demonstration manuscripts, 136 of which were numerical.

“An audit-trail probe extracted 249 candidate claims from the three demonstration manuscripts, of which 136 were numerical”

• Also stated in: § 3/3 demonstration manifests verify clean on an independent checkout · plain

  “249 manuscript claims extracted; of 136 numerical claims”

Probably not a substantial claim: may not pass S3 (load-bearing).

Demonstration body length averaged 1,576 ± 209 words.

“demonstration body length averaged 1,576 ± 209 words.”

May combine two claims.

The model recovered 11 of 27 (41%) of the defects, against 27 of 27 (100%) for the deterministic detectors.

“the model recovered 11 of 27 (41%), against 27 of 27 (100%) for the deterministic detectors.”

May combine two claims. The quote only partly states this claim.

The generic single-prompt LLM reviewer's recall by defect class was: style conventions 1/9, generated code 1/5, citation 1/3, cohort/numerical 1/2, reporting-framework naming 5/6, scope/estimand 1/1, artifact coverage 1/1, total 11/27.

“Style conventions 1 / 9 Generated code 1 / 5 Citation (incl.bibliography-internal) 1 / 3 Cohort / numerical 1 / 2”

• Also stated in: § Additional information · plain

  “Reporting-framework naming 5 / 6 Scope / estimand 1 / 1 Artifact coverage 1 / 1 Total 11 / 27”

Probably not a substantial claim: may not pass S3 (load-bearing).

Across the three demonstrations, body length averaged 1,576 words (range 1,340-1,738; SD 209), with n = 3.

“body length averaged 1,576 words (range 1,340-1,738; SD 209), with n = 3”

Probably not a substantial claim: may not pass S3 (load-bearing).

The internal checklist assessment covered 60.9% to 83.3% of applicable items, with a mean of 68.7% ± 12.7% (n = 3).

“The internal checklist assessment, an item-by-item self-assessment rather than an external reporting-quality judgment, ranged from 60.9% to 83.3% of applicable items (mean 68.7% ± 12.7%, n = 3, descriptive only)”

Classified as probably not a substantial claim. May combine two claims.

In the cross-sectional Demonstration 3, the scope-coherence gate was clean on the drafted manuscript, fired when the conclusion was given prognostic and surveillance language a single-time-point design cannot license, emitted a localized re-runnable diagnostic naming the offending clause, the claim was reworded to association-only language under human direction, and the gate was re-run and the art

“the gate is clean on the drafted manuscript (1); fires when the conclusion is given prognostic and surveillance language a single-time-point design cannot license (2, code CROSS_SECTIONAL_PROGNOSTIC); emits a localized re-runnable diagnostic naming the offending clause (3); the claim is reworded to association-only language under human direction (4); and the gate is re-run and the artifact re-ver”

May combine two claims.

In the offline seeded-defect benchmark, the deterministic gates recovered every one of the 27 injected defects and produced no clean false positives.

“Total 27 27 (100%) 0 11 (41%)”

• Also stated in: § Additional information · plain

  “The deterministic gates detected 27 / 27 across these same classes with no false positives on the clean inputs.”

May combine two claims.

Across 27 offline injection instances spanning all five gate families, the deterministic detectors recovered every injected defect and raised none of the corresponding signals on the clean inputs.

“Across 27 offline injection instances spanning all five gate families, the deterministic detectors recovered every injected defect and raised none of the corresponding signals on the clean inputs (Table 2 and Figure 3, panel A).”

May combine two claims.

Demonstration 2's arrow shows the in-loop change after the fix added a registration statement, while Demonstrations 1 and 3 compliance was unchanged by the fix loop.

“The Demonstration 2 arrow shows the in-loop change after the fix added a registration statement; Demonstrations 1 and 3 compliance was unchanged by the fix loop.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The 'Style and review-process integrity' row aggregates style-convention and generated-code detectors (nine and five injected defects), and 'Numerical, cohort, and pool arithmetic' includes the artifact-coverage detector.

“The”

May combine two claims.

The architecture is implemented as an open-source toolkit of 43 skills with 21 standard-library integrity detectors, and demonstrated on three reproducible public-dataset pipelines.

“Implemented as an open-source toolkit of 43 skills with 21 standard-library integrity detectors, and demonstrated on three reproducible public-dataset pipelines”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The 27 offline injection instances come from 17 distinct injectors, several applied across all three demonstration manuscripts; two further network-required citation injectors were not run, for 19 distinct injectors in total.

“The 27 offline injection instances come from 17 distinct injectors, several applied across all three demonstration manuscripts; two further network-required citation injectors (fabricated DOI, wrong author) were not run, for 19 distinct injectors in total.”

May combine two claims.

When an LLM regenerates a paragraph, it can restate a sample size, effect estimate, or confidence interval in a way that no longer matches the source table, and the text may not flag the mismatch.

“Numerical inconsistency is subtler: a model regenerating a paragraph may restate a sample size, an effect estimate, or a confidence interval in a form that no longer matches the source table, with nothing in the text to flag the discrepancy.”

May combine two claims.

The defect collection is intentionally complete across error families and based on recurring failure modes.

“The set is deliberately family-complete and grounded in recurring failure modes”

May combine two claims.

All harnesses reported here are deterministic code executed by the first author; each returns the same verdict on every run and is re-executable by any reader from the archived release, so the triggering and exact-match results carry no human judgment.

“All harnesses reported here are deterministic code executed by the first author; each returns the same verdict on every run and is re-executable by any reader from the archived release, so the triggering and exact-match results below carry no human judgment.”

Classified as probably not a substantial claim. The quote only partly states this claim.

The deterministic checks include cohort and pool arithmetic.

“cohort and pool arithmetic”

Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

A verification layer should check generated manuscript claims against external authorities using deterministic procedures where sufficient and reserve model judgment for questions that require interpretation.

“What is missing is not more generation, and not more LLM self-grading, but a layer that checks the claims a generated manuscript makes against external authorities (a reference database, the source data, a reporting checklist) using deterministic procedures wherever one suffices, and reserving model judgment for the questions that genuinely require it.”

• AssumptionRests on an assumption: The deterministic checks assigned to the deterministic tier can settle their integrity questions without interpretation.

May combine two claims.

The paper's contribution is an architecture yielding a human-checkable audit trail, not a replacement for peer review or a demonstration of human-level writing quality.

“We bound the claim deliberately: the contribution is an architecture that produces an auditable trail a human can verify, not a system that replaces human peer review or is shown here to match human writing quality.”

May combine two claims.

A large class of integrity questions reduces to a lookup or an arithmetic identity, and for these a deterministic checker is strictly preferable to model judgment because it is reproducible, auditable, and cannot itself fabricate a verdict.

“A large class of integrity questions reduces to a lookup or an arithmetic identity, and for these a deterministic checker is strictly preferable to model judgment: it is reproducible, it is auditable, and it cannot itself fabricate a verdict”

Classified as probably not a substantial claim. May combine two claims.

A single large prompt gives no inspection point for intermediate outputs, while a sequence of named skills creates a transition boundary suitable for a gate.

“A monolithic prompt that ingests data and emits a finished manuscript offers no seam at which an intermediate product can be inspected, whereas a chain of named skills exposes a well-defined boundary at every transition (after the analysis, after the figures, after the draft, after the compliance check), and that boundary is exactly where a gate can sit.”

Classified as probably not a substantial claim. May combine two claims.

Rebuilding inputs from tables in recently published medical-AI papers would limit redistribution and introduce training-data contamination that would confound a language-model generation demonstration.

“reconstructing inputs from the tables of recently published medical-AI papers, an alternative we considered, would both constrain redistribution and risk training-data contamination that confounds a demonstration of language-model generation”

Classified as probably not a substantial claim.

The defect set is intended as a regression-style challenge suite for known integrity-failure modes, not as a representative sample of real-world manuscript errors.

“it is best read as a regression-style challenge suite for known integrity-failure modes rather than a representative sample of real-world manuscript errors.”

Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

Halt-on-failure is deliberate because in a generation pipeline the cost of a silent error compounds, as each subsequent stage treats the flawed upstream artifact as ground truth.

“Halt-on-failure is deliberate: in a generation pipeline the cost of a silent error compounds, because each subsequent stage treats the flawed upstream artifact as ground truth.”

Classified as probably not a substantial claim. May combine two claims.

The few points where a judgment is unavoidable are confined and recorded, with per-claim records archived.

“The few points where a judgment is unavoidable are confined and recorded, with per-claim records archived.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

Decomposition makes each intermediate product a first-class, inspectable object and gives every stage transition a well-defined boundary at which a gate can run.

“Decomposition makes each intermediate product a first-class, inspectable object and gives every stage transition a well-defined boundary at which a gate can run.”

Classified as probably not a substantial claim. May combine two claims.

This work provides the missing verification layer for autonomous research pipelines instead of competing on autonomy.

“Such systems maximize generation; the present work is orthogonal, supplying the verification layer those pipelines lack rather than competing on autonomy.”

Classified as probably not a substantial claim.

The work offers an organizing taxonomy for deciding when a deterministic check is enough, rather than another single-purpose checker.

“our contribution is not one more single-purpose checker but the organizing taxonomy that decides, per integrity question, whether a deterministic check suffices.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The defect set is not exhaustive.

“we do not claim it is exhaustive”

Classified as probably not a substantial claim. May combine two claims.

The components the architecture composes are individually established; the contribution is their medical-research-specific organization under the determinism-where-possible discipline.

“The components it composes are individually established; the contribution is their medical-research-specific organization under the determinism-where-possible discipline”

May combine two claims.

Reporting guidelines consist of separate, item-by-item checks, so whether a manuscript covers a given item has a determinate answer.

“Each guideline is an enumerated list of discrete, individually checkable items, so”

• cites [4]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [11]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [12]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Each demonstration pipeline carries a content-hash manifest recording a SHA-256 over every input and derived table together with a per-column value hash, and a verification command recomputes the hashes and reports any drift.

“Each demonstration pipeline carries a content-hash manifest recording a SHA-256 over every input and derived table together with a per-column value hash, and a verification command recomputes the hashes and reports any drift.”

Classified as probably not a substantial claim. May combine two claims.

The demonstration covers three separate reporting guidelines-STARD, PRISMA, and STROBE-and the different gate paths each one activates.

“so that the demonstration exercises three distinct reporting guidelines (STARD, PRISMA, STROBE) and the distinct gate paths they trigger.”

Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

A deterministic procedure is appropriate where the claim reduces to a lookup or an arithmetic identity; a prose-level probe is appropriate only where the claim genuinely requires interpretation.

“A deterministic procedure serves where the claim reduces to a lookup or an arithmetic identity (a citation exists or it does not, a row of counts sums to its total or it does not, a checklist item is addressed or it is not); a prose-level probe, supplied by a human or by a model acting as an external reviewer rather than as the author of the text under review, serves only where the claim genuinely”

Classified as probably not a substantial claim.

Where a check cannot be made deterministic without overreaching, it is left as a prose probe rather than forced into a brittle heuristic.

“Where a check cannot be made deterministic without overreaching, it is left as a prose probe rather than forced into a brittle heuristic.”

May combine two claims.

The study provides feasibility and reproducibility evidence, not evidence of human-competitive quality.

“This is feasibility and reproducibility evidence, not a claim of human-competitive quality, which a separate blinded study addresses.”

Classified as probably not a substantial claim. May combine two claims.

The harness analyses are instrument-level and make no claim about the merit of the manuscripts the tool produces.

“The harness analyses are instrument-level (whether the detectors fire on the defects they target, whether the artifacts regenerate, and whether the audit trail is machine-traceable) and make no claim about the merit of the manuscripts the tool produces”

Classified as probably not a substantial claim.

The deterministic checks are implemented as standard-library detectors with synthetic fixtures and regression tests.

“we implement the deterministic checks as standard-library detectors with synthetic fixtures and regression tests.”

May combine two claims.

Restricting the detectors to the standard library keeps them portable and auditable: a reviewer can read a detector end to end and re-run it on any manuscript without installing a toolchain.

“Restricting the detectors to the standard library keeps them portable and auditable: a reviewer can read a detector end to end and re-run it on any manuscript without installing a toolchain.”

Classified as probably not a substantial claim.

The deterministic tier is deliberately conservative: a detector fires only when it can do so without interpretation, so that a flag is informative rather than noise.

“The deterministic tier is deliberately conservative: a detector fires only when it can do so without interpretation, so that a flag is informative rather than noise.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The demonstration covers what the authors treat as the main clinical research study types: diagnostic accuracy, evidence synthesis, and observational epidemiology.

“to span the dominant study-type families in clinical research (diagnostic accuracy, evidence synthesis, and observational epidemiology)”

• AssumptionRests on an assumption: Clinical research is dominated by three study-type families: diagnostic accuracy, evidence synthesis, and observational epidemiology.

Classified as probably not a substantial claim.

Recent agent tooling treats a skill as a named, self-contained package of instructions, runnable scripts, and reference files, with a developing cross-runtime specification.

“Recent tooling has converged on the notion of a skill: a self-contained unit bundling instructions, executable scripts, and reference assets behind a name an agent can invoke, with an emerging cross-host specification so the same skill runs under different runtimes [16].”

• cites [16]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S2 (checkable).

The taxonomy is best read as a reference instantiation of the determinism-where-possible discipline, the transferable contribution, rather than a claim that these categories carve the space completely.

“so the taxonomy is best read as a reference instantiation of the determinism-where-possible discipline, the transferable contribution, rather than a claim that these categories carve the space completely.”

May combine two claims.

The three pipelines ran end to end and their archived tables re-verify byte for byte from content-hash manifests verified on independent re-run.

“The three pipelines ran end to end, and every content-hash manifest verified clean on an independent re-run, so each demonstration's archived tables re-verify byte for byte (Table 1).”

• Also stated in: § 4.1 Demonstrations · plain

  “They establish that the pipeline runs end to end across three study types, that its outputs are reproducible from archived artifacts”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Autonomous research agents now try to go from idea to manuscript; some end-to-end systems have generated papers submitted or accepted at workshops, and multi-agent co-scientist systems help with hypothesis generation and experimental design.

“First, autonomous research agents now attempt the full arc from idea to manuscript: end-to-end systems have produced machine-learning papers submitted to, and in some cases accepted at, workshop venues [17], and multi-agent”

• cites [17]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [18]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [19]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

A reader reproduces any demonstration number from the v3.7.0 archive and any evaluation number from the v3.8.0 archive, from a fixed artifact rather than from the moving development branch.

“A reader reproduces any demonstration number (Table 1) from the v3.7.0 archive and any evaluation number (Tables 2 and 3) from the v3.8.0 archive, in each case from a fixed artifact rather than from the moving development branch”

Classified as probably not a substantial claim. May combine two claims.

The architecture is not specific to medicine; decomposition into gated skills with determinism wherever a deterministic procedure suffices applies to any writing task checkable against external authorities.

“the architecture is not specific to medicine.Decomposition into gated skills, with determinism wherever a deterministic procedure suffices, applies to any writing task checkable against external authorities”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The detectors that currently lack a synthetic fixture or a regression test fall partly in the citation family, and closing this gap is tracked future work.

“the detectors that currently lack a synthetic fixture or a regression test fall partly in the citation family, and closing this gap is tracked future work.”

Classified as probably not a substantial claim. May combine two claims.

The model used for demonstrations is identified by family and version (Anthropic Claude, Opus 4.8 model family) and accessed through a documented runtime (Claude Code agent runtime) over May-June 2026.

“The model is identified by family and version (Anthropic Claude, Opus 4.8 model family) and accessed through a documented runtime (the Claude Code agent runtime) over a stated date range (May-June 2026)”

Classified as probably not a substantial claim. May combine two claims.

The toolkit is an authoring and quality-control aid, not a clinical decision tool; it makes no diagnostic or treatment recommendation, and its outputs require expert review before any use.

“The toolkit is an authoring and quality-control aid, not a clinical decision tool: it makes no diagnostic or treatment recommendation, and its outputs require expert review before any use.”

Classified as probably not a substantial claim. May combine two claims.

For Demonstration 3, the manuscript was revised to association-only claims and passed re-verification.

“the manuscript was reworded to association-only claims and re-verified clean”

May combine two claims.

The evidence here is feasibility by demonstration; external, independent use of the toolkit by other researchers is untested.

“the evidence here is feasibility by demonstration; external, independent use of the toolkit by other researchers is untested”

Classified as probably not a substantial claim. May combine two claims.

The deterministic harnesses operate only on temporary copies and never modify the demonstration artifacts or the repository.

“the deterministic harnesses operate only on temporary copies and never modify the demonstration artifacts or the repository.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Every flag is a rerunnable diagnostic and every reported number carries a content-hash chain back to the source, so any reader can independently reproduce the verification.

“every flag is a rerunnable diagnostic and every reported number carries a content-hash chain back to the source, so any reader can independently reproduce the verification.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The prompts are the versioned skills themselves, published in the archived release rather than paraphrased.

“the prompts are the versioned skills themselves, published in the archived release rather than paraphrased”

May combine two claims.

The detectors' triggering verdicts are deterministic and operator-independent, but the human-judged labels layered on top were adjudicated by the developer-author, so those judgments most need independent replication.

“the detectors' triggering verdicts are deterministic and operator-independent, but the human-judged labels layered on top (whether a given firing is a true defect or a false positive, and which demonstration outputs were judged clean before injection) were adjudicated by the developerauthor, so those judgments, unlike the re-executable triggering results, most need the independent replication desc”

Probably not a substantial claim: may not pass S3 (load-bearing).

Both false positives share one root cause, the absence of a software-and-methods article-type profile.

“Both share one root cause, the absence of a software-and-methods article-type profile”

Classified as probably not a substantial claim.

By design, all references in the demonstrations remained unverified placeholders to test the reference-adequacy gate.

“the references in every demonstration were left as unverified placeholders by design, precisely to exercise the reference-adequacy gate.”

Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

Deterministic verification narrows the space in which a human must look; it does not remove the human.

“Deterministic verification narrows the space in which a human must look; it does not remove the human.”

Classified as probably not a substantial claim.

The claim that the trail is one a human can verify is a claim about re-executability rather than reviewer behaviour.

“Our claim that the trail is one”

May combine two claims.

The in-body AI-disclosure sentence and em-dash overuse are conventions a generic reviewer does not treat as errors.

“The in-body AI-disclosure sentence and em-dash overuse are conventions a generic reviewer does not treat as errors”

Probably not a substantial claim: may not pass S2 (checkable).

The correct reading of a clean gate is that a specific mechanical failure mode did not occur, not that the manuscript is correct.

“The correct reading of a clean gate is that a specific mechanical failure mode did not occur, not that the manuscript is correct.”

May combine two claims.

The extraction of claims and the exact-match comparison were performed by a deterministic script, so the 54% exact-match figure reproduces when re-executed.

“The claim extraction and the exact-match comparison are run by a deterministic script, so the 54% figure reproduces on re-execution”

Classified as probably not a substantial claim.

The resulting demonstration outputs were parsed and checked by the deterministic gates.

“the resulting outputs were parsed and checked by the deterministic gates.”

Classified as probably not a substantial claim.

A reader can reproduce the two load-bearing checks from a clone of the release with only the standard library plus pandas.

“A reader can reproduce the two load-bearing checks from a clone of the release with only the standard library plus pandas”

May combine two claims.

The demonstrations do not show that the resulting manuscripts are publishable or competitive with human writing.

“They do not establish that the resulting manuscripts are of publishable quality or competitive with human writing”

Classified as probably not a substantial claim.

Each harness writes a self-describing run package containing per-component determinism class, input and output content hashes, exact commands, and limitations, archived with the release.

“Each harness writes a self-describing run package (per-component determinism class, input and output content hashes, exact commands, and limitations) archived with the release”

May combine two claims.

The integrity gates detect genuine defects and provide re-executable evidence.

“its integrity gates surface real defects with re-executable evidence”

Classified as probably not a substantial claim. May combine two claims.

The toolkit was primarily authored by one of the authors, and the authors applied its own quality checks to this manuscript; this dogfooding is a deliberate test of the architecture, not an independent evaluation.

“the toolkit was primarily authored by one of us, and we applied its own quality checks to this manuscript; that dogfooding is a deliberate test of the architecture, not an independent evaluation of it.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

This paper is a software-and-methods report, a genre the toolkit's clinical-manuscript machinery does not target; there is no STARD or STROBE checklist to apply to an architecture paper.

“this paper is itself a software-and-methods report, a genre the toolkit's clinicalmanuscript machinery does not target: there is no STARD or STROBE checklist to apply to an architecture paper”

May combine two claims.

The seeded-defect benchmark measures recall on known injected defects but does not measure the false-negative rate on real manuscripts carrying naturally-occurring errors the detectors were never built to anticipate.

“The seeded-defect benchmark measures recall on known injected defects (every offline-injected defect was recovered) but does not measure the false-negative rate on real manuscripts carrying naturally-occurring errors the detectors were never built to anticipate”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

A second LLM-dependent harness, a bounded self-review convergence loop with logging fields adapted from MI-CLEAR-LLM [28], is specified and archived with the release but was not executed for this release.

“A second LLM-dependent harness, a bounded self-review convergence loop with logging fields adapted from MI-CLEAR-LLM [28], is specified and archived with the release but was not executed for this release.”

• cites [28]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim.

The first author determined whether each flag was a genuine defect or a false positive by checking the source artifact.

“Whether each flag was a genuine defect or a false positive was judged by the first author against the source artifact”

May combine two claims.

All reported values were taken from the frozen v3.7.0 run and independently re-verified through detector re-runs, manifest verification, and source-table cross-checks.

“All values are pulled from the frozen v3.7.0 run and independently re-verified (detector re-runs, manifest verification, source-table cross-checks).”

Probably not a substantial claim: may not pass S3 (load-bearing).

A coverage inventory listed the deterministic detectors and recorded which ones ship a synthetic fixture and a regression test.

“A coverage inventory enumerated the deterministic detectors and recorded which ship a synthetic fixture and a regression test.”

• Also stated in: § Gate coverage inventory · plain

  “21 deterministic detectors; 18 with a regression test, 17 with a synthetic fixture”

Probably not a substantial claim: may not pass S3 (load-bearing).

The comparison also instances the self-review case in which the model that produced a text is asked to find its own faults.

“the same model family used to generate the demonstrations, so the comparison also instances the self-review case in which the model that produced a text is asked to find its own faults”

Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

The architecture treats manuscript generation as a governed information pipeline rather than a text-generation task, and its value is governance.

“The architecture treats manuscript generation as a governed information pipeline rather than a text-generation task, and its value is governance.”

Classified as probably not a substantial claim. May combine two claims.

Because the three demonstrations are deliberately different study types reported against different guidelines, the summaries are descriptive only and not a pooled performance estimate.

“because the three are deliberately different study types reported against different guidelines, these summaries are descriptive only and not a pooled performance estimate.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Because the demonstration datasets are public, they may lie within the model's training corpus, so the paper makes no contamination-controlled accuracy claim.

“Because the demonstration datasets are public, they may lie within the model's training corpus, so we make no contamination-controlled accuracy claim”

• AssumptionRests on an assumption: The public demonstration datasets may lie within the model's training corpus.

May combine two claims.

The catalog counts for skills (43), reporting guidelines and risk-of-bias instruments (32), and deterministic detectors (21) are recomputed from disk and asserted against a single source-of-truth file in continuous integration, so documentation counts cannot silently drift.

“The catalog counts cited throughout the toolkit's documentation, namely the number of skills (43), reporting guidelines and risk-of-bias instruments (32), and deterministic detectors (21), are recomputed from disk and asserted against a single source-of-truth file in continuous integration, so a documentation count cannot silently drift from the artifacts it describes.”

Classified as probably not a substantial claim. May combine two claims.

The self-review score and verdict are the toolkit's internal grader output, not an external measure of manuscript quality; they are reported only to show the fix loop ran, and the companion study evaluates quality.

“The self-review score and verdict are the toolkit's own internal grader output, not an external measure of manuscript quality; they are reported only to show the fix loop ran, and the companion study, not this score, evaluates quality.”

Classified as probably not a substantial claim. May combine two claims.

The comparison is framed strictly as a recall comparison under one model, one fixed prompt, and one date, not as a universal model-superiority claim and not as a judgment of manuscript quality.

“We frame this strictly as a recall comparison under one model, one fixed prompt, and one date, not as a universal modelsuperiority claim and not as a judgment of manuscript quality.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Of the 21 detectors, 18 ship with a regression test and 17 with a privacy-free synthetic fixture wired into continuous integration.

“Of the 21 detectors, 18 ship with a regression test and 17 with a privacy-free synthetic fixture wired into continuous integration”

Classified as probably not a substantial claim.

The contribution is the per-question determinism taxonomy that organizes these checks for the medical-research workflow, not any single check in isolation.

“The contribution is the per-question determinism taxonomy that organizes these checks for the medical-research workflow, not any single check in isolation.”

May combine two claims.

Deterministic gates make a defined class of failures visible early, attach a re-executable diagnostic, and prevent the defective artifact from advancing.

“they make the failure visible early, attach a re-executable diagnostic to it, and refuse to let the defective artifact advance”

Probably not a substantial claim: may not pass S4 (based).

Minor patch-version drift in the analysis toolchain does not affect the derived values, which are fixed by the content-hash manifests.

“minor patch-version drift in the analysis toolchain (for example, the R interpreter) does not affect the derived values, which are fixed by the contenthash manifests.”

May combine two claims.

Part of this gap is definitional: the generated-code and bibliography-internal classes cannot surface in the manuscript text a generic reviewer reads, so a prose-only reviewer cannot reach them by construction, and even on the prose-visible classes the gap persists.

“Part of this gap is definitional: the generated-code and bibliography-internal classes cannot surface in the manuscript text a generic reviewer reads, so a prose-only reviewer cannot reach them by construction, and even on the prose-visible classes the gap persists.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The skill set reflects one physician-researcher's domains (radiology, diagnostic-accuracy and observational designs, and systematic review and meta-analysis), so its coverage and defaults are correspondingly biased, and a researcher from another field would find gaps.

“the skill set reflects one physician-researcher's domains (radiology, diagnostic-accuracy and observational designs, and systematic review and meta-analysis), so its coverage and defaults are correspondingly biased, and a researcher from another field would find gaps.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The internal checklist assessment reported genuine gaps rather than inflating coverage.

“reporting genuine gaps rather than inflating coverage”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The deterministic tier of the integrity-gate taxonomy comprises 21 standard-library detectors with no third-party dependencies, grouped into five families.

“The deterministic tier of the integrity-gate taxonomy comprises 21 standard-library detectors (no third-party dependencies) living inside the skills, grouped into the five families of the taxonomy”

Classified as probably not a substantial claim. May combine two claims.

The first command exits zero when every file and per-column hash matches; the second regenerates Table 2 and re-asserts its fixed reproducibility hash.

“The first command exits zero when every file and per-column hash matches; the second regenerates Table 2 and re-asserts its fixed reproducibility hash.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Recent AI scientist and co-scientist systems emphasize hypothesis generation, multi-agent critique, experimental planning, and end-to-end production.

“Recent AI scientist and co-scientist systems emphasize hypothesis generation, multi-agent critique, experimental planning, and end-to-end production [17][18][19]”

• cites [17]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [18]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [19]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

MedSci Skills is not claimed to be globally superior; the claim is limited to the verification/governance layer.

“MedSci Skills is not claimed to be globally superior; the claim is limited to the verification/governance layer.”

Probably not a substantial claim: may not pass S2 (checkable).

The auditable trail, rather than any claim to replace human judgment or to match human writing quality, is the contribution.

“That auditable trail, rather than any claim to replace human judgment or to match human writing quality, is the contribution.”

Classified as probably not a substantial claim.

Its pattern is to use generation where generation is useful, but to verify with deterministic, re-executable checks whenever an integrity question reduces to an external lookup, source-artifact reconciliation, reporting requirement, or arithmetic identity.

“Its pattern is to use generation where generation is useful, but to verify with deterministic, re-executable checks whenever an integrity question reduces to an external lookup, source-artifact reconciliation, reporting requirement, or arithmetic identity.”

Probably not a substantial claim: may not pass S3 (load-bearing).

MedSci Skills addresses a narrower, complementary problem: the downstream governance of generated research artifacts.

“MedSci Skills addresses a narrower, complementary problem: the downstream governance of generated research artifacts.”

Classified as probably not a substantial claim. May combine two claims.

The architecture's premise is that generation must be paired with verification, and its design resolves each integrity question with the cheapest sufficient mechanism: a deterministic, re-executable check wherever one suffices, and a prose-level probe only where interpretation is unavoidable.

“whose premise is that generation must be paired with verification, and whose design resolves each integrity question with the cheapest sufficient mechanism: a deterministic, re-executable check wherever one suffices, and a prose-level probe only where interpretation is unavoidable.”

May combine two claims.

Generative AI was not used to fabricate or alter data or results; every reported quantitative value derives from executed, version-pinned code, and the verification trail is published with the archived release.

“Generative AI was not used to fabricate or alter data or results; every reported quantitative value derives from executed, version-pinned code, and the verification trail is published with the archived release.”

Classified as probably not a substantial claim. May combine two claims.

Recall is detected over injected; it measures detector triggering, not population sensitivity.

“Recall is detected over injected; it measures detector triggering, not population sensitivity.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The authors used Anthropic's Claude (Opus 4.8 model family) via Claude Code agent runtime during May-June 2026 to draft and revise the manuscript and to generate the three demonstration pipelines under human direction.

“the authors used Anthropic's Claude (Opus 4.8 model family), accessed via the Claude Code agent runtime, during May-June 2026, for two purposes: (i) to draft and revise the text of this manuscript, and (ii) to generate the three demonstration pipelines (analysis code, figures, and demonstration manuscripts) under human direction.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

This clinical orientation is consistent with broader concerns that medical AI should be integrated in ways that preserve human calibration and foundational expertise rather than bypass them.

“This clinical orientation is consistent with broader concerns that medical AI should be integrated in ways that preserve human calibration and foundational expertise rather than bypass them [29].”

• cites [29]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

The conflict is mitigated by design: every deterministic result reported is re-executable and independently reproducible from the archived release, and an independent, blinded evaluation of the toolkit's outputs is deferred to a separate study.

“The conflict is mitigated by design: every deterministic result reported here is re-executable and independently reproducible from the archived release, and an independent, blinded evaluation of the toolkit's outputs is deferred to a separate study.”

Classified as probably not a substantial claim. May combine two claims.

Clean false positives count only the target defect signal raised on a clean input; an expected baseline signal is not counted.

“Clean false positives count only the target defect signal raised on a clean input; an expected baseline signal, such as the offline reference checker marking every entry unverified, is not counted.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

The transferable contribution is the taxonomy itself: the discipline of asking, for each integrity question, whether a deterministic procedure will settle it before reaching for model judgment.

“The transferable contribution is the taxonomy itself: the discipline of asking, for each integrity question, whether a deterministic procedure will settle it before reaching for model judgment.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The authors disclose a non-financial conflict of interest because the paper evaluates their own instrument, and they do not claim to be disinterested evaluators.

“Because this paper evaluates the authors' own instrument, the authors disclose a non-financial conflict of interest (an intellectual and reputational interest, and a potential future-commercial interest, in the toolkit's adoption) and do not claim to be disinterested evaluators of it.”

Probably not a substantial claim: may not pass S2 (checkable).

In a workflow where a language model can produce fluent error, the operative question is not whether the model is ever wrong but whether a human can find out before the error reaches a reader.

“In a workflow where a language model can produce fluent error, the operative question is not whether the model is ever wrong but whether a human can find out before the error reaches a reader.”

• AssumptionRests on an assumption: Language models can produce fluent errors in manuscript generation.