Cited by 129Patient Safety and Medication ErrorsHealthcare Quality and ManagementHospital Admissions and Outcomes

Front‐Line Staff Perspectives on Opportunities for Improving the Safety and Efficiency of Hospital Work Systems

Open access
Tucker, Anita L., Singer, Sara J., Hayes, Jennifer E., Falwell, Alyson·2008·Health Services Research

Abstract

Objective. To contrast the safety‐related concerns raised by front‐line staff about hospital work systems (operational failures) with national patient safety initiatives. Data Sources. Primary data included 1,732 staff‐identified operational failures at 20 U.S. hospitals from 2004 to 2006. Study Design. Senior managers observed front‐line staff and facilitated open discussion meetings with employees about their patient safety concerns. Data Collection. Hospitals submitted data on the operational failures identified through managers' interactions with front‐line workers. Data were analyzed for type of failure and frequency of occurrence. Recommendations from staff were compared with recommendations from national initiatives. Principal Findings. The two most frequent categories of operational failures, equipment/supplies and facility issues, posed safety risks and diminished staff efficiency, but have not been priorities in national initiatives. Conclusions. Our study suggests an underutilized strategy for improving patient safety and staff efficiency: leveraging front‐line staff experiences with work systems to identify and address operational failures. In contrast to the perceived tradeoff between safety and efficiency, fixing operational failures can yield benefits for both. Thus, prioritizing improvement of work systems in general, rather than focusing more narrowly on specific clinical conditions, can increase safety and efficiency of hospitals.

Integrity signals

Registry

Crossref · 10.1111/j.1475-6773.2008.00868.x

Cites

34 of 34 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 26 cited sources checked · 0 supported · 0 flagged

  • Findingown data

    Front-line workers experience routine breakdowns in work systems that impede safety and efficiency.

    “Our findings suggest that front-line workers experience routine breakdowns in work systems that impede safety and efficiency.”
    Quote in the paperSubstantial claim
  • Findingown data

    Hospitals conducted intervention activities in a median of five work areas.

    “Hospitals conducted intervention activities in a median of five work areas.”
    Quote in the paperNot a substantial claim
  • Findingown data

    85% of hospitals reported missing equipment or supplies.

    “This problem was pervasive: 85 percent of hospitals reported missing equipment or supplies.”
    Quote in the paperNot a substantial claim
  • Findingown data

    One-third of communication/documentation failures resulted from poor coordination among health care providers.

    “One-third of communication/documentation failures were the result of poor coordination among health care providers.”
    Quote in the paperNot a substantial claim
  • Findingown data

    Another third of equipment/supplies failures centered on equipment that did not meet the needs of patients.

    “Another third of the equipment/supplies failures centered on equipment that did not meet the needs of the patients.”
    Quote in the paperNot a substantial claim
  • May combine two claims. 28
  • Classified as probably not a substantial claim. 23
  • May combine two claims.

    Findingown data

    The two most frequent categories of operational failures were equipment/supplies and facility issues, each accounting for 18% of failures and reported by all 20 hospitals.

    “The two most frequently identified categories of operational failures were equipment/supply and facility design failures (18 percent each), which were reported in all 20 hospitals.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Findingcitation

    The methodology yielded concerns grounded in the context of direct patient care.

    “Similar to other studies that have considered the front-line perspective of patient safety (Pronovost et al. 2004;Frankel et al. 2005;Rathert, Fleig-Palmer, and Palmer 2006), our methodology yielded concerns that were grounded in the context of direct patient care.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The 20 hospitals collected 1,732 failures across 173 work areas, with a median of 62 failures per hospital.

    “The 20 hospitals collected 1,732 failures (median 5 62 failures per hospital) across 173 work areas.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingreasoning

    Preidentification of failures enabled the unit manager to distill commonly held concerns, which staff could then highlight during intervention activities with senior managers.

    “This preidentification of failures enabled the unit manager to distill commonly held concerns, which staff could then highlight during intervention activities with senior managers.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Findingnone given

    Work system observations allowed senior managers to witness challenges to providing safe patient care.

    “Work system observations allowed senior managers to witness challenges to providing safe patient care.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    OR staff reported they were frequently uninformed about scheduling changes, resulting in confusion and delay.

    “In addition, OR staff reported that they were frequently uninformed about scheduling changes, which resulted in confusion and delay.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The bottom quartile of hospitals identified 42 or fewer failures, while the top quartile recorded between 163 and 229 failures.

    “Similarly, with regard to operational failures, the bottom quartile identified 42 or fewer failures while the top quartile recorded between 163 and 229 failures.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Staff from all departments lamented a lack of advance notice about patient conditions, creating safety risks because they were unprepared when the patient arrived.

    “Staff from all departments lamented a lack of advance notice about patient conditions--such as a need for supplemental oxygen or isolation--which created safety risks because they were unprepared when the patient arrived.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Personnel frequently complained of insufficient storage space, which often resulted in storage of dirty equipment in nondesignated places such as hallways, creating a fire and infection control risk.

    “Personnel also frequently complained of insufficient storage space, which often resulted in storage of dirty equipment in nondesignated places, such as hallways, creating a fire and infection control risk.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The remaining five categories were policies (5%), response time (4%), security (4%), infection control (3%), and task management (2%).

    “The remaining five categories included operational failures related to policies (5 percent), response time (4 percent), security (4 percent), infection control (3 percent), and task management (2 percent).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The next three most frequent failure types were communication/documentation (16%), staffing/staff development (16%), and medication (12%).

    “The next three most frequently occurring failure types were communication/documentation (16 percent), staffing/staff development (16 percent), and medication (12 percent).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Poor lighting and a lack of automatic doors hindered physicians and staff.

    “Poor lighting and a lack of automatic doors hindered physicians and staff.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Implementation effort varied across hospitals: one hospital visited only three work areas, while four hospitals visited more than 10.

    “One hospital visited only three work areas, while four hospitals visited more than 10.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Similar to studies of computerized physician order entry systems, ADD machines had discrepancies that could lead to medication errors such as a mismatch between the dose in the drawer and the dose on the screen, active patients being deleted from the computer, or patients coming up on the screen who had already been discharged or who were never on that unit.

    “Similar to studies of computerized physician order entry systems (Koppel et al. 2005), we found that the ADD machines had discrepancies that could lead to medication errors such as a mismatch between the dose in the drawer and the dose on the screen, active patients being deleted from the computer, or patients coming up on the screen who had already been discharged or who were never on that unit.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Koppel et al. 2005 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    One hospital's ICU staff complained that weekly inventory of its ADD machine took 45 minutes.

    “One hospital's ICU staff complained that weekly inventory of its ADD machine took 45 minutes.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Senior managers observed that a lack of support staff caused inefficiencies and interruptions for physicians and nurses who had to perform support staff functions themselves.

    “Finally, senior managers observed that a lack of support staff (housekeepers, secretaries) caused inefficiencies and interruptions for physicians and nurses who had to perform support staff functions (e.g., answering phones, cleaning rooms) themselves.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Delays in procedures, test results, and surgeon arrival caused delays in treatment and sometimes rework as patients waited so long they needed to be reassessed.

    “There were also delays in procedures (e.g., line insertion), results from tests, and even surgeon arrival, which caused delays in treatment for patients and sometimes rework as patients waited so long they needed to be re-assessed.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Staff felt vulnerable because of a perceived lack of security in the hospital, especially on night shifts and in remote areas.

    “Staff also felt vulnerable because of a perceived lack of security in the hospital, especially on the night shifts and in remote areas of the hospitals.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Most hospitals had policies to meet publicized national goals, such as using two patient identifiers, but front-line staff reported low compliance with those policies.

    “Finally, LFLE suggested that while most hospitals had policies to satisfy publicized national goals, such as the use of two patient identifiers when providing care, front-line staff reported low compliance with such policies.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    LFLE communication failures not covered by national initiatives included difficulty reaching medical personnel, lack of notice about patient-procedure schedule changes, redundant documentation, and poorly designed forms.

    “However, LFLE communication failures not addressed by national initiatives included more basic issues such as difficulty contacting medical personnel, lack of notice about patient-procedure schedule changes, redundant documentation, and poorly designed forms that were difficult to use.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingnone given

    Many of the issues front-line staff raised have been identified elsewhere but have not been made priorities by national patient safety initiatives.

    “Many have been identified elsewhere (e.g., equipment inspection during JCAHO accreditation surveys), but they have not been highlighted as priorities by national patient safety initiatives.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The national patient safety initiatives reviewed are representative of national patient safety priorities.
  • May combine two claims.

    Interpretationown data

    Equipment/supply and facility failures posed safety risks and reduced staff efficiency.

    “The two most frequent categories of operational failures, equipment/supplies and facility issues, posed safety risks and diminished staff efficiency”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    Both safety and efficiency can benefit from improving work system performance.

    “Therefore, both safety and efficiency--which together create value for patients--can benefit from improving work system performance.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductown data

    The iterative coding process resulted in 10 failure categories.

    “Following recommendations for qualitative research (Miles and Huberman 1994), we used an iterative coding process that resulted in 10 failure categories.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Miles and Huberman 1994

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    All activities were approved by Institutional Review Boards at participating institutions.

    “None of the hospitals nor any individuals received compensation for participation, and all activities were approved by the Institutional Review Boards at the participating institutions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    Four hospitals were excluded from analysis because one closed and three completed observations in only one work area, leaving a final sample of 20 hospitals.

    “Four hospitals were excluded from the analysis because one closed and the other three completed observations in only one work area, leaving a final sample of 20 hospitals.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Study design and conductown data

    Two investigators independently coded 100 operational failures and achieved a nearly perfect kappa of 0.88.

    “We assessed reliability of our codes by having two investigators independently code 100 operational failures.They achieved a nearly perfect k value of 0.88.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Study design and conductnone given

    There was no difference between the 24 participating hospitals and 68 control hospitals nor the 92 hospitals in the larger study and all U.S. hospitals on teaching status, tax status, and ownership.

    “There was no difference between the 24 participating hospitals and 68 control hospitals nor the 92 hospitals in the larger study and all U.S. hospitals on teaching status, tax status, and ownership.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Study design and conductnone given

    There are undoubtedly other issues not captured by the data collection instruments that might negatively affect safety and efficiency.

    “Although our intervention raised a large number of safety concerns, there are undoubtedly other issues not captured by our data collection instruments that might negatively affect safety and efficiency.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    The pretest process was repeated until saturation was reached and no new codes needed to be developed.

    “This pretest process was repeated with a second subset of the data until saturation was reached and no new codes needed to be developed.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Contact with more people increases effectiveness of information gathering.

    “Prior research suggests that contact with more people increases effectiveness of information gathering (Thomas et al. 2005).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Thomas et al. 2005

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    As a result of the oxygen tank deficiency, patients were more likely to become unstable, resulting in ICU admission and longer hospital stays.

    “As a result, patients were more likely to become unstable, resulting in admission to the ICU and longer hospital stays.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Previous research shows that equipment failures can frustrate patient care providers and decrease quality of care.

    “Previous research on hospital work environments shows that equipment failures can frustrate patient care providers and decrease quality of care (de Leval et al. 2000;Beaudoin and Edgar 2003;Cleary 2003;Tucker 2004;Rathert, Fleig-Palmer, and Palmer 2006).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites de Leval et al. 2000

      Not checked in the free run.

    • cites Beaudoin and Edgar 2003

      Not checked in the free run.

    • cites Cleary 2003

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    When inadequate staff support forces health care providers to do housekeeping and secretarial tasks, it interferes with safe medical care and wastes expensive resources.

    “For example, requiring health care providers to perform housekeeping and secretarial functions because of inadequate staff support interferes with the safe delivery of medical care and wastes expensive resources (Tucker and Spear 2006).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Tucker and Spear 2006

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Poor facility design can compromise patient confidentiality and create safety risks through limited patient visibility.

    “Poor facility design can compromise patient confidentiality and create safety risks through limited patient visibility (Carayon et al. 2006).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Carayon et al. 2006

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Patient care delays place patients at risk for poor outcomes and prolonged pain and suffering.

    “Patient care delays place patients at risk for poor outcomes and prolonged pain and suffering (Derlet and Richards 2000).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Derlet and Richards 2000

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Hospitals must first be able to consistently provide required supply items in general before they can successfully implement improvements that depend on specific supplies, such as an infection-preventing surgical supply.

    “For example, before hospitals can successfully implement improvements that rely on specific supplies--such as an infection-preventing surgical supply--they need to first ensure that they can consistently provide required supply items in general.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data

    The study's data indicate that the national initiatives' implicit assumptions-that facilities support care and that necessary equipment is available, functional, and adequate-are incorrect.

    “However, our data suggest that these assumptions are faulty.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Operational failures are latent failures-system weaknesses that may not cause accidents alone but often lead to catastrophic events when combined.

    “operational failures are important because they are latent failures, or system weaknesses that on their own may be insufficient to cause accidents, but in combination often lead to catastrophic events (Reason 1990;Vincent, Taylor-Adams, and Stanhope 1998).”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Reason 1990

      Not checked in the free run.

    • cites Vincent, Taylor-Adams, and Stanhope 1998

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Missing equipment typically results in people working around the issue by locating substitutes, which wastes staff time and delays patient care.

    “As several of our examples illustrate, missing equipment typically results in people working around the issue by locating substitutes, which wastes staff time and delays patient care (Tucker 2004).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Tucker 2004

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    The types of failures uncovered may vary with implementation style.

    “Thus, the types of failures that were uncovered might vary with implementation style.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Study design and conductreasoning

    The issues identified likely represent only a subset of what a broader mandate might have recommended.

    “In summary, issues identified likely represent a subset of what might have been recommended with a broader mandate.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning

    Some issues raised may have fallen outside the safety domain.

    “Nonetheless, some of the issues raised may have been outside of the domain of safety.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductcitation

    Interpersonal risks of speaking up, including fear of shame or retribution, may have prevented complete disclosure.

    “While front-line staff were encouraged to speak openly, it is possible that interpersonal risks associated with speaking up, including fear of shame or retribution, may have presented a barrier to complete disclosure (Tucker and Edmondson 2003).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Tucker and Edmondson 2003

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    The willingness to sustain the effort required for intervention activities could not be standardized.

    “Although the hospitals were randomly selected, willingness to sustain effort required for intervention activities could not be standardized.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    More reliable work systems are a complementary strategy to increasing staffing levels, with associated improvements in staff satisfaction, lower turnover, and patient care outcomes.

    “Providing staff with more reliable work systems represents a complementary strategy to increasing staffing levels--with its commensurate improvement in staff satisfaction, reduced turnover, and patient care outcomes (Aiken et al. 2002).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Aiken et al. 2002 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    Having each hospital's liaison record the data rather than an outside researcher may have caused reporting bias.

    “Furthermore, the data were recorded by each hospital's liaison, rather than by an outside researcher, perhaps resulting in reporting bias.”
    Quote in the paperNot a substantial claim
47 of 47
  • The paper relies on this without support.

    The frequency with which operational failures were reported by staff reflects the actual frequency or importance of those failures in hospital work systems.

    “The two most frequently identified categories of operational failures were equipment/supply and facility design failures (18 percent each), which were reported in all 20 hospitals.”
  • The paper relies on this without support.

    The operational failures captured by the intervention's data collection instruments are representative of the work system problems that affect safety and efficiency in the participating hospitals.

    “Although our intervention raised a large number of safety concerns, there are undoubtedly other issues not captured by our data collection instruments that might negatively affect safety and efficiency.”
  • The paper relies on this without support.

    The national patient safety initiatives reviewed are representative of national patient safety priorities.

    “equipment and facilities issues were not explicitly mentioned by the Joint Commission's 2008National Patient Safety Goals (2007)”
3 of 3

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Frontline hospital staff involved in a patient safety intervention identified patient safety as a priority but cited lack of proper equipment/supplies and facility issues as major operational barriers that their institutions did not prioritize when implementing a new policy.

    “For instance, frontline hospital staff involved in a patient safety intervention identified patient safety as a priority; but they cited a lack of proper equipment/supplies and facility issues as major operational barriers that their institutions did not prioritize when implementing a new policy [32].”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

  • Medication communication share uses the wrong denominator

    Minor

    The table labels subcode percentages as percentages within their category. Communication accounts for 62 of 214 medication failures, or about 29%, not 23%.

    Reported 23 · recomputed 28.971963

  • Provider information-transfer percentage is one point high

    Minor

    The 89 failures involving information transfer are about 32% of the 275 communication/documentation failures, rather than the reported 33%.

    Reported 33 · recomputed 32.363636

  • Medication staffing share is understated

    Minor

    The 27 staffing and staff-development failures are about 13% of the 214 medication failures, not 10%.

    Reported 10 · recomputed 12.616822

  • Medication equipment share is understated

    Minor

    Equipment accounts for 55 of 214 medication failures, or about 26%, rather than the reported 20%.

    Reported 20 · recomputed 25.700935

4 of 4

Cites

Flagged first, then by citations

Research works printed but not linked: 4

  1. Beaudoin L. E., 2003, Hassles, Nursing Economics, 21, 106
  2. National Quality Forum, 2006, Safe Practices for Better Healthcare 2006 Update: A Consensus Report
  3. Pronovost P. J., 2004, Senior Executive, Joint Commission Journal of Quality Improvement, 30, 59
  4. Rathert C., 2006, Minimizing Medical Errors, Journal of Applied Management and Entrepreneurship, 11, 5

Cited by

Sorted by citations

Authors
Tucker, A. L., Singer, S. J., Hayes, J. E., & Falwell, A.
Affiliations
  • Harvard University (US)
  • Stanford University (US)
Corresponding author
Tucker, Anita L.
Venue
Health Services Research
Publisher
Wiley
Published
2008-09-20
Volume
43
Issue
5p2
Pages
1807-1829
ISSN
  • 0017-9124 (ISSN-L)
  • 1475-6773
OpenAlex
W2042274627
Cited by
129
References
34
Citations by year
2026: 3 · 2025: 3 · 2024: 7 · 2023: 6 · 2022: 11 · 2021: 12 · 2020: 3 · 2019: 7 · 2018: 9 · 2017: 11 · 2016: 11 · 2015: 5 · 2014: 10 · 2013: 5 · 2012: 9
FWCI
8.94
Type
journal article
Language
en
Open access
Locations
  • Health Services Research (publishedVersion)
  • PubMed Central (publishedVersion)
  • PubMed (publishedVersion)
Funders
Agency for Healthcare Research and Quality
Topics
  • Health Sciences › Health Professions › Emergency Medical Services › Patient Safety and Medication Errors
  • Health Sciences › Health Professions › Health Information Management › Healthcare Quality and Management
  • Health Sciences › Medicine › Emergency Medicine › Hospital Admissions and Outcomes
Keywords
patient safety, operational failures, employee efficiency, hospital management
MeSH terms
Attitude of Health Personnel, Patient Care, Health Priorities, Health Services Research, Hospital Administration, Hospital Administrators, Hospital Design and Construction, Humans, Materials Management, Hospital, Operations Research, Personnel, Hospital, Quality Assurance, Health Care, Sampling Studies, United States, Program Evaluation, Efficiency, Organizational, Safety Management, Interdisciplinary Communication

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-07.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-07.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review