Missed hypothyroidism diagnosis uncovered by linking laboratory and pharmacy data
Abstract
BACKGROUND: Although diagnostic errors are important, they have received less attention than medication errors. Timely follow-up of abnormal laboratory test results represents a critical aspect of the diagnostic process, and failures at this step are a cause of delayed or missed diagnosis, resulting in suboptimal clinical outcomes and malpractice litigation. We linked laboratory and pharmacy databases to (1) explore the potential for linking laboratory and pharmacy databases to uncover diagnostic errors, and (2) determine the frequency of failed follow-up of elevated levels of thyroid-stimulating hormone (TSH). METHODS: We downloaded TSH test results for 2 consecutive years from a laboratory database and linked this database with a pharmacy database to screen for patients with TSH levels of 20 mU/mL or higher who were not receiving levothyroxine. Patients with elevated TSH levels lacking prescriptions were followed up by telephone and record review. RESULTS: During the 2-year period, 982 (2.7%) of 36 760 unique patients tested for TSH level had elevated TSH levels. Of these patients, 177 (18.0%) had no recorded levothyroxine prescriptions. We attempted to contact 177 patients with high TSH levels who were not taking thyroid medications and reached 123 (69.5%). Of the 123 patients we were able to reach, 12 in 2000 and 11 in 2001 were unaware of their abnormal test results or a diagnosis of hypothyroidism, representing 2.3% of 982 patients with elevated TSH levels. We were unable to reach another 54 patients (5.5% of the total number of patients with elevated TSH levels) by either telephone or mail. CONCLUSIONS: By linking laboratory and pharmacy databases, we uncovered patients who did not undergo follow-up for abnormal TSH results. Conservatively, there was no follow-up for abnormal TSH results in more than 2% of patients, and another 5% of patients were lost to follow-up and possibly unaware of their results. Uncovering patients with missed diagnosis illustrates a potential use of linking laboratory and pharmacy databases to identify vulnerabilities in the care system and improve patient safety.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Outpatient care is often busy and fragmented, making follow-up of abnormal laboratory test results prone to error.
“Outpatient care is often busy and fragmented, and therefore follow-up of abnormal laboratory test results is prone to error.”
From Notification of Abnormal Lab Test Results in an Electronic Medical Record: Do Any Safety Concerns Remain? (2010) · cites this paper as [5]
Cites
Institute of Medicine (2000) · National Academies Press eBooks · doi:10.17226/9728 · Cited by 14,174 · see citing works
Wall, A. (2000) · British Journal of Healthcare Management · doi:10.12968/bjhc.2000.6.9.19311 · Cited by 5,909 · see citing works
The Colorado Thyroid Disease Prevalence Study
Canaris, G. J., Manowitz, N. R., Mayor, G., & Ridgway, E. C. (2000) · Archives of Internal Medicine · doi:10.1001/archinte.160.4.526 · Cited by 2,824 · see citing works
The Importance of Cognitive Errors in Diagnosis and Strategies to Minimize Them
Croskerry, P. (2003) · Academic Medicine · doi:10.1097/00001888-200308000-00003 · Cited by 1,675 · see citing works
Improving Safety with Information Technology
Bates, D. W., & Gawande, A. A. (2003) · New England Journal of Medicine · doi:10.1056/nejmsa020847 · Cited by 1,544 · see citing works
Reducing the Frequency of Errors in Medicine Using Information Technology
Bates, D. W., Cohen, M., Leape, L. L., Overhage, J. M., Shabot, M. M., & Sheridan, T. (2001) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2001.0080299 · Cited by 959 · see citing works
A primer on leading the improvement of systems: Fig 1
Berwick, D. M. (1996) · BMJ · doi:10.1136/bmj.312.7031.619 · Cited by 793 · see citing works
Computerized Surveillance of Adverse Drug Events in Hospital Patients
Classen, D. C. (1991) · JAMA · doi:10.1001/jama.1991.03470200059035 · Cited by 643 · see citing works
Jha, A. K., Kuperman, G. J., Teich, J. M., Leape, L. L., Shea, B. S., Rittenberg, E., Burdick, E., Seger, D. L., Vliet, M. V., & Bates, D. W. (1998) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1998.0050305 · Cited by 514 · see citing works
Guided Medication Dosing for Inpatients With Renal Insufficiency
Chertow, G. M. (2001) · JAMA · doi:10.1001/jama.286.22.2839 · Cited by 447 · see citing works
Effect of Computer-Based Alerts on the Treatment and Outcomes of Hospitalized Patients
Rind, D. M. (1994) · Archives of Internal Medicine · doi:10.1001/archinte.1994.00420130107014 · Cited by 323 · see citing works
Reducing Diagnostic Errors in Medicine
Graber, M. L., Gordon, R., & Franklin, N. (2002) · Academic Medicine · doi:10.1097/00001888-200210000-00009 · Cited by 287 · see citing works
Schiff, G. D., & Rucker, T. D. (1998) · JAMA · doi:10.1001/jama.279.13.1024 · Cited by 250 · see citing works
Diagnosing Diagnosis Errors: Lessons from a Multi-institutional Collaborative Project
Schiff, G. D., Kim, S., Abrams, R. I., Cosby, K. S., Lambert, B. L., Elstein, A. S., Hasler, S., Krosnjar, N., Odwazny, R., Wisniewski, M. F., et al. (2005) · Cited by 167 · see citing works
Interpretation of thyroid function tests
Dayan, C. M. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04060-5 · Cited by 162 · see citing works
Development of a Clinical Data Warehouse for Hospital Infection Control
Wisniewski, M. F., Kieszkowski, P., Zagorski, B., Trick, W. E., Sommers, M., & Weinstein, R. A. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1299 · Cited by 160 · see citing works
Linking Laboratory and Pharmacy
Schiff, G. D., Klass, D. B., Peterson, J. F., Shah, G., & Bates, D. W. (2003) · Archives of Internal Medicine · doi:10.1001/archinte.163.8.893 · Cited by 152 · see citing works
Liver Enzyme Monitoring in Patients Treated With Troglitazone
Graham, D. J. (2001) · JAMA · doi:10.1001/jama.286.7.831 · Cited by 138 · see citing works
Communicating Critical Test Results: Safe Practice Recommendations
Hanna, D., Griswold, P., Leape, L. L., & Bates, D. W. (2005) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/s1553-7250(05)31011-7 · Cited by 123 · see citing works
Errors Today and Errors Tomorrow
Berwick, D. M. (2003) · New England Journal of Medicine · doi:10.1056/nejme030044 · Cited by 116 · see citing works
Berwick, D. (2001) · BMJ · doi:10.1136/bmj.322.7281.247 · Cited by 93 · see citing works
Tegeder, I., Levy, Muth‐Selbach, Oelkers, Neumann, Dormann, Azaz‐Livshits, Criegee‐Rieck, Schneider, Hahn, et al. (1999) · British Journal of Clinical Pharmacology · doi:10.1046/j.1365-2125.1999.00926.x · Cited by 65 · see citing works
Schiff, G. D., Aggarwal, H. C., Kumar, S., & Mcnutt, R. (2000) · The American Journal of Medicine · doi:10.1016/s0002-9343(00)00546-5 · Cited by 52 · see citing works
Outpatient diagnostic errors: unrecognized hyperglycemia.
Edelman, D. E. (2002) · PubMed · Cited by 28 · see citing works
Introduction: Communicating Critical Test Results
Schiff, G. D. (2005) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/s1553-7250(05)31009-9 · Cited by 19 · see citing works
Linking patient medication data with laboratory information system
Forsström, J., Grönroos, P., Irjala, K. M. A., Heiskanen, J. S., & Torniainen, K. (1996) · International Journal of Bio-Medical Computing · doi:10.1016/0020-7101(96)01188-9 · Cited by 12 · see citing works
Gilmet, G., Mallon, R., Griffin, B. T., & Lewandowski, J. J. (1998) · Journal of Ambulatory Care Management · doi:10.1097/00004479-199801000-00003 · Cited by 6 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
The incidence of diagnostic error in medicine
Graber, M. L. (2013) · BMJ Quality & Safety · doi:10.1136/bmjqs-2012-001615 · Cited by 626 · see citing works
The detection and prevention of errors in laboratory medicine
Plebani, M. (2009) · Annals of Clinical Biochemistry International Journal of Laboratory Medicine · doi:10.1258/acb.2009.009222 · Cited by 493 · see citing works
Failure to Follow-Up Test Results for Ambulatory Patients: A Systematic Review
Callen, J. L., Westbrook, J. I., Georgiou, A., & Li, J. (2012) · Journal of General Internal Medicine · doi:10.1007/s11606-011-1949-5 · Cited by 229 · see citing works
Linking laboratory and medication data: new opportunities for pharmacoepidemiological research
ten Berg, M. J., Huisman, A., van den Bemt, P. M. L. A., Schobben, A. F. A. M., Egberts, A. C. G., & van Solinge, W. W. (2007) · Clinical Chemical Laboratory Medicine · doi:10.1515/cclm.2007.009 · Cited by 156 · see citing works
Callen, J. L., Georgiou, A., Li, J., & Westbrook, J. I. (2011) · BMJ Quality & Safety · doi:10.1136/bmjqs.2010.044339 · Cited by 165 · see citing works
Singh, H., Thomas, E. J., Sittig, D. F., Wilson, L., Espadas, D., Khan, M. M., & Petersen, L. A. (2010) · The American Journal of Medicine · doi:10.1016/j.amjmed.2009.07.027 · Cited by 160 · see citing works
“The American Journal of Medicine 2003;114(5):397– 403.”
Frequency of Failure to Inform Patients of Clinically Significant Outpatient Test Results
Casalino, L. P., Dunham, D., Chin, M. H., Bielang, R., Kistner, E. O., Karrison, T. G., Ong, M. K., Sarkar, U., McLaughlin, M. A., & Meltzer, D. O. (2009) · Archives of Internal Medicine · doi:10.1001/archinternmed.2009.130 · Cited by 159 · see citing works
Electronic health record-based triggers to detect potential delays in cancer diagnosis
Murphy, D. R., Laxmisan, A., Reis, B., Thomas, E. J., Esquivel, A., Forjuoh, S. N., Parikh, R. C., Khan, M. M., & Singh, H. (2013) · BMJ Quality & Safety · doi:10.1136/bmjqs-2013-001874 · Cited by 125 · see citing works
Wahls, T. L., & Cram, P. M. (2007) · BMC Family Practice · doi:10.1186/1471-2296-8-32 · Cited by 118 · see citing works
Mrazek, C., Keppel, M. H., Cadamuro, J., Haschke‐Becher, E., Oberkofler, H., Felder, T. K., & Lippi, G. (2020) · Biochemia Medica · doi:10.11613/bm.2020.020502 · Cited by 114 · see citing works
Murphy, D. R., Wu, L., Thomas, E. J., Forjuoh, S. N., Meyer, A. N. D., & Singh, H. (2015) · Journal of Clinical Oncology · doi:10.1200/jco.2015.61.1301 · Cited by 100 · see citing works
Interpretative commenting: A tool for improving the laboratory–clinical interface
Plebani, M. (2009) · Clinica Chimica Acta · doi:10.1016/j.cca.2009.03.012 · Cited by 77 · see citing works
Rozenblum, R., Rodríguez-Monguió, R., Volk, L. A., Forsythe, K. J., Myers, S., McGurrin, M., Williams, D. H., Bates, D. W., Schiff, G. D., & Seoane-Vazquez, E. C. (2019) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/j.jcjq.2019.09.008 · Cited by 75 · see citing works
Diagnostic Errors and Laboratory Medicine - Causes and Strategies.
Plebani, M. (2015) · PubMed Central · Cited by 73 · see citing works
Gordon, J. R. S., Wahls, T. L., Carlos, R. C., Pipinos, I. I., Rosenthal, G. E., & Cram, P. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-1-200907070-00005 · Cited by 53 · see citing works
Management of Test Results in Family Medicine Offices
Elder, N. C., McEwen, T. R., Flach, J. M., & Gallimore, J. J. (2009) · The Annals of Family Medicine · doi:10.1370/afm.961 · Cited by 51 · see citing works
Diagnosis and diagnostic errors: time for a new paradigm
Schiff, G. D. (2013) · BMJ Quality & Safety · doi:10.1136/bmjqs-2013-002426 · Cited by 51 · see citing works
Direct reporting of laboratory test results to patients by mail to enhance patient safety
Sung, S., Forman-Hoffman, V., Wilson, M. C., & Cram, P. (2006) · Journal of General Internal Medicine · doi:10.1111/j.1525-1497.2006.00553.x · Cited by 46 · see citing works
Wahls, T. L., Haugen, T. H., & Cram, P. M. (2007) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/s1553-7250(07)33052-3 · Cited by 46 · see citing works
Murphy, D. R., Thomas, E. J., Meyer, A. N. D., & Singh, H. (2015) · Radiology · doi:10.1148/radiol.2015142530 · Cited by 43 · see citing works
Low awareness and under-diagnosis of hypothyroidism
Gottwald‐Hostalek, U., & Schulte, B. (2021) · Current Medical Research and Opinion · doi:10.1080/03007995.2021.1997258 · Cited by 43 · see citing works
Challenges in patient safety improvement research in the era of electronic health records
Russo, E. M., Sittig, D. F., Murphy, D. R., & Singh, H. (2016) · Healthcare · doi:10.1016/j.hjdsi.2016.06.005 · Cited by 39 · see citing works
Patient- and system-related barriers for the earlier diagnosis of colorectal cancer
Wahls, T. L., & Peleg, I. I. (2009) · BMC Family Practice · doi:10.1186/1471-2296-10-65 · Cited by 34 · see citing works
Powell, L., Sittig, D. F., Chrouser, K. L., & Singh, H. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.6752 · Cited by 34 · see citing works
Laboratory-associated and diagnostic errors: a neglected link
Plebani, M. (2014) · Diagnosis · doi:10.1515/dx-2013-0030 · Cited by 33 · see citing works
DELVIN, E. E., Grey, V. L., & Vergee, Z. (2006) · Clinical Biochemistry · doi:10.1016/j.clinbiochem.2006.03.006 · Cited by 25 · see citing works
Prevalence of delayed clinician response to elevated prostate-specific antigen values
Nepple, K. G., Joudi, F. N., Hillis, S. L., & Wahls, T. L. (2008) · Mayo Clinic Proceedings · doi:10.4065/83.4.439 · Cited by 22 · see citing works
Wahls, T. (2007) · Journal of Ambulatory Care Management · doi:10.1097/01.jac.0000290402.89284.a9 · Cited by 21 · see citing works
Introduction: Communicating Critical Test Results
Schiff, G. D. (2005) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/s1553-7250(05)31009-9 · Cited by 19 · see citing works
Electronic Detection of Delayed Test Result Follow-Up in Patients with Hypothyroidism
Meyer, A. N. D., Murphy, D. R., Al-Mutairi, A., Sittig, D. F., Wei, L., Russo, E. M., & Singh, H. (2017) · Journal of General Internal Medicine · doi:10.1007/s11606-017-3988-z · Cited by 14 · see citing works
Test Result Management Practices of Canadian Internal Medicine Physicians and Trainees
Bodley, T. F., Kwan, J. L., Matelski, J. J., Darragh, P. J., & Cram, P. M. (2018) · Journal of General Internal Medicine · doi:10.1007/s11606-018-4656-7 · Cited by 12 · see citing works
Schiff, G. D. (2011) · JAMA · doi:10.1001/jama.2011.496 · Cited by 12 · see citing works
Proposed interventions to decrease the frequency of missed test results
Wahls, T. L., & Cram, P. M. (2009) · Advances in Health Sciences Education · doi:10.1007/s10459-009-9180-4 · Cited by 7 · see citing works
Yokoyama, I., Yamaguchi, H., Yamazaki, K., Sekiya, M., Arai, S., Nakamura, T. K., Suzuki, T., & Ishii, I. (2021) · Scientific Reports · doi:10.1038/s41598-021-81344-y · Cited by 7 · see citing works
Vargas‐Uricoechea, H., Barrera, C. A. B., Arenas-Quintero, H. M., Castellanos-Pinedo, A., Restrepo-Erazo, K., Ossman, J. J. D., Melo, L. J. R., Barraza-Gerardino, M., Mejía, G., Hernández-Triana, E., et al. (2023) · Revista Colombiana de Endocrinología Diabetes & Metabolismo · doi:10.53853/encr.10.4.818 · Cited by 4 · see citing works
Cassell, B. E., Walker, T., Alghamdi, S. A., Bill, J. G., Blais, P., Boutte, H. J., Brown, J. W., Sayuk, G. S., & Gyawali, C. P. (2017) · Digestive Diseases and Sciences · doi:10.1007/s10620-017-4563-5 · Cited by 3 · see citing works
2019 John M. Eisenberg Patient Safety and Quality Awards: An Interview with Gordon D. Schiff
Graber, I. B. M. L. (2020) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/j.jcjq.2020.04.008 · Cited by 3 · see citing works
AHRQ’s contributions to diagnostic safety: past, present, and future
Hussey, H. M., Batista, S., & Schiff, G. D. (2025) · Diagnosis · doi:10.1515/dx-2025-0126 · Cited by 2 · see citing works
[Subclinical thyroid dysfunction. Diagnostic and therapeutic considerations].
Ramos, D., & Pérez-Enríquez, B. (2006) · PubMed · Cited by 3 · see citing works
T3 and T4: Are we missing half the picture?
Klein, I. L. (2005) · Clinical cornerstone · doi:10.1016/s1098-3597(05)80051-1 · Cited by 2 · see citing works
Diagnostic Error: Have We Made Any Progress?
Hoffer, E. P. (2025) · The American Journal of Medicine · doi:10.1016/j.amjmed.2025.04.017 · Cited by 2 · see citing works
Showande, S. J., & Olaifa, O. A. (2012) · Indian Journal of Pharmacy Practice · Cited by 1 · see citing works
Fischer, S. H. (2011) · eScholarship@UMassChan · doi:10.13028/qvb0-7r85
Cassell, B. E., Alghamdi, S., Bill, J. G., Blais, P., Boutte, H. J., Brown, J. W., Sayuk, G. S., & Gyawali, C. P. (2016) · Gastroenterology · doi:10.1053/j.gastro.2016.05.033
Schifman, R. B., Cembrowski, G. S., Wolk, D. M., & Brisbois, J. I. (2014) · ASM Press eBooks · doi:10.1128/9781555817282.ch21
Risks and Adverse Events in Medicine
Niv, Y., & Tal, Y. (2023) · Springer eBooks · doi:10.1007/978-3-031-49865-7_1
- Authors
- Schiff, G. D.
- Affiliations
- John H. Stroger, Jr. Hospital of Cook County (US)
- Corresponding author
- Schiff, Gordon D.
- ORCID
- Schiff, Gordon D.
- Venue
- Archives of Internal Medicine
- Publisher
- American Medical Association (AMA)
- Published
- 2005-03-14
- Volume
- 165
- Issue
- 5
- Pages
- 574
- ISSN
- 0003-9926 (ISSN-L)
- OpenAlex
- W2161872467
- Cited by
- 47
- References
- 27
- Citations by year
- 2025: 2 · 2023: 2 · 2021: 2 · 2020: 3 · 2019: 1 · 2018: 1 · 2017: 2 · 2016: 2 · 2015: 3 · 2014: 2 · 2013: 4 · 2012: 1
- FWCI
- 2.36
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Archives of Internal Medicine (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Centers for Disease Control and Prevention (U50 CCU 515853)
- Agency for Healthcare Research and Quality (HS 11552)
- Topics
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Health Sciences › Medicine › Physiology › Clinical Laboratory Practices and Quality Control
- Health Sciences › Medicine › Endocrinology, Diabetes and Metabolism › Thyroid Disorders and Treatments
- Keywords
- missed diagnosis, diagnostic errors, hypothyroidism, thyroid-stimulating hormone, levothyroxine, patient safety, loss to follow-up
- MeSH terms
- Data Interpretation, Statistical, Diagnostic Errors, Follow-Up Studies, Humans, Hypothyroidism, Laboratories, Medical Record Linkage, Pharmacies, Retrospective Studies, Thyroid Function Tests, Thyroxine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review