Evolution of clinical Health Information Exchanges to population health resources: a case study of the Indiana network for patient care
Open accessAbstract
BACKGROUND: Motivated by the Triple Aim, US health care policy is expanding its focus from individual patient care to include population health management. Health Information Exchanges are positioned to play an important role in that expansion. OBJECTIVE: The objective is to describe the evolution of the Indiana Network for Patient Care (INPC) and discuss examples of its innovations that support both population health and clinical applications. METHODS: A descriptive analytical approach was used to gather information on the INPC. This included a literature review of recent systematic and scoping reviews, collection of research that used INPC data as a resource, and data abstracted by Regenstrief Data Services to understand the breadth of uses for the INPC as a data resource. RESULTS: Although INPC data are primarily gathered from and used in healthcare settings, their use for population health management and research has increased. By December 2023, the INPC contained nearly 25 million patients, a significant growth from 3.5 million in 2004. This growth was a result of the use of INPC data for population health surveillance, clinical applications for data, disease registries, Patient-Centered Data Homes, non-clinical population health advancements, and accountable care organization connections with Health Information Exchanges. CONCLUSION: By structuring services on the fundamental building blocks, expanding the focus to population health, and ensuring value in the services provided to the stakeholders, Health Information Exchanges are uniquely positioned to support both population health and clinical applications.
AI snapshot
Written from the paper’s full text.
TL;DR
This case study describes how the Indiana Network for Patient Care (INPC) evolved from a clinical health information exchange into a population health data resource. It reports growth to nearly 25 million patients by December 2023 and highlights innovations in surveillance, registries, data commons, EHR integration, and accountable care organization support.
Key findings
- The INPC grew from 3,554,480 total patients in 2004 to 25,449,906 in 2023, with Indiana county coverage expanding from 9 to 92 and clinical data elements increasing from about 53,055,000 to 16,000,000,000 (Table 1).
- By December 2023, the INPC contained at least one patient encounter for nearly two-thirds of Indiana’s population across its 92 counties; total Indiana patients in the INPC rose from 2,562,836 in 2004 to 13,336,671 in 2023.
- The Health Dart FHIR app, integrated with Cerner EHR, was piloted with 111 clinicians at IU Health Methodist ED from September 2017 through March 2018; intervention ED clinicians used HIE significantly more (10.55%) than other EDs (3.2%, p < 0.001), with increased odds of HIE usage (OR 1.15; CI 1.02–1.30; p = 0.026), and a laboratory experiment reduced clicks from 50 to 6 and search time from 3 minutes to 10 seconds.
- Disease registries and data commons included cancer registry linkage matching approximately 89% of patients with longitudinal records and identifying an additional 746,311 patients by June 2020; CoRDaCo contained data for 1,858,220 COVID-19 patients by February 2023; and the Patient-Centered Data Home pilot exchanged nearly 8,500,000 ADT messages among Heartland Region HIEs over one year.
Methods
- A descriptive analytical case study was used: a limited review of recent systematic and scoping HIE literature, collection of published studies and Regenstrief Institute working documents, and data abstractions by Regenstrief Data Services to understand the INPC’s growth and breadth of uses.
- The authors iteratively developed a narrative of the INPC’s evolution, validated working documents with HIE leadership, and reached consensus among authors; the study was deemed non-human subjects research with IRB approval waived and adhered to the Declaration of Helsinki.
- The theoretical framework drew on fundamental HIE building blocks and core services, layered over time, as described in the book *Health Information Exchange*.
Limitations
- The paper does not present a formal limitations section; it states that the Indiana Network for Population Health is still in its early stages and that creating and sustaining HIE remains a challenge, with many implementations relying on proprietary terminologies, suboptimal messaging standards, and health systems treating data as an asset to protect rather than a shared resource.
- The paper also states that many places lack HIEs with population health capabilities like the INPC and that more investment is needed by the US and other nations to develop and sustain HIE for population health.
- Evident from the text: this is a single-case descriptive study of one mature HIE, which limits generalizability; the methods rely on available publications, reports, and Regenstrief Data Services abstractions rather than a systematic, independent outcome evaluation.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
25 of 58 cited sources checked · 10 supported · 0 flagged · accuracy not yet measured
- Premisecitation
ELR provides a robust foundation upon which HIEs can offer electronic case reporting (eCR).
“Moreover, ELR provides a robust foundation upon which HIEs can offer electronic case reporting (eCR) [24].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [24] Dixon BE, Zhang Z, Arno JN, Revere D, Joseph Gibson P, Grannis SJ. Improving notifiable Disease Case Reporting through Electronic Information Exchange-facilitated decision support: a controlled before-and-after Trial. Public Health Rep. 2020;135(3):401–10. source
The Methods (page unavailable) describe electronic laboratory results triggering an HIE system that generates and electronically delivers prepopulated case-reporting forms. This supports laboratory reporting as a basis for HIE-facilitated reporting, but the forms were usually submitted to the health department by fax; the trial does not establish fully electronic case reporting. (LLM, conf=0.84)
Experimental — accuracy not yet measured
- Findingcitation
INPC data are aggregated from providers, payers, and public health agencies in real-time.
“INPC data are aggregated from providers, payers, and public health agencies in real-time, which was a recommended practice in Dixon et al.’s systematic review [16], enabling online functions such as clinical alerts that can influence patient care decisions at the point of care.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [16] Dixon BE, Whipple EC, Lajiness JM, Murray MD. Utilizing an integrated infrastructure for outcomes research: a systematic review. Health Info Libr J. 2016;33(1):7–32. source
The Discussion (page unavailable) describes the INPC as an integrated resource for clinical and administrative data collected across clinical facilities, supporting the general point that it brings data together. It does not establish that data come from payers and public health agencies, are aggregated in real time, or that such aggregation was a recommended practice of the review. (LLM, conf=0.84)
Experimental — accuracy not yet measured
- Findingcitation
The INPC provides population-level messages from public health departments to clinicians during localized outbreak events.
“Building upon its Docs4Docs service, the INPC provides population-level messages from public health departments to clinicians during localized outbreak events [26, 27].”
Quote in the paperSubstantial claim1 of 2 sources checked- cites [26] Bender DSK, editor. HL7 FHIR: an agile and RESTful approach to healthcare information exchange. 26th IEEE International Symposium on Computer-Based Medical Systems; 2013. source
- cites [27] Gamache R, Stevens KC, Merriwether R, Dixon BE, Grannis S. Development and Assessment of a Public Health Alert Delivered through a Community Health Information Exchange. Online J Public Health Inf. 2010;2(2). source
The Methods (Public Health Alerting and Alerting Workflow) describe public-health agencies sending alerts through DOCS4DOCS to physicians across a jurisdiction or in targeted areas. The Results describe alerts about local outbreaks. Our copy identifies DOCS4DOCS as an Indiana Health Information Exchange service, but does not identify the alerting service as part of the INPC. (LLM, conf=0.83)
Experimental — accuracy not yet measured
- Findingcitation
The INPC electronically notified infection preventionists in hospitals about a patient's prior infection with a multi-drug resistant organism, enabling rapid identification and isolation of patients who may carry "super-bugs."
“Moreover, the INPC electronically notified infection preventionists in hospitals about a patient’s prior infection with a multi-drug resistant organism [28], enabling rapid identification and isolation of patients who may carry “super-bugs.””
Quote in the paperSubstantial claim1 of 1 sources checked- cites [28] Kho AN, Doebbeling BN, Cashy JP, Rosenman MB, Dexter PR, Shepherd DC, et al. A regional informatics platform for coordinated antibiotic-resistant infection tracking, alerting, and prevention. Clin Infect Dis. 2013;57(2):254–62. source
- Premisecitation
ELR improves the completeness and timeliness of reporting in support of public health surveillance.
“Additional studies from Regenstrief investigators showed that ELR improves the completeness and timeliness of reporting in support of public health surveillance [22, 23].”
Quote in the paperSubstantial claim2 of 2 sources checked- cites [22] Overhage JM, Grannis S, McDonald CJ. A comparison of the completeness and timeliness of automated electronic laboratory reporting and spontaneous reporting of notifiable conditions. Am J Public Health. 2008;98(2):344–50. source
- cites [23] Dixon BE, Zhang Z, Lai PTS, Kirbiyik U, Williams J, Hills R, et al. Completeness and timeliness of notifiable disease reporting: a comparison of laboratory and provider reports submitted to a large county health department. BMC Med Inf Decis Mak. 2017;17(1):87. source
In Results > Timeliness (page not provided), electronic laboratory reports arrived sooner than faxed laboratory or provider reports. But Results > Completeness shows mixed field-level findings and lower average completeness for HIE-ELR reports than for either faxed laboratory or provider reports. This baseline comparison does not establish that ELR improves completeness. (LLM, conf=0.89)
Experimental — accuracy not yet measured
- Premisecitation
HIE infrastructures are ideal for developing registries because they typically curate many records for multiple populations drawn from varied sources across health systems, attenuating the common problem of data fragmentation plaguing retrospective database studies.
“HIE infrastructures are ideal for developing registries because they typically curate many records for multiple populations drawn from varied sources across health systems, attenuating the common problem of data fragmentation plaguing retrospective database studies [33, 34].”
Quote in the paperSubstantial claim1 of 2 sources checked- cites [33] Bourgeois FC, Olson KL, Mandl KD. Patients treated at multiple acute health care facilities: quantifying information fragmentation. Arch Intern Med. 2010;170(22):1989–95. source
- cites [34] Wei WQ, Leibson CL, Ransom JE, Kho AN, Caraballo PJ, Chai HS, et al. Impact of data fragmentation across healthcare centers on the accuracy of a high-throughput clinical phenotyping algorithm for specifying subjects with type 2 diabetes mellitus. J Am Med Inf Assoc. 2012;19(2):219–24. source
Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measured
- Findingcitation
The INPC has supported pioneering work developing and using research data commons.
“The INPC has also supported pioneering work developing and using research data commons, which collocate data, storage, and computing infrastructure with commonly used tools for analyzing and sharing data to create an interoperable resource for the research community [48].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [48] Grossman RL, Heath A, Murphy M, Patterson M, Wells W. Comput Sci Eng. 2016;18(5):10–20. A Case for Data Commons: Toward Data Science as a Service. source
The Abstract (page unavailable) supports the sentence’s definition of data commons as collocating data, computing infrastructure, and tools for an interoperable research resource. The OSDC and OCC Data Commons section describes the OCC’s work, but our copy does not identify the INPC or say it supported that work (searched: INPC and the claim’s wording). (LLM, conf=0.85)
Experimental — accuracy not yet measured
- Premisecitation
CoRDaCo enables easier participation in national collaborations such as the NCATS N3C initiative.
“Important secondary uses of CoRDaCo include easier participation in national collaborations, such as the NCATS N3C initiative [49, 52, 53, 54], which will greatly expand the pool of individuals who can directly access this data.”
Quote in the paperNot a substantial claim3 of 4 sources checked- cites [49] Dixon BE, Grannis SJ, McAndrews C, Broyles AA, Mikels-Carrasco W, Wiensch A, et al. Leveraging data visualization and a statewide health information exchange to support COVID-19 surveillance and response: application of public health informatics. J Am Med Inf Assoc. 2021;28(7):1363–73. source
The Discussion (page unavailable) says standardized INPC data make retrieval efficient and scalable, but it does not address CoRDaCo or participation in national collaborations. Searches for CoRDaCo, NCATS N3C, and national research collaboration found no passage supporting the attributed claim. (LLM, conf=0.74)
Experimental — accuracy not yet measured - cites [52] Haendel MA, Chute CG, Bennett TD, Eichmann DA, Guinney J, Kibbe WA, et al. The National COVID Cohort Collaborative (N3C): Rationale, design, infrastructure, and deployment. J Am Med Inf Assoc. 2021;28(3):427–43. source
- cites [53] Regenstrief Institute I. COVID Dashboard 2020. [Available from: www.regenstrief.org/covid-dashboard/]
Not checked in the free run.
- cites [54] Zidan N, Dey V, Allen K, et al. Understanding comorbidities and health disparities related to COVID-19: a comprehensive study of 776 936 cases and 1 362 545 controls in the state of Indiana, USA. JAMIA Open. 2023;6(1):ooad002. https://doi.org/10.1093/jamiaopen/ooad002. source
The Introduction (Background and significance; page unavailable) describes N3C as a national COVID-19 cohort, and Materials and Methods (page unavailable) describes CoRDaCo as a research data resource. Neither passage says CoRDaCo makes participation in N3C or other national collaborations easier; searches for that connection found no supporting passage. (LLM, conf=0.72)
Experimental — accuracy not yet measured
- Findingnone given
The Health Dart app allows clinicians to retrieve relevant data more efficiently and effectively than the traditional, Web-based viewer for patient data in the INPC (CareWeb).
“The app allows clinicians to retrieve relevant data more efficiently and effectively than the traditional, Web-based viewer for patient data in the INPC (called CareWeb).”
Quote in the paperSubstantial claim - Findingown data
The INPC contains over 16 billion clinical data elements.
“The information in the INPC comprises over 16 billion clinical data elements, such as encounters, lab tests, microbiology, pathology, radiology, cardiology, EKG, pharmacy data, and text reports.”
Quote in the paperNot a substantial claim - Findingreasoning
The INPC supported electronic laboratory reporting (ELR) from near its inception, reporting notifiable diseases from laboratories to public health agencies.
“Nearly from its inception, the INPC supported applications that deliver data and information to public health agencies. One of the first applications was electronic laboratory reporting (ELR), which reports notifiable diseases (e.g., HIV, measles) from laboratories to public health agencies.”
Quote in the paperNot a substantial claim - Findingnone given
By the end of 2023, the INPC contained at least one patient encounter for nearly two-thirds of the population in Indiana's 92 counties.
“By the end of 2023, the INPC contained at least one patient encounter for nearly two-thirds of the population in Indiana’s 92 counties.”
Quote in the paperNot a substantial claim - Findingcitation
By the end of December 2023, over half of the INPC patients were Indiana residents both living and deceased, as well as people who visited from other states such as Illinois, Ohio, Kentucky, and Michigan.
“By the end of December 2023, the network had grown to contain information on nearly 25 million patients, with over half being Indiana residents both living and deceased, as well as people who visited from other states, such as Illinois, Ohio, Kentucky, and Michigan [14].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [14] Services RD. Regenstrief Data Services 2019. [Available from: https://www.regenstrief.org/rds/data/]
Not checked in the free run.
- Findingcitation
The Health Dart app was associated with increased odds of HIE usage (OR: 1.15; CI: 1.02, 1.30; p = 0.026) in a difference-in-difference analysis.
“The App was associated with increased odds of HIE usage (OR: 1.15; CI: 1.02, 1.30; p = 0.026) in a difference-in-difference analysis [32].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [32] Schleyer TKL, Rahurkar S, Baublet AM, Kochmann M, Ning X, Martin DK et al. Preliminary evaluation of the Chest Pain Dashboard, a FHIR-based approach for integrating health information exchange information directly into the clinical workflow. AMIA Jt Summits Transl Sci Proc. 2019;2019:656– 64.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Findingcitation
The INPC was originally designed to support patient care by making it easier to access information from multiple healthcare organizations for a specific patient.
“The INPC was originally designed to support patient care by making it easier to access information from multiple healthcare organizations for a specific patient [19].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [19] McDonald CJ, Overhage JM, Barnes M, Schadow G, Blevins L, Dexter PR, et al. The Indiana network for patient care: a working local health information infrastructure. An example of a working infrastructure collaboration that links data from five health systems and hundreds of millions of entries. Health Aff (Millwood). 2005;24(5):1214–20. source
- Findingown data
The INPC has significantly augmented state registries.
“The INPC has significantly augmented state registries.”
Quote in the paperSubstantial claim - Findingcitation
SHIEC, now CIVITAS Networks for Health, initiated the Patient-Centered Data Home (PCDH) to share data among HIEs across the United States.
“Leveraging the regional positioning of HIEs, the Strategic Health Information Exchange Collaborative (SHIEC), now CIVITAS Networks for Health [47], initiated the Patient-Centered Data Home (PCDH) to share data among HIEs across the United States.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [47] Civitas Networks for Health. 2023. [Available from: https://www.civitasforhealth.org/programs/]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Findingnone given
The INPC supports various diabetes research and development projects using a registry of over one million Type 2 diabetics and 1.7 million controls.
“Further, the INPC supports various diabetes research and development projects using a registry of over one million Type 2 diabetics and 1.7 million controls.”
Quote in the paperNot a substantial claim - Findingcitation
Analysts at Regenstrief matched records from the INPC to the existing Indiana State Cancer Registry and at the beginning of June 2020 had identified an additional 746,311 patients.
“As a result, analysts at Regenstrief matched records from INPC to the existing registry and at the beginning of June 2020 had identified an additional 746,311 patients [14].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [14] Services RD. Regenstrief Data Services 2019. [Available from: https://www.regenstrief.org/rds/data/]
Not checked in the free run.
- Findingcitation
Over the past 20 years, the INPC has evolved to support the goals of population health in addition to patient care.
“Over the past 20 years, the Indiana Network for Patient Care (INPC), a clinical and claims data repository that is operated by Indiana’s Health Information Exchange (IHIE), has evolved to support the goals of population health in addition to patient care [11, 12], thus serving as a laboratory for change and innovation in parallel with evolving health policy.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [11] Overhage J. The Indiana Health Information Exchange. Health Information Exchange: navigating and managing a Network of Health Information Systems. Waltham, MA: Academic; 2016. pp. 267–79. source
- cites [12] Exchange IHI. Indiana Health Information Exchange 2020. [Available from: https://www.ihie.org/].
Not checked in the free run.
- Findingown data
The COVID-19 dashboard aided public health agencies in monitoring population-level hospitalization rates and critical care utilization.
“The dashboard aided public health agencies in monitoring population-level hospitalization rates as well as critical care utilization.”
Quote in the paperSubstantial claim - Findingreasoning
Higher completion rates were reported to the Indiana State Cancer Registry because of the newly identified cases.
“Higher completion rates were reported to the Indiana State Cancer Registry because of the newly identified cases.”
Quote in the paperSubstantial claim - Findingreasoning
The Health Dart app has been deployed at all 15 EDs in the IU Health system.
“Consequently, the app has now been deployed at all 15 EDs in the IU Health system.”
Quote in the paperNot a substantial claim - Findingnone given
In more recent years, the INPC evolved to develop applications that focus on population health and well-being, incorporating non-clinical data into its infrastructure.
“In more recent years, the INPC evolved to develop applications that focus on population health and well-being, incorporating non-clinical data into its infrastructure.”
Quote in the paperSubstantial claim - Findingnone given
Over the pilot year, nearly 8,500,000 admission, discharge, and transfer (ADT) messages were exchanged among HIEs in the Heartland Region.
“Over the pilot year, nearly 8,500,000 admission, discharge, and transfer (ADT) messages were exchanged among HIEs in the Heartland Region.”
Quote in the paperNot a substantial claim - Findingnone given
Based on the INPC, Regenstrief partnered with Indiana-based public health and community organizations to develop the Indiana Network for Population Health (INPH).
“Based on the INPC, Regenstrief partnered with Indiana-based public health and community organizations to develop the Indiana Network for Population Health (INPH).”
Quote in the paperSubstantial claim - Findingcitation
A traumatic brain injury, spinal cord injury, and stroke registry was developed using the INPC.
“An example of this is the traumatic brain injury, spinal cord injury, and stroke registry developed using the INPC [36].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [36] Regenstrief Institute I. Leveraging health information exchange to build a patient registry for traumatic brain injury, spinal cord injury, and stroke 2019. [Available from: www.regenstrief.org/projects/2503/]
Not checked in the free run.
- Findingcitation
Based on this research, Regenstrief Data Services gained access to the Indiana State Cancer Registry.
“Based on this research, RDS also gained access to the Indiana State Cancer Registry [14].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [14] Services RD. Regenstrief Data Services 2019. [Available from: https://www.regenstrief.org/rds/data/]
Not checked in the free run.
- Findingown data
A laboratory experiment showed that the Health Dart app reduced the number of clicks from 50 to 6 and search time from 3 min to 10 s, compared to existing methods for accessing the same information.
“A laboratory experiment showed that the app reduced the number of clicks from 50 to 6 and search time from 3 min to 10 s, compared to existing methods for accessing the same information.”
Quote in the paperNot a substantial claim - Findingcitation
A registry was created for individuals tested for sexually transmitted infection.
“Similarly, a registry was created for individuals tested for sexually transmitted infection [39].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [39] Dixon BET, Wang G, Tu J, Hoover W, Zhang S, Batteiger Z, Arno TA. An Integrated Surveillance System to Examine Testing, Services, and outcomes for sexually transmitted diseases. Stud Health Technol Inform. 2017;245:361–5.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Findingown data
By February 2023, CoRDaCo contained data for 1,858,220 patients infected with COVID-19.
“Work to create CoRDaCo has been underway since early April 2020 and by February 2023 contained data for 1,858,220 patients infected with COVID-19.”
Quote in the paperNot a substantial claim - Findingcitation
A partnership among Roche Diabetes Care GmbH, IBM, Eli Lilly and Company, the Regenstrief Institute, and the Indiana Biosciences Research Institute developed a predictive algorithm identifying patients at risk for chronic kidney disease.
“For example, a partnership among Roche Diabetes Care GmbH, IBM, Eli Lilly and Company, the Regenstrief Institute, and the Indiana Biosciences Research Institute developed a predictive algorithm identifying patients at risk for chronic kidney disease [43].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [43] Ravizza S, Huschto T, Adamov A, Bohm L, Busser A, Flother FF, et al. Predicting the early risk of chronic kidney disease in patients with diabetes using real-world data. Nat Med. 2019;25(1):57–9. source
- Findingnone given
Creating a curated collection of standardized COVID-19-related data elements allows Regenstrief's data analysts to create study-specific data sets more rapidly than previously feasible.
“In addition, creating a curated collection of standardized COVID-19-related data elements allows Regenstrief’s data analysts to create study-specific data sets more rapidly than previously feasible.”
Quote in the paperNot a substantial claim - Findingown data
The dashboard identified major differences in hospitalization rates among non-white populations in specific Indiana counties and zip codes.
“It further supported community-level discussions about resource sharing and disparities and identified major differences in hospitalization rates among non-white populations in specific counties and zip codes.”
Quote in the paperNot a substantial claim- Rests on an assumption: The COVID-19 dashboard's data accurately reflect population-level hospitalization rates and disparities across Indiana.
- Findingreasoning
Through the IADC, stakeholders across Indiana have partnered to lower barriers to access clinical and non-clinical data elements to enable research, interventions, and health and healthcare improvement.
“Through the IADC, stakeholders across the state have partnered to lower barriers to access clinical and non-clinical data elements to enable research, interventions, and health and healthcare improvement.”
Quote in the paperSubstantial claim - Findingnone given
In the Indiana Addiction Data Commons (IADC), patient health information and demographics were aggregated with other data such as criminal justice, socioeconomic status, and environmental factors to help manage substance use disorder (SUD).
“For example, in the Indiana Addiction Data Commons (IADC), patient health information and demographics were aggregated with other data such as criminal justice, socioeconomic status, and environmental factors to help manage substance use disorder (SUD).”
Quote in the paperSubstantial claim - Findingnone given
INPC data provided to ACOs vary depending on the organization's needs and capabilities.
“INPC data provided to ACOs vary depending on the organization and its needs as well as its capabilities.”
Quote in the paperNot a substantial claim - Interpretationreasoning
Community HIEs can support partnerships among clinical, industry, and research organizations.
“The latter two projects illustrate how community HIEs can support partnerships among clinical, industry, and research organizations.”
Quote in the paperSubstantial claim - Interpretationcitation
This sexually transmitted infection registry enables examination of provider adherence to testing guidelines and health services for those tested or treated for a sexually transmitted infection.
“This registry enables examination of provider adherence to testing guidelines and health services for those tested or treated for a sexually transmitted infection [40–[42].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [40–[42]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
The INPC is one of the most mature and largest HIEs in the United States.
“As one of the most mature and largest HIEs in the United States, the INPC’s experience helps illuminate the process and benefits of this evolution for both its patients and population health [13].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [13] Exchange IHI. Indiana Health Information Exchange 2017. [Available from: https://www.ihie.org/wp-content/uploads/2017/05/IHIE-Overview_March-2017.pdf]
Not checked in the free run.
- Interpretationreasoning
The more comprehensive information collected by HIEs can help care become more health focused.
“In contrast, the more comprehensive information collected by HIEs can help care become more health focused.”
Quote in the paperSubstantial claim - Interpretationnone given
The pre-existing data commons infrastructure enabled rapid development of the COVID-19 dashboard.
“The pre-existing data commons infrastructure enabled rapid development of the dashboard.”
Quote in the paperSubstantial claim - Premisecitation
Collectively within organizations like CIVITAS, more than 95% of the US population is represented within an HIE.
“Collectively within organizations like CIVITAS, more than 95% of the US population is represented within an HIE [47].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [47] Civitas Networks for Health. 2023. [Available from: https://www.civitasforhealth.org/programs/]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
Participation in ACOs expands HIE breadth due to electronic data sharing with more partner types.
“Participation in ACOs has also been found to expand HIE breadth due to electronic data sharing with more partner types [55].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [55] Apathy NCHA, Werner RM. Growth in health information exchange with ACO market penetration. Am J Managed Care. 2022;28(1):e7–13. source
- Interpretationnone given
Matching positive test results from various sources with the INPC database enables identification of any COVID-19 positive patient and their health history regardless of the provenance of the test result.
“Positive test results from various sources, including the Indiana State Department of Health, are matched with the INPC database, enabling identification of any COVID-19 positive patient and their health history regardless of the provenance of the test result.”
Quote in the paperSubstantial claim - Interpretationreasoning
HIE information can help calculate quality measures more accurately than previously possible.
“In addition, HIE information can help calculate quality measures more accurately than previously possible.”
Quote in the paperSubstantial claim - Premisecitation
Duplication and costs may be reduced when relevant information such as a recent CT scan result is made available to care managers and clinicians.
“In addition, duplication (and costs) may be reduced when relevant information, such as the results of a recent CT scan, is made available to care managers and clinicians [57].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [57] Kaufman BG, Spivack BS, Stearns SC, Song PH, O’Brien EC. Impact of Accountable Care organizations on utilization, Care, and outcomes: a systematic review. Med Care Res Rev. 2019;76(3):255–90. source
- Interpretationreasoning
HIEs can be a valuable asset for ACOs by providing a more comprehensive record of patients.
“In these ways, HIEs can be a valuable asset for ACOs by providing a more comprehensive record of patients.”
Quote in the paperSubstantial claim - Interpretationnone given
The INPC supports participation in ACOs by providing more complete and comprehensive clinical data than an individual ACO can typically obtain on its own.
“The INPC supports participating in ACOs by providing more complete and comprehensive clinical data than an individual ACO can typically obtain on its own.”
Quote in the paperSubstantial claim - Interpretationreasoning
An HIE is the most likely place to contain a patient's last colonoscopy information due to its longitudinal nature, since a colonoscopy typically occurs every five to ten years.
“Since a colonoscopy typically occurs every five to ten years, an HIE is the most likely place to contain that information due to its longitudinal nature.”
Quote in the paperNot a substantial claim
- Classified as probably not a substantial claim. 35
- May combine two claims. 24
- The quote only partly states this claim. 1
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationStudies have found that HIEs make patient information more available and accessible across organizations and have reduced duplicate testing and imaging and diagnostic discrepancies, lowered costs, and improved patient safety.
“Studies have found that HIEs make patient information more available and accessible across organizations and have reduced duplicate testing and imaging and diagnostic discrepancies, lowered costs, and improved patient safety [5–8].”
Quote in the paperNot a substantial claim2 of 4 sources checked- cites [5] Everson J, Cross DA. Mind the gap: the potential of alternative health information exchange. Am J Manag Care. 2019;25(1):32–8.
- cites [6] Menachemi N, Rahurkar S, Harle CA, Vest JR. The benefits of health information exchange: an updated systematic review. J Am Med Inf Assoc. 2018;25(9):1259–65. source
The Abstract reports fewer duplicated procedures, reduced imaging, lower costs, and improved patient safety; the Discussion describes HIE as providing access to patient information across organizations. The Healthcare Quality section reports improved medication reconciliation, but our copy does not report a reduction in diagnostic discrepancies. That part of the claim is unsupported. (LLM, conf=0.88)
Experimental — accuracy not yet measured - cites [7] Jung HY, Vest JR, Unruh MA, Kern LM, Kaushal R. Use of Health Information Exchange and repeat imaging costs. J Am Coll Radiol. 2015;12(12 Pt B):1364–70. source
The HIE Intervention section describes access to patient information contributed by multiple organizations. The Results report an association between HIE access and less repeat imaging, with estimated imaging cost savings. The paper does not establish reductions in duplicate testing generally or diagnostic discrepancies, nor does it report improved patient safety; the sentence also states the imaging and cost findings more causally than the paper does. (LLM, conf=0.88)
Experimental — accuracy not yet measured - cites [8] Michael Hochman JG, Edmondo J, Robinson. Health Affairs. 2019. Available from: https://www.healthaffairs.org/do/10.1377/hblog20190807.475758/full/.
Not checked in the free run.
May combine two claims.
PremisecitationHIEs have the potential to gather health information for entire populations, presenting opportunities for improving health at a broader level.
“In addition to supporting individual patient care, HIEs have the potential to gather health information for entire populations, presenting opportunities for improving health at a broader level [6, 9].”
Quote in the paperSubstantial claim2 of 2 sources checked- cites [6] Menachemi N, Rahurkar S, Harle CA, Vest JR. The benefits of health information exchange: an updated systematic review. J Am Med Inf Assoc. 2018;25(9):1259–65. source
- cites [9] Beland D, Katapally TR. Shaping Policy Change in Population Health: Policy entrepreneurs, ideas, and institutions. Int J Health Policy Manag. 2018;7(5):369–73. source
The Introduction discusses improving population health through policy, and “Population Health and Policy Entrepreneurs” discusses using research evidence for policy change. Neither addresses whether health information exchanges (HIEs) can gather information for entire populations; searches for HIEs and population-level electronic health information found no relevant passage. (LLM, conf=0.74)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationIn March 2020, health system partners and public health agencies were concerned that a surge in COVID-19 patients might overburden the health system, as had been seen in China and New York City.
“In March 2020, there were concerns among health system partners and public health agencies that a surge in COVID-19 patients might overburden the health system, as seen in China and New York City [50, 51].”
Quote in the paperNot a substantial claim2 of 2 sources checked- cites [50] Sun SXZ, Yu K, Jiang B, Zheng S, Pan X. COVID-19 and healthcare system in China: challenges and progression for a sustainable future. Global Health. 2021;17(1):14. source
- cites [51] Tangcharoensathien VBM, Meng Q, Mills A. Are overwhelmed health systems an inevitable consequence of COVID-19? Experiences from China, Thailand, and New York State. BMJ. 2021;372. source
The ‘Mobilising resources’ section (page unavailable) reports that COVID-19 demand exceeded capacity in New York City and that China rapidly added staff and hospital beds in Wuhan. The ‘Effect of covid-19 on health services’ section (page unavailable) says New York’s health delivery systems were overwhelmed. The paper does not document concerns held by the citing document’s health system partners or public health agencies in March 2020, nor does it explicitly say China’s health system was overwhelmed. (LLM, conf=0.85)
Experimental — accuracy not yet measured
May combine two claims.
FindingcitationThis traumatic brain injury, spinal cord injury, and stroke registry has been used to examine the risk of stroke and the utilization of health services following traumatic brain injury.
“This registry has been used to examine the risk of stroke [37] and the utilization of health services following traumatic brain injury [38].”
Quote in the paperNot a substantial claim1 of 2 sources checked- cites [37] McFarlane TD, Love J, Hanley S, Dixon BE, Hammond FM. Increased risk of Stroke among Young adults with Serious Traumatic Brain Injury. J Head Trauma Rehabil. 2020;35(3):E310–9. source
- cites [38] Eliacin J, Yang Z, Kean J, Dixon BE. Characterizing health care utilization following hospitalization for a traumatic brain injury: a retrospective cohort study. Brain Inj. 2021;35(1):119–29. source
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationSparse data often limit algorithm performance, and more complete data can help improve analytical accuracy.
“Sparse data often limit algorithm performance, and more complete data can help improve analytical accuracy [34, 45, 60].”
Quote in the paperNot a substantial claim3 of 3 sources checked- cites [34] Wei WQ, Leibson CL, Ransom JE, Kho AN, Caraballo PJ, Chai HS, et al. Impact of data fragmentation across healthcare centers on the accuracy of a high-throughput clinical phenotyping algorithm for specifying subjects with type 2 diabetes mellitus. J Am Med Inf Assoc. 2012;19(2):219–24. source
- cites [45] Tarumi S, Takeuchi W, Qi R, et al. Predicting pharmacotherapeutic outcomes for type 2 diabetes: an evaluation of three approaches to leveraging electronic health record data from multiple sources. J Biomed Inform. 2022;129:104001. https://doi.org/10.1016/j.jbi.2022.104001. source
- cites [60] Wang LOJ, Bielinski SJ, St Sauver JL, Fu S, He H, Cicek MS, Hathcock MA, Cerhan JR, Liu H. Impact of Diverse Data sources on computational phenotyping. Front Genet. 2020;3(11):556. source
Probably not a substantial claim: may not pass S2 (checkable).
InterpretationcitationMaintaining and advancing HIE infrastructure and engagement, and aligning policy with those efforts, remains necessary for expanding the reach and impact of community HIEs.
“Maintaining and advancing HIE infrastructure and engagement, and aligning policy with those efforts, remains necessary for expanding the reach and impact of community HIEs [4, 7, 8, 46].”
Quote in the paperNot a substantial claim3 of 4 sources checked- cites [4] Vest JR, Kash BA. Differing strategies to meet information-sharing needs: Publicly Supported Community Health Information Exchanges Versus Health Systems’ Enterprise Health Information exchanges. Milbank Q. 2016;94(1):77–108. source
The Discussion (Policy Implications; page not provided) recommends policy that could fund and require provider connectivity to community HIEs, supporting the claim’s focus on engagement and policy alignment. The Conclusions say community HIEs *may require* public funding and regulation for sustainability; they do not establish the stronger claim that maintaining and advancing infrastructure and engagement is necessary to expand their reach and impact. (LLM, conf=0.78)
Experimental — accuracy not yet measured - cites [7] Jung HY, Vest JR, Unruh MA, Kern LM, Kaushal R. Use of Health Information Exchange and repeat imaging costs. J Am Coll Radiol. 2015;12(12 Pt B):1364–70. source
The Discussion (page unavailable) supports investment in HIE and says further study is warranted as HIE becomes more widely implemented and providers gain experience. It does not establish that continued infrastructure development, engagement, and policy alignment are necessary to expand community HIEs’ reach and impact; that wording turns a tentative possibility into a requirement. (LLM, conf=0.82)
Experimental — accuracy not yet measured - cites [8] Michael Hochman JG, Edmondo J, Robinson. Health Affairs. 2019. Available from: https://www.healthaffairs.org/do/10.1377/hblog20190807.475758/full/.
Not checked in the free run.
- cites [46] Williams KS, Grannis SJ. Patient-centered data homes: a path towards national interoperability. Front Digit Health. 2022;4. source
May combine two claims.
InterpretationcitationVendor-based and proprietary HIEs have the potential to advance the use of non-clinical data, but their capabilities to address local community priorities are likely limited.
“While vendor-based and proprietary HIEs have the potential to advance the use of non-clinical data [4], their capabilities to address local community priorities are likely to be limited.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [4] Vest JR, Kash BA. Differing strategies to meet information-sharing needs: Publicly Supported Community Health Information Exchanges Versus Health Systems’ Enterprise Health Information exchanges. Milbank Q. 2016;94(1):77–108. source
The citation is attached to the claim that vendor-based and proprietary HIEs could advance use of non-clinical data. The Results describe vendor-mediated exchange and enterprise HIEs’ use of aggregated clinical information, but the passages found do not address their potential to use non-clinical data (searched: non-clinical data, nonclinical data, and social determinants). The statement about local community priorities appears after the citation and is not the point attributed to this source. (LLM, conf=0.74)
Experimental — accuracy not yet measured
May combine two claims.
Findingown dataBy December 2023, the INPC contained nearly 25 million patients, a significant growth from 3.5 million in 2004.
“By December 2023, the INPC contained nearly 25 million patients, a significant growth from 3.5 million in 2004.”
- Also stated in: § Growth of the Indiana network for patient care · plain
“By the end of December 2023, the network had grown to contain information on nearly 25 million patients”
Quote in the paperSubstantial claim- Also stated in: § Growth of the Indiana network for patient care · plain
The quote only partly states this claim.
FindingcitationDuring the pilot project phase from September 2017 through March 2018, clinicians at the intervention ED site used HIE significantly more (10.55%) than at other EDs (3.2%) during the study period (p < 0.001).
“The study found that clinicians at the intervention ED site used HIE significantly more (10.55%) than at other EDs (3.2%) during the study period (p < 0.001) [ [30, 32]].”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [30] Halamka JD, Osterland C, Safran C. CareWeb, a web-based medical record for an integrated health care delivery system. Int J Med Inf. 1999;54(1):1–8. source
- cites [32] Schleyer TKL, Rahurkar S, Baublet AM, Kochmann M, Ning X, Martin DK et al. Preliminary evaluation of the Chest Pain Dashboard, a FHIR-based approach for integrating health information exchange information directly into the clinical workflow. AMIA Jt Summits Transl Sci Proc. 2019;2019:656– 64.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Findingown dataIn qualitative interviews, clinicians rated the usefulness of the Health Dart application as very high but identified several opportunities for improvement.
“In qualitative interviews, clinicians rated the usefulness of the application as very high but identified several opportunities for improvement.”
Quote in the paperNot a substantial claimMay combine two claims.
FindingcitationINPC data are primarily gathered from and used in healthcare settings, but their use for population health management and research is increasing.
“INPC data are primarily gathered from and used in healthcare settings, but their use for population health management and research is increasing [11, 17].”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [11] Overhage J. The Indiana Health Information Exchange. Health Information Exchange: navigating and managing a Network of Health Information Systems. Waltham, MA: Academic; 2016. pp. 267–79. source
- cites [17] Institute ICaTS. Data Sources 2019. [Available from: http://indianactsi.org/researchers/services-tools/translational-informatics/data-core/data-sources/]
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingnone givenIHIE offers a 17-year-old clinical messaging service (Docs4Docs) that delivers laboratory and imaging results to primary care providers and specialists.
“IHIE further offers a 17-year-old clinical messaging service (Docs4Docs) that delivers laboratory and imaging results to primary care providers and specialists.”
Quote in the paperNot a substantial claimMay combine two claims.
FindingreasoningAdditional records from the INPC strengthened the sickle cell disease registry and enabled the state health department to secure additional funding for sickle cell disease surveillance.
“The additional records strengthened the registry and enabled the state health department to secure additional funding for sickle cell disease surveillance, which significantly impacts the African American population living in Indiana.”
Quote in the paperNot a substantial claimMay combine two claims.
FindingcitationIn 2015, linking INPC patients to the Indiana State Cancer Registry using probabilistic matching found that approximately 89% of patients with longitudinal records in the registry were matched, and additional cancer patients present in the INPC but not in the registry were identified.
“For example, in 2015, researchers linked INPC patients to the Indiana State Cancer Registry using probabilistic matching to determine the completeness of the registry [35]. Approximately 89% of the patients with longitudinal records in the registry were matched, and additional cancer patients present in the INPC but not in the registry were identified.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [35] Ruppert LP, He J, Martin J, Eckert G, Ouyang F, Church A, et al. Linkage of Indiana State Cancer Registry and Indiana Network for Patient Care Data. J Registry Manag. 2016;43(4):174–8.
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingnone givenIHIE supports a web-based application (INPC CareWeb) to view integrated medical records from providers across the state.
“For example, IHIE supports a web-based application (INPC CareWeb) to view integrated medical records from providers across the state.”
Quote in the paperNot a substantial claimMay combine two claims.
FindingcitationIHIE, through the INPC, supports broad data types as well as longitudinal records to track disease progression, treatment, and outcomes, reducing data fragmentation that is common in retrospective data-based studies.
“For example, IHIE, through the INPC, and like other HIEs supports broad data types as well as longitudinal records to track disease progression, treatment, and outcomes, reducing data fragmentation that is common in retrospective data-based studies as mentioned above [33–[35].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [33–[35]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim.
Findingnone givenThere is no comprehensive synthesis on the capabilities of the INPC.
“Although there are several manuscripts that describe services and individual research studies supported by the INPC, there is no comprehensive synthesis on the capabilities of the INPC.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
Findingnone givenThere is no recent review of the population health services developed and implemented by the INPC over the past two decades.
“Moreover, there is no recent review of the population health services developed and implemented by the INPC over the past two decades.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationCommunity HIEs typically do not integrate work and data flows directly with EHRs in health care practices and other organizations, resulting in workflow inefficiencies, increased information retrieval effort, and cognitive friction.
“Community HIEs typically do not integrate work and data flows directly with electronic health records (EHRs) in health care practices and other organizations. This lack of integration forces clinicians to access HIE data using a system separate from their EHR, resulting in workflow inefficiencies, increased information retrieval effort, and cognitive friction [30].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [30] Halamka JD, Osterland C, Safran C. CareWeb, a web-based medical record for an integrated health care delivery system. Int J Med Inf. 1999;54(1):1–8. source
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe study adhered to the guidelines of the Declaration of Helsinki.
“This study also adhered to the guidelines of the Declaration of Helsinki.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductreasoningThe study was deemed non-human subjects research; ethics approval and informed consent were deemed unnecessary, not applicable, and waived according to national regulations by Indiana University's Institutional Review Board.
“This study was deemed non-human subjects research; therefore ethics approval and informed consent were deemed unnecessary, not applicable, and waived according to national regulations by Indiana University’s Institutional Review Board.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Interpretationnone givenAutomated identification of COVID-19-positive patients is an essential function necessary to establish CoRDaCo.
“An essential function necessary to establish CoRDaCo is the automated identification of COVID-19-positive patients.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
InterpretationreasoningThe PCDH process allows comprehensive medical histories to follow patients wherever they seek care.
“The PCDH process allows comprehensive medical histories to follow patients wherever they seek care.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable). May combine two claims.
InterpretationreasoningThe example of the INPC can increase understanding of the benefits of these new directions and serve as a model for other HIEs making similar transitions.
“The example of the INPC can increase understanding of the benefits of these new directions and serve as a model for other HIEs making similar transitions.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
Interpretationnone givenHIEs can play an important role in expanding focus from individual patient care to population health management by expanding their focus on decision-making during individual patient encounters to include understanding population health and using population health data to guide clinical care.
“Health Information Exchanges (HIEs) can play an important role in this process by expanding their focus on decision-making during individual patient encounters to include understanding population health and using population health data to guide clinical care.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataIntegrating HIE data directly with the EHR is feasible and has several benefits.
“The app successfully demonstrated that integrating HIE data directly with the EHR is feasible and has several benefits.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenWorking documents were shared with leadership of the HIE for validation, and edits were made based on feedback following further discussion and consensus among the authors.
“Working documents were shared with leadership of the HIE for validation, and edits were made based on feedback following further discussion and consensus among the authors.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationCommunity HIEs have positive effects on cost savings and care decisions.
“Community HIEs have a particular role in this process since positive effects on cost savings and care decisions have been associated with the community HIEs [10].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [10] Rahurkar S, Vest JR, Menachemi N. Despite the spread of health information exchange, there is little evidence of its impact on cost, use, and quality of care. Health Aff (Millwood). 2015;34(3):477–83. source
May combine two claims.
InterpretationreasoningFor ACOs in Indiana, INPC information supports coordinating care, reducing duplication of services, and calculating quality metrics.
“For ACOs in Indiana, INPC information supports coordinating care, reducing the duplication of services, and calculating quality metrics.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationCoordinated care can help ensure patients receive the right care at the right time while avoiding unnecessary duplication of services and preventing medical errors.
“Coordinated care can help ensure that patients receive the right care at the right time while avoiding unnecessary duplication of services and preventing medical errors [ [56]].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [56] International HLS. HL7 FHIR Release 4 2020. [Available from: https://www.hl7.org/fhir/].
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
Interpretationnone givenMany health systems continue to see data as an asset to be protected rather than a shared resource needed by all organizations caring for the patient.
“In addition, many health systems continue to see data as an asset that needs to be protected rather than an important shared resource that is needed by all of the organizations taking care of the patient.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
InterpretationreasoningCreating and sustaining HIE remains a challenge.
“Creating and sustaining HIE remains a challenge.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
InterpretationreasoningHIE offers a more diverse set of patients and can help support less biased algorithms.
“HIE offers a more diverse set of patients and can help support less biased algorithms.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenImplementation of messaging standards is often suboptimal, with real-world messages failing to adhere to standards even though vendor products pass certification tests.
“Moreover, implementation of messaging standards is often suboptimal, where real-world messages fail to adhere to standards even though vendor products pass certification tests.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
Interpretationnone givenHealth Information Exchanges are essential components for national health data exchange.
“Health Information Exchanges are essential components for national health data exchange and must continue to evolve to remain relevant and sustainable.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningCommunity HIEs can be excellent partners for healthcare delivery systems to advance health and healthcare, which ultimately advances population health.
“Given the continued pressure of the regulatory environment on healthcare providers, community HIEs can be excellent partners for healthcare delivery systems to advance health and healthcare, which ultimately advances population health.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.
Interpretationnone givenFor HIEs to evolve, there must be dedication to building fundamental services, expanding beyond a clinical-care-only focus, and investing in services valuable to stakeholders.
“In order for HIEs to evolve, there has to be a dedication to building the fundamental services, expanding beyond the clinical care only focus, and investing in the services that are valuable to its stakeholders.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
InterpretationreasoningA network of community HIEs could make the vision of transparent and accessible patient information throughout the country (and potentially worldwide) a reality, as the Patient-Centered Data Home initiative has demonstrated.
“As the Patient-Centered Data Home initiative has demonstrated, a network of community HIEs could make the vision of transparent and accessible patient information throughout the country (and, potentially, worldwide) a reality.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
InterpretationreasoningHIEs in a community are more in tune with that community's health priorities and needs.
“Moreover, HIEs in a community are more in tune with that community's health priorities and needs.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationPolicy in the US is moving towards a national HIE with strong subnational units such as states and districts, and the INPC is trending in the same direction as policy.
“Policy in the US is moving towards national HIE with strong subnational units, such as states and districts, while INPC is advanced it is trending in the same direction as policy [58].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [58] National strategy to advance privacy-preserving data sharing and analytics a report by the fast-track action committee on advance privacy-preserving data sharing and analytics networking and information technology research and development subcommittee of the National Science and Technology Council. 2023. https://www.whitehouse.gov/wp-content/uploads/2023/03/National-Strategy-to-Advance-Privacy-Preserving-Data-Sharing-and-Analytics.pdf.
Not checked in the free run.
Probably not a substantial claim: may not pass S4 (based). May combine two claims.
Interpretationnone givenVendor-based models leave out latency due to standards and have a non-population focus.
“The vendor-based models leave out latency due to standards and have a non-population focus.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationreasoningMore complete and comprehensive information allows ACOs to achieve the Triple Aim objectives more efficiently and effectively than previously possible.
“More complete and comprehensive information allows ACOs to achieve the Triple Aim objectives of delivering the right care at the right time, reducing unnecessary duplication, and preventing medical errors more efficiently and effectively than previously possible.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
Interpretationnone givenMany places lack HIEs with population health capabilities like the INPC.
“Many places lack HIEs with population health capabilities like the INPC.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
Interpretationnone givenHIEs are agnostic to the type of data they include and the organizations providing the data.
“HIEs have the advantage of being agnostic to the type of data they include and the organizations providing the data.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationreasoningHIEs can combine health-related with non-health-related data, for instance connecting patient populations with their sociodemographic or environmental context.
“Thus, HIEs can combine health-related with non-health-related data, for instance, to connect patient populations with their sociodemographic or environmental context.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
Interpretationnone givenHIEs can support sophisticated clinical decision support interventions that may be difficult or impossible to implement in traditional EHR frameworks.
“HIEs can also support sophisticated clinical decision support interventions that may be difficult or impossible to implement in traditional EHR frameworks.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
Interpretationnone givenAlgorithms developed within a single hospital or health system may be overfitted to that population or biased towards unique characteristics of the patient population seeking care in that health system.
“Additionally, algorithms developed within a single hospital or health system may potentially be overfitted to that population or biased towards unique characteristics of the patient population seeking care in that health system.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable). May combine two claims.
InterpretationreasoningThe example of the INPC can increase understanding of the benefits of these new directions and serve as a model for other HIEs evolving along similar trajectories.
“The example of the INPC can increase understanding of the benefits of these new directions and serve as a model for other HIEs evolving along similar trajectories.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenIn the US, many implementations continue to rely on proprietary terminologies with limited translation to international standards, despite policies encouraging standards and interoperability.
“In the US, policies encourage the use of standards and interoperability, yet many implementations continue to rely on proprietary terminologies with limited translation to international standards.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenHIEs have a model that allows for non-standardized health information exchange compared with vendor-based standards-based exchange.
“HIEs have a model that allows for non-standardized health information exchange compared with that of the standard-based health information exchange of vendors.”
Quote in the paperNot a substantial claim
The paper relies on this without support.
The COVID-19 dashboard's data accurately reflect population-level hospitalization rates and disparities across Indiana.
“It further supported community-level discussions about resource sharing and disparities and identified major differences in hospitalization rates among non-white populations in specific counties and zip codes.”
Cites
The National COVID Cohort Collaborative (N3C): Rationale, design, infrastructure, and deployment
Haendel, M. A., Chute, C. G., Bennett, T. D., Eichmann, D. A., Guinney, J., Kibbe, W. A., Payne, P. R. O., Pfaff, E. R., Robinson, P. N., Saltz, J. H., et al. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa196 · Cited by 553 · see citing works
HL7 FHIR: An Agile and RESTful approach to healthcare information exchange
Bender, D., & Sartipi, K. (2013) · Proceedings of the 26th IEEE International Symposium on Computer-Based Medical Systems · doi:10.1109/cbms.2013.6627810 · Cited by 540 · see citing works
The Indiana Network For Patient Care: A Working Local Health Information Infrastructure
McDonald, C. J., Overhage, J. M., Barnes, M., Schadow, G., Blevins, L., Dexter, P. R., Mamlin, B., & the INPC Management Committee (2005) · Health Affairs · doi:10.1377/hlthaff.24.5.1214 · Cited by 330 · see citing works
The benefits of health information exchange: an updated systematic review
Menachemi, N., Rahurkar, S., Harle, C. A., & Vest, J. R. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy035 · Cited by 226 · see citing works
Self-citationCOVID-19 and healthcare system in China: challenges and progression for a sustainable future
Sun, S., Xie, Z., Yu, K., Jiang, B., Zheng, S., & Pan, X. (2021) · Globalization and Health · doi:10.1186/s12992-021-00665-9 · Cited by 191 · see citing works
Overhage, J. M., Grannis, S., & McDonald, C. J. (2008) · American Journal of Public Health · doi:10.2105/ajph.2006.092700 · Cited by 179 · see citing works
Self-citationImpact of Accountable Care Organizations on Utilization, Care, and Outcomes: A Systematic Review
Kaufman, B. G., Spivack, B. S., Stearns, S. C., Song, P. H., & O’Brien, E. C. (2019) · Medical Care Research and Review · doi:10.1177/1077558717745916 · Cited by 174 · see citing works
Predicting the early risk of chronic kidney disease in patients with diabetes using real-world data
Ravizza, S., Huschto, T., Adamov, A., Böhm, L., Büsser, A., Flöther, F. F., Hinzmann, R., König, H., McAhren, S. M., Robertson, D. H., et al. (2019) · Nature Medicine · doi:10.1038/s41591-018-0239-8 · Cited by 167 · see citing works
Self-citationPatients Treated at Multiple Acute Health Care Facilities: Quantifying Information Fragmentation
Bourgeois, F. C. (2010) · Archives of Internal Medicine · doi:10.1001/archinternmed.2010.439 · Cited by 140 · see citing works
Rahurkar, S., Vest, J. R., & Menachemi, N. (2015) · Health Affairs · doi:10.1377/hlthaff.2014.0729 · Cited by 133 · see citing works
Self-citationTangcharoensathien, V., Bassett, M. T., Meng, Q., & Mills, A. (2021) · BMJ · doi:10.1136/bmj.n83 · Cited by 122 · see citing works
Wei, W.-Q., Leibson, C. L., Ransom, J. E., Kho, A. N., Caraballo, P. J., Chai, H. S., Yawn, B. P., Pacheco, J. A., & Chute, C. G. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000597 · Cited by 112 · see citing works
Dixon, B. E., Grannis, S. J., McAndrews, C., Broyles, A. A., Mikels-Carrasco, W., Wiensch, A., Williams, J. L., Tachinardi, U., & Embi, P. J. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab004 · Cited by 88 · see citing works
Self-citationBiondich, P., & Grannis, S. J. (2004) · PubMed · Cited by 85 · see citing works
Self-citationTarumi, S., Takeuchi, W., Chalkidis, G., Rodriguez-Loya, S., Kuwata, J., Flynn, M., Turner, K. M., Sakaguchi, F. H., Weir, C., Kramer, H., et al. (2021) · Methods of Information in Medicine · doi:10.1055/s-0041-1728757 · Cited by 84 · see citing works
VEST, J. R., & KASH, B. A. (2016) · The Milbank Quarterly · doi:10.1111/1468-0009.12180 · Cited by 80 · see citing works
A Case for Data Commons: Toward Data Science as a Service
Grossman, R. L., Heath, A., Murphy, M., Patterson, M., & Wells, W. (2016) · Computing in Science & Engineering · doi:10.1109/mcse.2016.92 · Cited by 78 · see citing works
The Indiana Network for Patient Care
Biondich, P., & Grannis, S. J. (2004) · Journal of Public Health Management and Practice · doi:10.1097/00124784-200411001-00013 · Cited by 66 · see citing works
Self-citationUse of Health Information Exchange and Repeat Imaging Costs
Jung, H.-Y., Vest, J. R., Unruh, M. A., Kern, L. M., & Kaushal, R. (2015) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2015.09.010 · Cited by 60 · see citing works
Shaping Policy Change in Population Health: Policy Entrepreneurs, Ideas, and Institutions
Béland, D., & Katapally, T. R. (2018) · International Journal of Health Policy and Management · doi:10.15171/ijhpm.2017.143 · Cited by 57 · see citing works
The Indiana Health Information Exchange
Overhage, J. M. (2016) · Health Information Exchange · doi:10.1016/b978-0-12-803135-3.00027-x · Cited by 47 · see citing works
Dixon, B. E., Zhang, Z., Lai, P. T. S., Kirbiyik, U., Williams, J., Hills, R., Revere, D., Gibson, P. J., & Grannis, S. J. (2017) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-017-0491-8 · Cited by 40 · see citing works
Self-citationCareWeb™, a web-based medical record for an integrated health care delivery system
Halamka, J. D., Osterland, C., & Safran, C. (1999) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(98)00095-1 · Cited by 39 · see citing works
Schleyer, T., Rahurkar, S., Baublet, A. M., et al. (2019) · PubMed · Cited by 28 · see citing works
Self-citationUtilizing an integrated infrastructure for outcomes research: a systematic review
Dixon, B. E., Whipple, E. C., Lajiness, J. M., & Murray, M. D. (2016) · Health Information & Libraries Journal · doi:10.1111/hir.12127 · Cited by 27 · see citing works
Self-citationFalling short: how state laws can address health information exchange barriers and enablers
Schmit, C. D., Wetter, S., & Kash, B. A. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocx122 · Cited by 27 · see citing works
Batteiger, T. A., Dixon, B. E., Wang, J., et al. (2018) · Sexually Transmitted Diseases · doi:10.1097/olq.0000000000000928 · Cited by 25 · see citing works
Self-citationDixon, B. E., Jones, J., & Grannis, S. J. (2013) · American Journal of Infection Control · doi:10.1016/j.ajic.2012.10.022 · Cited by 24 · see citing works
Self-citationKho, A. N., Doebbeling, B. N., Cashy, J. P., Rosenman, M. B., Dexter, P. R., Shepherd, D. C., Lemmon, L., Teal, E., Khokar, S., & Overhage, J. M. (2013) · Clinical Infectious Diseases · doi:10.1093/cid/cit229 · Cited by 23 · see citing works
Gamache, R., Stevens, K. C., Merriwether, R., Dixon, B. E., & Grannis, S. (2010) · Online Journal of Public Health Informatics · doi:10.5210/ojphi.v2i2.3214 · Cited by 20 · see citing works
Self-citation(2016) · PubMed · Cited by 19 · see citing works
Increased Risk of Stroke Among Young Adults With Serious Traumatic Brain Injury
McFarlane, T. D., Love, J., Hanley, S., Dixon, B. E., & Hammond, F. M. (2020) · Journal of Head Trauma Rehabilitation · doi:10.1097/htr.0000000000000539 · Cited by 16 · see citing works
Self-citationLessons learned from the implementation of clinical messaging systems.
Barnes, M. (2007) · PubMed · Cited by 14 · see citing works
Dixon, B. E., Zhang, Z., Arno, J. N., Revere, D., Joseph Gibson, P., & Grannis, S. J. (2020) · Public Health Reports® · doi:10.1177/0033354920914318 · Cited by 14 · see citing works
Self-citationDixon, B. E., Tao, G., Wang, J., et al. (2017) · PubMed · doi:10.3233/978-1-61499-830-3-361 · Cited by 12 · see citing works
Self-citationTarumi, S., Takeuchi, W., Qi, R., Ning, X., Ruppert, L., Ban, H., Robertson, D. H., Schleyer, T., & Kawamoto, K. (2022) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2022.104001 · Cited by 12 · see citing works
Self-citationEnhancing laboratory report contents to improve outpatient management of test results
Chang, K. C., Overhage, J. M., Hui, S. L., et al. (2010) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m3391 · Cited by 11 · see citing works
Provider Adherence to Syphilis Testing Guidelines Among Stillbirth Cases
Ho, Y. A., Allen, K. S., Tao, G., Patel, C. G., Arno, J. N., Broyles, A. A., & Dixon, B. E. (2020) · Sexually Transmitted Diseases · doi:10.1097/olq.0000000000001230 · Cited by 11 · see citing works
Self-citationZidan, N., Dey, V., Allen, K., Price, J., Zappone, S. R., Hebert, C., Schleyer, T., & Ning, X. (2023) · JAMIA Open · doi:10.1093/jamiaopen/ooad002 · Cited by 11 · see citing works
Self-citation(2019) · PubMed · Cited by 10 · see citing works
Impact of Diverse Data Sources on Computational Phenotyping
Wang, L., Olson, J. E., Bielinski, S. J., St. Sauver, J. L., Fu, S., He, H., Cicek, M. S., Hathcock, M. A., Cerhan, J. R., & Liu, H. (2020) · Frontiers in Genetics · doi:10.3389/fgene.2020.00556 · Cited by 10 · see citing works
Eliacin, J., Yang, Z., Kean, J., & Dixon, B. E. (2021) · Brain Injury · doi:10.1080/02699052.2020.1861650 · Cited by 9 · see citing works
Self-citationGrowth in health information exchange with ACO market penetration
(2022) · The American Journal of Managed Care · doi:10.37765/ajmc.2022.88815 · Cited by 6 · see citing works
Patient-Centered Data Home: A Path Towards National Interoperability
Williams, K. S., & Grannis, S. J. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.887015 · Cited by 4 · see citing works
Self-citationRivera, R. L., Hosler, H., Jang, J. H., Schaffer, J. T., Price, J., Vest, J. R., & Schleyer, T. (2023) · ACI Open · doi:10.1055/s-0043-1772583 · Cited by 4 · see citing works
Self-citationOjo, O., Arno, J. N., Tao, G., Patel, C. G., Zhang, Z., Wang, J., Holderman, J. L., & Dixon, B. E. (2020) · International Journal of STD & AIDS · doi:10.1177/0956462420953718 · Cited by 3 · see citing works
Self-citationStatewide System of Electronic Notifiable Disease Reporting From Clinical Laboratories
Effler, P. V., Ching-Lee, M., Bogard, A., Ieong, M.-C., Nekomoto, T., & Jernigan, D. (1999) · JAMA · doi:10.1001/jama.282.19.1845
Flagged first, then by citations
Research works printed but not linked: 2
- Michael Hochman JG, Edmondo J, Robinson. Health Affairs. 2019. Available from: https://www.healthaffairs.org/do/10.1377/hblog20190807.475758/full/. · DOI
- Dixon B. Health Information Exchange: navigating and managing a Network of Health Information Systems. 2nd ed. San Diego: Elsevier Science & Technology; 2022.
Cited by
Sorted by citations
Large Language Model Symptom Identification From Clinical Text: Multicenter Study
McMurry, A., Phelan, D., Dixon, B. E., Geva, A., Gottlieb, D., Jones, J. R., Terry, M., Taylor, D. E., Callaway, H., Manoharan, S., et al. (2025) · Journal of Medical Internet Research · doi:10.2196/72984 · Cited by 20 · see citing works
“Boston Children’s Hospital (BCH), a large Northeastern urban pediatric academic medical center, and the Indiana Health Information Exchange (IHIE) [38,39]”
Self-citationMazurenko, O., Harle, C. A., Musey, P. I., Schleyer, T., Sanner, L. M., & Vest, J. R. (2025) · JAMIA Open · doi:10.1093/jamiaopen/ooaf060 · Cited by 3 · see citing works
“36,38,39 Health Dart will be the platform to deliver our HRSN risk prediction score.”
Self-citationAllen, K. S., Park, S., Price, J., Ning, X., & Schleyer, T. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.105971 · Cited by 2 · see citing works
Self-citationInfluences on Emergency Clinician Use of Health Information Exchange: Interview Study
Dixon, B. E., Ghimire, U., Richter, B., Bowditch, C., Rahurkar, S., Finnell, J. T., & Vest, J. R. (2025) · JMIR Medical Informatics · doi:10.2196/75865 · Cited by 1 · see citing works
“The INPC is managed by the Indiana Health Information Exchange, which has systematically expanded the service area and capabilities of the INPC, integrating longitudinal data from 38 health systems that encompass >100 hospitals with EDs [23,24].”
Self-citationComorbidities in sickle cell disease by age in the Indiana sickle cell data collection (IN-SCDC)
Gatz, J. L., Okolo, A. I., Janson, I. A., et al. (2026) · Hematology · doi:10.1080/16078454.2026.2655477
Self-citationMayfield, C. A., Siegal, R., Tong, L., et al. (2026) · Journal of Public Health Management and Practice · doi:10.1097/phh.0000000000002425
Telehealth Treatment of Anxiety in Patients With Low-Risk Chest Pain in the Emergency Department
Musey, P. I., Kroenke, K., Connors, J. D. N., Stump, T. E., Chernyak, Y., Prather, K., Montgomery, C., & Monahan, P. O. (2026) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2026.4225
- Authors
- Williams, K. S., Rahurkar, S., Grannis, S. J., Schleyer, T. K., & Dixon, B. E.
- Affiliations
- City University of New York (US)
- Regenstrief Institute (US)
- Corresponding author
- Williams, Karmen S.
- Venue
- BMC Medical Informatics and Decision Making
- Published
- 2025-02-24
- Volume
- 25
- Issue
- 1
- Pages
- 97-97
- ISSN
- 1472-6947 (ISSN-L)
- PMC
- PMC11849299
- OpenAlex
- W4407880394
- Semantic Scholar
- cf6de8b64c6fc97724f03a3fa3ed4e2a0f9e861c
- Cited by
- 7
- References
- 47
- Citations by year
- 2026: 3 · 2025: 4
- FWCI
- 5.20
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- BMC Medical Informatics and Decision Making (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- PubMed Central (submittedVersion, cc-by-nc-nd)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- U.S. National Library of Medicine (T15LM012502)
- Agency for Healthcare Research and Quality (R21HS025502)
- National Center for Advancing Translational Sciences (ULI TR002529)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Healthcare Systems and Technology
- Keywords
- health information exchange, population health management, Triple Aim, health data sources, population health surveillance, disease registries, accountable care organizations
- MeSH terms
- Population Health, Population Health Management, Patient Care, Humans, Indiana, Organizational Case Studies, Health Information Exchange
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-19.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-19.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review