The relationship between perceptions of electronic health record usability and clinical importance of social and environmental determinants of health on provider documentation
Open accessAbstract
Social and environmental determinants of health (SEDH) data in the electronic health record (EHR) can be inaccurate and incomplete. Providers are in a unique position to impact this issue as they both obtain and enter this data, however, the variability in screening and documentation practices currently limits the ability to mobilize SEDH data for secondary uses. This study explores whether providers’ perceptions of clinical importance of SEDH or EHR usability influenced data entry by analyzing two relationships: (1) provider charting behavior and clinical consideration of SEDH and (2) provider charting behavior and ease of EHR use in charting. We performed a cross-sectional study using an 11-question electronic survey to assess self-reported practices related to clinical consideration of SEDH elements, EHR usability and SEDH documentation of all staff physicians, identified using administrative listserves, at Penn State Health Hershey Medical Center during September to October 2021. A total of 201 physicians responded to and completed the survey out of a possible 2,478 identified staff physicians (8.1% response rate). A five-point Likert scale from “never” to “always” assessed charting behavior and clinical consideration. Responses were dichotomized as consistent/inconsistent and vital/not vital respectively. EHR usability was assessed as “yes” or “no” responses. Fisher’s exact tests assessed the relationship between charting behavior and clinical consideration and to compare charting practices between different SEDHs. Cumulative measures were constructed for consistent charting and ease of charting. A generalized linear mixed model (GLMM) compared SDH and EDH with respect to each cumulative measure and was quantified using odds ratios (OR) and 95% confidence intervals (CI). Our results show that provider documentation frequency of an SEDH is associated with perceived clinical utility as well as ease of charting and that providers were more likely to consistently chart on SDH versus EDH. Nuances in these relationships did exist with one notable example comparing the results of smoking (SDH) to infectious disease outbreaks (EDH). Despite similar percentages of physicians reporting that both smoking and infectious disease outbreaks are vital to care, differences in charting consistency and ease of charting between these two were seen. Taken as a whole, our results suggest that SEDH quality optimization efforts cannot consider physician perceptions and EHR usability as siloed entities and that EHR design should not be the only target for intervention. The associations found in this study provide a starting point to understand the complexity in how clinical utility and EHR usability influence charting consistency of each SEDH element, however, further research is needed to understand how these relationships intersect at various levels in the SEDH data optimization process.
AI snapshot
Written from the paper’s full text.
TL;DR
In a cross-sectional survey of 201 physicians at Penn State Health Hershey Medical Center, self-reported SEDH charting frequency was associated with perceived clinical importance and, for some elements, ease of EHR charting. Providers were much more likely to consistently chart social determinants of health (SDH) than environmental determinants of health (EDH).
Key findings
- Of 2,478 identified staff physicians, 201 completed the survey (8.1% response rate); 84% were attendings and 63% practiced both inpatient and outpatient medicine.
- Smoking was the only SDH consistently charted by at least half of physicians (78%); 9 of 13 SDHs were considered vital by at least half, with smoking highest at 87%. For EDHs, infectious disease outbreaks were most consistently charted (31%) and most often considered vital (80%), but only 16.4% reported it was easy to chart.
- Perceived clinical importance was significantly associated with consistent charting for all 13 SDHs, but ease of charting was significantly associated only for childcare, employment, insurance, smoking, and refugee status. For EDHs, perceived importance was significantly associated with charting only for infectious disease outbreaks and access to basic appliances; ease of charting was significant only for infectious disease outbreaks.
- The odds of consistently charting at least 1 SDH were 14 times the odds of charting at least 1 EDH (OR = 14.8, 95% CI 8.8–24.9, p < .001); the odds of easily charting at least 1 SDH were 10 times the odds of easily charting at least 1 EDH (OR = 10.8, 95% CI 6.7–17.5, p < .001).
Methods
- Cross-sectional electronic survey of all staff physicians at Penn State Health Hershey Medical Center during September–October 2021, distributed anonymously via administrative listservs; 201 of 2,478 physicians completed the 11-question REDCap survey.
- Charting behavior and clinical consideration were assessed on a five-point Likert scale and dichotomized as consistent/inconsistent and vital/not vital; EHR usability was assessed as yes/no for whether the EHR made documenting each SEDH element easy.
- Fisher’s exact tests assessed relationships between charting behavior and clinical consideration, and cumulative measures were compared for SDH versus EDH using a generalized linear mixed model with a binary distribution, logit link, fixed type effect, and random physician effect; results reported as odds ratios and 95% confidence intervals.
Limitations
- The authors report a low overall response rate of 8%, possible non-response bias, and inability to stratify analyses by medical specialty; they also note the study was conducted at a single academic medical center, limiting generalizability.
- The authors state they could not correlate physician responses with health system-level SEDH data quality or patient outcomes because of low structured documentation modalities and inability to use natural language processing analytics.
- Evident from the text: charting behavior was self-reported rather than extracted from actual EHR documentation, and the cross-sectional design cannot establish causality; the survey also occurred during the COVID-19 pandemic, which the authors suggest may have influenced participation and documentation perceptions.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
21 of 53 cited sources checked · 10 supported · 0 flagged · accuracy not yet measured
- Premisecitation
SEDH data in the electronic health record can be inaccurate and incomplete.
“Social and environmental determinants of health (SEDH) data in the electronic health record (EHR) can be inaccurate and incomplete.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [28] LA Cook, 2021, The quality of social determinants data in the electronic health record: a systematic review, J Am Med Inform Assoc source
- Premisecitation
The usability of EHR data is generally poor.
“consistent with the notion that the usability of EHR data is generally poor [29,30].”
Quote in the paperNot a substantial claim1 of 2 sources checked- cites [29] N Wiebe, 2019, Evaluation of interventions to improve inpatient hospital documentation within electronic health records: a systematic review, J Am Med Inform Assoc source
- cites [30] AA Dhavle, 2016, Analysis of Prescribers’ Notes in Electronic Prescriptions in Ambulatory Practice, JAMA Intern Med source
The paper’s discussion (section labeled “Downloaded From,” page not specified) calls for better EHR and e-prescribing interface design to reduce inappropriate use of free-text prescription notes. That supports a specific usability concern, but the study does not establish that EHR data are generally poor in usability. (LLM, conf=0.84)
Experimental — accuracy not yet measured
- Premisecitation
Inaccuracy and incompleteness have been identified with determinants of health data.
“issues including inaccuracy and incompleteness have been identified with determinants of health data [28]”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [28] LA Cook, 2021, The quality of social determinants data in the electronic health record: a systematic review, J Am Med Inform Assoc source
- Premisecitation
Those who care for vulnerable populations or routinely use social care services are more likely to engage with EHR determinants data.
“those who care for vulnerable populations or routinely use social care services are more likely to engage with EHR determinants data [34].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [34] BE Iott, 2022, Physician awareness of social determinants of health documentation capability in the electronic health record, J Am Med Inform Assoc source
The Results report greater awareness of EHR social-determinants documentation capability among physicians at community health centers, and the Discussion says physicians frequently involved in screening and social care may be more aware. The paper measures awareness, however, not whether these physicians are more likely to engage with or use EHR determinants data; it also presents the link to frequent social care work as a possibility. (LLM, conf=0.88)
Experimental — accuracy not yet measured
- Premisecitation
Negative EHR user experiences in general may result in partial data capture.
“negative EHR user experiences in general may result in partial data capture [29,32,33].”
Quote in the paperSubstantial claim1 of 3 sources checked- cites [29] N Wiebe, 2019, Evaluation of interventions to improve inpatient hospital documentation within electronic health records: a systematic review, J Am Med Inform Assoc source
- cites [32] AJ Johnson, 2009, Cohort study of structured reporting compared with conventional dictation, Radiology source
- cites [33] C Lanier, 2018, What factors influence the use of electronic health records during the first 10 minutes of the clinical encounter?, Int J Gen Med source
The Introduction (page not available) says physicians more readily accept EHRs after positive experiences, and the Discussion says EHR use can vary with expectations and experiences. Neither passage establishes that negative user experiences result in partial data capture; the study measured EHR use during encounters, not completeness of captured data. (LLM, conf=0.76)
Experimental — accuracy not yet measured
- Premisecitation
Provider behaviors for health determinants appear reduced compared to other medical history components.
“these provider behaviors appear reduced for health determinants as compared to other medical history components [26].”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [26] BE Iott, 2023, Characterizing the relative frequency of clinician engagement with structured social determinants of health data, J Am Med Inform Assoc source
- Premisecitation
Mobilizing SEDH data from the EHR is hindered by heterogeneous provider documentation practices and interoperability issues.
“Mobilizing this data from the electronic health record (EHR) is hindered by heterogeneous provider documentation practices and interoperability issues [1,2,9–22].”
Quote in the paperSubstantial claim2 of 10 sources checked- cites [1] BG Patra, 2021, Extracting social determinants of health from electronic health records using natural language processing: a systematic review, J Am Med Inform Assoc source
The Introduction says that unstructured notes and a lack of standardized data elements and collection practices limit access to SDoH information, supporting the documentation-practices part of the claim. The passages in our copy do not identify interoperability issues as a barrier; a search for interoperability and data exchange found no such statement. Page numbers were not available. (LLM, conf=0.86)
Experimental — accuracy not yet measured - cites [2] M Chen, 2020, Social determinants of health in electronic health records and their impact on analysis and risk prediction: A systematic review, J Am Med Inform Assoc source
- cites [9] O’Reilly K. How to improve screening for social determinants of health [Internet]. Chicago,IL. American Medical Association; 2019 [cited 2019 Oct 4]. https://www.ama-assn.org/delivering-care/patient-support-advocacy/how-improve-screening-social-determinants-health.
Not checked in the free run.
- cites [10] ET Masters, 2018, Natural Language Processing-Identified Problem Opioid Use and Its Associated Health Care Costs, J Pain Palliat Care Pharmacother source
- cites [11] Office of Disease Prevention and Health Promotion. About the data. [Internet]. Rockville, MD. Office of Disease Prevention and Health Promotion; 2020 [updated 2020 Feb 19]. https://wayback.archive-it.org/5774/20220413183449/https://www.healthypeople.gov/2020/topics-objectives/topic/social-determinants-health/interventions-resources.
Not checked in the free run.
- cites [12] Robeznieks A. New ICD-10 codes will help physicians tackle social barriers to care [Internet]. Chicago,IL. American Medical Association; 2019 [cited 2019 Apr 2]. https://www.ama-assn.org/practice-management/digital/new-icd-10-codes-will-help-physicians-tackle-social-barriers-care.
Not checked in the free run.
- cites [13] TK Fraze, 2019, Prevalence of Screening for Food Insecurity, Housing Instability, Utility Needs, Transportation Needs, and Interpersonal Violence by US Physician Practices and Hospitals, JAMA Netw Open source
The Methods describe survey data on whether practices and hospitals screen for social needs, while the Discussion describes barriers involving resources, incentives, and time. Neither section addresses heterogeneous EHR documentation practices or interoperability as obstacles to mobilizing SEDH data (searched: electronic health record documentation and interoperability). (LLM, conf=0.73)
Experimental — accuracy not yet measured - cites [14] Office of Disease Prevention and Health Promotion. Healthy People 2030: Social Determinants of Health [Internet]. Rockville, MD. Office of Disease Prevention and Health Promotion; 2020 [updated 2021 Aug 2]. https://health.gov/healthypeople/objectives-and-data/social-determinants-health.
Not checked in the free run.
- cites [15] NE Adler, 2016, Addressing Social Determinants of Health and Health Disparities: A Vital Direction for Health and Health Care, NAM Perspectives
Not checked in the free run.
- cites [16] A Palacio, 2018, Provider Perspectives on the Collection of Social Determinants of Health, Popul Health Manag source
- Premisecitation
Provider engagement with EHR health determinants data is associated with reduced hospital readmission rates.
“Provider engagement (documenting, reviewing and updating information) with EHR health determinants data is associated with reduced hospital readmission rates”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [26] BE Iott, 2023, Characterizing the relative frequency of clinician engagement with structured social determinants of health data, J Am Med Inform Assoc source
- Premisecitation
Providers often use non-structured formats to record health determinants information.
“providers often use non-structured formats to record health determinants information [1,14]”
Quote in the paperSubstantial claim1 of 2 sources checked- cites [1] BG Patra, 2021, Extracting social determinants of health from electronic health records using natural language processing: a systematic review, J Am Med Inform Assoc source
- cites [14] Office of Disease Prevention and Health Promotion. Healthy People 2030: Social Determinants of Health [Internet]. Rockville, MD. Office of Disease Prevention and Health Promotion; 2020 [updated 2021 Aug 2]. https://health.gov/healthypeople/objectives-and-data/social-determinants-health.
Not checked in the free run.
- Premisecitation
Providers are in a unique position to influence the quality of SEDH data in the EHR because they both obtain and enter this data.
“Providers are in a unique position to impact this issue as they both obtain and enter this data”
- Also stated in: § Introduction · plain
“Providers are in a unique position to influence the quality of determinants data within the EHR as they both acquire necessary elements from screening and record information [24,25].”
Quote in the paperSubstantial claim1 of 2 sources checked- cites [24] S Upadhyay, 2022, A Qualitative Analysis of the Impact of Electronic Health Records (HER) on Healthcare Quality and Safety: Clinicians’ Lived Experiences, Health Serv Insights source
The Discussions section says nurses interact frequently with patients and that accurate data entry by different clinical roles matters for care quality. The Conclusions section likewise emphasizes clinicians’ responsibility for accurate EHR notes. Neither passage addresses SEDH data specifically or says providers both obtain and enter that data. (LLM, conf=0.84)
Experimental — accuracy not yet measured - cites [25] H Chen, 2019, Facilitation or Hindrance: Physicians’ Perception on Best Practice Alerts (BPA) Usage in an Electronic Health Record System, Health Commun source
- Also stated in: § Introduction · plain
- Premisecitation
Variability in screening and documentation practices currently limits the ability to mobilize SEDH data for secondary uses.
“the variability in screening and documentation practices currently limits the ability to mobilize SEDH data for secondary uses”
Quote in the paperSubstantial claim2 of 10 sources checked- cites [1] BG Patra, 2021, Extracting social determinants of health from electronic health records using natural language processing: a systematic review, J Am Med Inform Assoc source
- cites [2] M Chen, 2020, Social determinants of health in electronic health records and their impact on analysis and risk prediction: A systematic review, J Am Med Inform Assoc source
- cites [9] O’Reilly K. How to improve screening for social determinants of health [Internet]. Chicago,IL. American Medical Association; 2019 [cited 2019 Oct 4]. https://www.ama-assn.org/delivering-care/patient-support-advocacy/how-improve-screening-social-determinants-health.
Not checked in the free run.
- cites [10] ET Masters, 2018, Natural Language Processing-Identified Problem Opioid Use and Its Associated Health Care Costs, J Pain Palliat Care Pharmacother source
- cites [11] Office of Disease Prevention and Health Promotion. About the data. [Internet]. Rockville, MD. Office of Disease Prevention and Health Promotion; 2020 [updated 2020 Feb 19]. https://wayback.archive-it.org/5774/20220413183449/https://www.healthypeople.gov/2020/topics-objectives/topic/social-determinants-health/interventions-resources.
Not checked in the free run.
- cites [12] Robeznieks A. New ICD-10 codes will help physicians tackle social barriers to care [Internet]. Chicago,IL. American Medical Association; 2019 [cited 2019 Apr 2]. https://www.ama-assn.org/practice-management/digital/new-icd-10-codes-will-help-physicians-tackle-social-barriers-care.
Not checked in the free run.
- cites [13] TK Fraze, 2019, Prevalence of Screening for Food Insecurity, Housing Instability, Utility Needs, Transportation Needs, and Interpersonal Violence by US Physician Practices and Hospitals, JAMA Netw Open source
The Discussion and Conclusions report that screening for social needs varies across physician practices and hospitals. The paper does not establish variability in documentation practices or say that either form of variability limits secondary uses of SEDH data; its Limitations section says the authors do not know how organizations use screening results. Page numbers are unavailable in our copy. (LLM, conf=0.82)
Experimental — accuracy not yet measured - cites [14] Office of Disease Prevention and Health Promotion. Healthy People 2030: Social Determinants of Health [Internet]. Rockville, MD. Office of Disease Prevention and Health Promotion; 2020 [updated 2021 Aug 2]. https://health.gov/healthypeople/objectives-and-data/social-determinants-health.
Not checked in the free run.
- cites [15] NE Adler, 2016, Addressing Social Determinants of Health and Health Disparities: A Vital Direction for Health and Health Care, NAM Perspectives
Not checked in the free run.
- cites [16] A Palacio, 2018, Provider Perspectives on the Collection of Social Determinants of Health, Popul Health Manag source
- Premisecitation
Lacking is an established standardized set of determinants or method of capture to inform care delivery and optimization efforts.
“Lacking is an established standardized set of determinants or method of capture [5,13,14,19] to inform care delivery and optimization efforts.”
Quote in the paperSubstantial claim2 of 4 sources checked- cites [5] EK Cottrell, 2019, Variation in Electronic Health Record Documentation of Social Determinants of Health Across a National Network of Community Health Centers, Am J Prev Med source
- cites [13] TK Fraze, 2019, Prevalence of Screening for Food Insecurity, Housing Instability, Utility Needs, Transportation Needs, and Interpersonal Violence by US Physician Practices and Hospitals, JAMA Netw Open source
The Discussion (page unavailable) says there is little consensus about the best approaches to addressing social needs, and the Conclusions report that most practices and hospitals do not screen across five key needs. This supports a lack of consistent practice, but the paper does not establish that no standardized set of determinants or method of capture exists. The Introduction also notes that professional groups have developed screening tools. (LLM, conf=0.78)
Experimental — accuracy not yet measured - cites [14] Office of Disease Prevention and Health Promotion. Healthy People 2030: Social Determinants of Health [Internet]. Rockville, MD. Office of Disease Prevention and Health Promotion; 2020 [updated 2021 Aug 2]. https://health.gov/healthypeople/objectives-and-data/social-determinants-health.
Not checked in the free run.
- cites [19] MN Cantor, 2018, Integrating Data On Social Determinants Of Health Into Electronic Health Records, Health Aff (Millwood) source
- Findingreasoning
Smoking was considered to be the most vital SDH.
“Unsurprising, smoking was considered to be the most vital SDH.”
Quote in the paperNot a substantial claim - Findingown data
Regarding all SDHs, charting frequency was significantly associated with physician perception of clinical importance.
“Regarding all SDHs, charting frequency was significantly associated with physician perception of clinical importance.”
Quote in the paperSubstantial claim - Findingown data
Physician perception of the ease of charting of an SDH was significantly associated with consistent charting of the SDHs of childcare, employment, insurance, smoking, and refugee status only.
“Physician perception of the ease of charting of an SDH, however, was significantly associated with consistent charting of the SDHs of childcare, employment, insurance, smoking, and refugee status only.”
Quote in the paperSubstantial claim- Rests on an assumption: Self-reported charting behavior accurately reflects actual documentation behavior.
- Rests on an assumption: The 11-question survey validly measures clinical consideration, EHR usability, and charting behavior.
- Rests on an assumption: The 201 respondents are representative of all staff physicians at the study institution.
- Findingown data
68.2% of physicians reported that at least 1 SDH was easy to chart.
“More than half (68.2%) of physicians reported that at least 1 SDH was easy to chart”
Quote in the paperNot a substantial claim - Findingown data
The odds of easily charting at least 1 SDH were 10 times the odds of easily charting at least 1 EDH (OR = 10.8, 95% CI (6.7, 17.5), p < .001).
“The odds of easily charting at least 1 SDH were 10 times the odds of easily charting at least 1 EDH (OR = 10.8, 95% CI (6.7, 17.5), p < .001).”
Quote in the paperSubstantial claim - Findingown data
Providers were more likely to consistently chart on SDH versus EDH.
“providers were more likely to consistently chart on SDH versus EDH.”
- Also stated in: § Discussion and conclusion · plain
“and that providers were more likely to consistently chart on SDH versus EDH.”
Quote in the paperSubstantial claim- Rests on an assumption: Self-reported charting behavior accurately reflects actual documentation behavior.
- Rests on an assumption: The 11-question survey validly measures clinical consideration, EHR usability, and charting behavior.
- Rests on an assumption: The 201 respondents are representative of all staff physicians at the study institution.
- Also stated in: § Discussion and conclusion · plain
- Findingown data
Not every association measured in the study showed statistical significance.
“however, not every association measured in our study showed statistical significance.”
Quote in the paperNot a substantial claim - Findingown data
The percentage of physicians charting on food security (SDH) was higher for those who charted on transportation (SDH) compared to those who did not (34.4% vs. 5.9%, p < 0.001).
“The percentage of physicians charting on food security (SDH) was higher for those who charted on transportation (SDH) compared to those who did not (34.4% vs. 5.9%, p < 0.001).”
Quote in the paperNot a substantial claim - Findingown data
Physician perception of whether an EDH was vital to patient care was significantly associated with consistent charting of the EDH for infectious disease outbreaks and access to basic appliances only.
“Physician perception of whether an EDH was vital to patient care was significantly associated with consistent charting of the EDH for infectious disease outbreaks and access to basic appliances only.”
Quote in the paperSubstantial claim- Rests on an assumption: Self-reported charting behavior accurately reflects actual documentation behavior.
- Rests on an assumption: The 11-question survey validly measures clinical consideration, EHR usability, and charting behavior.
- Rests on an assumption: The 201 respondents are representative of all staff physicians at the study institution.
- Findingown data
Trends in the raw data for these SDHs show that a higher percentage of physicians consistently charted SDHs if they perceived charting to be easy (Table 2).
“However, trends in the raw data for these SDHs do show that a higher percentage of physicians consistently charted SDHs if they perceived charting to be easy (Table 2).”
Quote in the paperNot a substantial claim - Findingown data
Provider documentation frequency of an SEDH is associated with perceived clinical utility as well as ease of charting.
“Our results show that provider documentation frequency of an SEDH is associated with perceived clinical utility as well as ease of charting”
Quote in the paperSubstantial claim- Rests on an assumption: Self-reported charting behavior accurately reflects actual documentation behavior.
- Rests on an assumption: The 11-question survey validly measures clinical consideration, EHR usability, and charting behavior.
- Rests on an assumption: The 201 respondents are representative of all staff physicians at the study institution.
- Findingown data
The percentage charting on household pollution and toxicities (EDH) was higher for those who charted on housing (SDH) compared to those who did not (18.2% vs. 2.2%, p = 0.006).
“The percentage charting on household pollution and toxicities (EDH) was higher for those who charted on housing (SDH) compared to those who did not (18.2% vs. 2.2%, p = 0.006).”
Quote in the paperNot a substantial claim - Findingown data
With regards to EDH, charting frequency was significantly associated with physician perception of clinical importance for infectious disease outbreaks and access to basic appliances only.
“With regards to EDH, charting frequency was significantly associated with physician perception of clinical importance for infectious disease outbreaks and access to basic appliances only.”
Quote in the paperSubstantial claim - Findingown data
Of the 13 SDHs assessed, smoking was the only SDH consistently charted on by at least half of physicians (78%).
“Of the 13 SDHs assessed, smoking was the only SDH that was consistently charted on by at least half of physicians (78%) with all other SDHs being consistently charted on by less than half (Fig 1).”
Quote in the paperNot a substantial claim- Rests on an assumption: Self-reported charting behavior accurately reflects actual documentation behavior.
- Rests on an assumption: The 11-question survey validly measures clinical consideration, EHR usability, and charting behavior.
- Rests on an assumption: The 201 respondents are representative of all staff physicians at the study institution.
- Findingown data
The SDHs reported as vital by less than half of physicians were education (46%), refugee status (43%), housing (49%) and access to guns in the household (40%).
“The SDHs that were reported by less than half were education (46%), refugee status (43%), housing (49%) and access to guns in the household (40%) (Fig 1.).”
Quote in the paperNot a substantial claim- Rests on an assumption: Self-reported charting behavior accurately reflects actual documentation behavior.
- Rests on an assumption: The 11-question survey validly measures clinical consideration, EHR usability, and charting behavior.
- Rests on an assumption: The 201 respondents are representative of all staff physicians at the study institution.
- Findingown data
Charting frequency was significantly associated with ease of charting for all SDHs except for housing, transportation, utilities, education, financial stability, personal safety, and access to guns.
“Charting frequency was significantly associated with ease of charting for all SDHs except for housing, transportation, utilities, education, financial stability, personal safety, and access to guns.”
Quote in the paperSubstantial claim - Findingown data
34.3% of physicians consistently charted on at least 1 EDH.
“whereas fewer charted on at least 1 EDH (34.3%)”
Quote in the paperSubstantial claim - Findingown data
The percentage charting on access to guns in the household (SDH) was higher for those who charted on personal safety (SDH) compared to those who did not (50.0% vs. 8.4%, p < 0.001).
“The percentage charting on access to guns in the household (SDH) was higher for those who charted on personal safety (SDH) compared to those who did not (50.0% vs. 8.4%, p < 0.001).”
Quote in the paperNot a substantial claim - Findingown data
88.1% of physicians consistently charted on at least 1 SDH.
“A majority of physicians consistently charted on at least 1 SDH (88.1%)”
Quote in the paperNot a substantial claim - Findingown data
The percentage charting on refugee status (SDH) was higher for those who charted on exposure to natural disasters (EDH) compared to those who did not (100% vs. 7.7%, p < 0.001).
“The percentage charting on refugee status (SDH) was higher for those who charted on exposure to natural disasters (EDH) compared to those who did not (100% vs. 7.7%, p < 0.001).”
Quote in the paperNot a substantial claim - Findingown data
The reported ease of charting for smoking was higher than most other SDHs and EDHs (Fig 1).
“What was notable was that the reported ease of charting for smoking was also higher than most other SDHs and EDHs (Fig 1).”
Quote in the paperSubstantial claim - Findingown data
Physician perception of the ease of charting of an EDH was significantly associated with consistent charting of the EDH of infectious disease outbreaks only.
“Physician perception of the ease of charting of an EDH was significantly associated with consistent charting of the EDH of infectious disease outbreaks only.”
Quote in the paperSubstantial claim- Rests on an assumption: Self-reported charting behavior accurately reflects actual documentation behavior.
- Rests on an assumption: The 11-question survey validly measures clinical consideration, EHR usability, and charting behavior.
- Rests on an assumption: The 201 respondents are representative of all staff physicians at the study institution.
- Findingown data
Physician perception of whether an SDH was vital to patient care was significantly associated with consistent charting of that SDH for all SDHs assessed.
“Physician perception of whether an SDH was vital to patient care was significantly associated with consistent charting of that SDH for all SDHs assess.”
Quote in the paperSubstantial claim- Rests on an assumption: Self-reported charting behavior accurately reflects actual documentation behavior.
- Rests on an assumption: The 11-question survey validly measures clinical consideration, EHR usability, and charting behavior.
- Rests on an assumption: The 201 respondents are representative of all staff physicians at the study institution.
- Findingown data
9 out of the 13 SDHs assessed were considered vital by over half of respondents.
“with 9 out of the 13 SDHs assessed being considered vital by over half of respondents.”
Quote in the paperNot a substantial claim - Findingown data
Charting frequency was significantly associated with ease of charting for the EDH of infectious disease outbreaks only.
“Charting frequency was significantly associated with ease of charting for the EDH of infectious disease outbreaks only.”
Quote in the paperNot a substantial claim - Findingown data
The odds of consistently charting on at least 1 SDH were 14 times the odds of charting on at least 1 EDH (OR = 14.8, 95% CI (8.8, 24.9), p < .001).
“The odds of consistently charting on at least 1 SDH were 14 times the odds of charting on at least 1 EDH (OR = 14.8, 95% CI (8.8, 24.9), p < .001).”
Quote in the paperSubstantial claim - Findingown data
18.4% of physicians reported ease in charting at least 1 EDH.
“compared to 18.4% of physicians who reported ease in charting at least 1 EDH”
Quote in the paperSubstantial claim - Findingown data
Less than 5% of physicians consistently charted on the other 6 EDHs.
“Less than 5% of physicians consistently charted on the other 6 EDHs (Fig 2).”
Quote in the paperNot a substantial claim- Rests on an assumption: Self-reported charting behavior accurately reflects actual documentation behavior.
- Rests on an assumption: The 11-question survey validly measures clinical consideration, EHR usability, and charting behavior.
- Rests on an assumption: The 201 respondents are representative of all staff physicians at the study institution.
- Findingown data
Trends in the raw EDH data show that a higher percentage of physicians consistently charted on EDHs if they perceived the EDH to be vital or easy to chart (Table 3).
“However, just as with SDH, trends in the raw EDH data do show that a higher percentage of physicians consistently charted on EDHs if they perceived the EDH to be vital or easy to chart (Table 3).”
Quote in the paperNot a substantial claim - Findingown data
43%-87% of physicians considered an SDH as vital to their patient care.
“Overall, 43%-87% of physicians considered an SDH as vital to their patient care”
Quote in the paperNot a substantial claim - Findingown data
The EDH of infectious disease outbreaks was considered to be the most vital to practice (80%) as compared to all other EDHs.
“Though the EDH of infectious disease outbreaks was considered to be the most vital to practice (80%) as compared to all other EDHs”
Quote in the paperNot a substantial claim - Findingown data
Smoking was the only SDH that was consistently charted on by greater than half of physicians.
“smoking was the only SDH that was consistently charted on by greater than half of physicians”
Quote in the paperSubstantial claim - Findingown data
42-80% of physicians considered an EDH as vital to their patient care.
“As compared to SDH, a similar percentage of physicians (42–80%) considered an EDH as vital to their patient care”
Quote in the paperNot a substantial claim - Findingown data
3 out of 7 EDHs were considered vital by over half of respondents.
“with 3 out of 7 being considered vital by over half of respondents.”
Quote in the paperNot a substantial claim - Findingown data
The rate of consistent charting of infectious disease outbreaks was relatively low (31%).
“the relatively low rates of consistent charting of this EDH (31%) was surprising”
Quote in the paperSubstantial claim - Findingown data
Our data shows discrepancies in provider considerations between SDH and EDH.
“Our data also shows discrepancies in provider considerations between SDH and EDH.”
Quote in the paperSubstantial claim - Findingown data
No EDH was consistently charted on by greater than half of physicians.
“and no EDH was consistently charted on by greater than half.”
Quote in the paperSubstantial claim - Findingown data
There is a difference in the reported ease of charting for smoking as compared to all other SEDHs.
“It is surprising, therefore, to see in our data a difference in the reported ease of charting for smoking as compared to all other SEDHs.”
Quote in the paperSubstantial claim - Findingown data
Less than half of physicians in all departments (with the exception of Psychiatry and Pathology) reported charting on infectious disease outbreaks.
“Less than half of physicians in all departments (with the exception of Psychiatry and Pathology) reported charting on infectious disease outbreaks.”
Quote in the paperSubstantial claim - Interpretationown data
Taken as a whole, the results suggest that SEDH quality optimization efforts cannot consider physician perceptions and EHR usability as siloed entities.
“Taken as a whole, our results suggest that SEDH quality optimization efforts cannot consider physician perceptions and EHR usability as siloed entities”
Quote in the paperNot a substantial claim- Rests on an assumption: Self-reported charting behavior accurately reflects actual documentation behavior.
- Rests on an assumption: The 11-question survey validly measures clinical consideration, EHR usability, and charting behavior.
- Rests on an assumption: The 201 respondents are representative of all staff physicians at the study institution.
- Interpretationreasoning
The lack of statistical significance for SDH ease-of-charting associations is likely due to the low overall numbers of respondents who reported that SDH charting was easy.
“The lack of statistical significance could be likely due to the low overall numbers of respondents who reported that SDH charting was easy.”
Quote in the paperNot a substantial claim - Interpretationown data
Frequency of charting of an SEDH is associated with physician perception of clinical importance or EHR usability.
“Generally, our data supports our hypothesis that frequency of charting of an SEDH is associated with physician perception of clinical importance or EHR usability”
Quote in the paperSubstantial claim - Interpretationown data
Lack of statistical significance for EDH associations is likely due to the overall low numbers of those who reported consistently charting on EDH.
“Lack of statistical significance for EDH associations is likely due to the overall low numbers of those who reported consistently charting on EDH.”
Quote in the paperSubstantial claim - Interpretationown data
There were notable differences in charting consistency and ease of charting between smoking (SDH) and infectious disease outbreaks (EDH).
“there were still notable differences in charting consistency and ease of charting between these two.”
Quote in the paperSubstantial claim - Interpretationown data
For the SDH of smoking, charting difficulty was less of an issue.
“Our data suggests that for the SDH of smoking, charting difficulty was less of an issue”
Quote in the paperSubstantial claim- Rests on an assumption: The process for charting on smoking would have been the same as for any other SDH or EDH for a particular provider.
- Interpretationown data
SEDH provider documentation is inconsistent.
“Our results show that SEDH provider documentation is inconsistent”
Quote in the paperSubstantial claim - Interpretationreasoning
The slightly higher reported rates of ease of charting on infectious disease outbreaks suggest that EHR design may not be the only factor that influences physician documentation.
“As with smoking, the slightly higher reported rates of ease of charting on this EDH suggests that EHR design may not be the only factor that influences physician documentation.”
Quote in the paperSubstantial claim - Interpretationown data
Despite using an expanded list of EDHs, the low rates of EDH charting or reported ease of charting was likely not due to reduced perceived clinical importance (Fig 1).
“Despite using an expanded list of EDHs, the low rates of EDH charting or reported ease of charting was likely not due to reduced perceived clinical importance (Fig 1).”
Quote in the paperSubstantial claim - Study design and conductreasoning
The low response resulted in our inability to stratify analyses by medical specialty.
“This low response resulted in our inability to stratify analyses by medical specialty.”
Quote in the paperNot a substantial claim - Study design and conductnone given
This study was conducted at a single academic medical center, possibly limiting the generalizability of the results.
“Second, this study was conducted at a single academic medical center, possibly limiting the generalizability of the results.”
Quote in the paperNot a substantial claim - Study design and conductreasoning
We were unable to correlate physician responses to a health system level assessment of SEDH data quality or patient outcomes secondary to low structured documentation modalities and an inability to utilize natural language processing analytics for this particular study.
“Finally, we were unable to correlate physician responses to a health system level assessment of SEDH data quality or patient outcomes secondary to low structured documentation modalities and an inability to utilize natural language processing analytics for this particular study.”
Quote in the paperNot a substantial claim
- Classified as probably not a substantial claim. 18
- May combine two claims. 13
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationStructured data entry can facilitate data use and exchange.
“Structured data entry can facilitate data use and exchange [13]”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [13] TK Fraze, 2019, Prevalence of Screening for Food Insecurity, Housing Instability, Utility Needs, Transportation Needs, and Interpersonal Violence by US Physician Practices and Hospitals, JAMA Netw Open source
The Discussion (page unavailable in our copy) says new diagnostic codes could let physicians and hospitals document patients’ social needs so payers can refer patients to resources. This supports a specific example of coded information being used across organizations, but the paper does not address the broader claim about structured data entry facilitating data use and exchange. (LLM, conf=0.72)
Experimental — accuracy not yet measured
Classified as probably not a substantial claim. May combine two claims.
PremisecitationSystematic screening and documentation of health determinants can directly impact patient care and research efforts.
“Systematic screening and documentation of health determinants can directly impact patient care [1–8] and research efforts [1,5].”
Quote in the paperSubstantial claim2 of 8 sources checked- cites [1] BG Patra, 2021, Extracting social determinants of health from electronic health records using natural language processing: a systematic review, J Am Med Inform Assoc source
- cites [2] M Chen, 2020, Social determinants of health in electronic health records and their impact on analysis and risk prediction: A systematic review, J Am Med Inform Assoc source
- cites [3] Committee on Integrating Primary Care and Public Health; Board on Population Health and Public Health Practice; Institute of Medicine. Primary Care and Public Health: Exploring Integration to Improve Population Health. Washington (DC): National Academies Press (US); 2012 Mar 28.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [4] Centers for Disease Control and Prevention. Social Determinants of Health at CDC [Internet]. Atlanta,GA. Centers for Disease Control and Prevention; 2020 [updated 2022]. https://www.cdc.gov/about/sdoh/index.html.
Not checked in the free run.
- cites [5] EK Cottrell, 2019, Variation in Electronic Health Record Documentation of Social Determinants of Health Across a National Network of Community Health Centers, Am J Prev Med source
- cites [6] JR Vest, 2019, Prediction of emergency department revisits using area-level social determinants of health measures and health information exchange information, Int J Med Inform source
- cites [7] JR Vest, 2019, Impact of Risk Stratification on Referrals and Uptake of Wraparound Services That Address Social Determinants: A Stepped Wedged Trial, Am J Prev Med source
- cites [8] DJ Feller, 2018, Using Clinical Notes and Natural Language Processing for Automated HIV Risk Assessment, J Acquir Immune Defic Syndr source
The Results and Discussion (pages not provided) show that documented social and behavioral risk factors improved an HIV risk-prediction model, supporting a benefit for research. The Conclusion proposes using predictive analytics to improve HIV screening, but describes an anticipated clinical benefit, not a demonstrated direct impact on patient care. The paper does not assess systematic screening and documentation of health determinants generally. (LLM, conf=0.84)
Experimental — accuracy not yet measured
May combine two claims.
PremisecitationOnly 15.6% of physician practices and 24.4% of hospitals perform comprehensive health determinants screening.
“only 15.6% of physician practices and 24.4% of hospitals performing comprehensive health determinants screening per The National Survey of Healthcare Organizations and Systems Responses (2017–2018) [13].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [13] TK Fraze, 2019, Prevalence of Screening for Food Insecurity, Housing Instability, Utility Needs, Transportation Needs, and Interpersonal Violence by US Physician Practices and Hospitals, JAMA Netw Open source
Probably not a substantial claim: may not pass S3 (load-bearing).
InterpretationcitationThis finding is congruent with SEDH data quality issues noted in the literature.
“This finding is congruent with SEDH data quality issues noted in the literature [28–30].”
Quote in the paperNot a substantial claim2 of 3 sources checked- cites [28] LA Cook, 2021, The quality of social determinants data in the electronic health record: a systematic review, J Am Med Inform Assoc source
- cites [29] N Wiebe, 2019, Evaluation of interventions to improve inpatient hospital documentation within electronic health records: a systematic review, J Am Med Inform Assoc source
- cites [30] AA Dhavle, 2016, Analysis of Prescribers’ Notes in Electronic Prescriptions in Ambulatory Practice, JAMA Intern Med source
The Abstract reports data-quality problems in electronic prescriptions: inappropriate free-text content and patient directions that conflict with structured fields. That supports the general point that electronic health data can have quality issues, but our copy does not identify these findings as SEDH-specific. (LLM, conf=0.78)
Experimental — accuracy not yet measured
May combine two claims.
Findingown dataIn general, respondents reported that SDHs were difficult to chart in the EHR; smoking and insurance were reported as easy to chart by 59% and 47% of physicians respectively, and rates for the other 11 SDHs were less than 30%.
“In general, respondents reported that SDHs were difficult to chart in the EHR. Smoking and insurance were reported as easy to chart by 59% and 47% of physicians respectively; rates for the other 11 SDHs were less than 30% (Fig 1).”
Quote in the paperSubstantial claim- Rests on an assumption: Self-reported charting behavior accurately reflects actual documentation behavior.
- Rests on an assumption: The 11-question survey validly measures clinical consideration, EHR usability, and charting behavior.
- Rests on an assumption: The 201 respondents are representative of all staff physicians at the study institution.
May combine two claims.
Findingown dataOf the 13 SDHs assessed, 9 were reported as vital to patient care by at least half of physicians, with smoking reported by the highest percentage (87%).
“Of the 13 SDHs assessed, 9 were reported as vital to their patient care by at least half of physicians with the SDH of smoking reported by the highest percentage of physicians (87%) (Fig 1.).”
Quote in the paperNot a substantial claim- Rests on an assumption: Self-reported charting behavior accurately reflects actual documentation behavior.
- Rests on an assumption: The 11-question survey validly measures clinical consideration, EHR usability, and charting behavior.
- Rests on an assumption: The 201 respondents are representative of all staff physicians at the study institution.
May combine two claims.
Findingown dataOf the 7 EDHs assessed, infectious disease outbreaks was consistently charted on by the most physicians (31%), which was far less than that for the SDH of smoking (78%).
“Of the 7 EDHs assessed in the survey, the EDH of infectious disease outbreaks was consistently charted on by the most physicians (31%) (Fig 2). This, however, was far less than that for the SDH of smoking (78%).”
Quote in the paperNot a substantial claim- Rests on an assumption: Self-reported charting behavior accurately reflects actual documentation behavior.
- Rests on an assumption: The 11-question survey validly measures clinical consideration, EHR usability, and charting behavior.
- Rests on an assumption: The 201 respondents are representative of all staff physicians at the study institution.
May combine two claims.
Findingown dataOf the 7 EDHs assessed, 3 were reported as vital to patient care by at least half of physicians; infectious disease had the highest percentage (80%), followed by access to basic appliances (59%) and household pollution (59%).
“Of the 7 EDHs assessed, 3 were reported as vital to patient care by at least half of physicians (Fig 2). Infectious disease had the highest percentage of physicians who perceived this EDH as vital to patient care (80%) followed by access to basic appliances (59%) and household pollution (59%).”
Quote in the paperNot a substantial claim- Rests on an assumption: Self-reported charting behavior accurately reflects actual documentation behavior.
- Rests on an assumption: The 11-question survey validly measures clinical consideration, EHR usability, and charting behavior.
- Rests on an assumption: The 201 respondents are representative of all staff physicians at the study institution.
May combine two claims.
Findingown dataThe EDH of infectious disease outbreaks was reported as easy to chart by only 16.4% of physicians; rates for the other 6 EDHs were all less than 10%.
“The EDH of infectious disease outbreaks was reported as easy to chart by only 16.4% of physicians; rates for the other 6 EDHs were all less than 10% (Fig 2).”
Quote in the paperSubstantial claim- Rests on an assumption: Self-reported charting behavior accurately reflects actual documentation behavior.
- Rests on an assumption: The 11-question survey validly measures clinical consideration, EHR usability, and charting behavior.
- Rests on an assumption: The 201 respondents are representative of all staff physicians at the study institution.
May combine two claims.
Findingown dataDespite similar percentages of physicians reporting that both smoking and infectious disease outbreaks are vital to care, differences in charting consistency and ease of charting between these two were seen.
“Despite similar percentages of physicians reporting that both smoking and infectious disease outbreaks are vital to care, differences in charting consistency and ease of charting between these two were seen.”
Quote in the paperSubstantial claim- Rests on an assumption: Self-reported charting behavior accurately reflects actual documentation behavior.
- Rests on an assumption: The 11-question survey validly measures clinical consideration, EHR usability, and charting behavior.
- Rests on an assumption: The 201 respondents are representative of all staff physicians at the study institution.
Classified as probably not a substantial claim.
Study design and conductreasoningThe GLMM used a random physician effect to account for correlation between the SDH and EDH responses per physician.
“The GLMM used a binary distribution with a logit link and consisted of a fixed type effect (SDH vs. EDH) and random physician effect to account for correlation between the SDH and EDH responses per physician.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Premisenone givenWhether data quality issues are related to incomplete entry, incomplete capture or a lack of universal guidelines is unclear from the existing literature.
“Whether data quality issues are related to incomplete entry, incomplete capture or a lack of universal guidelines is unclear from the existing literature.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationData quality relies on accuracy and completeness.
“Data quality relies on accuracy and completeness [27]”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [27] B Ehsani-Moghaddam, 2021, Data quality in healthcare: A report of practical experience with the Canadian Primary Care Sentinel Surveillance Network data, Health Inf Manag source
Probably not a substantial claim: may not pass S4 (based). May combine two claims.
Premisenone givenSEDH data quality and mobilization depends on collection and storage, two tasks performed by providers whose engagement with SEDH data may be modifiable.
“SEDH data quality and mobilization depends on collection and storage, two tasks performed by providers whose engagement with SEDH data may be modifiable.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductreasoningThe study relied on self-reported charting behavior because routine structured data entry of SEDH elements was limited at the study institution and to not exclude any possible provider SEDH documentation modality.
“We relied on self-reported charting behavior because routine structured data entry of SEDH elements was limited at the study institution and because we did not want to exclude any possible provider SEDH documentation modality.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
Study design and conductnone givenSystematized use of electronic screening forms, such as PRAPARE, was not a standardized practice at the study institution.
“Systematized use of electronic screening forms, such as PRAPARE, was not a standardized practice at the study institution”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductreasoningThe study was approved by the Institutional Review Board as exempt.
“The Institutional Review Board (IRB) at the study institution granted exempt status for this research (#STUDY00018033).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
Study design and conductreasoningRegardless of possible variation in documentation method, a physician would have been able to use their same chosen method to chart on all SEDHs.
“Regardless of this possible variation (using structured data entry or an unstructured form like a clinical note) a physician would have been able to use their same chosen method to chart on all SEDHs.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductreasoningProvider SEDH documentation may vary between different physicians.
“and provider SEDH documentation may vary between different physicians.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductreasoningThe survey was distributed by non-study team administrative personnel to ensure anonymous participation.
“Non-study team administrative personnel in these offices distributed the survey electronically using staff physician institutional email addresses via these administrative listservs to ensure anonymous participation.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationStructured data entry may negatively impact clinical workflows.
“Structured data entry may negatively impact clinical workflows [31]”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [31] RA Bush, 2017, Structured Data Entry in the Electronic Medical Record: Perspectives of Pediatric Specialty Physicians and Surgeons, J Med Syst source
Probably not a substantial claim: may not pass S2 (checkable).
Interpretationown dataThe associations found in this study provide a starting point to understand the complexity in how clinical utility and EHR usability influence charting consistency of each SEDH element.
“The associations found in this study provide a starting point to understand the complexity in how clinical utility and EHR usability influence charting consistency of each SEDH element”
Quote in the paperNot a substantial claim- Rests on an assumption: Self-reported charting behavior accurately reflects actual documentation behavior.
- Rests on an assumption: The 11-question survey validly measures clinical consideration, EHR usability, and charting behavior.
- Rests on an assumption: The 201 respondents are representative of all staff physicians at the study institution.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataA total of 2,478 staff physicians were identified, and 201 participants completed the survey (8.1% response rate) and were included in the analysis.
“A total of 2,478 staff physicians (1,800 attending physicians and 678 residents/fellows) were identified using an administrative listserv at the study institution during the project timeframe. Of this total, 201 participants completed the survey (8.1% response rate) and were included in the analysis.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
Interpretationown dataOur results provide a starting point to understand how clinical utility and EHR usability influence physician documentation practices for each individual SEDH element.
“Our results provide a starting point to understand how clinical utility and EHR usability influence physician documentation practices for each individual SEDH element.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataProvider documentation frequency of an SEDH is associated with clinical utility as well as ease of charting.
“In conclusion, our study results show that provider documentation frequency of an SEDH is associated with clinical utility as well as ease of charting”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductown dataThe study had a low overall response rate of 8%, which could lead to non-response bias.
“We had a low overall response rate of 8% which could lead to non-response bias.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataThe self-reported data in our study allowed us to assess for all possible types of charting behaviors and not only rely on discrete elements from structured data entry.
“One advantage of the self-reported data in our study, however, was that we were able to assess for all possible types of charting behaviors and not only rely on discrete elements from structured data entry.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
Interpretationnone givenPhysician responses seen in our study corroborated patterns seen in the literature.
“Furthermore, physician responses seen in our study corroborated patterns seen in the literature.”
Quote in the paperNot a substantial claim
The paper relies on this without support.
Self-reported charting behavior accurately reflects actual documentation behavior.
“We relied on self-reported charting behavior because routine structured data entry of SEDH elements was limited at the study institution and because we did not want to exclude any possible provider SEDH documentation modality.”
The paper relies on this without support.
The 11-question survey validly measures clinical consideration, EHR usability, and charting behavior.
“A five-point Likert scale from “never” to “always” was used to assess participant charting behavior and clinical consideration as specifically related to the participant’s own clinical practice. EHR usability was assessed by asking participants to answer “yes” or “no” to whether the EHR makes documenting each SEDH element easy.”
The paper relies on this without support.
The 201 respondents are representative of all staff physicians at the study institution.
“Of this total, 201 participants completed the survey (8.1% response rate) and were included in the analysis.”
The paper relies on this without support.
The process for charting on smoking would have been the same as for any other SDH or EDH for a particular provider.
“the process for charting on smoking would have been the same as for any other SDH or EDH for a particular provider.”
The paper relies on this without support.
Assessing for smoking status is deeply entrenched across all levels of medical training.
“Assessing for smoking status is deeply entrenched across all levels of medical training”
The paper relies on this without support.
Inconsistent and incomplete acquisition affects the quality and use of SEDH data.
“Inconsistent and incomplete acquisition affects the quality and use of SEDH data”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
SDH importance range excludes the reported 40% value
MinorThe discussion gives 43% as the lowest percentage considering an SDH vital, but the results report 40% for access to guns in the household.
“Overall, 43%-87% of physicians considered an SDH as vital to their patient care”
“access to guns in the household (40%)”
Emergency Medicine omitted from infectious-disease charting exceptions
MinorThe results identify Emergency Medicine as having exactly half its physicians chart on infectious disease outbreaks. The discussion nevertheless says every department except Psychiatry and Pathology had less than half charting on it.
“Less than half of physicians in all departments (with the exception of Psychiatry and Pathology) reported charting on infectious disease outbreaks.”
“with the exception of Pathology (100%), Psychiatry (55%), and Emergency Medicine (50%)”
Conflicting statements about food security's ease-of-charting association
MinorThe results list only five SDHs with a significant association between ease of charting and consistent charting, excluding food security. The discussion says the association was significant for every SDH except seven others, which includes food security among the significant SDHs.
“Physician perception of the ease of charting of an SDH, however, was significantly associated with consistent charting of the SDHs of childcare, employment, insurance, smoking, and refugee status only.”
“Charting frequency was significantly associated with ease of charting for all SDHs except for housing, transportation, utilities, education, financial stability, personal safety, and access to guns.”
Cites
Fraze, T. K., Brewster, A. L., Lewis, V. A., Beidler, L. B., Murray, G. F., & Colla, C. H. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.11514 · Cited by 359 · see citing works
Integrating Data On Social Determinants Of Health Into Electronic Health Records
Cantor, M. N., & Thorpe, L. (2018) · Health Affairs · doi:10.1377/hlthaff.2017.1252 · Cited by 308 · see citing works
Chen, M., Tan, X., & Padman, R. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa143 · Cited by 287 · see citing works
Adoption of Social Determinants of Health EHR Tools by Community Health Centers
Gold, R., Bunce, A., Cowburn, S., Dambrun, K., Dearing, M., Middendorf, M., Mossman, N., Hollombe, C., Mahr, P., Melgar, G., et al. (2018) · The Annals of Family Medicine · doi:10.1370/afm.2275 · Cited by 252 · see citing works
Patra, B. G., Sharma, M. M., Vekaria, V., Adekkanattu, P., Patterson, O. V., Glicksberg, B., Lepow, L. A., Ryu, E., Biernacka, J. M., Furmanchuk, A., et al. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab170 · Cited by 248 · see citing works
Behforouz, H., Drain, P. K., & Rhatigan, J. J. (2014) · New England Journal of Medicine · doi:10.1056/nejmp1404846 · Cited by 220 · see citing works
Bazemore, A., Cottrell, E., Gold, R. B., Hughes, L. S., Phillips, R. L., Angier, H. E., Burdick, T. E., Carrozza, M. A., & DeVoe, J. E. (2015) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv088 · Cited by 202 · see citing works
The quality of social determinants data in the electronic health record: a systematic review
Cook, L. A., Sachs, J., & Weiskopf, N. G. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab199 · Cited by 153 · see citing works
Cohort study of structured reporting compared with conventional dictation
Johnson, A. J., Chen, M. Y. M., Swan, J. S., Applegate, K. E., & Littenberg, B. (2009) · Radiology · doi:10.1148/radiol.2531090138 · Cited by 139 · see citing works
Using Clinical Notes and Natural Language Processing for Automated HIV Risk Assessment
Feller, D. J., Zucker, J., Yin, M. T., Gordon, P., & Elhadad, N. (2018) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000001580 · Cited by 130 · see citing works
Cottrell, E. K., Dambrun, K., Cowburn, S., Mossman, N., Bunce, A. E., Marino, M., Krancari, M., & Gold, R. (2019) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2019.07.014 · Cited by 111 · see citing works
Upadhyay, S., & Hu, H.-F. (2022) · Health Services Insights · doi:10.1177/11786329211070722 · Cited by 111 · see citing works
University of California, S. F., Adler, N. E., Cutler, D. M., Harvard University, Fielding, J. E., University of California, L. A., Galea, S., Boston University, Glymour, M. M., University of California, S. F., et al. (2016) · NAM Perspectives · doi:10.31478/201609t · Cited by 96 · see citing works
Hatef, E., Ma, X., Rouhizadeh, M., Singh, G., Weiner, J. P., & Kharrazi, H. (2021) · Population Health Management · doi:10.1089/pop.2020.0043 · Cited by 88 · see citing works
Ehsani-Moghaddam, B., Martin, K., & Queenan, J. A. (2021) · Health Information Management Journal · doi:10.1177/1833358319887743 · Cited by 84 · see citing works
Vest, J. R., & Ben-Assuli, O. (2019) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2019.06.013 · Cited by 61 · see citing works
Bush, R. A., Kuelbs, C., Ryu, J., Jiang, W., & Chiang, G. (2017) · Journal of Medical Systems · doi:10.1007/s10916-017-0716-5 · Cited by 56 · see citing works
Vest, J. R., Menachemi, N., Grannis, S. J., Ferrell, J. L., Kasthurirathne, S. N., Zhang, Y., Tong, Y., & Halverson, P. K. (2019) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2018.11.009 · Cited by 51 · see citing works
Wiebe, N., Otero Varela, L., Niven, D. J., Ronksley, P. E., Iragorri, N., & Quan, H. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz081 · Cited by 42 · see citing works
Provider Perspectives on the Collection of Social Determinants of Health
Palacio, A., Seo, D., Medina, H., Singh, V., Suarez, M., & Tamariz, L. (2018) · Population Health Management · doi:10.1089/pop.2017.0166 · Cited by 41 · see citing works
Analysis of Prescribers’ Notes in Electronic Prescriptions in Ambulatory Practice
Dhavle, A. A., Yang, Y., Rupp, M. T., Singh, H., Ward-Charlerie, S., & Ruiz, J. (2016) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2015.7786 · Cited by 25 · see citing works
Environmental Determinants of Health
Gibson, J. M. (2018) · Springer eBooks · doi:10.1007/978-3-319-71812-5_37 · Cited by 24 · see citing works
Chen, H., Butler, E., Guo, Y., George, T., Modave, F., Gurka, M., & Bian, J. (2019) · Health Communication · doi:10.1080/10410236.2018.1443263 · Cited by 24 · see citing works
Iott, B. E., Pantell, M. S., Adler-Milstein, J., & Gottlieb, L. M. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocac154 · Cited by 22 · see citing works
Iott, B. E., Adler-Milstein, J., Gottlieb, L. M., & Pantell, M. S. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocac251 · Cited by 13 · see citing works
Lanier, C., Cerutti, B., Dominicé Dao, M., Hudelson, P., & Junod Perron, N. (2018) · International Journal of General Medicine · doi:10.2147/ijgm.s178672 · Cited by 12 · see citing works
Natural Language Processing-Identified Problem Opioid Use and Its Associated Health Care Costs
Masters, E. T., Ramaprasan, A., Mardekian, J., Palmer, R. E., Gross, D. E., Cronkite, D., Von Korff, M., & Carrell, D. S. (2018) · Journal of Pain & Palliative Care Pharmacotherapy · doi:10.1080/15360288.2018.1488794 · Cited by 9 · see citing works
Flagged first, then by citations
Research works printed but not linked: 4
- Committee on Integrating Primary Care and Public Health; Board on Population Health and Public Health Practice; Institute of Medicine. Primary Care and Public Health: Exploring Integration to Improve Population Health. Washington (DC): National Academies Press (US); 2012 Mar 28.
- O’Reilly K. How to improve screening for social determinants of health [Internet]. Chicago,IL. American Medical Association; 2019 [cited 2019 Oct 4]. https://www.ama-assn.org/delivering-care/patient-support-advocacy/how-improve-screening-social-determinants-health.
- Robeznieks A. New ICD-10 codes will help physicians tackle social barriers to care [Internet]. Chicago,IL. American Medical Association; 2019 [cited 2019 Apr 2]. https://www.ama-assn.org/practice-management/digital/new-icd-10-codes-will-help-physicians-tackle-social-barriers-care.
- C Thomas-Henkel, 2017, Screening for Social Determinants of Health in Populations with Complex Needs: Implementation Considerations
Cited by
Still being checked.
- Authors
- Sood, N., Stetter, C., Kunselman, A., & Jasani, S.
- Affiliations
- Pennsylvania State University (US)
- Yale University (US)
- Corresponding author
- Jasani, Sona
- Venue
- PLOS Digital Health
- Publisher
- Public Library of Science (PLoS)
- Published
- 2024-01-11
- Volume
- 3
- Issue
- 1
- Pages
- e0000428
- ISSN
- 2767-3170 (ISSN-L)
- PMC
- PMC10783763
- OpenAlex
- W4390755860
- Semantic Scholar
- c80eccc799af48543245bf2b0178863731cbe275
- Cited by
- 6
- References
- 27
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 1
- FWCI
- 1.85
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLOS Digital Health (publishedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- University of Pennsylvania
- Pennsylvania State University
- Penn State College of Medicine
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Health Sciences › Nursing › Issues, ethics and legal aspects › Nursing Diagnosis and Documentation
- Keywords
- electronic health records, EHR usability, clinical documentation, infectious disease outbreaks, data entry, secondary use of health data, EHR design, physician perceptions, health data quality, health workforce data, health insurance data, health care costs
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-28.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-28.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review