Impact of Remote Consultations on Antibiotic Prescribing in Primary Health Care: Systematic Review
Open accessPublished version of a preprint
Abstract
Background: There has been growing international interest in performing remote consultations in primary care, particularly amidst the current COVID-19 pandemic. Despite this, the evidence surrounding the safety of remote consultations is inconclusive. The appropriateness of antibiotic prescribing in remote consultations is an important aspect of patient safety that needs to be addressed. Objective: This study aimed to summarize evidence on the impact of remote consultation in primary care with regard to antibiotic prescribing. Methods: Searches were conducted in MEDLINE, Embase, HMIC, PsycINFO, and CINAHL for literature published since the databases’ inception to February 2020. Peer-reviewed studies conducted in primary health care settings were included. All remote consultation types were considered, and studies were required to report any quantitative measure of antibiotic prescribing to be included in this systematic review. Studies were excluded if there were no comparison groups (face-to-face consultations). Results: In total, 12 studies were identified. Of these, 4 studies reported higher antibiotic-prescribing rates, 5 studies reported lower antibiotic-prescribing rates, and 3 studies reported similar antibiotic-prescribing rates in remote consultations compared with face-to-face consultations. Guideline-concordant prescribing was not significantly different between remote and face-to-face consultations for patients with sinusitis, but conflicting results were found for patients with acute respiratory infections. Mixed evidence was found for follow-up visit rates after remote and face-to-face consultations. Conclusions: There is insufficient evidence to confidently conclude that remote consulting has a significant impact on antibiotic prescribing in primary care. However, studies indicating higher prescribing rates in remote consultations than in face-to-face consultations are a concern. Further, well-conducted studies are needed to inform safe and appropriate implementation of remote consulting to ensure that there is no unintended impact on antimicrobial resistance.
AI snapshot
Written from the paper’s full text.
TL;DR
This systematic review found mixed evidence on whether remote consultations in primary care change antibiotic prescribing compared with face-to-face consultations. Across 12 studies, 4 reported higher prescribing remotely, 5 lower, and 3 similar, with insufficient evidence to draw a confident conclusion.
Key findings
- Of 12 included studies, 4 reported higher antibiotic-prescribing rates in remote consultations, 5 reported lower rates, and 3 reported similar rates compared with face-to-face consultations.
- Examples of higher remote prescribing included sinusitis (99% vs 94%; P<.001) and urinary tract infection (99% vs 49%; P<.001) in Mehrotra et al, 2012, and acute respiratory infection (52% vs 31%; P<.001) in Ray et al, 2019.
- Examples of lower remote prescribing included sinusitis (68.6% vs 94.3%; P<.001) in Johnson et al, 2019 and acute respiratory infection (52% vs 53%; P<.01) in Shi et al, 2018; McKinstry et al, 2002 found no significant difference (19.3% vs 16.0%; difference −3.3%, 95% CI −11.1% to 4.5%).
- Guideline-concordant prescribing was not significantly different between remote and face-to-face consultations for sinusitis, but results were conflicting for acute respiratory infections; evidence on follow-up visit rates was mixed.
Methods
- Systematic review following PRISMA, searching MEDLINE, Embase, HMIC, PsycINFO, and CINAHL from inception to February 14, 2020 for peer-reviewed primary studies in primary health care that compared remote consultations with face-to-face consultations and reported quantitative antibiotic prescribing.
- Twelve studies were included: 9 from the United States, 2 from Denmark, and 1 from Norway; 11 were cohort studies and 1 was a randomized controlled trial.
- Risk of bias was assessed with the National Heart, Lung, and Blood Institute tool for observational studies and the Cochrane tool for RCTs; results were synthesized narratively because studies were too heterogeneous for meta-analysis.
Limitations
- The authors state that terminology variation may have led to omitted papers, relevant papers may exist in grey literature or non-English languages, included studies came from only 4 high-income countries, and setting differences such as retail clinics versus primary care practices and nurse practitioners versus physicians were unaccounted for.
- The authors also note the dearth of relevant papers and that the small number of studies meant no clear pattern emerged regarding setting.
- Evident from the text: only 1 included study was an RCT, most were observational, and heterogeneity in populations, consultation types, and outcome definitions precluded meta-analysis; only 2 studies provided sample size justifications or power calculations, and 4 lacked adjustment for any confounding factors.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 93 cited sources checked · 0 supported · 0 flagged
- Findingown data
Of the 12 included studies, 5 reported lower antibiotic-prescribing rates in remote consultations compared with face-to-face consultations.
“Of these, 4 studies reported higher antibiotic-prescribing rates, 5 studies reported lower antibiotic-prescribing rates, and 3 studies reported similar antibiotic-prescribing rates in remote consultations compared with face-to-face consultations.”
Quote in the paperNot a substantial claim - Findingown data
Mixed evidence was found for follow-up visit rates after remote and face-to-face consultations.
“Mixed evidence was found for follow-up visit rates after remote and face-to-face consultations.”
Quote in the paperNot a substantial claim - Findingown data
Guideline-concordant prescribing was not significantly different between remote and face-to-face consultations for patients with sinusitis.
“Guideline-concordant prescribing was not significantly different between remote and face-to-face consultations for patients with sinusitis, but conflicting results were found for patients with acute respiratory infections.”
Quote in the paperSubstantial claim - Findingown data
The systematic review identified 12 studies.
“In total, 12 studies were identified.”
- Also stated in: § Study Selection · plain
“Our electronic database search yielded 2427 results, of which 12 studies were included in this review (Figure 1) [12].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [12] source
Not checked in the free run.
- Also stated in: § Study Selection · plain
- Findingown data
Of the 12 included studies, 3 reported similar antibiotic-prescribing rates in remote consultations compared with face-to-face consultations.
“Of these, 4 studies reported higher antibiotic-prescribing rates, 5 studies reported lower antibiotic-prescribing rates, and 3 studies reported similar antibiotic-prescribing rates in remote consultations compared with face-to-face consultations.”
Quote in the paperNot a substantial claim
- Findingown data
Of the 12 included studies, 4 reported higher antibiotic-prescribing rates in remote consultations compared with face-to-face consultations.
“Of these, 4 studies reported higher antibiotic-prescribing rates, 5 studies reported lower antibiotic-prescribing rates, and 3 studies reported similar antibiotic-prescribing rates in remote consultations compared with face-to-face consultations.”
Quote in the paperNot a substantial claim - Findingown data
Conflicting results were found for guideline-concordant prescribing between remote and face-to-face consultations for patients with acute respiratory infections.
“Guideline-concordant prescribing was not significantly different between remote and face-to-face consultations for patients with sinusitis, but conflicting results were found for patients with acute respiratory infections.”
Quote in the paperSubstantial claim - Findingcitation
Mehrotra et al 2012 reported that for urinary tract infection, the antibiotic-prescribing rate was 99% in remote consultations versus 49% in face-to-face consultations (P<.001).
“Intervention: 99%, control: 49% (P<.001)”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [22] source
Not checked in the free run.
- Findingcitation
Penza et al 2020 reported that for conjunctivitis, the antibiotic-prescribing rate during telephone consultations was 41.6% in remote consultations versus 19.8% in face-to-face consultations (P<.0001).
“Intervention: 41.6%, control: 19.8% (P<.0001)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [19] source
Not checked in the free run.
- Findingown data
Four included studies lacked adjustment for any confounding factors.
“Additionally, 4 studies lacked adjustment for any confounding factors [16,18,20,23].”
Quote in the paperNot a substantial claim0 of 4 sources checked - Findingcitation
Uscher-Pines et al 2016 reported that for uncomplicated acute bronchitis, the antibiotic-avoidance rate was 16.7% in remote consultations versus 27.9% in face-to-face consultations (P<.01).
“Intervention: 16.7%, control: 27.9% (P<.01)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [24] source
Not checked in the free run.
- Findingcitation
Shi et al 2018 reported that for acute respiratory infection, the antibiotic-prescribing rate was 52% in remote consultations versus 53% in face-to-face consultations (P<.01).
“Intervention: 52%, control: 53% (P<.01)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [25] source
Not checked in the free run.
- Findingcitation
Huibers et al 2014 reported that the antibiotic-prescribing rate was 26.1% (95% CI 25.9-26.3) in remote consultations versus 10.7% (95% CI 10.6-10.8) in face-to-face consultations.
“Intervention: 26.1% (95% CI 25.9-26.3) Control: 10.7% (95% CI 10.6-10.8)”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [16] source
Not checked in the free run.
- Findingcitation
The difference in antibiotic-prescribing rate between remote and face-to-face consultations ranged from 5% (n=201) to 50% (n=5165).
“The difference in prescribing rate ranged from 5% (n=201) to 50% (n=5165) [22].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [22] source
Not checked in the free run.
- Findingown data
Only 2 included studies provided sample size justifications or power calculations.
“However, only 2 studies provided sample size justifications or power calculations [17,26].”
Quote in the paperNot a substantial claim0 of 2 sources checked - Findingcitation
Mehrotra et al 2012 reported that for sinusitis, the antibiotic-prescribing rate was 99% in remote consultations versus 94% in face-to-face consultations (P<.001).
“Intervention: 99%, control: 94% (P<.001)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [22] source
Not checked in the free run.
- Findingcitation
Ray et al 2019 reported that for acute respiratory infection, the antibiotic-prescribing rate was 52% in remote consultations versus 31% in face-to-face consultations (P<.001).
“Intervention: 52%, control: 31% (P<.001)”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [27] source
Not checked in the free run.
- Findingnone given
All included studies had clearly defined their objectives, study population, and exposure and outcome measures.
“All studies had clearly defined their objectives, study population, and exposure and outcome measures.”
Quote in the paperNot a substantial claim - Findingcitation
We found 3 studies that reported the antibiotic-prescribing rate to be higher in remote settings than face-to-face consultations.
“We found 3 studies that reported the antibiotic-prescribing rate to be higher in remote settings than face-to-face consultations [19,22,27].”
Quote in the paperSubstantial claim0 of 3 sources checked - Findingcitation
McKinstry et al 2002 reported that the antibiotic-prescribing rate was 19.3% in remote consultations versus 16.0% in face-to-face consultations; difference −3.3% (95% CI −11.1% to 4.5%).
“Intervention: 19.3%, control: 16.0%; difference: −3.3% (95% CI −11.1% to 4.5%)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [21] McKinstry, B, 2002, Br J Gen Pract
Not checked in the free run.
- Findingown data
In the 3 cohort studies reporting higher antibiotic prescribing in face-to-face consultations, the differences in prescribing rates were generally smaller.
“The differences in prescribing rates were generally smaller in these studies”
Quote in the paperNot a substantial claim - Findingcitation
Johnson et al 2019 reported that for sinusitis, the antibiotic-prescribing rate was 68.6% in remote consultations versus 94.3% in face-to-face consultations (P<.001).
“Intervention: 68.6%, control: 94.3% (P<.001)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [26] source
Not checked in the free run.
- Findingcitation
Murray et al 2019 reported that for urinary tract infection, the antibiotic-prescribing rate in telephone consultations was 81% in remote consultations versus 83% in face-to-face consultations (P=.76).
“Intervention: 81%, control: 83% (P=.76)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [18] source
Not checked in the free run.
- Findingcitation
Two moderate-quality studies, an RCT and a retrospective cohort study, found no significant difference in antibiotic prescribing rate between remote and face-to-face settings.
“Additionally, 2 moderate-quality studies, an RCT and a retrospective cohort study, noted no significant difference in prescribing rate between the different settings [18,21].”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [18] source
Not checked in the free run.
- cites [21] McKinstry, B, 2002, Br J Gen Pract
Not checked in the free run.
- Findingcitation
The largest difference in antibiotic prescribing rates observed among these studies was 25.7% (n=350).
“the largest difference observed was 25.7% (n=350) [26]”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [26] source
Not checked in the free run.
- Findingcitation
The review found 3 cohort studies in which patients were more likely to be prescribed an antibiotic through face-to-face consultations than remote consultations.
“We also found 3 cohort studies that reported patients were more likely to be prescribed an antibiotic through face-to-face consultations [16,25,26].”
Quote in the paperSubstantial claim0 of 3 sources checked - Findingcitation
One study found a 1% difference in antibiotic prescribing rates between consultation types (n=1,336,867).
“1 study found a 1% difference (n=1,336,867) [25]”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [25] source
Not checked in the free run.
- Findingcitation
Of 2 studies assessing patients with suspected or confirmed UTI, 1 study found higher antibiotic-prescribing rates in remote consultations.
“Of 2 studies assessing patients with suspected or confirmed UTI, 1 study found higher antibiotic-prescribing rates in remote consultations [22].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [22] source
Not checked in the free run.
- Findingcitation
Another moderate-quality study found no significant difference in antibiotic-prescribing rate for patients with UTI between remote and face-to-face consultations.
“Another moderate-quality study found no significant difference in antibiotic-prescribing rate for patients with UTI [18].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [18] source
Not checked in the free run.
- Findingreasoning
The results of Rokstad and Straand and Ewen et al do not consider multiple prescriptions made in one consultation.
“However, their results do not consider multiple prescriptions made in one consultation.”
Quote in the paperSubstantial claim0 of 2 sources checked - Findingreasoning
Results for respiratory infections were mixed.
“Results for respiratory infections were mixed.”
Quote in the paperNot a substantial claim - Findingcitation
Two other high-quality studies noted lower antibiotic-prescribing rates for patients consulting remotely.
“However, 2 other high-quality studies noted lower antibiotic-prescribing rates for patients consulting remotely [25,26].”
Quote in the paperNot a substantial claim0 of 2 sources checked - Findingcitation
Guideline-concordant antibiotic management for sinusitis and patients with UTI revealed no significant difference between remote and face-to-face consultations.
“In contrast to the findings for antibiotic-prescribing rate, the guideline-concordant antibiotic management for sinusitis and patients with UTI revealed no significant difference between remote and face-to-face consultations [22,26].”
- Also stated in: § Principal Results · plain
“Guideline-concordant prescribing rates for patients with UTI or sinusitis were not significantly changed by remote consultations.”
Quote in the paperSubstantial claim0 of 2 sources checked - Also stated in: § Principal Results · plain
- Findingown data
The review found 5 US-based retrospective cohort studies that investigated follow-up visit rates after initial consultation for the same presentation.
“We found 5 US-based retrospective cohort studies that investigated follow-up visit rates after initial consultation for the same presentation [18,19,22,25,26].”
Quote in the paperNot a substantial claim0 of 5 sources checked - Findingcitation
Conflicting results were observed for guideline-concordant prescribing for patients with acute respiratory infection.
“However, conflicting results were observed for patients with acute respiratory infection [25,27].”
Quote in the paperNot a substantial claim0 of 2 sources checked - Findingown data
The review found 4 observational studies that reported guideline-concordant or guideline-recommended prescribing rates, measuring appropriateness against local or national guidelines.
“We found 4 observational studies that reported guideline-concordant prescribing rates or guideline-recommended prescribing rates, which measured the appropriateness of the prescriptions against local or national guidelines [22,25-27] (Table 2).”
Quote in the paperSubstantial claim0 of 4 sources checked - Findingcitation
Murray et al found no significant difference in antibiotic-prescribing rates in the initial consultation for patients who were followed up with.
“Further, Murray et al [18] found no significant difference in antibiotic-prescribing rates in the initial consultation for patients who were followed up with.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [18] source
Not checked in the free run.
- Findingcitation
Shi et al found higher follow-up rates for remote consultations for those who followed up within 2-21 days after their first visit.
“Shi et al [25] found this to be true for those who followed up within 2-21 days after their first visit.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [25] source
Not checked in the free run.
- Findingown data
This review of moderate- to high-quality studies found that evidence regarding the impact of remote consultations on antibiotic prescribing was mixed or inconsistent.
“This review of moderate- to high-quality studies found that evidence regarding the impact of remote consultations on antibiotic prescribing was mixed.”
- Also stated in: § Conclusions · plain
“We found inconsistent evidence across the included studies for the impact of remote consulting on antibiotic prescribing in primary care.”
Quote in the paperSubstantial claim - Also stated in: § Conclusions · plain
- Findingcitation
Of these 5 studies, 3 found that patients seen remotely were more likely to have another follow-up visit than those who attended face-to-face consultations.
“Of these 5 studies, 3 found that patients who were seen remotely were more likely to have another follow-up visit than those who attended face-to-face consultations [19,25,26].”
Quote in the paperNot a substantial claim0 of 3 sources checked - Findingnone given
Studies reporting higher antibiotic-prescribing rates in remote consultations than in face-to-face consultations were generally of better quality.
“Studies reporting higher antibiotic-prescribing rates in remote consultations than in face-to-face consultations were generally of better quality.”
Quote in the paperNot a substantial claim - Findingcitation
Penza et al found higher follow-up rates in both e-visits and telephone consultations than in face-to-face consultations 7 days after the initial visit.
“Results from the Penza et al [19] study indicated higher follow-up rates in both e-visits and telephone consultations than in face-to-face consultations 7 days after the initial visit.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [19] source
Not checked in the free run.
- Findingnone given
The included studies were conducted in 1 of 4 high-income countries.
“The included studies were conducted in 1 of 4 high-income countries.”
Quote in the paperNot a substantial claim - Findingreasoning
There was mixed evidence regarding whether remote consultations were more likely to be followed up with another consultation for the same condition.
“However, there was mixed evidence regarding whether remote consultations were more likely to be followed up with another consultation for the same condition.”
Quote in the paperNot a substantial claim - Findingnone given
Research on the remote prescribing of antibiotics is too limited to make useful comparisons.
“However, research on the remote prescribing of antibiotics is too limited to make useful comparisons.”
Quote in the paperSubstantial claim - Findingreasoning
With the small number of studies, no clear pattern emerged in terms of the impact of setting on the outcome.
“With the small number of studies, no clear pattern emerged in terms of the impact of setting on the outcome.”
Quote in the paperNot a substantial claim - Premisecitation
Primary care professionals are more likely to prescribe medications in remote consultations than in face-to-face settings.
“For example, PCPs are more likely to prescribe medications in remote consultations than in face-to-face settings [6,7].”
Quote in the paperSubstantial claim0 of 2 sources checked - Interpretationown data
There is insufficient evidence to confidently conclude that remote consulting has a significant impact on antibiotic prescribing in primary care.
“There is insufficient evidence to confidently conclude that remote consulting has a significant impact on antibiotic prescribing in primary care.”
Quote in the paperSubstantial claim - Premisecitation
There remains much uncertainty regarding the safety and effectiveness of remote consultations.
“there remains much uncertainty regarding the safety and effectiveness of remote consultations [4,5].”
Quote in the paperSubstantial claim0 of 2 sources checked - Premisecitation
Antibiotic prescribing behavior can be influenced by nonclinical factors unique to remote consultations, such as the inability to physically examine the patient.
“In particular, antibiotic prescribing behavior can be influenced by nonclinical factors that are unique to remote consultations, such as the inability to physically examine the patient [8].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [8] source
Not checked in the free run.
- Study design and conductnone given
The included studies were considered too heterogeneous in terms of study population, type of consultation, and outcome definitions for meta-analysis.
“The included studies were considered too heterogeneous in terms of study population, type of consultation, and outcome definitions for meta-analysis.”
Quote in the paperSubstantial claim - Interpretationreasoning
The lack of blinding in the RCT was not considered to significantly impact quality, since blinding to consultation type is rarely feasible.
“However, we did not consider this to significantly impact the quality, since blinding to consultation type is rarely feasible.”
Quote in the paperSubstantial claim - Interpretationcitation
Clinicians may be more likely to prescribe antibiotics for UTI in remote consultations.
“Clinicians may be more likely to prescribe antibiotics for UTI in remote consultations.”
Quote in the paperSubstantial claim - Interpretationreasoning
The inconsistency of results and the small number of studies make it difficult to draw strong conclusions for the effect of remote consultations on antibiotic prescribing.
“However, the inconsistency of results and the small number of studies make it difficult to draw strong conclusions for the effect of remote consultations on antibiotic prescribing.”
Quote in the paperSubstantial claim - Study design and conductreasoning
The effect of the setting of studies is unaccounted for.
“Additionally, the effect of the setting of studies is unaccounted for.”
Quote in the paperNot a substantial claim- Rests on an assumption: Retail clinics differ from primary care practices in that there is less chance of establishing a long-term doctor-patient relationship.
- Premisecitation
Banks et al noted that many remote consultations were followed up with face-to-face appointments for adequate clinical assessment.
“On the other hand, Banks et al [30] noted that many remote consultations were followed up with face-to-face appointments for adequate clinical assessment.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [30] source
Not checked in the free run.
- May combine two claims. 21
- Classified as probably not a substantial claim. 22
May combine two claims.
Findingown dataThe quality of included studies was generally fair, with 7 moderate-quality studies, including the RCT, and 5 observational studies considered high quality.
“The quality of studies was generally fair, with 7 moderate-quality studies, including the RCT, and 5 observational studies that were considered high quality.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.
FindingcitationRokstad and Straand 1997 reported that antibiotic-prescribing rate was lower in remote consultations; 7.8% of remote prescriptions were antibiotics versus 17.8% of face-to-face prescriptions.
“Intervention: 43.5% of all prescriptions; 7.8% of remote prescriptions were antibiotics Control: 56.6% of all prescriptions; 17.8% of face-to-face prescriptions were antibiotics”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [20] source
Not checked in the free run.
May combine two claims.
FindingcitationAnother study concluded that fewer antibiotics were avoided for bronchitis patients consulting over the phone; patients were more likely to receive an antibiotic for the same condition when consulting remotely.
“Another study concluded that fewer antibiotics were avoided for bronchitis patients consulting over the phone; patients were more likely to receive an antibiotic for the same condition when consulting remotely [24].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [24] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
FindingcitationEwen et al 2015 reported that 12.4% of all antibiotics prescriptions were made through telephone.
“12.4% of all antibiotics prescriptions made through telephone (6617 telephone consultations and 27,487 office consultations; 63,418 antibiotics were prescribed during 61,707 consultations to 31,302 individuals)*”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [23] source
Not checked in the free run.
May combine two claims.
FindingcitationThe RCT described adequate randomization but lacked blinding.
“The RCT described adequate randomization, but lacked blinding [21].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [21] McKinstry, B, 2002, Br J Gen Pract
Not checked in the free run.
May combine two claims.
FindingcitationPenza et al found higher antibiotic-prescribing rates for both telephone and text-based e-visits, but only the difference in telephone consultations was statistically significant.
“Penza et al found this relationship for both telephone and text-based e-visits, but only the difference in telephone consultations was statistically significant [19].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [19] source
Not checked in the free run.
May combine two claims.
Findingown dataTwo included studies could not be compared with the other included studies due to differences in outcome measures, and neither included a direct estimate of antibiotic prescribing.
“It was difficult to compare 2 studies with the other included studies due to differences in outcome measures; neither included a direct estimate of antibiotic prescribing.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
FindingcitationMurray et al 2019 reported that for urinary tract infection, the antibiotic-prescribing rate from text-based e-visits was 81% in remote consultations versus 83% in face-to-face consultations (P=.65).
“Intervention: 81%, control: 83% (P=.65)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [18] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
FindingcitationPenza et al 2020 reported that for conjunctivitis, the antibiotic-prescribing rate from text-based e-visits was 25.7% in remote consultations versus 19.8% in face-to-face consultations (P=.24).
“Intervention: 25.7%, control: 19.8% (P=.24)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [19] source
Not checked in the free run.
May combine two claims.
FindingcitationIn 3 studies, of which 2 were of high quality, researchers found higher antibiotic-prescribing rates in remote consultations than in direct PCP consultations.
“In 3 studies, of which 2 were of high quality, researchers found higher antibiotic-prescribing rates in remote consultations than in direct PCP consultations [22,24,27].”
Quote in the paperSubstantial claim0 of 3 sources checkedMay combine two claims.
FindingcitationIn Mehrotra et al, PCPs were less likely to order a UTI-relevant test in face-to-face consultations (did not order: 8%, did order: 51%; P<.01) but more likely to prescribe an antibiotic for UTI in remote consultations.
“Mehrotra et al [22] concluded that PCPs were less likely to order a UTI-relevant test in face-to-face consultations (did not order: 8%, did order: 51%; P<.01), but more likely to prescribe an antibiotic for UTI in remote consultations.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [22] source
Not checked in the free run.
May combine two claims.
Findingown dataAll 4 guideline-concordant prescribing studies were from the United States and investigated populations with confirmed sinusitis, UTI, or acute respiratory infection.
“All studies were from the United States and investigated populations with a confirmed diagnosis of sinusitis [22,26], UTI [22], or acute respiratory infection [25,27].”
Quote in the paperNot a substantial claim0 of 4 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Findingnone givenTo the authors' knowledge, this is the first systematic review to examine how antibiotic prescribing is affected by remote consultation in primary care.
“To our knowledge, this is the first systematic review to examine how antibiotic prescribing is affected by remote consultation in primary care.”
Quote in the paperNot a substantial claimMay combine two claims.
FindingcitationMurray et al and Mehrotra et al found no significant difference in follow-up visit rates between consultation types within the following 3 weeks and 30 days after the initial consultation, respectively.
“However, Murray et al [18] and Mehrotra et al [22] found no significant difference in follow-up visit rates between the consultation types within the following 3 weeks and 30 days after the initial consultation, respectively.”
Quote in the paperNot a substantial claim0 of 2 sources checkedMay combine two claims.
FindingcitationJohnson et al found higher follow-up rates for text-based e-visits relating to sinusitis in the subsequent 24 hours and 30 days after the initial consultation, but no difference at 7 days.
“Johnson et al [26] found this relationship to be true for text-based e-visits relating to sinusitis in the subsequent 24 hours and 30 days after the initial consultation, but found no difference in follow-up consultations at 7 days after the initial consultation.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [26] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingnone givenThe review faced a dearth of relevant papers.
“Other challenges we faced while conducting this review included the dearth of relevant papers.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingnone givenThere is significant variation in terminology among researchers, which could have led to the omission of a few relevant papers.
“However, there is significant variation in terminology among researchers, and this could have led to the omission of a few relevant papers.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe current literature is reliant on studies from high-income countries and observational studies, as confirmed by the inclusion of only one RCT in this review.
“Moreover, the current literature is reliant on studies from high-income countries and observational studies, as confirmed by the inclusion of only one RCT in this review.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingnone givenIn some studies, remote consultations were evaluated by nurse practitioners, who may have had a different skillset compared to primary care physicians who consulted with patients face-to-face.
“Moreover, in some studies, remote consultations were evaluated by nurse practitioners, who may have had a different skillset compared to primary care physicians who consulted with patients face-to-face.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationRemote consultations have been playing a substantial role in the health care response to the current COVID-19 pandemic by supporting continued access to services with minimized risk of disease transmission.
“remote consultations have been playing a substantial role in the health care response to the current COVID-19 pandemic by supporting continued access to services with minimized risk of disease transmission [2,3].”
Quote in the paperNot a substantial claim0 of 2 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataThree reviewers independently screened studies for inclusion.
“We had 3 reviewers independently screen studies for inclusion.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenSH assessed the quality of all papers and BH and GG each assessed half of the studies independently.
“SH assessed the quality of all papers and BH and GG each assessed half of the studies independently.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductcitationRisk of bias was assessed using the National Heart, Lung, and Blood Institute tool for observational studies and the Cochrane risk of bias tool for RCTs.
“The National Heart, Lung, and Blood Institute tool [13] was used to assess observational studies, and the Cochrane risk of bias tool [14] was applied to RCTs.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [13] National Heart, Lung, and Blood InstituteQuality Assessment Tool for Observational Cohort and Cross-Sectional StudiesStudy Quality Assessment Tools2020-10-21https://www.nhlbi.nih.gov/health-topics/study-quality-assessment-tools
Not checked in the free run.
- cites [14] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationOver 90 countries were reported to be already delivering health care services over the telephone in 2016.
“Over 90 countries have been reported to be already delivering health care services over the telephone in 2016 [1]”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [1] World Health Organization,, 2016, Global diffusion of eHealth: making universal health coverage achievable: report of the third global survey on eHealth
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitationThe systematic review was conducted following PRISMA guidelines.
“This systematic review was conducted following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines (Multimedia Appendix 1) [12].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [12] source
Not checked in the free run.
May combine two claims.
InterpretationcitationThe studies examining specific indications for antibiotics suggested that antibiotic-prescribing rates for patients with UTI in remote consultations was higher than in face-to-face consultations, but 1 study did not find any difference.
“The studies examining specific indications for antibiotics suggested that antibiotic-prescribing rates for patients with UTI in remote consultations was higher than in face-to-face consultations, but 1 study did not find any difference [18].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [18] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationMore recent reviews agree that there is a need for more research on the safety of care and the quality and safety of prescribing through remote consultations.
“More recent reviews agree that there is a need for more research on the safety of care [4] and the quality and safety of prescribing through remote consultations [4,32].”
Quote in the paperNot a substantial claim0 of 2 sources checkedMay combine two claims.
InterpretationreasoningSimilar guideline-concordant prescribing between remote and face-to-face consultations is reassuring, but the evidence for whether the management at remote consultations is effective is less clear.
“Similar guideline-concordant prescribing between remote and face-to-face consultations is reassuring, but the evidence for whether the management at remote consultations is effective is less clear.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationA systematic review of reviews on the benefits of telemedicine in 2002 found too little high-quality evidence to confidently conclude that telemedicine was beneficial.
“A systematic review of reviews on the benefits of telemedicine in 2002 found too little high-quality evidence to confidently conclude that telemedicine was beneficial.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [31] source
Not checked in the free run.
May combine two claims.
PremisecitationCompared to face-to-face consultations, PCPs order fewer tests and investigations and are unable to physically examine patients in remote settings, which can affect the appropriateness of patient management.
“Compared to face-to-face consultations, PCPs order fewer tests and investigations and are unable to physically examine patients in remote settings, which can affect the appropriateness of patient management [8,28].”
Quote in the paperNot a substantial claim0 of 2 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationcitationClinicians consulting in retail clinics via private telemedicine providers could feel pressured to prescribe antibiotics due to patient expectations and diagnostic uncertainty from lack of continuity in commercial remote consultations.
“Clinicians consulting in retail clinics via private telemedicine providers could feel pressured to prescribe antibiotics due to the expectations of patients who pay to see clinicians and the diagnostic uncertainty that stems from the lack of continuity in these commercial remote consultations [29].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [29] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe review attempted a comprehensive search by manually searching reference lists to find relevant search terms for remote consultation.
“We tried to conduct a comprehensive search by manually searching reference lists to find relevant search terms for remote consultation.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationcitationAntibiotic prescriptions made in follow-up appointments contribute to prescriptions made in face-to-face consultations, which could partially explain why some included studies found lower antibiotic-prescribing rates in initial remote consultations and higher frequencies of follow-up consultations.
“As antibiotic prescriptions made in follow-up appointments contribute to prescriptions made in face-to-face consultations, this could provide a partial explanation for why some of the included studies found lower antibiotic-prescribing rates in initial remote consultations and higher frequencies of follow-up consultations [25,26].”
Quote in the paperNot a substantial claim0 of 2 sources checked- Rests on an assumption: Antibiotic prescriptions made in follow-up appointments contribute to prescriptions made in face-to-face consultations.
Probably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningAs this is a novel study, it is difficult to compare the findings of this review directly with other reviews.
“As this is a novel study, it is difficult to compare the findings of this review directly with other reviews.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
InterpretationreasoningA high follow-up visit rate does not necessarily correlate with poor management at initial consultation, but it raises the question of the effectiveness (including cost-effectiveness) of remote consultations.
“Therefore, a high follow-up visit rate does not necessarily correlate with poor management at initial consultation, but it does raise the question of the effectiveness (including cost-effectiveness) of remote consultations.”
Quote in the paperSubstantial claim- Rests on an assumption: Follow-up visits after remote consultations are often necessary per clinicians' advice and patients' need for physical examinations.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe 2002 systematic review reported that research was beginning to address the literature gaps in the field.
“However, the review reported that research was beginning to address the literature gaps in the field [31].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [31] source
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.
InterpretationreasoningThe divided weight of evidence in this review makes it difficult to inform health policy, as the evidence regarding remote consultations is still evolving.
“The divided weight of evidence in this review makes it difficult to inform health policy, as the evidence regarding remote consultations is still evolving.”
Quote in the paperNot a substantial claim
The paper relies on this without support.
Overprescribing of antibiotics drives antimicrobial resistance, which is a global concern with consequent impact on patients and health systems, especially primary health care.
“The overprescribing of antibiotics drives antimicrobial resistance, which is a global concern with consequent impact on patients and health systems, especially primary health care.”
The paper relies on this without support.
Follow-up visits after remote consultations are often necessary per clinicians' advice and patients' need for physical examinations.
“Follow-up visits after remote consultations are often necessary per clinicians’ advice and patients’ need for physical examinations.”
The paper relies on this without support.
Retail clinics differ from primary care practices in that there is less chance of establishing a long-term doctor-patient relationship.
“For example, retail clinics differ from primary care practices, as there is less chance of establishing a long-term doctor-patient relationship.”
The paper relies on this without support.
Antibiotic prescriptions made in follow-up appointments contribute to prescriptions made in face-to-face consultations.
“As antibiotic prescriptions made in follow-up appointments contribute to prescriptions made in face-to-face consultations”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
No significant differences were found in dosage and choice of antibiotics when comparing remote and face-to-face environments.
“Han et al. (2020) [12], when comparing the dosage and choice of antibiotics, found no significant differences.”
From Patient safety risk associated with synchronous telehealth: A scoping review (2025) · cites this paper as [12]
The Results sections on prescribing behavior and guideline-concordant prescribing (page unavailable) compare prescribing rates and overall guideline concordance, not antibiotic dosage or choice. Searches for dosage, dosing, and antibiotic selection found no comparison of those outcomes between remote and face-to-face consultations. (LLM, conf=0.76)
Experimental — accuracy not yet measuredOther studies have described problems of increased antimicrobial prescribing, reduced ordering of diagnostic investigations and delayed diagnosis of cancer attributed to the pandemic-related shift to remote consultations.
“Other studies have described problems of increased antimicrobial prescribing (120), reduced ordering of diagnostic investigations (121) and delayed diagnosis of cancer (122, 123) attributed to the pandemic-related shift to remote consultations”
From Planning and Evaluating Remote Consultation Services: A New Conceptual Framework Incorporating Complexity and Practical Ethics (2021) · cites this paper as [120]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Huibers study is classified as lower prescribing despite a higher remote rate
MajorThe Huibers results show an antibiotic-prescribing rate of 26.1% in remote consultations versus 10.7% face-to-face, yet the study is listed and discussed among those with lower prescribing in remote consultations. This affects the review's count of studies favoring each direction.
“We also found 3 cohort studies that reported patients were more likely to be prescribed an antibiotic through face-to-face consultations [16,25,26].”
“Intervention: 26.1% (95% CI 25.9-26.3) Control: 10.7% (95% CI 10.6-10.8)”
Country totals leave out the Scottish study
MinorThe stated country counts account for all 12 studies as being in the United States, Denmark, or Norway, but Table 1 identifies McKinstry et al as a study conducted in Scotland.
“Of these 12 studies, 9 were conducted in the United States [18,19,22-27], 2 were conducted in Denmark [16,17], and 1 was conducted in Norway [20].”
“McKinstry et al, 2002 [21] | Scotland | Primary care practices | Randomized controlled trial”
Cites
The Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817 · see citing works
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578 · see citing works
Llor, C., & Bjerrum, L. (2014) · Therapeutic Advances in Drug Safety · doi:10.1177/2042098614554919 · Cited by 2,079 · see citing works
Popay, J., Roberts, H., Sowden, A., Petticrew, M., Arai, L., Rodgers, M., Britten, N., Roen, K., & Duffy, S. (2006) · Lancaster University · doi:10.13140/2.1.1018.4643 · Cited by 2,070 · see citing works
Effectiveness of telemedicine: A systematic review of reviews
Ekeland, A. G., Bowes, A., & Flottorp, S. (2010) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2010.08.006 · Cited by 1,162 · see citing works
The Impact of Telehealthcare on the Quality and Safety of Care: A Systematic Overview
McLean, S., Sheikh, A., Cresswell, K., Nurmatov, U., Mukherjee, M., Hemmi, A., & Pagliari, C. (2013) · PLoS ONE · doi:10.1371/journal.pone.0071238 · Cited by 255 · see citing works
Antibiotic Prescribing During Pediatric Direct-to-Consumer Telemedicine Visits
Ray, K. N., Shi, Z., Gidengil, C. A., Poon, S. J., Uscher-Pines, L., & Mehrotra, A. (2019) · Pediatrics · doi:10.1542/peds.2018-2491 · Cited by 206 · see citing works
Electronic Consultation in Primary Care Between Providers and Patients: Systematic Review
Mold, F., Hendy, J., Lai, Y.-L., & de Lusignan, S. (2019) · JMIR Medical Informatics · doi:10.2196/13042 · Cited by 181 · see citing works
Access and Quality of Care in Direct-to-Consumer Telemedicine
Uscher-Pines, L., Mulcahy, A., Cowling, D., Hunter, G., Burns, R., & Mehrotra, A. (2016) · Telemedicine and e-Health · doi:10.1089/tmj.2015.0079 · Cited by 162 · see citing works
The Use of Digital Health in the Detection and Management of COVID-19
Alwashmi, M. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17082906 · Cited by 159 · see citing works
Mehrotra, A., Paone, S., Martich, G. D., Albert, S. M., & Shevchik, G. J. (2013) · JAMA Internal Medicine · doi:10.1001/2013.jamainternmed.305 · Cited by 150 · see citing works
Wallace, P., Haines, A., Harrison, R., Barbour, J., Thompson, S., Jacklin, P., Roberts, J., Lewis, L., & Wainwright, P. (2002) · The Lancet · doi:10.1016/s0140-6736(02)08828-1 · Cited by 145 · see citing works
The primary care response to COVID-19 in England's National Health Service
Majeed, A., Maile, E. J., & Bindman, A. B. (2020) · Journal of the Royal Society of Medicine · doi:10.1177/0141076820931452 · Cited by 138 · see citing works
Self-citationUse of an electronic consultation system in primary care: a qualitative interview study
Banks, J., Farr, M., Salisbury, C., Bernard, E., Northstone, K., Edwards, H., & Horwood, J. (2018) · British Journal of General Practice · doi:10.3399/bjgp17x693509 · Cited by 108 · see citing works
Shi, Z., Mehrotra, A., Gidengil, C. A., Poon, S. J., Uscher-Pines, L., & Ray, K. N. (2018) · Health Affairs · doi:10.1377/hlthaff.2018.05091 · Cited by 108 · see citing works
McKinstry, B., Walker, J. J., Campbell, C., Heaney, D., & Wyke, S. (2002) · Europe PMC (PubMed Central) · Cited by 106 · see citing works
Clinical use of Skype: a review of the evidence base
Armfield, N. R., Gray, L. C., & Smith, A. C. (2012) · Journal of Telemedicine and Telecare · doi:10.1258/jtt.2012.sft101 · Cited by 91 · cited 1× · see citing works
“The increasingly commonplace nature of remote consulting in primary care notwithstanding, there remains much uncertainty regarding the safety and effectiveness of remote consultations [4,5].”
Antibiotic prescribing patterns in out-of-hours primary care: A population-based descriptive study
Huibers, L., Moth, G., Christensen, M. B., & Vedsted, P. (2014) · Scandinavian Journal of Primary Health Care · doi:10.3109/02813432.2014.972067 · Cited by 43 · see citing works
Johnson, K. M., Dumkow, L. E., Burns, K. W., Yee, M. A., & Egwuatu, N. E. (2019) · Open Forum Infectious Diseases · doi:10.1093/ofid/ofz393 · Cited by 39 · see citing works
Comparison of eVisit Management of Urinary Symptoms and Urinary Tract Infections with Standard Care
Murray, M. A., Penza, K. S., Myers, J. F., Furst, J. W., & Pecina, J. L. (2020) · Telemedicine and e-Health · doi:10.1089/tmj.2019.0044 · Cited by 39 · see citing works
Treating pediatric conjunctivitis without an exam: An evaluation of outcomes and antibiotic usage
Penza, K. S., Murray, M. A., Myers, J. F., Maxson, J., Furst, J. W., & Pecina, J. L. (2020) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x18793031 · Cited by 27 · see citing works
Antibiotic prescribing in primary care
Hay, A. D. (2019) · BMJ · doi:10.1136/bmj.l780 · Cited by 23 · see citing works
Sundseth, A. C., Gjelstad, S., Straand, J., & Rosvold, E. O. (2018) · Scandinavian Journal of Primary Health Care · doi:10.1080/02813432.2018.1459164 · Cited by 19 · see citing works
Websites That Offer Care Over the Internet: Is There an Access Quality Tradeoff?
DeJong, C., Santa, J., & Dudley, R. A. (2014) · JAMA · doi:10.1001/jama.2014.1026 · Cited by 18 · see citing works
Rokstad, K., & Straand, J. (1997) · Scandinavian Journal of Primary Health Care · doi:10.3109/02813439709018496 · Cited by 17 · see citing works
Antibiotic prescribing by telephone in primary care
Ewen, E., Willey, V. J., Kolm, P., McGhan, W. F., & Drees, M. (2015) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.3686 · Cited by 14 · see citing works
Does indirect consultation lead to overprescribing in general practice?
Haaijer-Ruskamp, F. M., Stewart, R., & Wesseling, H. (1987) · Social Science & Medicine · doi:10.1016/0277-9536(87)90205-x · Cited by 12 · see citing works
Is it getting easier to obtain antibiotics in the UK?
Hayhoe, B., Greenfield, G., & Majeed, A. (2019) · British Journal of General Practice · doi:10.3399/bjgp19x700829 · Cited by 11 · see citing works
Self-citationDrug prescriptions in Danish out-of-hours primary care: a 1-yearpopulation-based study
Christensen, M. B., Nørøxe, K. B., Moth, G., Vedsted, P., & Huibers, L. (2016) · Scandinavian Journal of Primary Health Care · doi:10.1080/02813432.2016.1248622 · Cited by 8 · see citing works
Flagged first, then by citations
Research works printed but not linked: 2
- World Health Organization,, 2016, Global diffusion of eHealth: making universal health coverage achievable: report of the third global survey on eHealth
- McKinstry, B, 2002, Br J Gen Pract, 52, 306
Cited by
Sorted by citations
Greenhalgh, T., Rosen, R., Shaw, S. E., Byng, R., Faulkner, S., Finlay, T., Grundy, E., Husain, L., Hughes, G., Leone, C., et al. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.726095 · Cited by 173 · see citing works
“Other studies have described problems of increased antimicrobial prescribing (120), reduced ordering of diagnostic investigations (121) and delayed diagnosis of cancer (122, 123) attributed to the pandemic-related shift to remote consultations.”
Babel, A., Taneja, R., Mondello Malvestiti, F., Monaco, A., & Donde, S. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.669869 · Cited by 199 · see citing works
Darley, S., Coulson, T., Peek, N., Moschogianis, S., van der Veer, S. N., Wong, D. C., & Brown, B. C. (2022) · Journal of Medical Internet Research · doi:10.2196/37436 · Cited by 53 · see citing works
Patient safety risk associated with synchronous telehealth: A scoping review
Oliveira, J. S. R. D., Fernandez, R. S., Molina, M. R., Pinto, A. C. P. N., Rocha-Filho, C. R., Ferreira, T. M., & Peres, S. V. (2025) · PLoS One · doi:10.1371/journal.pone.0336992 · Cited by 7 · see citing works
- Authors
- Han, S. M., Greenfield, G., Majeed, A., & Hayhoe, B.
- Affiliations
- Imperial College London (GB)
- Corresponding author
- Greenfield, Geva
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2020-11-09
- Volume
- 22
- Issue
- 11
- Pages
- e23482
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC7655728
- OpenAlex
- W3090542392
- Semantic Scholar
- 6ebf4508ead332794e8d60dc6f03ec8dbfa473e5
- Cited by
- 80
- References
- 29
- Citations by year
- 2026: 7 · 2025: 6 · 2024: 13 · 2023: 17 · 2022: 14 · 2021: 23
- FWCI
- 1.99
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Spiral (Imperial College London) (submittedVersion, cc-by)
- Funders
- National Institute for Health and Care Research (CL-2015-21-008)
- Topics
- Life Sciences › Immunology and Microbiology › Applied Microbiology and Biotechnology › Antibiotic Use and Resistance
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Health Sciences › Health Professions › General Health Professions › Primary Care and Health Outcomes
- Keywords
- teleconsultation, telemedicine, antibiotic prescribing, primary care, face-to-face consultation, guideline-concordant prescribing, sinusitis, acute respiratory infections, follow-up visits, antimicrobial resistance, COVID-19 pandemic
- MeSH terms
- SARS-CoV-2, COVID-19 Drug Treatment, Adult, Anti-Bacterial Agents, Female, Humans, Male, Primary Health Care, Remote Consultation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-06.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-06.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review