Exposure to and experiences with a computerized decision support intervention in primary care: results from a process evaluation
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Trials evaluating the effects of interventions usually provide little insight into the factors responsible for (lack of) changes in desired outcomes. A process evaluation alongside a trial can shed light on the mechanisms responsible for the outcomes of a trial. The aim of this study was to investigate exposure to and experiences with a computerized decision support system (CDSS) intervention, in order to gain insight into the intervention's impact and to provide suggestions for improvement. METHODS: A process evaluation was conducted as part of a large-scale cluster-randomized controlled trial investigating the effects of the CDSS NHGDoc on quality of care. Data on exposure to and experiences with the intervention were collected during the trial period among participants in both the intervention and control group - whenever applicable - by means of the NHGDoc server and an electronic questionnaire. Multiple data were analyzed using descriptive statistics. RESULTS: Ninety-nine percent (n = 229) of the included practices generated data for the NHGDoc server and 50 % (n = 116) responded to the questionnaire: both general practitioners (GPs; n = 112; 49 %) and practice nurses (PNs; n = 52; 37 %) participated. The actual exposure to the NHGDoc system and specific heart failure module was limited with 52 % of the GPs and 42 % of the PNs reporting to either never or rarely use the system. Overall, users had a positive attitude towards CDSSs. The most perceived barriers to using NHGDoc were a lack of learning capacity of the system, the additional time and work it requires to use the CDSS, irrelevant alerts, too high intensity of alerts and insufficient knowledge regarding the system. CONCLUSIONS: Several types of barriers may have negatively affected the impact of the intervention. Although users are generally positive about CDSSs, a large share of them is insufficiently aware of the functions of NHGDoc and, finds the decision support not always useful or relevant and difficult to integrate into daily practice. In designing CDSS interventions we suggest to more intensely involve the end-users and increase the system's flexibility and learning capacity. To improve implementation a proper introduction of a CDSS among its target group including adequate training is advocated. TRIAL REGISTRATION: Clinical trials NCT01773057 .
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Process evaluation in randomised controlled trials of complex interventions
Oakley, A., Strange, V., Bonell, C., Allen, E., & Stephenson, J. (2006) · BMJ · doi:10.1136/bmj.332.7538.413 · Cited by 1,247
Overriding of Drug Safety Alerts in Computerized Physician Order Entry
van der Sijs, H., Aarts, J., Vulto, A., & Berg, M. (2006) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1809 · Cited by 1,117
Criteria for evaluating evidence on public health interventions
Rychetnik, L., Frommer, M., Hawe, P., & Shiell, A. (2002) · Journal of Epidemiology and Community Health · doi:10.1136/jech.56.2.119 · Cited by 1,042
Hopewell, S., Clarke, M., Moher, D., Wager, E., Middleton, P., Altman, D. G., Schulz, K. F., & and the CONSORT Group (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050020 · Cited by 674 · cited 1×
“We deliberately chose for this method, as we aimed at both practitioners and patients being blinded to group allocation, which is important in protecting against bias [23, 24].”
Overrides of Medication Alerts in Ambulatory Care
Isaac, T., Weissman, J. S., Davis, R. B., Massagli, M., Cyrulik, A., Sands, D. Z., & Weingart, S. N. (2009) · Archives of Internal Medicine · doi:10.1001/archinternmed.2008.551 · Cited by 309
Taking healthcare interventions from trial to practice
Glasziou, P., Chalmers, I., Altman, D. G., Bastian, H., Boutron, I., Brice, A., Jamtvedt, G., Farmer, A., Ghersi, D., Groves, T., et al. (2010) · BMJ · doi:10.1136/bmj.c3852 · Cited by 209 · cited 1×
“Results of the process evaluation can provide insight in the feasibility and reproducibility of the intervention [14] and can be used to improve the implementation of NHGDoc as well as similar CDSS interventions.”
Cited by
Kilsdonk, E., Peute, L. W., & Jaspers, M. W. M. (2017) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2016.12.001 · Cited by 283
Meunier, P.-Y., Raynaud, C., Guimaraes, E., Gueyffier, F., & Letrilliart, L. (2023) · The Annals of Family Medicine · doi:10.1370/afm.2908 · Cited by 149
Laka, M., Milazzo, A., & Merlin, T. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18041901 · Cited by 78
Zanaboni, P., & Fagerlund, A. J. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-034773 · Cited by 68
Fletcher, E., Burns, A., Wiering, B., Lavu, D., Shephard, E., Hamilton, W., Campbell, J. L., & Abel, G. (2023) · BMC Primary Care · doi:10.1186/s12875-023-01973-2 · Cited by 40
Metadata
- Authors
- Lugtenberg, M., Pasveer, D., van der Weijden, T., Westert, G. P., & Kool, R. B.
- Venue
- BMC Family Practice
- Published
- 2015-10-16
- Volume
- 16
- Issue
- 1
- Pages
- 141-141
- ISSN
- 1471-2296 (ISSN-L)
- OpenAlex
- W2160236013
- Cited by
- 39
- References
- 6
- FWCI
- 3.85
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Exposure to and experiences with a computerized decision support intervention in primary care: results from a process evaluation. https://app.cochat.ai/papers/10.1186/s12875-015-0364-0
- The paper
- Lugtenberg, M., Pasveer, D., van der Weijden, T., Westert, G. P., & Kool, R. B. (2015). Exposure to and experiences with a computerized decision support intervention in primary care: results from a process evaluation. BMC Family Practice. https://doi.org/10.1186/s12875-015-0364-0
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.