The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
A systematic review of trials evaluating success factors of interventions with computerised clinical decision support
Open accessAbstract
BACKGROUND: Computerised clinical decision support (CDS) can potentially better inform decisions, and it can help with the management of information overload. It is perceived to be a key component of a learning health care system. Despite its increasing implementation worldwide, it remains uncertain why the effect of CDS varies and which factors make CDS more effective. OBJECTIVE: To examine which factors make CDS strategies more effective on a number of outcomes, including adherence to recommended practice, patient outcome measures, economic measures, provider or patient satisfaction, and medical decision quality. METHODS: We identified randomised controlled trials, non-randomised trials, and controlled before-and-after studies that directly compared CDS implementation with a given factor to CDS without that factor by searching CENTRAL, MEDLINE, EMBASE, and CINAHL and checking reference lists of relevant studies. We considered CDS with any objective for any condition in any healthcare setting. We included CDS interventions that were either displayed on screen or provided on paper and that were directed at healthcare professionals or targeted at both professionals and patients. The reviewers screened the potentially relevant studies in duplicate. They extracted data and assessed risk of bias in independent pairs or individually followed by a double check by another reviewer. We summarised results using medians and interquartile ranges and rated our certainty in the evidence using the GRADE system. RESULTS: We identified 66 head-to-head trials that we synthesised across 14 comparisons of CDS intervention factors. Providing CDS automatically versus on demand led to large improvements in adherence. Displaying CDS on-screen versus on paper led to moderate improvements and making CDS more versus less patient-specific improved adherence modestly. When CDS interventions were combined with professional-oriented strategies, combined with patient-oriented strategies, or combined with staff-oriented strategies, then adherence improved slightly. Providing CDS to patients slightly increased adherence versus CDS aimed at the healthcare provider only. Making CDS advice more explicit and requiring users to respond to the advice made little or no difference. The CDS intervention factors made little or no difference to patient outcomes. The results for economic outcomes and satisfaction outcomes were sparse. CONCLUSION: Multiple factors may affect the success of CDS interventions. CDS may be more effective when the advice is provided automatically and displayed on-screen and when the suggestions are more patient-specific. CDS interventions combined with other strategies probably also improves adherence. Providing CDS directly to patients may also positively affect adherence. The certainty of the evidence was low to moderate for all factors. TRIAL REGISTRATION: PROSPERO, CRD42016033738.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Although previous studies have studied factors affecting the implementation of CDS tools [48], the use of black box models in health care settings presents unique challenges and opportunities related to trust and transparency.”
From Integrating a Machine Learning System Into Clinical Workflows: Qualitative Study (2020) · cites this paper as [48]
In the citing paper
“The WPA in common with WHO advocates for a pragmatic approach to implementing viable alternatives to coercion, 601 one of which is adopting a community-based collaborative care approach that includes shared or supported decisionmaking.”
From Time for united action on depression: a Lancet–World Psychiatric Association Commission (2022) · cites this paper as [601]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
GRADE guidelines: 3. Rating the quality of evidence
Balshem, H., Helfand, M., Schünemann, H. J., Oxman, A. D., Kunz, R., Brozek, J., Vist, G. E., Falck-Ytter, Y., Meerpohl, J., & Norris, S. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.07.015 · Cited by 8,285
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485 · cited 1×
“For studies in which the authors had not defined a primary outcome, we defined the primary outcome as the one that had been used for the sample size calculation [25].”
MethodSelf-citationFrom Triple to Quadruple Aim: Care of the Patient Requires Care of the Provider
Bodenheimer, T., & Sinsky, C. (2014) · The Annals of Family Medicine · doi:10.1370/afm.1713 · Cited by 3,462
Effectiveness and efficiency of guideline dissemination and implementation strategies
Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., et al. (2004) · Health Technology Assessment · doi:10.3310/hta8060 · Cited by 3,044
How should meta‐regression analyses be undertaken and interpreted?
Thompson, S. G., & Higgins, J. P. T. (2002) · Statistics in Medicine · doi:10.1002/sim.1187 · Cited by 3,026
Kawamoto, K., Houlihan, C. A., Balas, E. A., & Lobach, D. F. (2005) · BMJ · doi:10.1136/bmj.38398.500764.8f · Cited by 2,703
GRADE guidelines: 7. Rating the quality of evidence—inconsistency
Guyatt, G. H., Oxman, A. D., Kunz, R., Woodcock, J., Brozek, J., Helfand, M., Alonso-Coello, P., Glasziou, P., Jaeschke, R., Akl, E. A., et al. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.03.017 · Cited by 2,320
Forsetlund, L., Bjørndal, A., Rashidian, A., Jamtvedt, G., O'Brien, M. A., Wolf, F. M., Davis, D., Odgaard-Jensen, J., & Oxman, A. D. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003030.pub2 · Cited by 1,849
Educational outreach visits: effects on professional practice and health care outcomes
O'Brien, M. A., Rogers, S., Jamtvedt, G., Oxman, A. D., Odgaard-Jensen, J., Kristoffersen, D. T., Forsetlund, L., Bainbridge, D., Freemantle, N., Davis, D., et al. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000409.pub2 · Cited by 1,279
Effectiveness and efficiency of guideline dissemination and implementation strategies
Grimshaw, J. M., Thomas, R. E., MacLennan, G., Fraser, C., Ramsay, C. R., Vale, L., Whitty, P., Eccles, M. P., Matowe, L., Shirran, L., et al. (2005) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462305290190 · Cited by 864
Research works printed but not linked: 2
- Fretheim A, Flottorp S, Oxman A. Effect of interventions for implementing clinical practice guidelines. Oslo: Knowledge Centre for the Health Services at The Norwegian Institute of Publich Health (NIPH); 2015. Report from Norwegian Knowledge Centre for the Health Services (NOKC) No. 10-2015. Available from: https://www.ncbi.nlm.nih.gov/books/NBK390571/ .
- EPOC resources for review authors. http://epoc.cochrane.org/resources/epoc-resources-review-authors . Accessed Jan 2016.
Cited by
Sorted by citations
Time for united action on depression: a Lancet–World Psychiatric Association Commission
Herrman, H., Patel, V., Kieling, C., Berk, M., Buchweitz, C., Cuijpers, P., Furukawa, T. A., Kessler, R. C., Kohrt, B. A., Maj, M., et al. (2022) · The Lancet · doi:10.1016/s0140-6736(21)02141-3 · Cited by 1,104
Kwan, J. L., Lo, L., Ferguson, J., Goldberg, H. R., Díaz-Martínez, J. P., TOMLINSON, G. A., Grimshaw, J., & Shojania, K. G. (2020) · BMJ · doi:10.1136/bmj.m3216 · Cited by 493
Jacobs, M., He, J., F. Pradier, M., Lam, B., Ahn, A. C., McCoy, T. H., Perlis, R. H., Doshi-Velez, F., & Gajos, K. Z. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445385 · Cited by 177
Integrating a Machine Learning System Into Clinical Workflows: Qualitative Study
Sandhu, S., Lin, A. L., Brajer, N., Sperling, J., Ratliff, W., Bedoya, A. D., Balu, S., O'Brien, C., & Sendak, M. P. (2020) · Journal of Medical Internet Research · doi:10.2196/22421 · Cited by 168
Chomutare, T., Tejedor, M., Svenning, T. O., Marco-Ruiz, L., Tayefi, M., Lind, K., Godtliebsen, F., Moen, A., Ismail, L., Makhlysheva, A., et al. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph192316359 · Cited by 164
Self-citationKouri, A., Yamada, J., Cheung, J. L. S., de Velde, S. V., & Gupta, S. (2022) · Implementation Science · doi:10.1186/s13012-022-01199-3 · Cited by 135
What Role Can Process Mining Play in Recurrent Clinical Guidelines Issues? A Position Paper
Gatta, R., Vallati, M., Fernández-Llatas, C., Martínez-Millana, A., Orini, S., Sacchi, L., Lenkowicz, J., Marcos, M., Muñoz-Gama, J., Cuendet, M. A., et al. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17186616 · Cited by 73
Self-citationKawamoto, K., & McDonald, C. J. (2020) · Annals of Internal Medicine · doi:10.7326/m19-0875 · Cited by 72
Klarenbeek, S. E., Weekenstroo, H. H. A., Sedelaar, J. P. M., Fütterer, J. J., Prokop, M., & Tummers, M. (2020) · Cancers · doi:10.3390/cancers12041032 · Cited by 74
Chen, W., O’Bryan, C. M., Gorham, G., Howard, K., Balasubramanya, B., Coffey, P., Abeyaratne, A., & Cass, A. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00326-x · Cited by 69
Electronic Health Records and Use of Clinical Decision Support
Mills, S. (2019) · Critical Care Nursing Clinics of North America · doi:10.1016/j.cnc.2019.02.006 · Cited by 61
Heselmans, A., Delvaux, N., Laenen, A., de Velde, S. V., Ramaekers, D., Kunnamo, I., & Aertgeerts, B. (2020) · Implementation Science · doi:10.1186/s13012-019-0955-6 · Cited by 60
Self-citationTrinkley, K. E., Kahn, M. G., Bennett, T. D., Glasgow, R. E., Haugen, H. A., Kao, D. P., Kroehl, M., Lin, C., Malone, D. C., & Matlock, D. D. (2020) · Journal of Medical Internet Research · doi:10.2196/19676 · Cited by 56
Harry, M. L., Truitt, A. R., Saman, D. M., Henzler-Buckingham, H. A., Allen, C. I., Walton, K. M., Ekstrom, H. L., O’Connor, P. J., Sperl‐Hillen, J. M., Bianco, J. A., et al. (2019) · BMC Health Services Research · doi:10.1186/s12913-019-4326-4 · Cited by 53
Doherty, E. L., Wiggers, J., Wolfenden, L., Anderson, A., Crooks, K., Tsang, T. W., Elliott, E. J., Dunlop, A. J., Attia, J., Dray, J., et al. (2019) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-019-2436-y · Cited by 46
Muylle, K. M., Gentens, K., Dupont, A. G., & Cornu, P. (2021) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2021.104393 · Cited by 45
Venkateswaran, M., Ghanem, B., Abbas, E., Khader, K. A., Ward, I. A., Awwad, T., Baniode, M., Frost, M. J., Hijaz, T., Isbeih, M., et al. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(21)00269-7 · Cited by 43
Kawamoto, K., Kukhareva, P., Shakib, J. H., Kramer, H., Rodriguez-Loya, S., Warner, P. B., Shields, D. E., Weir, C. R., Fiol, G. D., Taft, T., et al. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.15343 · Cited by 41
Paskins, Z., Roldan, V. D. T., Hawarden, A., Bullock, L., Urtecho, M., Torres, G. F., Morera, L., Suárez, N. R. E., Worrall, A., Blackburn, S. J., et al. (2020) · Osteoporosis International · doi:10.1007/s00198-020-05479-w · Cited by 41
Damoiseaux‐Volman, B. A., van der Velde, N., Ruige, S. G., Romijn, J. A., Abu–Hanna, A., & Medlock, S. K. (2021) · JMIR Medical Informatics · doi:10.2196/28023 · Cited by 42
White, N. M., Carter, H. E., Kularatna, S., Borg, D. N., Brain, D., Tariq, A., Abell, B., Blythe, R. D., & McPhail, S. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad040 · Cited by 40
Chen, W., Howard, K., Gorham, G., O’Bryan, C. M., Coffey, P., Balasubramanya, B., Abeyaratne, A., & Cass, A. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocac110 · Cited by 41
Identification of Uncontrolled Symptoms in Cancer Patients Using Natural Language Processing
DiMartino, L., Miano, T., Wessell, K. L., Bohac, B., & Hanson, L. C. (2021) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2021.10.014 · Cited by 37
Interrupting providers with clinical decision support to improve care for heart failure
Blecker, S., Austrian, J. S., Horwitz, L. I., Kuperman, G. J., Shelley, D., Ferrauiola, M., & Katz, S. D. (2019) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2019.103956 · Cited by 34
Derksen, C., Walter, F. M., Akbar, A. B., Parmar, A. V. E., Saunders, T. S., Round, T., Rubin, G. P., & Scott, S. E. (2025) · Implementation Science · doi:10.1186/s13012-025-01445-4 · Cited by 34
Jacques Bouaud, A., Sylvia Pelayo, A., Lamy, J.-B., Prebet, C., Ngô, C., Teixeira, L., Guézennec, G., & Brigitte Séroussi, A. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101922 · Cited by 30
Hunter, B., Biezen, R., Alexander, K., Lumsden, N. G., Hallinan, C. M., Wood, A., McMorrow, R., Jones, J., Nelson, C., & Manski-Nankervis, J.-A. E. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-040228 · Cited by 30
Stagg, B. C., Stein, J. D., Medeiros, F. A., Wirostko, B. M., Crandall, A. S., Hartnett, M. E., Cummins, M. R., Morris, A. H., Hess, R., & Kawamoto, K. (2020) · Ophthalmology Glaucoma · doi:10.1016/j.ogla.2020.08.006 · Cited by 29
Walraven, J. E. W., Verhoeven, R. H. A., van der Meulen, R., van der Hoeven, J. J. M., Lemmens, V. E. P. P., Hesselink, G., & Desar, I. M. E. (2023) · BMJ Open Quality · doi:10.1136/bmjoq-2022-002130 · Cited by 28
Klarenbeek, S. E., Schuurbiers-Siebers, O. C. J., van den Heuvel, M. M., Prokop, M., & Tummers, M. (2020) · Biology · doi:10.3390/biology10010009 · Cited by 28
Reflection Machines: Supporting Effective Human Oversight Over Medical Decision Support Systems
Haselager, P., Schraffenberger, H., Thill, S., Fischer, S. W. S., Lanillos, P., van de Groes, S., & van Hooff, M. L. (2023) · Cambridge Quarterly of Healthcare Ethics · doi:10.1017/s0963180122000718 · Cited by 27
Gatta, R., Vallati, M., Fernández-Llatas, C., Martínez-Millana, A., Orini, S., Sacchi, L., Lenkowicz, J., Marcos, M., Muñoz-Gama, J., Cuendet, M. A., et al. (2019) · Lecture notes in business information processing · doi:10.1007/978-3-030-37453-2_44 · Cited by 26
Self-citationClinical Decision Support for Laboratory Testing
Hughes, A. E. O., & Jackups, R. (2021) · Clinical Chemistry · doi:10.1093/clinchem/hvab201 · Cited by 26
Quality-in-use characteristics for clinical decision support system assessment
Souza-Pereira, L., Ouhbi, S., & Pombo, N. G. C. C. (2021) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2021.106169 · Cited by 25
Söling, S., Köberlein–Neu, J., Müller, B. S., Dinh, T. S., Muth, C., Pfaff, H., Karbach, U., AdAM Study Group, Kellermann-Mühlhoff, P., Düvel, L., et al. (2020) · Implementation Science · doi:10.1186/s13012-020-01043-6 · Cited by 24
Artificial intelligence in the GPs office: a retrospective study on diagnostic accuracy
Ellertsson, S., Loftsson, H., & Sigurðsson, E. L. (2021) · Scandinavian Journal of Primary Health Care · doi:10.1080/02813432.2021.1973255 · Cited by 25
Akhloufi, H., van der Sijs, H., Melles∗, D. C., van der Hoeven, C. P., Vogel, M., Mouton, J. W., & Verbon, A. (2022) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-022-01860-3 · Cited by 24
A systematic review of theoretical constructs in CDS literature
Liu, S., Reese, T. J., Kawamoto, K., Fiol, G. D., & Weir, C. R. (2021) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-021-01465-2 · Cited by 23
Røst, T. B., Clausen, C. E., Øystein Nytrø, A., Koposov, R. A., LEVENTHAL, B. L., Westbye, O. S., Bakken, V., Flygel, L. H. K., Koochakpour, K., & Skokauskas, N. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.564205 · Cited by 22
Hoffmann, M., Stichele, R. V., Bates, D. W., Björklund, J., Alexander, S., Andersson, M. L., Auraaen, A., Bennie, M., Dahl, M., Eiermann, B., et al. (2020) · Expert Review of Clinical Pharmacology · doi:10.1080/17512433.2020.1805314 · Cited by 24
Self-citationNothacker, M., Busse, R., Elsner, P. U., Fölsch, U. R., Gogol, M., Jungehulsing, G. J., Kopp, I., Marckmann, G., Maschmann, J., Meyer, H., et al. (2019) · DMW - Deutsche Medizinische Wochenschrift · doi:10.1055/a-0891-3940 · Cited by 21
Chen, J., Chokshi, S. K., Hegde, R., González, J., Iturrate, E., Aphinyanaphongs, Y., & Mann, D. (2020) · Journal of Medical Internet Research · doi:10.2196/16848 · Cited by 24
Jeffries, M., Salema, N.-E., Laing, L., Shamsuddin, A., Sheikh, A., Avery, A. J., Chuter, A., Waring, J. J., & Keers, R. N. (2021) · PLoS ONE · doi:10.1371/journal.pone.0250946 · Cited by 19
Liu, S., Reese, T. J., Kawamoto, K., Fiol, G. D., & Weir, C. R. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab160 · Cited by 18
Accuracy of Risk Estimates from the iPrevent Breast Cancer Risk Assessment and Management Tool
Phillips, K., Liao, Y., Milne, R. L., MacInnis, R. J., Collins, I. M., Buchsbaum, R., Weideman, P. C., Bickerstaffe, A., Nesci, S., Chung, W. K., et al. (2019) · JNCI Cancer Spectrum · doi:10.1093/jncics/pkz066 · Cited by 17
Lin, L. K., Alam, P., Fearon, E., & Hargreaves, J. (2020) · Implementation Science · doi:10.1186/s13012-020-01018-7 · Cited by 17
Thompson, C. A., Mebrahtu, T. F., Skyrme, S., Bloor, K. E., Andre, D., Keenan, A., Ledward, A., Yang, H., & Randell, R. (2023) · Health and Social Care Delivery Research · doi:10.3310/grnm5147 · Cited by 19
Clinical Decision Support System in laboratory medicine
Flores, E., Martínez-Racaj, L., Torreblanca, R., Blasco, Á., López‐Garrigós, M., Gutiérrez, I., & Salinas, M. (2023) · Clinical Chemistry and Laboratory Medicine (CCLM) · doi:10.1515/cclm-2023-1239 · Cited by 17
Ma, J., Zhou, H., Fu, Q., & Lü, G. (2023) · BMC Public Health · doi:10.1186/s12889-023-15201-0 · Cited by 19
Muylle, K. M., Gentens, K., Dupont, A. G., & Cornu, P. (2019) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2019.104013 · Cited by 17
Coninck, L. D., Declercq, A., Bouckaert, L., Döpp, C. M. E., Graff, M. J. L., & Aertgeerts, B. (2024) · BMC Geriatrics · doi:10.1186/s12877-024-04797-6 · Cited by 16
Self-citationSöling, S., Demirer, I., Köberlein–Neu, J., Hower, K. I., Müller, B. S., Pfaff, H., Karbach, U., & AdAM Study Group (2023) · BMC Family Practice · doi:10.1186/s12875-023-02081-x · Cited by 14
Murphy, M. E., McSharry, J., Byrne, M., Boland, F., Corrigan, D., Gillespie, P., Fahey, T. P., & Smith, S. M. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-032594 · Cited by 14
Elchynski, A. L., Desai, N., D’Silva, D., Hall, B., Marks, Y., Wiisanen, K., Cicali, E. J., Cavallari, L. H., & Nguyen, K. A. (2021) · Journal of Personalized Medicine · doi:10.3390/jpm11111227 · Cited by 13
Knowledge-Based Decision Support in Healthcare via Near Field Communication
Loseto, G., Scioscia, F., Ruta, M., Gramegna, F., Ieva, S., Pinto, A., & Scioscia, C. (2020) · Sensors · doi:10.3390/s20174923 · Cited by 13
García-García, J. A., Carrero, M., Escalona, M. J., & Lizcano, D. (2023) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2023.104573 · Cited by 12
Brunner, J., Farmer, M. M., Bean‐Mayberry, B., Coffinier, C., Than, C. T., Hamilton, A. B., & Finley, E. P. (2022) · Frontiers in Health Services · doi:10.3389/frhs.2022.946802 · Cited by 12
Lakha, S., Levin, M. A., Leibowitz, A. B., Lin, H., & Gal, J. S. (2020) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000004546 · Cited by 12
Biffi, A., Castellini, G., Castillo, G. D., Nard, F. D., Vismara, C., Cabitza, F., Corrao, G., & Gianola, S. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.106220 · Cited by 11
Snyder, M. E., Jaynes, H. A., Gernant, S. A., Diiulio, J., Militello, L. G., Doucette, W. R., Adeoye‐Olatunde, O. A., & Russ, A. L. (2019) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-019-0866-0 · Cited by 11
Mebrahtu, T. F., Bloor, K. E., Ledward, A., Keenan, A., Andre, D., Randell, R., Skyrme, S., Yang, H., King, H., & Thompson, C. A. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd014699 · Cited by 11
Oluoch, T., Ronald Cornet, A., Muthusi, J., Katana, A., Kimanga, D. O., Kwaro, D., Okeyo, N. O., Abu–Hanna, A., & de Keizer, N. F. (2021) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-021-01718-0 · Cited by 11
Association of Electronic Prescribing of Controlled Substances With Opioid Prescribing Rates
Everson, J., Cheng, A. K., Patrick, S. W., & Dusetzina, S. B. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.27951 · Cited by 11
The Effects of Different Vertical Air Temperatures on Mental Performance
Tanaka, M., Ohnaka, T., Yamazaki, S., & Tochihara, Y. (1987) · American Industrial Hygiene Association Journal · doi:10.1080/15298668791385093 · Cited by 11
Cornell, S., Doust, J. A., Morgan, M. A. J., Greaves, K., Hawkes, A. L., de Wet, C., O’Connor, D. A., & Bonner, C. (2023) · PEC Innovation · doi:10.1016/j.pecinn.2023.100140 · Cited by 10
Interests and needs of eye care providers in clinical decision support for glaucoma
Stagg, B. C., Stein, J. D., Medeiros, F. A., Cummins, M. R., Kawamoto, K., & Hess, R. (2021) · BMJ Open Ophthalmology · doi:10.1136/bmjophth-2020-000639 · Cited by 10
Graber, J., Kittelson, A. J., Juarez‐Colunga, E., Jin, X., Bade, M., & Stevens‐Lapsley, J. E. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocac123 · Cited by 10
Román-Villarán, E., Álvarez-Romero, C., Martínez-García, A., Escobar-Rodríguez, G. A., García-Lozano, M. J., Barón‐Franco, B., Moreno-Gaviño, L., Moreno-Conde, J., Rivas-González, J. A., & Parra-Calderón, C. L. (2022) · JMIR Formative Research · doi:10.2196/27990 · Cited by 10
A scoping review of clinical decision support systems for child and adolescent mental health
Bertie, L., McDermott, E. A., Quiroz, J. C., & Hudson, J. L. (2025) · Current Psychology · doi:10.1007/s12144-025-07365-2 · Cited by 9
Muylle, K. M., Laere, S. V., Pannone, L., Coenen, S., de Asmundis, C., Dupont, A. G., & Cornu, P. (2022) · British Journal of Clinical Pharmacology · doi:10.1111/bcp.15580 · Cited by 9
Adaptive bolus calculators for people with type 1 diabetes: A systematic review
Unsworth, R., Avari, P., Lett, A. M., Oliver, N. S., & Reddy, M. (2023) · Diabetes Obesity and Metabolism · doi:10.1111/dom.15204 · Cited by 8
Soames, J., & Pettigrew, L. M. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-080546 · Cited by 8
Saman, D. M., Chrenka, E. A. B., Harry, M. L., Allen, C. I., Freitag, L. A., Asche, S. E., Truitt, A. R., Ekstrom, H. L., O’Connor, P. J., Sperl‐Hillen, J. M., et al. (2021) · BMC Health Services Research · doi:10.1186/s12913-021-06551-9 · Cited by 8
Clinical Performance Feedback and Decision Support
Ivers, N. M., Brown, B. C., & Grimshaw, J. (2020) · Wiley eBooks · doi:10.1002/9781119488620.ch13 · Cited by 8
Abuzour, A. S., Wilson, S. A., Woodall, A., Mair, F. S., Aslam, A., Clegg, A., Shantsila, E., Gabbay, M., Abaho, M., Bollegala, D., et al. (2025) · Journal of Medical Internet Research · doi:10.2196/74304 · Cited by 7
Marcial, L. H., Blumenfeld, B. H., Harle, C. A., Jing, X., Keller, M. S., Lee, V., Lin, Z., Dover, A., Midboe, A. M., Al-Showk, S., et al. (2019) · PubMed Central · Cited by 7
Self-citationGruss, C. L., Kappen, T. H., Fowler, L. C., Li, G., Freundlich, R. E., McEvoy, M. D., Rothman, B. S., Sandberg, W. S., & Wanderer, J. P. (2023) · Journal of Clinical Anesthesia · doi:10.1016/j.jclinane.2023.111081 · Cited by 7
Integration of Risk Scores and Integration Capability in Electronic Patient Records
Heider, A.-K., & Mang, H. (2022) · Applied Clinical Informatics · doi:10.1055/s-0042-1756367 · Cited by 7
Chang, T. S., Buchipudi, A., Fonarow, G. C., Pfeffer, M. A., Singer, J. S., & Cheng, E. M. (2019) · Applied Clinical Informatics · doi:10.1055/s-0039-1692186 · Cited by 8
Stonesifer, C. J., Crusco, S., & Rajupet, S. R. (2021) · Tobacco Prevention & Cessation · doi:10.18332/tpc/131823 · Cited by 7
Lindell, O. P., Karlsson, L., Nilsson, S., Charitakis, E., Hagström, E., Muhr, T., Nilsson, L. E., Henriksson, M., & Janzon, M. (2022) · American Heart Journal · doi:10.1016/j.ahj.2022.02.005 · Cited by 7
Wohlgemut, J. M., Pisirir, E., Stoner, R. S., Perkins, Z., Marsh, W., Tai, N. R. M., & Kyrimi, E. (2024) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-024-02739-1 · Cited by 6
Sistemas de apoio à decisão clínica e desfecho clínico na Atenção Primária à Saúde
Silva, D. F. J., Hattori, W. T., & Bonito, R. F. (2022) · Revista de APS · doi:10.34019/1809-8363.2022.v25.35484 · Cited by 6
Mazurenko, O., McCord, E., McDonnell, C., Apathy, N. C., Sanner, L. M., Adams, M. C. B., Mamlin, B. W., Vest, J. R., Hurley, R. W., & Harle, C. A. (2023) · JAMIA Open · doi:10.1093/jamiaopen/ooad063 · Cited by 6
Cucchi, E. W., Burzynski, J., Marshall, N., & Greenberg, B. (2024) · JAMIA Open · doi:10.1093/jamiaopen/ooae143 · Cited by 5
de Rezende, V. M. L. R., Borges, I. N., Ravetti, C. G., de Souza, R. P., Vassallo, P. F., Caldas, A. C. D. P., Gatto, F. R., Okamura, G. H., Lacerda, R. L. D. B., Póvoa, P. M. S. R., et al. (2025) · BMJ Open · doi:10.1136/bmjopen-2024-084981 · Cited by 5
Scaling out a Digital-First Behavioral Health Care Model to Primary Care
Youn, S. J., Schuler, K. L., Sah, P., Jaso, B. A., Pennine, M., O’Dea, H., Eyllon, M., Barnes, J. B., Murillo, L., Orth, L., et al. (2025) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-025-01433-2 · Cited by 5
Leitch, S. V., Zeng, J., Smith, A. J., & Stokes, T. (2021) · International Journal for Equity in Health · doi:10.1186/s12939-021-01461-y · Cited by 5
Atlas, S. J., Burdick, T. E., Wright, A. T., Zhao, W., Hort, S. J., Aman, D. G., Thillaiyapillai, M., Orav, E. J., Wint, A. J., Smith, R. E., et al. (2025) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2025.104908 · Cited by 4
Harnessing Electronic Medical Records in Cardiovascular Clinical Practice and Research
Gouda, P., & Ezekowitz, J. A. (2022) · Journal of Cardiovascular Translational Research · doi:10.1007/s12265-022-10313-1 · Cited by 4
da Fonseca, S. F., Ribeiro, A. L. P., Cimini, C. C. R., Soares, T. B. D. C., Delfino-Pereira, P., Nogueira, L. T., de Moura, R. M. F., Motta‐Santos, D., Ribeiro, L. B., Camargos, M., et al. (2023) · American Heart Journal · doi:10.1016/j.ahj.2023.04.006 · Cited by 4
Graber, J., Hinrichs‐Kinney, L., Churchill, L., Matlock, D. D., Kittelson, A. J., Lutz, A. D., Bade, M., & Stevens‐Lapsley, J. E. (2025) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.70028 · Cited by 4
Decision support for Scotland’s health and social care: learning from an outcomes-focused approach
Wales, A. (2020) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2019-100124 · Cited by 4
Gerdesköld, C., Toth-Pal, E., Wårdh, I., Nilsson, G. H., & Nager, A. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-01313-9 · Cited by 4
Ullah, A., William, W., Bradley, F., Nelson, P. A., Dowding, D., Morciano, M., & Cullum, N. A. (2023) · BMC Infectious Diseases · doi:10.1186/s12879-022-07939-6 · Cited by 4
Fedele, D. A., Ray, J. M., Mallela, J. L., Bian, J., Chen, A., Qin, X., Salloum, R. G., Kelly, M. N., Gurka, M. J., & Hollenbach, J. P. (2025) · JMIR Formative Research · doi:10.2196/65794 · Cited by 3
Saini, S. K., & Sunil, D. (2025) · International Journal of Environmental Sciences · doi:10.64252/0e30q322 · Cited by 3
An inventory of policy levers to reduce low value care: Results of a rapid scoping review
Warkentin, L. M., Tjosvold, L., & Bond, K. (2025) · Health Policy · doi:10.1016/j.healthpol.2025.105508 · Cited by 3
van Staa, T. P., Pirmohamed, M., Sharma, A. K., Buchan, I. E., & Ashcroft, D. M. (2022) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.2807 · Cited by 3
Supporting quality and safety in general practice: Response rates to computer decision support
Davies, D., Morgan, M. A. J., & de Wet, C. (2022) · Australian Journal of General Practice · doi:10.31128/ajgp-08-21-6112 · Cited by 3
Metadata
- Authors
- Van de Velde, S., Heselmans, A., Delvaux, N., Brandt, L., Marco-Ruiz, L., Spitaels, D., Cloetens, H., Kortteisto, T., Roshanov, P., Kunnamo, I., Aertgeerts, B., Vandvik, P. O., & Flottorp, S.
- Affiliations
- KU Leuven (BE)
- University of Oslo (NO)
- Tampere University Hospital (FI)
- McMaster University (CA)
- Finnish Medical Society Duodecim (FI)
- Norwegian Institute of Public Health (NO)
- ORCID
- Venue
- Implementation Science
- Published
- 2018-08-20
- Volume
- 13
- Issue
- 1
- Pages
- 114-114
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC6102833
- OpenAlex
- W2888668484
- Cited by
- 156
- References
- 40
- Citations by year
- 2026: 11 · 2025: 14 · 2024: 14 · 2023: 18 · 2022: 26 · 2021: 20 · 2020: 35 · 2019: 15 · 2018: 1
- FWCI
- 3.28
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Implementation Science (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- BIBSYS Brage (BIBSYS (Norway)) (acceptedVersion, cc-by-nc-sa)
- Lirias (KU Leuven) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- NORA - Norwegian Open Research Archives (submittedVersion, other-oa)
- NORA - Norwegian Open Research Archives (submittedVersion, cc-by-nc-sa)
- NORA - Norwegian Open Research Archives (submittedVersion, cc-by)
- Funders
- Horizon 2020 (654981)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- computerized clinical decision support, success factors, patient satisfaction, economic outcomes, learning healthcare systems
- MeSH terms
- Decision Support Techniques, Humans, Quality of Life, Randomized Controlled Trials as Topic, Decision Support Systems, Clinical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review

