Patient-specific computer-based decision support in primary healthcare—a randomized trial
Open accessThe DOI matches its Crossref record; 44 of the 45 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Computer-based decision support systems are a promising method for incorporating research evidence into clinical practice. However, evidence is still scant on how such information technology solutions work in primary healthcare when support is provided across many health problems. In Finland, we designed a trial where a set of evidence-based, patient-specific reminders was introduced into the local Electronic Patient Record (EPR) system. The aim was to measure the effects of such reminders on patient care. The hypothesis was that the total number of triggered reminders would decrease in the intervention group compared with the control group, indicating an improvement in patient care. METHODS: From July 2009 to October 2010 all the patients of one health center were randomized to an intervention or a control group. The intervention consisted of patient-specific reminders concerning 59 different health conditions triggered when the healthcare professional (HCP) opened and used the EPR. In the intervention group, the triggered reminders were shown to the HCP; in the control group, the triggered reminders were not shown. The primary outcome measure was the change in the number of reminders triggered over 12 months. We developed a unique data gathering method, the Repeated Study Virtual Health Check (RSVHC), and used Generalized Estimation Equations (GEE) for analysing the incidence rate ratio, which is a measure of the relative difference in percentage change in the numbers of reminders triggered in the intervention group and the control group. RESULTS: In total, 13,588 participants were randomized and included. Contrary to our expectation, the total number of reminders triggered increased in both the intervention and the control groups. The primary outcome measure did not show a significant difference between the groups. However, with the inclusion of patients followed up over only six months, the total number of reminders increased significantly less in the intervention group than in the control group when the confounding factors (age, gender, number of diagnoses and medications) were controlled for. CONCLUSIONS: Computerized, tailored reminders in primary care did not decrease during the 12 months of follow-up time after the introduction of a patient-specific decision support system. TRIAL REGISTRATION: ClinicalTrial.gov NCT00915304.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, after 6 months, the incidence of reminders was significantly lower in the intervention group compared with the control group, especially when the data were adjusted for confounding factors such as age, gender, comorbidities, and medications.”
From The Empirical Foundations of Telemedicine Interventions in Primary Care (2016) · cites this paper as [108]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“After 12 months, the incidence of trigger reminders increased in both intervention and control groups, but overall no differences were observed between the two groups.”
From The Empirical Foundations of Telemedicine Interventions in Primary Care (2016) · cites this paper as [108]
The cited source says what the claim attributes to it.
In the citing paper
“especially when the data were adjusted for confounding factors such as age, gender, comorbidities, and medications.”
From The Empirical Foundations of Telemedicine Interventions in Primary Care (2016) · cites this paper as [108]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2005) · Statistics for Biology and Health · doi:10.1007/0-387-27255-0_9 · Cited by 20,133
Longitudinal data analysis using generalized linear models
LIANG, K.-Y., & ZEGER, S. L. (1986) · Biometrika · doi:10.1093/biomet/73.1.13 · Cited by 18,550
McCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836
(2005) · Cited by 3,748
Assessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309
Garg, A. X., Adhikari, N. K. J., McDonald, H., Rosas-Arellano, M. P., Devereaux, P. J., Beyene, J., Sam, J., & Haynes, R. B. (2005) · JAMA · doi:10.1001/jama.293.10.1223 · Cited by 2,936
Kawamoto, K., Houlihan, C. A., Balas, E. A., & Lobach, D. F. (2005) · BMJ · doi:10.1136/bmj.38398.500764.8f · Cited by 2,703
Akaike's Information Criterion in Generalized Estimating Equations
Pan, W. (2001) · Biometrics · doi:10.1111/j.0006-341x.2001.00120.x · Cited by 2,493
The Impact of eHealth on the Quality and Safety of Health Care: A Systematic Overview
Black, A. D., Car, J., Pagliari, C., Anandan, C., Cresswell, K., Bokun, T., McKinstry, B., Procter, R., Majeed, A., & Sheikh, A. (2011) · PLoS Medicine · doi:10.1371/journal.pmed.1000387 · Cited by 1,442
Generation of allocation sequences in randomised trials: chance, not choice
Schulz, K. F., & Grimes, D. A. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07683-3 · Cited by 774
Research works printed but not linked: 2
- Hojgaard L: Forward look - implementation of medical research in clinical practice. 2011, Strasbourg: European science foundation
- Car J, Black A, Anandan C, Cresswell K, Pagliari C, McKinstry B, Procter R, Majeed A, Sheikh A: The impact of eHealth on the quality & safety of healthcare. A systematic overview & synthesis of the literature. Report for the NHS Connecting for Health Evaluation Programme. 2008, London: Imperial College London
Cited by
The Empirical Foundations of Telemedicine Interventions in Primary Care
Bashshur, R. L., Howell, J. D., Krupinski, E. A., Harms, K. M., Bashshur, N., & Doarn, C. R. (2016) · Telemedicine and e-Health · doi:10.1089/tmj.2016.0045 · Cited by 370
Keyworth, C., Hart, J., Armitage, C. J., & Tully, M. P. (2018) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-018-0661-3 · Cited by 149
Kwag, K. H., González‐Lorenzo, M., Banzi, R., Bonovas, S., & Moja, L. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5234 · Cited by 113
Sönnichsen, A. C., Trampisch, U. S., Rieckert, A., Piccoliori, G., Vögele, A., Flamm, M., Johansson, T., Esmail, A., Reeves, D., Löffler, C., et al. (2016) · Trials · doi:10.1186/s13063-016-1177-8 · Cited by 114
Self-citationMoja, L., Polo Friz, H., Capobussi, M., Kwag, K., Banzi, R., Ruggiero, F., González-Lorenzo, M., Liberati, E. G., Mangia, M., Nyberg, P., et al. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.17094 · Cited by 68
Self-citation
Metadata
- Authors
- Kortteisto, T., Raitanen, J., Komulainen, J., Kunnamo, I., Mäkelä, M., Rissanen, P., & Kaila, M.
- Affiliations
- University of Tampere (FI)
- Urho Kaleva Kekkonen Institute (FI)
- Finnish Medical Society Duodecim (FI)
- University of Helsinki (FI)
- Corresponding author
- Kortteisto, Tiina
- Venue
- Implementation Science
- Published
- 2014-01-20
- Volume
- 9
- Issue
- 1
- Pages
- 15-15
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC3901002
- OpenAlex
- W2170819724
- Semantic Scholar
- 397440f43bb358ce9ae20c21fd77818e43fd9adb
- Cited by
- 27
- References
- 45
- Citations by year
- 2026: 1 · 2025: 2 · 2023: 1 · 2021: 3 · 2019: 3 · 2018: 3 · 2017: 4 · 2016: 6 · 2015: 4
- FWCI
- 8.51
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Implementation Science (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Tampere University Institutional Repository (Tampere University) (publishedVersion)
- Työväentutkimus Vuosikirja (submittedVersion)
- Tampere University Institutional Repository (Tampere University) (submittedVersion)
- STM:n Hallinnonalan avoin julkaisuarkisto (Julkari) (submittedVersion)
- Funders
- Tekes
- Suomalainen Lääkäriseura Duodecim
- Terveyden ja hyvinvoinnin laitos
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Technology and Human Factors in Education and Health
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- computer-based decision support, electronic health records, primary care, evidence-based practice, clinical reminders, generalized estimating equations
- MeSH terms
- Adolescent, Adult, Child, Female, Finland, Humans, Information Systems, Male, Middle Aged, Primary Health Care, Quality of Health Care, Reminder Systems, Decision Support Systems, Clinical, Young Adult, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Patient-specific computer-based decision support in primary healthcare—a randomized trial. https://app.cochat.ai/papers/10.1186/1748-5908-9-15
- The paper
- Kortteisto, T., Raitanen, J., Komulainen, J., Kunnamo, I., Mäkelä, M., Rissanen, P., & Kaila, M. (2014). Patient-specific computer-based decision support in primary healthcare—a randomized trial. Implementation Science. https://doi.org/10.1186/1748-5908-9-15
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.