Assessment of Health Information Technology Interventions in Evidence-Based Medicine: A Systematic Review by Adopting a Methodological Evaluation Framework
Open accessAbstract
Background: The application of Health Information Technologies (HITs) can be an effective way to advance medical research and health services provision. The two-fold objective of this work is to: (i) identify and review state-of-the-art HITs that facilitate the aims of evidence-based medicine and (ii) propose a methodology for HIT assessment. Methods: The systematic review was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Furthermore, we consolidated existing knowledge in the field and proposed a Synthesis Framework for the Assessment of Health Information Technology (SF/HIT) in order to evaluate the joint use of Randomized Controlled Trials (RCTs) along with HITs in the field of evidence-based medicine. Results: 55 articles met the inclusion criteria and refer to 51 (RCTs) published between 2008 and 2016. Significant improvements in healthcare through the use of HITs were observed in the findings of 31 out of 51 trials—60.8%. We also confirmed that RCTs are valuable tools for assessing the effectiveness, acceptability, safety, privacy, appropriateness, satisfaction, performance, usefulness and adherence. Conclusions: To improve health service delivery, RCTs apply and exhibit formalization by providing measurable outputs. Towards this direction, we propose the SF/HIT as a framework which may help researchers to carry out appropriate evaluations and extend their studies.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The synthesis framework for the assessment of health information technology (SF/HIT) was used to structure the evaluation because it included a whole system set of outcome variables.
“The synthesis framework for the assessment of health information technology (SF/HIT) was used to structure the evaluation of the studies because it included a whole system set of outcome variables [31].”
From The Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review (2020) · cites this paper as [31]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823 · see citing works
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554 · see citing works
Evidence based medicine: what it is and what it isn't
Sackett, D. L., Rosenberg, W. M. C., Gray, J. A. M., Haynes, R. B., & Richardson, W. S. (1996) · BMJ · doi:10.1136/bmj.312.7023.71 · Cited by 15,769 · see citing works
An Experimental Application of the DELPHI Method to the Use of Experts
Dalkey, N., & Helmer, O. (1963) · Management Science · doi:10.1287/mnsc.9.3.458 · Cited by 6,061 · see citing works
Yeh, M. (2014) · Journal of Nursing Research · doi:10.1097/jnr.0000000000000065 · Cited by 3,836 · see citing works
Chaudhry, B., Wang, J., Wu, S., Maglione, M., Mojica, W., Roth, E., Morton, S. C., & Shekelle, P. G. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-10-200605160-00125 · Cited by 3,159 · see citing works
Improving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127 · see citing works
Boulkedid, R., Abdoul, H., Loustau, M., Sibony, O., & Alberti, C. (2011) · PLoS ONE · doi:10.1371/journal.pone.0020476 · Cited by 2,045 · see citing works
Eysenbach, G., & CONSORT-EHEALTH Group (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1923 · Cited by 1,863 · see citing works
Buntin, M. B., Burke, M. F., Hoaglin, M. C., & Blumenthal, D. (2011) · Health Affairs · doi:10.1377/hlthaff.2011.0178 · Cited by 1,311 · see citing works
Häyrinen, K., Saranto, K., & Nykänen, P. (2008) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2007.09.001 · Cited by 1,303 · see citing works
Pop-Eleches, C., Thirumurthy, H., Habyarimana, J. P., Zivin, J. G., Goldstein, M. P., de Walque, D., MacKeen, L., Haberer, J., Kimaiyo, S., Sidle, J., et al. (2011) · AIDS · doi:10.1097/qad.0b013e32834380c1 · Cited by 982 · see citing works
Medical Subject Headings (MeSH).
(2000) · Europe PMC (PubMed Central) · Cited by 789 · see citing works
Blumenthal, D. (2009) · New England Journal of Medicine · doi:10.1056/nejmp0912825 · Cited by 727 · see citing works
The Benefits and Challenges of Using Systematic Reviews in International Development Research
Mallett, R., Hagen-Zanker, J., Slater, R., & Duvendack, M. (2012) · Journal of Development Effectiveness · doi:10.1080/19439342.2012.711342 · Cited by 565 · see citing works
Evidence, hierarchies, and typologies: horses for courses: Table 1
Petticrew, M., & Roberts, H. (2003) · Journal of Epidemiology and Community Health · doi:10.1136/jech.57.7.527 · Cited by 539 · see citing works
Health Information Technology: An Updated Systematic Review With a Focus on Meaningful Use
Jones, S. S., Rudin, R. S., Perry, T., & Shekelle, P. G. (2014) · Annals of Internal Medicine · doi:10.7326/m13-1531 · Cited by 475 · see citing works
Costs And Benefits Of Health Information Technology: New Trends From The Literature
Goldzweig, C. L., Towfigh, A., Maglione, M., & Shekelle, P. (2009) · Health Affairs · doi:10.1377/hlthaff.28.2.w282 · Cited by 375 · see citing works
Angelis, C. D. D., Drazen, J. M., Frizelle, F., Haug, C. J., Hoey, J., Horton, R. C., Kotzin, S., Laine, C. M., Marušić, A., Overbeke, A. J. P. M., et al. (2005) · New England Journal of Medicine · doi:10.1056/nejme058127 · Cited by 354 · see citing works
CBT for depression: a pilot RCT comparing mobile phone vs. computer
Watts, S., Mackenzie, A., Thomas, C., Griskaitis, A., Mewton, L., Williams, A., & Andrews, G. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-49 · Cited by 329 · see citing works
Mobile phones improve antenatal care attendance in Zanzibar: a cluster randomized controlled trial
Lund, S., Nielsen, B. B., Hemed, M., Boas, I. M., Said, A., Said, K., Makungu, M. H., & Rasch, V. (2014) · BMC Pregnancy and Childbirth · doi:10.1186/1471-2393-14-29 · Cited by 301 · see citing works
Proudfoot, J., Clarke, J., Birch, M.-R., Whitton, A. E., Parker, G., Manicavasagar, V., Harrison, V., Christensen, H., & Hadzi-Pavlovic, D. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-312 · Cited by 264 · see citing works
Kearney, N., McCann, L., Norrie, J., Taylor, L., Gray, P., McGee-Lennon, M., Sage, M., Miller, M., & Maguire, R. (2009) · Supportive Care in Cancer · doi:10.1007/s00520-008-0515-0 · Cited by 263 · see citing works
Turner-McGrievy, G., & Tate, D. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1841 · Cited by 263 · see citing works
Jamal, A., McKenzie, K., & Clark, M. (2009) · Health Information Management Journal · doi:10.1177/183335830903800305 · Cited by 222 · see citing works
BEST PRACTICE IN UNDERTAKING AND REPORTING HEALTH TECHNOLOGY ASSESSMENTS
Busse, R., Orvain, J., Garrido, M. V., Perleth, M., Drummond, M., ̈rtner, F. G., Jørgensen, T., Jovell, A. J., Malone, J., ̈ther, A. R., et al. (2002) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462302000284 · Cited by 216 · see citing works
Internet-based cognitive-behavioural therapy for severe health anxiety: randomised controlled trial
Hedman, E., Andersson, G., Andersson, E., Ljótsson, B., Rück, C., Asmundson, G. J. G., & Lindefors, N. (2011) · British Journal of Psychiatry · doi:10.1192/bjp.bp.110.086843 · Cited by 212 · see citing works
Whittaker, R., Dorey, E., Bramley, D. M., Bullen, C., Denny, S., Elley, C. R., Maddison, R., McRobbie, H. J., Parag, V., Rodgers, A., et al. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1553 · Cited by 201 · see citing works
Kropff, J., Favero, S. D., Place, J., Toffanin, C., VISENTIN, R., Monaro, M., Messori, M., Palma, F. D., Lanzola, G., Farret, A., et al. (2015) · The Lancet Diabetes & Endocrinology · doi:10.1016/s2213-8587(15)00335-6 · Cited by 201 · see citing works
McKinstry, B., Hanley, J., Wild, S., Pagliari, C., Paterson, M., Lewis, S., Sheikh, A., Krishan, A., Stoddart, A., & Padfield, P. (2013) · BMJ · doi:10.1136/bmj.f3030 · Cited by 199 · see citing works
Reid, S. C., Kauer, S. D., Hearps, S. J., Crooke, A. H., Khor, A. S., Sanci, L. A., & Patton, G. C. (2011) · BMC Family Practice · doi:10.1186/1471-2296-12-131 · Cited by 192 · see citing works
Gajecki, M., Berman, A. H., Sinadinovic, K., Rosendahl, I., & Andersson, C. (2014) · Addiction Science & Clinical Practice · doi:10.1186/1940-0640-9-11 · Cited by 179 · see citing works
Terrell, K. M., Perkins, A. J., Dexter, P. R., Hui, S. L., Callahan, C. M., & Miller, D. K. (2009) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2009.02352.x · Cited by 162 · see citing works
Whittaker, R., Merry, S., Stasiak, K., McDowell, H., Doherty, I., Shepherd, M., Dorey, E., Parag, V., Ameratunga, S., & Rodgers, A. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1857 · Cited by 161 · see citing works
Goodarzi, M., Ebrahimzadeh, I., Rabi, A. S., Saeedipor, B., & Jafarabadi, M. A. (2012) · Journal of Diabetes & Metabolic Disorders · doi:10.1186/2251-6581-11-10 · Cited by 160 · see citing works
Arora, S., Peters, A. L., Agy, C., & Menchine, M. D. (2012) · Diabetes Technology & Therapeutics · doi:10.1089/dia.2011.0252 · Cited by 147 · see citing works
Turner‐McGrievy, G. M., & Tate, D. F. (2013) · Translational Behavioral Medicine · doi:10.1007/s13142-012-0183-y · Cited by 144 · see citing works
Home telemonitoring in COPD: a systematic review of methodologies and patients’ adherence.
Cruz, J., Brooks, D., & Marques, A. (2014) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2014.01.008 · Cited by 144 · see citing works
Buckingham, B. A., Raghinaru, D., Cameron, F., Bequette, B. W., Chase, H. P., Maahs, D. M., Slover, R. H., Wadwa, R. P., Wilson, D. M., Ly, T. T., et al. (2015) · Diabetes Care · doi:10.2337/dc14-3053 · Cited by 138 · see citing works
Albrecht, U., Folta-Schoofs, K., Behrends, M., & von Jan, U. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2497 · Cited by 135 · see citing works
Effectiveness of a Web-Based Colorectal Cancer Screening Patient Decision Aid
MILLER, D. P., Spangler, J. G., Case, L. D., Goff, D. C., Singh, S., & Pignone, M. P. (2011) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2011.02.019 · Cited by 125 · see citing works
Electronic Alerts Versus On-Demand Decision Support to Improve Dyslipidemia Treatment
van Wyk, J. T., van Wijk, M. A. M., Sturkenboom, M., Mosseveld, M., Moorman, P. W., & van der Lei, J. (2008) · Circulation · doi:10.1161/circulationaha.107.697201 · Cited by 124 · see citing works
Lund, S., Rasch, V., Hemed, M., Boas, I. M., Said, A., Said, K., Makundu, M. H., & Nielsen, B. B. (2014) · JMIR mhealth and uhealth · doi:10.2196/mhealth.2941 · Cited by 120 · see citing works
King, A. C., Bickmore, T. W., Campero, M. I., Pruitt, L. A., & Yin, J. L. (2013) · Journal of Health Communication · doi:10.1080/10810730.2013.798374 · Cited by 114 · see citing works
Bigna, J. J. R., Noubiap, J. J. N., Kouanfack, C., Plottel, C. S., & Koulla-Shiro, S. (2014) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(14)70741-8 · Cited by 109 · see citing works
Clinical Trials Registration and Results Information Submission. Final rule.
(2016) · PubMed · Cited by 101 · see citing works
Computer-Assisted Screening for Intimate Partner Violence and Control
Ahmad, F., Hogg‐Johnson, S., Stewart, D. E., Skinner, H. A., Glazier, R. H., & Levinson, W. S. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-2-200907210-00124 · Cited by 99 · see citing works
Hedman, E., Andersson, E., Lindefors, N., Andersson, G., Rück, C., & Ljótsson, B. (2013) · Psychological Medicine · doi:10.1017/s0033291712001079 · Cited by 98 · see citing works
Kristensen, F. B., Lampe, K., Chase, D. L., Lee-Robin, S. H., Wild, C., Moharra, M., Garrido, M. V., Nielsen, C. P., Røttingen, J., Neikter, S. A., et al. (2009) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462309990626 · Cited by 88 · see citing works
An Electronic Health Record–Based Intervention to Improve Tobacco Treatment in Primary Care
Linder, J. A., Rigotti, N. A., Schneider, L. I., Kelley, J. H. K., Brawarsky, P., & Haas, J. S. (2009) · Archives of Internal Medicine · doi:10.1001/archinternmed.2009.53 · Cited by 83 · see citing works
Tulbure, B. T., Szentagotai, A., David, O., Ștefan, S., Månsson, K. N. T., David, D., & Andersson, G. (2015) · PLOS ONE · doi:10.1371/journal.pone.0123997 · Cited by 81 · see citing works
Tamblyn, R. M., Eguale, T., Buckeridge, D. L., Huang, A. R., Hanley, J., Reidel, K. E., Shi, S., & Winslade, N. E. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000609 · Cited by 81 · see citing works
Iterative development of MobileMums: a physical activity intervention for women with young children
Fjeldsoe, B. S., Miller, Y. D., O’Brien, J. L., & Marshall, A. L. (2012) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-9-151 · Cited by 80 · see citing works
Jonas, W. B. (2001) · Western Journal of Medicine · doi:10.1136/ewjm.175.2.79 · Cited by 74 · see citing works
DeAngelis, C. D., Drazen, J. M., Frizelle, F., Huang, C., Hoey, J., Horton, R., Kotzin, S., Laine, C., Marušić, A., Overbeke, A. J. P. M., et al. (2005) · American Journal of Ophthalmology · doi:10.1016/j.ajo.2005.07.004 · Cited by 74 · see citing works
Stoddart, A., Hanley, J., Wild, S. H., Pagliari, C., Paterson, M., Lewis, S. C., Sheikh, A., Krishan, A., Padfield, P. L., & McKinstry, B. (2013) · BMJ Open · doi:10.1136/bmjopen-2013-002681 · Cited by 71 · see citing works
Sittig, D. F., Gonzalez, D., & Singh, H. (2014) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2014.07.007 · Cited by 70 · see citing works
A mHealth cardiac rehabilitation exercise intervention: findings from content development studies
Dale, L. P., Maddison, R., Whittaker, R., Stewart, R., Kerr, A., Jiang, Y., Kira, G., Carter, K., & Dalleck, L. C. (2012) · BMC Cardiovascular Disorders · doi:10.1186/1471-2261-12-36 · Cited by 68 · see citing works
Study Designs and Systematic Reviews of Interventions: Building Evidence Across Study Designs
Sargeant, J. M., Kelton, D. F., & O'Connor, A. M. C. (2014) · Zoonoses and Public Health · doi:10.1111/zph.12127 · Cited by 64 · see citing works
Kay-Lambkin, F., Baker, A., Lewin, T., & Carr, V. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1522 · Cited by 63 · see citing works
Garrido, G., Barrios, M., Penadés, R., Enríquez, M., Garolera, M., Aragay, N., Pajares, M., Vallès, V., Delgado, L., Alberni, J., et al. (2013) · Schizophrenia Research · doi:10.1016/j.schres.2013.08.025 · Cited by 62 · see citing works
Norman, G. J., Kolodziejczyk, J. K., Adams, M. A., Patrick, K., & Marshall, S. J. (2012) · Preventive Medicine · doi:10.1016/j.ypmed.2012.10.012 · Cited by 58 · see citing works
Suhling, H., Rademacher, J., Zinowsky, I., Fuge, J., Greer, M., Warnecke, G., Smits, J. M., Bertram, A., Haverich, A., Welte, T., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0090828 · Cited by 54 · see citing works
Short, C. E., Vandelanotte, C., Dixon, M. W., Rosenkranz, R. R., Caperchione, C. M., Hooker, C., Karunanithi, M., Kolt, G. S., Maeder, A. J., Ding, H., et al. (2014) · JMIR Research Protocols · doi:10.2196/resprot.2776 · Cited by 51 · see citing works
Ammenwerth, E., Duftschmid, G., Gall, W., Hackl, W. O., Hoerbst, A., Janzek‐Hawlat, S., Jeske, M., Jung, M., Woertz, K., & Dorda, W. (2014) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2014.06.004 · Cited by 47 · see citing works
Lana, A., Ornia, G. F., & López, M. L. (2013) · Preventive Medicine · doi:10.1016/j.ypmed.2013.11.015 · Cited by 43 · see citing works
A Web‐based communication aid for patients with cancer
Meropol, N. J., Egleston, B. L., Buzaglo, J. S., Balshem, A. M., Benson, A. B., Cegala, D. J., Cohen, R. B., Collins, M., Diefenbach, M. A., Miller, S. M., et al. (2013) · Cancer · doi:10.1002/cncr.27874 · Cited by 42 · see citing works
McClure, J. B., Anderson, M. L., Bradley, K. A., An, L. C., & Catz, S. L. (2016) · JMIR mhealth and uhealth · doi:10.2196/mhealth.6002 · Cited by 42 · see citing works
Batch, B. C., Tyson, C. C., Bagwell, J., Corsino, L., Intille, S. S., Lin, P., Lazenka, T., Bennett, G. G., Bosworth, H. B., Voils, C. I., et al. (2014) · Contemporary Clinical Trials · doi:10.1016/j.cct.2014.01.003 · Cited by 40 · see citing works
Computer-Assisted Guidance for Dental Office Tobacco-Cessation Counseling
Rindal, D. B., Rush, W. A., Schleyer, T., Kirshner, M. C., Boyle, R. G., Thoele, M. J., Asche, S. E., Thyvalikakath, T. P., Spallek, H., Durand, E., et al. (2013) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2012.10.023 · Cited by 40 · see citing works
Ybarra, M. L., Korchmaros, J. D., Prescott, T. L., & Birungi, R. (2015) · Annals of Behavioral Medicine · doi:10.1007/s12160-014-9673-0 · Cited by 38 · see citing works
Mbuagbaw, L., Thabane, L., & Ongolo-Zogo, P. (2013) · BMC Research Notes · doi:10.1186/1756-0500-6-131 · Cited by 35 · see citing works
Antypas, K., & Wangberg, S. C. (2014) · JMIR Research Protocols · doi:10.2196/resprot.2725 · Cited by 32 · see citing works
Managing Diabetes in Pregnancy Using Cell Phone/Internet Technology
Bartholomew, M. L., Soules, K., Church, K., Shaha, S. H., Burlingame, J. M., Graham, G. M., Sauvage, L. M., & Žalud, I. (2015) · Clinical Diabetes · doi:10.2337/diaclin.33.4.169 · Cited by 31 · see citing works
Ammenwerth, E., & de Keizer, N. F. (2007) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2276 · Cited by 31 · see citing works
Short message service or disService: Issues with text messaging in a complex medical environment
Wu, R. C., Appel, L., Morra, D. J., Lo, V., Kitto, S. C., & Quan, S. D. (2014) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2014.01.003 · Cited by 30 · see citing works
Development of a taxonomy for health information technology.
Dixon, B. E., Zafar, A., & McGowan, J. J. (2007) · PubMed · Cited by 27 · see citing works
Design of telehealth trials – Introducing adaptive approaches
Law, L. M., & Wason, J. M. S. (2014) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2014.09.002 · Cited by 26 · see citing works
Ramirez, M., Wu, S., Jin, H., Ell, K., Gross-Schulman, S. G., Sklaroff, L. M., & Guterman, J. J. (2016) · JMIR Mental Health · doi:10.2196/mental.4823 · Cited by 25 · see citing works
Evaluation of a Tele-Health System for upper extremity stroke rehabilitation
Kizony, R., Weiss, P. L., Feldman, Y., Shani, M., Elion, O., Kizony, R., Weiss, P. L., Kizony, R., Harel, S., & Baum-Cohen, I. (2013) · International Conference on Virtual Rehabilitation · doi:10.1109/icvr.2013.6662096 · Cited by 23 · see citing works
Voorhees, B. W. V., Hsiung, R. C., Marko-Holguin, M., Houston, T. K., Fogel, J., Lee, R., & Ford, D. E. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2197 · Cited by 21 · see citing works
A Randomized Trial of Computer Kiosk–expedited Management of Cystitis in the Emergency Department
Stein, J. C., Navab, B., Frazee, B., Tebb, K., Hendey, G. W., Maselli, J. H., & Gonzales, R. (2011) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2011.01167.x · Cited by 20 · see citing works
Meltzer, E. O., Kelley, N. J., & Hovell, M. F. (2008) · The Open Respiratory Medicine Journal · doi:10.2174/1874306400802010072 · Cited by 17 · see citing works
Performance of a computer‐based assessment of cognitive function measures in two cohorts of seniors
Espeland, M. A., Katula, J. A., Rushing, J., Kramer, A. F., Jennings, J. M., Sink, K. M., Nadkarni, N. K., Reid, K. F., Castro, C. M., Church, T., et al. (2013) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.3949 · Cited by 16 · see citing works
Crombie, I. K., Falconer, D., Irvine, L. A., Williams, B., Ricketts, I., Humphris, G. M., Norrie, J. D., Rice, P. M., & Slane, P. (2013) · Public Health Research · doi:10.3310/phr01030 · Cited by 16 · see citing works
Ryan, D. P., Musgrave, Pinnock, H., Price, D. B., & Malhotra (2012) · Pragmatic and Observational Research · doi:10.2147/por.s34380 · Cited by 8 · see citing works
Evidence-based health and clinical informatics: a systematic review on randomized controlled trials
Christopoulou, S. C., Kotsilieris, T., & Anagnostopoulos, I. E. (2017) · Health and Technology · doi:10.1007/s12553-016-0170-2 · Cited by 7 · see citing works
Self-citationHow to conduct an appraisal of a senior house officer.
Clancy, M. J. (1999) · Emergency Medicine Journal · doi:10.1136/emj.16.5.371 · Cited by 4 · see citing works
Flagged first, then by citations
2 of the 90 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- [17]Shekelle P.G. Goldzweig C.L. Costs and Benefits of Health Information Technology: An Updated Systematic Review Health Foundation London, UK 2009
- [27]Tang P. Key Capabilities of an Electronic Health Record System Institute of Medicine of the National Academies Washington, DC, USA 2003 25057672
Cited by
Sorted by citations
The Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review
Milne-Ives, M., de Cock, C., Lim, E., Shehadeh, M. H., de Pennington, N., Mole, G., Normando, E., & Meinert, E. (2020) · Journal of Medical Internet Research · doi:10.2196/20346 · Cited by 626 · see citing works
A design and evaluation framework for digital health interventions
Kowatsch, T., Otto, L., Harperink, S., Cotti, A., & Schlieter, H. (2019) · it - Information Technology · doi:10.1515/itit-2019-0019 · Cited by 118 · see citing works
Conversational Agents for Body Weight Management: Systematic Review
Noh, E., Won, J., Jo, S., Hahm, D., & Lee, H. (2023) · Journal of Medical Internet Research · doi:10.2196/42238 · Cited by 34 · see citing works
Kukhareva, P., Weir, C. R., Fiol, G. D., Aarons, G. A., Taft, T., Schlechter, C. R., Reese, T. J., Curran, R. L., Nanjo, C. J., Borbolla, D. A., et al. (2022) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2022.104014 · Cited by 37 · see citing works
Wolff, H. B., Alberts, L., van der Linden, N., Bongers, M. L., Verstegen, N. E., Lagerwaard, F. J., Hofman, F. N., Groot, C. A. U., Senan, S., Sharouni, S. Y. E., et al. (2020) · Lung Cancer · doi:10.1016/j.lungcan.2020.01.011 · Cited by 30 · see citing works
Ogundipe, A., Sim, T. F., & Emmerton, L. (2022) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2022.09.010 · Cited by 22 · see citing works
de Pennington, N., Mole, G., Lim, E., Milne‐Ives, M., Normando, E. M., Xue, K., & Meinert, E. (2021) · JMIR Research Protocols · doi:10.2196/27227 · Cited by 15 · see citing works
Li, M., Liu, S., Yu, B., Li, N., Lyu, A., Yang, H., He, H., Zhang, N., Ma, J., Sun, M., et al. (2025) · Journal of Medical Internet Research · doi:10.2196/63209 · Cited by 12 · see citing works
“The synthesis framework for the assessment of health IT (SF/HIT) was used to structure the evaluation of the studies because it included a whole system set of outcome variables [41].”
Christopoulou, S. C. (2022) · BioMedInformatics · doi:10.3390/biomedinformatics2030032 · Cited by 9 · see citing works
Self-citationHau, J. P., Brasher, P. M. A., Cragg, A., Small, S. S., Wickham, M. E., & Hohl, C. M. (2021) · Trials · doi:10.1186/s13063-021-05061-7 · Cited by 9 · see citing works
Impacts on Context Aware Systems in Evidence-Based Health Informatics: A Review
Christopoulou, S. C. (2022) · Healthcare · doi:10.3390/healthcare10040685 · Cited by 8 · see citing works
Self-citationLópez, A. D. D., Real, J., Meza, C., Borràs-Santos, A., Collado‐Borrell, R., Escudero‐Vilaplana, V., & Gomis‐Pastor, M. (2024) · Healthcare · doi:10.3390/healthcare12232328 · Cited by 7 · see citing works
Ganga, R. N., Santa, K., Ali, M., & Smith, G. (2024) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph21101318 · Cited by 5 · see citing works
Ogundipe, A., Sim, T. F., & Emmerton, L. (2023) · Exploratory Research in Clinical and Social Pharmacy · doi:10.1016/j.rcsop.2023.100252 · Cited by 5 · see citing works
Simms, D. J., Prakash, V., & Garg, L. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-22038-8.00013-1 · Cited by 4 · see citing works
Effective use of information technology for the quality of public health practice
Chinnakali, P., & Kumar, S. S. (2023) · Elsevier eBooks · doi:10.1016/b978-0-323-95356-6.00014-8 · Cited by 3 · see citing works
Benson, R., Kenny, C., Ashraf‐Ganjouei, A., Zhao, M., Darawsheh, R., Qian, A. S., & Hong, J. C. (2025) · JCO Clinical Cancer Informatics · doi:10.1200/cci-25-00112 · Cited by 4 · see citing works
A Holistic Ecosystem for Clinical Protocols and Trials ManagementPreprint
Christopoulou, S. C. (2024) · medRxiv · doi:10.1101/2024.03.10.24304032
Self-citationFerreira, R. J. D. S., Brito, L. C., Amorim, G., Pinto, P., Dezo, F., Dias, D., Monteiro, C. N., Araújo, A. L. D. L. E. S., & Vogeley, A. C. E. (2024) · Metodologias e Aprendizado · doi:10.21166/metapre.v7i1.5088
Health information technology in pharmacy: A concept-mapping approach to evaluation
Ogundipe, A., Sim, T. F., & Emmerton, L. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-44607-8.00017-0
- Authors
- Christopoulou, S., Kotsilieris, T., & Anagnostopoulos, I.
- Affiliations
- University of Thessaly (GR)
- Technological Educational Institute of Peloponnese (GR)
- Corresponding author
- Christopoulou, Stella
- Venue
- Healthcare
- Publisher
- MDPI AG
- Published
- 2018-08-31
- Volume
- 6
- Issue
- 3
- Pages
- 109
- ISSN
- 2227-9032 (ISSN-L)
- PMC
- PMC6165327
- OpenAlex
- W2889463378
- Cited by
- 20
- References
- 90
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 6 · 2023: 3 · 2022: 4 · 2021: 2 · 2020: 2 · 2019: 1
- FWCI
- 0.23
- Type
- journal article
- Language
- en
- Open access
- gold
- dx.doi.org
- Licence
- Locations
- Healthcare (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, other-oa)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- University of Thessaly Institutional Repository (University of Thessaly) (submittedVersion)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Technology and Human Factors in Education and Health
- Keywords
- health information technology, evidence-based medicine, randomized controlled trials, technology effectiveness, privacy, health care delivery
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
