Identification of tele-ICU system requirements using a content validity assessment
Abstract
Objectives Telemedicine in intensive care (tele-ICU) involves the use of information technologies to deliver care instructions from a command center to remote hospitals. To ensure acceptance and usability, clinicians should participate early in the design. This study surveyed clinical professionals to identify and rank important functions for a tele-ICU system.Methods This cross-sectional, prospective, structured, two-round survey included European intensive-care professionals that were not familiar with tele-ICU systems. In the first round, statements of system function specifications were evaluated for validity; in the second round, unclear items were rephrased and new items were added. Item-level content validity indexes (I-CVI) were calculated, and values above a 0.75 threshold were considered relevant. Weighted ranking points (WRP) was calculated from the ranking data.Results A total of 26 responses were received from professionals for four European countries; the majority were intensive-care specialists (77%). A total set of 50 items were selected for the survey. Thirty-six functional specifications were identified with I-CVIs above 0.75, including online access to all patient data (13 items), related risks and alarms (8 items), audio-visual contact for consultations and for monitoring patient beds (5 items), information security (5 items), and resource allocation (5 items). The highest ranking system functions were real time monitoring, alarms, audio-visual connections, and data security.Conclusions Professionals not familiar with tele-ICUs regarded full patient data access, alarms, data security, and audio-visual connections the most important functions in pre-implementation phase.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The most disruptive implementation of ICT in intensive care medicine in the recent past has been the introduction of tele-ICUs, which has been accompanied by several staff acceptance studies.
“The most disruptive implementation of ICT in intensive care medicine in the recent past has been the introduction of tele-ICUs, which has been accompanied by several staff acceptance studies [21,52,53].”
From Clinical requirements of future patient monitoring in the intensive care unit: qualitative study (2019) · cites this paper as [53]
Cites
Is the CVI an acceptable indicator of content validity? Appraisal and recommendations
Polit, D. F., Beck, C. T., & Owen, S. V. (2007) · Research in Nursing & Health · doi:10.1002/nur.20199 · Cited by 5,273 · see citing works
Valentin, A., Ferdinande, P., & ESICM Working Group on Quality Improvement (2011) · Intensive Care Medicine · doi:10.1007/s00134-011-2300-7 · Cited by 333 · see citing works
Predictive factors of telemedicine service acceptance and behavioral intention of physicians
Rho, M. J., Choi, I. Y., & Lee, J. (2014) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2014.05.005 · Cited by 260 · see citing works
Impact of Telemedicine Intensive Care Unit Coverage on Patient Outcomes
Young, L. B., Chan, P. S., Lu, X., Nallamothu, B. K., Sasson, C., & Cram, P. M. (2011) · Archives of Internal Medicine · doi:10.1001/archinternmed.2011.61 · Cited by 248 · see citing works
Lilly, C. M., Zubrow, M. T., Kempner, K. M., Reynolds, H. N., Subramanian, S., Eriksson, E. A., Jenkins, C. L., Rincon, T., Kohl, B., Groves, R. H., et al. (2014) · Critical Care Medicine · doi:10.1097/ccm.0000000000000539 · Cited by 161 · see citing works
Impact of an Intensive Care Unit Telemedicine Program on a Rural Health Care System
Zawada, E. T., Herr, P., Larson, D., Fromm, R. E., Kapaska, D., & Erickson, D. (2009) · Postgraduate Medicine · doi:10.3810/pgm.2009.05.2016 · Cited by 112 · see citing works
Staff acceptance of a telemedicine intensive care unit program: A qualitative study
Moeckli, J., Cram, P., Cunningham, C., & Reisinger, H. S. (2013) · Journal of Critical Care · doi:10.1016/j.jcrc.2013.05.008 · Cited by 100 · see citing works
Franzini, L., Sail, K., Thomas, E. J., & Wueste, L. (2011) · Journal of Critical Care · doi:10.1016/j.jcrc.2010.12.004 · Cited by 85 · see citing works
Telemedicine Intervention Improves ICU Outcomes
Sadaka, F. G., Palagiri, A. V., Trottier, S. J., Deibert, W., Gudmestad, D., Sommer, S. E., & Veremakis, C. (2013) · Critical Care Research and Practice · doi:10.1155/2013/456389 · Cited by 71 · see citing works
Bedside Nurses' Perceptions of Intensive Care Unit Telemedicine
Mullen‐Fortino, M., Dimartino, J., Entrikin, L., Mulliner, S. J., Hanson, C. W., & Kahn, J. M. (2011) · American Journal of Critical Care · doi:10.4037/ajcc2012801 · Cited by 68 · see citing works
Khunlertkit, A., & Carayon, P. (2012) · Journal of Critical Care · doi:10.1016/j.jcrc.2012.10.005 · Cited by 62 · see citing works
Different Systems and Formats for Tele-ICU Coverage
Reynolds, H. N., Bander, J. J., & McCarthy, M. S. (2012) · Critical Care Nursing Quarterly · doi:10.1097/cnq.0b013e318266bc26 · Cited by 35 · see citing works
A Business Case for Tele-Intensive Care Units
Coustasse, A., Deslich, S., Bailey, D., Hairston, A., & Paúl, D. (2014) · The Permanente Journal · doi:10.7812/tpp/14-004 · Cited by 35 · see citing works
Resident Perceptions of a Tele-Intensive Care Unit Implementation
Coletti, C., Elliott, D. J., & Zubrow, M. T. (2010) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2010.0040 · Cited by 28 · see citing works
The Effects of Health Information Technology Change Over Time: A Study of Tele-ICU Functions
Woods, D. D., Schweikhart, S. B., Ebright, P. R., Patterson, E. S., & Anders, S. H. (2012) · Applied Clinical Informatics · doi:10.4338/aci-2011-12-ra-0073 · Cited by 16 · see citing works
Levesque, É., Hoti, E., la Serna, S. C. D., Habbouchi, H., Ichaı̈, P., Saliba, F., Samuel, D., & Azoulay, D. (2012) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2012.11.013 · Cited by 11 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Clinical requirements of future patient monitoring in the intensive care unit: qualitative study
Poncette, A.-S., Spies, C., Mosch, L., Schieler, M., Weber-Carstens, S., Krampe, H., & Balzer, F. (2019) · JMIR Medical Informatics · doi:10.2196/13064 · Cited by 136 · see citing works
Jansson, M. M., Liisanantti, J. H., Ala‐Kokko, T., & Reponen, J. (2021) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2021.104680 · Cited by 33 · see citing works
Self-citationMosch, L. K., Poncette, A.-S., Spies, C., Weber‐Carstens, S., Schieler, M., Krampe, H., & Balzer, F. (2021) · JMIR Formative Research · doi:10.2196/22866 · Cited by 36 · see citing works
Jansson, M. M., Ohtonen, P. P., Alalääkkölä, T., Heikkinen, J., Mäkiniemi, M., Lahtinen, S., Lahtela, R., Ahonen, M., Jämsä, S., & Liisantti, J. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-08780-y · Cited by 31 · see citing works
Self-citationAlmathami, H. K. Y., Win, K. T., & Vlahu‐Gjorgievska, E. (2021) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2021.104618 · Cited by 12 · see citing works
Stănescu, A., Gordon, P. E., Copotoiu, S. M., & Boeriu, C. M. (2017) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2017.0037 · Cited by 7 · see citing works
Structure and Design of the Tele-ICU
Fortis, S., & Goede, M. R. (2019) · Springer eBooks · doi:10.1007/978-3-030-11569-2_6 · Cited by 4 · see citing works
Validación exploratoria de un cuestionario de actitudes hacia la estadística con tecnología
Cujba, A., & Pifarré, M. (2024) · Campus Virtuales · doi:10.54988/cv.2024.1.1266 · Cited by 3 · see citing works
Remote Proactive Physiologic Monitoring in the ICU
Ramnath, V. R., & Malhotra, A. (2019) · Springer eBooks · doi:10.1007/978-3-030-11569-2_2 · Cited by 3 · see citing works
Moura, A. B. F., Silva, L. M., Motter, F. R., Silva, I. C., Silva, W. A. S., Leão, B. D. F., Col, S. V. C. D., & Gadenz, S. D. (2023) · Research Square · doi:10.21203/rs.3.rs-3536188/v1
Tele Intensive Care Nursing: A Systematic Review
Alptekin, H. M., YEREBAKAN, A. N., & Akyüz, N. (2025) · Ordu Üniversitesi Hemşirelik Çalışmaları Dergisi · doi:10.38108/ouhcd.1334889
Moura, A. B. F., Motter, F. R., Silva, L. M., Silva, I. C., Silva, W. A. S., Leão, B. D. F., Col, S. V. C. D., & Gadenz, S. D. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1713349
Clausen, C. E., Pant, D., Koposov, R. A., Øystein Nytrø, A., Leventhal, B., Lydersen, S., Westbye, O. S., Røst, T. B., & Skokauskas, N. (2026) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-026-03720-w
- Authors
- Larinkari, S., Liisanantti, J. H., Ala-Lääkkölä, T., Meriläinen, M., Kyngäs, H., & Ala-Kokko, T.
- Affiliations
- Oulu University Hospital (FI)
- University of Oulu (FI)
- Corresponding author
- Liisanantti, Janne H.
- Venue
- International Journal of Medical Informatics
- Publisher
- Elsevier BV
- Published
- 2016-02
- Volume
- 86
- Pages
- 30-36
- ISSN
- 1386-5056 (ISSN-L)
- OpenAlex
- W2183032926
- Cited by
- 13
- References
- 17
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 1 · 2023: 1 · 2022: 1 · 2021: 3 · 2019: 3 · 2017: 1
- FWCI
- 0.36
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Medical Informatics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Oulun Yliopistollinen Sairaala
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Surgery › Healthcare Technology and Patient Monitoring
- Keywords
- tele-ICU, telemedicine, intensive care, system requirements, content validity, real-time patient monitoring, clinical alarm systems, audiovisual communication, data security, resource allocation
- MeSH terms
- Adult, Attitude of Health Personnel, Clinical Competence, Critical Care, Cross-Sectional Studies, Female, Humans, Intensive Care Units, Male, Prospective Studies, Quality of Health Care, Surveys and Questionnaires, Telemedicine, Patient Safety
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review