Integrating Quantitative and Qualitative Methods in Patient Care Information System Evaluation: Guidance for the Organizational Decision Maker
The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Summary: Objective: The aim of this paper is twofold. First, we describe two important dimensions of patient care information systems (PCIS) evaluation: the domain of evaluation and the different phases of the PCIS implementation. Second, we claim that, though Randomized Controlled Trials (RCTs) are often still seen as the standard approach, this type of design hardly generates relevant information for the organizational decision maker. Method: Interpretive study of evaluation literature. Results and Conclusions: The field of evaluation is scattered and the types of questions that can be asked and methods that can be used seem infinite and badly demarcated. Different stakeholders, moreover, often have different priorities in evaluating ICT. The most important reason for the lack of relevance of RCTs is that they are ill suited for investigating why and how a PCIS is being used, or not, and what the (often unplanned) effects and consequences are. Subsequently, our aim is to contribute to the discussion about the viability of qualitative versus quantitative methods in PCIS evaluation, by arguing for a specific integration of quantitative and qualitative research methods. The joint utilization of these methods, we claim, yields the richest results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Pope, C., & Mays, N. (1995) · BMJ · doi:10.1136/bmj.311.6996.42 · Cited by 2,336
Combining IS Research Methods: Towards a Pluralist Methodology
Mingers, J. (2001) · Information Systems Research · doi:10.1287/isre.12.3.240.9709 · Cited by 1,380
Patient care information systems and health care work: a sociotechnical approach
Berg, M. (1999) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(99)00011-8 · Cited by 786 · cited 1×
“, without looking at unplanned organizational changes like improved doctor-nurse communication, reduced waiting times or changes in tasks and responsibilities of staff produces incomplete results [25, 26].”
BackgroundSelf-citationKuperman, G. J., Teich, J. M., Tanasijevic, M. J., Ma'Luf, N., Rittenberg, E., Jha, A., Fiskio, J., Winkelman, J., & Bates, D. W. (1999) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1999.0060512 · Cited by 252
Current evaluations of information technology in health care are often inadequate.
Heathfield, H. A., & Buchan, I. E. (1996) · BMJ · doi:10.1136/bmj.313.7063.1008 · Cited by 29
Cited by
Poissant, L. (2005) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1700 · Cited by 901
Yusof, M. M., Kuljis, J., Papazafeiropoulou, A., & Stergioulas, L. K. (2008) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2007.08.011 · Cited by 740
A rational model for assessing and evaluating complex interventions in health care
May, C. (2006) · BMC Health Services Research · doi:10.1186/1472-6963-6-86 · Cited by 447
Investigating evaluation frameworks for health information systems
Yusof, M. M., Papazafeiropoulou, A., Paul, R. J., & Stergioulas, L. K. (2008) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2007.08.004 · Cited by 304
The SAMS: Smartphone Addiction Management System and Verification
Lee, H., Ahn, H., Choi, S., & Choi, W. (2014) · Journal of Medical Systems · doi:10.1007/s10916-013-0001-1 · Cited by 304
Metadata
- Authors
- Berg, M., & Stoop, A. P.
- Venue
- Methods of Information in Medicine
- Publisher
- Georg Thieme Verlag KG
- Published
- 2003
- Volume
- 42
- Issue
- 04
- Pages
- 458-462
- ISSN
- 0026-1270 (ISSN-L)
- 2511-705X
- OpenAlex
- W77681507
- Cited by
- 117
- References
- 5
- FWCI
- 19.20
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Integrating Quantitative and Qualitative Methods in Patient Care Information System Evaluation: Guidance for the Organizational Decision Maker. https://app.cochat.ai/papers/10.1055/s-0038-1634349
- The paper
- Berg, M., & Stoop, A. P. (2003). Integrating Quantitative and Qualitative Methods in Patient Care Information System Evaluation: Guidance for the Organizational Decision Maker. Methods of Information in Medicine. https://doi.org/10.1055/s-0038-1634349
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.