Undertaking sociotechnical evaluations of health information technologies
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
There is an increasing international recognition that the evaluation of health information technologies should involve assessments of both the technology and the social/organisational contexts into which it is deployed. There is, however, a lack of agreement on definitions, published guidance on how such 'sociotechnical evaluations' should be undertaken, and how they distinguish themselves from other approaches. We explain what sociotechnical evaluations are, consider the contexts in which these are most usefully undertaken, explain what they entail, reflect on the potential pitfalls associated with such research, and suggest possible ways to avoid these.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Crowe, S., Cresswell, K., Robertson, A., Huby, G., Avery, A., & Sheikh, A. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-100 · Cited by 2,697
Self-citationThe Impact of eHealth on the Quality and Safety of Health Care: A Systematic Overview
Black, A. D., Car, J., Pagliari, C., Anandan, C., Cresswell, K., Bokun, T., McKinstry, B., Procter, R., Majeed, A., & Sheikh, A. (2011) · PLoS Medicine · doi:10.1371/journal.pmed.1000387 · Cited by 1,442
Self-citationPatient care information systems and health care work: a sociotechnical approach
Berg, M. (1999) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(99)00011-8 · Cited by 786
Harrison, M. I., Koppel, R., & Bar-Lev, S. (2007) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2384 · Cited by 691
Principles of Sociotechnical Design Revisted
Cherns, A. (1987) · Human Relations · doi:10.1177/001872678704000303 · Cited by 545
GREENHALGH, T., POTTS, H. W. W., WONG, G., BARK, P., & SWINGLEHURST, D. (2009) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2009.00578.x · Cited by 541
Theorising big IT programmes in healthcare: Strong structuration theory meets actor-network theory
Greenhalgh, T., & Stones, R. (2010) · Social Science & Medicine · doi:10.1016/j.socscimed.2009.12.034 · Cited by 371
Greenhalgh, T., Hinder, S., Stramer, K., Bratan, T., & Russell, J. (2010) · BMJ · doi:10.1136/bmj.c5814 · Cited by 343 · cited 3×
“2,14,15 With this in mind, it is, for example, often insufficient to only explore healthcare professional perspectives on technology implementation and adoption; there is also a need to gain insights into managerial and organisational perspectives to get a more rounded understanding of…”
BackgroundSheikh, A., Cornford, T., Barber, N., Avery, A., Takian, A., Lichtner, V., Petrakaki, D., Crowe, S., Marsden, K., Robertson, A., et al. (2011) · BMJ · doi:10.1136/bmj.d6054 · Cited by 314
Self-citationEvaluating eHealth Interventions: The Need for Continuous Systemic Evaluation
Catwell, L., & Sheikh, A. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000126 · Cited by 307 · cited 1×
“…of the complex processes involved in using and implementing technology in social contexts to improve the safety and quality of health-care, 3–9 current sociotechnical approaches somewhat fail to distinguish themselves from other methodologies such as usability testing and…”
BackgroundSelf-citation
Cited by
Cresswell, K. M., Lee, L., Mozaffar, H., Williams, R., Sheikh, A., & on behalf of the NIHR ePrescribing Programme Team (2017) · Health Services Research · doi:10.1111/1475-6773.12581 · Cited by 64
“The resulting dichotomous view surrounding engagement/disengagement and adopters/nonadopters is simplistic and fails to take a longer-term perspective, which takes into account evolving interactions between users and technology (Cresswell and Sheikh 2014).”
BackgroundSelf-citationExperiences with online consultation systems in primary care: case study of one early adopter site
Casey, M., Shaw, S., & Swinglehurst, D. (2017) · British Journal of General Practice · doi:10.3399/bjgp17x693137 · Cited by 41
Abdelaziz, S., Garfield, S., Neves, A. L., Lloyd, J., Norton, J., van Dael, J., Wheeler, C., McLeod, M., & Franklin, B. D. (2024) · BMJ Open · doi:10.1136/bmjopen-2024-089026 · Cited by 19
Metadata
- Authors
- Cresswell, K. M., & Sheikh, A.
- Venue
- Journal of Innovation in Health Informatics
- Publisher
- Portico
- Published
- 2014-03-18
- Volume
- 21
- Issue
- 2
- Pages
- 78-83
- ISSN
- 1475-9985 (ISSN-L)
- 2058-4555
- OpenAlex
- W2130835411
- Cited by
- 52
- References
- 13
- FWCI
- 20.54
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Undertaking sociotechnical evaluations of health information technologies. https://app.cochat.ai/papers/10.14236/jhi.v21i2.54
- The paper
- Cresswell, K. M., & Sheikh, A. (2014). Undertaking sociotechnical evaluations of health information technologies. Journal of Innovation in Health Informatics. https://doi.org/10.14236/jhi.v21i2.54
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.