The qualculative dimension of healthcare data interoperability
Open accessAbstract
Research on interoperability and information exchange between information technology systems touts the use of secondary data for a variety of purposes, including research, management, quality improvement, and accountability. However, many studies have pointed out that this is difficult to achieve in practice. Hence, this article aims to examine the causes for this by reporting an ethnographic study of the data work performed by medical records coders and birth certificate clerks working in a hospital system to uncover the practices of creating administrative data (e.g. secondary data). The article illustrates that clerks and coders use situated qualitative judgments of the accuracy and authority of different primary medical accounts. Coders and clerks also employ their understandings of the importance of different future uses of data as they make crucial decisions about how much discretion to exercise in producing accurate data and how much effort to put toward clarifying problematic medical data. These findings suggest that information technology systems designed for interoperability and secondary data also need to be designed in ways that support the qualculative practices of data workers in order to succeed, including making future uses of data clear to data workers and finding ways to minimize conflicting data before data workers encounter it.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The information gives healthcare providers a thorough picture of a patient's medical and social history.
“The information gives healthcare providers a thorough picture of a patient's medical and social history [15].”
From Interoperability of heterogeneous health information systems: a systematic literature review (2023) · cites this paper as [15]
Interoperability solutions are already being used by health systems to help minimize costs and medical errors by easily sharing health data among providers, payers, labs, and others.
“Interoperability solutions are already being used by health systems to assist minimize costs and medical errors by easily sharing health data among providers, payers, labs, and others [15].”
From Interoperability of heterogeneous health information systems: a systematic literature review (2023) · cites this paper as [15]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Basics of Qualitative Research (3rd ed.): Techniques and Procedures for Developing Grounded Theory
Corbin, J., & Strauss, A. (2008) · SAGE · doi:10.4135/9781452230153 · Cited by 12,136 · see citing works
Saturation in qualitative research: exploring its conceptualization and operationalization
Saunders, B., Sim, J., Kingstone, T., Baker, S., Waterfield, J., Bartlam, B., Burroughs, H., & Jinks, C. (2018) · Quality & Quantity · doi:10.1007/s11135-017-0574-8 · Cited by 12,033 · see citing works
Sorting Things Out: Classification and Its Consequences
Bowker, G. C., & Star, S. L. (1999) · doi:10.7551/mitpress/6352.001.0001 · Cited by 6,188 · see citing works
Mining electronic health records: towards better research applications and clinical care
Jensen, P. B., Jensen, L. J., & Brunak, S. (2012) · Nature Reviews Genetics · doi:10.1038/nrg3208 · Cited by 1,680 · see citing works
Weiskopf, N. G., & Weng, C. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000681 · Cited by 1,216 · cited 1× · see citing works
“24 Due to such difficulties with data extraction and ensuring data quality 25 and the effort it takes to overcome them, clinical data from EHRs are not yet widely used for second-order research purposes.”
Background(2013) · The MIT Press eBooks · doi:10.7551/mitpress/9302.001.0001 · Cited by 1,173 · see citing works
Walker, J., Pan, E., Johnston, D., Adler-Milstein, J., Bates, D. W., & Middleton, B. (2005) · Health Affairs · doi:10.1377/hlthaff.w5.10 · Cited by 811 · see citing works
Big Data, Little Data, No Data
Borgman, C. L. (2015) · The MIT Press eBooks · doi:10.7551/mitpress/9963.001.0001 · Cited by 598 · see citing works
Hersh, W. R., Weiner, M. G., Embi, P. J., Logan, J. R., Payne, P. R. O., Bernstam, E. V., Lehmann, H. P., Hripcsak, G., Hartzog, T. H., Cimino, J. J., et al. (2013) · Medical Care · doi:10.1097/mlr.0b013e31829b1dbd · Cited by 567 · see citing works
On Qualculation, Agency, and Otherness
Callon, M., & Law, J. (2005) · Environment and Planning D: Society and Space · doi:10.1068/d343t · Cited by 448 · see citing works
The Multiple Bodies of the Medical Record: Toward a Sociology of an Artifact
Berg, M., & Bowker, G. C. (1997) · Sociological Quarterly · doi:10.1111/j.1533-8525.1997.tb00490.x · Cited by 402 · see citing works
Cochoy, F. (2008) · Marketing Theory · doi:10.1177/1470593107086483 · Cited by 323 · see citing works
Interoperability: The Key To The Future Health Care System
Brailer, D. J. (2005) · Health Affairs · doi:10.1377/hlthaff.w5.19 · Cited by 213 · see citing works
Birnholtz, J. P., & Bietz, M. J. (2003) · doi:10.1145/958160.958215 · Cited by 201 · see citing works
Tang, P. C., Ralston, M., Arrigotti, M. F., Qureshi, L., & Graham, J. (2007) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2198 · Cited by 193 · see citing works
Missing clinical and behavioral health data in a large electronic health record (EHR) system
Madden, J. M., Lakoma, M. D., Rusinak, D., Lu, C. Y., & Soumerai, S. B. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocw021 · Cited by 173 · see citing works
A development framework for semantically interoperable health information systems
López, D. M., & Blobel, B. G. M. E. (2008) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2008.05.009 · Cited by 145 · see citing works
Proceedings of the 2011 iConference
(2011) · doi:10.1145/1940761 · Cited by 144 · see citing works
What Counts? An Ethnographic Study of Infection Data Reported to a Patient Safety Program
Dixon‐Woods, M., Leslie, M., Bion, J., & Tarrant, C. (2012) · Milbank Quarterly · doi:10.1111/j.1468-0009.2012.00674.x · Cited by 144 · see citing works
The Electronic Health Record and its Contribution to Healthcare Information Systems Interoperability
Jardim, S. V. B. (2013) · Procedia Technology · doi:10.1016/j.protcy.2013.12.105 · Cited by 72 · see citing works
Fluids or flows? Information and qualculation in medical practice
Moser, I., & Law, J. (2006) · Information Technology & People · doi:10.1108/09593840610649961 · Cited by 71 · see citing works
Rolland, B., & Lee, C. P. (2013) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2441776.2441826 · Cited by 59 · see citing works
On behalf of the HF Data Project, Mazzali, C., Paganoni, A. M., Ieva, F., Masella, C., Maistrello, M., Agostoni, O., Scalvini, S., & Frigerio, M. (2016) · BMC Health Services Research · doi:10.1186/s12913-016-1489-0 · Cited by 57 · see citing works
A Review of Cross Organizational Healthcare Data Sharing
Azarm, M., Kuziemsky, C., & Peyton, L. (2015) · Procedia Computer Science · doi:10.1016/j.procs.2015.08.363 · Cited by 51 · see citing works
Interoperable support for collaborative, mobile, and accessible health care
Mouttham, A., Kuziemsky, C. E., Langayan, D., Peyton, L., & Pereira, J. L. (2011) · Information Systems Frontiers · doi:10.1007/s10796-011-9296-y · Cited by 51 · see citing works
Cooperative Work and Coordinative Practices
Schmidt, K. (2008) · Computer supported cooperative work · doi:10.1007/978-1-84800-068-1_1 · Cited by 50 · see citing works
Intellectual capital, calculability and qualculation
Rooney, J., & Dumay, J. (2015) · The British Accounting Review · doi:10.1016/j.bar.2015.07.002 · Cited by 46 · see citing works
Layers in Sorting Practices: Sorting out Patients with Potential Cancer
Møller, N. H., & Bjørn, P. (2011) · Computer Supported Cooperative Work (CSCW) · doi:10.1007/s10606-011-9133-3 · Cited by 40 · see citing works
A framework for understanding process interoperability and health information technology
Kuziemsky, C. E., & Peyton, L. (2016) · Health Policy and Technology · doi:10.1016/j.hlpt.2016.02.007 · Cited by 22 · see citing works
Becoming a Good Homecare Practitioner: Integrating Many Kinds of Work
Bratteteig, T., & Eide, I. (2017) · Computer Supported Cooperative Work (CSCW) · doi:10.1007/s10606-017-9288-7 · Cited by 22 · see citing works
Aune, M., Godbolt, Å. L., & Sørensen, K. H. (2016) · Acta Sociologica · doi:10.1177/0001699316657397 · Cited by 20 · see citing works
Interoperability strategies for scientific cyberinfrastructure: Research and practice
Baker, K. S., Ribes, D., Millerand, F., & Bowker, G. C. (2005) · Proceedings of the American Society for Information Science and Technology · doi:10.1002/meet.14504201237 · Cited by 16 · see citing works
Denaxas, S., Asselbergs, F. W., & Moore, J. H. (2016) · BioData Mining · doi:10.1186/s13040-016-0109-1 · Cited by 10 · see citing works
Doria, L. (2013) · Palgrave Macmillan UK eBooks · doi:10.1057/9781137313485 · Cited by 6 · see citing works
Flagged first, then by citations
Research works printed but not linked: 7
- Begoyan A. An overview of interoperability standards for electronic health records. In: Proceedings of the integrated design and process technology, Antalya, 2007. Dallas, TX: Society for Design and Process Science.
- Walker J, Pan E, Johnston D, et al. The value of health care information exchange and interoperability. Health Aff 2005; 24: W5-W10.
- Callon M and Law J. On qualculation, agency, and otherness. Environ Plan D Soc Space 2005; 23(5): 717-733.
- Ryan A and Eklund P. A framework for semantic interoperability in healthcare: a service oriented archi- tecture based on health informatics standards. Stud Health Technol Inform 2008; 136: 759-764.
- Botsis T, Hartvigsen G, Chen F, et al. Secondary use of EHR: data quality issues and informatics oppor- tunities. Summit on Translat Bioinforma 2010; 2010: 1-5.
- Pedersen R and Ellingsen G. The electronic patient record-sufficient quality for clinical research? In: Proceedings ECIS, Helsinki, 9-11 June 2011, pp. 274-286. Helsinki: AIS eLibrary.
- Berg M and Bowker G. The multiple bodies of the medical record. Sociol Quart 1997; 38(3): 513-537.
Cited by
Sorted by citations
Interoperability of heterogeneous health information systems: a systematic literature review
Torab-Miandoab, A., Samad-Soltani, T., Jodati, A., & Rezaei-Hachesu, P. (2023) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-023-02115-5 · Cited by 393 · see citing works
Data work in healthcare: An Introduction
Bossen, C., Pine, K. H., Cabitza, F., Ellingsen, G., & Piras, E. M. (2019) · Health Informatics Journal · doi:10.1177/1460458219864730 · Cited by 153 · see citing works
Self-citationHoeyer, K. (2023) · The MIT Press eBooks · doi:10.7551/mitpress/14926.001.0001 · Cited by 107 · see citing works
Pine, K. H., & Bossen, C. (2020) · Big Data & Society · doi:10.1177/2053951720965616 · Cited by 49 · see citing works
Self-citationPatient data work: filtering and sensing patient‐reported outcomes
Torenholt, R., Saltbæk, L., & Langstrup, H. (2020) · Sociology of Health & Illness · doi:10.1111/1467-9566.13114 · Cited by 37 · see citing works
Bottom-Up Organizing with Tools from On High: Understanding the Data Practices of Labor Organizers
Khovanskaya, V. D., Sengers, P., & Dombrowski, L. S. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376185 · Cited by 31 · see citing works
Data Work and Decision Making in Emergency Medical Services: A Distributed Cognition Perspective
Zhang, Z., Joy, K., Upadhyayula, P., Ozkaynak, M., Harris, R. J., & Adelgais, K. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479500 · Cited by 31 · see citing works
FAIRVASC: A semantic web approach to rare disease registry integration
McGlinn, K., Rutherford, M. A., Gisslander, K., Hederman, L., Little, M. A., & O’Sullivan, D. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105313 · Cited by 25 · see citing works
Data work and practices in healthcare: A scoping review
Bertelsen, P., Bossen, C., Knudsen, C., & Pedersen, A. M. (2024) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2024.105348 · Cited by 14 · see citing works
A New Architecture for Intelligent Clinical Decision Support for Intensive Medicine
Peixoto, H., Guimarães, T. A. S., & Santos, M. F. (2020) · Procedia Computer Science · doi:10.1016/j.procs.2020.03.077 · Cited by 11 · see citing works
Torenholt, R., & Tjørnhøj‐Thomsen, T. (2021) · Social Science & Medicine · doi:10.1016/j.socscimed.2021.114645 · Cited by 10 · see citing works
Leveraging Graph Databases for Enhanced Healthcare Data Management: A Performance Comparison Study
Turhan, S. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386297 · Cited by 10 · see citing works
The role of peri‐operative registries in improving the quality of care in low‐resource environments
Kluyts, H., & Biccard, B. M. (2021) · Anaesthesia · doi:10.1111/anae.15445 · Cited by 9 · see citing works
Paliwal, G., Bunglowala, A., & Kanthed, P. (2022) · Health and Technology · doi:10.1007/s12553-022-00638-x · Cited by 6 · see citing works
The ethics of data interoperability: Mapping problems and strategies in biomedical data and beyond
Caplan, A. B., & Koopman, C. (2025) · Big Data & Society · doi:10.1177/20539517251352815 · Cited by 5 · see citing works
Chuma, K. G. (2025) · Oxford Open Digital Health · doi:10.1093/oodh/oqaf013 · Cited by 4 · see citing works
Rossem, W. R. V., & Pelizza, A. (2025) · Big Data & Society · doi:10.1177/20539517251388349 · Cited by 4 · see citing works
The Myth of Good Data: An Ecosystem Perspective on Data Integrity Breakdown and Rehabilitation
Pine, K. H., & Mazmanian, M. (2025) · MIS Quarterly · doi:10.25300/misq/2025/17587 · Cited by 4 · see citing works
Self-citationZakreuskaya, A., Buschek, D., Mackay, W. E., Avellino, I., Dove, G., & Eskofier, B. M. (2024) · Mensch und Computer (MuC) · doi:10.1145/3670653.3670665 · Cited by 4 · see citing works
Standard Document Development for Health Information Exchange in Korea
Jung, S., Bae, S., Seong, D., & Yi, B.-K. (2022) · Applied Clinical Informatics · doi:10.1055/s-0042-1749331 · Cited by 3 · see citing works
Exploring Metadata Catalogs in Health Care Data Ecosystems: Taxonomy Development Study
Scheider, S., & Mallick, M. K. (2025) · JMIR Formative Research · doi:10.2196/63396 · Cited by 3 · see citing works
Poirier, L., Huang, J., & MacGibbon, C. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732114 · Cited by 2 · see citing works
Wireless standard-compliant e-health solution for elderly people with multiuser identification
Ruiz, I. M., & González, F. J. G. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e15394 · Cited by 2 · see citing works
Digital Legacies and Distressed Capacities
Parkar, K. (2023) · South Asia Multidisciplinary Academic Journal · doi:10.4000/samaj.8744 · Cited by 2 · see citing works
Digital Transformation of Business Model: The Case of Israeli HealthTech
Berman, T., Schallmo, D. R. A., & Willams, C. A. (2024) · Springer proceedings in business and economics · doi:10.1007/978-3-031-47888-8_3 · Cited by 2 · see citing works
Pine, K. H., & Morton, C. H. (2021) · Global maternal and child health · doi:10.1007/978-3-030-54775-2_7
Self-citation(2023) · The MIT Press eBooks · doi:10.7551/mitpress/14926.003.0012
Improving Healthcare Data Usability for Clinicians and Patients
Delaney, S. (2024) · doi:10.32920/26882503
Vashistha, R., & Kumar, K. V. (2025) · International Journal of Innovative Research in Advanced Engineering · doi:10.26562/ijirae.2025.v1202.02
Satu Sehat Interoperability Agent
Martono, H. Y., Yunanto, A. A., & Santoso, D. S. (2024) · International Conference on Information Technology Systems and Innovation · doi:10.1109/icitsi65188.2024.10929376
Karačić, T. (2025) · doi:10.5463/thesis.1051
Torab-Miandoab, A., Samad‐Soltani, T., Jodati, A., & Rezaei‐Hachesu, P. (2023) · Figshare · doi:10.6084/m9.figshare.22612778
Priou, S., Kempf, E., Janković, M., Châtellier, G., & Lamé, G. (2026) · Health Systems · doi:10.1080/20476965.2026.2665355
Health Information Technology, Data, and Algorithms
El‐Azab, S., Moura, I., & Nong, P. (2026) · Wiley eBooks · doi:10.1002/9781394311446.ch13
- Authors
- Pine, K. H.
- Affiliations
- Arizona State University (US)
- Corresponding author
- Pine, Kathleen H
- ORCID
- Pine, Kathleen H
- Venue
- Health Informatics Journal
- Publisher
- SAGE Publications
- Published
- 2019-04-19
- Volume
- 25
- Issue
- 3
- Pages
- 536-548
- ISSN
- 1355-4743 (ISSN-L)
- 1460-4582
- 1741-2811
- OpenAlex
- W2939104293
- Cited by
- 37
- References
- 35
- Citations by year
- 2026: 2 · 2025: 9 · 2024: 6 · 2023: 7 · 2022: 4 · 2021: 4 · 2020: 4 · 2019: 1
- FWCI
- 3.56
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Health Informatics Journal (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Division of Information and Intelligent Systems (1319897)
- Topics
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Nursing › Issues, ethics and legal aspects › Nursing Diagnosis and Documentation
- Keywords
- health data interoperability, secondary data, administrative data, data work, qualitative judgment, data accuracy, discretion, data quality, information technology design
- MeSH terms
- Health Information Interoperability, Anthropology, Cultural, Birth Certificates, Cooperative Behavior, Delivery of Health Care, Humans, Information Systems, Interviews as Topic, Medical Record Administrators, Electronic Health Records, Quality Improvement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
