Putting patient-reported outcomes on the ‘Big Data Road Map’.
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The recent advance of telehealth has greatly increased the availability of patient-reported data collection (e.g., pain surveys on smartphone apps) [58], but certain patient groups may have lower (digital) health literacy or may be less able to self-report health outcomes.”
From Bias in medical AI: Implications for clinical decision-making (2024) · cites this paper as [58]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., Amtmann, D., Bode, R., Buysse, D., Choi, S., et al. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.04.011 · Cited by 5,128 · cited 1×
“Patient-reported Outcomes Measurement Information System), use of appropriate methods for instrument development (item response theory) and computerised adaptive testing may go some way to address this.(24) A key challenge to be faced in the use of PROs for research, audit and to inform individualised care is ensuring…”
MethodPatient reported outcome measures could help transform healthcare
Black, N. (2013) · BMJ · doi:10.1136/bmj.f167 · Cited by 1,960 · cited 1×
“The use of PROs in clinical trials is well established, but widespread use in routine UK clinical practice is relatively uncommon; where it does take place, data collection and reporting tends to have a focus on provider performance rather than individual patient care.(11)”
MethodThe Prognostic Significance of Patient-Reported Outcomes in Cancer Clinical Trials
Gotay, C. C., Kawamoto, C. T., Bottomley, A., & Efficace, F. (2008) · Journal of Clinical Oncology · doi:10.1200/jco.2007.13.3439 · Cited by 644 · cited 1×
“Where PRO data may be used as an outcome in prognostic models to predict those patients most likely to obtain health gains and at an individual level to identify those who are a priority for care.(13) .”
MethodKoch, L., Jansen, L., Brenner, H., & Arndt, V. (2013) · Psycho-Oncology · doi:10.1002/pon.3022 · Cited by 511
The Impact of Electronic Patient Portals on Patient Care: A Systematic Review of Controlled Trials
Ammenwerth, E., Schnell-Inderst, P., & Hoerbst, A. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2238 · Cited by 364 · cited 1×
“Technological advancement such as patient portals and mobile phone applications may facilitate advancement in the integration of PROs with electronic health records.(17,18) For instance, a current UK-led initiative is working to link routinely collected electronic PRO data provided by cancer survivors, to cancer regis…”
BackgroundFinding the Missing Link for Big Biomedical Data
Weber, G. M., Mandl, K. D., & Kohane, I. S. (2014) · JAMA · doi:10.1001/jama.2014.4228 · Cited by 346 · cited 1×
“The term ‘big data’ is used to describe large, complex datasets and the associated advances in technology and analytics.(1,2) Within healthcare, this covers many different types of data including, for example: routinely collected clinic data in electronic health records; healthcare claims data, genomics data; public d…”
BackgroundGetting the Most out of PROMs: Putting Health Outcomes at the Heart of NHS Decision-Making
Devlin, N. J., & Appleby, J. (2010) · Monographs · Cited by 343
Self-citationAgreement between patient-reported symptoms and their documentation in the medical record.
Pakhomov, S., Jacobsen, S. J., Chute, C. G., & Roger, V. L. (2008) · PubMed · Cited by 281
VAN DER WEES, P. J., NIJHUIS‐VAN DER SANDEN, M. W. G., AYANIAN, J. Z., BLACK, N., WESTERT, G. P., & SCHNEIDER, E. C. (2014) · The Milbank Quarterly · doi:10.1111/1468-0009.12091 · Cited by 242
McCANN, L., MAGUIRE, R., MILLER, M., & KEARNEY, N. (2009) · European Journal of Cancer Care · doi:10.1111/j.1365-2354.2008.00938.x · Cited by 191 · cited 1×
“Technological advancement such as patient portals and mobile phone applications may facilitate advancement in the integration of PROs with electronic health records.(17,18) For instance, a current UK-led initiative is working to link routinely collected electronic PRO data provided by cancer survivors, to cancer regis…”
Background
Research works printed but not linked: 3
- Weber G, 2014, JAMA, 311, 2479
- Pakhomov S, 2008, Am J Managed Care, 14, 530
- Curtis L. Comparison of Machine Learning & Traditional Outcomes Research Methods from a Researcher's Perspective. Conference: ISPOR 19th Annual International Meeting, 31 May–4 June 2014. URL: http://www.ispor.org/Event/Program/2014Montreal?day=3 (last checked June 2014).
Cited by
EQ-5D and the EuroQol group: past, present and future
Devlin, N. J., & Brooks, R. (2017) · Applied Health Economics and Health Policy · doi:10.1007/s40258-017-0310-5 · Cited by 1,189
“EQ-5D has thus become part of the ‘big data’ revolution in health care [32].”
BackgroundSelf-citationBias in medical AI: Implications for clinical decision-making
Cross, J. L., Choma, M. A., & Onofrey, J. A. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000651 · Cited by 607
“The recent advance of tele-health has greatly increased the availability of patient-reported data collection (e.g., pain surveys on smartphone apps) [58], but certain patient groups may have lower (digital) health literacy or may be less able to self-report health outcomes.”
BackgroundMaximising the impact of patient reported outcome assessment for patients and society
Calvert, M., Kyte, D., Price, G., Valderas, J. M., & Hjollund, N. H. (2019) · BMJ · doi:10.1136/bmj.k5267 · Cited by 328
Self-citationPatient reported outcome measures in rare diseases: a narrative review
Slade, A., Isa, F., Kyte, D., Pankhurst, T., Kerecuk, L., Ferguson, J., Lipkin, G., & Calvert, M. (2018) · Orphanet Journal of Rare Diseases · doi:10.1186/s13023-018-0810-x · Cited by 240
“However such an approach is not without challenges, for example reducing levels of missing data and providing information on PROM results to patients in an easily accessible way can be difficult to achieve [62, 63].”
BackgroundSelf-citationKirchhof, P., Breithardt, G., Bax, J., Benninger, G., Blomstrom-Lundqvist, C., Boriani, G., Brandes, A., Brown, H., Brueckmann, M., Calkins, H., et al. (2016) · Europace · doi:10.1093/europace/euv304 · Cited by 141
“semi-automated, or remote assessment of patients.(31) In the future, these data may be used at an individual level to identify patients with deteriorating symptoms or aggregated to provide a quality measure.”
BackgroundSelf-citation
Metadata
- Authors
- Calvert, M., Thwaites, R., Kyte, D., & Devlin, N.
- Affiliations
- University of Birmingham (GB)
- Takeda (United Kingdom) (GB)
- Office Of Health Economics (GB)
- Corresponding author
- Calvert, Melanie
- Venue
- Journal of the Royal Society of Medicine
- Publisher
- SAGE Publications
- Published
- 2015-03-31
- Volume
- 108
- Issue
- 8
- Pages
- 299-303
- ISSN
- 0141-0768 (ISSN-L)
- 1758-1095
- PMC
- PMC4535436
- OpenAlex
- W1997825078
- Cited by
- 52
- References
- 18
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 11 · 2023: 1 · 2022: 6 · 2021: 5 · 2020: 4 · 2019: 3 · 2018: 4 · 2017: 6 · 2016: 3 · 2015: 2
- FWCI
- 12.08
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Journal of the Royal Society of Medicine (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion)
- Funders
- National Institute for Health and Care Research (SPCR-017)
- Topics
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Health Sciences › Health Professions › General Health Professions › Patient Satisfaction in Healthcare
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Keywords
- patient-reported outcomes, big data, health data infrastructure
- MeSH terms
- Humans, Surveys and Questionnaires, Information Management, Self Report, Patient Outcome Assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Putting patient-reported outcomes on the ‘Big Data Road Map’. https://app.cochat.ai/papers/10.1177/0141076815579896
- The paper
- Calvert, M., Thwaites, R., Kyte, D., & Devlin, N. (2015). Putting patient-reported outcomes on the ‘Big Data Road Map’. Journal of the Royal Society of Medicine. https://doi.org/10.1177/0141076815579896
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.