Putting patient-reported outcomes on the ‘Big Data Road Map’.
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The recent advance of telehealth has greatly increased the availability of patient-reported data collection (e.g., pain surveys on smartphone apps) [58], but certain patient groups may have lower (digital) health literacy or may be less able to self-report health outcomes.”
From Bias in medical AI: Implications for clinical decision-making (2024) · cites this paper as [58]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., Amtmann, D., Bode, R., Buysse, D., Choi, S., et al. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.04.011 · Cited by 5,128 · cited 1×
“Patient-reported Outcomes Measurement Information System), use of appropriate methods for instrument development (item response theory) and computerised adaptive testing may go some way to address this.(24) A key challenge to be faced in the use of PROs for research, audit and to inform individualised care is ensuring…”
MethodPatient reported outcome measures could help transform healthcare
Black, N. (2013) · BMJ · doi:10.1136/bmj.f167 · Cited by 1,960 · cited 1×
“The use of PROs in clinical trials is well established, but widespread use in routine UK clinical practice is relatively uncommon; where it does take place, data collection and reporting tends to have a focus on provider performance rather than individual patient care.(11)”
MethodThe Prognostic Significance of Patient-Reported Outcomes in Cancer Clinical Trials
Gotay, C. C., Kawamoto, C. T., Bottomley, A., & Efficace, F. (2008) · Journal of Clinical Oncology · doi:10.1200/jco.2007.13.3439 · Cited by 644 · cited 1×
“Where PRO data may be used as an outcome in prognostic models to predict those patients most likely to obtain health gains and at an individual level to identify those who are a priority for care.(13) .”
MethodKoch, L., Jansen, L., Brenner, H., & Arndt, V. (2013) · Psycho-Oncology · doi:10.1002/pon.3022 · Cited by 511
The Impact of Electronic Patient Portals on Patient Care: A Systematic Review of Controlled Trials
Ammenwerth, E., Schnell-Inderst, P., & Hoerbst, A. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2238 · Cited by 364 · cited 1×
“Technological advancement such as patient portals and mobile phone applications may facilitate advancement in the integration of PROs with electronic health records.(17,18) For instance, a current UK-led initiative is working to link routinely collected electronic PRO data provided by cancer survivors, to cancer regis…”
BackgroundFinding the Missing Link for Big Biomedical Data
Weber, G. M., Mandl, K. D., & Kohane, I. S. (2014) · JAMA · doi:10.1001/jama.2014.4228 · Cited by 346 · cited 1×
“The term ‘big data’ is used to describe large, complex datasets and the associated advances in technology and analytics.(1,2) Within healthcare, this covers many different types of data including, for example: routinely collected clinic data in electronic health records; healthcare claims data, genomics data; public d…”
BackgroundGetting the Most out of PROMs: Putting Health Outcomes at the Heart of NHS Decision-Making
Devlin, N. J., & Appleby, J. (2010) · Monographs · Cited by 343
Self-citationAgreement between patient-reported symptoms and their documentation in the medical record.
Pakhomov, S., Jacobsen, S. J., Chute, C. G., & Roger, V. L. (2008) · PubMed · Cited by 281
VAN DER WEES, P. J., NIJHUIS‐VAN DER SANDEN, M. W. G., AYANIAN, J. Z., BLACK, N., WESTERT, G. P., & SCHNEIDER, E. C. (2014) · The Milbank Quarterly · doi:10.1111/1468-0009.12091 · Cited by 242
McCANN, L., MAGUIRE, R., MILLER, M., & KEARNEY, N. (2009) · European Journal of Cancer Care · doi:10.1111/j.1365-2354.2008.00938.x · Cited by 191 · cited 1×
“Technological advancement such as patient portals and mobile phone applications may facilitate advancement in the integration of PROs with electronic health records.(17,18) For instance, a current UK-led initiative is working to link routinely collected electronic PRO data provided by cancer survivors, to cancer regis…”
BackgroundWu, A. W., Kharrazi, H., Boulware, L. E., & Snyder, C. F. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.04.005 · Cited by 188 · cited 2×
“This will necessitate a coordinated approach, guided by input from a range of stakeholders, to ensure a clear rationale for PRO assessment utilising optimal instruments, aimed at facilitating high-quality data capture and appropriate governance.(16) Adding PROs to the heart of the big data agenda will open up an impor…”
BackgroundMacefield, R. C., Jacobs, M., Korfage, I. J., Nicklin, J., Whistance, R. N., Brookes, S. T., Sprangers, M. A., & Blazeby, J. M. (2014) · Trials · doi:10.1186/1745-6215-15-49 · Cited by 179 · cited 1×
“This may necessitate the development of ‘core outcome sets including PROs’ for routine clinical care.(15) PROs should also be rigorously selected based on the rationale for their use, ensuring that they are valid and reliable for the population of interest.”
BackgroundCalvert, M., & Freemantle, N. (2003) · Journal of Clinical Pharmacy and Therapeutics · doi:10.1046/j.0269-4727.2003.00521.x · Cited by 142 · cited 1×
“In trials, PROs provide additional ‘patient-centred’ data which are unique in capturing the patient’s own opinion on the impact of their disease, and its treatment, on their life.(8) This is important: evidence suggests clinical indicators, when used in isolation, can underestimate the impact of a disease upon the ind…”
BackgroundSelf-citationAndikyan, V., Rezk, Y., Einstein, M. H., Gualtiere, G., Leitao, M. M., Sonoda, Y., Abu-Rustum, N. R., Barakat, R. R., Basch, E. M., & Chi, D. S. (2012) · Gynecologic Oncology · doi:10.1016/j.ygyno.2012.07.124 · Cited by 73 · cited 1×
“Where real-time monitoring of PRO data may help with early identification of problems requiring a prompt response (PROAlerts), facilitate improved communication between patients and their clinical team and allow rapid referral to appropriate specialist care when necessary.(14)?”
BackgroundPatient-Reported Outcome Alerts
Kyte, D. G., Draper, H., & Calvert, M. (2013) · JAMA · doi:10.1001/jama.2013.277222 · Cited by 45 · cited 2×
“A key challenge to be faced in the use of PROs for research, audit and to inform individualised care is ensuring that patients understand who has access to their data and, crucially, how this information will be acted upon.(25) Patients’ PRO data can sometimes reveal ‘worrying levels of psychological distress or physi…”
BackgroundSelf-citationRothman, M. L., Gnanaskathy, A., Wicks, P. J., & Papadopoulos, E. J. (2015) · Value in Health · doi:10.1016/j.jval.2014.10.001 · Cited by 44 · cited 1×
“The use of these complex unstructured data to inform health policy is the subject of considerable debate.(21) Further research will be necessary to develop and refine methods to utilise social media data effectively.”
Clinician's Checklist for Reading and Using an Article About Patient-Reported Outcomes
Wu, A. W., Bradford, A. N., Velanovich, V., Sprangers, M. A. G., Brundage, M., & Snyder, C. F. (2014) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2014.01.017 · Cited by 32 · cited 1×
“Harmonisation is required both within and across institutions with collaboration between academia and industry, patient advocates, regulatory bodies, commissioners and policy-makers.(23) The NHS made laudable progress towards the routine collection of PRO data in healthcare settings with the introduction of the PROMs…”
BackgroundIs Big Data the New Frontier for Academic-Industry Collaboration?
JAIN, S. H., Rosenblatt, M., & Duke, J. D. (2014) · JAMA · doi:10.1001/jama.2014.1845 · Cited by 31 · cited 1×
“Collaboration between healthcare providers, academics and the pharmaceutical industry will be essential to maximise the use of big data to inform healthcare policy and delivery.(7)”
Background
Research works printed but not linked: 3
- Weber G, 2014, JAMA, 311, 2479
- Pakhomov S, 2008, Am J Managed Care, 14, 530
- Curtis L. Comparison of Machine Learning & Traditional Outcomes Research Methods from a Researcher's Perspective. Conference: ISPOR 19th Annual International Meeting, 31 May–4 June 2014. URL: http://www.ispor.org/Event/Program/2014Montreal?day=3 (last checked June 2014).
Cited by
EQ-5D and the EuroQol group: past, present and future
Devlin, N. J., & Brooks, R. (2017) · Applied Health Economics and Health Policy · doi:10.1007/s40258-017-0310-5 · Cited by 1,189
“EQ-5D has thus become part of the ‘big data’ revolution in health care [32].”
BackgroundSelf-citationBias in medical AI: Implications for clinical decision-making
Cross, J. L., Choma, M. A., & Onofrey, J. A. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000651 · Cited by 607
“The recent advance of tele-health has greatly increased the availability of patient-reported data collection (e.g., pain surveys on smartphone apps) [58], but certain patient groups may have lower (digital) health literacy or may be less able to self-report health outcomes.”
BackgroundMaximising the impact of patient reported outcome assessment for patients and society
Calvert, M., Kyte, D., Price, G., Valderas, J. M., & Hjollund, N. H. (2019) · BMJ · doi:10.1136/bmj.k5267 · Cited by 328
Self-citationPatient reported outcome measures in rare diseases: a narrative review
Slade, A., Isa, F., Kyte, D., Pankhurst, T., Kerecuk, L., Ferguson, J., Lipkin, G., & Calvert, M. (2018) · Orphanet Journal of Rare Diseases · doi:10.1186/s13023-018-0810-x · Cited by 240
“However such an approach is not without challenges, for example reducing levels of missing data and providing information on PROM results to patients in an easily accessible way can be difficult to achieve [62, 63].”
BackgroundSelf-citationKirchhof, P., Breithardt, G., Bax, J., Benninger, G., Blomstrom-Lundqvist, C., Boriani, G., Brandes, A., Brown, H., Brueckmann, M., Calkins, H., et al. (2016) · Europace · doi:10.1093/europace/euv304 · Cited by 141
“semi-automated, or remote assessment of patients.(31) In the future, these data may be used at an individual level to identify patients with deteriorating symptoms or aggregated to provide a quality measure.”
BackgroundSelf-citation
Metadata
- Authors
- Calvert, M., Thwaites, R., Kyte, D., & Devlin, N.
- Affiliations
- University of Birmingham (GB)
- Takeda (United Kingdom) (GB)
- Office Of Health Economics (GB)
- Corresponding author
- Calvert, Melanie
- Venue
- Journal of the Royal Society of Medicine
- Publisher
- SAGE Publications
- Published
- 2015-03-31
- Volume
- 108
- Issue
- 8
- Pages
- 299-303
- ISSN
- 0141-0768 (ISSN-L)
- 1758-1095
- PMC
- PMC4535436
- OpenAlex
- W1997825078
- Cited by
- 52
- References
- 18
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 11 · 2023: 1 · 2022: 6 · 2021: 5 · 2020: 4 · 2019: 3 · 2018: 4 · 2017: 6 · 2016: 3 · 2015: 2
- FWCI
- 12.08
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Journal of the Royal Society of Medicine (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion)
- Funders
- National Institute for Health and Care Research (SPCR-017)
- Topics
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Health Sciences › Health Professions › General Health Professions › Patient Satisfaction in Healthcare
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Keywords
- patient-reported outcomes, big data, health data infrastructure
- MeSH terms
- Humans, Surveys and Questionnaires, Information Management, Self Report, Patient Outcome Assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.