Design and feasibility of integrating personalized PRO dashboards into prostate cancer care
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Objective Patient-reported outcomes (PROs) are a valued source of health information, but prior work focuses largely on data capture without guidance on visual displays that promote effective PRO use in patient-centered care. We engaged patients, providers, and design experts in human-centered design of “PRO dashboards” that illustrate trends in health-related quality of life (HRQOL) reported by patients following prostate cancer treatment. Materials and Methods We designed and assessed the feasibility of integrating dashboards into care in 3 steps: (1) capture PRO needs of patients and providers through focus groups and interviews; (2) iteratively build and refine a prototype dashboard; and (3) pilot test dashboards with patients and their provider during follow-up care. Results Focus groups ( n = 60 patients) prioritized needs for dashboards that compared longitudinal trends in patients’ HRQOL with “men like me.” Of the candidate dashboard designs, 50 patients and 50 providers rated pictographs less helpful than bar charts, line graphs, or tables ( P < .001) and preferred bar charts and line graphs most. Given these needs and the design recommendations from our Patient Advisory Board ( n = 7) and design experts ( n = 7), we built and refined a prototype that charts patients’ HRQOL compared with age- and treatment-matched patients in personalized dashboards. Pilot testing dashboard use ( n = 12 patients) improved compliance with quality indicators for prostate cancer care ( P < .01). Conclusion PRO dashboards are a promising approach for integrating patient-generated data into prostate cancer care. Informed by human-centered design principles, this work establishes guidance on dashboard content, tailoring, and clinical use that patients and providers find meaningful.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cella, D., Yount, S., Rothrock, N., Gershon, R., Cook, K., Reeve, B., Ader, D., Fries, J. F., Bruce, B., & Rose, M. (2007) · Medical Care · doi:10.1097/01.mlr.0000258615.42478.55 · Cited by 3,118 · cited 1×
“PROs complement traditional clinical data by representing a patient’s assessment of symptoms, physical function, and HRQOL without interpretation from clinicians or caregivers.(11,12) Although implementation in routine clinical practice has been limited,(13,14) advancing technology is improving the feasibility of adop…”
Role of Computerized Physician Order Entry Systems in Facilitating Medication Errors
Koppel, R. (2005) · JAMA · doi:10.1001/jama.293.10.1197 · Cited by 2,126
Wei, J. T., Dunn, R. L., Litwin, M. S., Sandler, H. M., & Sanda, M. G. (2000) · Urology · doi:10.1016/s0090-4295(00)00858-x · Cited by 1,520 · cited 1×
“Under our conceptual model of patient-centered use in cancer care, patients complete periodic assessments with the Expanded Prostate Cancer Index (EPIC).(38) EPIC measures symptom severity and bother on a 0 to 100 scale for urinary, bowel, and sexual domains, with higher scores indicating better HRQOL.”
Velikova, G., Booth, L., Smith, A. B., Brown, P. M., Lynch, P., Brown, J. M., & Selby, P. J. (2004) · Journal of Clinical Oncology · doi:10.1200/jco.2004.06.078 · Cited by 1,382
Tailored and Targeted Health Communication: Strategies for Enhancing Information Relevance
Kreuter, M. W., & Wray, R. J. (2003) · American Journal of Health Behavior · doi:10.5993/ajhb.27.1.s3.6 · Cited by 1,095
Quality-of-life outcomes in men treated for localized prostate cancer
Litwin, M. S., Hays, R. D., Fink, A., Ganz, P. A., Leake, B., Leach, G. E., & Brook, R. H. (1995) · JAMA · doi:10.1001/jama.1995.03520260051032 · Cited by 1,020
Detmar, S. B., Muller, M. J., Schornagel, J. H., Wever, L. D. V., & Aaronson, N. K. (2002) · JAMA · doi:10.1001/jama.288.23.3027 · Cited by 1,011
Muller, M. J., & Kuhn, S. (1993) · Communications of the ACM · doi:10.1145/153571.255960 · Cited by 909
Middleton, B., Bloomrosen, M., Dente, M. A., Hashmat, B., Koppel, R., Overhage, J. M., Payne, T. H., Rosenbloom, S. T., Weaver, C., & Zhang, J. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-001458 · Cited by 618
Impact of patient‐reported outcome measures on routine practice: a structured review
Marshall, S., Haywood, K., & Fitzpatrick, R. (2006) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2006.00650.x · Cited by 602
Grand challenges in clinical decision support
Sittig, D. F., Wright, A., Osheroff, J. A., Middleton, B., Teich, J. M., Ash, J. S., Campbell, E., & Bates, D. W. (2008) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2007.09.003 · Cited by 582
Research works printed but not linked: 57
- Gore, 2009, Survivorship beyond convalescence: 48-month quality-of-life outcomes after treatment for localized prostate cancer, J Natl Cancer Inst., 101, 888, 10.1093/jnci/djp114 · DOI · Paper page
- Sanda, 2008, Quality of life and satisfaction with outcome among prostate-cancer survivors, N Engl J Med., 358, 1250, 10.1056/NEJMoa074311 · DOI · Paper page
- Stanford, 2000, Urinary and sexual function after radical prostatectomy for clinically localized prostate cancer: the Prostate Cancer Outcomes Study, JAMA., 283, 354, 10.1001/jama.283.3.354 · DOI · Paper page
- Litwin, 1998, Differences in urologist and patient assessments of health related quality of life in men with prostate cancer: results of the CaPSURE database, J Urol., 159, 1988, 10.1016/S0022-5347(01)63222-1 · DOI · Paper page
- Spencer, 2003, Quality-of-care indicators for early-stage prostate cancer, J Clin Oncol., 21, 1928, 10.1200/JCO.2003.05.157 · DOI
- Greenhalgh, 1999, The effectiveness of the use of patient-based measures of health in routine practice in improving the process and outcomes of patient care: A literature review, J Eval Clin Pract., 5, 401, 10.1046/j.1365-2753.1999.00209.x · DOI · Paper page
- Chen, 2013, A systematic review of the impact of routine collection of patient reported outcome measures on patients, providers and health organisations in an oncologic setting, BMC Health Serv Res., 13, 211, 10.1186/1472-6963-13-211 · DOI · Paper page
- Devlin, 2010, Getting the Most Out of PROMS: Putting Health Outcomes at the Heart of NHS Decision Making
- Lipscomb, 2007, Patient-reported outcomes assessment in cancer trials: taking stock, moving forward, J Clin Oncol., 25, 5133, 10.1200/JCO.2007.12.4644 · DOI · Paper page
- Donaldson, 2004, Taking stock of health-related quality-of-life measurement in oncology practice in the United States, J Natl Cancer Inst Monogr, 33, 155, 10.1093/jncimonographs/lgh017 · DOI
- Snyder, 2012, Implementing patient-reported outcomes assessment in clinical practice: a review of the options and considerations, Qual Life Res., 21, 1305, 10.1007/s11136-011-0054-x · DOI · Paper page
- Jensen, 2015, The role of technical advances in the adoption and integration of patient-reported outcomes in clinical care, Med Care., 53, 153, 10.1097/MLR.0000000000000289 · DOI · Paper page
- Berry, 2011, Enhancing patient-provider communication with the electronic self-report assessment for cancer: a randomized trial, J Clin Oncol., 29, 1029, 10.1200/JCO.2010.30.3909 · DOI · Paper page
- Berry, 2014, Electronic self-report assessment for cancer and self-care support: results of a multicenter randomized trial, J Clin Oncol., 32, 199, 10.1200/JCO.2013.48.6662 · DOI · Paper page
- Berry, 2011, Patient-reported symptoms and quality of life integrated into clinical cancer care, Semin Oncol Nurs., 27, 203, 10.1016/j.soncn.2011.04.005 · DOI
- Basch, 2012, Recommendations for incorporating patient-reported outcomes into clinical comparative effectiveness research in adult oncology, J Clin Oncol., 30, 4249, 10.1200/JCO.2012.42.5967 · DOI · Paper page
- Reeve, 2014, Recommended patient-reported core set of symptoms to measure in adult cancer treatment trials, J Natl Cancer Inst., 106, dju129, 10.1093/jnci/dju129 · DOI · Paper page
- Chen, 2014, Recommended patient-reported core set of symptoms to measure in prostate cancer treatment trials, J Natl Cancer Inst., 106, dju132, 10.1093/jnci/dju132 · DOI
- Wu, 2013, Measure once, cut twice—adding patient-reported outcome measures to the electronic health record for comparative effectiveness research, J Clin Epidemiol., 66, S12, 10.1016/j.jclinepi.2013.04.005 · DOI · Paper page
- Jensen, 2014, Review of electronic patient-reported outcomes systems used in cancer clinical care, J Oncol Pract., 10, e215, 10.1200/JOP.2013.001067 · DOI · Paper page
- Abernethy, 2008, Improving health care efficiency and quality using tablet personal computers to collect research-quality, patient-reported data, Health Serv Res., 43, 1975, 10.1111/j.1475-6773.2008.00887.x · DOI · Paper page
- Taenzer, 2000, Impact of computerized quality of life screening on physician behaviour and patient satisfaction in lung cancer outpatients, Psychooncology., 9, 203, 10.1002/1099-1611(200005/06)9:3<203::AID-PON453>3.0.CO;2-Y · doi:10.1002/1099-1611(200005/06)9:3<203::aid-pon453>3.0.co;2-y
- Shneiderman, 2013, Improving health and healthcare with interactive visualization tools, IEEE Computer., 46, 58, 10.1109/MC.2013.38 · DOI · Paper page
- Dolan, 2013, Development and initial evaluation of a treatment decision dashboard, BMC Med Inform Decis Making., 13, 51, 10.1186/1472-6947-13-51 · DOI · Paper page
- Hilarius, 2008, Use of health-related quality-of-life assessments in daily clinical oncology nursing practice: a community hospital-based intervention study, Cancer., 113, 628, 10.1002/cncr.23623 · DOI · Paper page
- Fortin, 2001, Identifying patient preferences for communicating risk estimates: a descriptive pilot study, BMC Med Inform Decis Making., 1, 2, 10.1186/1472-6947-1-2 · DOI
- Brundage, 2005, Communicating quality of life information to cancer patients: a study of six presentation formats, J Clin Oncol., 23, 6949, 10.1200/JCO.2005.12.514 · DOI · Paper page
- Feldman-Stewart, 2007, Further insight into the perception of quantitative information: judgments of gist in treatment decisions, Med Decis Making., 27, 34, 10.1177/0272989X06297101 · DOI · Paper page
- Hawley, 2008, The impact of the format of graphical presentation on health-related knowledge and treatment choices, Patient Educ Couns., 73, 448, 10.1016/j.pec.2008.07.023 · DOI · Paper page
- International Organization for Standardization (ISO), Ergonomics of Human-system Interaction – Part 210: Human-centered Design for Interactive Systems
- Johnson, 2005, A user-centered framework for redesigning health care interfaces, J Biomed Inform., 38, 75, 10.1016/j.jbi.2004.11.005 · DOI · Paper page
- Martin, 2015, Defining a standard set of patient-centered outcomes for men with localized prostate cancer, Eur Urol., 67, 460, 10.1016/j.eururo.2014.08.075 · DOI · Paper page
- Schmidt, 2014, Assessing quality of life in patients with prostate cancer: a systematic and standardized comparison of available instruments, Qual Life Res., 23, 2169, 10.1007/s11136-014-0678-8 · DOI
- Israel, 2008, Critical issues in developing and following CBPR Principles
- Alexander, 2009, A systematic review of the designs of clinical technology: findings and recommendations for future research, ANS Adv Nurs Sci., 32, 252, 10.1097/ANS.0b013e3181b0d737 · DOI · Paper page
- Brennan, 2010, Project HealthDesign: rethinking the power and potential of personal health records, J Biomed Inform., 43, S3, 10.1016/j.jbi.2010.09.001 · DOI
- Wolpin, 2011, A deliberate and rigorous approach to development of patient-centered technologies, Semin Oncol Nurs., 27, 183, 10.1016/j.soncn.2011.04.003 · DOI · Paper page
- Sox, 2010, Patient-centered design of an information management module for a personally controlled health record, J Med Internet Res., 12, e36, 10.2196/jmir.1269 · DOI · Paper page
- Delbecq, 1986, Group Techniques for Program Planning: a Guide to Nominal Group and Delphi Processes
- Izard, 2014, User-centered design of quality of life reports for clinical care of patients with prostate cancer, Surg., 155, 789, 10.1016/j.surg.2013.12.007 · DOI
- Galesic, 2011, Graph literacy: a crosscultural comparison, Med Decis Making., 31, 444, 10.1177/0272989X10373805 · DOI · Paper page
- Molich, 1990, Improving a human-computer dialogue, Commun ACM., 33, 338, 10.1145/77481.77486 · DOI · Paper page
- Jeffries, 1992, Usability testing vs. heuristic evaluation: was there a contest?, ACM SIGCHI Bull., 24, 39, 10.1145/142167.142179 · DOI
- Nielsen, 1994, Heuristic evaluation, 25
- Wharton, 1992, Applying cognitive walkthroughs to more complex user interfaces: experiences, issues and recommendations, 381, 10.1145/142750.142864 · DOI
- Lepore, 1999, Psychoeducational support group enhances quality of life after prostate cancer, Canc Res Ther Contr., 8, 81
- Maly, 1998, Perceived efficacy in patient–physician interactions (PEPPI): validation of an instrument in older persons, J Am Geriatr Soc., 46, 889, 10.1111/j.1532-5415.1998.tb02725.x · DOI · Paper page
- Sepucha, 2002, Consultation planning to help breast cancer patients prepare for medical consultations: effect on communication and satisfaction for patients and physicians, J Clin Oncol., 20, 2695, 10.1200/JCO.2002.10.068 · DOI
- Smith, 1984, Measuring patient perceptions of the patient-doctor interaction. Development of the PDIS, Eval Health Prof., 7, 77, 10.1177/016327878400700106 · doi:10.1177/016327878400700106
- Bowman, 1992, Assessment of the patient-doctor interaction scale for measuring patient satisfaction, Patient Edu Couns., 19, 75, 10.1016/0738-3991(92)90103-P · DOI
- R Development Core Team, 2011, R: A Language and Environment for Statistical Computing
- Schield, 2006, Percentage Graphs in USA Today Snapshots Online, 2364
- Franklin, 2013, An information-centric framework for designing patient-centered medical decision aids and risk communication, AMIA Annu Symp Proc., 2013, 456
- Dimitropoulos, 2014, Health IT Research Priorities To Support the Health Care Delivery System of the Future
- Fagerlin, 2007, “If I'm better than average, then I'm ok?”: comparative information influences beliefs about risk and benefits, Patient Educ Couns., 69, 140, 10.1016/j.pec.2007.08.008 · DOI
- Zikmund-Fisher, 2011, “I'll do what they did”: social norm information and cancer treatment decisions, Patient Educ Couns., 85, 225, 10.1016/j.pec.2011.01.031 · DOI
- Dalkin, 2006, Health-related quality of life outcomes after radical prostatectomy: attention to study design and the patient-based importance of single-surgeon studies, Urol Oncol., 24, 28, 10.1016/j.urolonc.2005.05.009 · DOI
Cited by
Design Thinking in Health Care
Altman, M., Huang, T. T. K., & Breland, J. Y. (2018) · Preventing Chronic Disease · doi:10.5888/pcd15.180128 · Cited by 548
“…(not the IUD) in intervention group compared with control group, no difference in selection of contraceptive methods between groups Mixed success Hartzler et al, 2016 (30) Prostate cancer Clinical dashboard Display personalized trends in patients’ HRQOL following prostate cancertreatment to…”
Göttgens, I., & Oertelt-Prigione, S. (2021) · JMIR mHealth and uHealth · doi:10.2196/28102 · Cited by 385
Yang, L. Y., Manhas, D. S., Howard, A. F., & Olson, R. A. (2018) · Supportive Care in Cancer · doi:10.1007/s00520-017-3865-7 · Cited by 268
A user-centred design framework for mHealth
Farao, J., Malila, B., Conrad, N., Mutsvangwa, T., Rangaka, M. X., & Douglas, T. S. (2020) · PLoS ONE · doi:10.1371/journal.pone.0237910 · Cited by 203
Evaluating and improving the usability of a mHealth platform to assess postoperative dental pain
Ibarra-Noriega, A. M., Yansane, A., Mullins, J., Simmons, K., Skourtes, N., Holmes, D., White, J., Kalenderian, E., & Walji, M. F. (2024) · JAMIA Open · doi:10.1093/jamiaopen/ooae018 · Cited by 3
Metadata
- Authors
- Hartzler, A. L., Izard, J. P., Dalkin, B. L., Mikles, S. P., & Gore, J. L.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2015-08-09
- Volume
- 23
- Issue
- 1
- Pages
- 38-47
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- OpenAlex
- W2290883466
- Cited by
- 72
- References
- 11
- FWCI
- 2.60
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.