Utilizing Patient Reported Outcome Measures (PROMs) in ambulatory oncology in Alberta: Digital reporting at the micro, meso and macro level
Open accessAbstract
Cancer patients experience numerous distressing symptoms and concerns across the course of their illness, which negatively influence their quality of life. Regardless of cancer type, unmanaged symptoms can lead to adverse downstream consequences. Patient Reported Outcome Measures (PROMs) can be used to inform patient care and lead to targeted symptom management but simply gathering this information does not improve outcomes for the patient. Patient generated information must be easy for the clinicians to access and interpret if it is to be used to inform care delivery in ambulatory oncology facilities. This pragmatic work responded to this need. One Canadian provincial ambulatory oncology jurisdiction implemented digital tracking of PROMs over time in the provincial Electronic Medical Record (EMR) to support full integration of PROMs into standard care workflows and processes. Due to an inability within the EMR for direct patient entry, a hybrid data-entry was designed where the patient completes a paper-based PROM in the waiting room, and after clinical review, a clinician documents this along with their clinical assessment in the EMR. Several digital dashboards were developed which report PROMs data at the micro (individual), meso (clinic) and macro (program) levels. Using PROMs routinely in these provincial practice settings has numerous benefits including enhanced patient-clinician communication, assisting with problem detection, management of symptoms, and improving outcomes for patients. There are over 60,000 unique patients represented in our PROMs database, and over 300,000 unique screening events captured. The PROMs data is now used at all levels of the provincial cancer jurisdiction to provide targeted person centred care (micro), to staff appropriately at a clinic or program level (meso), and for capacity planning for provincial programs (macro). A new provincial EMR is currently being implemented which has an associated patient portal. Based on the success of this work, integration of direct entry of PROMs by the patient prior to the appointment and an associated workflow for symptom management is underway in this jurisdiction.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Only three included studies explicitly involved managers, administrators, or service-level decision-makers.
“Only three included studies explicitly involved managers, administrators, or service-level decision-makers [8,38,54].”
From Digital health technologies in oncology services: A scoping review of clinical implementation, organisational evidence gaps, and policy implications (2026) · cites this paper as [38]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
EQ-SD: a measure of health status from the EuroQol Group
Rabin, R., & Charro, F. D. (2001) · Annals of Medicine · doi:10.3109/07853890109002087 · Cited by 5,613 · see citing works
Basch, E., Deal, A. M., Dueck, A. C., Scher, H. I., Kris, M. G., Hudis, C., & Schrag, D. (2017) · JAMA · doi:10.1001/jama.2017.7156 · Cited by 2,302 · see citing works
Shippee, N. D., Shah, N. D., May, C. R., Mair, F. S., & Montori, V. M. (2012) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.05.005 · Cited by 728 · see citing works
Managing Cancer Care During the COVID-19 Pandemic: Agility and Collaboration Toward a Common Goal
Ueda, M., Martins, R. G., Hendrie, P. C., McDonnell, T., Crews, J. R., Wong, T., McCreery, B., Jagels, B., Crane, A., Byrd, D. R., et al. (2020) · Journal of the National Comprehensive Cancer Network · doi:10.6004/jnccn.2020.7560 · Cited by 515 · see citing works
Hui, D., Hannon, B. L., Zimmermann, C., & Bruera, E. D. (2018) · CA A Cancer Journal for Clinicians · doi:10.3322/caac.21490 · Cited by 443 · see citing works
Watanabe, S., Nekolaichuk, C., Beaumont, C., Johnson, L., Myers, J., & Strasser, F. (2010) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2010.04.020 · Cited by 382 · see citing works
Defining Patient Complexity From the Primary Care Physician's Perspective
Grant, R. W., Ashburner, J. M., Hong, C. S., Chang, Y., Barry, M. J., & Atlas, S. J. (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-12-201112200-00001 · Cited by 220 · see citing works
Implementing screening for distress, the 6th vital sign: a Canadian strategy for changing practice
Bultz, B. D., Groff, S. L., Fitch, M. I., Blais, M. C., Howes, J. L., Levy, K. S., & Mayer, C. (2011) · Psycho-Oncology · doi:10.1002/pon.1932 · Cited by 197 · see citing works
Pask, S., Pinto, C., Bristowe, K., van Vliet, L., Nicholson, C. J., Evans, C., George, R., Bailey, K. P., Davies, J. M., Guo, P., et al. (2018) · Palliative Medicine · doi:10.1177/0269216318757622 · Cited by 151 · see citing works
The Edmonton symptom assessment system—what do patients think?
Watanabe, S., Nekolaichuk, C., Beaumont, C., & Mawani, A. (2008) · Supportive Care in Cancer · doi:10.1007/s00520-008-0522-1 · Cited by 121 · see citing works
Symptom Clusters in Breast Cancer Survivors: A Latent Class Profile Analysis
Lee, L., Ross, A. C., Griffith, K. A., Jensen, R. E., & Wallen, G. R. (2019) · Oncology nursing forum · doi:10.1188/20.onf.89-100 · Cited by 67 · see citing works
Symptom Management and Palliative Care for Patients with Cancer
Yates, P. M. (2017) · Nursing Clinics of North America · doi:10.1016/j.cnur.2016.10.006 · Cited by 59 · see citing works
Snyder, C. F., Brundage, M., Rivera, Y. M., & Wu, A. W. (2019) · Medical Care · doi:10.1097/mlr.0000000000001089 · Cited by 46 · see citing works
Watson, L. C., Groff, S. L., Tamagawa, R., Looyis, J., Farkas, S., Schaitel, B., DeIure, A., Faris, P., & Bultz, B. D. (2016) · Journal of the National Comprehensive Cancer Network · doi:10.6004/jnccn.2016.0019 · Cited by 32 · see citing works
Self-citationPatient-Reported Outcomes in Alberta: Rationale, Scope, and Design of a Database Initiative
Cuthbert, C. A., Watson, L. C., Xu, Y., Boyne, D. J., Hemmelgarn, B. R., & Cheung, W. Y. (2019) · Current Oncology · doi:10.3747/co.26.4919 · Cited by 30 · see citing works
Self-citationTamagawa, R., Groff, S. L., Anderson, J., Champ, S., DeIure, A., Looyis, J., Faris, P., & Watson, L. C. (2016) · Journal of the National Comprehensive Cancer Network · doi:10.6004/jnccn.2016.0135 · Cited by 21 · see citing works
Self-citationPham, P. N., Xiao, H., Sarayani, A., Chen, M., & Brown, J. D. (2018) · Medical Care · doi:10.1097/mlr.0000000000001006 · Cited by 15 · see citing works
Watson, L. C., Qi, S., DeIure, A., Photitai, É., Chmielewski, L., & Smith, L. (2020) · Journal of the National Comprehensive Cancer Network · doi:10.6004/jnccn.2020.7586 · Cited by 14 · see citing works
Self-citation
Flagged first, then by citations
1 of the 19 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Glenwright, B. G., Simmich, J., Cottrell, M. A., O’Leary, S. P., Sullivan, C. M., Pole, J. D., & Russell, T. G. (2023) · Journal of Patient-Reported Outcomes · doi:10.1186/s41687-023-00554-2 · Cited by 135 · see citing works
Engagement and attrition in digital mental health: current challenges and potential solutions
Smith, K., Ward, T., Lambe, S., Ostinelli, E. G., Blease, C., Gant, T., Gold, S. M., Holmes, E. A., Paccoud, I., Vinnikova, A., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01778-w · Cited by 71 · see citing works
Capozzi, L., Daun, J. T., Francis, G. J., Wilding, M. D. G., Urgoiti, G. B. R., Langelier, D. M., & Culos-Reed, N. S. (2023) · Current Oncology · doi:10.3390/curroncol30070461 · Cited by 22 · see citing works
Integrating Patient-Reported Outcomes Into the Care of People With Advanced Cancer—A Practical Guide
Lai-Kwon, J. E., Thorner, E. D., Rutherford, C., Crossnohere, N. L., & Brundage, M. (2024) · American Society of Clinical Oncology Educational Book · doi:10.1200/edbk_438512 · Cited by 21 · see citing works
Amat-Fernández, C., Pardo, Y., Ferrer, M., Bosch, G., Lizano-Barrantes, C., Briseño, R., Vernet-Tomás, M. D. M., Fumadó, L., Beisani, M., Redondo‐Pachón, D., et al. (2025) · Health and Quality of Life Outcomes · doi:10.1186/s12955-025-02333-7 · Cited by 18 · see citing works
Symptom severity and trajectories among adolescent and young adult patients with cancer
Harper, A. S., Maseja, N., Parkinson, R., Pakseresht, M., McKillop, S. J., Henning, J., Watson, L. C., Cuthbert, C. A., Cheung, W. Y., & Fidler-Benaoudia, M. M. (2023) · JNCI Cancer Spectrum · doi:10.1093/jncics/pkad049 · Cited by 17 · see citing works
Self-citationWatson, L. C., Link, C., Qi, S., DeIure, A., Chmielewski, L., Hildebrand, A., & Barbera, L. C. (2024) · JCO Oncology Practice · doi:10.1200/op.24.00088 · Cited by 15 · see citing works
Self-citationExtracorporeal photopheresis in the management of graft-versus-host disease
Bredeson, C., Rumble, R. B., Varela, N. P., Kuruvilla, J. G., & Kouroukis, C. T. (2014) · Current Oncology · doi:10.3747/co.21.1882 · Cited by 15 · see citing works
Drury, A., Boland, V., & Dowling, M. (2024) · Seminars in Oncology Nursing · doi:10.1016/j.soncn.2024.151632 · Cited by 14 · see citing works
Bischof, A. Y., Kuklinski, D., Salvi, I. L., Walker, C., Vogel, J., & Geißler, A. (2024) · Journal of Medical Internet Research · doi:10.2196/55267 · Cited by 11 · see citing works
Lai-Kwon, J. E., Rutherford, C., Best, S., Ly, T., Zhang, I., Devereux, C., Herath, D., Burbury, K., & Jefford, M. (2024) · Supportive Care in Cancer · doi:10.1007/s00520-024-09034-9 · Cited by 9 · see citing works
Hansen, S. T., Jørgensen, L., Schmidt, V.-J., Ørsted, L. G., & Piil, K. (2024) · European Journal of Oncology Nursing · doi:10.1016/j.ejon.2024.102712 · Cited by 8 · see citing works
Roberts, A., Benterud, E., Santana, M., Engbers, J. D. T., Lorenz, C. H., Verdin, N., Pearson, W., Edgar, P., Adekanye, J., Javaheri, P. A., et al. (2024) · Journal of Patient-Reported Outcomes · doi:10.1186/s41687-024-00779-9 · Cited by 7 · see citing works
Watson, L. C., Link, C., Qi, S., Photitai, É., Chmielewski, L., Fode, D., & DeIure, A. (2022) · Patient Experience Journal · doi:10.35680/2372-0247.1626 · Cited by 7 · see citing works
Self-citationMirzaei, S., Bagherian-Sararoudi, R., Davazdahemami, M. H., Izadi, R., & Sharbafchi, M. R. (2025) · BMC Psychiatry · doi:10.1186/s12888-025-06823-2 · Cited by 6 · see citing works
Implementation of Patient Reported Outcomes in Outpatient Palliative Care: From Paper to Computer
Hui, D., Mastroleo, G. S., Morales, A. R. D., Peek, A., Reddy, A. S., Zhukovsky, D. S., Joy, M. P., Ali, S., & Bruera, E. D. (2023) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2023.04.012 · Cited by 6 · see citing works
Sudarshan, M., Tasnim, S., Ramji, S., Rappaport, J. M. P., Barron, J. O., Bribriesco, A., Schraufnagel, D. P., Lapin, B. R., Li, Y., Raymond, D. P., et al. (2023) · Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/j.jtcvs.2023.08.032 · Cited by 6 · see citing works
Córdoba, R., Rodríguez, M. D. O., Ramos-Cillán, S., García, A. L., Morillo, D., Perez-Saenz, M. A., Miranda, C., Martos, R., Beltrán, L., Castillo, E., et al. (2025) · eJHaem · doi:10.1002/jha2.70129 · Cited by 5 · see citing works
Hill, J., Alhumaid, M., Ghosh, S., Le, A., Watanabe, S., & Fairchild, A. M. (2022) · Supportive Care in Cancer · doi:10.1007/s00520-022-07246-5 · Cited by 4 · see citing works
Watson, L. C., Link, C., Qi, S., DeIure, A., Chmielewski, L., Hildebrand, A., Smith, L., & Barbera, L. C. (2023) · Digital Health · doi:10.1177/20552076231190998 · Cited by 4 · see citing works
Self-citationSayah, F. A., Short, H., Ohinmaa, A. E., Dean, S., Hubley, B., Lahtinen, M., & Johnson, J. A. (2025) · Journal of Patient-Reported Outcomes · doi:10.1186/s41687-025-00887-0 · Cited by 3 · see citing works
Yan, J. T., Boyne, D. J., Lo, E., Farah, E., O'Sullivan, D. E., & Cheung, W. Y. (2023) · Journal of Comparative Effectiveness Research · doi:10.57264/cer-2023-0061 · Cited by 4 · see citing works
Developing eHealth for Home Dialysis: Clinicians’ Needs for a Digital Patient Engagement Platform
Hölsä, S., Viitanen, J., Valkonen, P., Lääveri, T., & Rauta, V. (2024) · Studies in health technology and informatics · doi:10.3233/shti231137 · Cited by 3 · see citing works
Triage for palliative radiotherapy by clinical specialist radiation therapists: A scoping review
Paterson, P., & Fairchild, A. M. (2023) · Technical Innovations & Patient Support in Radiation Oncology · doi:10.1016/j.tipsro.2023.100213 · Cited by 2 · see citing works
Wang, Y., Allsop, M. J., Epstein, J. B., Howell, D., Rapoport, B. L., Schofield, P. E., Sebille, Y. Z. A. V., Thong, M. S. Y., Walraven, I., Wolf, J. R., et al. (2024) · Supportive Care in Cancer · doi:10.1007/s00520-024-08373-x · Cited by 1 · see citing works
Improving Practice in a Head and Neck Oncology Clinic Using the PRO-CTCAE Tool
Ruddy, R. A., Carter, B. M., Giuliante, M., & Walton, A. (2024) · Journal of the Advanced Practitioner in Oncology · doi:10.6004/jadpro.2024.15.5.2 · Cited by 1 · see citing works
K., P., Vashistha, R., & Kv, K. (2025) · International Research Journal of Computer Science · doi:10.26562/irjcs.2025.v1202.03 · Cited by 1 · see citing works
Tsui, T. C. O., Mercer, R. E., Zhou, E. J., Desai, R. K., Chatterjee, S., Yeung, C. Y. L., Pullenayegum, E., & Chan, K. (2025) · Current Oncology · doi:10.3390/curroncol32060308 · Cited by 1 · see citing works
Tsitsi, T., Polychronis, G., Papoui, E., Cloconi, C., Michail, K., & Charalambous, A. (2026) · Journal of Cancer Policy · doi:10.1016/j.jcpo.2026.100789
Symptom severity and complexity trends in patients undergoing radiation therapyPreprint
Yannitsos, D., Qi, S., Davies, O., Watson, L. C., & Barbera, L. C. (2023) · Research Square · doi:10.21203/rs.3.rs-3273369/v1
Self-citationVashistha, R., & Kumar, K. V. (2025) · International Journal of Innovative Research in Advanced Engineering · doi:10.26562/ijirae.2025.v1202.02
Semciw, A. I., Jessup, R. L., Duckham, R. L., Gokhale, S., Gray, H., Bell, E. C., Quick, S. M., Gentle, J., Phan, U., See, K., et al. (2025) · JMIR Research Protocols · doi:10.2196/85701
Glenwright, B. G., Simmich, J., Cottrell, M. A., O’Leary, S. P., Sullivan, C. M., Pole, J. D., & Russell, T. G. (2023) · Figshare · doi:10.6084/m9.figshare.22602760
Roberts, A., Benterud, E., Santana, M. J., Engbers, J. D. T., Lorenz, C. H., Verdin, N., Pearson, W., Edgar, P., Adekanye, J., Javaheri, P. A., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26943783
Glenwright, B. G., Simmich, J., Cottrell, M. A., O’Leary, S. P., Sullivan, C. M., Pole, J. D., & Russell, T. G. (2023) · Figshare · doi:10.6084/m9.figshare.22602769
Ong, H. I., Aurora, H., Heriot, A. G., Cooper, N., Proud, D., Warrier, S., Smart, P. J., Burgess, A., & Mohan, H. M. (2026) · European Journal of Cancer Care · doi:10.48130/ejcc-0026-0021
- Authors
- Watson, L., Delure, A., Qi, S., Link, C., Chmielewski, L., Photitai, É., & Smith, L.
- Affiliations
- Alberta Health Services (CA)
- Corresponding author
- Watson, Linda
- Venue
- Journal of Patient-Reported Outcomes
- Published
- 2021-10
- Volume
- 5
- Issue
- S2
- Pages
- 97-97
- ISSN
- 2509-8020 (ISSN-L)
- PMC
- PMC8511222
- OpenAlex
- W3206141921
- Cited by
- 35
- References
- 19
- Citations by year
- 2026: 1 · 2025: 9 · 2024: 11 · 2023: 11 · 2022: 2 · 2014: 1
- FWCI
- 5.23
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Journal of Patient-Reported Outcomes (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, other-oa)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Libraries and Cultural Resources (University of Calgary) (submittedVersion)
- Funders
- Canadian Partnership Against Cancer
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Oncology › Cancer survivorship and care
- Health Sciences › Health Professions › General Health Professions › Patient Satisfaction in Healthcare
- Keywords
- patient-reported outcome measures, outpatient oncology, cancer symptom management, electronic health records, digital dashboard, person-centred care, capacity planning, patient-clinician communication, Alberta
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review