Development and Validation of a Questionnaire to Detect Behavior Change in Multiple Advance Care Planning Behaviors
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
INTRODUCTION: Advance directives have traditionally been considered the gold standard for advance care planning. However, recent evidence suggests that advance care planning involves a series of multiple discrete behaviors for which people are in varying stages of behavior change. The goal of our study was to develop and validate a survey to measure the full advance care planning process. METHODS: The Advance Care Planning Engagement Survey assesses "Process Measures" of factors known from Behavior Change Theory to affect behavior (knowledge, contemplation, self-efficacy, and readiness, using 5-point Likert scales) and "Action Measures" (yes/no) of multiple behaviors related to surrogate decision makers, values and quality of life, flexibility for surrogate decision making, and informed decision making. We administered surveys at baseline and 1 week later to 50 diverse, older adults from San Francisco hospitals. Internal consistency reliability of Process Measures was assessed using Cronbach's alpha (only continuous variables) and test-retest reliability of Process and Action Measures was examined using intraclass correlations. For discriminant validity, we compared Process and Action Measure scores between this cohort and 20 healthy college students (mean age 23.2 years, SD 2.7). RESULTS: Mean age was 69.3 (SD 10.5) and 42% were non-White. The survey took a mean of 21.4 minutes (±6.2) to administer. The survey had good internal consistency (Process Measures Cronbach's alpha, 0.94) and test-retest reliability (Process Measures intraclass correlation, 0.70; Action Measures, 0.87). Both Process and Action Measure scores were higher in the older than younger group, p<.001. CONCLUSION: A new Advance Care Planning Engagement Survey that measures behavior change (knowledge, contemplation, self-efficacy, and readiness) and multiple advance care planning actions demonstrates good reliability and validity. Further research is needed to assess whether survey scores improve in response to advance care planning interventions and whether scores are associated with receipt of care consistent with one's wishes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Self-efficacy: Toward a unifying theory of behavioral change
Bandura, A. (1977) · Psychological Review · doi:10.1037/0033-295x.84.2.191 · Cited by 43,925
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Self-efficacy: Toward a unifying theory of behavioral change
Bandura, A. (1978) · Advances in Behaviour Research and Therapy · doi:10.1016/0146-6402(78)90002-4 · Cited by 10,586
Foundations of Clinical Research: Applications to Practice,
(2002) · Survey of Ophthalmology · doi:10.1016/s0039-6257(02)00362-4 · Cited by 9,489 · cited 1×
“8 indicates almost perfect agreement [20].”
Pfeiffer, E. (1975) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.1975.tb00927.x · Cited by 5,321 · cited 1×
“Participants were eligible if they were not significantly cognitively impaired as assessed by the Short Portable Mental Status Questionnaire (SPMSQ) (score $8 out of 10), [11] and did not self-report as being blind (could see well enough to read newspaper print) or deaf (could hear well enough to talk on the phone).”
MethodThe Sources of Four Commonly Reported Cutoff Criteria: What Did They Really Say?
Lance, C. E., Butts, M. M., & Michels, L. C. (2006) · Organizational Research Methods · doi:10.1177/1094428105284919 · Cited by 2,053 · cited 1×
“70 is generally considered an acceptable level for internal consistency [17].”
BackgroundHandbook of Communication and Social Interaction Skills
(2003) · Routledge eBooks · doi:10.4324/9781410607133 · Cited by 1,095
Interpersonal communication competence
Spitzberg, B. H., & Cupach, W. R. (1984) · Cited by 950
Degner, L. F., Sloan, J. A., & Venkatesh, P. (2015) · PsycTESTS Dataset · doi:10.1037/t22188-000 · Cited by 904 · cited 1×
“, making all decisions on their own, sharing decision making, or to have doctor make decisions) [12].”
BackgroundThe Control Preferences Scale.
Degner, L. F., Sloan, J. A., & Venkatesh, P. (1997) · PubMed · Cited by 903
Redefining the “Planning” in Advance Care Planning: Preparing for End-of-Life Decision Making
Sudore, R. L., & Fried, T. R. (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-153-4-201008170-00008 · Cited by 852 · cited 2×
“Traditionally, advance care planning has focused on deciding whether to have medical procedures such as cardiopulmonary resuscitation (CPR) or mechanical ventilation at the end-of-life [1].”
BackgroundMethodSelf-citationMeasuring Functioning and Well-Being
Stewart, A., & Ware, J. E. (1992) · Cited by 458
Self-citationReproducibility of plasma hormone levels in postmenopausal women over a 2-3-year period.
Hankinson, S. E., Manson, J. E., Spiegelman, D. L., Willett, W. C., Longcope, C., & Speizer, F. E. (1995) · PubMed · Cited by 384
Interventions to Improve Care for Patients with Limited Health Literacy.
Sudore, R. L., & Schillinger, D. (2009) · PubMed · Cited by 361
Self-citationSarkar, U., Schillinger, D., López, A., & Sudore, R. (2011) · Journal of General Internal Medicine · doi:10.1007/s11606-010-1552-1 · Cited by 296 · cited 1×
“Previous experience with advance care planning was assessed through self-report yes/no questions such as: ‘‘Have you ever filled out an advance directive? Made life threatening medical decisions for yourself? For someone else?’’ [13] We also included one selfreported, validated question concerning health literacy (lim…”
BackgroundSelf-citationCompleting an Advance Directive in the Primary Care Setting: What Do We Need for Success?
Ramsaroop, S. D., Reid, M. C., & Adelman, R. D. (2007) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2007.01065.x · Cited by 249 · cited 1×
“To date, completion of a written advance directive has been the gold standard for successful advance care planning and the main outcome used to determine whether advance care planning interventions are successful [2].”
BackgroundAdvance Care Planning Beyond Advance Directives: Perspectives From Patients and Surrogates
McMahan, R. D., Knight, S. J., Fried, T. R., & Sudore, R. L. (2013) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2012.09.006 · Cited by 195 · cited 2×
“This study also confirms findings from other research that participants are engaging not just in advance directive completion, but also in a wide range of advance care planning behaviors, such as discussions with surrogates and clinicians, which may be equally helpful for end-of-life decision making [4,8].”
MethodResultSelf-citationStages of Change for the Component Behaviors of Advance Care Planning
Fried, T. R., Redding, C. A., Robbins, M. L., Paiva, A., O'Leary, J. R., & Iannone, L. (2010) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2010.03184.x · Cited by 181 · cited 3×
“One survey includes global questions concerning decisional balance, medical and religious beliefs, and processes of change for advance care planning in general, and another assesses stage of behavior change for several advance care planning behaviors including completing advance directive forms and talking with surrog…”
BackgroundResultSudore, R. L., Schickedanz, A. D., Landefeld, C. S., Williams, B. A., Lindquist, K., Pantilat, S. Z., & Schillinger, D. (2008) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2008.01701.x · Cited by 166 · cited 3×
“This study also confirms findings from other research that participants are engaging not just in advance directive completion, but also in a wide range of advance care planning behaviors, such as discussions with surrogates and clinicians, which may be equally helpful for end-of-life decision making [4,8].”
BackgroundResultSelf-citationAn advance directive redesigned to meet the literacy level of most adults: A randomized trial
Sudore, R. L., Landefeld, C. S., Barnes, D. E., Lindquist, K., Williams, B. A., Brody, R., & Schillinger, D. (2007) · Patient Education and Counseling · doi:10.1016/j.pec.2007.08.015 · Cited by 118 · cited 1×
“Previous experience with advance care planning was assessed through self-report yes/no questions such as: ‘‘Have you ever filled out an advance directive? Made life threatening medical decisions for yourself? For someone else?’’ [13] We also included one selfreported, validated question concerning health literacy (lim…”
BackgroundSelf-citationFried, T. R., Redding, C. A., Robbins, M. L., Paiva, A., O’Leary, J. R., & Iannone, L. (2012) · Patient Education and Counseling · doi:10.1016/j.pec.2011.04.035 · Cited by 101 · cited 1×
“One survey includes global questions concerning decisional balance, medical and religious beliefs, and processes of change for advance care planning in general, and another assesses stage of behavior change for several advance care planning behaviors including completing advance directive forms and talking with surrog…”
BackgroundMethods of Constructing Health Measures
Stewart, A., Hays, R. D., & Ware, J. E. (1992) · Cited by 84
Self-citationInterpersonal Communication Skills in Health Care Contexts
Street, R. L. (2003) · doi:10.4324/9781410607133.ch23 · Cited by 49 · cited 4×
“Social Cognitive Theory [5,6] and Behavior Change Theory [6,7] (the most well established theories for how people change behavior) posit that behavior change requires change in several factors or processes including: (a) knowledge or understanding of the importance of the behavior, (b) contemplation of engaging in the…”
BackgroundMethodInfluentialConfidence Intervals for Cronbach's Coefficient Alpha ValuesPreprint
Koning, A., & Franses, P. H. (2003) · RePEc: Research Papers in Economics · Cited by 31
Reach and Impact of a Mass Media Event Among Vulnerable Patients: The Terri Schiavo Story
Sudore, R. L., Landefeld, C. S., Pantilat, S. Z., Noyes, K. M., & Schillinger, D. (2008) · Journal of General Internal Medicine · doi:10.1007/s11606-008-0733-7 · Cited by 22 · cited 1×
“For example, a study of the impact of the Terri Schiavo media coverage found that her story motivated 61% of English and Spanish-speaking older adults to define their own goals for medical care and 66% to talk to their family and friends about advance care planning, yet only 3% completed an advance directive [21].”
BackgroundSelf-citation
Cited by
Sudore, R. L., Schillinger, D., Katen, M. T., Shi, Y., Boscardin, W. J., Osua, S., & Barnes, D. E. (2018) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2018.4657 · Cited by 196
Self-citationSudore, R. L., Knight, S. J., McMahan, R. D., Feuz, M., Farrell, D., Miao, Y., & Barnes, D. E. (2014) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2013.05.023 · Cited by 194
“The primary outcome, engagement in ACP, was measured with the ACP Engagement Survey.21 The ACP Engagement Survey assesses Process Measures of factors known from Social and Behavior Change Theory to affect behavior such as knowledge, contemplation, self-efficacy, and readiness, using 5-point Likert scales (Process Meas…”
MethodInfluentialSelf-citationMosher, C. E., Beck-Coon, K. A., Wu, W., Lewson, A. B., Stutz, P. V., Brown, L. F., Tang, Q., Helft, P. R., Levoy, K., Hickman, S. E., et al. (2024) · BMC Palliative Care · doi:10.1186/s12904-024-01564-7 · Cited by 23
“Patient self-efficacy and readiness for advance care planning were assessed with the 15-item Advance Care Planning Engagement Survey [48, 49].”
Method
Metadata
- Authors
- Sudore, R. L., Stewart, A. L., Knight, S. J., McMahan, R. D., Feuz, M., Miao, Y., & Barnes, D. E.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-09-05
- Volume
- 8
- Issue
- 9
- Pages
- e72465
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2042429178
- Cited by
- 165
- References
- 25
- FWCI
- 5.04
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.