Animated Graphics for Comparing Two Risks: A Cautionary Tale
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The increasing use of computer-administered risk communications affords the potential to replace static risk graphics with animations that use motion cues to reinforce key risk messages. Research on the use of animated graphics, however, has yielded mixed findings, and little research exists to identify the specific animations that might improve risk knowledge and patients' decision making. OBJECTIVE: To test whether viewing animated forms of standard pictograph (icon array) risk graphics displaying risks of side effects would improve people's ability to select the treatment with the lowest risk profile, as compared with viewing static images of the same risks. METHODS: A total of 4198 members of a demographically diverse Internet panel read a scenario about two hypothetical treatments for thyroid cancer. Each treatment was described as equally effective but varied in side effects (with one option slightly better than the other). Participants were randomly assigned to receive all risk information in 1 of 10 pictograph formats in a quasi-factorial design. We compared a control condition of static grouped icons with a static scattered icon display and with 8 Flash-based animated versions that incorporated different combinations of (1) building the risk 1 icon at a time, (2) having scattered risk icons settle into a group, or (3) having scattered risk icons shuffle themselves (either automatically or by user control). We assessed participants' ability to choose the better treatment (choice accuracy), their gist knowledge of side effects (knowledge accuracy), and their graph evaluation ratings, controlling for subjective numeracy and need for cognition. RESULTS: When compared against static grouped-icon arrays, no animations significantly improved any outcomes, and most showed significant performance degradations. However, participants who received animations of grouped icons in which at-risk icons appeared 1 at a time performed as well on all outcomes as the static grouped-icon control group. Displays with scattered icons (static or animated) performed particularly poorly unless they included the settle animation that allowed users to view event icons grouped. CONCLUSIONS: Many combinations of animation, especially those with scattered icons that shuffle randomly, appear to inhibit knowledge accuracy in this context. Static pictographs that group risk icons, however, perform very well on measures of knowledge and choice accuracy. These findings parallel recent evidence in other data communication contexts that less can be more-that is, that simpler, more focused information presentation can result in improved understanding. Decision aid designers and health educators should proceed with caution when considering the use of animated risk graphics to compare two risks, given that evidence-based, static risk graphics appear optimal.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Efficient Assessment of Need for Cognition
Cacioppo, J. T., Petty, R. E., & Feng Kao, C. (1984) · Journal of Personality Assessment · doi:10.1207/s15327752jpa4803_13 · Cited by 2,913
Measuring Numeracy without a Math Test: Development of the Subjective Numeracy Scale
Fagerlin, A., Zikmund-Fisher, B. J., Ubel, P. A., Jankovic, A., Derry, H. A., & Smith, D. M. (2007) · Medical Decision Making · doi:10.1177/0272989x07304449 · Cited by 960 · cited 1×
“Because ample evidence exists that even highly educated adults can have poor numeracy skills (ie, facility and comfort with quantitative health information such as risk statistics) [29-31], all study participants also completed the Subjective Numeracy Scale (SNS) [32], a validated measure of quantitative ability and p…”
BackgroundSelf-citationAnimation as an Aid to Multimedia Learning
Mayer, R. E., & Moreno, R. (2002) · Educational Psychology Review · doi:10.1023/a:1013184611077 · Cited by 749
Multimedia instructions and cognitive load theory: Effects of modality and cueing
Tabbers, H. K., Martens, R. L., & Van Merriënboer, J. J. G. (2004) · British Journal of Educational Psychology · doi:10.1348/000709904322848824 · Cited by 478 · cited 1×
“This type of signaling may help people make sense of verbal information [19], may help them better learn how a complex system such as a turbofan jet engine works [20], and may help somewhat in the acquisition of complex cognitive skills such as doing experimental research or designing a house [21].”
BackgroundMayer, R. E., Hegarty, M., Mayer, S., & Campbell, J. (2005) · Journal of Experimental Psychology: Applied · doi:10.1037/1076-898x.11.4.256 · Cited by 462 · cited 1×
“This was the case in our context, and this may explain the lack of benefit demonstrated, similar to previous studies where static graphics were able to effectively convey information (eg, [39]).”
ResultZikmund-Fisher, B. J., Smith, D. M., Ubel, P. A., & Fagerlin, A. (2007) · Medical Decision Making · doi:10.1177/0272989x07303824 · Cited by 353
Self-citation
Cited by
Trevena, L. J., Zikmund-Fisher, B. J., Edwards, A., Gaissmaier, W., Galesic, M., Han, P. K., King, J., Lawson, M. L., Linder, S. K., Lipkus, I., et al. (2013) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-13-s2-s7 · Cited by 538
Self-citationEvidence-Based Risk Communication: A Systematic Review
Zipkin, D. A., Umscheid, C. A., Keating, N. L., Allen, E., Aung, K., Beyth, R., Kaatz, S., Mann, D. M., Sussman, J. B., Korenstein, D., et al. (2014) · Annals of Internal Medicine · doi:10.7326/m14-0295 · Cited by 427
The Science of Visual Data Communication: What Works
Franconeri, S. L., Padilla, L. M., Shah, P., Zacks, J. M., & Hullman, J. (2021) · Psychological Science in the Public Interest · doi:10.1177/15291006211051956 · Cited by 360
Garcia-Retamero, R., & Cokely, E. T. (2017) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720817690634 · Cited by 298
Risk and Uncertainty Communication
Spiegelhalter, D. (2017) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-010814-020148 · Cited by 248
Measuring Graph Literacy without a Test: A Brief Subjective Assessment
Garcia-Retamero, R., Cokely, E. T., Ghazal, S., & Joeris, A. (2016) · Medical Decision Making · doi:10.1177/0272989x16655334 · Cited by 64
Meloncon, L., & Warner, E. (2017) · 2017 IEEE International Professional Communication Conference (ProComm) · doi:10.1109/ipcc.2017.8013960 · Cited by 50
“[29] Animations and static visualizations Animations do not significantly improved any outcomes, and most showed significant performance degradations.”
BackgroundVehicle operating state anomaly detection and results virtual reality interpretation
Alizadeh, M., Hamilton, M., Jones, P., Ma, J., & Jaradat, R. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.114928 · Cited by 18
Metadata
- Authors
- Zikmund-Fisher, B. J., Witteman, H. O., Fuhrel-Forbis, A., Exe, N. L., Kahn, V. C., & Dickson, M.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2012-07-25
- Volume
- 14
- Issue
- 4
- Pages
- e106
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W2015931541
- Cited by
- 64
- References
- 6
- FWCI
- 4.87
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.