Getting users to pay attention to anti-phishing education: evaluation of retention and transfer
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Educational materials designed to teach users not to fall for phishing attacks are widely available but are often ignored by users. In this paper, we extend an embedded training methodology using learning science principles in which phishing education is made part of a primary task for users. The goal is to motivate users to pay attention to the training materials. In embedded training, users are sent simulated phishing attacks and trained after they fall for the attacks. Prior studies tested users immediately after training and demonstrated that embedded training improved users' ability to identify phishing emails and websites. In the present study, we tested users to determine how well they retained knowledge gained through embedded training and how well they transferred this knowledge to identify other types of phishing emails. We also compared the effectiveness of the same training materials delivered via embedded training and delivered as regular email messages. In our experiments, we found that: (a) users learn more effectively when the training materials are presented after users fall for the attack (embedded) than when the same training materials are sent by email (non-embedded); (b) users retain and transfer more knowledge after embedded training than after non-embedded training; and (c) users with higher Cognitive Reflection Test (CRT) scores are more likely than users with lower CRT scores to click on the links in the phishing emails from companies with which they have no account.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Judgment under Uncertainty: Heuristics and Biases
(1982) · doi:10.1017/cbo9780511809477 · Cited by 8,240
Mayer, R. E. (2009) · doi:10.1017/cbo9780511811678 · Cited by 7,800
Mayer, R. (2020) · doi:10.1017/9781316941355 · Cited by 7,777
Cognitive Reflection and Decision Making
Frederick, S. (2005) · Journal of Economic Perspectives · doi:10.1257/089533005775196732 · Cited by 5,256
Mayer, R. E. (2001) · doi:10.1017/cbo9781139164603 · Cited by 2,304
Schmidt, R. A., & Bjork, R. A. (1992) · Psychological Science · doi:10.1111/j.1467-9280.1992.tb00029.x · Cited by 1,582 · cited 1×
“• Immediate feedback : Researchers have shown that providing immediate feedback during the learning phase result s in more efficient learning and faster learning, provides gu idance towards correct behavior, and reduces unproductive floundering [22].”
BackgroundDhamija, R., Tygar, J. D., & Hearst, M. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124861 · Cited by 1,376
Mayer, R. E., & Anderson, R. B. (1992) · Journal of Educational Psychology · doi:10.1037/0022-0663.84.4.444 · Cited by 1,000 · cited 1×
“developed the contiguity principle, which states that “the effectiveness of the computer aided instruction increases when words and pictures are presented contiguously (rather than isolated from o ne another) in time and space” [17].”
BackgroundDecision strategies and susceptibility to phishing
Downs, J. S., Holbrook, M. B., & Cranor, L. F. (2006) · Proceedings of the second symposium on Usable privacy and security - SOUPS '06 · doi:10.1145/1143120.1143131 · Cited by 352 · cited 1×
“User studies examining phishing or phishing-related interventions are often agnostic to individual user characteristics (sex, age, education level and hours using computer) or have not found significant relationships between features such as age or gender and phishing-related behavior [6, 7, 15, 23].”
BackgroundSelf-citation
Cited by
Hong, J. (2012) · Communications of the ACM · doi:10.1145/2063176.2063197 · Cited by 551
Self-citationTeaching Johnny not to fall for phish
Kumaraguru, P., Sheng, S., Acquisti, A., Cranor, L. F., & Hong, J. (2010) · ACM Transactions on Internet Technology · doi:10.1145/1754393.1754396 · Cited by 396
Self-citationSecurity awareness of computer users: A phishing threat avoidance perspective
Arachchilage, N. A. G., & Love, S. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.05.046 · Cited by 332
“Previous research has revealed that well-designed user security education can be effective (Kumaraguru et al., 2007a,b; Sheng et al., 2007).”
BackgroundInfluentialDefending against phishing attacks: taxonomy of methods, current issues and future directions
Gupta, B. B., Arachchilage, N. A. G., & Psannis, K. E. (2018) · Telecommunication Systems · doi:10.1007/s11235-017-0334-z · Cited by 293
Why phishing still works: User strategies for combating phishing attacks
Alsharnouby, M., Alaca, F., & Chiasson, S. (2015) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2015.05.005 · Cited by 260
Metadata
- Authors
- Kumaraguru, P., Rhee, Y., Sheng, S., Hasan, S., Acquisti, A., Cranor, L. F., & Hong, J.
- Venue
- Proceedings of the anti-phishing working groups 2nd annual eCrime researchers summit
- Publisher
- ACM
- Published
- 2007-10-04
- Pages
- 70-81
- OpenAlex
- W2040174723
- Cited by
- 127
- References
- 9
- FWCI
- 2.91
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Getting users to pay attention to anti-phishing education: evaluation of retention and transfer. https://app.cochat.ai/papers/10.1145/1299015.1299022
- The paper
- Kumaraguru, P., Rhee, Y., Sheng, S., Hasan, S., Acquisti, A., Cranor, L. F., & Hong, J. (2007). Getting users to pay attention to anti-phishing education: evaluation of retention and transfer. Proceedings of the anti-phishing working groups 2nd annual eCrime researchers summit. https://doi.org/10.1145/1299015.1299022
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.