Teaching Johnny not to fall for phish
The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Abstract
Phishing attacks, in which criminals lure Internet users to Web sites that spoof legitimate Web sites, are occurring with increasing frequency and are causing considerable harm to victims. While a great deal of effort has been devoted to solving the phishing problem by prevention and detection of phishing emails and phishing Web sites, little research has been done in the area of training users to recognize those attacks. Our research focuses on educating users about phishing and helping them make better trust decisions. We identified a number of challenges for end-user security education in general and anti-phishing education in particular: users are not motivated to learn about security; for most users, security is a secondary task; it is difficult to teach people to identify security threats without also increasing their tendency to misjudge nonthreats as threats. Keeping these challenges in mind, we developed an email-based anti-phishing education system called “PhishGuru” and an online game called “Anti-Phishing Phil” that teaches users how to use cues in URLs to avoid falling for phishing attacks. We applied learning science instructional principles in the design of PhishGuru and Anti-Phishing Phil. In this article we present the results of PhishGuru and Anti-Phishing Phil user studies that demonstrate the effectiveness of these tools. Our results suggest that, while automated detection systems should be used as the first line of defense against phishing attacks, user education offers a complementary approach to help people better recognize fraudulent emails and websites.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mayer, R. E. (2009) · doi:10.1017/cbo9780511811678 · Cited by 7,800
Mayer, R. (2020) · doi:10.1017/9781316941355 · Cited by 7,777
Detection Theory: A User's Guide
Macmillan, N. A., & Creelman, C. D. (1991) · Cited by 5,415
Mayer, R. E. (2001) · doi:10.1017/cbo9781139164603 · Cited by 2,304
Clark, R. C., Mayer, R. E., & Thalheimer, W. (2003) · Performance Improvement · doi:10.1002/pfi.4930420510 · Cited by 2,257
When and where do we apply what we learn?: A taxonomy for far transfer
Barnett, S. M., & Ceci, S. J. (2002) · Psychological Bulletin · doi:10.1037/0033-2909.128.4.612 · Cited by 2,076 · cited 2×
“Researchers have developed a taxonomy to classify different types of transfers [Gagne et al. 1948; Barnett and Ceci 2002].”
BackgroundHandbook of Human-Computer Interaction
(1988) · Elsevier eBooks · doi:10.1016/c2009-0-12113-x · Cited by 2,058
Cognitive Tutors: Lessons Learned
Anderson, J. R., Corbett, A. T., Koedinger, K. R., & Pelletier, R. (1995) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0402_2 · Cited by 1,982 · cited 2×
“Researchers have shown that providing immediate feedback during the knowledge acquisition phase results in efficient learning, guidance towards correct behavior, and a reduction in unproductive floundering [Anderson et al. 1995; Mathan and Koedinger 2003; Schmidt and Bjork 1992].”
Background(1993) · Medical Entomology and Zoology · Cited by 1,882
Schmidt, R. A., & Bjork, R. A. (1992) · Psychological Science · doi:10.1111/j.1467-9280.1992.tb00029.x · Cited by 1,582 · cited 3×
“Researchers have shown that providing immediate feedback during the knowledge acquisition phase results in ef.cient learning, guidance towards correct behavior, and a reduction in unproductive .oundering [Anderson et al. 1995; Mathan and Koedinger 2003; Schmidt and Bjork 1992].”
BackgroundInfluentialCordova, D. I., & Lepper, M. R. (1996) · Journal of Educational Psychology · doi:10.1037/0022-0663.88.4.715 · Cited by 1,568
Cognitive principles of multimedia learning: The role of modality and contiguity.
Moreno, R., & Mayer, R. E. (1999) · Journal of Educational Psychology · doi:10.1037//0022-0663.91.2.358 · Cited by 1,527
Situated Learning and Education
Anderson, J. R., Reder, L. M., & Simon, H. A. (1996) · Educational Researcher · doi:10.2307/1176775 · Cited by 1,455
Encyclopedia of Measurement and Statistics
Salkind, N. (2007) · Sage eBooks · doi:10.4135/9781412952644 · Cited by 1,420
Adams, A., & Sasse, M. A. (1999) · Communications of the ACM · doi:10.1145/322796.322806 · Cited by 1,401
Dhamija, R., Tygar, J. D., & Hearst, M. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124861 · Cited by 1,376
Macmillan, N. A., & Creelman, C. D. (2004) · doi:10.4324/9781410611147 · Cited by 1,269
The transfer of cognitive skill
(1990) · Choice Reviews Online · doi:10.5860/choice.27-2989 · Cited by 1,257
Understanding the potential of teachable moments: the case of smoking cessation
McBride, C. M. (2003) · Health Education Research · doi:10.1093/her/18.2.156 · Cited by 1,162 · cited 2×
“There is a plethora of literature on teachable moments, for example in the area of sexual behaviors and HIV prevention, injury prevention, and smoking cessation [McBride et al. 2003].”
BackgroundJagatic, T. N., Johnson, N. A., Jakobsson, M., & Menczer, F. (2007) · Communications of the ACM · doi:10.1145/1290958.1290968 · Cited by 1,156
Why Johnny can't encrypt: a usability evaluation of PGP 5.0
Whitten, A., & Tygar, J. D. (1999) · Cited by 1,082
Schwartz, D. L., & Bransford, J. D. (1998) · Cognition and Instruction · doi:10.1207/s1532690xci1604_4 · Cited by 1,037
Mayer, R. E., & Anderson, R. B. (1992) · Journal of Educational Psychology · doi:10.1037/0022-0663.84.4.444 · Cited by 1,000 · cited 2×
“proposed the contiguity principle, which states that: the effectiveness of the computer aided instruction increases when words and pictures are presented contiguously (rather than isolated from one another) in time and space [Mayer and Anderson 1992].”
BackgroundCSI/FBI computer crime and security survey
Power, R. (2001) · Medical Entomology and Zoology · Cited by 924
Aleven, V. A. W. M. M., & Koedinger, K. R. (2002) · Cognitive Science · doi:10.1207/s15516709cog2602_1 · Cited by 895
Chapter 3: Rethinking Transfer: A Simple Proposal With Multiple Implications
BRANSFORD, J. D., & SCHWARTZ, D. L. (1999) · Review of Research in Education · doi:10.3102/0091732x024001061 · Cited by 881 · cited 2×
“The definition and measurement of transfer are heavily debated in the learning science literature [Bransford and Schwartz 2001; Singley and Anderson 1989; Schwartz and Bransford 1998].”
BackgroundMethodHow People Learn: Bridging Research and Practice
Donovan, M. S., Bransford, J. D., & Pellegrino, J. W. (2000) · Cited by 872
One hundred years of forgetting: A quantitative description of retention.
Rubin, D. C., & Wenzel, A. E. (1996) · Psychological Review · doi:10.1037//0033-295x.103.4.734 · Cited by 814
You've been warned: an empirical study of the effectiveness of web browser phishing warnings
Egelman, S., Cranor, L. F., & Hong, J. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357219 · Cited by 607
Self-citationLearning to detect phishing emails
Fette, I., Sadeh, N., & Tomasic, A. (2007) · Proceedings of the 16th international conference on World Wide Web · doi:10.1145/1242572.1242660 · Cited by 604
Do security toolbars actually prevent phishing attacks?
Wu, M., Miller, R. C., & Garfinkel, S. L. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124863 · Cited by 557
Anti-Phishing Phil: the design and evaluation of a game that teaches people not to fall for phish
Sheng, S., Magnien, B., Kumaraguru, P., Acquisti, A., Cranor, L. F., Hong, J., & Nunge, E. (2007) · Proceedings of the 3rd symposium on Usable privacy and security · doi:10.1145/1280680.1280692 · Cited by 509
Self-citationA comparison of machine learning techniques for phishing detection
Abu-Nimeh, S., Nappa, D., Wang, X., & Nair, S. (2007) · Proceedings of the anti-phishing working groups 2nd annual eCrime researchers summit · doi:10.1145/1299015.1299021 · Cited by 502
The battle against phishing: Dynamic Security Skins
Dhamija, R., & Tygar, J. D. (2005) · Proceedings of the 2005 symposium on Usable privacy and security - SOUPS '05 · doi:10.1145/1073001.1073009 · Cited by 442
Security and Usability: Designing Secure Systems that People Can Use
Cranor, L. F., & Garfinkel, S. (2005) · Cited by 431
Self-citationDecision strategies and susceptibility to phishing
Downs, J. S., Holbrook, M. B., & Cranor, L. F. (2006) · Proceedings of the second symposium on Usable privacy and security - SOUPS '06 · doi:10.1145/1143120.1143131 · Cited by 352
Self-citationEncyclopedia of Measurement and Statistics
(2007) · Reference Reviews · doi:10.1108/09504120710838967 · Cited by 346
An Empirical Analysis of Phishing Blacklists
Sheng, S., Wardman, B., Warner, G., Cranor, L., Hong, J., & Zhang, C. (2018) · doi:10.1184/r1/6469805 · Cited by 337
Self-citationHandbook of human-computer interaction
Wilson, J. (1989) · Applied Ergonomics · doi:10.1016/0003-6870(89)90201-9 · Cited by 334
Maintenance of knowledge: Questions about memory we forgot to ask.
Bahrick, H. P. (1979) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.108.3.296 · Cited by 325 · cited 2×
“Learners should be able to use the acquired knowledge to make decisions [Mandl and Levin 1989; Bahrick 1979].”
BackgroundCorbett, A. T., & Anderson, J. R. (2001) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/365024.365111 · Cited by 280 · cited 2×
“showed that students who got immediate feedback performed significantly better than students who got delayed feedback [Corbett and Anderson 2001].”
BackgroundProtecting people from phishing: the design and evaluation of an embedded training email system
Kumaraguru, P., Rhee, Y., Acquisti, A., Cranor, L. F., Hong, J., & Nunge, E. (2007) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240760 · Cited by 280
Self-citationA Framework for Reasoning About the Human in the Loop
Cranor, L. F. (2018) · Figshare · doi:10.1184/r1/6620651 · Cited by 255
Self-citationPhinding Phish: Evaluating Anti-Phishing Tools
Zhang, Y., Egelman, S., Cranor, L., & Hong, J. (2018) · Figshare · doi:10.1184/r1/6470321 · Cited by 247
Self-citationKnowledge Acquisition From Text and Pictures
(1989) · Advances in Psychology · doi:10.1016/s0166-4115(08)x6085-6 · Cited by 241
Phishing and countermeasures: understanding the increasing problem of electronic identity theft
(2007) · Choice Reviews Online · doi:10.5860/choice.44-6276 · Cited by 231
Fostering the Intelligent Novice: Learning From Errors With Metacognitive Tutoring
Mathan, S. A., & Koedinger, K. R. (2005) · Educational Psychologist · doi:10.1207/s15326985ep4004_7 · Cited by 197
Getting users to pay attention to anti-phishing education: evaluation of retention and transfer
Kumaraguru, P., Rhee, Y. W., Sheng, S., Hasan, S., Acquisti, A., Cranor, L. F., & Hong, J. (2007) · doi:10.1145/1299015.1299022 · Cited by 189
Self-citationYe, Z. (., Smith, S., & Anthony, D. (2005) · ACM Transactions on Information and System Security · doi:10.1145/1065545.1065546 · Cited by 173
(2016) · The Psychology of Information Security · doi:10.2307/j.ctt19jcgrc.15 · Cited by 172
Handbook of Human Computer Interaction
(2021) · Springer eBooks · doi:10.1007/978-3-319-27648-9 · Cited by 166
Web wallet: preventing phishing attacks by revealing user intentions
Wu, M., Miller, R. C., & Little, G. (2006) · Proceedings of the second symposium on Usable privacy and security - SOUPS '06 · doi:10.1145/1143120.1143133 · Cited by 164
Immediate and delayed transfer of training effects in statistical reasoning.
Fong, G. T., & Nisbett, R. E. (1991) · Journal of Experimental Psychology General · doi:10.1037//0096-3445.120.1.34 · Cited by 147
An Evaluation of Extended Validation and Picture-in-Picture Phishing Attacks
Jackson, C., Simon, D. R., Tan, D. S., & Barth, A. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-77366-5_27 · Cited by 146
Fostering E-Mail Security Awareness: The West Point Carronade
Ferguson, A. (2005) · The EDUCAUSE quarterly/EDUCAUSE quarterly · Cited by 110
(2006) · Elsevier eBooks · doi:10.1016/b978-1-59749-030-6.x5000-4 · Cited by 90
The measurement of transfer of training.
Gagné, R. M., Foster, H., & Crowley, M. E. (1948) · Psychological Bulletin · doi:10.1037/h0061154 · Cited by 87
Online Identity Theft: Phishing Technology, Chokepoints and Countermeasures
Emigh, A., & Labs, R. (2005) · Cited by 82
TrustBar: Protecting (even Naïve) Web Users from Spoofing and Phishing Attacks
Herzberg, A., & Gbara, A. (2004) · Cited by 81
Phishing IQ Tests Measure Fear, Not Ability
Anandpara, V., Dingman, A., Jakobsson, M., Liu, D., & Roinestad, H. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-77366-5_33 · Cited by 80
Don't be a phish: steps in user education
Robila, S. A., & Ragucci, J. W. (2006) · ACM SIGCSE Bulletin · doi:10.1145/1140123.1140187 · Cited by 76
van Merriënboer, J. J. G., de Croock, M. B. M., & Jelsma, O. (1997) · Perceptual and Motor Skills · doi:10.2466/pms.1997.84.3.784 · Cited by 59
Fighting phishing at the user interface
Miller, R. C., & Wu, M. (2006) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 51
Phishing: Cutting the Identity Theft Line
Lininger, R., & Vines, R. D. (2005) · Cited by 49
THE MYTH OF USER EDUCATIONPreprint
Görling, S. (2006) · SSRN Electronic Journal · Cited by 41
Robila, S. A., & Ragucci, J. W. (2006) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/1140124.1140187 · Cited by 35
Modeling the Acquisition of Fluent Skill in Educational Action Games
Baker, R. S., Habgood, M. P. J., Ainsworth, S. E., & Corbett, A. T. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-73078-1_5 · Cited by 29
Comparing Instructional Strategies for Integrating Conceptual and Procedural Knowledge.
Rittle‐Johnson, B., & Koedinger, K. R. (2002) · Cited by 22
Eberts, R. E. (1997) · Elsevier eBooks · doi:10.1016/b978-044481862-1.50102-3 · Cited by 22
Cited by
Sheng, S., Holbrook, M., Kumaraguru, P., Cranor, L. F., & Downs, J. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753383 · Cited by 620
Self-citationHong, J. (2012) · Communications of the ACM · doi:10.1145/2063176.2063197 · Cited by 551
Self-citationPhishing Attacks: A Recent Comprehensive Study and a New Anatomy
Alkhalil, Z., Hewage, C., Nawaf, L., & Khan, I. (2021) · Frontiers in Computer Science · doi:10.3389/fcomp.2021.563060 · Cited by 524
Anti-Phishing Phil: the design and evaluation of a game that teaches people not to fall for phish
Sheng, S., Magnien, B., Kumaraguru, P., Acquisti, A., Cranor, L. F., Hong, J., & Nunge, E. (2007) · Proceedings of the 3rd symposium on Usable privacy and security · doi:10.1145/1280680.1280692 · Cited by 509
Self-citationUser preference of cyber security awareness delivery methods
Abawajy, J. (2014) · Behaviour & Information Technology · doi:10.1080/0144929x.2012.708787 · Cited by 361
Metadata
- Authors
- Kumaraguru, P., Sheng, S., Acquisti, A., Cranor, L. F., & Hong, J.
- Venue
- ACM Transactions on Internet Technology
- Published
- 2010-05
- Volume
- 10
- Issue
- 2
- Pages
- 1-31
- ISSN
- 1533-5399 (ISSN-L)
- 1557-6051
- OpenAlex
- W2071869991
- Cited by
- 396
- References
- 69
- FWCI
- 42.47
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.