Towards Baselines for Shoulder Surfing on Mobile Authentication
Open accessThe DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
Given the nature of mobile devices and unlock procedures, unlock authentication is a prime target for credential leaking via shoulder surfing, a form of an observation attack. While the research community has investigated solutions to minimize or prevent the threat of shoulder surfing, our understanding of how the attack performs on current systems is less well studied. In this paper, we describe a large online experiment (n = 1173) that works towards establishing a baseline of shoulder surfing vulnerability for current unlock authentication systems. Using controlled video recordings of a victim entering in a set of 4- and 6-length PINs and Android unlock patterns on different phones from different angles, we asked participants to act as attackers, trying to determine the authentication input based on the observation. We find that 6-digit PINs are the most elusive attacking surface where a single observation leads to just 10.8% successful attacks (26.5% with multiple observations). As a comparison, 6-length Android patterns, with one observation, were found to have an attack rate of 64.2% (79.9% with multiple observations). Removing feedback lines for patterns improves security to 35.3% (52.1% with multiple observations). This evidence, as well as other results related to hand position, phone size, and observation angle, suggests the best and worst case scenarios related to shoulder surfing vulnerability which can both help inform users to improve their security choices, as well as establish baselines for researchers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Touch me once and i know it's you!: implicit authentication based on touch screen patterns
De Luca, A., Hang, A., Brudy, F., Lindner, C., & Hussmann, H. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208544 · Cited by 485
Testing metrics for password creation policies by attacking large sets of revealed passwords
Weir, M., Aggarwal, S., Collins, M., & Stern, H. (2010) · Proceedings of the 17th ACM conference on Computer and communications security · doi:10.1145/1866307.1866327 · Cited by 411
Kelley, P. G., Komanduri, S., Mazurek, M. L., Shay, R., Vidas, T., Bauer, L., Christin, N., Cranor, L. F., & Lopez, J. (2012) · 2012 IEEE Symposium on Security and Privacy · doi:10.1109/sp.2012.38 · Cited by 397
Design and evaluation of a shoulder-surfing resistant graphical password scheme
Wiedenbeck, S., Waters, J., Sobrado, L., & Birget, J.-C. (2006) · Proceedings of the working conference on Advanced visual interfaces - AVI '06 · doi:10.1145/1133265.1133303 · Cited by 382
Reducing shoulder-surfing by using gaze-based password entry
Kumar, M., Garfinkel, T., Boneh, D., & Winograd, T. (2007) · Proceedings of the 3rd symposium on Usable privacy and security · doi:10.1145/1280680.1280683 · Cited by 309
A PIN-entry method resilient against shoulder surfing
Roth, V., Richter, K., & Freidinger, R. (2004) · Proceedings of the 11th ACM conference on Computer and communications security · doi:10.1145/1030083.1030116 · Cited by 282
Quantifying the security of graphical passwords: the case of android unlock patterns
Uellenbeck, S., Dürmuth, M., Wolf, C., & Holz, T. (2013) · Proceedings of the 2013 ACM SIGSAC conference on Computer & communications security - CCS '13 · doi:10.1145/2508859.2516700 · Cited by 205
Password entry usability and shoulder surfing susceptibility on different smartphone platforms
Schaub, F., Deyhle, R., & Weber, M. (2012) · Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia · doi:10.1145/2406367.2406384 · Cited by 168
A Birthday Present Every Eleven Wallets? The Security of Customer-Chosen Banking PINs
Bonneau, J., Preibusch, S., & Anderson, R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-32946-3_3 · Cited by 164
Shoulder surfing defence for recall-based graphical passwords
Zakaria, N. H., Griffiths, D., Brostoff, S., & Yan, J. J. (2011) · Symposium On Usable Privacy and Security · doi:10.1145/2078827.2078835 · Cited by 155
von Zezschwitz, E., Dunphy, P., & De Luca, A. (2013) · Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services · doi:10.1145/2493190.2493231 · Cited by 142
The Anatomy of Smartphone Unlocking: A Field Study of Android Lock Screens
Harbach, M., Luca, A. D., & Egelman, S. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858267 · Cited by 142
Egelman, S., Jain, S., Portnoff, R. S., Liao, K., Consolvo, S., & Wagner, D. (2014) · Proceedings of the 2014 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2660267.2660273 · Cited by 134
Look into my eyes! can you guess my password?
Luca, A. D., Denzel, M., & Hußmann, H. (2009) · Symposium On Usable Privacy and Security · doi:10.1145/1572532.1572542 · Cited by 132
Shoulder-surfing resistance with eye-gaze entry in cued-recall graphical passwords
Forget, A., Chiasson, S., & Biddle, R. (2010) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753491 · Cited by 127
Now you see me, now you don't: protecting smartphone authentication from shoulder surfers
De Luca, A., Harbach, M., von Zezschwitz, E., Maurer, M.-E., Slawik, B. E., Hussmann, H., & Smith, M. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557097 · Cited by 117
SwiPIN: Fast and Secure PIN-Entry on Smartphones
von Zezschwitz, E., Luca, A. D., Brunkow, B., & Hußmann, H. (2015) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702212 · Cited by 114
ColorPIN: securing PIN entry through indirect input
Luca, A. D., Hertzschuch, K., & Hußmann, H. (2010) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753490 · Cited by 111
Vibrapass: secure authentication based on shared lies
De Luca, A., von Zezschwitz, E., & Hußmann, H. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518840 · Cited by 106
User-generated free-form gestures for authentication: security and memorability
Sherman, M., Clark, G., Yang, Y., Sugrim, S., Modig, A., Lindqvist, J., Oulasvirta, A., & Roos, T. (2014) · Proceedings of the 12th annual international conference on Mobile systems, applications, and services · doi:10.1145/2594368.2594375 · Cited by 105
A pilot study on the security of pattern screen-lock methods and soft side channel attacks
Andriotis, P., Tryfonas, T., Oikonomou, G., & Yildiz, C. (2013) · Proceedings of the sixth ACM conference on Security and privacy in wireless and mobile networks · doi:10.1145/2462096.2462098 · Cited by 105
A New Graphical Password Scheme Resistant to Shoulder-Surfing
Gao, H., Ren, Z., Chang, X., Liu, X., & Aickelin, U. (2010) · International Conference on Cyberworlds (CW) · doi:10.1109/cw.2010.34 · Cited by 104
Usability and Security of Text Passwords on Mobile Devices
Melicher, W., Kurilova, D., Segreti, S. M., Kalvani, P., Shay, R., Ur, B., Bauer, L., Christin, N., Cranor, L. F., & Mazurek, M. L. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858384 · Cited by 92
Exploring the design space of graphical passwords on smartphones
Schaub, F., Walch, M., Könings, B., & Weber, M. (2013) · Proceedings of the Ninth Symposium on Usable Privacy and Security · doi:10.1145/2501604.2501615 · Cited by 87
DRAW-A-PIN: Authentication using finger-drawn PIN on touch devices
Nguyen, T., Sae-Bae, N., & Memon, N. D. (2017) · Computers & Security · doi:10.1016/j.cose.2017.01.008 · Cited by 82
Complexity Metrics and User Strength Perceptions of the Pattern-Lock Graphical Authentication Method
Andriotis, P., Tryfonas, T., & Oikonomou, G. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-07620-1_11 · Cited by 80
Covert Attentional Shoulder Surfing: Human Adversaries Are More Powerful Than Expected
Kwon, T., Shin, S., & Na, S. (2013) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2013.2270227 · Cited by 70
Understanding Grip Shifts: How Form Factors Impact Hand Movements on Mobile Phones
Eardley, R., Roudaut, A., Gill, S., & Thompson, S. J. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025835 · Cited by 69
Aviv, A. J., Budzitowski, D., & Kuber, R. (2015) · Proceedings of the 31st Annual Computer Security Applications Conference · doi:10.1145/2818000.2818014 · Cited by 68
Self-citationEasy to Draw, but Hard to Trace?
von Zezschwitz, E., Luca, A. D., Janssen, P., & Hußmann, H. (2015) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702202 · Cited by 67
Shirazi, A. S., Moghadam, P., Ketabdar, H., & Schmidt, A. (2012) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208352 · Cited by 49
A new shoulder-surfing resistant password for mobile environments
Kim, S., Kim, J., Kim, S.-Y., & Cho, H.-G. (2011) · International Conference on Ubiquitous Information Management and Communication (IMCOM) · doi:10.1145/1968613.1968647 · Cited by 42
Understanding visual perceptions of usability and security of Android's graphical password pattern
Aviv, A. J., & Fichter, D. (2014) · Annual Computer Security Applications Conference · doi:10.1145/2664243.2664253 · Cited by 34
Self-citationOn quantifying the effective password space of grid-based unlock gestures
von Zezschwitz, E., Eiband, M., Buschek, D., Oberhuber, S., Luca, A. D., Alt, F., & Hußmann, H. (2016) · International Conference on Mobile and Ubiquitous Multimedia (MUM) · doi:10.1145/3012709.3012729 · Cited by 29
May the Force Be with You: The Future of Force-Sensitive Authentication
Krombholz, K., Hupperich, T., & Holz, T. (2017) · IEEE Internet Computing · doi:10.1109/mic.2017.78 · Cited by 19
Developing and Evaluating a Gestural and Tactile Mobile Interface to Support User Authentication
Ali, A. X. (2016) · iConference · doi:10.9776/16141 · Cited by 16
iOS Security and Privacy: Authentication Methods, Permissions, and Potential Pitfalls with Touch ID
Tipton, S. J., White, D. J., Sershon, C., & Choi, Y. B. (2014) · Cited by 14
Research works printed but not linked: 7
- [6] Adam J Aviv, Katherine Gibson, Evan Mossop, Matt Blaze, and Jonathan M Smith. 2010. Smudge Attacks on Smartphone Touch Screens.. In Proceedings of the 2010 Workshop on Offensive Technology (WOOT'10) . 1-7. -
- [7] Chandrasekhar Bhagavatula, Blase Ur, Kevin Iacovino, Su Mon Kywe, Lorrie Faith Cranor, and Marios Savvides. 2015. Biometric Authentication on iPhone and Android: Usability, Perceptions, and Influences on Adoption. (2015). -
- [8] Andrea Bianchi and Ian Oakley. 2014. Multiplexed input to protect against casual observers. In Proceedings of HCI Korea . Hanbit Media, Inc., 7-11. -
- [10] Ivan Cherapau, Ildar Muslukhov, Nalin Asanka, and Konstantin Beznosov. 2015. On the impact of touch id on iphone passcodes. In Eleventh Symposium On Usable Privacy and Security (SOUPS 2015) . 257-276. -
- [27] Behzad Malek, Mauricio Orozco, and Abdulmotaleb El Saddik. 2006. Novel shoulder-surfing resistant haptic-based graphical password. In Proc. EuroHaptics , Vol. 6. -
- [44] Oliver Wiese and Volker Roth. 2015. Pitfalls of Shoulder Surfing Studies. In NDSS Workshop on Usable Security . 1-6. -
- [46] Ziming Zhao, Gail-Joon Ahn, Jeong-Jin Seo, and Hongxin Hu. 2013. On the security of picture gesture authentication. In 22nd USENIX Security Symposium (USENIX Security 13) . 383-398.
Cited by
Mathis, F., Vaniea, K. E., & Khamis, M. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445478 · Cited by 62
Shoulder surfing experiments: A systematic literature review
Bošnjak, L., & Brumen, B. (2020) · Computers & Security · doi:10.1016/j.cose.2020.102023 · Cited by 51
Draw It As Shown: Behavioral Pattern Lock for Mobile User Authentication
Ku, Y., Park, L. H., Shin, S., & Kwon, T. (2019) · IEEE Access · doi:10.1109/access.2019.2918647 · Cited by 48
Strengthen user authentication on mobile devices by using user’s touch dynamics pattern
Teh, P. S., Zhang, N., Tan, S., Shi, Q., Khoh, W. H., & Nawaz, R. (2019) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-019-01654-y · Cited by 48
On the Security of Smartphone Unlock PINs
Markert, P., Bailey, D. V., Golla, M., Dürmuth, M., & Aviv, A. J. (2021) · ACM Transactions on Privacy and Security · doi:10.1145/3473040 · Cited by 41
Self-citation
Metadata
- Authors
- Aviv, A. J., Davin, J. T., Wolf, F., & Kuber, R.
- Affiliations
- United States Naval Academy (US)
- University of Maryland, Baltimore County (US)
- Venue
- Proceedings of the 33rd Annual Computer Security Applications Conference
- Publisher
- ACM
- Published
- 2017-12-04
- Pages
- 486-498
- ISSN
- 1063-9527 (ISSN-L)
- OpenAlex
- W2756320651
- Cited by
- 45
- References
- 37
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 5 · 2023: 9 · 2022: 7 · 2021: 6 · 2020: 4 · 2019: 6 · 2018: 3
- FWCI
- 2.73
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Annual Computer Security Applications Conference (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (public-domain)
- Funders
- National Security Agency
- Office of Naval Research (N00014-15-1-2776, N00014)
- Topics
- Physical Sciences › Computer Science › Information Systems › User Authentication and Security Systems
- Physical Sciences › Computer Science › Computer Networks and Communications › Advanced Authentication Protocols Security
- Physical Sciences › Computer Science › Information Systems › Information and Cyber Security
- Keywords
- shoulder surfing, mobile authentication, pin, credential leakage, attack success rate, hand position, viewing angle, security baseline
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.