Biometric authentication on a mobile device: a study of user effort, error and task disruption
The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
We examine three biometric authentication modalities -- voice, face and gesture -- as well as password entry, on a mobile device, to explore the relative demands on user time, effort, error and task disruption. Our laboratory study provided observations of user actions, strategies, and reactions to the authentication methods. Face and voice biometrics conditions were faster than password entry. Speaking a PIN was the fastest for biometric sample entry, but short-term memory recall was better in the face verification condition. None of the authentication conditions were considered very usable. In conditions that combined two biometric entry methods, the time to acquire the biometric samples was shorter than if acquired separately but they were very unpopular and had high memory task error rates. These quantitative results demonstrate cognitive and motor differences between biometric authentication modalities, and inform policy decisions in selecting authentication methods.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Baddeley, A. D., & Hitch, G. (1974) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60452-1 · Cited by 9,860
SUS: A 'Quick and Dirty' Usability Scale
(1996) · Usability Evaluation In Industry · doi:10.1201/9781498710411-35 · Cited by 8,989
An Empirical Evaluation of the System Usability Scale
Bangor, A., Kortum, P. T., & Miller, J. T. (2008) · International Journal of Human–Computer Interaction · doi:10.1080/10447310802205776 · Cited by 5,181 · cited 2×
“Sauro [27] analyzed over 500 studies using the SUS, allowing a raw SUS score to be transformed into a percentile, while Bangor et al [6] proposed an A-F grading scale, allowing for easy interpretation.”
MethodAdams, A., & Sasse, M. A. (1999) · Communications of the ACM · doi:10.1145/322796.322806 · Cited by 1,401
A large-scale study of web password habits
Florencio, D., & Herley, C. (2007) · Proceedings of the 16th international conference on World Wide Web · doi:10.1145/1242572.1242661 · Cited by 1,047 · cited 1×
“Even in desktop environments, users often select poor quality passwords [12][13].”
BackgroundGenerating Cancelable Fingerprint Templates
Ratha, N. K., Chikkerur, S., Connell, J. H., & Bolle, R. M. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1004 · Cited by 877 · cited 1×
“Privacy considerations may be addressed by cancellable biometrics [26].”
BackgroundProceedings of the 26th annual conference of the cognitive science society
Dieussaert, K., Ford, M., & Horsten, L. (2004) · Cited by 853
Interaction in 4-second bursts: the fragmented nature of attentional resources in mobile HCI
Oulasvirta, A., Tamminen, S., Roto, V., & Kuorelahti, J. (2005) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1054972.1055101 · Cited by 576 · cited 2×
“Interaction with mobile devices tends to be brief and interruption driven [24][25].”
BackgroundSecurity and Usability: Designing Secure Systems that People Can Use
Cranor, L. F., & Garfinkel, S. (2005) · Cited by 431
The electrical engineering handbook
Chen, W. (2005) · Cited by 294
Implicit authentication for mobile devices
Jakobsson, M., Shi, E., Golle, P., & Chow, R. (2009) · Cited by 223
Where do security policies come from?
Florêncio, D., & Herley, C. (2010) · Proceedings of the Sixth Symposium on Usable Privacy and Security · doi:10.1145/1837110.1837124 · Cited by 154
Trafton, J. G., & Monk, C. A. (2007) · Reviews of Human Factors and Ergonomics · doi:10.1518/155723408x299852 · Cited by 154
Reviews of Human Factors and Ergonomics
Morrissey, S. (2008) · Ergonomics · doi:10.1080/00140130701223758 · Cited by 151
A closer look at recognition-based graphical passwords on mobile devices
Dunphy, P., Heiner, A. P., & Asokan, N. (2010) · Proceedings of the Sixth Symposium on Usable Privacy and Security · doi:10.1145/1837110.1837114 · Cited by 119 · cited 1×
“Android screen lock pattern), graphical passwords [11], and biometric authentication [22] are beginning to emerge as alternative mobile authentication mechanisms, but passwords and PINs remain the most common methods used today.”
MethodTowards understanding user perceptions of authentication technologies
Jones, L. A., Antón, A. I., & Earp, J. B. (2007) · ACM Workshop on Privacy in the Electronic Society (WPES) · doi:10.1145/1314333.1314352 · Cited by 77 · cited 1×
“User attitudes have been explored [14][19][30], but relatively little attention has been paid to empirical comparison of the usability of biometric authentication methods.”
BackgroundSmart phone use by non-mobile business users
Bao, P., Pierce, J., Whittaker, S., & Zhai, S. (2011) · Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services · doi:10.1145/2037373.2037440 · Cited by 72 · cited 5×
“Bao et al [7] measured the time to type an 8-character, mixed-case alphanumeric password on desktops and mobile phones.”
BackgroundResultInfluentialSecurity Management for Mobile Devices by Face Recognition
Ijiri, Y., Sakuragi, M., & Lao, S. (2006) · IEEE International Conference on Mobile Data Management (MDM) · doi:10.1109/mdm.2006.138 · Cited by 65 · cited 1×
“Research has explored algorithms suitable for use on mobile devices [16][21], and for processing face and voice data gathered in noisy mobile environments [2], or with low resolution cameras [29].”
BackgroundUsability evaluation of multi-modal biometric verification systems
Toledano, D. T., Fernández Pozo, R., Hernández Trapote, Á., & Hernández Gómez, L. (2006) · Interacting with Computers · doi:10.1016/j.intcom.2006.01.004 · Cited by 64 · cited 1×
“al’s usability evaluation of multimodal (non mobile) biometric authentication systems [32] is a notable exception.”
BackgroundSecuring Electronic Medical Records Using Biometric Authentication
Krawczyk, S., & Jain, A. K. (2005) · Lecture notes in computer science · doi:10.1007/11527923_115 · Cited by 58 · cited 3×
“[20] S. Krawczyk and A. K. Jain.”
BackgroundInfluentialMultitasking and Interruptions during Mobile Web Tasks
Nagata, S. F. (2003) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120304701105 · Cited by 49 · cited 1×
“Interaction with mobile devices tends to be brief and interruption driven [24][25].”
BackgroundBevan, N. (1999) · International Conference on Human-Computer Interaction · Cited by 48
Biometric Authentication for a Mobile Personal Device
Tao, Q., & Veldhuis, R. N. J. (2006) · EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services (MobiQuitous) · doi:10.1109/mobiq.2006.340409 · Cited by 40
Multi-biometric cohort analysis for biometric fusion
Aggarwal, G., Ratha, N., Bolle, R. M., & Chellappa, R. (2008) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2008.4518837 · Cited by 38 · cited 1×
“Researchers have also investigated fusion of multiple biometrics to compensate for loss of quality in one modality [3][8][34].”
BackgroundImproving E-Banking Security with Biometrics: Modelling User Attitudes and Acceptance
Tassabehji, R., & Kamala, M. (2009) · IFIP International Conference on New Technologies, Mobility and Security (NTMS) · doi:10.1109/ntms.2009.5384806 · Cited by 28 · cited 1×
“User attitudes have been explored [14][19][30], but relatively little attention has been paid to empirical comparison of the usability of biometric authentication methods.”
BackgroundFace Biometrics for Personal Identification
Hammoud, R. I., Abidi, M. A., & Abidi, B. R. (2007) · Springer eBooks · doi:10.1007/978-3-540-49346-4 · Cited by 28
Experiments with Simple Iris Recognition for Mobile Phones
Kurkovsky, S., Carpenter, T., & MacDonald, C. (2010) · International Conference on Information Technology: New Generations · doi:10.1109/itng.2010.75 · Cited by 24
Gunson, N., Marshall, D., McInnes, F. R., & Jack, M. A. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2010.10.001 · Cited by 22 · cited 1×
“User attitudes have been explored [14][19][30], but relatively little attention has been paid to empirical comparison of the usability of biometric authentication methods.”
BackgroundFace biometrics for personal identification : multi-sensory multi-modal systems
Hammoud, R. I., Abidi, B. R., & Abidi, M. A. (2007) · Springer eBooks · Cited by 14
QPLC: A novel multimodal biometric score fusion method
Basak, J. K., Kate, K., Tyagi, V., & Ratha, N. (2010) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2010.5543232 · Cited by 12 · cited 1×
“Researchers have also investigated fusion of multiple biometrics to compensate for loss of quality in one modality [3][8][34].”
BackgroundMultitasking and interruptions during mobile web tasks
Nagata, S. F. (2003) · PsycEXTRA Dataset · doi:10.1037/e576962012-005 · Cited by 12
Multimodal Face and Speaker Identification for Mobile Devices
Hazen, T. J., Weinstein, E., Heisele, B., Park, A., & Ming, J. (2007) · Springer eBooks · doi:10.1007/978-3-540-49346-4_9 · Cited by 10
Biometric score fusion through discriminative training
Tyagi, V., & Ratha, N. (2011) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2011.5981833 · Cited by 3
Research works printed but not linked: 4
- M. Lennon . One in Three Experience Mobile Device Loss or Theft. Do People in 'Party Cities' Lose More Phones? , 2011 . http://www.securityweek.com/one-three-experience-mobile-device-loss-or-theft-do-people-party-cities-lose-more-phones. M. Lennon. One in Three Experience Mobile Device Loss or Theft. Do People in 'Party Cities' Lose More Phones?, 2011. http://www.securityweek.com/one-three-experience-mobile-device-loss-or-theft-do-people-party-cities-lose-more-phones.
- J. Sauro . Measuring usability with the System Usability Scale (SUS) , 2011 . http://www.measuringusability.com/sus.php. J. Sauro. Measuring usability with the System Usability Scale (SUS), 2011. http://www.measuringusability.com/sus.php.
- S. A. Schuckers , R. Derakhshani , S. Parthasardhi , and L. A. Hornak . Liveness detection in biometric devices . In Electrical Engineering Handbook , 3 rd edition. CRC Press , 2006 . S. A. Schuckers, R. Derakhshani, S. Parthasardhi, and L. A. Hornak. Liveness detection in biometric devices. In Electrical Engineering Handbook, 3rd edition. CRC Press, 2006.
- 10.5555/1790343.1790365 · doi:10.5555/1790343.1790365
Cited by
Surveying the Development of Biometric User Authentication on Mobile Phones
Meng, W., Wong, D. S., Furnell, S., & Zhou, J. (2015) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2014.2386915 · Cited by 300
“A laboratory study then can be seen in [214], which provided observations of user actions, strategies, and reactions to the authentication methods like voice and face.”
BackgroundFIRME: Face and Iris Recognition for Mobile Engagement
Marsico, M. D., Galdi, C., Nappi, M., & Riccio, D. (2014) · Image and Vision Computing · doi:10.1016/j.imavis.2013.12.014 · Cited by 148
“Face and iris share the properties required, because they are contact-less, can be processed by light-weight algorithms in terms of space and computational time, and just require the webcam available on all mobile devices.”
BackgroundBiometric Authentication on iPhone and Android: Usability, Perceptions, and Influences on Adoption
Bhagavatula, C., Ur, B., Iacovino, K., Kywe, S. M., Cranor, L. F., & Savvides, M. (2015) · Workshop on Usable Security (USEC) · doi:10.14722/usec.2015.23003 · Cited by 147
“compared face recognition, voice recognition, and gesture authentication to passwords on mobile devices [13].”
BackgroundGhorbani Lyastani, S., Schilling, M., Neumayr, M., Backes, M., & Bugiel, S. (2020) · 2020 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp40000.2020.00047 · Cited by 128
“Yet, an interesting question is to which extent the authenticator device type could undermine the security guarantees of FIDO2, for instance, if users lose their phone regularly [76], do not protect access to their device [77], [78], or depend on the battery life of the phone [34].”
BackgroundMultitouch Gesture-Based Authentication
Sae-Bae, N., Memon, N. D., Isbister, K., & Ahmed, K. (2014) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2014.2302582 · Cited by 106
Metadata
- Authors
- Trewin, S., Swart, C., Koved, L., Martino, J., Singh, K., & Ben-David, S.
- Affiliations
- IBM Research - Thomas J. Watson Research Center (US)
- IBM Research - Haifa (IL)
- Venue
- Proceedings of the 28th Annual Computer Security Applications Conference
- Publisher
- ACM
- Published
- 2012-12-03
- Pages
- 159-168
- ISSN
- 1063-9527 (ISSN-L)
- OpenAlex
- W2044308859
- Cited by
- 118
- References
- 33
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 1 · 2023: 4 · 2022: 8 · 2021: 7 · 2020: 7 · 2019: 21 · 2018: 10 · 2017: 9 · 2016: 20 · 2015: 8 · 2014: 14 · 2013: 4
- FWCI
- 6.54
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Annual Computer Security Applications Conference (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Information Systems › User Authentication and Security Systems
- Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- biometric authentication, mobile devices, voice biometrics, face recognition, gesture recognition, password entry, PIN entry, usability, user effort, error rate, multimodal authentication
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.