Usability of mobile applications: literature review and rationale for a new usability model
Open accessThe DOI matches its Crossref record; 151 of the 152 references it cites were found in a registry or an index; none of the 11 sources its claims cite is checked for support yet.
Abstract
The usefulness of mobile devices has increased greatly in recent years allowing users to perform more tasks in a mobile context. This increase in usefulness has come at the expense of the usability of these devices in some contexts. We conducted a small review of mobile usability models and found that usability is usually measured in terms of three attributes; effectiveness, efficiency and satisfaction. Other attributes, such as cognitive load, tend to be overlooked in the usability models that are most prominent despite their likely impact on the success or failure of an application. To remedy this we introduces the PACMAD (People At the Centre of Mobile Application Development) usability model which was designed to address the limitations of existing usability models when applied to mobile devices. PACMAD brings together significant attributes from different usability models in order to create a more comprehensive model. None of the attributes that it includes are new, but the existing prominent usability models ignore one or more of them. This could lead to an incomplete usability evaluation. We performed a literature search to compile a collection of studies that evaluate mobile applications and then evaluated the studies using our model.
Overview
CoChat Summary
TL;DR
The paper reviews mobile usability models and proposes PACMAD, a model with three factors and seven attributes, including cognitive load, to address limitations of traditional models for mobile applications. A literature review of 131 papers from 2008–2010 found effectiveness, efficiency, and satisfaction most commonly evaluated, while memorability was rarely evaluated.
Key findings
- PACMAD identifies three factors—User, Task, and Context of use—and seven usability attributes: Effectiveness, Efficiency, Satisfaction, Learnability, Memorability, Errors, and Cognitive load; cognitive load is the main addition to existing prominent models.
- In the reviewed studies, the most commonly evaluated attributes were Satisfaction (58.02%, 76 studies), Efficiency (54.96%, 72), Effectiveness (51.15%, 67), Errors (32.82%, 43), Cognitive Load (22.90%, 30), Learnability (20.61%, 27), and Memorability (2.29%, 3).
- Task was the dominant research focus (46.92%, 61 papers), followed by Interaction (29.77%, 39), User (9.23%, 12), Context (8.46%, 11), and Development Methodology (6.15%, 8).
- Controlled experiments were the most common research methodology (59.51%, 97 studies), followed by field studies (26.99%, 44); the discussion states almost 23% of studies measured cognitive load, supporting its inclusion, while only 2% evaluated memorability.
Methods
- Literature review of papers published 2008–2010, searched via ACM digital library, IEEE digital library, and Google Scholar using search strings including “Mobile Application Evaluations,” “Usability of mobile applications,” and “Mobile application usability evaluations.”
- Sources included MobileHCI, IJMHCI, TOCHI, IJHCS, PUC, and IJHCI; CHI and IEEE TOMC were discarded because less than 5% of their papers were relevant. Abstract screening was done by the first two authors, with disagreements resolved by discussion.
- 131 papers were included (Table 3); 20 relevant papers without formal evaluations were excluded, and multiple studies within papers were considered independently, yielding 163 studies for methodology analysis. Data extraction was by one reviewer, with the first and second authors independently reviewing a 10% sample.
Limitations
- The paper states that 8 out of 139 relevant papers were unavailable (less than 6%), that omitting certain sources may have introduced bias, and that some outlying studies may have been omitted due to limited resources, though omitted papers were believed to be of borderline significance.
- The text makes evident that the review was limited to 2008–2010 and to selected venues; the studies often did not explicitly cite usability criteria, and the attributes are not orthogonal.
- The paper also notes that it adopts a relatively simple view of cognitive load, and that a more powerful multifactorial approach would be preferable but is beyond its scope.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 12 Not valid · 8 Not checked · 85 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“From our review it is apparent that many existing models for usability do not consider mobility and its consequences, such as additional cognitive load.”
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“None of the attributes that it includes are new, but the existing prominent usability models ignore one or more of them.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Other attributes, such as cognitive load, tend to be overlooked in the usability models that are most prominent despite their likely impact on the success or failure of an application.”
- Also stated in: § Introduction · plain
“This aspect of usability is often overlooked in existing usability models, which are outlined in the next section, as these models are designed for applications which are seldom used in a mobile context.”
- Also stated in: § Limitations for mobile applications · hedged
“From our review it is apparent that many existing models for usability do not consider mobility and its consequences, such as additional cognitive load.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Introduction · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We conducted a small review of mobile usability models and found that usability is usually measured in terms of three attributes; effectiveness, efficiency and satisfaction.”
- Also stated in: § RQ1: What attributes are used when considering the usability of mobile applications? · plain
“The three most common attributes, Effectiveness, Efficiency and Satisfaction, correspond to the attributes identified by the ISO ' s standard for usability.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § RQ1: What attributes are used when considering the usability of mobile applications? · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Twenty papers that were identified as being relevant did not contain any formal evaluations of the proposed technologies.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
46 more claims
Create a free account to see all 105 claims and every source verdict.
- Borderline: one of the tests for a substantial claim is unclear. 1
- Probably not a substantial claim. 45
- It may state two separate claims as one. 18
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For example, different results can be obtained if more people that are elderly are taken into account, as their acceptance and use of technology are different from the younger generation [59].”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ RQ1: What attributes are used when considering the usability of mobile applications?
“About 26% of the studies considered cognitive load.”
§ RQ1: What attributes are used when considering the usability of mobile applications?
“| Cognitive Load | 22.90% | 30 |”
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
(1993) · Cited by 9,879
Challenges, Methodologies, and Issues in the Usability Testing of Mobile Applications
Zhang, D., & Adipat, B. (2005) · International Journal of Human-Computer Interaction · doi:10.1207/s15327590ijhc1803_3 · Cited by 613 · cited 3×
“Zhang and Adipat [6] highlighted a number of issues that have been introduced by the advent of mobile devices: Mobile Context: When using mobile applications the user is not tied to a single location.”
BackgroundInfluentialA Review of Mobile HCI Research Methods
Kjeldskov, J., & Graham, C. (2003) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-45233-1_23 · Cited by 375
Understanding and capturing people's privacy policies in a mobile social networking application
Sadeh, N., Hong, J., Cranor, L., Fette, I., Kelley, P., Prabaker, M., & Rao, J. (2009) · Personal and Ubiquitous Computing · doi:10.1007/s00779-008-0214-3 · Cited by 318
Foundations of Augmented Cognition
(2005) · CRC Press eBooks · doi:10.1201/9781482289701 · Cited by 315
Context of Use within usability activities
MAGUIRE, M. (2001) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.2001.0486 · Cited by 275 · cited 1×
“Context of use can vary enormously and so should be considered an important factor of usability [5,33].”
BackgroundArvanitis, T. N., Petrou, A., Knight, J. F., Savas, S., Sotiriou, S., Gargalakos, M., & Gialouri, E. (2009) · Personal and Ubiquitous Computing · doi:10.1007/s00779-007-0187-7 · Cited by 245
An empirical investigation of mobile ticketing service adoption in public transportation
Mallat, N., Rossi, M., Tuunainen, V. K., & Öörni, A. (2007) · Personal and Ubiquitous Computing · doi:10.1007/s00779-006-0126-z · Cited by 223
An innovative mobile electronic tourist guide application
Kenteris, M., Gavalas, D., & Economou, D. (2009) · Personal and Ubiquitous Computing · doi:10.1007/s00779-007-0191-y · Cited by 210
Predicting the effects of in-car interface use on driver performance: an integrated model approach
SALVUCCI, D. D. (2001) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.2001.0472 · Cited by 195
Enhancing learning: a study of how mobile devices can facilitate sensemaking
Rogers, Y., Connelly, K., Hazlewood, W. R., & Tedesco, L. P. (2009) · Personal and Ubiquitous Computing · doi:10.1007/s00779-009-0250-7 · Cited by 169
The performance of hand postures in front- and back-of-device interaction for mobile computing
Wobbrock, J. O., Myers, B. A., & Aung, H. H. (2008) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2008.03.004 · Cited by 169
Benefits and costs of adaptive user interfaces
Lavie, T., & Meyer, J. (2010) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2010.01.004 · Cited by 158
Investigating selection and reading performance on a mobile phone while walking
Schildbach, B., & Rukzio, E. (2010) · Proceedings of the 12th international conference on Human computer interaction with mobile devices and services · doi:10.1145/1851600.1851619 · Cited by 154 · cited 2×
“Research has shown that using mobile applications while walking can slow down the walker’s average walking speed [8].”
BackgroundGetting off the treadmill: evaluating walking user interfaces for mobile devices in public spaces
Kane, S. K., Wobbrock, J. O., & Smith, I. E. (2008) · Proceedings of the 10th international conference on Human computer interaction with mobile devices and services · doi:10.1145/1409240.1409253 · Cited by 151
Tan, F. B., & Chou, J. P. C. (2008) · International Journal of Human-Computer Interaction · doi:10.1080/10447310802335581 · Cited by 150
Human-Computer Interaction with Mobile Devices and Services
CONINX, K., Luyten, K., VANDERVELPEN, C., den Bergh, J. V., & CREEMERS, B. (2003) · Lecture notes in computer science · doi:10.1007/b12029 · Cited by 140
Empirical evidence about the UML: a systematic literature review
Budgen, D., Burn, A. J., Brereton, O. P., Kitchenham, B. A., & Pretorius, R. (2011) · Software: Practice and Experience · doi:10.1002/spe.1009 · Cited by 138
A user study of auditory versus visual interfaces for use while driving
Sodnik, J., Dicke, C., Tomažič, S., & Billinghurst, M. (2008) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2007.11.001 · Cited by 134
Age- and experience-related user behavior differences in the use of complicated electronic devices
Kang, N. E., & Yoon, W. C. (2008) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2007.12.003 · Cited by 128
Papiercraft: A gesture-based command system for interactive paper
Liao, C., Guimbretière, F. V., Hinckley, K., & Hollan, J. (2008) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1314683.1314686 · Cited by 126
TimeWarp: interactive time travel with a mobile mixed reality game
Herbst, I., Braun, A.-K., McCall, R., & Broll, W. (2008) · Proceedings of the 10th international conference on Human computer interaction with mobile devices and services · doi:10.1145/1409240.1409266 · Cited by 116
Mobile phones assisting with health self-care: a diabetes case study
Preuveneers, D., & Berbers, Y. (2008) · Proceedings of the 10th international conference on Human computer interaction with mobile devices and services · doi:10.1145/1409240.1409260 · Cited by 114
MobGeoSen: facilitating personal geosensor data collection and visualization using mobile phones
Kanjo, E., Benford, S., Paxton, M., Chamberlain, A., Fraser, D. S., Woodgate, D., Crellin, D., & Woolard, A. (2007) · Personal and Ubiquitous Computing · doi:10.1007/s00779-007-0180-1 · Cited by 106
Embodied interaction with a 3D versus 2D mobile map
Oulasvirta, A., Estlander, S., & Nurminen, A. (2008) · Personal and Ubiquitous Computing · doi:10.1007/s00779-008-0209-0 · Cited by 104
Activity-based computing for medical work in hospitals
Bardram, J. E. (2009) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1534903.1534907 · Cited by 100
Measuring user experience: complementing qualitative and quantitative assessment
Fehnert, B., & Kosagowsky, A. (2008) · Proceedings of the 10th international conference on Human computer interaction with mobile devices and services · doi:10.1145/1409240.1409294 · Cited by 98
A Comparative Study Between Tablet and Laptop PCs: User Satisfaction and Preferences
Ozok, A. A., Benson, D., Chakraborty, J., & Norcio, A. F. (2008) · International Journal of Human-Computer Interaction · doi:10.1080/10447310801920524 · Cited by 96
Visualization of off-screen objects in mobile augmented reality
Schinke, T., Henze, N., & Boll, S. (2010) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1851600.1851655 · Cited by 93
Navigation techniques for small-screen devices: An evaluation on maps and web pages
Burigat, S., Chittaro, L., & Gabrielli, S. (2007) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2007.08.006 · Cited by 91
GraspZoom: zooming and scrolling control model for single-handed mobile interaction
Miyaki, T., & Rekimoto, J. (2009) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1613858.1613872 · Cited by 90
Touch key design for target selection on a mobile phone
Park, Y. S., Han, S. H., Park, J., & Cho, Y. (2008) · Proceedings of the 10th international conference on Human computer interaction with mobile devices and services · doi:10.1145/1409240.1409304 · Cited by 83
Proactive displays: Supporting awareness in fluid social environments
McDonald, D. W., McCarthy, J. F., Soroczak, S., Nguyen, D. H. A., & Rashid, A. M. (2008) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1314683.1314684 · Cited by 82
ONTRACK: Dynamically adapting music playback to support navigation
Jones, M., Jones, S., Bradley, G., Warren, N., Bainbridge, D., & Holmes, G. (2008) · Personal and Ubiquitous Computing · doi:10.1007/s00779-007-0155-2 · Cited by 81
Pressure-based text entry for mobile devices
Brewster, S. A., & Hughes, M. (2009) · Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services · doi:10.1145/1613858.1613870 · Cited by 80
Does context matter in quality evaluation of mobile television?
Jumisko-Pyykkö, S., & Hannuksela, M. M. (2008) · Proceedings of the 10th international conference on Human computer interaction with mobile devices and services · doi:10.1145/1409240.1409248 · Cited by 80
Mobile technologies in mobile spaces: Findings from the context of train travel
Axtell, C., Hislop, D., & Whittaker, S. (2008) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2008.07.001 · Cited by 80
Expectations for user experience in haptic communication with mobile devices
Heikkinen, J., Olsson, T., & Väänänen, K. (2009) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1613858.1613895 · Cited by 77
Rapid prototyping and evaluation of in-vehicle interfaces
Salvucci, D. D. (2009) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1534903.1534906 · Cited by 77
Lessons from early stages design of mobile applications
de Sá, M., & Carriço, L. M. (2008) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1409240.1409255 · Cited by 75
Supporting device discovery and spontaneous interaction with spatial references
Gellersen, H. W., Fischer, C., Guinard, D., Gostner, R., Kortuem, G., Kray, C., Rukzio, E., & Streng, S. (2008) · Personal and Ubiquitous Computing · doi:10.1007/s00779-008-0206-3 · Cited by 74
A usability comparison of three alternative message formats for an SMS banking service
Peevers, G., Douglas, G., & Jack, M. A. (2007) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2007.09.005 · Cited by 69
Pressure-based menu selection for mobile devices
Wilson, G., Stewart, C. D., & Brewster, S. A. (2010) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1851600.1851631 · Cited by 69
Appropriating Heuristic Evaluation for Mobile Computing
Bertini, E., Catarci, T., Dix, A., Gabrielli, S., Kimani, S., & Santucci, G. (2009) · International Journal of Mobile Human Computer Interaction · doi:10.4018/jmhci.2009010102 · Cited by 68
Mobiphos: a collocated-synchronous mobile photo sharing application
Clawson, J., Voida, A., Patel, N., & Lyons, K. (2008) · Proceedings of the 10th international conference on Human computer interaction with mobile devices and services · doi:10.1145/1409240.1409261 · Cited by 64
Takayama, L. A., & Nass, C. (2006) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2006.06.005 · Cited by 62
Collaborative use of mobile phones for brainstorming
Lucero, A., Keränen, J., & Korhonen, H. (2010) · Proceedings of the 12th international conference on Human computer interaction with mobile devices and services · doi:10.1145/1851600.1851659 · Cited by 61
Hang, A., Rukzio, E., & Greaves, A. (2008) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1409240.1409263 · Cited by 61
Iterative design of MOVE: A situationally appropriate vehicle navigation system
Lee, J., Forlizzi, J., & Hudson, S. E. (2008) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2007.01.004 · Cited by 61
Fickas, S. F., Sohlberg, M. M., & Hung, P.-F. (2008) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2008.07.006 · Cited by 58
RearType: text entry using keys on the back of a device
Scott, J., Izadi, S., Rezai, L. S., Ruszkowski, D., Bi, X., & Balakrishnan, R. (2010) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1851600.1851630 · Cited by 56
Sintoris, C., Stoica, A., Papadimitriou, I., Yiannoutsou, N., Komis, V., & Avouris, N. (2010) · International Journal of Mobile Human Computer Interaction · doi:10.4018/jmhci.2010040104 · Cited by 55
Developing a questionnaire for measuring mobile business service experience
Vuolle, M., Tiainen, M., Kallio, T., Vainio, T., Kulju, M., & Wigelius, H. (2008) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1409240.1409247 · Cited by 52
Foundations for designing and evaluating user interfaces based on the crossing paradigm
Apitz, G., Guimbretière, F. V., & Zhai, S. (2008) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1746259.1746263 · Cited by 49
Tlk or txt? Using voice input for SMS composition
Cox, A. L., Cairns, P. A., Walton, A., & Lee, S. (2007) · Personal and Ubiquitous Computing · doi:10.1007/s00779-007-0178-8 · Cited by 47
Vibrotactile feedback as an orientation aid for blind users of mobile guides
Ghiani, G., Leporini, B., & Paternò, F. (2008) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1409240.1409306 · Cited by 46
Children's Interaction with Mobile Touch-Screen Devices: Experiences and Guidelines for Design
McKnight, L., & Cassidy, B. (2010) · International Journal of Mobile Human Computer Interaction · doi:10.4018/jmhci.2010040101 · Cited by 45
Rangoli: a visual phonebook for low-literate users
Joshi, A. N., Welankar, N., Naveen, B. L., Kanitkar, K., & Sheikh, R. (2008) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1409240.1409264 · Cited by 44
Chittaro, L., & Nadalutti, D. (2008) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1409240.1409297 · Cited by 43
Supporting intelligent and trustworthy maritime path planning decisions
Cummings, M. L., Buchin, M. E., Carrigan, G. P., & Donmez, B. (2010) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2010.05.002 · Cited by 43
Effects of mobile map orientation and tactile feedback on navigation speed and situation awareness
Smets, N. J. J. M., Brake, G. M. T., Neerincx, M. A., & Lindenberg, J. (2008) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1409240.1409249 · Cited by 43
Ecker, R., Broy, V., Butz, A. M., et al. (2009) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1613858.1613887 · Cited by 43
What input errors do you experience? Typing and pointing errors of mobile Web users
Chen, T., Yeşilada, Y., & Harper, S. (2009) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.10.003 · Cited by 42
Mobile Internet Services from Consumers' Perspectives
Lee, S. (2009) · International Journal of Human-Computer Interaction · doi:10.1080/10447310902865008 · Cited by 41
User Experience of Mobile Internet: Analysis and Recommendations
Kaasinen, E., Roto, V., Roloff, K., Väänänen, K., Vainio, T., Maehr, W., Joshi, D., & Shrestha, S. (2009) · International Journal of Mobile Human Computer Interaction · doi:10.4018/ijmhci.2009100102 · Cited by 40
Map, diagram, and web page navigation on mobile devices
(2008) · doi:10.1145/1409240.1409257 · Cited by 37
Decision and stress: cognition and e-accessibility in the information workplace
Adams, R. (2007) · Universal Access in the Information Society · doi:10.1007/s10209-006-0061-9 · Cited by 37 · cited 2×
“For a more accurate assessment it may be preferable to adopt a more powerful multifactorial approach [1,12] but this is beyond the scope of this paper.”
BackgroundUser Acceptance of Mobile Services
Kaasinen, E. (2009) · International Journal of Mobile Human Computer Interaction · doi:10.4018/jmhci.2009010105 · Cited by 35
User experiences with activity-based navigation on mobile devices
Brush, A. J. B., Karlson, A. K., Scott, J., Sarin, R., Jacobs, A., Bond, B., Murillo, O., Hunt, G. C., Sinclair, M., Hammil, K., et al. (2010) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1851600.1851616 · Cited by 35
T-Bars: towards tactile user interfaces for mobile touchscreens
Hall, M., Hoggan, E. E., & Brewster, S. A. (2008) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1409240.1409301 · Cited by 35
Sørensen, C., & Al-Taitoon, A. (2008) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2008.07.002 · Cited by 34
Assessing mobile touch interfaces for tetraplegics
Guerreiro, T. J. V., Nicolau, H., Jorge, J., & Gonçalves, D. (2010) · Proceedings of the 12th international conference on Human computer interaction with mobile devices and services · doi:10.1145/1851600.1851608 · Cited by 34
Field evaluation of a mobile location-based notification system for police officers
Streefkerk, J. W., van Esch-Bussemakers, M. P., & Neerincx, M. A. (2008) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1409240.1409252 · Cited by 34
Mobile interaction with static and dynamic NFC-based displays
Hardy, R. M., Rukzio, E., Holleis, P., & Wagner, M. W. (2010) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1851600.1851623 · Cited by 33
Contextual queries express mobile information needs
(2010) · doi:10.1145/1851600.1851658 · Cited by 32
A tangible user interface for assessing cognitive mapping ability
Sharlin, E., Watson, B. A., Sutphen, S., Liu, L., Lederer, R., & Frazer, J. H. (2008) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2008.09.014 · Cited by 31
Keijzers, J. J., den Ouden, E., & Lü, Y. (2008) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1409240.1409269 · Cited by 30
Exploiting the icon arrangement on mobile devices as information source for context-awareness
Böhmer, M., & Bauer, G. (2010) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1851600.1851633 · Cited by 30
Situated local and global orientation in mobile you-are-here maps
Falko Schmid, A., Kuntzsch, C., Winter, S., Kazerani, A., & Preisig, B. (2010) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1851600.1851617 · Cited by 30
Adaptive training of video sets for image recognition on mobile phones
Bruns, E., & Bimber, O. (2009) · Personal and Ubiquitous Computing · doi:10.1007/s00779-008-0194-3 · Cited by 30 · cited 1×
“For example Bruns and Bimber [14] have developed an augmented reality application which allows users to take a photograph of an exhibit at an art gallery which allows the system to find additional information about the work of art.”
BackgroundEvaluating Mobile Applications: A Spreadsheet Case Study
Flood, D., Harrison, R., Iacob, C., & Duce, D. (2012) · International Journal of Mobile Human Computer Interaction · doi:10.4018/jmhci.2012100103 · Cited by 29 · cited 1×
“Learnability A recent survey of mobile application users [9] found that users will spend on average 5 minutes or less learning to use a mobile application.”
BackgroundSelf-citation(2008) · doi:10.1145/1409240.1409299 · Cited by 28
Ask and You Will Receive: Training Novice Adults to use a PDA in an Active Learning Environment
Arning, K., & Ziefle, M. (2010) · International Journal of Mobile Human Computer Interaction · doi:10.4018/jmhci.2010100602 · Cited by 28
Field testing mobile digital storytelling software in rural Kenya
Reitmaier, T., Bidwell, N. J., & Marsden, G. (2010) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1851600.1851649 · Cited by 27
Dahl, Y., & Svanæs, D. (2007) · Personal and Ubiquitous Computing · doi:10.1007/s00779-007-0141-8 · Cited by 26
Control centric approach in designing scrolling and zooming user interfaces
Eslambolchilar, P., & Murray‐Smith, R. (2008) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2008.07.005 · Cited by 25
Lacroix, J. P. W., Saini, P. K., & Holmes, R. (2008) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1409240.1409302 · Cited by 25
Motion marking menus: An eyes-free approach to motion input for handheld devices
Oakley, I., & Park, J. (2009) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.02.002 · Cited by 25
Designing mobile awareness cues
Oulasvirta, A. (2008) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1409240.1409246 · Cited by 24
Evaluation of picture browsing using a projector phone
(2008) · doi:10.1145/1409240.1409286 · Cited by 24
Investigating five key predictive text entry with combined distance and keystroke modelling
Dunlop, M. D., & Masters, M. M. (2007) · Personal and Ubiquitous Computing · doi:10.1007/s00779-007-0179-7 · Cited by 24
Semi-automatic zooming for mobile map navigation
Kratz, S., Brodien, I., & Rohs, M. (2010) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1851600.1851615 · Cited by 22
Swiping paper: the second hand, mundane artifacts, gesture and collaboration
Luff, P., Pitsch, K., Heath, C., Herdman, P., & Wood, J. (2009) · Personal and Ubiquitous Computing · doi:10.1007/s00779-009-0253-4 · Cited by 22
Evaluation of an off-screen visualization for magic lens and dynamic peephole interfaces
Henze, N., & Boll, S. (2010) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1851600.1851632 · Cited by 22
Schröder, S., & Ziefle, M. (2008) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1409240.1409256 · Cited by 22
Practices in creating videos with mobile phones
Puikkonen, A., Häkkilä, J., Ballagas, R., & Mäntyjärvi, J. (2009) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1613858.1613862 · Cited by 21
Mobile technology for crime scene examination
Baber, C., Smith, P. A., Butler, M., et al. (2008) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2008.12.004 · Cited by 21
An explorative comparison of magic lens and personal projection for interacting with smart objects
Kawsar, F., Rukzio, E., & Kortuem, G. (2010) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1851600.1851627 · Cited by 21
The Optimal Size of Handwriting Character Input Boxes on PDAs
Ren, X., & Zhou, X. (2009) · International Journal of Human-Computer Interaction · doi:10.1080/10447310903025511 · Cited by 20
An evaluation of product review modalities for mobile phones
von Reischach, F., Spiegler, E. D., Michahelles, F., & Schmidt, A. (2010) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1851600.1851635 · Cited by 20
Kray, C., Rohs, M., Hook, J., & Kratz, S. (2009) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.09.006 · Cited by 20
Fixed in time and "time in motion": mobility of vision through a SenseCam lens
Lindley, S. E., Harper, R. H. R., Randall, D. W., Glancy, M., & Smyth, N. (2009) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1613858.1613861 · Cited by 19
A user-adaptive city guide system with an unobtrusive navigation interface
Takeuchi, Y., & Sugimoto, M. (2007) · Personal and Ubiquitous Computing · doi:10.1007/s00779-007-0192-x · Cited by 19
Dai, L., Sears, A., & Goldman, R. (2009) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1502800.1502804 · Cited by 18
Playing different games on different phones
(2008) · doi:10.1145/1409240.1409296 · Cited by 17
(2010) · doi:10.1145/1851600.1851611 · Cited by 17
A study of direct versus planned 3D camera manipulation on touch-based mobile phones
Dècle, F., & Hachet, M. (2009) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1613858.1613899 · Cited by 16
Capricorn - an intelligent user interface for mobile widgets
Boström, F., Nurmi, P., Floréen, P., Liu, T., Oikarinen, T.-K., Vetek, A., & Boda, P. (2008) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1409240.1409280 · Cited by 16
Instrumented Usability Analysis for Mobile Devices
Crossan, A., Murray‐Smith, R., Brewster, S. A., & Musizza, B. (2009) · International Journal of Mobile Human Computer Interaction · doi:10.4018/jmhci.2009010101 · Cited by 15
Hands on music: physical approach to interaction with digital music
Bergman, J., Kauko, J., & Keränen, J. (2009) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1613858.1613901 · Cited by 15
Exploring music collections on mobile devices
(2008) · doi:10.1145/1409240.1409288 · Cited by 14
Lin, P., & Chien, L.-W. (2010) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2010.06.006 · Cited by 14
End-to-end adaptation scheme for ubiquitous remote experimentation
Salzmann, C., Gillet, D., & Müllhaupt, P. (2007) · Personal and Ubiquitous Computing · doi:10.1007/s00779-007-0184-x · Cited by 13
Deploying and evaluating a mixed reality mobile treasure hunt
(2008) · doi:10.1145/1409240.1409282 · Cited by 13
(2010) · doi:10.1145/1851600.1851621 · Cited by 12
Text versus speech: a comparison of tagging input modalities for camera phones
Cherubini, M., Anguera, X., Oliver, N., & de Oliveira, R. C. (2009) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1613858.1613860 · Cited by 12
(2009) · doi:10.7748/ns.23.39.19.s25 · Cited by 12
Data logging plus e-diary: towards an online evaluation approach of mobile service field trial
Liu, N., Liu, Y., & Wang, X. (2010) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1851600.1851650 · Cited by 12
A model of novice and expert navigation performance in constrained-input interfaces
Cockburn, A., & Gutwin, C. A. (2010) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1806923.1806927 · Cited by 11
Context-aware photo selection for promoting photo consumption on a mobile phone
Yoon, Y., Ahn, Y.-R., Lee, G., Hong, S., & Kim, M. (2008) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1409240.1409245 · Cited by 11
Liu, Y., & Räihä, K. (2008) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1409240.1409265 · Cited by 11
Development of the Conceptual Prototype for Haptic Interface on the Telematics System
Ji, Y. G., & Jin, B. S. (2009) · International Journal of Human-Computer Interaction · doi:10.1080/10447310903025545 · Cited by 11
Development of a Dual-Modal Presentation of Texts for Small Screens
Xu, S., Fang, X., Brzeziński, J., & Chan, S. S. (2008) · International Journal of Human-Computer Interaction · doi:10.1080/10447310802537566 · Cited by 11
Taylor, C., Samuels, N., & Ramey, J. A. (2009) · International Journal of Mobile Human Computer Interaction · doi:10.4018/jmhci.2009062603 · Cited by 10
Zoom interaction design for pen-operated portable devices
Büring, T., Gerken, J., & Reiterer, H. (2008) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2008.03.005 · Cited by 9
Relative role of merging and two-handed operation on command selection speed
Chen, N. Y., Guimbretière, F. V., & Löckenhoff, C. E. (2008) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2008.06.003 · Cited by 9
Estimating Cognitive Overload in Mobile Applications for Decision Support within the Medical Domain
(2012) · doi:10.5220/0003971501030107 · Cited by 8
Self-citationExploring the design space of Smart Horizons
(2008) · doi:10.1145/1409240.1409289 · Cited by 8
Usage of spatial information for selection of co-located devices
Gostner, R., Rukzio, E., & Gellersen, H. W. (2008) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1409240.1409305 · Cited by 8
Design ideas for IT in public spaces
Kristoffersen, S., & Bratteberg, I. (2010) · Personal and Ubiquitous Computing · doi:10.1007/s00779-009-0255-2 · Cited by 7
Exploring casual point-and-tilt interactions for mobile geo-blogging
Robinson, S., Eslambolchilar, P., & Jones, M. (2009) · Personal and Ubiquitous Computing · doi:10.1007/s00779-009-0236-5 · Cited by 7
3D content-based search using sketches
(2007) · doi:10.1007/s00779-007-0166-z · Cited by 7
Novel interfaces for digital cameras and camera phones
(2010) · doi:10.1145/1851600.1851625 · Cited by 7
(2008) · doi:10.1145/1409240.1409298 · Cited by 7
(2010) · doi:10.1145/1851600.1851641 · Cited by 7
(2010) · doi:10.4018/jmhci.2010070104 · Cited by 5
(2008) · doi:10.1145/1409240.1409278 · Cited by 4
Improving the User Experience of a Mobile Photo Gallery by Supporting Social Interaction
Vartiainen, E. (2009) · International Journal of Mobile Human Computer Interaction · doi:10.4018/jmhci.2009062604 · Cited by 4
Supporting blind users in selecting from very long lists of items on mobile phones
Chittaro, L., & Marassi, A. (2010) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1851600.1851607 · Cited by 3
Coupa: operation with pen linking on mobile devices
Yu, K., Tian, F., & Wang, K. (2009) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1613858.1613871 · Cited by 2
Cited by
The mHealth App Usability Questionnaire (MAUQ): Development and Validation Study
Zhou, L., Bao, J., Setiawan, I. M. A., Saptono, A., & Parmanto, B. (2019) · JMIR mHealth and uHealth · doi:10.2196/11500 · Cited by 675
An expectation-confirmation model of continuance intention to use mobile instant messaging
Oghuma, A. P., Libaque-Saenz, C. F., Wong, S. F., & Chang, Y. (2016) · Telematics and Informatics · doi:10.1016/j.tele.2015.05.006 · Cited by 562
Information security management needs more holistic approach: A literature review
Soomro, Z. A., Shah, M. H., & Ahmed, J. (2016) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2015.11.009 · Cited by 439
Location based services: ongoing evolution and research agenda
Huang, H., Gartner, G., Krisp, J. M., Raubal, M., & Van de Weghe, N. (2018) · Journal of Location Based Services · doi:10.1080/17489725.2018.1508763 · Cited by 316
User experience model for augmented reality applications in urban heritage tourism
Han, D.-I., tom Dieck, M. C., & Jung, T. (2018) · Journal of Heritage Tourism · doi:10.1080/1743873x.2016.1251931 · Cited by 281
Metadata
- Authors
- Harrison, R., Flood, D., & Duce, D.
- Affiliations
- Oxford Brookes University (GB)
- Corresponding author
- Harrison, Rachel
- Venue
- Journal of Interaction Science
- Published
- 2013
- Volume
- 1
- Issue
- 1
- Pages
- 1
- ISSN
- 2194-0827 (ISSN-L)
- OpenAlex
- W2120571425
- Cited by
- 736
- References
- 152
- Citations by year
- 2026: 33 · 2025: 44 · 2024: 50 · 2023: 58 · 2022: 74 · 2021: 62 · 2020: 84 · 2019: 77 · 2018: 49 · 2017: 72 · 2016: 55 · 2015: 49 · 2014: 27 · 2013: 1
- FWCI
- 79.76
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Journal of Interaction Science (publishedVersion, cc-by)
- Radar (Oxford Brookes University) (submittedVersion, cc-by-nc-nd)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Information Systems › Mobile and Web Applications
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- software usability, usability model, cognitive load, effectiveness, efficiency and satisfaction, usability evaluation, mobile devices, user satisfaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
