Usability metric for mobile application: a goal question metric (GQM) approach
The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Many usability guidelines have been created in numerous areas and mobile devices application is included as well. However, there is not much published works in relation to the usability guidelines that comes up together with metric. Although a number of measurement models (e.g. The Metric for Usability Standard in Computing [MUSiC]) have been produced for evaluating usability, they are not focusing on mobile application. This paper will make an attempt to review the existing measurement models and will further explain the development of usability metric using GQM approach. Further research will firstly develop a set of usability guidelines for mobile application which will be used to develop a metric for usability measurement.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Hussain and Kutar [52] include safety as a component within their usability guidelines for mobile apps.”
From A user-centred design framework for mHealth (2020) · cites this paper as [52]
Citations
Cites
(1993) · Cited by 9,879
The Goal Question Metric Approach
Basili, V. R., Caldiera, G., & Rombach, H. D. (1994) · Cited by 1,651
Software Structure Metrics Based on Information Flow
Henry, S., & Kafura, D. (1981) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1981.231113 · Cited by 782
Usability measurement and metrics: A consolidated model
Seffah, A., Donyaee, M., Kline, R. B., & Padda, H. K. (2006) · Software Quality Journal · doi:10.1007/s11219-006-7600-8 · Cited by 648
Challenges, Methodologies, and Issues in the Usability Testing of Mobile Applications
Zhang, D., & Adipat, B. (2005) · International Journal of Human-Computer Interaction · doi:10.1207/s15327590ijhc1803_3 · Cited by 613
The Goal/Question/Metric Method : A Practical Guide for Quality Improvement of Software Development
Berghout, E. W., & van Solingen, R. (1998) · Cited by 483
Research-based web design & usability guidelines
Shneiderman, B. (2006) · Cited by 376
Meta-analysis of correlations among usability measures
Hornbæk, K., & Law, E. L.-C. (2007) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240722 · Cited by 276
IEEE Standard for a Software Quality Metrics Methodology
(1992) · IEEE Standards · doi:10.1109/ieeestd.1993.115124 · Cited by 169
USABILITY FOR MOBILE COMMERCE ACROSS MULTIPLE FORM FACTORS
Chan, S. S., Fang, X., Brzezinski, J., Zhou, Y., Xu, S., & Lam, J. (2002) · Journal of electronic commerce research · Cited by 147
Research works printed but not linked: 5
- ISO. 1998 . INTERNATIONAL STANDARD: ISO 9241-11(Guidance on usability). Geneva . ISO. 1998. INTERNATIONAL STANDARD: ISO 9241-11(Guidance on usability). Geneva.
- Jun , G. and Tarasewich , P . 2004. Guidelines for handheld mobile device interface design . In Proceedings of the DSI 2004 Annual Meeting ( Boston). Northeastern University. Jun, G. and Tarasewich, P. 2004. Guidelines for handheld mobile device interface design. In Proceedings of the DSI 2004 Annual Meeting (Boston). Northeastern University.
- Nokia . 2008. Top 10 Usability Guidelines for Enterprise Applications. Nokia Forum , Nokia Corporation . Nokia. 2008. Top 10 Usability Guidelines for Enterprise Applications. Nokia Forum, Nokia Corporation.
- Openwave . 2008. Top 10 Usability Guidelines for WAP Applications . Openwave Systems Inc . Openwave. 2008. Top 10 Usability Guidelines for WAP Applications. Openwave Systems Inc.
- Webcredible . 2007. 7 usability guidelines for websites on mobile devices . Webcredible Ltd . Webcredible. 2007. 7 usability guidelines for websites on mobile devices. Webcredible Ltd.
Cited by
A user-centred design framework for mHealth
Farao, J., Malila, B., Conrad, N., Mutsvangwa, T., Rangaka, M. X., & Douglas, T. S. (2020) · PLoS ONE · doi:10.1371/journal.pone.0237910 · Cited by 203
Usability evaluation of mobile applications using ISO 9241 and ISO 25062 standards
Moumane, K., Idri, A., & Abran, A. (2016) · SpringerPlus · doi:10.1186/s40064-016-2171-z · Cited by 163
Usability Dimensions for Mobile Applications-A Review
Baharuddin, R., Singh, D., & Razali, R. (2013) · Research Journal of Applied Sciences, Engineering and Technology ` · doi:10.19026/rjaset.5.4776 · Cited by 157
Sarrab, M., Elbasir, M., & Alnaeli, S. M. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.09.003 · Cited by 174
Software assurance practices for mobile applications: A survey of the state of the art
Corral, L., Sillitti, A., & Succi, G. (2014) · Computing · doi:10.1007/s00607-014-0395-8 · Cited by 73
Usability evaluation of mobile applications; where do we stand?
Zahra, F. T., Hussain, A., & Mohd, H. (2017) · AIP conference proceedings · doi:10.1063/1.5005389 · Cited by 58
Self-citationUsability Testing of Mobile Applications: A Methodological Framework
Weichbroth, P. (2024) · Applied Sciences · doi:10.3390/app14051792 · Cited by 106
mLUX: Usability and User Experience Development Framework for M-Learning
Dirin, A., & Nieminen, M. (2015) · International Journal of Interactive Mobile Technologies (iJIM) · doi:10.3991/ijim.v9i3.4446 · Cited by 50
Usability of context-aware mobile educational game
Lu, C. J. J., Chang, M., Kinshuk, K., Huang, E., & Chen, C. (2011) · Knowledge Management & E-Learning An International Journal · doi:10.34105/j.kmel.2011.03.031 · Cited by 37
On the Use of Software Quality Standard ISO/IEC9126 in Mobile Environments
Idri, A., Moumane, K., & Abran, A. (2013) · 2013 20th Asia-Pacific Software Engineering Conference (APSEC) · doi:10.1109/apsec.2013.12 · Cited by 34
“…focused on extending the ISO 9126 metrics to certain types of mobile applications (M-Learning, M-Commerce, MWeb, etc.) [11, 12, 13], while others have proposed new metrics for all categories of mobile applications to evaluate quality characteristics, such as Usability, for instance [14, 15, 16].”
Backgroundde Paula, D. F. O., Menezes, B. H. X. M., & Araújo, C. C. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-07626-3_29 · Cited by 34
Mobile Apps for Older Users – The Development of a Mobile Apps Repository for Older People
García‐Peñalvo, F. J., Conde, M. Á., & Olivera, V. M. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-07485-6_12 · Cited by 47
Can Adaptive Interfaces Improve the Usability of Mobile Applications?
Wesson, J. L., Singh, A. K., & van Tonder, B. (2010) · IFIP International Federation for Information Processing/IFIP · doi:10.1007/978-3-642-15231-3_19 · Cited by 32
Usability Evaluation Metrics of Tourism Mobile Applications
Hashim, N. L., & Isse, A. J. (2019) · Journal of Software Engineering and Applications · doi:10.4236/jsea.2019.127016 · Cited by 32
Evaluating Mobile Applications: A Spreadsheet Case Study
Flood, D., Harrison, R., Iacob, C., & Duce, D. (2012) · International Journal of Mobile Human Computer Interaction · doi:10.4018/jmhci.2012100103 · Cited by 29
“The paper is then concluded in Section 7.”
BackgroundASSESSING WEB SITE USABILITY MEASUREMENT
Aziz, N. S. (2013) · International Journal of Research in Engineering and Technology · doi:10.15623/ijret.2013.0209058 · Cited by 29
Towards the Design of Usable Privacy by Design Methodologies
Pattakou, A., Mavroeidi, A., Diamantopoulou, V., Kalloniatis, C., & Gritzalis, S. (2018) · IEEE International Workshop on Evolving Security & Privacy Requirements Engineering (ESPRE) · doi:10.1109/espre.2018.00007 · Cited by 32
A Framework for Designing Usability: Usability Redesign of a Mobile Government Application
Kureerung, P., Ramingwong, L., Ramingwong, S., Cosh, K., & Eiamkanitchat, N. (2022) · Information · doi:10.3390/info13100470 · Cited by 21
Development of Usability Guidelines: A Systematic Literature Review
Goundar, M. S., Kumar, B. A., & Ali, A. B. M. S. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2141009 · Cited by 24
Evaluating Usability for Mobile Application: A MAUEM Approach
Saleh, A. M., Ismail, R., & Fabil, N. (2017) · International Conference on Software and e-Business (ICSEB) · doi:10.1145/3178212.3178232 · Cited by 32
A review on usability guidelines for designing mobile apps user interface for children with autism
Sofian, N. M., Hashim, A. S., & Ahmad, W. F. W. (2018) · AIP conference proceedings · doi:10.1063/1.5055496 · Cited by 17
Usability evaluation of a real-time water quality monitoring mobile application
Bokingkito, P. B., & Caparida, L. T. (2022) · Procedia Computer Science · doi:10.1016/j.procs.2021.12.185 · Cited by 15
Ontology Design for Automatic Evaluation of Web User Interface Usability
Robal, T., Marenkov, J., & Kalja, A. (2017) · Portland International Conference on Management of Engineering and Technology (PICMET) · doi:10.23919/picmet.2017.8125425 · Cited by 15
Assessing Website Usability Attributes Using Partial Least Squares
Aziz, N. (2014) · International Journal of Information and Electronics Engineering · doi:10.7763/ijiee.2014.v4.423 · Cited by 14
Analysis of the Usability of M-Commerce Applications
Jakimoski, K. (2014) · International Journal of u- and e- Service Science and Technology · doi:10.14257/ijunesst.2014.7.6.02 · Cited by 12
A usability evaluation of UUM mobile for students app on IOS and Android platforms
Hussain, A., Mkpojiogu, E. O. C., Abduljabbar, A. M., & Almadhagi, A. H. G. (2018) · AIP conference proceedings · doi:10.1063/1.5055454 · Cited by 11
Self-citationUsing pre-test to validate the Questionnaire for Website Usability (QWU)
Aziz, N. S., & Kamaludin, A. (2015) · International Conference on Software Engineering and Computer Systems · doi:10.1109/icsecs.2015.7333093 · Cited by 12
CoKnowEMe: An Edge Evaluation Scheme for QoS of IoMT Microservices in 6G Scenario
Aiosa, G. V., Attanasio, B., Corte, A. L., & Scatà, M. (2021) · Future Internet · doi:10.3390/fi13070177 · Cited by 10
Mobile apps repository for older people
Conde, M. Á., García‐Peñalvo, F. J., & Olivera, V. M. (2014) · Ninth International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM'21) · doi:10.1145/2669711.2669981 · Cited by 16
An Improved Usability Evaluation Model for Point-of-Sale Systems
Kabir, M. A., & Han, B. (2016) · International Journal of Smart Home · doi:10.14257/ijsh.2016.10.7.27 · Cited by 9
Usability of the PAL Objectives Dashboard for Children's Diabetes Self-Management Education
Peters, R., Oleari, E., Sardu, F., & Neerincx, M. A. (2019) · International Conference e-Society, e-Learning and e-Technologies · doi:10.1145/3312714.3312736 · Cited by 11
A heuristic checklist for usability evaluation of Saudi government mobile applications
Al-Khalifa, H. S., Al-Twaim, B., & AlHarbi, B. (2016) · International Conference on Information Integration and Web-based Applications & Services (iiWAS) · doi:10.1145/3011141.3011189 · Cited by 14
STATE-OF-THE-ART OF M-LEARNING USABILITY AND USER EXPERIENCE
Dirin, A., & Nieminen, M. (2013) · Cited by 7
Usability evaluation model for mobile e-book applications
Matraf, M. S. B., & Hussain, A. (2017) · AIP conference proceedings · doi:10.1063/1.5005388 · Cited by 7
Self-citationUsability Testing of Mobile Flipboard Application on both Non-Users and Novice Users
Naeem, M., Adetunmbi, S., & Hussain, A. (2020) · International Journal of Interactive Mobile Technologies (iJIM) · doi:10.3991/ijim.v14i05.13341 · Cited by 6
Self-citationUsability Evaluation Framework of Smart Home Applications for Senior Citizens
Ashraf, A., Zhu, X., Liu, J., Rauf, Q., & Firdaus, R. (2022) · International Conference on Software Technology and Engineering · doi:10.1109/icste57415.2022.00012 · Cited by 7
Angsupanich, S., & Matayong, S. (2023) · Universal Access in the Information Society · doi:10.1007/s10209-023-01016-8 · Cited by 8
Modeling subjective metrics for mobile evaluation
Hussain, A., Kutar, M., Mutalib, A. B. A., & Kamal, F. M. (2012) · Universiti Utara Malaysia Institutional Repository (Universiti Utara Malaysia) · Cited by 11
Self-citationSellung, R. A., Hölscher, M., & Burgstaller, L. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-12673-4_10 · Cited by 7
Evaluation Methods and Results for Intermodal Mobility Applications in Public Transport
Stopka, U., Fischer, K., & Pessier, R. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-39513-5_32 · Cited by 5
IT service management using ITIL v3: A case study
Bayona-Oré, S., Baca, Y., & de la Cruz, G. A. V. (2017) · Iberian Conference on Information Systems and Technologies (CISTI) · doi:10.23919/cisti.2017.7975963 · Cited by 4
Obsessive UX: Role of UX & Heuristic Evaluation in Building A Product that Attracts Human Emotions
Pandey, G., Bhasin, D., Thakur, P., Gonge, S. S., Joshi, R., & Kotecha, K. V. (2023) · IEEE International Conference for Convergence in Technology (I2CT) · doi:10.1109/i2ct57861.2023.10126483 · Cited by 4
Yildiz, E., Bilgen, S., Tokdemir, G., Çağıltay, N. E., & Erturan, Y. N. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10359-4_21 · Cited by 4
A Study on Immediate Automatic Usability Evaluation of Web Application User Interfaces
Marenkov, J., Robal, T., & Kalja, A. (2016) · Communications in computer and information science · doi:10.1007/978-3-319-40180-5_18 · Cited by 4
Ekambaram, V., Sharma, V. K., & Rajput, N. (2016) · Advances in multimedia and interactive technologies book series · doi:10.4018/978-1-5225-0945-5.ch002 · Cited by 4
Park, S., Park, S., & Ma, K. (2018) · Sensors · doi:10.3390/s18092963 · Cited by 6
Weyand, S. (2011) · uO Research (University of Ottawa) · doi:10.20381/ruor-3191 · Cited by 6
Expert Review on Usefulness of an Integrated Checklist-based Mobile Usability Evaluation Framework
Zulzalil, H. B., Rahmat, H., Ghani, A., & Kamaruddin, A. B. (2023) · Journal of Computer Science Research · doi:10.30564/jcsr.v5i3.5816 · Cited by 7
Correia, A. C. D. C., Brizolara, P. L. S., de Miranda, L. C., & Marciano, J. N. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-07626-3_49 · Cited by 3
Analytic Model and Assessment Framework for Data Quality Evaluation in State Grid
Li, Z., Wu, S., Zhou, H., Zou, S., & Dong, T. (2019) · Journal of Physics Conference Series · doi:10.1088/1742-6596/1302/2/022083 · Cited by 3
Nguyen, T. Q., Dang, T. N., Hoang, C. L., Truong, D. T. N., & Nguyen, V. A. (2019) · Conference proceedings - Canadian Conference on Electrical and Computer Engineering · doi:10.1109/ccece.2019.8861740 · Cited by 3
Tuah, N. M., & Wills, G. B. (2019) · Lecture notes in electrical engineering · doi:10.1007/978-981-15-0058-9_53 · Cited by 3
User-interface evaluation metrics for a typical M-Learning application
Kantore, A. (2011) · Nelson Mandela University Research Repository · Cited by 4
Usability Assessment of a Philippine Commuting Navigation Application
Toledo, J., Salgado, A. C., Gozum, C. C., & Custodio, B. P. (2020) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-51828-8_38 · Cited by 3
Kusumo, D. S., Sabariah, M. K., & Wiharja, K. R. S. (2017) · Jurnal Ilmu Komputer dan Informasi · doi:10.21609/jiki.v10i2.459 · Cited by 2
Assessing Website Usability Attributes
Aziz, N. S., Kamaludin, A., Yacob, A., & Sulaiman, N. S. (2014) · UMP Institutional Repository (Universiti Malaysia Pahang) · Cited by 2
Liu, B. M., Beheshti, M., Naeimi, T., Zhu, Z., Vedanthan, R., Seiple, W., & Rizzo, J. (2023) · Disability and Rehabilitation Assistive Technology · doi:10.1080/17483107.2023.2187094 · Cited by 4
Health Care Engineering, Part II: Research and Development in the Health Care Environment
Frize, M. (2013) · Synthesis lectures on biomedical engineering · doi:10.2200/s00540ed1v01y201310bme051 · Cited by 1
IT Professional Preferences to Evaluate Systems Usability
Ribeiro, S., Furtado, E. S., Furtado, J. V., & Cavalcante, N. (2017) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-60492-3_42 · Cited by 1
CREATING USABLE MOBILE AMBIENT INTELLIGENT APPLICATIONS FOR HOSPITALITY CUSTOMERS
Collins, G. R. (2010) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 1
User Interface Redesigning Based on a Usability Design Framework
Kureerung, P., Ramingwong, L., & Ramingwong, S. (2021) · International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON) · doi:10.1109/ecti-con51831.2021.9454792 · Cited by 2
A comparative analysis of web-based GIS applications using usability metrics
Abdulmonim, D. A. (2015) · UTHM Institutional Repository (Universiti Tun Hussein Onn Malaysia) · Cited by 1
An evaluation approach for research project pilot technological applications
Marcelino-Jesus, E., Sarraipa, J., & Jardim‐Gonçalves, R. (2013) · AIP conference proceedings · doi:10.1063/1.4825771
Making Mobile Touch Screens More Usable Using SUM Metrics Model
Bessa, A. T., Ferreira, S. B. L., Alvim, A. C. F., Cavalcante, N. W. F., & Alves, A. D. S. (2018) · Americanae (AECID Library) · doi:10.34627/rcc.v10iespecial.46
Usability Construct for Mobile Applications: A Clustering based Approach
Kotala, P. (2015) · NDSU Repository (North Dakota State University)
Towards a prior validation of a model-based approach for mobile usability evaluation
Ammar, L. B. (2020) · International Journal of ADVANCED AND APPLIED SCIENCES · doi:10.21833/ijaas.2020.11.009
Clinical Trials and Usability Studies in a Medical Environment
Frize, M. (2014) · Synthesis lectures on biomedical engineering · doi:10.1007/978-3-031-01658-5_6
Usability Evaluation of Smart Phone Application Store
Adnan, M. A. (2015) · KTH Publication Database DiVA (KTH Royal Institute of Technology)
To Understand The Mobile Application Quality Factors: An Exploratory Study
Yadav, P., Singh, N., & Sachar, D. (2022) · Trinity Journal of Management, IT & Media · doi:10.48165/acspublisher.tjmitm.2022.10
A usability evaluation model for mobile learning for hearing impaired children
Abidin, N. H. Z., Hashim, N. L., Matraf, M. S. B., & Yusof, N. (2026) · AIP conference proceedings · doi:10.1063/5.0318957
Metadata
- Authors
- Hussain, A., & Ferneley, E.
- Affiliations
- University of Salford (GB)
- ORCID
- Hussain, Azham
- Venue
- Proceedings of the 10th International Conference on Information Integration and Web-based Applications & Services
- Publisher
- ACM
- Published
- 2008-11-24
- Pages
- 567-570
- OpenAlex
- W1993925935
- Cited by
- 70
- References
- 16
- Citations by year
- 2026: 1 · 2024: 1 · 2023: 4 · 2022: 6 · 2021: 2 · 2020: 4 · 2019: 5 · 2018: 5 · 2017: 7 · 2016: 6 · 2015: 6 · 2014: 10 · 2013: 6 · 2012: 2
- FWCI
- 1.29
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Information Integration and Web-based Applications & Services (iiWAS) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Physical Sciences › Computer Science › Information Systems › Mobile and Web Applications
- Keywords
- usability metrics, mobile application, usability guidelines, Goal Question Metric
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.