Complementing text entry evaluations with a composition task
The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
A common methodology for evaluating text entry methods is to ask participants to transcribe a predefined set of memorable sentences or phrases. In this article, we explore if we can complement the conventional transcription task with a more externally valid composition task. In a series of large-scale crowdsourced experiments, we found that participants could consistently and rapidly invent high quality and creative compositions with only modest reductions in entry rates. Based on our series of experiments, we provide a best-practice procedure for using composition tasks in text entry evaluations. This includes a judging protocol which can be performed either by the experimenters or by crowdsourced workers on a microtask market. We evaluated our composition task procedure using a text entry method unfamiliar to participants. Our empirical results show that the composition task can serve as a valid complementary text entry evaluation method.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The main task in all evaluation studies was a transcription task”
From A Review of Design and Evaluation Practices in Mobile Text Entry for Visually Impaired and Blind Persons (2023) · cites this paper as [64]
In the citing paper
“Delving into the details of how the lab studies were performed, we noted that all involved a form of transcription tasks, which have been termed as the de facto method for text entry studies [64,97], even though its validity has been criticized previously and alternatives have been proposed, such as the image description task or the composition task [64,98,99].”
From A Review of Design and Evaluation Practices in Mobile Text Entry for Visually Impaired and Blind Persons (2023) · cites this paper as [64]
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
Crowdsourcing user studies with Mechanical Turk
Kittur, A., Chi, E. H., & Suh, B. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357127 · Cited by 1,923
The Enron Corpus: A New Dataset for Email Classification Research
Klimt, B., & Yang, Y. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-30115-8_22 · Cited by 1,157
Phrase sets for evaluating text entry techniques
MacKenzie, I. S., & Soukoreff, R. W. (2003) · CHI '03 extended abstracts on Human factors in computing systems - CHI '03 · doi:10.1145/765891.765971 · Cited by 825
Crowdsourcing graphical perception: using mechanical turk to assess visualization design
Heer, J., & Bostock, M. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753357 · Cited by 816
Text Entry for Mobile Computing: Models and Methods, Theory and Practice
MacKenzie, I. S., & Soukoreff, R. W. (2002) · Human-Computer Interaction · doi:10.1207/s15327051hci172&3_2 · Cited by 571
The design and evaluation of a high-performance soft keyboard
MacKenzie, I. S., & Zhang, S. X. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.302983 · Cited by 422
Metrics for text entry research: an evaluation of MSD and KSPC, and a new unified error metric
Soukoreff, R. W., & MacKenzie, I. S. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642632 · Cited by 398
Fast hands-free writing by gaze direction
Ward, D. J., & MacKay, D. J. C. (2002) · Nature · doi:10.1038/418838a · Cited by 329
Patterns of entry and correction in large vocabulary continuous speech recognition systems
Karat, C.-M., Halverson, C., Horn, D., & Karat, J. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303160 · Cited by 275
Research works printed but not linked: 2
- Vertanen Keith, 2011, Proceedings of the ACL Conference on Empirical Methods in Natural Language Processing. ACL, 700--711
- 10.5555/646079 · doi:10.5555/646079
Cited by
How do People Type on Mobile Devices?: Observations from a Study with 37,000 Volunteers
Palin, K., Feit, A. M., Kim, S., Kristensson, P. O., & Oulasvirta, A. (2019) · Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services · doi:10.1145/3338286.3340120 · Cited by 190
“It is also possible to use alternative methods, such as a composition task [38] or even object-based methods, such as instructing users to annotate an image [12].”
MethodSelf-citationPerformance Envelopes of Virtual Keyboard Text Input Strategies in Virtual Reality
Dudley, J. J., Benko, H., Wigdor, D., & Kristensson, P. O. (2019) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar.2019.00027 · Cited by 149
“Vertanen and Kristensson [30] found that entry rates dropped by between approximately 15 and 35% depending on the nature of the composition task.”
BackgroundSelf-citationReyal, S., Zhai, S., & Kristensson, P. O. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702597 · Cited by 135
“Complementary data might be gained by also using a composition task [23], which is able to more accurately model actual text entry activities.”
MethodSelf-citationVertanen, K. D., Memmi, H., Emge, J., Reyal, S., & Kristensson, P. O. (2015) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702135 · Cited by 148
“It is also possible to use composition in text entry studies [20].”
Self-citationBuschek, D., Zürn, M., & Eiband, M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445372 · Cited by 108
Dang, H., Goller, S., Lehmann, F., & Buschek, D. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580969 · Cited by 83
Filteryedping: Design Challenges and User Performance of Dwell-Free Eye Typing
Pedrosa, D. D. C., Pimentel, M. D. G. C., Wright, A., & Truong, K. N. (2015) · ACM Transactions on Accessible Computing · doi:10.1145/2724728 · Cited by 78
On Suggesting Phrases vs. Predicting Words for Mobile Text Composition
Arnold, K. C., Gajos, K. Z., & Kalai, A. T. (2016) · Proceedings of the 29th Annual Symposium on User Interface Software and Technology · doi:10.1145/2984511.2984584 · Cited by 69
“While text input methods (such as those cited above) have been conventionally evaluated using transcription tasks, composition tasks are becoming more favored as they are more representative of people’s actual use of text entry systems [36, 21].”
MethodResearchIME: A Mobile Keyboard Application for Studying Free Typing Behaviour in the Wild
Buschek, D., Bisinger, B., & Alt, F. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173829 · Cited by 51
“judgement of crowd workers [61]), we recorded random trigrams, which a human observer cannot “correct” post-hoc.”
BackgroundInvestigating Tilt-based Gesture Keyboard Entry for Single-Handed Text Entry on Large Devices
Yeo, H.-S., Phang, X.-S., Castellucci, S. J., Kristensson, P. O., & Quigley, A. J. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025520 · Cited by 57
“For the composition task, we used the recommended instruction in [34], which for completeness is quoted in full below: “Imagine you are using a mobile device and need to write a message.”
MethodInfluentialSelf-citationVelociWatch: Designing and Evaluating a Virtual Keyboard for the Input of Challenging Text
Vertanen, K., Gaines, D., Fletcher, C., Stanage, A. M., Watling, R., & Kristensson, P. O. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300821 · Cited by 42
“A composition task would be even more realistic [29], but makes error rate harder to measure.”
BackgroundSelf-citationThe inviscid text entry rate and its application as a grand goal for mobile text entry
Kristensson, P. O., & Vertanen, K. (2014) · Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services · doi:10.1145/2628363.2628405 · Cited by 39
“Vertanen, K., and Kristensson, P. O.”
BackgroundMethodInfluentialSelf-citationThe Impact of Word, Multiple Word, and Sentence Input on Virtual Keyboard Decoding Performance
Vertanen, K., Fletcher, C., Gaines, D., Gould, J., & Kristensson, P. O. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174200 · Cited by 39
“A complementary evaluation strategy is therefore to use a composition task, in which users are asked to compose messages [32].”
MethodSelf-citationQuantifying Aversion to Costly Typing Errors in Expert Mobile Text Entry
Banović, N., Rao, V. V., Saravanan, A., Dey, A. K., & Mankoff, J. C. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025695 · Cited by 44
“We focus on transcription, but future research should explore how to adapt our model to composition tasks [39].”
BackgroundMethodHarmonized authentication based on ThumbStroke dynamics on touch screen mobile phones
Zhou, L., Kang, Y., Zhang, D., & Lai, J. (2016) · Decision Support Systems · doi:10.1016/j.dss.2016.09.007 · Cited by 39
Dudley, J. J., Zheng, J., Gupta, A., Benko, H., Longest, M., Wang, R. Y., & Kristensson, P. O. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3320238 · Cited by 39
“…following: (1) the diversity and number of participants in the study; (2) the potential performance impact of employing a composition task [16,29,50] rather than a transcription task; (3) the choice of phrase set in the studies [28,39,47]; and (4) the impact of the language model and any…”
BackgroundSelf-citationEvaluation of a Smart-Restorable Backspace Technique to Facilitate Text Entry Error Correction
Arif, A. S., Kim, S., Stuerzlinger, W., Lee, G., & Mazalek, A. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858407 · Cited by 30
“We used transcription tasks to increase the internal validity [29].”
MethodThe Effects of Predictive Features of Mobile Keyboards on Text Entry Speed and Errors
Alharbi, O. M., Stuerzlinger, W., & Putze, F. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3427311 · Cited by 21
How We Swipe: A Large-scale Shape-writing Dataset and Empirical Findings
Leiva, L. A., Kim, S., Cui, W., Bi, X., & Oulasvirta, A. (2021) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/3447526.3472059 · Cited by 21
Komninos, A., Stefanis, V., & Garofalakis, J. (2023) · Multimodal Technologies and Interaction · doi:10.3390/mti7020022 · Cited by 16
A Participatory Design and Formal Study Investigation into Mobile Text Entry for Older Adults
Nicol, E., Komninos, A., & Dunlop, M. D. (2016) · International Journal of Mobile Human Computer Interaction · doi:10.4018/ijmhci.2016040102.oa · Cited by 15
Multilingual phrase sampling for text entry evaluations
Franco-Salvador, M., & Leiva, L. A. (2018) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2018.01.006 · Cited by 15
Gaines, D., Kristensson, P. O., & Vertanen, K. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445199 · Cited by 13
“We compared our participant-supplied references with the crowdsourced protocol from Vertanen and Kristensson [8].”
BackgroundMethodInfluentialSelf-citationPutze, F., Schünemann, M., Schultz, T., & Stuerzlinger, W. (2017) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3136755.3136784 · Cited by 15
Mining, analyzing, and modeling text written on mobile devices
Vertanen, K., & Kristensson, P. O. (2019) · Natural Language Engineering · doi:10.1017/s1351324919000548 · Cited by 14
“For purposes of measuring error rate, we obtained a reference text for each composition via a crowdsourced judging process (Vertanen & Kristensson, 2014).”
MethodSelf-citationComparing Smartphone Speech Recognition and Touchscreen Typing for Composition and Transcription
Foley, M., Casiez, G., & Vogel, D. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376861 · Cited by 19
“In comparison, Vertanen and Kristensson [29] did not find any difference between transcription and composition, Vertanen et al.”
BackgroundMethodResultInfluentialSTAT: Subtle Typing Around the Thigh for Head-Mounted Displays
Henderson, J., Ceha, J., & Lank, E. (2020) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/3379503.3403549 · Cited by 16
“[P9] observed that “smaller words are much more difficult than larger words in the real-world use is that, as with modern smartphone-based WGKs, related works, a composition task [40] would assist in assessing 6.2.2 In vs.”
BackgroundInfluentialReviewing Speech Input with Audio: Differences between Blind and Sighted Users
Hong, J., Vaing, C., Kacorri, H., & Findlater, L. (2020) · ACM Transactions on Accessible Computing · doi:10.1145/3382039 · Cited by 11
“The test prompts (in Appendix A) were selected from a list of short scenarios (“situations”) studied by Vertanen and Kristensson [62] for a freeform text composition task, such as: “Your housemate has been sick for the last week.”
MethodPhraseFlow: Designs and Empirical Studies of Phrase-Level Input
Zhang, M. R., & Zhai, S. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445166 · Cited by 13
“Modelled after the study of composition types by Vertanen and Kristensson [36], we designed six composition prompts listed in Table 2.”
MethodKristensson, P. O., Mjelde, M., & Vertanen, K. D. (2023) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3581641.3584093 · Cited by 16
Self-citationA Monte Carlo simulation approach for quantitatively evaluating keyboard layouts for gesture input
Conway, R., & Sangaline, E. W. (2016) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2016.10.001 · Cited by 11
The State of Pilot Study Reporting in Crowdsourcing: A Reflection on Best Practices and Guidelines
Oppenlaender, J., Abbas, T., & Gadiraju, U. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3641023 · Cited by 17
“For instance, Vertanen and Kristensson [216] simply reported that the “ exact instructions we gave workers evolved over the course of several pilot experiments ” (p. 18).”
BackgroundText entry tap accuracy and exploration of tilt controlled layered interaction on Smartwatches
Dunlop, M. D., Roper, M., & Imperatore, G. (2017) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/3098279.3098560 · Cited by 11
“…used traditional text-entry transcription tasks in a laboratory environment, we are also interested if different tasks (e.g. prompted composition [42] or image description [33]) or "in the wild" [26] study would affect usability of tilt and give greater challenges to the one short line approach…”
BackgroundReflections on design workshops with older adults for touchscreen mobile text entry
Komninos, A., Nicol, E., & Dunlop, M. D. (2014) · Interaction design & architecture(s)/ID&A Interaction design & architecture(s) · doi:10.55612/s-5002-021-005 · Cited by 11
SkiMR: Dwell-free Eye Typing in Mixed Reality
Hu, J., Dudley, J. J., & Kristensson, P. O. (2024) · IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr58804.2024.00065 · Cited by 15
“In Study 2, we investigated the feasibility of this enhanced system in a real-world scenario through a composition task [46].”
BackgroundMethodInfluentialSelf-citationA systematic comparison of 3 phrase sampling methods for text entry experiments in 10 languages
Sanchis-Trilles, G., & Leiva, L. A. (2014) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/2628363.2634229 · Cited by 7
“This methodology is interesting for a number of reasons [8].”
BackgroundInviscid Text Entry and Beyond
Vertanen, K., Dunlop, M. D., Clawson, J., Kristensson, P. O., & Arif, A. S. (2016) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2851581.2856472 · Cited by 7
“[21]), the domain is still largely dominated by controlled lab experiments in which users copy set phrases (e.”
BackgroundSelf-citationAccelerating Text Communication via Abbreviated Sentence Input
Adhikary, J. K., Berger, J., & Vertanen, K. (2021) · doi:10.18653/v1/2021.acl-long.514 · Cited by 12
Self-citationInvestigating the Tradeoffs of Everyday Text-Entry Collection Methods
Rodrigues, A., Nicolau, H., Santos, A. J. D., Branco, D., Rainey, J., Verweij, D., Smeddinck, J. D., Montague, K., & Guerreiro, T. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501908 · Cited by 8
Yang, B., & Kristensson, P. O. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3604260 · Cited by 10
“The literature has long considered approaches for evaluating text entry methods (e.g. [59]), such as expanded rehearsal interval training [58], representative stimulus sentences [28, 50], stimulus sentence presentation styles [24], and composition tasks [14, 51].”
BackgroundSelf-citationDon’t Look Up: The Cost of Attention to Stimulus Phrases in Mobile Text Entry Evaluations
Komninos, A., Tsiouma, A., Gogoulou, G., & Garofalakis, J. D. (2022) · Panhellenic Conference on Informatics · doi:10.1145/3575879.3576015 · Cited by 5
“Lab studies in text entry use transcription tasks as the de-facto method [17, 20].”
BackgroundMethodInfluentialMobile Typing as a Window into Sensorimotor and Cognitive Function
Viviani, L., Liso, A., & Craighero, L. (2025) · Brain Sciences · doi:10.3390/brainsci15101084 · Cited by 6
“Examples include responding to predefined mobile notifications, generating messages under simulated mobile contexts, composing freeform messages, or emulating interactions via assistive technologies [100].”
InfluentialHaw, W., Ren, Y., Ng, K., & Arif, A. S. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642445 · Cited by 4
An LLM-driven Transcription Task for Mobile Text Entry Studies
Komninos, A., Feit, A. M., Leiva, L. A., Lehmann, F., Simou, I., Minas, D., Fotopoulos, A., & Xenos, M. (2024) · International Conference on Mobile and Ubiquitous Multimedia (MUM) · doi:10.1145/3701571.3701586 · Cited by 4
“Firstly, the transcription task has been criticised as having low external validity [37].”
A Thumb Stroke-Based Virtual Keyboard for Sight-Free Text Entry on Touch-Screen Mobile Phones
Lai, J., Zhang, D., Wang, S., Kilic, I. D. Y., & Zhou, L. (2018) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2018.039 · Cited by 4
“Usually, participants need to use a new keyboard for multiple sessions over a period of time [28], making it very difficult to have a large sample size.”
BackgroundBolton, F. J., Te’eni, D., & Toch, E. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2137915 · Cited by 3
“We modified an online NASA-TLX implementation from Vertanen and Kristensson (2014) to record the Raw TLX scales.”
MethodLi, Y., & Feit, A. M. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3749520 · Cited by 5
“…frequently refer to the reference text while typing (up to 25% of total attention [30]), and the fact that the text is fixed and might not align well with a person’s real-world writing style and vocabulary, such as composing messages to friends, which requires additional cognitive processing [52].”
Measuring Inviscid Text Entry Using Image Description Tasks
Dunlop, M. D., Nicol, E., Komninos, A., Dona, P., & Durga, N. (2016) · Cited by 3
A Dataset of Noisy Typing on QWERTY Keyboards
Vertanen, K., & Kristensson, P. O. (2023) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3581754.3584174 · Cited by 2
“In the case of composition tasks, this is the text that was determined via a crowdsourced procedure [12] or provided by the participant [7].”
MethodSelf-citationProbabilistic Text Entry—Case Study 3
Vertanen, K. D. (2021) · ACM eBooks · doi:10.1145/3447404.3447420 · Cited by 2
Self-citationMobile Text Entry Behaviour in Lab and In-the-Wild studies: Is it different?Preprint
Komninos, A., Katsaris, K., Nicol, E., Dunlop, M. D., & Garofalakis, J. D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.06323 · Cited by 3
“So far only two studies proposing an alternative type of task exists (Vertanen & Kristensson, 2014)(Nicol, Komninos, & Dunlop, 2016), but even in these evaluations, the authors do not explore cognition or attention factors.”
BackgroundTowards LLM-Generated Affective Phrase Sets for Text Entry Evaluation
Komninos, A., Simou, I., Fotopoulos, A., Michanetzi, E. L., & Xenos, M. (2024) · International Conference on Mobile and Ubiquitous Multimedia (MUM) · doi:10.1145/3701571.3703384 · Cited by 2
“Our aim is to reduce the problem of external validity of TTs [14] by integrating emotions into the task environment.”
From wax tablets to touchscreens
Kristensson, P. O. (2014) · XRDS Crossroads The ACM Magazine for Students · doi:10.1145/2659835 · Cited by 2
Self-citationDesign and evaluation of a versatile text input device for virtual and immersive workspaces
Brun, D., Gouin-Vallerand, C., & George, S. (2024) · Human-Computer Interaction · doi:10.1080/07370024.2024.2352705 · Cited by 2
“For the same reason, since our user studies were limited to transcriptions, we are planning to conduct studies with composition tasks, which has been shown to be a valid complementary text entry evaluation method (Vertanen & Kristensson, 2014).”
Komninos, A., Nicol, E., & Dunlop, M. D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.06318 · Cited by 2
“Vertanen and Kristensson [22] investigated complementing copy tasks with composition tasks by asking users to (a) reply to a message, (b) compose a message without scenario prompting and (c) compose with scenario prompting.”
Intelligent Techniques to Accelerate Everyday Text Communication
Adhikary, J. K. (2022) · Digital Commons - Michigan Tech (Michigan Technological University) · doi:10.37099/mtu.dc.etdr/1405
Modelling human behavior during text entry
Simou, I., & Komninos, A. (2023) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/3565066.3609739
“Although affording high internal validity to studies, the general-isability of the findings is hindered by several factors [15].”
IDCText: An Application for Conducting Text Input Research Studies in Indian Languages
Deshmukh, V., & Joshi, A. N. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-80829-6_5
Could You Hear That? Identifying Marathi Phrases Suitable for Aural Transcription Tasks
Shetye, S. A., & Joshi, A. N. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-80829-6_4
Designing for Numerical Transcription Typing: Frequent Numbers Matter
Wiseman, S. (2014) · UCL Discovery (University College London)
Increasing the expressive power of gesture-based interaction on mobile devices
Alvina, J. (2017) · theses.fr (ABES) · doi:10.70675/321afbd6z06f9z427fz8d24z4fa7e3b63ff2
Komninos, A., Simou, I., & Garofalakis, J. D. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3816773
“…entry support features (e.g. autocorrect, glide typing, word suggestions etc.) so as not to impose additional cognitive burdens that might artificially impact the core of the experiment (visual memory schema recall while typing) and threaten its internal validity with confounding factors [58].”
Influential
Metadata
- Authors
- Vertanen, K., & Kristensson, P. O.
- Affiliations
- Montana Technological University (US)
- University of St Andrews (GB)
- Venue
- ACM Transactions on Computer-Human Interaction
- Published
- 2014-02
- Volume
- 21
- Issue
- 2
- Pages
- 1-33
- ISSN
- 1073-0516 (ISSN-L)
- 1557-7325
- OpenAlex
- W2054689358
- Cited by
- 62
- References
- 31
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 6 · 2023: 7 · 2022: 4 · 2021: 6 · 2020: 6 · 2019: 4 · 2018: 4 · 2017: 5 · 2016: 7 · 2015: 3 · 2014: 5
- FWCI
- 12.92
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Computer-Human Interaction (publishedVersion)
- Cambridge University Engineering Department Publications Database (submittedVersion)
- Funders
- Engineering and Physical Sciences Research Council (EP/H027408/1)
- Scottish Informatics and Computer Science Alliance
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Physical Sciences › Computer Science › Information Systems › User Authentication and Security Systems
- Keywords
- generalizability, crowdsourced experiments, microtasks, entry rate
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.