The DOI matches its Crossref record.
An iterative design methodology for user-friendly natural language office information applications
Open accessAbstract
A six-step, iterative, empirical human factors design methodology was used to develop CAL, a natural language computer application to help computer-naive business professionals manage their personal calendars.Input language is processed by a simple, nonparsing algorithm with limited storage requirements and a quick response time.CAL allows unconstrained English inputs from users with no training (except for a five minute introduction to the keyboard and display) and no manual (except for a two-page overview of the system).In a controlled test of performance, CAL correctly responded to between 86 percent and 97 percent of the storage and retrieval requests it received, according to various criteria.This level of performance could never have been achieved with such a simple processing model were it not for the empirical approach used in the development of the program and its dictionaries.The tools of the engineering psychologist are clearly invaluable in the development of user-friendly software, if that software is to accommodate the unruly language of computer-naive, first-time users.The key is to elicit the cooperation of such users as partners in an iterative, empirical development process.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
MultiWOZ - A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modelling
Budzianowski, P., Wen, T.-H., Tseng, B.-H., Casanueva, I., Ultes, S., Ramadan, O., & Gašić, M. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1547 · Cited by 1,028
Advancing the Aging and Technology Agenda in Gerontology
Schulz, R., Wahl, H.-W., Matthews, J. T., De Vito Dabbs, A., Beach, S. R., & Czaja, S. J. (2015) · The Gerontologist · doi:10.1093/geront/gnu071 · Cited by 449
Suede: a Wizard of Oz prototyping tool for speech user interfaces
Klemmer, S. R., Sinha, A. K., Chen, J., Landay, J. A., Aboobaker, N., & Wang, A. (2000) · Proceedings of the 13th annual ACM symposium on User interface software and technology - UIST '00 · doi:10.1145/354401.354406 · Cited by 230
Social Simulacra: Creating Populated Prototypes for Social Computing Systems
Park, J. S., Popowski, L., Cai, C., Morris, M. R., Liang, P., & Bernstein, M. S. (2022) · Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3526113.3545616 · Cited by 212
Designing Relational Agents as Long Term Social Companions for Older Adults
Vardoulakis, L. P., Ring, L., Barry, B., Sidner, C. L., & Bickmore, T. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33197-8_30 · Cited by 166
Calendar.help: Designing a Workflow-Based Scheduling Agent with Humans in the Loop
Cranshaw, J., Elwany, E., Newman, T., Kocielnik, R., Yu, B., Soni, S., Teevan, J., & Monroy-Hernández, A. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025780 · Cited by 106
Exiting the Cleanroom: On Ecological Validity and Ubiquitous Computing
Carter, S., Mankoff, J., Klemmer, S. R., & Matthews, T. (2008) · Human–Computer Interaction · doi:10.1080/07370020701851086 · Cited by 107
Albouys-Perrois, J., Laviole, J., Briant, C., & Brock, A. M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174203 · Cited by 107
Silva, A., Schrum, M., Hedlund-Botti, E., Gopalan, N., & Gombolay, M. (2023) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2022.2101698 · Cited by 104
The Impact of Training on Human–Autonomy Team Communications and Trust Calibration
Johnson, C. J., Demir, M., McNeese, N. J., Gorman, J. C., Wolff, A. T., & Cooke, N. J. (2023) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/00187208211047323 · Cited by 68
Dietz, G., Le, J. K., Tamer, N., Han, J., Gweon, H., Murnane, E. L., & Landay, J. A. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445039 · Cited by 67
Large, D. R., Clark, L., Quandt, A., Burnett, G., & Skrypchuk, L. (2017) · Applied Ergonomics · doi:10.1016/j.apergo.2017.04.003 · Cited by 65
Getting to Know Each Other: The Role of Social Dialogue in Recovery from Errors in Social Robots
Lucas, G. M., Boberg, J., Traum, D., Artstein, R., Gratch, J., Gainer, A., Johnson, E., Leuski, A., & Nakano, M. (2018) · Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/3171221.3171258 · Cited by 61
Peng, L., Li, D., Zhang, Z., Zhang, T., Huang, A., Yang, S., & Hu, Y. (2024) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2024.103629 · Cited by 59
Planning for Natural Language Failures with the AI Playbook
Hong, M. K., Fourney, A., DeBellis, D., & Amershi, S. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445735 · Cited by 54
A Virtual Assistive Companion for Older Adults: Design Implications for a Real-World Application
Tsiourti, C., Ben Moussa, M., Quintas, J., Loke, B., Jochem, I., Lopes, J. A., & Konstantas, D. (2018) · Lecture Notes in Networks and Systems · doi:10.1007/978-3-319-56994-9_69 · Cited by 45
Wargnier, P., Benveniste, S., Jouvelot, P., & Rigaud, A.-S. (2018) · Technology and Disability · doi:10.3233/tad-180189 · Cited by 32
Revisiting “Hole in the Wall” Computing: Private Smart Speakers and Public Slum Settings
Robinson, S., Pearson, J., Ahire, S., Ahirwar, R., Bhikne, B., Maravi, N., & Jones, M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174072 · Cited by 37
Fair navigation planning: A resource for characterizing and designing fairness in mobile robots
Brandão, M., Jirotka, M., Webb, H., & Luff, P. (2020) · Artificial Intelligence · doi:10.1016/j.artint.2020.103259 · Cited by 35
Xu, W., Ma, J., Yao, J., Lin, W., Zhang, C., Xia, X., Zhuang, N., Weng, S., Xie, X., Feng, S., et al. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581043 · Cited by 27
The CaMeLi Framework—A Multimodal Virtual Companion for Older Adults
Tsiourti, C., Quintas, J., Ben-Moussa, M., Hanke, S., Nijdam, N. A., & Konstantas, D. (2018) · Studies in Computational Intelligence · doi:10.1007/978-3-319-69266-1_10 · Cited by 25
Iniesto, F., Coughlan, T., Lister, K., Devine, P., Freear, N., Greenwood, R., Holmes, W., Kenny, I., McLeod, K., & Tudor, R. (2023) · ACM Transactions on Accessible Computing · doi:10.1145/3568166 · Cited by 25
From the Curtain to Kansas: Conducting Wizard-of-Oz Studies in the Wild
Mitchell, E., & Mamykina, L. (2021) · Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411763.3443446 · Cited by 16
Autonomous Robotic Dialogue System with Reinforcement Learning for Elderlies with Dementia
Magyar, J., Kobayashi, M., Nishio, S., Sincak, P., & Ishiguro, H. (2019) · 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC) · doi:10.1109/smc.2019.8914248 · Cited by 15
(2010) · Maynooth University ePrints and eTheses Archive (Maynooth University) · Cited by 14
Piecing Together Teamwork: A Responsible Approach to an LLM-based Educational Jigsaw Agent
Doherty, E., Perkoff, E. M., von Bayern, S., Zhang, R., Dey, I., Bodzianowski, M., Puntambekar, S., & Hirshfield, L. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713349 · Cited by 12
Enhancing Storytelling Experience with Story-Aware Interactive Puppet
Kim, B., Pyun, J., & Lee, W. (2018) · Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3170427.3188515 · Cited by 7
Chen, D., Chen, H., Yang, Y., Lin, A., & Yu, Z. (2021) · arXiv · doi:10.48550/arxiv.2104.00783 · Cited by 6
Conversational AI Systems for Social Good: Opportunities and Challenges
Qi, P., Huang, J., Wu, Y., He, X., & Zhou, B. (2021) · arXiv · doi:10.48550/arxiv.2105.06457 · Cited by 3
Metadata
- Authors
- Kelley, J. F.
- Venue
- ACM Transactions on Information Systems
- Published
- 1984-01
- Volume
- 2
- Issue
- 1
- Pages
- 26-41
- ISSN
- 1046-8188 (ISSN-L)
- 1558-2868
- OpenAlex
- W1969152782
- Cited by
- 702
- References
- 0
- FWCI
- 4.33
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
