The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Wizard of Oz studies: why and how
Abstract
Article Free Access Share on Wizard of Oz studies: why and how Authors: Nils Dahlbäck Natural Language Processing Laboratory, Department of Computer and Information Science, S-581 83 LINKÖPING, Sweden Natural Language Processing Laboratory, Department of Computer and Information Science, S-581 83 LINKÖPING, SwedenView Profile , Arne Jönsson Natural Language Processing Laboratory, Department of Computer and Information Science, S-581 83 LINKÖPING, Sweden Natural Language Processing Laboratory, Department of Computer and Information Science, S-581 83 LINKÖPING, SwedenView Profile , Lars Ahrenberg Natural Language Processing Laboratory, Department of Computer and Information Science, S-581 83 LINKÖPING, Sweden Natural Language Processing Laboratory, Department of Computer and Information Science, S-581 83 LINKÖPING, SwedenView Profile Authors Info & Claims IUI '93: Proceedings of the 1st international conference on Intelligent user interfacesFebruary 1993 Pages 193–200https://doi.org/10.1145/169891.169968Published:01 February 1993Publication History 288citation3,913DownloadsMetricsTotal Citations288Total Downloads3,913Last 12 Months541Last 6 weeks121 Get Citation AlertsNew Citation Alert added!This alert has been successfully added and will be sent to:You will be notified whenever a record that you have chosen has been cited.To manage your alert preferences, click on the button below.Manage my AlertsNew Citation Alert!Please log in to your account Save to BinderSave to BinderCreate a New BinderNameCancelCreateExport CitationPublisher SiteeReaderPDF
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Definite reference and mutual knowledge
Clark, H. H. (1981) · Medical Entomology and Zoology · Cited by 1,443
Shatz, M., & Gelman, R. (1973) · Monographs of the Society for Research in Child Development · doi:10.2307/1165783 · Cited by 872
Cuetos, F. (1988) · Cognition · doi:10.1016/0010-0277(88)90004-2 · Cited by 519
Fraser, N. M., & Gilbert, G. N. (1991) · Computer Speech & Language · doi:10.1016/0885-2308(91)90019-m · Cited by 442
The representation and use of focus in dialogue understanding.
Grosz, B. J. (1977) · University of California, Berkeley eBooks · Cited by 419
Getting computers to talk like you and me
Reichman, R. (1985) · Cited by 219
The pragmatics of referring and the modality of communication
Cohen, P. R. (1984) · doi:10.5555/970160.970162 · Cited by 114
Kennedy, A., Wilkes, A., Elder, L., & Murray, W. S. (1988) · Cognition · doi:10.1016/0010-0277(88)90003-0 · Cited by 69
Using Natural Language Interfaces
Ogden, W. C. (1988) · Elsevier eBooks · doi:10.1016/b978-0-444-70536-5.50018-x · Cited by 66
Talking to a Computer Is Not like Talking to Your Best Friend.
Jönsson, A., & Dahlbäck, N. (1988) · Scandinavian Conference on AI · Cited by 61
Self-citation
Cited by
Socially intelligent robots: Dimensions of human-robot interaction
Dautenhahn, K. (2007) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2006.2004 · Cited by 1,210
Li, J. (2015) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2015.01.001 · Cited by 652
Methods for Evaluating Interactive Information Retrieval Systems with Users
Kelly, D. (2009) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000012 · Cited by 633
Oviatt, S. (2007) · Human Factors and Ergonomics · doi:10.1201/9781410615862.ch21 · Cited by 485
Holbrook, A. L., Krosnick, J. A., & Pfent, A. (2007) · Advances in Telephone Survey Methodology · doi:10.1002/9780470173404.ch23 · Cited by 380
Empathy in Virtual Agents and Robots: A Survey
Paiva, A., Leite, I., Boukricha, H., & Wachsmuth, I. (2017) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2912150 · Cited by 361
Predicting human interruptibility with sensors
Fogarty, J., Hudson, S. E., Atkeson, C. G., Avrahami, D., Forlizzi, J., Kiesler, S., Lee, J. C., & Yang, J. (2005) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1057237.1057243 · Cited by 344
Prototyping an intelligent agent through Wizard of Oz
Maulsby, D., Greenberg, S., & Mander, R. (1993) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '93 · doi:10.1145/169059.169215 · Cited by 307
Rothenbucher, D., Li, J., Sirkin, D., Mok, B., & Ju, W. (2016) · 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) · doi:10.1109/roman.2016.7745210 · Cited by 303
Effect of a robot on user perceptions
Kidd, C. D., & Breazeal, C. (2005) · 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566) · doi:10.1109/iros.2004.1389967 · Cited by 295
Does appearance matter in the interaction of children with autism with a humanoid robot?
Robins, B., Dautenhahn, K., & Dubowski, J. (2006) · Interaction Studies. Social Behaviour and Communication in Biological and Artificial Systems · doi:10.1075/is.7.3.16rob · Cited by 257
Health dialog systems for patients and consumers
Bickmore, T., & Giorgino, T. (2006) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2005.12.004 · Cited by 242
“Another method that is widely used in dialog system development is the ‘‘Wizard-Of-Oz’’ technique, in which (unbeknownst to test subjects) a human confederate replaces some or all of a dialog system’s functionality during live interactions between subjects and the system [70].”
MethodSuede: a Wizard of Oz prototyping tool for speech user interfaces
Klemmer, S. R., Sinha, A. K., Chen, J., Landay, J. A., Aboobaker, N., & Wang, A. (2000) · Proceedings of the 13th annual ACM symposium on User interface software and technology - UIST '00 · doi:10.1145/354401.354406 · Cited by 230
“The Wizard of Oz technique has been used for years to simulate speech recognition systems when performing both low-fidelity tests of proposed design ideas and user studies on “finished” interface designs [12].”
BackgroundMethodThe State of Speech in HCI: Trends, Themes and Challenges
Clark, L., Doyle, P., Garaialde, D., Gilmartin, E., Schlögl, S., Edlund, J., Aylett, M., Cabral, J., Munteanu, C., Edwards, J., et al. (2019) · Interacting with Computers · doi:10.1093/iwc/iwz016 · Cited by 193
“In WoZ studies participants are led to believe they are interacting with a system, however, a (usually unseen) confederate controls the system’s output (Dahlbäck, Jönsson, & Ahrenberg, 1993).”
BackgroundSchueller, S. M., Tomasino, K. N., & Mohr, D. C. (2017) · Clinical Psychology: Science and Practice · doi:10.1037/h0101740 · Cited by 70
Exploring human error recovery strategies: Implications for spoken dialogue systems
Skantze, G. (2005) · Speech Communication · doi:10.1016/j.specom.2004.11.005 · Cited by 137
Towards human-like spoken dialogue systems
Edlund, J., Gustafson, J., Heldner, M., & Hjalmarsson, A. (2008) · Speech Communication · doi:10.1016/j.specom.2008.04.002 · Cited by 135
Corti, K., & Gillespie, A. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2015.12.039 · Cited by 118
Exiting the Cleanroom: On Ecological Validity and Ubiquitous Computing
Carter, S., Mankoff, J., Klemmer, S. R., & Matthews, T. (2008) · Human–Computer Interaction · doi:10.1080/07370020701851086 · Cited by 107
“Wizard of Oz was originally adopted for speech user interfaces because having a human “recognize” the speech obviates the overhead of implementing or configuring a functioning speech recognizer (Dahlbäck et al., 1993; J. F. Kelley, 1984; Maulsby et al., 1993).”
Social support agents for older adults: longitudinal affective computing in the home
Ring, L., Shi, L., Totzke, K., & Bickmore, T. (2015) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-014-0157-0 · Cited by 97
Benevolent deception in human computer interaction
Adar, E., Tan, D. S., & Teevan, J. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466246 · Cited by 93
Will AI Console Me when I Lose my Pet? Understanding Perceptions of AI-Mediated Email Writing
Liu, Y., Mittal, A., Yang, D., & Bruckman, A. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517731 · Cited by 92
Large, D. R., Clark, L., Quandt, A., Burnett, G., & Skrypchuk, L. (2017) · Applied Ergonomics · doi:10.1016/j.apergo.2017.04.003 · Cited by 65
Reducing working memory load in spoken dialogue systems
Wolters, M., Georgila, K., Moore, J. D., Logie, R. H., MacPherson, S. E., & Watson, M. (2009) · Interacting with Computers · doi:10.1016/j.intcom.2009.05.009 · Cited by 66
Supporting spatial awareness and independent wayfinding for pedestrians with visual impairments
Yang, R., Park, S., Mishra, S. R., Hong, Z., Newsom, C., Joo, H., Hofer, E., & Newman, M. W. (2011) · The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/2049536.2049544 · Cited by 60
Situated Participatory Design: A Method for In Situ Design of Robotic Interaction with Older Adults
Stegner, L., Senft, E., & Mutlu, B. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580893 · Cited by 56
“Second, Wizard of Oz (WoZ) allows participants to interact with a system that is controlled by an operator behind the scenes [12].”
BackgroundData-driven models for timing feedback responses in a Map Task dialogue system
Meena, R., Skantze, G., & Gustafson, J. (2014) · Computer Speech & Language · doi:10.1016/j.csl.2014.02.002 · Cited by 56
Reicherts, L., Rogers, Y., Capra, L., Wood, E., Duong, T. D., & Sebire, N. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3484221 · Cited by 52
(2006) · doi:10.1145/1142405.1142443 · Cited by 52
How Do Data Analysts Respond to AI Assistance? A Wizard-of-Oz Study
Gu, K., Grunde-McLaughlin, M., McNutt, A., Heer, J., & Althoff, T. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641891 · Cited by 40
Kloft, A. M., Welsch, R., Kosch, T., & Villa, S. (2023) · arXiv · doi:10.48550/arxiv.2309.16606 · Cited by 34
Bourguet, M.-L. (2006) · Signal Processing · doi:10.1016/j.sigpro.2006.02.047 · Cited by 30
Measuring the acceptable word error rate of machine-generated webcast transcripts
Munteanu, C., Penn, G., Baecker, R., Toms, E., & James, D. (2006) · Interspeech 2006 · doi:10.21437/interspeech.2006-40 · Cited by 21
The MATCH corpus: a corpus of older and younger users’ interactions with spoken dialogue systems
Georgila, K., Wolters, M., Moore, J. D., & Logie, R. H. (2010) · Language Resources and Evaluation · doi:10.1007/s10579-010-9118-8 · Cited by 21
"This machine is for the aides": Tailoring Voice Assistant Design to Home Health Care Work
Bartle, V., Albright, L., & Dell, N. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581118 · Cited by 18
From the Curtain to Kansas: Conducting Wizard-of-Oz Studies in the Wild
Mitchell, E., & Mamykina, L. (2021) · Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411763.3443446 · Cited by 16
A Systematic Review on Design-Based Nudges for Adolescent Online Safety
Agha, Z., Ali, N. S., Park, J., & Wisniewski, P. J. (2025) · International Journal of Child-Computer Interaction · doi:10.1016/j.ijcci.2024.100702 · Cited by 14
Rogers, W. A., Essa, I. A., & Fisk, A. D. (2007) · Ergonomics in Design: The Quarterly of Human Factors Applications · doi:10.1177/106480460701500303 · Cited by 12
Piecing Together Teamwork: A Responsible Approach to an LLM-based Educational Jigsaw Agent
Doherty, E., Perkoff, E. M., von Bayern, S., Zhang, R., Dey, I., Bodzianowski, M., Puntambekar, S., & Hirshfield, L. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713349 · Cited by 12
Dimensional Reasoning and Research Design Spaces
MacNeil, S., Okerlund, J., & Latulipe, C. (2017) · Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition · doi:10.1145/3059454.3059472 · Cited by 8
Raees, M., Khan, V.-J., Lykourentzou, I., & Papangelis, K. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791467 · Cited by 5
“However, around 33% (19 studies) do not construct real AI interventions, and, instead, use simulated AI or Wizard-of-Oz [37] approaches, trying to replicate what users would believe or experience while interacting with AI-assisted decision-making.”
From Trust to Appropriate Reliance: Measurement Constructs in Human-AI Decision-Making
Raees, M., & Papangelis, K. (2026) · arXiv · doi:10.48550/arxiv.2604.23896 · Cited by 5
“%) do not construct real AI interventions, and, instead, use simulated [18] approaches, trying to replicate what users would believe or experience while interacting with AI-assisted decision support.”
Metadata
- Authors
- Dahlbäck, N., Jönsson, A., & Ahrenberg, L.
- Venue
- Proceedings of the 1st international conference on Intelligent user interfaces - IUI '93
- Publisher
- ACM Press
- Published
- 1993
- Pages
- 193-200
- OpenAlex
- W2092795326
- Cited by
- 742
- References
- 14
- FWCI
- 4.18
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.