CoChat

AI in Informal Science Education: Bringing Turing Back to Life to Perform the Turing Test

Open access
Gonzalez, Avelino J., Hollister, James R., DeMara, Ronald F., Leigh, Jason, Lanman, Brandan, Lee, Sang-Yoon, Parker, Shane, Walls, Christopher, Parker, Jeanne, Wong, Josiah, Barham, Clayton, Wilder, Bryan · 2017 · International Journal of Artificial Intelligence in Education

The DOI matches its Crossref record; 30 of the 31 references it cites were found in a registry or an index.

Abstract

This paper describes an interactive museum exhibit featuring an avatar of Alan Turing that informs museum visitors about artificial intelligence and Turing’s seminal Turing Test for machine intelligence. The objective of the exhibit is to engage and motivate visiting children in the hope of sparking an interest in them about computer science and artificial intelligence, and cause them to consider pursuing future studies and/or careers in these fields. The exhibit interacts with the visitors, allowing them to participate in a simplified version of Turing’s test that is brief and informal to suit the limitations of a five-minute exhibit. In this exhibit, the visitor (targeted towards middle school age children) invokes an avatar of his/her own choice, and acts to endow it with human-like qualities (voice, brain, eyesight and hearing). Then, the visitor engages the avatar in a (brief) question-and-answer session to determine whether the visitor thinks that he/she is interacting with a real human on a video conference or with an avatar. We consider this interaction to be an extension of the original Turing Test because, unlike Turing’s original that used text via a teletype, this version features a graphical embodiment of an agent with which one can converse in spoken natural language. This extension serves to make passing the Turing Test more difficult, as now the avatar must not only communicate like a human, but also look, sound and act the part. It also makes the exhibit visual, dynamic and interesting to the visitors. Evaluations were performed with museum visitors, both in backrooms with prototypes as well as on the museum floor with the final version. The formative and summative evaluations performed indicated overall success in engaging the museum visitors and increasing their interest in computer science. More specifically, the formative testing, mostly done in quiet back rooms with selected test subjects, indicated that on the important questions about enjoyment of exhibit and increased interest in computer science by the test subjects, their self-reported Likert scale responses (1 being negative and 5 being positive) increased from 3.16 in the first evaluation to 4.38 in the third one for increased interest in CS. Likewise for the question about exhibit enjoyment (from 3.92 to 4.56). The summative evaluation, done through unobtrusive observation of exhibit use on museum floor, indicated that almost 74% of the parties that initiated the exhibit were either highly or moderately engaged by the exhibit. However, there was one major negative finding, namely the overly long duration of the exhibit, which may have caused premature abandonment of the exhibit in several cases during the summative evaluation. These tests and their results are presented and discussed in detail in this paper. The exhibit has been on permanent display at the Orlando (FL) Science Center since June 2014 and has received a strongly positive response from visitors since that time.

Overview

Integrity signals

Registry

Crossref · 10.1007/s40593-017-0144-1

Cites

30 of 30 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Research works printed but not linked: 1

  1. Lee, C., Sidner, C., Kidd, C. Engagement during dialogues with robots, 2005. AAAI Spring Symposia.

Cited by

See all 35

Metadata

Authors
Gonzalez, A. J., Hollister, J. R., DeMara, R. F., Leigh, J., Lanman, B., Lee, S.-Y., Parker, S., Walls, C., Parker, J., Wong, J., Barham, C., & Wilder, B.
Affiliations
  • University of Central Florida (US)
  • University of Illinois Chicago (US)
  • Orlando Science Center (US)
Venue
International Journal of Artificial Intelligence in Education
Publisher
Elsevier BV
Published
2017-06
Volume
27
Issue
2
Pages
353-384
ISSN
1560-4292 (ISSN-L)
OpenAlex
W2596069950
Cited by
31
References
31
Citations by year
2026: 5 · 2025: 4 · 2024: 6 · 2023: 5 · 2022: 4 · 2021: 2 · 2019: 2 · 2018: 2 · 2017: 1
FWCI
23.15
Type
journal article
Language
en
Open access
Licence
Locations
  • International Journal of Artificial Intelligence in Education (publishedVersion, cc-by-nc-nd)
  • Journal of International Crisis and Risk Communication Research (submittedVersion)
Funders
Directorate for Education and Human Resources (DRL1138325)
Topics
  • Social Sciences › Arts and Humanities › Museology › Museums and Cultural Heritage
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
  • Social Sciences › Arts and Humanities › Visual Arts and Performing Arts › Art, Technology, and Culture
Keywords
Turing test, Alan Turing, interactive museum exhibits, artificial intelligence in education, informal science education, embodied avatars, chatbots, natural language interaction, junior high school students, STEM outreach, exhibition evaluation, human-robot interaction, museum visitor engagement

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.