The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Question Understanding Aid (QUAID): A Web Facility that Tests Question Comprehensibility
Abstract
When respondents do not understand the meaning of a survey question, they will not supply valid and reliable answers. Survey methodologists should therefore benefit from computer tools and other analytical schemes that help them identify problems with questions with respect to comprehension difficulty. We developed a Web facility called Question Understanding Aid (QUAID; www.psyc.memphis.edu/quaid.html) that assists survey methodologists in identifying problems with the wording, syntax, and semantics of questions on questionnaires. The survey methodologist enters the question into the Web facility, along with any context information and answer alternatives that accompany the question. QUAID quickly returns a list of potential problems with question comprehension, including unfamiliar technical terms, vague or imprecise relative terms, vague or ambiguous noun phrases, complex syntax, and working memory overload. This article describes QUAID and some empirical studies that have assessed the validity and utility of QUAID’s critiques of questions. The output of QUAID was compared with the judgments of experts in language, discourse, and cognition during the development of the tool. In one evaluation, expert survey methodologists critiqued and revised problematic questions, whereas in a second evaluation survey methodologists evaluated the quality of original problematic questions, questions revised with the assistance of QUAID, and questions revised without QUAID. In a third evaluation, eye-tracking data were collected while respondents read questions on a computer screen and answered questions aloud. Respondents had a tendency to give up processing difficult questions too early (called an early exit), which potentially threatens the validity of the respondents’ answers. Survey methodologists are encouraged to use QUAID and further evaluate its validity and utility.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Eye movements in reading and information processing: 20 years of research
Rayner, K. (1998) · Psychological Bulletin · doi:10.1037/0033-2909.124.3.372 · Cited by 7,979
A theory of reading: From eye fixations to comprehension.
Just, M. A., & Carpenter, P. A. (1980) · Psychological Review · doi:10.1037/0033-295x.87.4.329 · Cited by 5,220
Cognition and survey measurement: History and overview
Jobe, J. B., & Mingay, D. J. (1991) · Applied Cognitive Psychology · doi:10.1002/acp.2350050303 · Cited by 127
Cited by
Hulland, J., Baumgartner, H., & Smith, K. M. (2018) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-017-0532-y · Cited by 1,067
“Several authors have suggested lists of common comprehension problems due to poorly formulated items, including Tourangeau et al. (2000), Graesser et al. (2000, 2006), and Lenzner and colleagues (e.g., Lenzner 2012; Lenzner et al. 2011; Lenzner et al. 2010).”
BackgroundAutomated Evaluation of Text and Discourse with Coh-Metrix
McNamara, D. S., Graesser, A. C., McCarthy, P. M., & Cai, Z. (2014) · Cambridge University Press eBooks · doi:10.1017/cbo9780511894664 · Cited by 892
Self-citationCoh-Metrix: Providing Multilevel Analyses of Text Characteristics
Graesser, A. C., McNamara, D. S., & Kulikowich, J. M. (2011) · Educational Researcher · doi:10.3102/0013189x11413260 · Cited by 619
Self-citationComputational analyses of multilevel discourse comprehension
Graesser, A. C., & McNamara, D. S. (2011) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2010.01081.x · Cited by 325
Self-citationAutoTutor and Family: A Review of 17 Years of Natural Language Tutoring
Nye, B. D., Graesser, A. C., & Hu, X. (2014) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-014-0029-5 · Cited by 286
Self-citation
Metadata
- Authors
- Graesser, A. C.
- Venue
- Public Opinion Quarterly
- Publisher
- Oxford University Press (OUP)
- Published
- 2006-03-01
- Volume
- 70
- Issue
- 1
- Pages
- 3-22
- ISSN
- 0033-362X (ISSN-L)
- 1537-5331
- OpenAlex
- W2170562344
- Cited by
- 169
- References
- 3
- FWCI
- 12.68
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Question Understanding Aid (QUAID): A Web Facility that Tests Question Comprehensibility. https://app.cochat.ai/papers/10.1093/poq/nfj012
- The paper
- Graesser, A. C. (2006). Question Understanding Aid (QUAID): A Web Facility that Tests Question Comprehensibility. Public Opinion Quarterly. https://doi.org/10.1093/poq/nfj012
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.