The Random Probe: A Technique for Evaluating the Validity of Closed Questions
The DOI matches its Crossref record.
Abstract
The familiar dilemma of open versus closed interview questions becomes especially acute when surveys are undertaken outside middle-class American society. Inevitable ignorance of the subtleties of another culture leads the researcher toward an open-ended approach, while his experience with the difficulties of channeling diverse free responses into a useful frame of reference and of coding enormous masses of verbal data encourages him to rely on closed questions. The method of 'random probes suggested here is intended to allow a survey researcher to eat his cake and still have a little left over.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Back-translation for cross-cultural research.
Brislin, R. W. (1970) · Journal of Cross-Cultural Psychology · doi:10.1177/135910457000100301 · Cited by 14,091
Guillemin, F., Bombardier, C., & Beaton, D. (1993) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(93)90142-n · Cited by 6,060
Structural Topic Models for Open‐Ended Survey Responses
Roberts, M. E., Stewart, B. M., Tingley, D., Lucas, C., Leder‐Luis, J., Gadarian, S. K., Albertson, B., & Rand, D. G. (2014) · American Journal of Political Science · doi:10.1111/ajps.12103 · Cited by 1,952
Retrospective reports of strategic‐level managers: Guidelines for increasing their accuracy
Huber, G. P., & Power, D. J. (1985) · Strategic Management Journal · doi:10.1002/smj.4250060206 · Cited by 1,708
The Science of Asking Questions
Schaeffer, N. C., & Presser, S. (2003) · Annual Review of Sociology · doi:10.1146/annurev.soc.29.110702.110112 · Cited by 621
Prejudice, Politics, and Public Opinion: Understanding the Sources of Racial Policy Attitudes
Krysan, M. (2000) · Annual Review of Sociology · doi:10.1146/annurev.soc.26.1.135 · Cited by 282
Leitgöb, H., Seddig, D., Asparouhov, T., Behr, D., Davidov, E., De Roover, K., Jak, S., Meitinger, K., Menold, N., Muthén, B., et al. (2023) · Social Science Research · doi:10.1016/j.ssresearch.2022.102805 · Cited by 271
Mahler, C., Hermann, K., Horne, R., Ludt, S., Haefeli, W. E., Szecsenyi, J., & Jank, S. (2010) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2009.01169.x · Cited by 188
“The first draft of the MARS-D was then piloted among eight people using Shuman’s random mode method [17] to ensure that the items were understood as having a meaning equivalent to the meaning of the source item.”
MethodAssessing Cross-National Equivalence of Measures of Xenophobia: Evidence from Probing in Web Surveys
Braun, M., Behr, D., & Kaczmirek, L. (2013) · International Journal of Public Opinion Research · doi:10.1093/ijpor/eds034 · Cited by 51
Metadata
- Authors
- Schuman, H.
- Venue
- American Sociological Review
- Publisher
- SAGE Publications
- Published
- 1966-04
- Volume
- 31
- Issue
- 2
- Pages
- 218
- ISSN
- 0003-1224 (ISSN-L)
- OpenAlex
- W2028609370
- Cited by
- 138
- References
- 0
- FWCI
- 7.60
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.