CoChat

Research Methodology and the Question of Validity

Wolfson, Nessa · 1986 · TESOL Quarterly
Cited by 92

The DOI matches its Crossref record.

Abstract

The analysis of the rules of speaking for a specific speech community is the first step in understanding what it means to be communicatively competent among that group. We must have reliable descriptions of these rules and patterns in order to improve second language instruction and assessment. However, there are serious questions as to the best methods of gathering and analyzing the very data upon which such descriptions must rest. This article discusses the advantages and disadvantages of different research approaches to the study of everyday speech behavior and hence to our understanding of communicative competence. Methodology is one of the most basic questions for any discipline dealing with human interaction. Language learning and the acquisition of the rules for appropriate speech behavior are no exception. The questions of what constitutes data and how we treat data are fundamental to the entire enterprise of explaining and describing the acquisition of a second language, both from the point of view of linguistic and of sociolinguistic rules (or, recognizing that the two are inextricably interwoven, research into the acquisition of what has come to be known as communicative competence). No matter what else we do, we must remember that if data are inadequate, there is always the danger that the theory and conclusions drawn from them could be unreliable and misleading. For this reason, the question of data source must be kept open to constant examination and reexamination regarding its validity. The approaches toward the gathering of data for linguistic analysis are roughly of two types: observation and elicitation. Within the category of elicitation, we can include all techniques in which subjects are aware that what they say (or in some cases, what they say they say) is being studied by an investigator. This category would include such widely differing techniques as the elicitation of

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2307/3586519

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cited by

Metadata

Authors
Wolfson, N.
Venue
TESOL Quarterly
Publisher
JSTOR
Published
1986-12
Volume
20
Issue
4
Pages
689
ISSN
0039-8322 (ISSN-L)
OpenAlex
W2067319996
Cited by
92
References
0
FWCI
20.84
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.