The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Assessed Levels of Second Language Speaking Proficiency: How Distinct?
Abstract
The study reported in this paper is an investigation of the nature of speaking proficiency in English as a second language in the context of a larger project to develop a rating scale for a new international test of English for Academic Purposes, TOEFL iBT (Brown et al. 2005). We report on a large-scale study of the relationship between detailed features of the spoken language produced by test-takers and holistic scores awarded by raters to these performances. Spoken test performances representing five different tasks and five different proficiency levels (200 performances in all) were analyzed using a range of measures of grammatical accuracy and complexity, vocabulary, pronunciation, and fluency. The results showed that features from each category helped distinguish overall levels of performance, with particular features of vocabulary and fluency having the strongest impact. Overall, the study contributes important insights into the nature of spoken proficiency as it develops and can be measured in rating scales for speaking, and has implications for methodological issues of the appropriateness of the use in language testing research contexts of measures developed in research on second language acquisition.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Handbook of Qualitative Research
Crozier, G., Denzin, N., & Lincoln, Y. (1994) · British Journal of Educational Studies · doi:10.2307/3121684 · Cited by 26,666
THEORETICAL BASES OF COMMUNICATIVE APPROACHES TO SECOND LANGUAGE TEACHING AND TESTING
CANALE, M., & SWAIN, M. (1980) · Applied Linguistics · doi:10.1093/applin/i.1.1 · Cited by 5,044
Fundamental Considerations in Language Testing
Spolsky, B., & Bachman, L. F. (1991) · The Modern Language Journal · doi:10.2307/329499 · Cited by 4,362
The CHILDES project: tools for analyzing talk
MacWhinney, B. (1992) · Child Language Teaching and Therapy · doi:10.1177/026565909200800211 · Cited by 3,396
Measuring Second Language Performance
Kleinsasser, R. C., & McNamara, T. (1998) · The Modern Language Journal · doi:10.2307/330236 · Cited by 1,253
Self-citationThe Influence of Planning and Task Type on Second Language Performance
Foster, P., & Skehan, P. (1996) · Studies in Second Language Acquisition · doi:10.1017/s0272263100015047 · Cited by 1,147 · cited 4×
“In the studies of global accuracy reported in Foster and Skehan (1996) and Skehan and Foster (1999), no inter-coder reliability measures were reported.”
BackgroundInfluentialSecond Language Development in Writing: Measures of Fluency, Accuracy and Complexity
Broussard, K. M., Wolfe-Quintero, K., Inagaki, S., & Kim, H.-Y. (2001) · TESOL Quarterly · doi:10.2307/3587656 · Cited by 920
The Influence of Task Structure and Processing Conditions on Narrative Retellings
Skehan, P., & Foster, P. (1999) · Language Learning · doi:10.1111/1467-9922.00071 · Cited by 699
Syntactic Maturity in Schoolchildren and Adults
Hunt, K. W. (1970) · Monographs of the Society for Research in Child Development · doi:10.2307/1165818 · Cited by 619
THE EFFECTS OF DIFFERENT LENGTHS OF TIME FOR PLANNING ON SECOND LANGUAGE PERFORMANCE
Mehnert, U. (1998) · Studies in Second Language Acquisition · doi:10.1017/s0272263198001041 · Cited by 513
The development of fluency in advanced learners of French
TOWELL, R., HAWKINS, R., & BAZERGUI, N. (1996) · Applied Linguistics · doi:10.1093/applin/17.1.84 · Cited by 482
PLANNING AND FOCUS ON FORM IN L2 ORAL PERFORMANCE
Ortega, L. (1999) · Studies in Second Language Acquisition · doi:10.1017/s0272263199001047 · Cited by 450
Task Complexity and Second Language Narrative Discourse
Robinson, P. (1995) · Language Learning · doi:10.1111/j.1467-1770.1995.tb00964.x · Cited by 362
Lee, J.-W., & Schallert, D. L. (1997) · TESOL Quarterly · doi:10.2307/3587757 · Cited by 315
van Lier, L. (1989) · TESOL Quarterly · doi:10.2307/3586922 · Cited by 265
An investigation of planning time and proficiency level on oral test discourse
Wigglesworth, G. (1997) · Language Testing · doi:10.1177/026553229701400105 · Cited by 258
Coming to grips with lexical richness in spontaneous speech data
Vermeer, A. (2000) · Language Testing · doi:10.1177/026553220001700103 · Cited by 231
Iwashita, N., McNamara, T., & Elder, C. (2001) · Language Learning · doi:10.1111/0023-8333.00160 · Cited by 230
Self-citationDoes thick description lead to smart tests? A data-based approach to rating scale construction
Fulcher, G. (1996) · Language Testing · doi:10.1177/026553229601300205 · Cited by 213
Riggenbach, H. (2000) · doi:10.3998/mpub.16109 · Cited by 181
Brown, A., Iwashita, N., & McNamara, T. (2005) · ETS Research Report Series · doi:10.1002/j.2333-8504.2005.tb01982.x · Cited by 165
Self-citationAssessing Second Language Writing: The Rater’s Perspective
Lumley, T. (2005) · Cited by 161
Methods of Morpheme Quantification: Their Effect on the Interpretation of Second Language Data
Pica, T. (1983) · Studies in Second Language Acquisition · doi:10.1017/s0272263100000309 · Cited by 138
Item Response Theory and the validation of an ESP test for health professionals
McNamara, T. F. (1990) · Language Testing · doi:10.1177/026553229000700105 · Cited by 112
Self-citationIs fluency, like beauty, in the eyes (and ears) of the beholder?
Freed, B. F. (2000) · Dialnet (Universidad de la Rioja) · Cited by 103
Cited by
Complexity, accuracy and fluency in second language acquisition
Housen, A., & Kuiken, F. (2009) · Applied Linguistics · doi:10.1093/applin/amp048 · Cited by 863
Defining and operationalising L2 complexity
Bulté, B., & Housen, A. (2012) · Language Learning & Language Teaching · doi:10.1075/lllt.32.02bul · Cited by 587
The Relationship of Lexical Richness to the Quality of ESL Learners’ Oral Narratives
LU, X. (2012) · The Modern Language Journal · doi:10.1111/j.1540-4781.2011.01232_1.x · Cited by 526
Relative salience of suprasegmental features on judgments of L2 comprehensibility and accentedness
Kang, O. (2010) · System · doi:10.1016/j.system.2010.01.005 · Cited by 327
Isaacs, T., & Trofimovich, P. (2012) · Studies in Second Language Acquisition · doi:10.1017/s0272263112000150 · Cited by 325
Metadata
- Authors
- Iwashita, N., Brown, A., McNamara, T., & O'Hagan, S.
- Venue
- Applied Linguistics
- Publisher
- Oxford University Press (OUP)
- Published
- 2007-07-01
- Volume
- 29
- Issue
- 1
- Pages
- 24-49
- ISSN
- 0142-6001 (ISSN-L)
- 1477-450X
- OpenAlex
- W2115055261
- Cited by
- 409
- References
- 25
- FWCI
- 37.94
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.