CoChat
Sign Up
Cited by 124Stuttering Research and TreatmentResearch Data Management PracticesLanguage Development and Disorders

Fluency Bank: A new resource for fluency research and practice

Open access
Bernstein Ratner, Nan, MacWhinney, Brian·2018·Journal of Fluency Disorders
DOI 10.1016/j.jfludis.2018.03.002PMC PMC5986295
Open this paper in CoChat — free account

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.jfludis.2018.03.002

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • People who stutter are rarely involved in addressing the complexities of stuttered speech annotation.

    “people who stutter (PWS) are rarely involved to address such complexities [6, 58, 83, 102].”

    From Disability-First AI Dataset Annotation: Co-designing Stuttered Speech Annotation Guidelines with People Who Stutter (2026) · cites this paper as [83]

    Section 2.2, “The coding dilemma and potential solutions” (page unavailable), describes significant reliability problems in fluency coding and disagreement among coders. It does not say that people who stutter are rarely involved in addressing those problems; searches for their involvement in annotation found no supporting passage. (LLM, conf=0.78)

    Experimental — accuracy not yet measured

  • The five stuttering events used in Sep-28k represent the core disfluency types identified across prior work.

    “We adopted the five stuttering events used in Sep-28k as our initial ontology, as these events represent the core disfluency types identified across prior work [32, 58, 63, 83].”

    From Disability-First AI Dataset Annotation: Co-designing Stuttered Speech Annotation Guidelines with People Who Stutter (2026) · cites this paper as [83]

    Section 2.2 discusses coding disfluency patterns and names segment repetitions, drawls, and retraces. The paper therefore supports the general premise that disfluencies have distinguishable types, but our copy does not identify Sep-28k’s five events or establish them as the core types across prior work. No page number is available in the indexed copy. (LLM, conf=0.77)

    Experimental — accuracy not yet measured

  • Our guidelines differ from SLP frameworks developed to measure fluency and stuttering severity, as well as from earlier labeling frameworks designed primarily to detect stuttering events.

    “Our guidelines differ from SLP frameworks developed to measure fluency and stuttering severity [83, 109], as well as from earlier labeling frameworks designed primarily to detect stuttering events [58].”

    From Disability-First AI Dataset Annotation: Co-designing Stuttered Speech Annotation Guidelines with People Who Stutter (2026) · cites this paper as [83]

    Section 1.2 (TalkBank Features; page unavailable) describes FluencyBank’s standardized codes for marking stuttering and other disfluencies, supporting its identification as a fluency-labeling framework. Section 3.3 (Teaching with FluencyBank; page unavailable) discusses scoring stuttering severity with the separate SSI-4 instrument, rather than presenting FluencyBank as a framework developed to measure severity. The sentence’s comparison with the citing authors’ own guidelines is not established by this source. (LLM, conf=0.81)

    Experimental — accuracy not yet measured

  • Conventional annotation guidelines focus primarily on audible speech.

    “In contrast to conventional annotation guidelines that focus primarily on audible speech [58, 83]”

    From Disability-First AI Dataset Annotation: Co-designing Stuttered Speech Annotation Guidelines with People Who Stutter (2026) · cites this paper as [83]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The citation lists haven’t been fetched yet

References 113 · Cited by 124

Research works printed but not linked: 91

  1. Altmann GT 2001 The language machine: Psycholinguistics in review British Journal of Psychology 92 Part 1 129 170 11802868
  2. Arnold JE Fagnano M Tanenhaus MK 2003 Disfluencies signal theee, um, new information Journal of Psycholinguistic Research 32 25 36 12647561
  3. Arnold JE Kam CLH Tanenhaus MK 2007 If you say thee uh you are describing something hard: the on-line attribution of disfluency during reference comprehension Journal of Experimental Psychology Learning, Memory, and Cognition 33 914 930 17723069
  4. Bakker K 1999 Technical solutions for quantitative and qualitative assessments of speech fluency Seminars in Speech and Language 20 185 195 10343364
  5. Bauman J Hall N Wagovich S Weber-Fox C Bernstein Ratner N 2012 Past tense marking in the spontaneous speech of preschool children who do and do not stutter Journal of Fluency Disorders 37 314 24 23218214 PMC3520126
  6. Bernstein Ratner N MacWhinney B 2016 Your laptop to the rescue: Using the CHILDES Archive and CLAN programs to improve language sample analysis Seminars in Speech and Language 37 2 74 84 27111268 PMC8856510
  7. Bernstein Ratner N MacWhinney B (in press) Use of big data in child language assessment Lust B Development of Linguistic Linked Open Data Resources for Collaborative Data-Intensive Research in the Language Sciences Cambridge, MA MIT Press
  8. Boltz MG 2005 Temporal dimensions of conversational interaction: The role of response latencies and pauses in social impression formation Journal of Language and Social Psychology 24 103 138
  9. Bortfeld H Leon SD Bloom JE Schober MF Brennan S 2001 Disfluency rates in conversation: effects of age, relationship, topic, role, and gender Language and Speech 44 part 2 123 147 11575901
  10. Boscolo B Bernstein Ratner N Rescorla L 2002 Fluency of school-aged children with a history of specific expressive language impairment: An exploratory study American Journal of Speech Language Pathology 11 41 49
  11. Brocklehurst PH Corley M 2011 Investigating the inner speech of people who stutter: Evidence for (and against) the Covert Repair Hypothesis Journal of Communication Disorders 44 246 260 21208627
  12. Brown R 1973 A first language Cambridge, MA Harvard University Press
  13. Brundage SB Bothe A Lengeling A Evans J 2006 Comparing judgments of stuttering made by students, clinicians, and highly experienced judges Journal of Fluency Disorders 31 271 283 16982086
  14. Byrd C Bedore L Ramos D 2015 The disfluent speech of bilingual Spanish–English children: Considerations for differential diagnosis of stuttering Language, Speech, and Hearing Services in Schools 46 30 43 PMC4689226 25215876
  15. Cordes AK 2000 Individual and consensus judgments of disfluency types in the speech of persons who stutter Journal of Speech, Language, and Hearing Research 43 951 964 11386481
  16. Cordes AK Ingham R 1994 The reliability of observational data: II. Issues in the identification and measurement of stuttering events Journal of Speech and Hearing Research 37 279 294 8028309
  17. Cordes AK Ingham R 1996 Time-interval measurement of stuttering: establishing and modifying judgment accuracy Journal of Speech and Hearing Research 39 298 310 8729918
  18. Cordes AK Ingham R Frank P Ingham J 1992 Time-interval analysis of interjudge and intrajudge agreement for stuttering event judgments Journal of Speech and Hearing Research 35 483 494 1608240
  19. Corley M MacGregor LJ Donaldson DI 2007 It’s the way that you, er, say it: Hesitations in speech affect language comprehension Cognition 105 658 668 17173887
  20. Dale PS McMillan AJ Hayiou-Thomas ME Plomin R 2014 Illusory recovery: Are recovered children with early language delay at continuing elevated risk? American Journal of Speech-Language Pathology 23 3 437 447 24686486 PMC4214119
  21. De Jong NH Wempe TON 2009 Praat script to detect syllable nuclei and measure speech rate automatically Behavior Research Methods 41 2 385 390 19363178
  22. Dell GS Reich PA 1981 Stages in sentence production: An analysis of speech error data Journal of Verbal Learning and Verbal Behavior 20 6 611 629
  23. Dell GS O’Seaghdha PG 1992 Stages of lexical access in language production Cognition 42 1 287 314 1582160
  24. De Nil L Brutten G Hancock K Craig A McCready C McCaul A Gilmore G 1998 Communication Attitude Test–Revised Journal of Speech, Language, and Hearing Research 41 1242 1252 9859881
  25. Finneran D Leonard L Miller C 2009 Speech disruptions in the sentence formulation of school-age children with specific language impairment Language and Communication Disorders 44 271 286 PMC2730412 19424892
  26. MacWhinney B Fromm D Forbes M Holland A 2011 AphasiaBank: Methods for studying discourse Aphasiology 25 11 1286 1307 22923879 PMC3424615
  27. Fox Tree JE 1995 The effects of false starts and repetitions on the processing of subsequent words in spontaneous speech Journal of Memory and Language 34 709 738
  28. Fraundorf SH Watson DG 2014 Alice’s adventures in um-derland: Psycholinguistic dimensions of variation in disfluency production Language, Cognition and Neuroscience 29 1083 1096 PMC4203439 25339788
  29. Freudenthal D Pine JM Aguado‐Orea J Gobet F 2007 Modeling the developmental patterning of finiteness marking in English, Dutch, German, and Spanish using MOSAIC Cognitive Science 31 2 311 341 21635299
  30. Fromkin V 1973 Slips of the tongue San Francisco WH Freeman 4756435
  31. Guo LY Tomblin JB Samelson V 2008 Speech disruptions in the narratives of English-speaking children with specific language impairment Journal of Speech, Language, and Hearing Research 51 722 738 PMC2558670 18506046
  32. Hall NE Yamashita TS Aram DM 1993 Relationship between language and fluency in children with developmental language disorders Journal of Speech and Hearing Research 36 568 579 7687313
  33. Hartsuiker RJ Notebaert L 2010 Lexical access problems lead to disfluencies in speech Experimental Psychology 57 169 177 20178924
  34. Hassanali KN Liu Y Iglesias A Solorio T Dollaghan C 2014 Automatic generation of the index of productive syntax for child language transcripts Behavior Research Methods 46 1 254 262 23720148
  35. Hester E Pellowski M 2014 Speech disruptions in the narratives of African American Children with reading disabilities Journal of Developmental & Physical Disabilities 26 83 92
  36. Horton WS Spieler DH Shriberg E 2010 A corpus analysis of patterns of age-related change in conversational speech Psychology and Aging 25 708 713 20677883 PMC2943985
  37. Howell P Davis S Williams R 2009 The effects of bilingualism on stuttering during late childhood Archives of Disease in Childhood 94 42 46 PMC2597689 18782846
  38. Howell P Tang K Tuomainen O Chan SK Beltran K Mirawdeli A Harris J 2016 Identification of fluency and word‐finding difficulty in samples of children with diverse language backgrounds International Journal of Language & Communication Disorders 28035712
  39. Huang R 2016 An Evaluation of POS Taggers for the CHILDES Corpus Unpublished dissertation, City University of New York. Retrieved August 7, 2016 from http://academicworks.cuny.edu/cgi/viewcontent.cgi?article=2634&context=gc_etds
  40. Hubbard CP 1998 Reliability of judgments of stuttering and disfluency in young children’s speech Journal of Communication Disorders 31 245 259 9621906
  41. Indefrey P Levelt WJ 2000 The neural correlates of language production The new Cognitive Neurosciences 2nd 845 865 MIT press
  42. Ingham R Cordes AK 1997 Identifying the authoritative judgments of stuttering: comparisons of self-judgments and observer judgments Journal of Speech, Language, and Hearing Research 40 581 594 9210116
  43. Ingham RJ Cordes AK Finn P 1993 Time-interval measurement of stuttering: systematic replication of Ingham, Cordes, and Gow (1993) Journal of Speech and Hearing Research 36 1168 1176 8114483
  44. Jaeger JJ 2004 Kids’ slips: What young children’s slips of the tongue reveal about language development Psychology Press
  45. Justice LM Breit-Smith A Rogers M 2010 Data recycling: using existing databases to increase research capacity in speech-language development and disorders Language, Speech, and Hearing Services in Schools 41 39 43 20051578
  46. Kemper S Hoffman L Schmalzried R Herman R Kieweg D 2011 Tracking talking: Dual task costs of planning and producing speech for young versus older adults Aging, Neuropsychology and Cognition 18 257 279 PMC3091967 21140310
  47. Kloth SAM Kraaimaat FW Janssen P Brutten GJ 2000 Persistence and remission of incipient stuttering among high-risk children Journal of Fluency Disorders 24 4 253 265
  48. Kowal S O’Connell DC Sabin EF 1975 Development of temporal planning and vocal hesitations in spontaneous narratives Journal of Psycholinguistic Research 4 195 207
  49. Lake JK Humphreys KR Cardy S 2011 Listener vs. speaker-oriented aspects of speech: Studying the disfluencies of individuals with autism spectrum disorders Psychonomic Bulletin and Review 18 135 140 21327345
  50. Lee LL Canter SM 1971 Developmental sentence scoring: a clinical procedure for estimating syntactic development in children’s spontaneous speech Journal of Speech & Hearing Disorders 36 315 340 5566112
  51. Leech K Bernstein Ratner N Weber C 2017 Preliminary evidence that growth in productive language differentiates stuttering persistence and recovery Journal of Speech, Language & Hearing Research 60 11 3097 3109 PMC5945073 29049493
  52. Levelt W Roelofs A Meyer A 1999 A theory of lexical access in speech production Behavioral and Brain Sciences 22 1 38 11301520
  53. Lickley RJ Bard EC 1998 When can listeners detect disfluency in spontaneous speech? Language and Speech 41 203 226 10194877
  54. Louko LJ Edwards ML Conture EG 1990 Phonological characteristics of young stutterers and their normally fluent peers: Preliminary observations Journal of Fluency Disorders 15 4 191 210
  55. MacGregor LJ Corley M Donaldson DI 2010 Listening to the sound of silence: disfluent silent pauses in speech have consequences for listeners Neuropsychologia 48 3982 3992 20950633
  56. MacWhinney B Leinbach J 1991 Implementations are not conceptualizations: Revising the verb learning model Cognition 40 1 121 157 1786671
  57. MacWhinney B Snow C 1990 The child language data exchange system: An update Journal of Child Language 17 2 457 472 2380278 PMC9807025
  58. Marcus GF Pinker S Ullman M Hollander M Rosen TJ Xu F Clahsen H 1992 Overregularization in language acquisition Monographs of the society for research in child development i 178 1518508
  59. Martin RC Crowther JE Knight M Tamborello F 2nd Yang CL 2010 Planning in sentence production: evidence for the phrase as a default planning scope Cognition 116 177 192 20501338 PMC2930890
  60. McDaniel D McKee C Garrett MF 2010 Children’s sentence planning: Syntactic correlates of fluency variations Journal of Child Language 37 59 94 19523262
  61. Metze F Riebling E Fosler-Lussier E Plummer A Bates R 2015 The speech recognition virtual kitchen turns one Sixteenth Annual Conference of the International Speech Communication Association
  62. Miles S Ratner NB 2001 Parental language input to children at stuttering onset Journal of Speech, Language, and Hearing Research 44 5 1116 1130 11708531
  63. Ntourou K Conture EG Lipsey MW 2011 Language abilities of children who stutter: A meta-analytical review American Journal of Speech-Language Pathology 20 3 163 179 21478281 PMC3738062
  64. Nye C Vanryckeghem M Schwartz JB Herder C Turner HM III Howard C Bosshardt H 2013 Behavioral stuttering interventions for children and adolescents: A systematic review and meta-analysis Journal of Speech, Language & Hearing Research 56 921 932 23275413
  65. O’Connell DC Kowal S 2005 Uh and um revisited: Are they interjections for signaling delay? Journal of Psycholinguistic Research 34 6 555 576 16341914
  66. Ozuru Y Hirst W 2006 Surface features of utterances, credibility judgments, and memory Memory and Cognition 34 1512 1526 17263075
  67. Pinker S Prince A 1988 On language and connectionism: Analysis of a parallel distributed processing model of language acquisition Cognition 28 1 73 193 2450717
  68. Postma A Kolk H 1993 The covert repair hypothesis: Pre-articulatory repair processes in normal speech Journal of Speech and Hearing Research 36 472 8331905
  69. Price LH Hendricks S Cook C 2010 Incorporating computer-aided language sample analysis into clinical practice Language, Speech, and Hearing Services in Schools 41 2 206 222 19755638
  70. Riley J Riley G Maguire G 2004 Subjective Screening of Stuttering Severity, Locus of Control and Avoidance: research edition Journal of Fluency Disorders 29 51 62 15026214
  71. Rispoli M Hadley P Holt J 2008 Stalls and revisions: A developmental perspective on sentence production Journal of Speech, Language and Hearing Research 51 953 966 18658064
  72. Rose Y Hedlund G Byrne R Wareham T MacWhinney B 2007 Phon 1.2: A Computational Basis for Phonological Database Elaboration and Model Testing Buttery P Villavicencio A Korhonen A Proceedings of the Workshop on Cognitive Aspects of Computational Language Acquisition, 45th Annual Meeting of the Association for Computational Linguistics 17 24 Stroudsburg ACL
  73. Ryan BP 2001 A longitudinal study of articulation, language, rate, and fluency of 22 preschool children who stutter Journal of Fluency Disorders 26 2 107 127
  74. Sagae K Davis E Lavie E MacWhinney B Wintner S 2007 High-accuracy annotation and parsing of CHILDES transcripts Proceedings of the 45th Meeting of the Association for Computational Linguistics Prague ACL
  75. Sagae K Lavie A MacWhinney B 2005 Automatic measurement of syntactic development in child language Proceedings of the 43rd Meeting of the Association for Computational Linguistics 197 204 Ann Arbor ACL
  76. Sin K Beltran K Howell P 2015 Language history and its impact on stuttering and word-finding disfluency Proceedings of the Eighth World Congress on Fluency Disorders www.theifa.org
  77. Sisskin V Wasilus S 2014 Lost in the literature, but not the caseload: working with atypical disfluency from theory to practice Seminars in Speech and Language 35 144 152 24782276
  78. Smith A Hall N Tan X Farrell K 2011 Speech timing and pausing in children with Specific Language Impairment Clinical Linguistics & Phonetics 25 145 154 21070133
  79. Smith A Roberts J Smith S Locke J Bennett J 2006 Reduced speaking rate as an early predictor of reading disability American Journal of Speech-Language Pathology 15 289 297 16896178
  80. Smith AB Smith SL Locke JL Bennett J 2008 A longitudinal study of speech timing in young children later found to have reading disability Journal of Speech, Language & Hearing Research 51 1300 1314 18812490
  81. Spencer C Weber-Fox C 2014 Preschool speech articulation and nonword repetition abilities may help predict eventual recovery or persistence of stuttering Journal of fluency disorders 41 32 46 25173455 PMC4150085
  82. Steinberg M Bernstein Ratner N Berl M Gaillard W 2013 Fluency patterns in narratives from children with localization-related epilepsy Journal of Fluency Disorders 38 193 205 23773671 PMC3687359
  83. Stemberger JP 1989 Speech errors in early child language production Journal of Memory and Language 28 2 164 188
  84. Strekas A Bernstein Ratner N Berl M Gaillard WD 2013 Narrative abilities of children with epilepsy International Journal of Language and Communication Disorders 48 207 219 23472960
  85. Tumanova V Conture EG Lambert E Walden T 2014 Speech disfluencies of preschool-aged children who do and do not stutter Journal of Communication Disorders 49 25 41 24503151 PMC4048759
  86. Valian V Solt S Stewart J 2009 Abstract categories or limited-scope formulae? The case of children’s determiners Journal of Child Language 36 4 743 778 19123961
  87. Vasic N Wijnen F 2004 Stuttering as a monitoring deficit Hartsuiker RJ Bastiaanse R Postma A Wijnen F Phonological encoding and monitoring in normal and pathological speech Hove, East Sussex Psychology Press
  88. Wagovich SA Hall NE Clifford BA 2009 Speech disruptions in relation to language growth in children who stutter: an exploratory study Journal of Fluency Disorders 34 242 256 20113769
  89. Yairi E Ambrose N 1999 Early childhood stuttering I: Persistency and recovery rates Journal of Speech, Language and Hearing Research 42 1097 10515508
  90. Yairi E Ambrose NG Paden EP Throneburg RN 1996 Predictive factors of persistence and recovery: Pathways of childhood stuttering Journal of communication disorders 29 1 51 77 8722529
  91. Yoshimura Y MacWhinney B 2007 The effect of oral repetition in L2 speech fluency: System for an experimental tool and a language tutor SLATE Conference 25 28

Authors
Bernstein Ratner, N., & MacWhinney, B.
Affiliations
Carnegie Mellon University (US)
ORCID
Venue
Journal of Fluency Disorders
Publisher
Elsevier BV
Published
2018-06
Volume
56
Pages
69-80
ISSN
0094-730X (ISSN-L)
DOI
10.1016/j.jfludis.2018.03.002
PMC
PMC5986295
OpenAlex
W2794511405
Cited by
124
References
113
Citations by year
2026: 18 · 2025: 25 · 2024: 28 · 2023: 24 · 2022: 20 · 2021: 4 · 2020: 2 · 2019: 2 · 2018: 1
FWCI
2.64
Type
journal article
Language
en
Open access
Licence
Locations
  • Journal of Fluency Disorders (acceptedVersion)
  • PubMed (publishedVersion)
  • PubMed Central (acceptedVersion)
Funders
  • National Institutes of Health (1 R01 DC015494-01)
  • National Science Foundation (BCS-1626300/1626294)
Topics
  • Social Sciences › Psychology › Clinical Psychology › Stuttering Research and Treatment
  • Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
  • Social Sciences › Psychology › Developmental and Educational Psychology › Language Development and Disorders
Keywords
fluency disorders, data repositories, data sharing, computational tools, clinical evaluation, orthography, teaching materials, stuttering

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review