Dynamic development of syntactic complexity in second language writing: A longitudinal case study of a young Chinese EFL learner
Open accessAbstract
The present study analyzes the English diaries written by a young Chinese English as a foreign language (EFL) learner over a 1-year period in an attempt to determine the developmental process of Chinese EFL young learners’ written language in terms of syntactic complexity. This study aimed to use a wide range of metrics to explore densely collected data based on Dynamic Systems Theory. The longitudinal study data were analyzed through eight large-grained measures related to sentential, clausal, and phrasal features by using L2 Syntactic Complexity Analyzer, as well as fine-grained measures related to seven modifiers, an adjective placed before a noun, ordinal numerals are indicated (ADJA), cardinal numeral (CARD), predicative adjective, adverbial adjective (ADJP), adverbs (ADV), prepositional phrases (PREP), subordinate (SUB), and relative clause (REL), through manual annotations. The results show that, first, the developmental process was not linear but spiral in terms of large-grained measures. The sentential level varied, and the development process of the young learner is different from Chinese English learners studying in colleges. Second, the dynamic features of fine-grained measures are also prominent in the seven indicators. ADJA, PREP, and REL showed a steady increase, ADJP showed an obvious decline, while ADV and SUB first increased and then declined. Third, the correlation analysis revealed a competitive interaction within fine-grained measures and between large-grained and fine-grained measures.
AI snapshot
Written from the paper’s full text.
TL;DR
This longitudinal case study tracked one 11-year-old Chinese EFL learner’s English diaries over a 1-year period, using large- and fine-grained syntactic complexity measures under Dynamic Systems Theory. It found non-linear, spiral development with competition among subsystems rather than uniform growth.
Key findings
- Large-grained measures showed unstable, curved development: MLS and MLT increased obviously, MLC increased slightly, C/T and DC/T trended upward, T/S was relatively stable, and CP/C and CN/C fluctuated with opposite trends. Strong correlations appeared between MLS and MLT, and C/T correlated with MLS, MLT, DC/T, and T/S; CP/C correlated negatively with MLS, C/T, DC/T, T/S, and CN/C.
- Fine-grained measures diverged: ADJA, PREP, and REL showed upward trends; ADJP declined; ADV and SUB first increased then declined; CARD showed no obvious developmental trend. A competitive relation occurred between ADJA and ADJP.
- Correlation analysis found PREP significantly positively related to MLS (r = 0.738, P < 0.05) and MLT (r = 0.705, P < 0.05); SUB moderately related to MLS (r = 0.543, P < 0.05); PREP related to DC/T (r = 0.604, P < 0.05) and C/T (r = 0.616, P < 0.05); SUB related to DC/T (r = 0.654, P < 0.05) and C/T (r = 0.580, P < 0.05); ADJP negatively related to MLC (r = –0.288, P < 0.05) and CN/C (r = –0.324, P < 0.05).
- Qualitative reading linked peaks to rich life experiences: MLS peaked in weeks 29, 32, 45, and 51; week 45’s argumentative “Money” diary had the highest C/T and MLS, suggesting genre/topic effects even for a beginner learner.
Methods
- Longitudinal case study of Alice, a Chinese girl aged 11, based on her English diaries written over a 1-year period in 2017; the corpus comprised 20,665 words and 365 diary entries, later combined into 52 weekly text files because L2SCA requires at least 50 words per file.
- Eight large-grained syntactic complexity measures were computed with L2 Syntactic Complexity Analyzer at sentential, clausal, and phrasal levels; seven fine-grained modifier types (ADJA, CARD, ADJP, ADV, PREP, SUB, REL) were manually annotated by two English instructors, with Cohen’s kappa = 0.91 and discrepancies resolved through discussion.
- Development trajectories were described using Excel trend lines, and correlation/clustering analysis was conducted with R heat maps and correlation analysis.
Limitations
- The paper states that although the study gives insight into one learner’s L2 writing development, “the generalizations cannot be extended to all EFL beginner learners.”
- The design is a single-participant case study over one year, with naturalistic diaries written without any time limit, given topic, or word limit; these features are evident from the text and limit generalizability and control over task effects.
- The large-grained analysis aggregated daily diaries into weekly files to meet L2SCA’s minimum word requirement, which is evident from the methods and may obscure within-week variation; fine-grained analysis was also restricted to seven manually annotated modifier types.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
4 of 20 cited sources checked · 4 supported · 0 flagged
- Findingown data
REL showed a steady increase.
“ADJA, PREP, and REL showed a steady increase”
Quote in the paperSubstantial claim - Findingown data
CP/C and CN/C of the phrasal structure fluctuated.
“CP/C and CN/C of the phrasal structure fluctuated and exhibited an opposite developmental trend.”
Quote in the paperNot a substantial claim- Rests on an assumption: The eight syntactic complexity indices obtained from L2SCA validly measure syntactic complexity in English writing.
- Findingown data
MLT was closely related to the change in MLS.
“and MLT was closely related to the change in MLS.”
Quote in the paperNot a substantial claim - Findingown data
The developmental process of the young Chinese EFL learner's written syntactic complexity was not linear but spiral in terms of large-grained measures.
“The results show that, first, the developmental process was not linear but spiral in terms of large-grained measures.”
Quote in the paperSubstantial claim - Findingown data
T/S was relatively stable.
“C/T and DC/T all showed an upward trend while T/S was relatively stable.”
Quote in the paperNot a substantial claim- Rests on an assumption: The eight syntactic complexity indices obtained from L2SCA validly measure syntactic complexity in English writing.
- Findingown data
A strong correlation was found between MLS and MLT.
“A strong correlation was found between MLS and MLT, and a strong correlation between C/T index with MLS, MLT, DC/T, and T/S was revealed.”
Quote in the paperNot a substantial claim- Rests on an assumption: The eight syntactic complexity indices obtained from L2SCA validly measure syntactic complexity in English writing.
- Findingown data
The dynamic features of fine-grained measures are prominent in the seven indicators.
“Second, the dynamic features of fine-grained measures are also prominent in the seven indicators.”
Quote in the paperSubstantial claim - Findingown data
Correlation analysis revealed a competitive interaction between large-grained and fine-grained measures.
“Third, the correlation analysis revealed a competitive interaction within fine-grained measures and between large-grained and fine-grained measures.”
Quote in the paperSubstantial claim - Findingown data
SUB first increased and then declined.
“while ADV and SUB first increased and then declined.”
Quote in the paperSubstantial claim - Findingown data
PREP showed a steady increase.
“ADJA, PREP, and REL showed a steady increase”
Quote in the paperSubstantial claim - Findingown data
A strong correlation was found between C/T index and MLS, MLT, DC/T, and T/S.
“A strong correlation was found between MLS and MLT, and a strong correlation between C/T index with MLS, MLT, DC/T, and T/S was revealed.”
Quote in the paperNot a substantial claim- Rests on an assumption: The eight syntactic complexity indices obtained from L2SCA validly measure syntactic complexity in English writing.
- Findingown data
CARD showed no obvious development trend.
“CARD showed no obvious development trend.”
Quote in the paperNot a substantial claim - Findingown data
MLS shows four consecutive peaks at week 29, week 32, week 45, and week 51.
“The MLS shows four consecutive peaks (week 29, week 32, week 45, and week 51)”
Quote in the paperSubstantial claim - Findingown data
The eight measures of syntactic complexity indicate that the changes in both peak and regression were unstable during the process of development.
“The eight measures of syntactic complexity indicate that the changes in both peak and regression were unstable during the process of development (see Figure 1).”
Quote in the paperSubstantial claim- Rests on an assumption: The eight syntactic complexity indices obtained from L2SCA validly measure syntactic complexity in English writing.
- Findingown data
Different modifiers showed different development trends.
“The data reveal that different modifiers showed different development trends (see Figure 3).”
Quote in the paperSubstantial claim - Findingown data
The sentential level varied in the young learner's development.
“The sentential level varied”
Quote in the paperSubstantial claim - Findingown data
C/T and MLS reached the highest peak in week 45.
“C/T and MLS reached the highest peak in week 45.”
Quote in the paperSubstantial claim - Findingown data
There is a significant negative relationship among ADJP, MLC and CN/C (rmlc-adjp = -0.288, P < 0.05; rcn/c-adjp = -0.324, P < 0.05).
“There is a significant negative relationship among ADJP, MLC and CN/C (rmlc–adjp = –0.288, P < 0.05; rcn/c–adjp = –0.324, P < 0.05).”
Quote in the paperNot a substantial claim - Findingown data
CP/C and CN/C exhibited an opposite developmental trend.
“CP/C and CN/C of the phrasal structure fluctuated and exhibited an opposite developmental trend.”
Quote in the paperNot a substantial claim- Rests on an assumption: The eight syntactic complexity indices obtained from L2SCA validly measure syntactic complexity in English writing.
- Findingown data
A slight increase in the MLC during the development process was observed.
“The increase in MLS and MLT was obvious, while a slight increase in the MLC during the development process was observed.”
Quote in the paperNot a substantial claim- Rests on an assumption: The eight syntactic complexity indices obtained from L2SCA validly measure syntactic complexity in English writing.
- Findingown data
The increase in MLS and MLT was obvious during the development process.
“The increase in MLS and MLT was obvious, while a slight increase in the MLC during the development process was observed.”
Quote in the paperNot a substantial claim- Rests on an assumption: The eight syntactic complexity indices obtained from L2SCA validly measure syntactic complexity in English writing.
- Findingown data
In the week 45 diary, Alice used subordination, coordination, and more complex syntactic structures such as a preposition + what-clause, which is different from other daily narrative entries without topic in the corpus.
“She used subordination, coordination, more complex syntactic structures such as a preposition + what-clause in this entry, which is different from other daily narrative entries without topic in the corpus”
Quote in the paperSubstantial claim - Findingown data
ADJP showed an obvious decline.
“ADJP showed an obvious decline”
Quote in the paperSubstantial claim - Findingown data
There is a significant high positive relationship among PREP, MLS, and MLC (rprep-mls = 0.738, P < 0.05; rprep-mlt = 0.705, P < 0.05).
“There is a significant high positive relationship among PREP, MLS, and MLC (rprep–mls = 0.738, P < 0.05; rprep–mlt = 0.705, P < 0.05).”
Quote in the paperNot a substantial claim - Findingown data
CP/C correlated negatively with the other indices including MLS, C/T, DC/T, T/S, and CN/C.
“CP/C and the other indices including MLS, C/T, DC/T, T/S, and CN/C correlated negatively, indicative of a state of competition between them in the development process.”
Quote in the paperSubstantial claim- Rests on an assumption: The eight syntactic complexity indices obtained from L2SCA validly measure syntactic complexity in English writing.
- Findingown data
ADV first increased and then declined.
“while ADV and SUB first increased and then declined.”
Quote in the paperSubstantial claim - Findingown data
ADV and SUB showed an upward trend and then a downward trend.
“ADV and SUB showed an upward trend and then a downward trend;”
Quote in the paperNot a substantial claim - Findingown data
ADJA showed a steady increase.
“ADJA, PREP, and REL showed a steady increase”
Quote in the paperSubstantial claim - Findingown data
ADJP showed a downward trend.
“ADJP showed a downward trend;”
Quote in the paperNot a substantial claim - Findingown data
Correlation analysis revealed a competitive interaction within fine-grained measures.
“Third, the correlation analysis revealed a competitive interaction within fine-grained measures and between large-grained and fine-grained measures.”
Quote in the paperSubstantial claim - Findingown data
The three measures (MLS, MLT, DC/T) showed an obvious upward trend according to the polynomial trend line.
“According to the polynomial trend line, the three measures showed an obvious upward trend.”
Quote in the paperSubstantial claim - Findingreasoning
The frequency of numerals changed little over the whole observation period.
“Therefore, the variation can be seen from the polynomial trend that the frequency of numerals changed little over the whole observation period.”
Quote in the paperNot a substantial claim - Findingreasoning
Changes in T/S and MLC were almost negligible compared to MLS and MLT in Alice's writing development.
“The changes in T/S and MLC were almost negligible as compared to MLS and MLT.”
Quote in the paperSubstantial claim - Findingown data
Alice took some modifiers as schematic or fixed chunks, such as "go back home," "really good," "a bit tired," "a lot better," and "very funny."
“the participant took some modifiers as schematic or fixed chunks, such as “go back home,” “really good,” “a bit tired,” “a lot better,” and “very funny,””
Quote in the paperSubstantial claim - Findingreasoning
REL rose very slowly.
“REL rose very slowly”
Quote in the paperNot a substantial claim - Findingown data
Alice rarely used sentence adverbs such as occasionally, actually, and alone.
“while sentence adverbs like occasionally, actually, and alone were rarely used.”
Quote in the paperNot a substantial claim - Findingreasoning
Cardinal words show a steady development trend with little variation in Alice's corpus.
“Cardinal words, having a function similar to ADJA in grammar and playing a role in modifying and defining nouns, show a steady development trend with little variation in the corpus.”
Quote in the paperNot a substantial claim - Findingown data
In Alice's corpus, the frequency of ADJA increased significantly over time.
“while the ADJA increased significantly”
Quote in the paperSubstantial claim - Findingreasoning
During the 1-year observation period, MLC showed slight fluctuations at several instances from a relatively stable state.
“During the 1-year observation period, slight fluctuations in the MLC were observed at several instances from a relatively stable state.”
Quote in the paperSubstantial claim - Findingown data
An inverse relationship was observed between ADJP and ADJA over time: when adjective modifiers increased, predicative adjectives or adverbial adjectives decreased.
“The inverse relationship was further observed between ADJP and ADJA over time. That is, when the adjective modifiers increased in the learner’s writing, the predicative adjectives or adverbial adjectives decreased.”
Quote in the paperSubstantial claim - Findingown data
Seven indicators besides C/T and MLS were significantly higher in the data.
“Seven indicators besides C/T and MLS were significantly higher in the data”
Quote in the paperSubstantial claim - Interpretationown data
The negative correlation between CP/C and the other indices is indicative of a state of competition between them in the development process.
“CP/C and the other indices including MLS, C/T, DC/T, T/S, and CN/C correlated negatively, indicative of a state of competition between them in the development process.”
Quote in the paperSubstantial claim- Rests on an assumption: The eight syntactic complexity indices obtained from L2SCA validly measure syntactic complexity in English writing.
- Interpretationreasoning
The development of writing shows dynamic non-linear and unpredictable complexity characteristics.
“The indicators of large-grained and fine-grained measures in the writing development were found to be interrelated and affected the coordination and competition in the development process, highlighting the dynamic non-linear and unpredictable complexity characteristics of writing development.”
Quote in the paperSubstantial claim - Interpretationown data
The development process of the young learner is different from Chinese English learners studying in colleges.
“the development process of the young learner is different from Chinese English learners studying in colleges.”
Quote in the paperSubstantial claim - Interpretationown data
The indicators of large-grained and fine-grained measures affected the coordination and competition in the development process.
“The indicators of large-grained and fine-grained measures in the writing development were found to be interrelated and affected the coordination and competition in the development process, highlighting the dynamic non-linear and unpredictable complexity characteristics of writing development.”
Quote in the paperSubstantial claim - Interpretationown data
The indicators of large-grained and fine-grained measures in the writing development were interrelated.
“The indicators of large-grained and fine-grained measures in the writing development were found to be interrelated and affected the coordination and competition in the development process, highlighting the dynamic non-linear and unpredictable complexity characteristics of writing development.”
Quote in the paperSubstantial claim - Interpretationown data
An increase in the length of production in Alice's diary is attributable to a vacation full of rich and colorful activities, compared to periods of routine daily life.
“In this study, an increase in the length of production evident from Alice’s diary is indicative of an obvious increase due to a vacation that was full of rich and colorful activities, as compared to other periods of routine daily life.”
Quote in the paperSubstantial claim - Interpretationown data
Genre differences causing differences in syntactic complexity can explain the writing performance of young beginner learners as well.
“verifying that genre differences causing differences in syntactic complexity can explain to the writing performance of young beginner learners as well.”
Quote in the paperSubstantial claim - Premisecitation
High frequency of use of predicate adjectives is related to lower second language proficiency.
“Hinkel (2002) found that high frequency of use of predicate adjectives was related to lower second language proficiency”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Hinkel (2002) source
- Interpretationown data
The developmental process of the young learner is inevitably accompanied with variability and interplay in terms of subsystems in syntactic complexity.
“Taken together, the developmental process of the young leaner is inevitably accompanied with variability and interplay in terms of subsystems in syntactic complexity.”
Quote in the paperSubstantial claim - Interpretationnone given
The slow rise of REL is due to the absence of corresponding classroom input of relative clauses in elementary school in China.
“REL rose very slowly due to the absence of corresponding classroom input of relative clauses in the elementary school in China.”
Quote in the paperNot a substantial claim- Rests on an assumption: Elementary school English instruction in China does not include relative clauses.
- Interpretationcitation
The inverse relationship between ADJP and ADJA is indicative of interaction in dynamic systems.
“This is indicative of the interaction in the dynamic systems”
Quote in the paperSubstantial claim - Premisecitation
Even advanced English learners are obviously less likely to use adverbs than native speakers.
“because even advanced English learners are obviously less likely to use adverbs than native speakers.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Jiang et al. (2019) source
- Interpretationreasoning
Input plays a key role in the development of learners' language.
“The input provided plays a key role in the development of language of the learners.”
- Also stated in: § Discussion and conclusion · plain
“First, input plays a significant role in the learner’s language development”
Quote in the paperSubstantial claim - Also stated in: § Discussion and conclusion · plain
- Premisecitation
More energy is needed to push a stable MLC system out of attractor states by external perturbations such as classroom input, reading, or immersion in an English environment.
“At this moment more energy is needed to push it out of the attractor states by perturbations outside, such as input in class, reading, immersion in English environment, etc.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites de Bot et al., 2005 source
- Interpretationreasoning
Alice's negligible increase in MLC and T/S is attributable to her elementary school English instruction being restricted to simple sentences with no clause practice.
“As a beginner English learner, Alice’s classroom English learning in elementary school was restricted to simple sentences, with no practice of clauses, leading to a negligible increase in MLC and T/S.”
Quote in the paperSubstantial claim- Rests on an assumption: Alice's elementary school English learning was restricted to simple sentences and did not include practice with clauses.
- Interpretationown data
Alice's adverb usage lacked diversity.
“and thus adverb usage lacked diversity.”
Quote in the paperNot a substantial claim - Interpretationreasoning
The generalizations from this study cannot be extended to all EFL beginner learners.
“Although the present study has provided us insight in L2 writing developmental paths of one particular learner, the generalizations cannot be extended to all EFL beginner learners.”
Quote in the paperSubstantial claim
- Classified as probably not a substantial claim. 22
- May combine two claims. 25
- The quote only partly states this claim. 2
Classified as probably not a substantial claim. May combine two claims.
PremisecitationDynamic Systems Theory works at the system level and explains the system's behavior, not at the elemental level.
“DST works at the system level and explains the system’s behavior, not at the elemental level (Larsen-Freeman and Cameron, 2008).”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Larsen-Freeman and Cameron, 2008 source
Classified as probably not a substantial claim.
PremisecitationFrom a Dynamic Systems Theory perspective, language development is a complex system containing many subsystems that interact, are interconnected, and are interdependent.
“From this perspective, language development is considered a complex system which contains many subsystems that interact, are interconnected, and are interdependent.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Larsen-Freeman and Cameron, 2008 source
Classified as probably not a substantial claim.
PremisecitationSeveral studies have recommended that much narrower measures are needed to capture L2 learners' writing development.
“Besides the large-grained measures, several studies have recommended that much narrower measures are needed to capture L2 learners’ writing development (e.g., Biber et al., 2011; Mazgutova and Kormos, 2015).”
Quote in the paperSubstantial claim1 of 2 sources checkedProbably not a substantial claim: may not pass S2 (checkable).
PremisecitationThe approach of using fine-grained measures is helpful in understanding the types of detailed structures learners expand in the sentences.
“The approach of using fine-grained measures is helpful in understanding the types of detailed structures learners expand in the sentences (Kyle and Crossley, 2018).”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Kyle and Crossley, 2018 source
May combine two claims.
Findingown dataThere is a moderate positive relationship among SUB, MLS and MLC (rsub-mls = 0.543, P < 0.05; rprep-mlt = 0.544, P < 0.05).
“There is a moderate positive relationship among SUB, MLS and MLC (rsub–mls = 0.543, P < 0.05; rprep–mlt = 0.544, P < 0.05).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataADJA, PREP, and REL showed an upward trend.
“ADJA, PREP, and REL showed an upward trend;”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataWhen the participant used more Subject + verb + predicative structures (SVP) simple sentence structures, the MLSs, T-units, and clauses tended to decrease, and noun phrases were rarely used.
“When the participant used more Subject + verb + predicative structures (SVP) simple sentence structures, the MLSs, T-units, and clauses tended to decrease, and noun phrases were rarely used.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Findingown dataIn week 45, Alice wrote a diary titled Money, listing specific examples of daily consumption of her peers and expressing disapproval of excessive spending and high consumption.
“While reading the corpus of the 45th week, I found that Alice wrote one diary titled Money, listing specific examples of daily consumption of her peers and expressing her disapproval of excessive spending and high consumption.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Findingown dataIn week 51, when Christmas, New Year's Day, and her mother's birthday were approaching, Alice described in detail how she prepared birthday gifts and how much she looked forward to Christmas and New Year holiday.
“In week 51, when Christmas, New Year’s Day, and her mother’s birthday were approaching, Alice described in detail how she prepared birthday gifts and how much she looked forward to Christmas and New Year holiday.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Findingown dataIn week 29, Alice had gone on a trip with her family during the summer vacation and described what she saw and felt on the way to the destination.
“On reading the diary entries for week 29, I found that Alice had gone on a trip with her family during the summer vacation. She described what she saw and felt on the way to the destination.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataC/T and DC/T showed an upward trend.
“C/T and DC/T all showed an upward trend while T/S was relatively stable.”
Quote in the paperNot a substantial claim- Rests on an assumption: The eight syntactic complexity indices obtained from L2SCA validly measure syntactic complexity in English writing.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataThe graph representing the growth and decline trends are curved, and reflect obvious dynamic characteristics.
“The graph representing the growth and decline trends are curved, and reflect obvious dynamic characteristics.”
Quote in the paperNot a substantial claim- Rests on an assumption: The eight syntactic complexity indices obtained from L2SCA validly measure syntactic complexity in English writing.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingnone givenIn week 32, Alice attended badminton training class and described her experience during the game, including how to play well under the guidance of the coach.
“In week 32, Alice attended badminton training class, and described her experience during the game (i.e., how to play well under the guidance of the coach).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataPREP and SUB were found to be moderately correlated with DC/T and C/T (rprep-dc/t = 0.604, P < 0.05; rprep-c/t = 0.616, P < 0.05; rsub-dc/t = 0.654, P < 0.05; rsub-c/t = 0.580, P < 0.05).
“PREP and SUB were found to be moderately correlated with DC/T and C/T (rprep–dc/t = 0.604, P < 0.05; rprep–c/t = 0.616, P < 0.05; rsub–dc/t = 0.654, P < 0.05; rsub–c/t = 0.580, P < 0.05).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Findingnone givenSyntactic modifiers are used in beginner young learners' syntax in the written output.
“Besides, syntactic modifiers are used in beginner young learners’ syntax in the written output”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe frequency of both PREP and REL increased over time, as in the case of ADJA.
“The frequency of both PREP and REL increased as in the case of ADJA.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataPREP curves were steeper and exhibited an early rise, and prepositional phrases were used more frequently.
“The PREP curves were steeper and exhibited an early rise, and prepositional phrases were found to be used more frequently.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe frequency of ADV adverb usage was almost zero in the first 6 weeks but increased significantly with the passage of time.
“The frequency of ADV adverb usage was almost zero in the first 6 weeks but increased significantly with the passage of time.”
Quote in the paperNot a substantial claimMay combine two claims. The quote only partly states this claim.
Findingown dataIn Alice's corpus, the frequency of ADJP ranked higher than the other fine-grained indicators but decreased gradually over time.
“As evident from Figure 3, the frequency of ADJP in learners’ corpus ranked higher than the other fine-grained indicators but decreased gradually over time”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataThe increase in the length of sentences and of the T-units takes place not only through expansion at the phrasal level via the use of prepositional phrases but also through expansion at the clausal level via adverbial clauses by adding adjuncts (of time, place, etc.).
“The correlation results indicate that the increase in the length of sentences and of the T-units takes place not only through expansion at the phrasal level via the use of prepositional phrases but also through expansion at the clausal level via adverbial clauses by adding adjuncts (of time, place, etc.).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationAccording to Wolfe-Quintero et al. (1998), correlation greater than 0.650 is a strong correlation, 0.450-0.650 is a moderate correlation, and less than 0.450 is a weak correlation.
“According to Wolfe-Quintero et al. (1998), correlation greater than 0.650 is a strong correlation, 0.450–0.650 is a moderate correlation, and less than 0.450 is a weak correlation.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Wolfe-Quintero et al. (1998)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim.
Interpretationown dataThe use of complex syntactic structures in the week 45 diary is reflective of Alice's attempt to state her stand with regard to daily expenses, while discussing and asserting her viewpoint supplemented with examples.
“and is reflective of her attempt to state her stand with regard to daily expenses, while discussing and asserting her viewpoint supplemented with examples”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
PremisecitationThere are significant differences between MLS, MLT, and DC/T in the writing of beginners and intermediate English learners.
“According to the findings of Jiang et al. (2019), there are significant differences between MLS, MLT, DC/T in the writing of beginners and intermediate English learners.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Jiang et al. (2019) source
Classified as probably not a substantial claim.
PremisecitationUsage of different modifiers can serve as developmental indicators for young beginner learners progressing from pre-attributive modifiers to post-phrasal and clausal modifiers.
“Jiang et al. (2019) found that usage of different modifiers can serve as developmental indicators for the young beginner learners progressing from pre-attributive modifiers to post-phrasal and clausal modifiers.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Jiang et al. (2019) source
Classified as probably not a substantial claim.
PremisecitationLu (2011) found that syntactic complexity in argumentative essays, which need more causal reasoning, is higher than in narrative essays.
“Lu (2011) found the syntactic complexity in argumentative essays which needed more causal reasoning are higher than that in narrative essays.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Lu (2011)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThese types of modifiers can be included in the basic list of grammatical modifiers.
“According to Vyatkina et al. (2015), these types of modifiers can be included in the basic list of grammatical modifiers.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Vyatkina et al. (2015) source
Classified as probably not a substantial claim.
PremisecitationVyatkina et al. (2015) investigated the written output in the writing of English of beginner learners of German using seven indicators: ADJA, CARD, ADJP, ADV, PREP, SUB, and REL.
“Vyatkina et al. (2015) investigated the written output in the writing of English of beginner learners of German using seven indicators an adjective placed before a noun, ordinal numerals are indicated (ADJA), cardinal numeral (CARD), predicative adjective, adverbial adjective (ADJP), adverbs (ADV), prepositional phrases (PREP), subordinate (SUB), and relative clause (REL).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Vyatkina et al. (2015) source
Classified as probably not a substantial claim. May combine two claims.
PremisecitationComplexity can be viewed as an index of language development and progress, and as a valid and basic descriptor of second language performance in L2 research.
“Bulté and Housen (2014) have stated that complexity can be viewed as an index of language development and progress, being treated as a valid and basic descriptor of second language performance in L2 research.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Bulté and Housen (2014) source
The quote only partly states this claim.
Study design and conductown dataThe interrater reliability for the manual annotation of the seven types of modifiers in the corpus, measured by Cohen's kappa, was 0.91.
“The interrater reliability was measured by using Cohen’s kappa, which had the value 0.91”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
PremisecitationChildren's language development is the product of the interaction between their innate psychological cognitive ability and objective experience.
“Children’s language development is the product of the interaction between their innate psychological cognitive ability and objective experience.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Piaget (1997)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim. May combine two claims.
Study design and conductnone givenThe daily diary represented completely natural English output spontaneously written without any time limit, without any given topic, and word limit.
“The daily diary represented the completely natural English output spontaneously written without any time limit, without any given topic, and word limit.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataDuring the observation period, a competitive relation occurs between ADJA and ADJP subsystems, such that growth of ADJA is usually accompanied by a decrease in the usage of ADJP.
“During the observation period, a competitive relation occurs between ADJA and ADJP subsystems.”
- Also stated in: § Fine-grained measures · plain
“That is, the growth of ADJA is usually accompanied by a decrease in the usage of ADJP.”
Quote in the paperNot a substantial claim- Also stated in: § Fine-grained measures · plain
May combine two claims.
InterpretationreasoningThe interaction between Alice's life experience and her psychological cognitive ability directly encodes experience into word representations, enriching sentence expression and leading to an increase in the length of sentences and clauses.
“Owing to the interaction between Alice’s own life experience and her psychological cognitive ability, it is directly encoded into her thinking and is transformed from experience into word representations; thus the sentence expression is enriched, and an increase in the length of sentences and clauses can be observed.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
PremisecitationPiaget (1997) emphasized the relationship between children's language development and their active experiences in his theory of cognitive development.
“Piaget (1997) emphasized the relationship between children’s language development and their active experiences in his theory of cognitive development.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Piaget (1997)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Interpretationown dataBoth the global measures of syntactic complexity, MLS, MLT, DC/T, and CN/C, and the more specific indices of syntactic modifiers, ADJP, ADJA, ADV, SUB, and PREP, can capture the syntactic development changes of the beginner level learners.
“Based on the above correlation analysis, it was found that both the global measures of syntactic complexity, MLS, MLT, DC/T, and CN/C, and the more specific indices of syntactic modifiers, ADJP, ADJA, ADV, SUB, and PREP, can capture the syntactic development changes of the beginner level learners.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningIn case of insufficient input, the MLC system failed to get out of the attractor states with fluctuations; thus, the whole development appeared stable.
“In case of insufficient input, the MLC system failed to get out of the attractor states with fluctuations; thus, the whole development appeared stable.”
Quote in the paperSubstantial claim- Rests on an assumption: Chinese primary school English curriculum is limited to the alphabet and simple daily communication.
- Rests on an assumption: Chinese primary school students are not required to do writing work as part of school learning.
- Rests on an assumption: Chinese English classes have limited teaching hours and there is very limited access to the target language outside the classroom.
May combine two claims.
PremisecitationThe use of adverbs is a strong discriminator of different proficiency levels or indicator of language development.
“The use of adverbs is a strong discriminator of different proficiency levels or indicator of language development”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Jiang et al. (2019) source
May combine two claims.
PremisecitationSome subsystems in dynamic systems support each other while others compete for limited resources, and the development of one leads to the retreat of the other.
“Some subsystems support each other while others compete for limited resources, and the development of one leads to the retreat of the other (Van Geert, 1991).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Van Geert, 1991 source
Probably not a substantial claim: may not pass S3 (load-bearing).
InterpretationcitationThe finding is in line with Yang et al. (2015), who found that topic had a significant effect on syntactic complexity features.
“This is also in line with the results reported by Yang et al. (2015), who found that topic had a significant effect on syntactic complexity features.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Yang et al. (2015) source
May combine two claims.
Interpretationown dataAlice's usage of basic English syntactic structures was reduced while more varied syntactic structures were gradually increasing during the dynamic developmental process.
“indicating that the participant’s usage of basic English syntactic structures was reduced while more varied syntactic structures were gradually increasing in the dynamic developmental process.”
Quote in the paperSubstantial claim
The paper relies on this without support.
Adolescents constitute the main body of beginner and intermediate learners.
“Adolescents constitute the main body of beginner and intermediate learners”
The paper relies on this without support.
Adolescents differ from adult learners in cognition and emotions.
“and are surely different from adult learners in their cognition and emotions.”
The paper relies on this without support.
Empirical studies on the development in writing of L2 young learners based on Dynamic Systems Theory are rare.
“empirical studies on the development in writing of L2 young learners based on DST are rare.”
The paper relies on this without support.
German and English are similar and both belong to the Indo-European language family.
“Considering the similarity between the German and English language, and as both belong to the Indo-European language family”
The paper relies on this without support.
The eight syntactic complexity indices obtained from L2SCA validly measure syntactic complexity in English writing.
“Eight syntactic complexity indices for each written text file were obtained and an Excel file of the data was prepared.”
The paper relies on this without support.
Alice's elementary school English learning was restricted to simple sentences and did not include practice with clauses.
“As a beginner English learner, Alice’s classroom English learning in elementary school was restricted to simple sentences, with no practice of clauses”
The paper relies on this without support.
Chinese primary school English curriculum is limited to the alphabet and simple daily communication.
“Although Chinese students start English learning at the primary school, the English curriculum is actually limited to the alphabet and simple daily communication.”
The paper relies on this without support.
Chinese primary school students are not required to do writing work as part of school learning.
“They are not required to do writing work as part of school learning.”
The paper relies on this without support.
Chinese English classes have limited teaching hours and there is very limited access to the target language outside the classroom.
“Furthermore, limited teaching hours are devoted to English classes in the weekly teaching schedule and there is very limited access to the target language outside the classroom.”
The paper relies on this without support.
Elementary school English instruction in China does not include relative clauses.
“due to the absence of corresponding classroom input of relative clauses in the elementary school in China”
The paper relies on this without support.
Numerals are mostly used in descriptive writing such as science and technology.
“Numerals are mostly used in descriptive writing such as science and technology.”
The paper relies on this without support.
Different genres and topics can cause differences in syntactic complexity.
“different genres and topics can cause differences in syntactic complexity”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Phrasal measures use different denominators
MajorTable 1 defines CP/C and CN/C per clause, but the Metrics text describes the two selected phrasal measures as CP/T and CN/T, per T-unit. These are different measures.
“| | Phrasal | CP/C | Number of coordinate phrases per clause | | | | CN/C | Number of complex noun phrases per clause |”
“Two sets of measures of phrasal syntactic complexity were chosen: Coordinate Phrases per T-Unit (CP/T) and Complex Noun Phrases per T-Unit (CN/T).”
A correlation called moderate exceeds the stated strong threshold
MinorThe SUB-DC/T correlation of 0.654 is included among correlations called moderate, although the paper defines correlations greater than 0.650 as strong.
“PREP and SUB were found to be moderately correlated with DC/T and C/T (rprep–dc/t = 0.604, P < 0.05; rprep–c/t = 0.616, P < 0.05; rsub–dc/t = 0.654, P < 0.05; rsub–c/t = 0.580, P < 0.05).”
“correlation greater than 0.650 is a strong correlation, 0.450–0.650 is a moderate correlation”
The second purported 7-day period spans eight dates
MinorThe text says entries were combined into 7-day periods, but its example for week 2 runs from January 8 through January 15, an inclusive span of eight days.
“the entries for each 7-day period of the diary were combined into one file”
“from 8 to 15 January 2017, the diary texts were synthesized and named 2017 week2.txt”
PREP-MLT correlation is reported with two values
MinorThe same correlation label, rprep-mlt, is assigned both 0.705 and 0.544 in successive sentences. At least one reported correlation value or label is wrong.
“rprep–mlt = 0.705, P < 0.05”
“rprep–mlt = 0.544, P < 0.05”
Cites
Towards an Organic Approach to Investigating CAF in Instructed SLA: The Case of Complexity
Norris, J. M., & Ortega, L. (2009) · Applied Linguistics · doi:10.1093/applin/amp044 · Cited by 1,258 · see citing works
Automatic analysis of syntactic complexity in second language writing
Lu, X. (2010) · International Journal of Corpus Linguistics · doi:10.1075/ijcl.15.4.02lu · Cited by 1,053 · cited 2× · see citing works
“Therefore, a few syntactic complexity measures were selected for this study based on Lu (2011) to gauge the complexity of syntactic organization by L2 Syntactic Complexity Analyzer (hereafter L2SCA; Lu, 2010) at the sentential, clausal and phrasal levels (refer to Table 1).”
MethodSecond Language Development in Writing: Measures of Fluency, Accuracy and Complexity
Broussard, K. M., Wolfe-Quintero, K., Inagaki, S., & Kim, H.-Y. (2001) · TESOL Quarterly · doi:10.2307/3587656 · Cited by 913 · cited 1× · see citing works
“According to Wolfe-Quintero et al. (1998), correlation greater than 0.”
Larsen-Freeman, D. (2006) · Applied Linguistics · doi:10.1093/applin/aml029 · Cited by 805 · cited 1× · see citing works
“…and variations of learners’ language production from a multi-dimensional perspective by analyzing different variables that support or compete with each other to discover the factors that influence L2 development (e.g., Larsen-Freeman, 2006; Verspoor et al., 2008, 2012; Vyatkina et al., 2015).”
BackgroundBIBER, D., GRAY, B., & POONPON, K. (2011) · TESOL Quarterly · doi:10.5054/tq.2011.244483 · Cited by 804 · see citing works
Lu, X. (2011) · TESOL Quarterly · doi:10.5054/tq.2011.240859 · Cited by 788 · cited 3× · see citing works
“Lu (2011) found the syntactic complexity in argumentative essays which needed more causal reasoning are higher than that in narrative essays.”
BackgroundMethodResultConceptualizing and measuring short-term changes in L2 writing complexity.
Bulté, B., & Housen, A. (2014) · Journal of Second Language Writing · doi:10.1016/j.jslw.2014.09.005 · Cited by 474 · cited 2× · see citing works
“Bulté and Housen (2014) have stated that complexity can be viewed as an index of language development and progress, being treated as a valid and basic descriptor of second language performance in L2 research.”
BackgroundMethodA dynamic systems model of cognitive and language growth.
van Geert, P. (1991) · Psychological Review · doi:10.1037/0033-295x.98.1.3 · Cited by 464 · cited 1× · see citing works
“This is indicative of the interaction in the dynamic systems: Some subsystems support each other while others compete for limited resources, and the development of one leads to the retreat of the other (Van Geert, 1991).”
BackgroundMeasuring Syntactic Complexity in L2 Writing Using Fine‐Grained Clausal and Phrasal Indices
KYLE, K., & CROSSLEY, S. A. (2018) · The Modern Language Journal · doi:10.1111/modl.12468 · Cited by 405 · cited 1× · see citing works
“The approach of using fine-grained measures is helpful in understanding the types of detailed structures learners expand in the sentences (Kyle and Crossley, 2018).”
Variability in Second Language Development From a Dynamic Systems Perspective
Verspoor, M. H., Lowie, W. M., & van Dijk, M. (2008) · Modern Language Journal · doi:10.1111/j.1540-4781.2008.00715.x · Cited by 368 · cited 1× · see citing works
“…and variations of learners’ language production from a multi-dimensional perspective by analyzing different variables that support or compete with each other to discover the factors that influence L2 development (e.g., Larsen-Freeman, 2006; Verspoor et al., 2008, 2012; Vyatkina et al., 2015).”
BackgroundResearch methodology on language development from a complex systems perspective
FREEMAN, D. L., & CAMERON, L. (2008) · The Modern Language Journal · doi:10.1111/j.1540-4781.2008.00714.x · Cited by 363 · cited 1× · see citing works
“DST works at the system level and explains the system’s behavior, not at the elemental level (Larsen-Freeman and Cameron, 2008).”
BackgroundYang, W., Lu, X., & Weigle, S. C. (2015) · Journal of Second Language Writing · doi:10.1016/j.jslw.2015.02.002 · Cited by 349 · cited 2× · see citing works
“Large-grained measures With respect to the syntactic complexity measures mentioned and established by earlier researchers, the present study follows Norris and Ortega (2009) and other recommendations reported in the literature (e.g., Bulté and Housen, 2014; Yang et al., 2015; Yoon and Polio, 2017) to examine syntactic…”
BackgroundResultThe Linguistic Development of Students of English as a Second Language in Two Written Genres
Yoon, H., & Polio, C. G. (2016) · TESOL Quarterly · doi:10.1002/tesq.296 · Cited by 321 · cited 1× · see citing works
“Large-grained measures With respect to the syntactic complexity measures mentioned and established by earlier researchers, the present study follows Norris and Ortega (2009) and other recommendations reported in the literature (e.g., Bulté and Housen, 2014; Yang et al., 2015; Yoon and Polio, 2017) to examine syntactic…”
ResultA dynamic usage based perspective on L2 writing
Verspoor, M. H., Schmid, M., & Xu, X.-Y. (2012) · Journal of Second Language Writing · doi:10.1016/j.jslw.2012.03.007 · Cited by 272 · see citing works
Second Language Writers' Text: Linguistic and Rhetorical Features
Hinkel, E. (2002) · doi:10.4324/9781410602848 · Cited by 240 · cited 1× · see citing works
“Hinkel (2002) found that high frequency of use of predicate adjectives was related to lower second language proficiency, while high frequency of attributive adjectives was related to higher second language proficiency.”
BackgroundSecond Language Acquisition: An Advanced Resource Book
Bot, K. D. (2005) · doi:10.4324/9780203446416 · Cited by 210 · see citing works
Syntactic and lexical development in an intensive English for academic purposes programme.
Mazgutova, D., & Kormos, J. (2015) · Journal of Second Language Writing · doi:10.1016/j.jslw.2015.06.004 · Cited by 209 · cited 1× · see citing works
“Fine-grained measures Besides the large-grained measures, several studies have recommended that much narrower measures are needed to capture L2 learners’ writing development (e.g., Biber et al., 2011; Mazgutova and Kormos, 2015).”
BackgroundJiang, J., Bi, P., & Liu, H. (2019) · Journal of Second Language Writing · doi:10.1016/j.jslw.2019.100666 · Cited by 109 · cited 4× · see citing works
“The use of adverbs is a strong discriminator of different proficiency levels or indicator of language development, for which reason Jiang et al. (2019) suggest adding adverb modifiers to the fine-grained indicators to investigate the characteristics of linguistic development, because even advanced English learners are…”
BackgroundInfluentialLu, X., Casal, J. E., & Liu, Y. (2019) · Journal of English for Academic Purposes · doi:10.1016/j.jeap.2019.100832 · Cited by 100 · cited 1× · see citing works
“The present study focuses on syntactic complexity as defined as “the degree of variation, sophistication, and elaboration of the syntactic structures used in language production” (Lu et al., 2020).”
BackgroundVyatkina, N., Hirschmann, H., & Golcher, F. (2015) · Journal of Second Language Writing · doi:10.1016/j.jslw.2015.06.006 · Cited by 70 · cited 1× · see citing works
“Researchers have been trying to explore the development and variations of learners’ language production from a multi-dimensional perspective by analyzing different variables that support or compete with each other to discover the factors that influence L2 development (e.g., Larsen-Freeman, 2006; Verspoor et al., 2008,…”
BackgroundTheorizing advancedness, setting up the longitudinal research agenda
Ortega, L., & Byrnes, H. (2009) · Routledge eBooks · doi:10.4324/9780203871652-24
Flagged first, then by citations
Research works printed but not linked: 2
- Hou, 2019, A diachronic study on the development trajectory of English writing ability of Chinese engineering college students., Chin. J. Foreign Lang., 16, 62
- Piaget, 1997, Principles of Generative Epistemology.
Cited by
Sorted by citations
Shen, C., Guo, J., Shi, P., Qu, S., & Tian, J. (2023) · PLoS ONE · doi:10.1371/journal.pone.0292688 · Cited by 21 · see citing works
Linguistic Features Distinguishing Students’ Writing Ability Aligned with CEFR Levels
Ma, H., Wang, J., & He, L. (2023) · Applied Linguistics · doi:10.1093/applin/amad054 · Cited by 10 · see citing works
Kim, M., Kim, Y., & Kang, S. (2024) · IRAL - International Review of Applied Linguistics in Language Teaching · doi:10.1515/iral-2023-0287 · Cited by 4 · see citing works
“…including lexical and syntactic complexity in L2 writing, underscoring the dynamic and non-linear nature of growth trajectories (e.g., Bulté and Housen 2018; Duan and Shi 2021; Köylü et al. 2023; Pfenninger 2020; Rokoszewska 2022; Verspoor et al. 2008; Vyatkina 2012; Wang 2022; Zheng 2016).”
InfluentialInternational Internship: Enhancing Japanese Language Skills through Workplace Experience
Karnawati, R. A., Seruni, A. P., KATAGIRI, J., et al. (2025) · Jurnal Pendidikan dan Pengajaran · doi:10.23887/jpp.v58i3.94784
Li, X., Xu, H., Song, K., et al. (2026) · Mathematics · doi:10.3390/math14183433
- Authors
- Wang, Z.
- Affiliations
- Ocean University of China (CN)
- Corresponding author
- Wang, Zhihong
- ORCID
- Wang, Zhihong
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2022-08-09
- Volume
- 13
- Pages
- 974481-974481
- ISSN
- 1664-1078 (ISSN-L)
- PMC
- PMC9396378
- OpenAlex
- W4290759694
- Semantic Scholar
- 5d04448289d1aba766729fd32dd1f419ff8729fa
- Cited by
- 5
- References
- 20
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 1 · 2023: 2
- FWCI
- 3.76
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Psychology (publishedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Shandong Office of Philosophy and Social Science
- Topics
- Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
- Social Sciences › Psychology › Developmental and Educational Psychology › Second Language Acquisition and Learning
- Social Sciences › Psychology › Developmental and Educational Psychology › Language Development and Disorders
- Keywords
- syntactic complexity, second language writing, Chinese learners of English, young learners, developmental trajectories, dynamical systems theory, relative clauses, prepositional phrases, adverbs, spiral development
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-19.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-19.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review