Cited by 14EFL/ESL Teaching and LearningSecond Language Learning and TeachingCommunication in Education and Healthcare

Teacher questions, wait time, and student output in classroom interaction in EMI science classes: An interdisciplinary view

Open access
An, Jiangshan, Childs, Ann·2023·Studies in Second Language Learning and Teaching

Abstract

Past research has often shown a lack of student output in English medium instruction (EMI) classes (e.g., An et al., 2021; Lo & Macaro, 2012) and this study seeks to identify possible reasons. Guided by literature on wait time (Rowe, 1986) and teacher higher-order thinking questions (Chin, 2007), this study explores whether these two pedagogical moves have the same impact on classroom interaction in EMI science classes. 30 EMI science lessons were recorded from seven EMI high school programs in China, taught by 15 native speakers of English to homogenous groups of Chinese students. Correlation tests showed that when there was more wait time after a teacher question, the students produced lengthier responses with more linguistic complexity, took up more talk time, and asked more questions. However, greater use of teacher higher-order thinking questions, coded by Chin’s (2007) framework of constructivist questions, did not correlate with any student output measures. This suggests that wait time may be a more effective factor leading to more student output in EMI classes than asking higher-order thinking questions. Qualitative analysis showed teachers’ follow-up moves may have also played a role in the limited success of higher-order thinking questions.

AI snapshot

Written from the paper’s full text.

TL;DR

In 28 recorded EMI high school science lessons in China taught by native-English-speaking teachers, longer wait time after teacher questions correlated with greater student output, while greater use of higher-order thinking questions did not. The authors argue wait time may be a more effective pedagogical move than higher-order questioning alone in EMI classes.

Key findings

  • Wait time averaged only 1.01 seconds per lesson, but it had significant moderate positive correlations with all four student-output measures: turn length of student responses (r = .46, p < .05), noun-verb ratio (r = -.45, p < .05), number of student questions (r = .42, p < .05), and time percentage of student talk (r = .43, p < .05).
  • Higher-order thinking questions made up 46.83% of teacher questions, but their use did not correlate significantly with any student-output measure: turn length r = -.07 (Pearson), noun-verb ratio r = .16, number of student questions r = .18, student talk time r = -.10, all p > .05.
  • Student output was generally limited: average student response turn length was 3.30 seconds, noun-verb ratio was 5.19:1, students asked 2.46 questions per lesson on average, and student talk was 10.06% of teacher-whole class interaction time.
  • Higher-order questions lacked variety: pumping was the most common type (24.61% of all teacher questions; 52.55% of higher-order questions), while constructive challenge was 0.65% and reflective toss 0.00%; recall questions were 9.75%.

Methods

  • The study recorded 30 EMI science lessons from seven foreign high school programs in China, taught by 15 native speakers of English to 308 Chinese students aged 16–18; two lessons were excluded, leaving 28 lessons for analysis.
  • Video recordings were transcribed verbatim in NVivo 11. Wait time was coded to 0.00 seconds; teacher questions were coded using Chin’s (2007) constructivist questioning framework; student output was measured by average turn length, noun-verb ratio, number of student questions, and percentage of student talk.
  • Quantitative analysis used correlation tests in SPSS (Spearman’s Rho except one Pearson correlation); qualitative analysis examined lesson transcripts and follow-up moves using Tang’s (2021) framework. Inter-rater reliability was .78 based on 10% of lessons recoded.

Limitations

  • Stated: convenience sampling was used due to accessibility, only schools granting access were recruited, and the authors note the term “native speaker teacher” is problematic though retained; they also call for more research in various contexts.
  • Stated: there were no standard exams in these programs, so students’ English proficiency was estimated from three questionnaire items; ANOVA showed no significant differences among the 15 classes on those items.
  • Evident: the design is correlational and cannot establish causation; the sample is small (15 teachers, 28 lessons), Wait Time II was not analyzed because there was little evidence of it in the data, and the coding reliability was .78.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.14746/ssllt.38283

Cites

28 of 28 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

2 of 46 cited sources checked · 1 supported · 0 flagged · accuracy not yet measured

  • Interpretationcitation

    The moderate level of correlation perhaps indicates a heightened need for wait time for students to think and phrase answers due to the dual cognitive challenges in EMI science classes.

    “The moderate level of correlation perhaps indicates a heightened need for wait time for students to think and phrase answers due to the dual cognitive challenges in EMI science classes (An & Thomas, 2021).”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites An & Thomas, 2021 source

      Section 4.3.1 (page unavailable) reports that students struggled to process science explanations in English in real time, and Section 5.2 identifies accurately phrasing questions as a major challenge. These findings support the proposed difficulty of thinking and responding in EMI science classes, but the paper does not connect a moderate correlation to a heightened need for wait time. (LLM, conf=0.82)

      Experimental — accuracy not yet measured
  • Findingown data

    Almost half, 46.83%, of teacher questions were higher-order thinking questions by Chin's definition.

    “Almost half, 46.83%, were higher-order thinking questions by Chin's (2007) definition.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Chin's (2007) source
  • Findingown data

    There were no significant differences among the 15 classes for all three English proficiency questions.

    “Results showed no significant differences among the 15 classes for all three questions.”
    Quote in the paperSubstantial claim
  • Findingown data

    In Excerpt 1, extended wait time after a higher-order thinking question was followed by an extensive student response.

    “Excerpt 1 from T7's biology lesson on plant structure demonstrates how extended wait time, after a higher-order thinking question, was followed by an extensive student response:”
    Quote in the paperSubstantial claim
  • Findingown data

    In Excerpt 2, extended wait time after a recall question also led to substantial student output with sophisticated linguistic structure.

    “Excerpt 2 from T13's biology lesson on continental drift theory demonstrates how extended wait time after a recall question also led to substantial student output with sophisticated linguistic structure:”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. 37
  • May combine two claims. 23
  • The quote only partly states this claim. 1
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    During social interaction, a learner can be assisted by a more competent other to accomplish a task which is beyond the learner's current ability.

    “During social interaction, a learner can be assisted by a more competent other to accomplish a task which is beyond the learner's current ability.This process is termed scaffolding (Wood et al., 1976).”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Wood et al., 1976 source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    On average 54.13 questions were asked by the teachers in a lesson and one teacher question occurred every 49.63 seconds during teacher-whole class interaction time.

    “As background information, on average 54.13 questions were asked by the teachers in a lesson and one teacher question occurred every 49.63 seconds during teacher-whole class interaction time.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingreasoning

    Despite the use of more higher-order thinking questions, there was a limited variety.

    “Despite the use of more higher-order thinking questions, however, there was a limited variety.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    There was a wide range of average wait time across the lessons, with a standard deviation of 1.23 seconds, indicating some degree of variation in the teachers' practices.

    “However, there was a wide range of average wait time across the lessons, as shown by the standard deviation of 1.23 seconds, indicating some degree of variation in the teachers' practices.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    In Excerpt 4, the teacher asked a pumping question to invite students to hypothesize whether an open-closed tube should be longer or shorter than the open-open tube to obtain resonance with the same tuning fork.

    “In Excerpt 4, the teacher asked a pumping question in Turn 11 to invite students to make a hypothesis of a new scenario, that is, to obtain resonance with the same tuning fork whether the open-closed tube should be longer or shorter than the open-open tube.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Wait time after teacher questions had a rather short average length of 1.01 seconds per lesson, showing the teachers generally did not leave long wait times.

    “Wait time after teacher questions had a rather short average length of 1.01 seconds per lesson, showing the teachers generally did not leave long wait times.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    The teacher then conducted an experiment that proved the student's first answer, shorter, was correct.

    “The teacher then conducted an experiment, which proved the student's first answer, shorter, was correct.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Half of the teacher questions were higher-order thinking questions, with recall questions occupying only a small proportion.

    “The finding that half of the teacher questions were higher-order thinking questions, with recall questions occupying only a small proportion”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The noun verb ratio in student responses was 5.19:1, showing a strong noun-oriented nature and limited use of verbs.

    “The noun verb ratio in student responses, 5.19:1, showed a strong noun-oriented nature, indicating limited use of verbs.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    In Turn 34, the teacher asked a pumping question to elicit students' ideas about whether identical twins have the same fingerprints.

    “In Turn 34, the teacher asked a pumping question to elicit students' ideas about whether identical twins have the same fingerprints.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Wait time seemed to be a stronger factor leading to student output of more quantity and quality, whereas the use of higher-order thinking questions did not necessarily achieve the same effect.

    “One of the foremost findings of this study is that wait time seemed to be a stronger factor leading to student output of more quantity and quality whereas the use of higher-order thinking questions did not necessarily achieve the same effect.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). The quote only partly states this claim.

    Findingreasoning

    The teacher's elaboration led the student to quickly change her answer to longer.

    “This led the student to quickly change her answer to longer.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Initial higher-order thinking questions often received incomplete student answers, and there was a lack of follow-up questions or effective follow-up questions by the teacher to push students to elaborate their answers.

    “Examination of the lesson excerpts shows often initial higher-order thinking questions received incomplete student answers, and there was a lack of follow-up questions or effective follow-up questions by the teacher to push students to elaborate their answers.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The moderate positive correlation between wait time and all four student output measures suggests that when the teachers did give more wait time, the students were able to produce lengthier output with more complicated linguistic structures involving verbs instead of single-noun answers, talk more and initiate more questions themselves.

    “The moderate positive correlation between wait time and all four student output measures suggests that when the teachers did give more wait time, the students were able to produce lengthier output with more complicated linguistic structures involving verbs instead of single-noun answers, talk more and initiate more questions themselves.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The wait time led to the student's one-word answer, shorter.

    “This led to the student's one-word answer, shorter.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    After the short student turn, the teacher immediately provided a full explanation himself: fingerprints are not genetic.

    “After this short student turn, the teacher in Turn 38 immediately provided a full explanation himself: fingerprints are not genetic.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    After the student's short answer No in Turn 35, the teacher asked a follow-up pumping question Why to invite elaboration from the student.

    “After the student's short answer No in Turn 35, the teacher asked a follow-up pumping question: Why to invite elaboration from the student.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    A lengthy wait time of three seconds was given in Turn 12.

    “Then, a lengthy wait time of three seconds was given in Turn 12.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    The teacher repeated back maybe shorter but did not indicate if the student's answer was correct.

    “Then the teacher repeated back maybe shorter but does not indicate if the student's answer is correct.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The time percentage of student talk averaged 10.06% of teacher whole-class interaction time, showing overall limited student participation.

    “The time percentage of student talk averaged 10.06% of teacher whole-class interaction time, showing overall limited student participation.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Pumping was the most widely used type, accounting for 24.61% of all teacher questions, which is 52.55% of all higher-order thinking questions.

    “Pumping was the most widely used type, accounting for 24.61% of all teacher questions, which is 52.55% of all higher-order thinking questions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The teacher asked a yes/no follow-up question referring to Figure 1 to confirm with the student the reason for her answer.

    “He then asked a yes/no follow-up question, which referred to Figure 1 to confirm with the student the reason for her answer.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    As Excerpts 3 and 4 show, initial higher-order thinking questions, typically pumping questions, often did not receive a full answer, and there were often missed opportunities for other varieties of higher-order thinking questions to be asked as follow-up questions.

    “As Excerpts 3 and 4 show, initial higher-order thinking questions, typically pumping questions, often did not receive a full answer, and there were often missed opportunities for other varieties of higher-order thinking questions to be asked as follow-up questions.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Cognitive development originates from social contexts and proceeds to individual mental activity.

    “As Vygotsky (1986) states, cognitive development originates from social contexts and proceeds to individual mental activity.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Vygotsky (1986)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Modified input and feedback that occur during negotiation of meaning are particularly beneficial for second or foreign language (L2) development.

    “Long's (1996) interaction hypothesis argued that the modified input and feedback that occur during negotiation of meaning are particularly beneficial for second or foreign language (L2) development, highlighting again the significance of interaction.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Long's (1996) source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Increased wait time, to a threshold of three seconds or more, gives students more time to think about the questions and is associated with positive changes in classroom interaction patterns, including increased number and length of student utterances.

    “Studies later found that an increased wait time, to a threshold of three seconds or more, gives students more time to think about the questions and is associated with positive changes in the classroom interaction patterns, including increased number and length of student utterances (Swift & Gooding, 1983) and student answers being”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Swift & Gooding, 1983 source
    • cites Rowe, 1986 source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Questions asking for reasons and metacognitive questions generated the most complex responses.

    “In addition, questions asking for reasons and metacognitive questions generated the most complex responses.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Llinares and Pascual Peña (2015)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Constructivist teaching is often contrasted with teaching by transmission where teacher questions often elicit only restricted student responses consisting of pre-determined single detached words which typically only require lower-order thinking.

    “Constructivist teaching is often contrasted with teaching by transmission where teacher questions often elicit only restricted student responses consisting of pre-determined”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Chin, 2006 source
    • cites van Zee & Minstrell, 1997 source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Teachers normally leave an average of less than one second of wait time after asking a question.

    “Rowe's work found that teachers normally leave an average of less than one second of wait time after asking a question (Rowe, 1974).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Rowe, 1974 source
  • Classified as probably not a substantial claim.

    Premisecitation

    EMI teachers' own English proficiency has often been called into question and identified as a reason for the prevalent use of closed and lower-order thinking questions.

    “In EMI studies, EMI teachers' own English proficiency has often been called into question and identified as a reason for the prevalent use of closed and lowerorder thinking questions (Sopia et al., 2010;Yip et al., 2007).”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Sopia et al., 2010

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Yip et al., 2007
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    In CLIL lessons in Austria, questions for facts were predominant at 89%, and short student responses featuring single noun phrases persisted independent of the type of questions.

    “In contrast, Dalton-Puffer (2007) found in CLIL lessons in Austria that while questions for facts were predominant at 89%, short student responses featuring single noun phrases persisted independent of the type of questions.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Dalton-Puffer (2007) source
  • May combine two claims.

    Study design and conductown data

    The inter-rater reliability for coding all measures was .78, indicating a reasonable level of reliability.

    “This resulted in an inter-rater reliability of .78,indicating a reasonable level of reliability (Robson, 2002).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Robson, 2002

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Average wait time greater than three seconds led to higher achievement in learning.

    “Tobin (1987) further argued that average wait time greater than three seconds led to higher achievement in learning.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Tobin (1987) source
  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    There is little research on wait time in EMI contexts.

    “In addition, there is little research on wait time in EMI contexts.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Language development needs not only input but also output where learners can test their hypotheses of language forms and notice the gap between their interlanguage and the target forms.

    “In second language acquisition (SLA), it is now well accepted that language development needs not only input but also output where learners can test their hypotheses of language forms and notice the gap between their interlanguage and the target forms (Swain, 1985).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Swain, 1985

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    In CLIL history classes in Madrid, 65.84% of teacher questions were recall questions, with questions for eliciting facts producing the simplest and shortest responses.

    “Llinares and Pascual Peña (2015) found in CLIL history classes in Madrid that 65.84% of teacher questions were recall questions, with questions for eliciting facts producing the simplest and shortest responses.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Llinares and Pascual Peña (2015)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationreasoning

    When EMI teachers possess high English proficiency, they might be more confident in opening up conversations to collectively construct knowledge with students on complicated subject matter and adopt a constructivist teaching approach with a more dialogic nature.

    “This shows that when EMI teachers possess high English proficiency, they might be more confident in opening up conversations to collectively construct knowledge with students on complicated subject matter and adopt a constructivist teaching approach with a more dialogic nature.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The NSTs in the study had high English proficiency.
  • Probably not a substantial claim: may not pass S2 (checkable).

    Premisecitation

    Each questioning approach possesses a special and meaningful function in contributing to constructivist teaching.

    “As Chin (2007) discussed, each of the questioning approaches possesses a special and meaningful function in contributing to constructivist teaching.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Chin (2007) source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The follow-up question Why was a probing move aimed at eliciting the underlying principle of an outcome.

    “This follow-up question is also a probing move (Tang, 2021) as it aimed to elicit the underlying principle of an outcome.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Tang, 2021

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationown data

    In EMI classes, wait time after lower-order thinking questions may be helpful if the language barrier causes challenges to students' responses.

    “This could be because in EMI classes wait time after lower-order thinking questions may be helpful if the language barrier causes challenges to students' responses, as demonstrated by Excerpt 3.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    This case demonstrates possible missed opportunities of follow-up questioning to address the initial higher-order thinking question.

    “This case demonstrates possible missed opportunities of follow-up questioning to address the initial higher-order thinking question.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Modelling a possible sentence structure and key words may scaffold students' use of language to provide a full answer.

    “This may scaffold students' use of language to provide a full answer.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    This atmosphere effect was also observed in L1 classrooms.

    “This was also observed in L1 classrooms (Samiroden, 1983).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Samiroden, 1983

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Students may need to create their own language in explaining their reasoning, as compared to likely recycling or reciting the language they received in answering recall questions.

    “The students may need to create their own language in explaining their reasoning, as compared to likely recycling or reciting the language they received in answering recall questions.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Higher-order thinking questions may place a higher demand on language use.

    “Due to the more complex thinking processes requested, higher-order thinking questions may also place a higher demand on language use.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Higher-order thinking questions require more complex thinking processes than recall questions.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    The teacher's elaboration of the difference between Figure 1 and Figure 2 in Turn 17 seemed to be an effort to lead students to think more and possibly point to a contradiction.

    “His elaboration of the difference between Figure 1 and Figure 2 in Turn 17 seemed to be an effort to lead students to think more and possibly point to a contradiction.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Pumping, the most commonly used type, is a more straightforward form of constructivist questions.

    “One reason could be that pumping, the most commonly used type, by Chin's (2007) definition, is a more straightforward form of constructivist questions.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Chin's (2007) source
  • May combine two claims.

    Interpretationreasoning

    The short average student turn length and the high noun-verb ratio suggest a prevalent use of short noun-oriented answers and limited degree of articulation of science processes, where verbs would be typically required.

    “The short average student turn length and the high noun-verb ratio suggest a prevalent use of short noun-oriented answers and limited degree of articulation of science processes, where verbs would be typically required.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    Follow-up questions have been well established in L1 science classes as helpful for pushing students to elaborate on their thinking, but the follow-up moves discussed are typically centered around the science content.

    “While follow-up questions have been well established in L1 science classes as helpful for pushing students to elaborate on their thinking (Mortimer & Scott, 2003;Tang, 2021), the follow-up moves discussed are typically centered around the science content.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Mortimer & Scott, 2003
    • cites Tang, 2021

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    A wide range of questioning approaches and multiple effective follow-up questions may be necessary in building extensive dialogues.

    “a wide range of questioning approaches and multiple effective follow-up questions may be necessary in building extensive dialogues.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Apart from the limited use of wait time and the lack of variety of the higher-order thinking questions, another reason for the lack of effect could be a lack of effective follow-up questions.

    “Apart from the limited use of wait time and the lack of variety of the higher-order thinking questions, another reason could be a lack of effective follow-up questions.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Follow-up moves that model or elicit key language items are particularly needed.

    “Thus, follow-up moves that model or elicit key language items are particularly needed.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Follow-up moves scaffolding the language constitute an additional dimension that needs to be addressed in EMI classes.

    “This incorporation of the language aspect is another key implication of this study, where we argue that follow-up moves scaffolding the language constitute an additional dimension that needs to be addressed in EMI classes.”
    Quote in the paperNot a substantial claim
53 of 53
  • The paper relies on this without support.

    The 28 lessons from seven EMI programs are representative of EMI science classes in foreign high school programs in China.

    “Convenience sampling was adopted due to accessibility issues and only the schools that gave access were recruited.”
  • The paper relies on this without support.

    The qualitative excerpts selected for analysis are representative of the observed classroom interaction patterns.

    “Examination of the lesson excerpts shows often initial higher-order thinking questions received incomplete student answers, and there was a lack of follow-up questions or effective follow-up questions by the teacher to push students to elaborate their answers.”
  • The paper relies on this without support.

    The NSTs in the study had high English proficiency.

    “This study showed that EMI teachers' high English proficiency may lead to more higher-order thinking questions”
    “This shows that when EMI teachers possess high English proficiency, they might be more confident in opening up conversations to collectively construct knowledge with students on complicated subject matter and adopt a constructivist teaching approach with a more dialogic nature.”
  • The paper relies on this without support.

    Higher-order thinking questions require more complex thinking processes than recall questions.

    “Due to the more complex thinking processes requested, higher-order thinking questions may also place a higher demand on language use.”
4 of 4

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Socratic-question subtypes do not add to their stated total

    Minor

    The listed subtype counts total 391, not the 425 Socratic questions reported in Table 5.

    Reported 425 · recomputed 391

  • Wait time in Excerpt 1 is 18 seconds, not eight

    Minor

    The excerpt labels the wait-time interval 14:22-14:40, a duration of 18 seconds.

    Reported 8 · recomputed 18

  • Higher-order question category percentages exceed the stated total

    Minor

    The four category percentages in Table 5 sum to 47.93%, rather than the reported 46.83% for higher-order thinking questions.

    Reported 46.83 · recomputed 47.93

  • A negative correlation is described as positive

    Minor

    The reported correlation between wait time and noun-verb ratio is −.45, although the results describe wait time as positively correlated with all four student-output measures.

4 of 4

Cites

Flagged first, then by citations

Research works printed but not linked: 6

  1. An, J., & Murphy, V. (2018). English as a medium of instruction in primary schools in South America: A review of the evidence. A report commissioned by the Oxford University Press.
  2. Borkowska, K. (2011). Approaches to studying classroom discourse: Introduction. In S. Walsh (Ed.), Exploring classroom discourse language in action (pp. 67-89). Routledge.
  3. Robson, C. (2002). Real world research: A resource for social scientists and practitioner-researchers (2nd ed.). Blackwell.
  4. Samiroden, W. D. (1983). The effects of higher cognitive level questions wait time ranges by biology student teachers on student achievement and perception of teacher effectiveness. [Unpublished doctoral dissertation, Oregon State University].
  5. Sopia, Y., Ong, T., Hashimah, A., Sadiah, B., & Lai, Y. Y. (2010). Teaching science through English: Engaging pupils cognitively. International CLIL Research Journal, 1(3), 46-59.
  6. Swain, M. (1985). Communicative competence: Some roles of comprehensible input and output in its development. In S. Gass & C. Madden (Eds.), Input in second language acquisition (pp. 235-253). Newbury House.

Cited by

Sorted by citations

Authors
An, J., & Childs, A.
Affiliations
  • Purdue University Fort Wayne (US)
  • University of Oxford (GB)
Venue
Studies in Second Language Learning and Teaching
Published
2023-06-29
Volume
13
Issue
2
Pages
471-493
ISSN
  • 2083-5205 (ISSN-L)
  • 2084-1965
OpenAlex
W4382725364
Cited by
14
References
25
Citations by year
2026: 4 · 2025: 5 · 2024: 4 · 2023: 1
FWCI
15.94
Type
journal article
Language
en
Open access
Locations
  • Studies in Second Language Learning and Teaching (publishedVersion, cc-by)
  • Studies in Second Language Learning and Teaching (Adam Mickiewicz University in Poznan) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
  • Social Sciences › Arts and Humanities › Literature and Literary Theory › Second Language Learning and Teaching
  • Social Sciences › Psychology › Social Psychology › Communication in Education and Healthcare
Keywords
English-medium instruction, waiting time, higher-order thinking questions, classroom interaction, science education, teacher questioning, student talk time, student questioning, Chinese high school students, native English-speaking teachers

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-23.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-23.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review