Development and application of a generative-AI-driven virtual simulation teaching system for international business negotiation scenarios
Open accessAbstract
Conventional international business negotiation courses struggle to deliver authentic cross-cultural interaction, immediate individualized feedback, and scenario variety at scale. This study designs and deploys a virtual simulation teaching system that positions generative artificial intelligence as a culturally differentiated counterpart rather than as a tutor. The system rests on a five-layer architecture that couples a multi-agent role generation framework, a retrieval-augmented case knowledge base for dynamic scenario construction, and an intelligent assessment module producing real-time narrative feedback anchored in a twelve-indicator rubric. A single-institution controlled experiment enrolled 124 third-year international trade undergraduates and compared four negotiation scenarios across a fifteen-week semester; primary outcomes were derived from blind human rubric scoring rather than from the system’s own indicators. After adjusting for baseline covariates and total practice time, the experimental group still outperformed the control group on every competence dimension, with the largest adjusted effects observed for cross-cultural sensitivity (Cohen’s d = 1.84, 95% CI [1.42, 2.26]) and strategy diversity (d = 1.69, 95% CI [1.28, 2.10]). Engagement telemetry recorded a 41% increase in voluntary practice sessions above the assigned schedule, and ablation studies located retrieval grounding as the single largest module contributor to output quality. Learner satisfaction reached 4.34 on a five-point scale, with self-reported retention holding at six-month follow-up in the experimental group. These initial findings—obtained in one cohort of Chinese undergraduates—suggest that generative AI may extend the constructivist promise of virtual simulation into interactional domains previously bottlenecked by partner availability, with gains concentrated where conventional pedagogy tends to underperform; broader validation across institutions, disciplines, and cultural contexts is still required before stronger claims can be made.
AI snapshot
Written from the paper’s full text.
TL;DR
The paper develops and tests a generative-AI virtual simulation system for international business negotiation, using multi-agent culturally differentiated counterparts, retrieval-augmented scenarios, and rubric-based feedback. In a single-institution randomized controlled experiment with 124 third-year international trade undergraduates, the experimental group outperformed controls on all competence dimensions, with the largest adjusted effects on cross-cultural sensitivity and strategy diversity.
Key findings
- The experimental group outperformed the control group on every competence dimension after ANCOVA adjustment; largest adjusted effects were cross-cultural sensitivity (Cohen’s d = 1.84, 95% CI [1.42, 2.26]) and strategy diversity (d = 1.69, 95% CI [1.28, 2.10]). Overall negotiation score was 84.6 (SD 6.2) vs 75.1 (SD 7.4), d = 1.39.
- CCSS scores rose from 3.41 to 4.17 in the experimental group vs 3.38 to 3.62 in controls; group × time interaction was significant, F(1, 119) = 62.4, p < 0.001, partial η² = 0.34.
- Engagement telemetry recorded a 41% increase in voluntary practice sessions above the assigned schedule; learner satisfaction reached 4.34/5 vs 3.67/5 for controls, and six-month follow-up in the experimental arm showed self-reported confidence 0.71 SD above baseline.
- Ablation studies found retrieval grounding was the largest module contributor: removing RAG dropped quality from 4.41 to 3.74 (15.2% degradation). Model quality index was GPT-4o Q = 4.41, Qwen-2.5-72B Q = 4.18, and GPT-3.5-turbo Q = 3.62; automated vs blind human scoring showed r = 0.78, ICC(3,1) = 0.87, mean bias +0.07.
Methods
- Single-institution randomized controlled experiment in Fall 2024 across a 15-week semester with 124 third-year International Trade undergraduates; block randomization (size four) assigned 62 to the AI-driven simulation system and 62 to conventional case discussion and human role-play. Both arms received the same 90-minute weekly lecture and 24 scheduled sessions across four negotiation scenarios.
- Primary outcomes came from blind human rubric scoring of redacted transcripts (inter-rater κ = 0.81), plus the Cross-Cultural Sensitivity Scale, a knowledge posttest, a strategy diversity index, engagement telemetry, satisfaction surveys, and semi-structured interviews. Analysis used independent-samples t tests with Bonferroni correction, Cohen’s d, and pre-registered ANCOVA adjusting for pretest score, GPA, CET-4 score, and total voluntary-practice minutes.
- System evaluation included latency and throughput testing, expert-rated content quality across 600 sampled agent turns, and ablation studies removing RAG, the cultural reasoning module, or the moderator agent.
Limitations
- Stated: the sample is one cohort of third-year Chinese undergraduates at one institution and one program over a single 15-week semester; the in-house rubric’s cross-context transportability is unknown; the six-month retention analysis covers only the experimental arm, so it is a within-group trajectory rather than a between-arm contrast; AI counterparts inherit training-corpus biases; cultural stereotyping remains a risk; voice input was optional and used in roughly 32% of sessions, confounding modality with latency; novelty/Hawthorne effects and time-on-task cannot be fully excluded; motivational asymmetry from an unblindable pedagogical trial remains.
- Stated: automated scoring shows mild upward drift on the two most subjective indicators—relational pacing and deadlock handling—so primary outcomes rely on blind human ratings, with automated scores used only for learner-facing feedback and internal telemetry.
- Evident from the text: attrition reporting is inconsistent across sections and figures (the text says 61/62/61 for primary analysis, while figures report experimental n = 60 and control n = 61), and the retention follow-up lacked a control comparison, limiting causal interpretation.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 33 cited sources checked · 0 supported · 0 flagged
- Findingown data
The largest effects landed on cross-cultural sensitivity and strategic decision-making under uncertainty rather than on dimensions where classroom instruction already performs adequately.
“The largest effects landed exactly where prior pedagogical research had located the deepest weaknessescross-cultural sensitivity and strategic decision-making under uncertainty -rather than on dimensions where classroom instruction already performs adequately.”
Quote in the paperSubstantial claim - Findingown data
Adjusted effect on cross-cultural sensitivity remained d = 1.61 (95% CI [1.19, 2.03]) after controlling for voluntary practice minutes.
“the adjusted effect on cross-cultural sensitivity remained d = 1.61 (95% CI [1.19, 2.03])”
Quote in the paperSubstantial claim - Findingown data
The largest adjusted effect for strategy diversity was d = 1.69, 95% CI [1.28, 2.10].
“and strategy diversity (d = 1.69, 95% CI [1.28, 2.10])”
Quote in the paperSubstantial claim- Rests on an assumption: The twelve-indicator rubric used for assessment is a valid measure of negotiation competence.
- Findingown data
Ablation studies located retrieval grounding as the single largest module contributor to output quality.
“ablation studies located retrieval grounding as the single largest module contributor to output quality”
Quote in the paperNot a substantial claim - Findingnone given
The system has a five-layer architecture that decoupled interaction, services, AI engine, data, and infrastructure.
“a five-layer architecture that decoupled interaction, services, AI engine, data, and infrastructure”
Quote in the paperSubstantial claim
- Findingown data
The group × time interaction for CCSS was significant (F(1, 119) = 62.4, p < 0.001, partial η2 = 0.34) under a two-way mixed-model ANOVA.
“group × time interaction was significant (F(1, 119) = 62.4,p < 0.001, partial η² = 0.34) under a two-way mixed-model ANOVA.”
Quote in the paperSubstantial claim - Findingown data
Two learners reported uneasiness that the AI counterpart occasionally produced responses they could not fully predict, which they read alternately as realism and as unfairness.
“Two learners reported the opposite reaction -uneasy that the AI counterpart occasionally produced responses they could not fully predict, which they read alternately as realism and as unfairness.”
Quote in the paperNot a substantial claim - Findingown data
Students become responsible for setting their own session frequency.
“Students become responsible for setting their own session frequency”
Quote in the paperNot a substantial claim - Findingown data
Communication & persuasion: experimental mean 85.1 (SD 5.9) vs control 77.4 (SD 6.8), t=6.74, p<0.001, d=1.21.
“85.1 (5.9) 77.4 (6.8) 6.74 < 0.001 1.21”
Quote in the paperSubstantial claim - Findingown data
Learner satisfaction reached 4.34 on a five-point scale.
“Learner satisfaction reached 4.34 on a five-point scale”
Quote in the paperNot a substantial claim- Rests on an assumption: The twelve-indicator rubric used for assessment is a valid measure of negotiation competence.
- Findingown data
After adjusting for baseline covariates and total practice time, the experimental group outperformed the control group on every competence dimension.
“After adjusting for baseline covariates and total practice time, the experimental group still outperformed the control group on every competence dimension”
Quote in the paperSubstantial claim- Rests on an assumption: The twelve-indicator rubric used for assessment is a valid measure of negotiation competence.
- Findingown data
Pilot learners identified 5 seconds as the upper bound of acceptable wait time.
“the 5-second threshold that pilot learners had identified as the upper bound of acceptable wait time.”
Quote in the paperSubstantial claim - Findingown data
The composite degradation from ablations was 15.2%, 11.3%, and 5.2% respectively.
“yielding 15.2%, 11.3%, and 5.2% respectively.”
Quote in the paperSubstantial claim - Findingown data
Self-reported retention held at six-month follow-up in the experimental group.
“with self-reported retention holding at sixmonth follow-up in the experimental group”
Quote in the paperSubstantial claim- Rests on an assumption: The twelve-indicator rubric used for assessment is a valid measure of negotiation competence.
- Findingown data
A single mid-tier server with two A100 GPUs supports up to forty concurrent learners under our load tests.
“A single mid-tier server with two A100 GPUs supports up to forty concurrent learners under our load tests”
Quote in the paperNot a substantial claim- Rests on an assumption: The load test capacity of 40 concurrent learners is sufficient for a typical business school cohort.
- Findingown data
Telemetry showed students exercise the freedom to set their own session frequency unevenly.
“the freedom our telemetry showed they exercise, but unevenly.”
Quote in the paperNot a substantial claim - Findingown data
The second contribution is empirical evidence, obtained under the boundary conditions of a single cohort, that gains concentrate on the dimensions conventional teaching struggles to reach.
“The second is empirical -evidence, obtained under the boundary conditions of a single cohort, that gains concentrate on the dimensions conventional teaching struggles to reach”
Quote in the paperSubstantial claim - Findingnone given
The system has an assessment engine that translated rubric scores into immediate narrative feedback.
“an assessment engine that translated rubric scores into immediate narrative feedback.”
Quote in the paperSubstantial claim - Findingown data
The largest adjusted effect for cross-cultural sensitivity was Cohen's d = 1.84, 95% CI [1.42, 2.26].
“with the largest adjusted effects observed for cross-cultural sensitivity (Cohen's d = 1.84, 95% CI [1.42, 2.26])”
Quote in the paperSubstantial claim- Rests on an assumption: The twelve-indicator rubric used for assessment is a valid measure of negotiation competence.
- Findingown data
Cross-cultural sensitivity showed the largest and most robust effect.
“with crosscultural sensitivity showing the largest and most robust effect.”
Quote in the paperSubstantial claim - Findingown data
Engagement telemetry recorded a 41% increase in voluntary practice sessions above the assigned schedule.
“Engagement telemetry recorded a 41% increase in voluntary practice sessions above the assigned schedule”
Quote in the paperNot a substantial claim - Findingnone given
The system has a multi-agent framework for generating negotiation roles conditioned on cultural and personality parameters.
“a multi-agent framework for generating negotiation roles conditioned on cultural and personality parameters”
Quote in the paperSubstantial claim - Findingnone given
Voice-augmented turns pay a transcription overhead of roughly one second on top of the text pipeline.
“Because voice-augmented turns pay a transcription overhead of roughly one second on top of the text pipeline, we also stratified latency by input modality.”
Quote in the paperSubstantial claim - Findingown data
Automated scoring shows a mild systematic drift upward on the two most subjective indicators-relational pacing and deadlock handling-where cultural nuance dominates.
“Automated scoring shows a mild systematic drift upward on the two most subjective indicators -relational pacing and deadlock handling -where cultural nuance dominates;”
Quote in the paperNot a substantial claim - Findingown data
Learning satisfaction: experimental mean 4.45 (SD 0.42) vs control 3.81 (SD 0.58), t=7.05, p<0.001, d=1.27.
“4.45 (0.42) 3.81 (0.58) 7.05 < 0.001 1.27”
Quote in the paperSubstantial claim - Findingown data
Retrieval grounding contributes the largest single-module effect on negotiation quality.
“Retrieval grounding contributes the largest single-module effect on negotiation quality.”
Quote in the paperSubstantial claim - Findingown data
Between-group difference in voluntary sessions was significant at p < 0.01 under an unadjusted independent-samples t test in some weeks.
“asterisks mark weeks where the betweengroup difference in voluntary sessions was significant at p < 0.01 under an unadjusted independent-samples t test.”
Quote in the paperNot a substantial claim - Premisenone given
A single conversational agent, however capable, struggles to enact the layered behavior of a foreign trade delegation.
“A single conversational agent, however capable, struggles to enact the layered behavior of a foreign trade delegation.”
Quote in the paperSubstantial claim - Interpretationreasoning
Cultural stereotyping is a real risk when Hofstede vectors and exemplar cases are used to condition agent behavior.
“Cultural stereotyping is a real risk when Hofstede vectors and exemplar cases are used to condition agent behavior”
Quote in the paperSubstantial claim - Interpretationreasoning
A Saudi-profiled counterpart trained on a narrow case set can flatten into caricature.
“a Saudiprofiled counterpart trained on a narrow case set can flatten into caricature.”
Quote in the paperSubstantial claim - Interpretationown data
AI-driven practice helps most precisely where conventional methods struggle most.
“We read this as evidence that AI-driven practice helps most precisely where conventional methods struggle most.”
Quote in the paperSubstantial claim - Interpretationreasoning
For programs training internationally oriented commercial talent under similar logistical constraints, this design offers one workable route to high-fidelity practice without study-abroad dependencies.
“for programs training internationally oriented commercial talent under similar logistical constraints, this design offers one workable route to high-fidelity practice without studyabroad dependencies”
Quote in the paperNot a substantial claim - Interpretationreasoning
For a negotiation curriculum, lecturing about distributive bargaining produces declarative knowledge that may never convert into procedural competence unless learners practice in environments resembling the ones they will later inhabit.
“For a negotiation curriculum, the implication is uncomfortable: lecturing about distributive bargaining produces declarative knowledge that may never convert into procedural competence unless learners practice in environments resembling the ones they will later inhabit.”
Quote in the paperSubstantial claim - Study design and conductnone given
Primary outcomes were derived from blind human rubric scoring rather than from the system's own indicators.
“primary outcomes were derived from blind human rubric scoring rather than from the system's own indicators”
Quote in the paperSubstantial claim - Interpretationcitation
The third contribution is a theoretical extension: treating the AI as counterpart rather than tutor lets psychological fidelity become a design parameter that scales beyond the boundaries of small-cohort role-play.
“The third is theoreticala specific extension of the constructivist and fidelity vocabularies: treating the AI as counterpart rather than tutor lets psychological fidelity, the axis Kuipers and colleagues placed at the heart of authentic simulation, become a design parameter that scales beyond the boundaries of small-cohort role-play.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Kuipers et al., 2019
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisenone given
Feedback in traditional international business negotiation courses, when offered, arrives hours or days later in aggregate form rather than at the moment of a poor concession or a mistimed silence.
“Feedback, when offered, arrives hours or days later in aggregate form rather than at the moment of a poor concession or a mistimed silence.”
Quote in the paperSubstantial claim - Premisecitation
International business negotiation typically unfolds through a recognizable arc-preparation, opening, bargaining, deadlock handling, closing, and follow-up-even though the precise rhythm varies with industry and counterparty.
“International business negotiation typically unfolds through a recognizable arcpreparation, opening, bargaining, deadlock handling, closing, and follow-up-even though the precise rhythm varies with industry and counterparty [31].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [31]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
Employers repeatedly note that fresh graduates possess theoretical knowledge of negotiation principles yet falter when confronted with adversarial counterparts, ambiguous instructions, or culturally unfamiliar settings.
“Employers repeatedly note that fresh graduates possess theoretical knowledge of negotiation principles yet falter when confronted with adversarial counterparts, ambiguous instructions, or culturally unfamiliar settings [4].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [4]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
Mello and van der Merwe found that specialists deliberately sacrificed surface realism to safeguard the emotional stakes of the simulated scenario.
“Mello and van der Merwe reached a compatible conclusion in a recent study of mixed-reality teacher training, finding that specialists deliberately sacrificed surface realism to safeguard the emotional stakes of the simulated scenario [64].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [64]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
Within the constructivist tradition, generative AI supplies a scalable counterpart-role that was previously the bottleneck for authentic interactional practice.
“within the constructivist tradition, generative AI supplies a scalable counterpart-role that was previously the bottleneck for authentic interactional practice.”
Quote in the paperNot a substantial claim - Study design and conductown data
Reliability was acceptable, with Cronbach's α = 0.89 across the full instrument.
“Reliability was acceptable, with Cronbach's α = 0.89 across the full instrument.”
Quote in the paperNot a substantial claim - Interpretationreasoning
Justification behavior in negotiation counterparts emerges more reliably with chain-of-thought scaffolding than under direct prompting.
“that justification behavior emerges more reliably with chain-of-thought scaffolding than under direct prompting.”
Quote in the paperSubstantial claim - Interpretationown data
We are reasonably confident the gap does not collapse under a single competing explanation.
“so we are reasonably confident the gap does not collapse under a single competing explanation.”
Quote in the paperSubstantial claim - Interpretationown data
The widening CCSS gap is consistent with the hypothesis that repeated exposure to differentiated cultural counterparts produces calibration that classroom discussion alone struggles to deliver.
“The widening gap is consistent with the hypothesis that repeated exposure to differentiated cultural counterparts produces calibration that classroom discussion alone struggles to deliver.”
Quote in the paperSubstantial claim - Interpretationown data
The boundary at 60 concurrent sessions constrains the practical scale of voice-first deployments.
“a boundary that constrains the practical scale of voice-first deployments”
Quote in the paperSubstantial claim - Premisecitation
Inserting intermediate reasoning steps elicits latent capacity already present in sufficiently large models.
“Inserting intermediate reasoning steps elicits latent capacity already present in sufficiently large models [21]”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [21]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationown data
The pattern of results matches the design intent of the AI module rather than reflecting any generalized improvement.
“a pattern that matches the design intent of the AI module rather than reflecting any generalized improvement.”
Quote in the paperSubstantial claim - Premisenone given
Cross-cultural authenticity is difficult to stage in traditional international business negotiation courses when all participants share the same nationality and language background.
“Cross-cultural authenticity is difficult to stage when all participants share the same nationality and language background.”
Quote in the paperSubstantial claim - Premisecitation
Recent syntheses of GenAI for human learning have identified the interactional axis as one of the least explored.
“Recent syntheses of GenAI for human learning have identified this interactional axis as one of the least explored [66];”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [66]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationown data
The narrower-than-expected gap between GPT-4o and Qwen suggests that for negotiation pedagogy, model capability has reached a point where retrieval grounding and prompt design matter at least as much as raw scale.
“The narrower-than-expected gap between GPT-4o and Qwen suggests that for negotiation pedagogy, model capability has reached a point where retrieval grounding and prompt design matter at least as much as raw scale.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Cultural appropriateness matters most in this domain.
- Premisecitation
Earlier implementations in business education relied heavily on scripted dialogue trees and pre-recorded video clips, producing experiences that felt rigid after one or two attempts.
“Earlier implementations in business education, however, relied heavily on scripted dialogue trees and pre-recorded video clips, producing experiences that felt rigid after one or two attempts [9].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [9]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationown data
Retrieval grounding rather than raw model capability did the heaviest lifting in this domain.
“The takeaway, somewhat against our initial expectation, is that retrieval grounding rather than raw model capability did the heaviest lifting in this domain.”
Quote in the paperSubstantial claim - Interpretationown data
Generative AI, embedded in a properly architected simulation environment, is associated with measurable gains in negotiation competence that conventional role-play has, in our program, struggled to deliver, at the scale of a single institution and a single cohort.
“The evidence assembled in Section IV supports a cautious claim, framed at the scale of a single institution and a single cohort: generative AI, embedded in a properly architected simulation environment, is associated with measurable gains in negotiation competence that conventional role-play has, in our program, struggled to deliver.”
Quote in the paperSubstantial claim- Rests on an assumption: Additional time on task contributes to skill acquisition.
- Premisecitation
These shortcomings together explain why graduates report a gap between coursework and the first negotiation they conduct on the job.
“These shortcomings together explain why graduates report a gap between coursework and the first negotiation they conduct on the job [15].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [15]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Study design and conductown data
Automated system scoring was compared to blind human rating across the twelve rubric indicators.
“Bland-Altman plot of automated system scoring versus blind human rating across the twelve rubric indicators.”
Quote in the paperSubstantial claim - Study design and conductown data
Baseline pretest values were closely matched across arms - negotiation-knowledge pretest 68.3 (SD 7.1) for experimental and 68.
“baseline pretest values were closely matched across arms -negotiation-knowledge pretest 68.3 (SD 7.1) for experimental and 68.”
Quote in the paperNot a substantial claim
- May combine two claims. 72
- Classified as probably not a substantial claim. 43
- The quote only partly states this claim. 3
May combine two claims.
Findingown dataThe moderator's role proved more important than initially expected-without it, persona drift across long sessions became noticeable to learners by the third or fourth turn.
“The moderator's role proved more important than we initially expected-without it, persona drift across long sessions became noticeable to learners by the third or fourth turn”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataAverage response latency settled at 2.3 seconds per agent turn, which proved acceptable to learners during pilot testing.
“Average response latency settled at 2.3 seconds per agent turn, which proved acceptable to learners during pilot testing.”
Quote in the paperNot a substantial claimMay combine two claims.
FindingreasoningCross-cultural scenario construction now scales without the logistical impossibility of recruiting authentic foreign counterparts for every cohort, and individualized feedback no longer waits on instructor bandwidth-the assessment engine returns session-specific commentary minutes after a session closes.
“Cross-cultural scenario construction now scales without the logistical impossibility of recruiting authentic foreign counterparts for every cohort, and individualized feedback no longer waits on instructor bandwidth -the assessment engine returns session-specific commentary minutes after a session closes.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe adjusted effect sizes reported in Table 5 attenuate by roughly 8-14% relative to the unadjusted values but remain large and statistically significant.
“the adjusted effect sizes reported in Table 5 attenuate by roughly 8-14% relative to the unadjusted values but remain large and statistically significant”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataFeedback usefulness scored highest (4.51), followed by content authenticity (4.39); usability scored lowest (4.08), with most complaints traced to occasional voice-recognition errors when learners spoke with strong regional accents.
“Feedback usefulness scored highest (4.51), followed by content authenticity (4.39); usability scored lowest (4.08), with most complaints traced to occasional voice-recognition errors when learners spoke with strong regional accents.”
Quote in the paperNot a substantial claimMay combine two claims.
FindingcitationThe cross-border M&A scenario showed the largest experimental advantage, whereas the contract-drafting scenario exhibited a more modest gap.
“The cross-border M&A scenario, which carries the heaviest informational and cultural load, showed the largest experimental advantage, whereas the contract-drafting scenariowhere conventional role-play already exposes students to standard clauses-exhibited a more modest gap [56].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [56]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
FindingreasoningThis study designed, built, and tested a virtual simulation teaching system for international business negotiation in which generative AI takes the role of a culturally differentiated counterpart rather than a tutor.
“This study designed, built, and tested a virtual simulation teaching system for international business negotiation in which generative AI takes the role of a culturally differentiated counterpart rather than a tutor.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataSubgroup satisfaction differed in shape rather than magnitude: international trade students valued strategic-decision feedback most, English majors gravitated toward cultural and language register dimensions, and law-background students preferred dispute-resolution scenarios where formal argumentation mattered.
“Satisfaction differed in shape rather than magnitude: international trade students valued the strategic-decision feedback most, English majors gravitated toward the cultural and language register dimensions, and law-background students preferred the disputeresolution scenarios where formal argumentation mattered.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataUnder a load of 40 concurrent sessions, the mean total latency held at 2.34 s (σ = 0.41 s); at 80 concurrent sessions, latency drifted to 3.91 s, still below the 5-second threshold that pilot learners had identified as the upper bound of acceptable wait time.
“Under a load of 40 concurrent sessions, the mean total latency held at 2.34 s (σ = 0.41 s); at 80 concurrent sessions, latency drifted to 3.91 s, still below the 5-second threshold that pilot learners had identified as the upper bound of acceptable wait time.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataText-only turns clear the 5-second study threshold across the full tested range, while voice-augmented turns approach or cross it beyond 60 concurrent sessions.
“Text-only turns clear the study threshold across the full tested range, while voice-augmented turns approach or cross it beyond 60 concurrent sessions -a boundary that constrains the practical scale of voice-first deployments and that we return to in Section V.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataExperimental learners returned a composite satisfaction score of 4.34 on a five-point scale, against 3.67 for the control group.
“Experimental learners returned S learner = 4.34 on a five-point scale, against 3.67 for the control group.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataPearson correlation across the twelve indicators reached r = 0.78, ICC(3,1) = 0.87, and a Bland-Altman analysis located the mean bias at only +0.07 rating points on a five-point scale, with 95% limits of agreement of [-0.11, +0.25].
“Pearson correlation across the twelve indicators reached r = 0.78, ICC(3,1) = 0.87, and a Bland-Altman analysis (Figure 9) located the mean bias at only +0.07 rating points on a five-point scale, with 95% limits of agreement of [-0.11, +0.25].”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataEight instructors used the system across the semester; their evaluation averaged 4.21 on pedagogical value, with the highest marks given to the assessment dashboard's ability to surface individual weaknesses that would otherwise stay invisible in cohort-sized classes.
“Eight instructors used the system across the semester.Their evaluation, captured through a structured rubric, averaged 4.21 on pedagogical value, with the highest marks given to the assessment dashboard's ability to surface individual weaknesses that would otherwise stay invisible in cohort-sized classes.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Findingnone givenInstructors move from staging role-plays to curating scenarios, calibrating rubrics, and intervening at the moments the AI cannot read.
“Instructors move from staging role-plays to curating scenarios, calibrating rubrics, and intervening at the moments the AI cannot read.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataSemi-structured interviews attributed the extra practice to three factors: the freshness of rotating counterpart profiles, the low social cost of failing in front of a non-judgmental AI, and the immediate rubric feedback at session close.
“the semi-structured interviews reported in Section 4.3 attribute the extra practice to three factors -the freshness of rotating counterpart profiles, the low social cost of failing in front of a non-judgmental AI, and the immediate rubric feedback at session close.”
Quote in the paperSubstantial claimThe quote only partly states this claim.
Findingown dataAt six-month follow-up (n = 54 from the experimental group), self-reported confidence in handling cross-cultural negotiation remained 0.71 standard deviations above baseline.
“Self-reported confidence in handling cross-cultural negotiation remained 0.71 standard deviations above baseline, computed as:”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataStrategic decision-making: experimental mean 83.8 (SD 6.8) vs control 74.5 (SD 7.6), t=7.18, p<0.001, d=1.29.
“83.8 (6.8) 74.5 (7.6) 7.18 < 0.001 1.29”
Quote in the paperSubstantial claimMay combine two claims.
FindingcitationThe experimental group moved from a baseline mean of 3.41 to a posttest mean of 4.17 on the CCSS, while the control group rose only from 3.38 to 3.62.
“The experimental group moved from a baseline mean of 3.41 (on a five-point scale) to a posttest mean of 4.17, while the control group rose only from 3.38 to 3.62 [57].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [57]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Findingown dataAblation studies showed that removing RAG dropped quality from 4.41 to 3.74; removing the cultural reasoning module dropped it to 3.91; removing the moderator agent caused a milder fall to 4.18 but visibly increased persona drift across long sessions.
“Removing RAG dropped quality from 4.41 to 3.74; removing the cultural reasoning module dropped it to 3.91; removing the moderator agent caused a milder fall to 4.18 but visibly increased persona drift across long sessions.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataInformation & analysis: experimental mean 82.3 (SD 7.1) vs control 76.8 (SD 7.9), t=4.08, p<0.001, d=0.73.
“82.3 (7.1) 76.8 (7.9) 4.08 < 0.001 0.73”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataIn the experimental cohort, voice input was invoked in roughly 32% of sessions, most heavily in the first two weeks and again during the M&A scenarios; the remaining 68% of sessions ran text-only.
“Telemetry from the experimental cohort indicates that voice input was invoked in roughly 32% of sessions, most heavily in the first two weeks and again during the M&A scenarios; the remaining 68% of sessions ran text-only.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataOverall negotiation score: experimental mean 84.6 (SD 6.2) vs control 75.1 (SD 7.4), t=7.74, p<0.001, d=1.39.
“84.6 (6.2) | 75.1 (7.4) | 7.74 | < 0.001 | 1.39”
Quote in the paperSubstantial claimMay combine two claims.
FindingcitationUnder the quality index, GPT-4o reached Q = 4.41, Qwen-2.5-72B reached Q = 4.18, and a baseline GPT-3.5-turbo configuration trailed at Q = 3.62.
“Under this index, GPT-4o reached Q = 4.41, Qwen-2.5-72Breached Q = 4.18, and a baseline GPT-3.5-turboconfiguration trailed at Q = 3.62 [59].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [59]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- The authors state this as an assumption: Cultural appropriateness matters most in this domain.
May combine two claims.
Findingown dataCross-cultural sensitivity: experimental mean 86.9 (SD 5.4) vs control 74.2 (SD 8.1), t=10.27, p<0.001, d=1.84.
“86.9 (5.4) 74.2 (8.1) 10.27 < 0.001 1.84”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Findingnone givenThe system has a retrieval-augmented scenario sampler that kept training material fresh across sessions.
“a retrieval-augmented scenario sampler that kept training material fresh across sessions”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataStrategy diversity index: experimental mean 0.71 (SD 0.09) vs control 0.54 (SD 0.11), t=9.42, p<0.001, d=1.69.
“0.71 (0.09) 0.54 (0.11) 9.42 < 0.001 1.69”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataTwo instructors raised concerns about overreliance: learners might accept the AI's feedback as authoritative when it is, in fact, probabilistic.
“Two instructors raised concerns about overreliance: learners might accept the AI's feedback as authoritative when it is, in fact, probabilistic.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe experimental group outperformed the control group on every competence dimension, with the gap widest on cross-cultural sensitivity and strategic decision-making.
“The experimental group outperformed the control group on every dimension, with the gap widest on cross-cultural sensitivity and strategic decisionmaking-a pattern that matches the design intent of the AI module rather than reflecting any generalized improvement.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataEmpirical concurrent throughput reached 14.6 successful turns per second on the production cluster, with ρsuccess = 0.984.
“Empirical Θ reached 14.6 successful turns per second on the production cluster, with ρsuccess = 0.984.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataExperimental learners initiated 41% more voluntary sessions than their control-group peers, and their voluntary session length grew rather than shrank across weeks.
“Experimental learners initiated 41% more voluntary sessions than their control-group peers, and their voluntary session length grew rather than shrank across weeks.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataCCSS gain: experimental mean 0.76 (SD 0.21) vs control 0.24 (SD 0.19), t=14.43, p<0.001, d=2.59.
“0.76 (0.21) 0.24 (0.19) 14.43 < 0.001 2.59”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataSessions completed: experimental mean 31.4 (SD 4.7) vs control 22.3 (SD 3.9), t=11.74, p<0.001, d=2.10.
“31.4 (4.7) 22.3 (3.9) 11.74 < 0.001 2.10”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe largest experimental advantage appears in the cross-border M&A scenario, the smallest in contract drafting.
“The largest experimental advantage appears in the cross-border M&A scenario, the smallest in contract drafting.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataEnd-to-end response latency per agent turn was measured across five concurrent-session loads, stratified by input modality.
“End-to-end response latency per agent turn across five concurrent-session loads, stratified by input modality (text-only vs voice-augmented).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataKnowledge posttest: experimental mean 87.2 (SD 5.5) vs control 81.3 (SD 6.4), t=5.51, p<0.001, d=0.99.
“87.2 (5.5) 81.3 (6.4) 5.51 < 0.001 0.99”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe two profiles (learner satisfaction and instructor evaluation) align closely on content authenticity, feedback usefulness, and pedagogical value, and diverge most on the usability axis where voice-recognition errors dominated open-text complaints.
“the two profiles align closely on content authenticity, feedback usefulness, and pedagogical value, and diverge most on the usability axis where voice-recognition errors dominated open-text complaints.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationThe pedagogical appeal of RAG is twofold: it curbs hallucination and it lets instructors update the underlying knowledge base without retraining the model.
“The pedagogical appeal of RAG is twofold.It curbs hallucination-a serious concern when a model is meant to enact a Japanese trading partner or a Brazilian buyer with culturally specific norms-and it lets instructors update the underlying knowledge base without retraining the model [23].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [23]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationEvaluating educational effectiveness draws on Kirkpatrick's four-level model: reaction, learning, behavior, and results.
“Evaluating educational effectiveness draws on Kirkpatrick's four-level model: reaction, learning, behavior, and results [30].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [30]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim.
PremisecitationKolb's experiential learning cycle provides a rhythm for structuring each negotiation session and its debrief.
“Kolb's experiential learning cycleconcrete experience, reflective observation, abstract conceptualization, active experimentation-provides a rhythm for structuring each negotiation session and its debrief [27].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [27]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenVoice input was optional, adopted in roughly a third of sessions, and its confounding with modality-dependent latency has been reported openly rather than absorbed silently.
“Voice input was optional, adopted in roughly a third of sessions, and its confounding with modality-dependent latency has been reported openly rather than absorbed silently.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductown dataBaseline equivalence was checked across grade point average, prior English proficiency (CET-4 scores), and a pretest of negotiation knowledge; no statistically meaningful differences emerged between groups.
“Baseline equivalence was checked across grade point average, prior English proficiency (CET-4 scores), and a pretest of negotiation knowledge; no statistically meaningful differences emerged between groups.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductreasoningThe assigned protocol was symmetric: six mandatory sessions per scenario for every learner in either arm, giving 24 scheduled sessions per student.
“The assigned protocol was symmetric: six mandatory sessions per scenario for every learner in either arm, giving 24 scheduled sessions per student.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationA recent synthesis by Yan and colleagues formalized the promises and challenges of GenAI across the learning cycle and identified authentic interactional practice as one of the least explored frontiers.
“a recent synthesis by Yan and colleagues in Nature Human Behaviour formalized the promises and challenges of GenAI across the learning cycle and identified authentic interactional practice as one of the least explored frontiers [66].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [66]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenThe full backend, prompt templates, evaluation pipeline, and anonymized session-trace samples have been packaged and are available with the article's Related files, and a Code Availability section records the archive.
“the full backend, prompt templates, evaluation pipeline, and anonymized session-trace samples have been packaged and are available with the article's Related files, and a Code Availability section in the Declarations records the archive”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductown dataCronbach's α measured on a pilot cohort (n = 34) reached 0.86 across the full rubric, with dimension-level α values between 0.78 and 0.89.
“Cronbach's α measured on a pilot cohort (n = 34) reached 0.86 across the full rubric, with dimension-level α values between 0.78 and 0.89.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationLarge language models such as GPT-4 and its successors can sustain coherent multi-turn dialogue, adopt distinct personas, and respond to nuanced prompts in ways that approximate human conversational partners.
“Large language models such as GPT-4 and its successors can sustain coherent multi-turn dialogue, adopt distinct personas, and respond to nuanced prompts in ways that approximate human conversational partners [5].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [5]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Study design and conductnone givenRandomization used a computer-generated sequence (block size four, seed pre-registered with the departmental research office); allocation concealment was preserved through sequentially numbered opaque sealed envelopes opened only in the presence of a witness after each student had completed baseline testing.
“Randomization used a computer-generated sequence (block size four, seed pre-registered with the departmental research office); allocation concealment was preserved through sequentially numbered opaque sealed envelopes opened only in the presence of a witness after each student had completed baseline testing.”
Quote in the paperSubstantial claimMay combine two claims.
Premiseown dataInteraction quality in traditional international business negotiation courses depends on the seniority and improvisational skill of fellow students, leaving weaker groups without a competent counterpart.
“Interaction quality depends on the seniority and improvisational skill of fellow students, leaving weaker groups without a competent counterpart.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductown dataBoth groups received identical lecture content and identical scenario themes across eight weeks of practical training.
“Both groups received identical lecture content and identical scenario themesinternational trade contract negotiation, cross-border merger and acquisition negotiation, technology licensing negotiation, and dispute resolution negotiation -across eight weeks of practical training.”
Quote in the paperSubstantial claimMay combine two claims. The quote only partly states this claim.
Interpretationown dataThese initial findings suggest that generative AI may extend the constructivist promise of virtual simulation into interactional domains previously bottlenecked by partner availability, with gains concentrated where conventional...
“These initial findings -obtained in one cohort of Chinese undergraduates -suggest that generative AI may extend the constructivist promise of virtual simulation into interactional domains previously bottlenecked by partner availability”
Quote in the paperSubstantial claim- Rests on an assumption: The twelve-indicator rubric used for assessment is a valid measure of negotiation competence.
Probably not a substantial claim: may not pass S4 (based). May combine two claims.
Interpretationnone givenEach phase of international business negotiation calls upon a distinct skill cluster: information gathering and BATNA estimation in preparation, anchoring and framing at the opening, concession management and packaging through the middle, and closure rituals at the end.
“Each phase calls upon a distinct skill cluster: information gathering and BATNA estimation in preparation, anchoring and framing at the opening, concession management and packaging through the middle, and closure rituals at the end.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.
Interpretationnone givenAI counterparts inherit biases from their training corpora that ongoing curation can mitigate but not eliminate.
“AI counterparts inherit biases from their training corpora that ongoing curation can mitigate but not eliminate”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataTwo independent coders processed the transcripts under an open-then-axial coding scheme (Cohen's κ = 0.83 on the initial pass).
“Two independent coders processed the transcripts under an open-then-axial coding scheme (Cohen's κ = 0.83 on the initial pass).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
Interpretationnone givenIn an education deployment of our size, LoRA turns culturally specialized adapter training from a prohibitive line item into a routine one.
“In an education deployment of our size, LoRA turns culturally specialized adapter training from a prohibitive line item into a routine one.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductnone givenThe sample is one cohort of third-year Chinese undergraduates at one university within one program, running across a single fifteen-week semester.
“The sample is one cohort of third-year Chinese undergraduates at one university within one program, running across a single fifteen-week semester.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductnone givenOutcome measurement leans on blind human raters and validated external instruments (CCSS, knowledge exam) alongside the twelve-indicator rubric.
“Outcome measurement leans on blind human raters and validated external instruments (CCSS, knowledge exam) alongside the twelve-indicator rubric”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
PremisecitationNegotiation competence can be decomposed into four trainable strands: information and analytical skill, communication and persuasion skill, cross-cultural sensitivity, and strategic decision-making under uncertainty.
“From these considerations we decompose negotiation competence into four trainable strands: information and analytical skill, communication and persuasion skill, crosscultural sensitivity, and strategic decision-making under uncertainty [34].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [34]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Study design and conductown dataAll primary outcomes are analyzed both as raw group comparisons and, in a pre-registered secondary analysis, as ANCOVA-adjusted estimates that condition on pretest score, GPA, CET-4 score, and total voluntary-practice minutes.
“All primary outcomes reported below are analyzed both as raw group comparisons and, in a pre-registered secondary analysis, as ANCOVA-adjusted estimates that condition on pretest score, GPA, CET-4 score, and total voluntary-practice minutes.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based). The quote only partly states this claim.
InterpretationcitationThe decay in confidence was shallower than the typical post-course drop reported in conventional curricula.
“a decay shallower than the typical post-course drop reported in conventional curricula [62].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [62]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenThe twelve-indicator rubric was developed in-house and its cross-context transportability remains an open question.
“the rubric itself was developed in-house and its cross-context transportability remains an open question.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationInternational work by Kasneci and colleagues mapped the opportunities and risks of large language models in classrooms.
“International work by Kasneci and colleagues mapped the opportunities and risks of large language models in classrooms [12]”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [12]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim.
PremisecitationBrown, Collins, and Duguid extended this view through situated cognition, arguing that concepts inhabit the activities and contexts within which they are produced.
“Brown, Collins, and Duguid extended this view through situated cognition, arguing that concepts inhabit the activities and contexts within which they are produced [26].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [26]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Interpretationnone givenThe retrieval-augmented design curbs hallucination but does not eliminate it.
“The retrievalaugmented design curbs hallucination but does not eliminate it.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenThe system-only indicators inform learner-facing feedback but do not enter the primary outcome analysis in Section 4.1.
“The system-only indicators inform learner-facing feedback but do not enter the primary outcome analysis in Section 4.1.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationreasoningReliability of AI-generated content remains the most pressing limitation.
“Reliability of AI-generated content remains the most pressing limitation.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningCasting a generative model as counterpart rather than tutor supplies the missing mechanism to instantiate context, and psychological fidelity is the axis on which a counterpart-shaped AI can deliver.
“Casting a generative model as counterpart rather than tutor supplies exactly that missing constituent, and it extends the constructivist and fidelity vocabularies in a specific way: the fidelity axis that had received the least attention in business-education simulation, psychological fidelity in the Kuipers sense [63], is precisely the axis on which a counterpart-shaped AI can deliver.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [63]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataSampling for interviews was purposive and stratified: six students from each of three posttest score terciles, balanced by gender, with recruitment closed once thematic saturation was reached across the three strata.
“Sampling was purposive and stratified: we drew six students from each of three posttest score terciles, balanced by gender, and closed recruitment once thematic saturation was reached across the three strata.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
Interpretationown dataThe ambivalence is not a defect but a marker that the simulation crossed into the territory where genuine practice begins.
“We see this ambivalence not as a defect but as a marker that the simulation crossed into the territory where genuine practice begins.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductreasoningThe six-month retention analysis covers only the experimental arm and therefore reads as a within-group trajectory, not a between-arm contrast.
“The six-month retention analysis covers only the experimental arm and therefore reads as a within-group trajectory, not a between-arm contrast.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
Interpretationnone givenThe eight-week intervention is short relative to the career-length consolidation of negotiation skill.
“the eight-week intervention is short relative to the career-length consolidation of negotiation skill”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationThe second research stream explores how generative AI can support writing instruction, programming education, and conversational language practice, with growing evidence that adaptive feedback raises learner engagement.
“The second stream, situated within educational technology, explores how generative AI can support writing instruction, programming education, and conversational language practice, with growing evidence that adaptive feedback raises learner engagement [11].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [11]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
PremisecitationConventional international business negotiation courses struggle to deliver authentic cross-cultural interaction, immediate individualized feedback, and scenario variety at scale.
“Conventional international business negotiation courses struggle to deliver authentic cross-cultural interaction, immediate individualized feedback, and scenario variety at scale”
- Also stated in: § A R T I C L E I N P R E S S · boosted
“Traditional international business negotiation courses, in our observation and confirmed by recent surveys, exhibit four persistent weaknesses.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [14]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [15]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Also stated in: § A R T I C L E I N P R E S S · boosted
Probably not a substantial claim: may not pass S2 (checkable), S4 (based).
Interpretationnone givenThe first contribution is a modular architecture for pedagogical multi-agent dialogue that other interaction-heavy domains, from counseling to diplomatic practice, could plausibly adapt.
“The first is methodologicala modular architecture for pedagogical multi-agent dialogue that other interaction-heavy domains, from counseling to diplomatic practice, could plausibly adapt.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningThe fixed branching logic of earlier implementations limited replay value and made it difficult to expose learners to the improvisational quality that real negotiations demand.
“The fixed branching logic limited replay value and made it difficult to expose learners to the improvisational quality that real negotiations demand.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationHall's distinction between high-context and low-context communication adds a complementary lens, capturing how much meaning travels through explicit verbal content versus surrounding cues such as silence, hierarchy, and prior relationship.
“Hall's distinction between highcontext and low-context communication adds a complementary lens, capturing how much meaning travels through explicit verbal content versus surrounding cues such as silence, hierarchy, and prior relationship [33].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [33]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
PremisecitationChinese universities face mounting pressure to cultivate practitioners capable of handling high-stakes negotiations under uncertain geopolitical conditions, a demand that conventional classroom instruction struggles to meet.
“Chinese universities, in particular, face mounting pressure to cultivate practitioners capable of handling high-stakes negotiations under uncertain geopolitical conditions, a demand that conventional classroom instruction struggles to meet [3].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [3]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Study design and conductown dataReturn rates were 59/60 in the experimental arm and 58/61 in the control arm, with non-response driven by illness during the final week.
“Return rates were high: 59/60 in the experimental arm and 58/61 in the control arm, with non-response driven by illness during the final week.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
PremisecitationKnowledge, according to constructivist accounts, is not transmitted intact from instructor to learner but assembled through active engagement with authentic problems.
“Knowledge, according to constructivist accounts, is not transmitted intact from instructor to learner but assembled through active engagement with authentic problems [25].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [25]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim.
PremisecitationWhat remains underexplored is the intersection of these strands: a purpose-built negotiation environment in which AI agents act as culturally differentiated counterparties rather than as generic conversational tools, and in which the human learner-not the model-is the object of evaluation.
“What remains underexplored is the intersection of these strands: a purpose-built negotiation environment in which AI agents act as culturally differentiated counterparties rather than as generic conversational tools, and in which the human learner -not the model -is the object of evaluation [13].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [13]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationVirtual simulation systems are conventionally decomposed into a presentation layer, an interaction layer, a logic and content layer, and a data layer, with the design principles of fidelity, interactivity, scalability, and assessability guiding each.
“Architecturally, virtual simulation systems are conventionally decomposed into a presentation layer, an interaction layer, a logic and content layer, and a data layer, with the design principles of fidelity, interactivity, scalability, and assessability guiding each [29].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [29]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Study design and conductown dataThe primary outcome analysis continues to rely on blind human ratings, and automated scores enter only in learner-facing feedback and internal engineering telemetry.
“the primary outcome analysis therefore continues to rely on blind human ratings, and the automated scores enter only in learner-facing feedback and in the internal engineering telemetry.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationScenarios in traditional international business negotiation courses tend to be static, drawn from textbook cases that students often anticipate before the role-play begins.
“Scenarios tend to be static, drawn from textbook cases that students often anticipate before the role-play begins [14].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [14]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim. May combine two claims.
Study design and conductown dataBlind rubric scoring proceeded on this dataset: for every session in both arms, the full transcript was extracted, stripped of role identifiers, model-specific stylistic cues, and any timestamp or telemetry markers, and re-tagged with a random session code before being routed to two trained graders blind to group assignment (inter-rater agreement κ = 0.81).
“Blind rubric scoring proceeded on this dataset: for every session in both arms, the full transcript was extracted, stripped of role identifiers, model-specific stylistic cues, and any timestamp or telemetry markers, and re-tagged with a random session code before being routed to two trained graders blind to group assignment (inter-rater agreement κ = 0.81 );”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationParallel work in the NLP community, most visibly the NegotiationArena platform of Bianchi and colleagues, has begun to probe LLM negotiation behavior as an object of study, though this line of work targets agent-to-agent evaluation rather than human learning.
“Parallel work in the NLP community -most visibly the NegotiationArena platform of Bianchi and colleagues -has begun to probe LLM negotiation behavior as an object of study, though this line of work targets agent-to-agent evaluation rather than human learning [67].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [67]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Study design and conductown dataAttrition was low but not zero: two students in the experimental group withdrew for medical reasons and one control student transferred programs mid-semester, leaving 61/62/61 for primary analysis under an intention-to-treat frame.
“Attrition was low but not zero: two students in the experimental group withdrew for medical reasons and one control student transferred programs mid-semester, leaving 61/62/61 for primary analysis under an intention-to-treat frame.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe first research stream consistently identifies cross-cultural competence as the most fragile dimension of the trained skillset.
“The first, rooted in business and language education, examines pedagogical models for negotiation training-case-based learning, role-play, and simulation games-and consistently identifies cross-cultural competence as the most fragile dimension of the trained skillset [10].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [10]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
Premisenone givenCulture shapes every phase of international business negotiation, sometimes invisibly.
“Culture shapes every one of these phases, sometimes invisibly.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductreasoningThe questionnaire was distributed to both arms with parallel item wording so that the satisfaction gap could be interpreted as a cross-arm comparison rather than as an absolute score.
“The questionnaire was distributed to both arms -experimental learners rated the AI simulation system and control learners rated their conventional role-play curriculum against parallel item wording -so that the satisfaction gap could be interpreted as a cross-arm comparison rather than as an absolute score.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenEffect sizes in this range are unusually large for educational interventions of this length.
“effect sizes in this range are unusually large for educational interventions of this length”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductreasoningThe retention figure is a within-group change from baseline rather than a between-arm contrast, and it should not be read as evidence that AI-driven training decays more slowly than conventional training.
“As a consequence, the retention figure is a within-group change from baseline rather than a between-arm contrast, and it should not be read as evidence that AI-driven training decays more slowly than conventional training.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductreasoningWe mitigated cultural stereotyping through expert review of the case base and through deliberate within-nationality variation in personality parameters.
“We mitigated this through expert review of the case base and through deliberate within-nationality variation in personality parameters”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataThe selective pattern suggests the intervention worked through the mechanisms the design anticipated, but it does not by itself rule out competing explanations.
“This selective pattern is itself informative; it suggests the intervention worked through the mechanisms the design anticipated, but it does not by itself rule out competing explanations that we take up in turn.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductown dataContent quality was assessed across three dimensions-fluency, contextual relevance, and cultural appropriateness-each rated by three expert annotators on a five-point scale across 600 sampled agent turns, with inter-rater reliability α = 0.79 on Krippendorff's α.
“Content quality was assessed across three dimensions-fluency, contextual relevance, and cultural appropriateness-each rated by three expert annotators on a five-point scale across 600 sampled agent turns.Inter-rater reliability reached α = 0.79 on Krippendorff's α.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataThe study received Institutional Review Board approval and written informed consent from every participant.
“After receiving Institutional Review Board approval and obtaining written informed consent from every participant, we enrolled 124 third-year students from the International Business Negotiation course.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
PremisecitationPsychological fidelity is at the heart of authentic simulation.
“the axis Kuipers and colleagues placed at the heart of authentic simulation”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Kuipers et al., 2019
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim.
Study design and conductown dataPost-intervention negotiation skill scores across the four competence dimensions were scored by two blind human graders on redacted transcripts.
“both scored by two blind human graders on redacted transcripts”
Quote in the paperSubstantial claim
The paper relies on this without support.
The twelve-indicator rubric used for assessment is a valid measure of negotiation competence.
“an intelligent assessment module producing real-time narrative feedback anchored in a twelve-indicator rubric”
The paper relies on this without support.
Hofstede's six-dimensional framework and Hall's high/low-context distinction are useful priors for conditioning AI counterparts.
“We treat these frameworks pragmatically rather than dogmatically: they are useful priors for conditioning AI counterparts, not deterministic predictors of behavior.”
The paper relies on this without support.
The case knowledge base assembled from Harvard cases, anonymized transcripts, and synthesized cases is representative of real negotiation scenarios.
“The case knowledge base feeding the retrieval pipeline was assembled from three sources: published Harvard Business School cases licensed for educational use, anonymized transcripts contributed by industry advisors, and synthesized cases generated under expert review to fill thematic gaps [45].”
The paper relies on this without support.
The scenario sampler's distance measure D and difficulty indicator adequately produce non-repetitive, appropriately difficult scenarios.
“where D(,ℋλ) measures distance between candidate scenario and the learner's session history ℋλ, and β controls how aggressively the sampler avoids repetition.The indicator term keeps difficulty aligned with the instructor's syllabus.”
The paper relies on this without support.
The load test capacity of 40 concurrent learners is sufficient for a typical business school cohort.
“A single mid-tier server with two A100 GPUs supports up to forty concurrent learners under our load tests, a capacity sufficient for a typical business school cohort.”
The authors state this as an assumption.
Learners read prose advice more carefully than rubric numbers.
“We deliberately chose to deliver this feedback in narrative rather than tabular form, on the working assumption that learners read prose advice more carefully than rubric numbers-an assumption that the experimental data in the next section partly confirms and partly complicates.”
The paper relies on this without support.
Additional time on task contributes to skill acquisition.
“since additional time on task inevitably contributes to skill acquisition”
The authors state this as an assumption.
Cultural appropriateness matters most in this domain.
“with weights set to (0.25, 0.35, 0.40), reflecting our judgment that cultural appropriateness matters most in this domain.”
The paper relies on this without support.
The twelve-indicator rubric is a valid measure of negotiation competence across contexts.
“the rubric itself was developed in-house and its cross-context transportability remains an open question.”
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- ConsistentF(1, 119) = 62.4reported p < .001 · recomputed p < .001
“F(1, 119) = 62.4,p < .001”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Abstract labels an unadjusted effect as adjusted
MajorThe abstract calls the cross-cultural sensitivity effect of d = 1.84 adjusted for covariates and practice time. The later Table 5 discussion identifies the adjusted effect as d = 1.61; 1.84 is the effect shown in the table before the stated attenuation.
“After adjusting for baseline covariates and total practice time, the experimental group still outperformed the control group on every competence dimension, with the largest adjusted effects observed for cross-cultural sensitivity (Cohen's d = 1.84, 95% CI [1.42, 2.26]) and strategy diversity (d = 1.69, 95% CI [1.28, 2.10]).”
“voluntary practice minutes, the adjusted effect on cross-cultural sensitivity remained d = 1.61 (95% CI [1.19, 2.03])”
Control-group completed sessions fall below its mandatory schedule
MajorThe paper says control learners practiced the same 24 mandatory sessions as experimental learners, but Table 5 reports only 22.3 completed sessions on average for the control group. That mean cannot represent completion of all 24 assigned sessions, before any voluntary practice is counted.
“The control group practiced these scheduled sessions through fixed-script role-play with classmates; the experimental group ran the same 24 sessions against AI counterparts whose national, personality, and strategy profiles varied between sessions.”
“31.4 (4.7) 22.3 (3.9) 11.74 < 0.001 2.10”
Experimental-group attrition count does not add up
MinorThe experimental group began with 62 students and two withdrew, leaving 60, not the reported 61. The figure captions also give an experimental sample of 60 after attrition.
Reported 61 · recomputed 60
“Attrition was low but not zero: two students in the experimental group withdrew for medical reasons and one control student transferred programs mid-semester, leaving 61/62/61 for primary analysis under an intention-to-treat frame.”
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 27
- H. Liu and Y. Chen, "Cultivating Cross-Cultural Business Talents in Chinese Universities under the Belt and Road Initiative," Higher Education Studies, vol. 11, no. 3, pp. 84-93, 2021.
- R. Tulder, A. Verbeke, and L. Piscitello, "International Business in the Information and Digital Age," Progress in International Business Research, vol. 13, pp. 1-22, 2018.
- Z. Wang and X. Han, "Development and Application of Virtual Simulation Experimental Teaching Projects in Chinese Universities," Experimental Technology and Management, vol. 37, no. 4, pp. 1-6, 2020.
- L. Liu, M. Zhang, and Y. Ye, "A Review of Virtual Simulation Experimental Teaching in Higher Education," Computer Applications in Engineering Education, vol. 28, no. 3, pp. 502-518, 2020.
- Y. Park, D. Kim, and S. Lee, "Multi-Agent Dialogue Systems for Educational Applications: A Survey," IEEE Access, vol. 10, pp. 96345-96362, 2022.
- B. Reiche, M. L. Lee, and A. Allen, "Global Work Experiences and Cultural Intelligence," Journal of Management Studies, vol. 56, no. 3, pp. 605-632, 2019.
- T. Brown, B. Mann, N. Ryder, et al., "Language Models are Few-Shot Learners," in Advances in Neural Information Processing Systems, vol. 33, pp. 1877-1901, 2020.
- A. Vaswani, N. Shazeer, N. Parmar, et al., "Attention Is All You Need," in Advances in Neural Information Processing Systems, vol. 30, pp. 5998-6008, 2017.
- M. Hu, "Construction and Application of Virtual Simulation Experimental Teaching Platform in Higher Education," Computer Applications in Engineering Education, vol. 29, no. 5, pp. 1217-1227, 2021.
- D. H. Jonassen and S. Land, Theoretical Foundations of Learning Environments, 2nd ed., Routledge, 2012.
- D. A. Kolb, Experiential Learning: Experience as the Source of Learning and Development, 2nd ed., Pearson FT Press, 2014.
- Y. Chen and J. Zhang, "Design and Implementation of a Virtual Simulation Experimental Teaching System Based on B/S Architecture," International Journal of Emerging Technologies in Learning, vol. 16, no. 11, pp. 213-227, 2021.
- R. J. Lewicki, B. Barry, and D. M. Saunders, Negotiation, 8th ed., McGraw-Hill Education, 2020.
- G. Hofstede, G. J. Hofstede, and M. Minkov, Cultures and Organizations: Software of the Mind, 3rd ed., McGraw-Hill, 2010.
- B. M. Goldman and D. L. Shapiro, The Psychology of Negotiations in the 21st Century Workplace, Routledge, 2012.
- H. Raiffa, J. Richardson, and D. Metcalfe, Negotiation Analysis: The Science and Art of Collaborative Decision Making, Harvard University Press, 2002.
- H. Kang and J. Kim, "Design and Implementation of an Event-Driven Architecture for Real-Time Educational Applications," Journal of Educational Computing Research, vol. 59, no. 8, pp. 1565-1588, 2022.
- Q. Wu, G. Bansal, J. Zhang, et al., "AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation," in Proceedings of the 1st Conference on Language Modeling (COLM), 2024.
- L. Susskind and J. Cruikshank, Breaking Robert's Rules: The New Way to Run Your Meeting, Build Consensus, and Get Results, Oxford University Press, 2006.
- A. Radford, J. W. Kim, T. Xu, G. Brockman, C. McLeavey, and I. Sutskever, "Robust Speech Recognition via Large-Scale Weak Supervision," in Proceedings of the 40th International Conference on Machine Learning (ICML), vol. 202, pp. 28492-28518, 2023.
- V. Aleven, B. M. McLaren, J. Sewall, et al., "Example-Tracing Tutors: Intelligent Tutoring Systems by Non-Programmers," International Journal of Artificial Intelligence in Education, vol. 26, no. 1, pp. 224-269, 2016.
- L. S. Vygotsky, Mind in Society: The Development of Higher Psychological Processes, Harvard University Press, 1978.
- Z. Yang, Z. Liu, P. Hu, Z. Wang, Y. Zhang, and J. Wang, "Building Cooperative Embodied Agents Modularly with Large Language Models," in Proceedings of the 12th International Conference on Learning Representations (ICLR), 2024.
- G. Chen and W. J. Starosta, "The Development and Validation of the Intercultural Sensitivity Scale," Human Communication, vol. 3, no. 1, pp. 1-15, 2000.
- J. Yu, Y. Wang, K. Zhao, et al., "S3: Increasing GPU Utilization during Generative Inference for Higher Throughput," in Advances in Neural Information Processing Systems, vol. 36, 2023.
- J. Nielsen, Usability Engineering, Morgan Kaufmann, San Francisco, CA, 1993.
- F. Bianchi, P. J. Chia, M. Yuksekgonul, J. Tagliabue, D. Jurafsky, and J. Zou, "How Well Can LLMs Negotiate? NegotiationArena Platform and Analysis," in Proceedings of the 41st International Conference on Machine Learning (ICML), PMLR 235, pp. 3935- 3951, 2024.
- Authors
- Mo, Q.
- Affiliations
- Ningbo University of Technology (CN)
- Corresponding author
- Mo, Qunli
- Venue
- Scientific Reports
- Published
- 2026-08-07
- ISSN
- 2045-2322 (ISSN-L)
- OpenAlex
- W7201832194
- Cited by
- 0
- References
- 0
- FWCI
- 0.00
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Scientific Reports (publishedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
- Social Sciences › Business, Management and Accounting › Management of Technology and Innovation › Management and Marketing Education
- Social Sciences › Education › Innovative Teaching Methodologies in Social Sciences
- Keywords
- generative AI, virtual simulation, international business negotiation, intercultural sensitivity, retrieval-augmented generation, intelligent assessment, narrative feedback, student engagement, international trade education, constructivist teaching, student satisfaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-29.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-29.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review