The DOI matches its DataCite record.
Nebula: A discourse aware Minecraft Builder
Open accessAbstract
When engaging in collaborative tasks, humans efficiently exploit the semantic structure of a conversation to optimize verbal and nonverbal interactions. But in recent "language to code" or "language to action" models, this information is lacking. We show how incorporating the prior discourse and nonlinguistic context of a conversation situated in a nonlinguistic environment can improve the "language to action" component of such interactions. We finetune an LLM to predict actions based on prior context; our model, Nebula, doubles the net-action F1 score over the baseline on this task of Jayannavar et al.(2020). We also investigate our model's ability to construct shapes and understand location descriptions using a synthetic dataset
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Chaturvedi et al. discuss location and reference ambiguity in embodied settings that involve physical spaces such as a Minecraft game.
“Finally, Chaturvedi et al. [9] discuss location and and reference ambiguity, in emboddied settings that involve physical spaces such as a Minecraft game.”
From LLMs Get Lost In Multi-Turn Conversation (2025) · cites this paper as [9]
Citations
Cited by
Sorted by citations
LLMs Get Lost In Multi-Turn Conversation
Laban, P., Hayashi, H., Zhou, Y., & Neville, J. (2025) · arXiv · Cited by 419
Metadata
- Authors
- Chaturvedi, A., Thompson, K., & Asher, N.
- Affiliations
- Linagora (France) (FR)
- Centre National de la Recherche Scientifique (FR)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2024
- Pages
- 6431-6443
- arXiv
- 2406.18164
- OpenAlex
- W4404781498
- Cited by
- 1
- References
- 0
- Citations by year
- 2026: 1
- FWCI
- 0.29
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- dx.doi.org
- Licence
- Locations
- Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- European Commission
- Agence Nationale de la Recherche (France2030, ANR‐19, ANR-21-FAI2-0005, ANR-21-ASIA-0005)
- Région Occitanie Pyrénées-Méditerranée
- NextGenerationEU
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- collaborative tasks, discourse context, large language models, action prediction, Minecraft, location description, synthetic dataset
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
