The DOI matches its DataCite record; 1 of the 1 references it cites were found in a registry or an index.
Thread of Thought Unraveling Chaotic Contexts
Abstract
Large Language Models (LLMs) have ushered in a transformative era in the field of natural language processing, excelling in tasks related to text comprehension and generation. Nevertheless, they encounter difficulties when confronted with chaotic contexts (e.g., distractors rather than long irrelevant context), leading to the inadvertent omission of certain details within the chaotic context. In response to these challenges, we introduce the "Thread of Thought" (ThoT) strategy, which draws inspiration from human cognitive processes. ThoT systematically segments and analyzes extended contexts while adeptly selecting pertinent information. This strategy serves as a versatile "plug-and-play" module, seamlessly integrating with various LLMs and prompting techniques. In the experiments, we utilize the PopQA and EntityQ datasets, as well as a Multi-Turn Conversation Response dataset (MTCR) we collected, to illustrate that ThoT significantly improves reasoning performance compared to other prompting techniques.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Evaluations on question answering and conversation datasets reveal substantial performance improvements of 47.20% and 17.8%, respectively, especially in chaotic contexts.”
From A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applications (2024) · cites this paper as Zhou et al., 2023
In the citing paper
“ThoT's flexibility shines as a versatile”
From A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applications (2024) · cites this paper as Zhou et al., 2023
In the citing paper
“ThoT, inspired by human cognition, systematically examines extensive contexts into manageable segments for incremental analysis, employing a two-phase approach where the LLM first summarizes and examines each segment before refining the information for a final response.”
From A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applications (2024) · cites this paper as Zhou et al., 2023
In the citing paper
“Zhou et al. [2023] presented Thread of Thought (ThoT), a prompting technique designed to enhance the reasoning abilities of LLMs within chaotic contexts.”
From A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applications (2024) · cites this paper as Zhou et al., 2023
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression
Jiang, H., Wu, Q., Luo, X., Li, D., Lin, C.-Y., Yang, Y., & Qiu, L. (2023) · arXiv · Cited by 12 · cited 4×
“Recent studies (Xu et al., 2023; Jiang et al., 2023) have proposed various solutions to enhance the performance of LLMs in long-context scenarios, upon an intuition of input capacity optimization.”
BackgroundMethodInfluential
Cited by
A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applications
Sahoo, P., Singh, A. K., Saha, S., Jain, V., Mondal, S., & Chadha, A. (2024) · arXiv · doi:10.48550/arxiv.2402.07927 · Cited by 288
Use of artificial intelligence for liver diseases: A survey from the EASL congress 2024
Žigutytė, L., Sorz-Nechay, T., Clusmann, J., & Kather, J. N. (2024) · JHEP Reports · doi:10.1016/j.jhepr.2024.101209 · Cited by 33
Metadata
- Authors
- Zhou, Y., Geng, X., Shen, T., Tao, C., Long, G., Lou, J.-G., & Shen, J.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- arXiv
- 2311.08734
- References
- 1
- Type
- Preprint
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
