The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index; none of the 3 sources its claims cite is checked for support yet.
Learning To Retrieve Prompts for In-Context Learning
Open accessAbstract
In-context learning is a recent paradigm in natural language understanding, where a large pretrained language model (LM) observes a test instance and a few training examples as its input, and directly decodes the output without any update to its parameters.However, performance has been shown to strongly depend on the selected training examples (termed prompts).In this work, we propose an efficient method for retrieving prompts for in-context learning using annotated data and an LM.Given an inputoutput pair, we estimate the probability of the output given the input and a candidate training example as the prompt, and label training examples as positive or negative based on this probability.We then train an efficient dense retriever from this data, which is used to retrieve training examples as prompts at test time.We evaluate our approach on three sequence-tosequence tasks where language utterances are mapped to meaning representations, and find that it substantially outperforms prior work and multiple baselines across the board.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
The paper proposes Efficient Prompt Retrieval (EPR), which uses a language model to label which training examples are good in-context prompts and trains a dense retriever from that signal. EPR substantially outperforms prior prompt-retrieval baselines on BREAK, MTOP, and SMCALFLOW.
Key findings
- With GPT-NEO as both scoring and inference LM, EPR improves over the best baseline from 26.0 to 31.9 on BREAK, from 57.0 to 64.2 on MTOP, and from 51.4 to 54.3 on SMCALFLOW.
- In the one-shot BREAK setting, EPR reaches 23.0 LF-EM, outperforming the best baseline by 8.5 points and BM25-ORACLE by 5 points.
- When GPT-NEO is used as a proxy scoring LM for larger inference LMs, EPR outperforms BM25 and CBR by 2–8 points across all datasets and pretrained models.
- Prompt-copying analysis shows high abstract copying in MTOP and SMCALFLOW (>80%); on MTOP, 84.5% of examples were abstractly copied, and EPR achieved 71.6% EM on that copied subset versus 64.2% overall.
Methods
- EPR generates training data by retrieving candidate prompts with an unsupervised retriever (BM25 or SBERT; BM25 chosen), scoring each candidate with a scoring LM as Prob(y | candidate, x), and labeling top-k as positive and bottom-k as negative (k=5, L=50).
- It trains a dense retriever with DPR-style contrastive learning using BERT-base input and prompt encoders, then uses FAISS maximum inner-product search at inference to retrieve prompts within the inference LM’s context limit.
- Evaluation covers three structured sequence-to-sequence tasks—BREAK, MTOP, and SMCALFLOW—using GPT-NEO as scoring LM and GPT-NEO, GPT-J, GPT-3, or CODEX as inference LMs, with LF-EM/NEM/EM metrics and a 2,048-token context size.
Limitations
- Paper-stated: the authors note that large language models exhibit bias, and since EPR is trained on signal from such LMs, it might also exhibit these biases.
- Paper-stated: the method scores each training example independently at training time, while at test time the LM observes a sequence of examples; modeling dependence between examples is left to future work.
- Evident from the text: evaluation is limited to three English structured tasks mapping utterances to meaning representations, and the approach relies on a scoring LM as a proxy for the inference LM.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
19 Own result · 11 Own interpretation · 6 No basis given · 3 Not checked yet
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Table 3 shows test results on BREAK and MTOP corroborating that EPR substantially improves performance compared to BM25 and CBR.”
§ Learning To Retrieve Prompts for In-Context Learning > Model
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“BM25 outperforms SBERT for prompt retrieval, and consequently we use BM25 in all of our supervised approaches to retrieve the set of candidates, Ē.”
§ Learning To Retrieve Prompts for In-Context Learning > Model
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“EPR substantially outperforms all other baselines.”
§ Learning To Retrieve Prompts for In-Context Learning > Model
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: The candidate set Ē includes good prompt candidates and hard negatives.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“CODEX outperforms GPT-3, which can be explained by the fact that it was trained on code, and our datasets involve mapping to programs or meaning representations.”
§ Learning To Retrieve Prompts for In-Context Learning > Model
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Moreover, accuracy on examples where copying occurred is much higher compared to accuracy where no copying happened.”
§ Learning To Retrieve Prompts for In-Context Learning > Prompt copying
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We test the effect of k, the number of prompts labeled as positive or negative, and L, the number of prompts retrieved by the unsupervised retriever.Table 8 shows that performance is is generally robust w.r.t these hyperparameters.”
- Also stated in: § Additional information · plain
“In the LM-as-a-service setup, using GPT-Neo, we search for other values for L and k, and note that the choice of our hyperparameters is robust.”
§ Learning To Retrieve Prompts for In-Context Learning > Additional information
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Additional information · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For the unsupervised methods, the RANDOM baseline shows that random sampling of training examples leads to poor performance.”
§ Learning To Retrieve Prompts for In-Context Learning > Model
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“When the scoring LM and inference LM are identical (using GPT-NEO (Black et al., 2021)), performance compared to the best baseline improves from 26% to 31.9% on BREAK, from 57% to 64.2% on MTOP, and from 51.4% to 54.3% on SMCALFLOW.”
- Also stated in: § Model · plain
“Specifically, when comparing to the best baseline, it improves performance from 26.0 to 31.9 on BREAK, from 57.0 to 64.2 on MTOP, and from 51.4 to 54.3 on SMCALFLOW.”
§ Learning To Retrieve Prompts for In-Context Learning > Similar examples
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Model · plain
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Analogously, when using CODEX as the scoring LM and inference LM performance remains roughly the same: 29.5→29.3.”
§ Learning To Retrieve Prompts for In-Context Learning > Model
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We evaluate our approach on three sequence-tosequence tasks where language utterances are mapped to meaning representations, and find that it substantially outperforms prior work and multiple baselines across the board.”
- Also stated in: § Similar examples · plain
“We observe that EPR substantially improves performance compared to prior work on prompt retrieval.”
§ Learning To Retrieve Prompts for In-Context Learning > Abstract
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Similar examples · plain
- It may state two separate claims as one. 10
- Probably not a substantial claim. 5
- The quote only partly states this claim. 1
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ANYCORRECT-ORACLE reaches 53.6%, 20 points above LM-ORACLE.”
§ Learning To Retrieve Prompts for In-Context Learning > Model
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For both, we experimented with passing the retriever the training pair (x, y) or the target sequence y only, and found that using y leads to slightly higher performance.”
§ Learning To Retrieve Prompts for In-Context Learning > 3.1 Generating the Training Data
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Interestingly, EPR outperforms BM25-ORACLE on MTOP and SMCALFLOW and is comparable on BREAK.”
§ Learning To Retrieve Prompts for In-Context Learning > Model
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“All training examples retrieved by EPR perform an argmax (argmin in the original utterance), and return in the final step”
§ Learning To Retrieve Prompts for In-Context Learning > Model
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one. The quote only partly states this claim.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Zooming in on different inference LMs, GPT-J performs slightly better than GPT-NEO across the board, since it was trained on the same data and using the same procedure as GPT-NEO.”
§ Learning To Retrieve Prompts for In-Context Learning > Model
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Indeed, EPR outperforms the best baseline by 8.5%, and BM25-ORACLE by 5%.”
§ Learning To Retrieve Prompts for In-Context Learning > Model
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For example, on MTOP, 84.5% of the examples were abstractly copied, and on that subset of examples, EPR achieves 71.6% EM, compared to 64.2% on the entire validation set.”
§ Learning To Retrieve Prompts for In-Context Learning > Prompt copying
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Surprisingly, GPT-J outperforms CODEX (except on MTOP) and GPT-3 despite being 30x smaller.”
§ Learning To Retrieve Prompts for In-Context Learning > Model
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Tables 9, 10, and 11 provide more examples for cases where EPR is correct while CBR is incorrect along with the top-3 prompts for each method.”
- Also stated in: § 6 Conclusions · plain
“An example from MTOP development set where EPR is correct and CBR is incorrect along with the top-3 training examples retrieved from each retriever.”
- Also stated in: § 6 Conclusions · plain
“An example from SMCALFLOW development set where EPR is correct and CBR is incorrect along with the top-3 training examples retrieved from each retriever.”
§ Learning To Retrieve Prompts for In-Context Learning > Additional information
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Also stated in: § 6 Conclusions · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We observe that the rate of copying is much higher in MTOP and SM-CALFLOW compared to BREAK, where in MTOP and SMCALFLOW abstract copying reaches more than 80%.”
§ Learning To Retrieve Prompts for In-Context Learning > Prompt copying
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Large language models have been shown to exhibit various kinds of bias (Bender et al., 2021)”
§ Learning To Retrieve Prompts for In-Context Learning > Additional information
What the sources say
- Not checked yetcites Bender et al., 2021
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“since EPR is trained on the signal obtained from such large LMs, it might also exhibit these biases.”
§ Learning To Retrieve Prompts for In-Context Learning > Additional information
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“On BREAK, we evaluate performance on the development set with LF-EM (Hasson and Berant, 2021), which is a better metric compared to Normalized Exact Match (NEM), the official metric, as it measures whether two meaning representations are semantically equivalent.”
§ Learning To Retrieve Prompts for In-Context Learning > 4.3 Experimental Details
What the sources say
- Not checked yetcites Hasson and Berant, 2021
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The performance of LM-ORACLE is substantially higher than EPR, showing that the supervision provided by the scoring LM is strong, and training a better retriever from this signal can substantially enhance performance.”
§ Learning To Retrieve Prompts for In-Context Learning > Model
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“shows that EPR captures both lexical and structure similarity.”
§ Learning To Retrieve Prompts for In-Context Learning > Model
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The authors state this as an assumption.
The candidate set Ē includes good prompt candidates and hard negatives.
“This should lead to relevant positive examples, assuming that the set of candidates, Ē includes good prompt candidates and hard negatives, since all candidates have high similarity with (x, y) according to R u (y, D).”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Although instance-level demonstrations generally perform better than task-level demonstrations, it requires a labeled training set in advance for retrieval.”
From What Makes Good In-Context Demonstrations for Code Intelligence Tasks with LLMs? (2023) · cites this paper as [32]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Retrieval allows LLMs to access databases, mitigating hallucinations (Li et al. 2022;Wang, Yang, and Wei 2023;Rubin, Herzig, and Berant 2022;Liu et al. 2022).”
From Expel: LLM agents are experiential learners (2024) · cites this paper as Rubin, Herzig, and Berant 2022
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Recent work has demonstrated that retrieval-based mechanisms can improve language models for various tasks requiring factual or procedural knowledge (Liu et al., 2021;Poesia et al., 2021;Rubin et al., 2022;Madaan et al., 2022;Shrivastava et al., 2023).”
From Learning Performance-Improving Code Edits (2023) · cites this paper as Rubin et al., 2022
In the citing paper
“earlier research has showed several positive pedagogical impacts of using NLP-based social conversational agents on children's perception of their own competencies and their attitudes towards learning ([51]).”
From GPT-3-Driven Pedagogical Agents to Train Children’s Curious Question-Asking Skills (2024) · cites this paper as [51]
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Reimers, N., & Gurevych, I. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1410 · Cited by 12,778
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2023) · ACM Computing Surveys · doi:10.1145/3560815 · Cited by 4,361
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2021) · arXiv · doi:10.48550/arxiv.2107.13586 · Cited by 4,352
Billion-scale similarity search with GPUs
Johnson, J., Douze, M., & Jegou, H. (2021) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2019.2921572 · Cited by 4,228
Ankerst, M. (1999) · doi:10.1145/304181.304187 · Cited by 3,982
Research works printed but not linked: 2
- Geoffrey E. Hinton and Sam T. Roweis. 2002. Stochas- tic neighbor embedding. In NIPS.
- Urvashi Khandelwal, Angela Fan, Dan Jurafsky, Luke Zettlemoyer, and Mike Lewis. 2021. Nearest Neigh- bor Machine Translation. In Proceedings of ICLR.
Cited by
Sorted by citations
Items 201–300 of 387
The Strong Pull of Prior Knowledge in Large Language Models and Its Impact on Emotion Recognition
Chochlakis, G., Potamianos, A., Lerman, K., & Narayanan, S. S. (2024) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii63134.2024.00041 · Cited by 11
Wang, S., Jean, S., Sengupta, S., Gung, J., Παππάς, Ν., & Zhang, Y. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.478 · Cited by 7
SEER : A Knapsack approach to Exemplar Selection for In-Context HybridQA
Tonglet, J., Reusens, M., Borchert, P., & Baesens, B. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.837 · Cited by 8
Who Knows the Answer? Finding the Best Model and Prompt for Each Query Using Confidence-Based Search
Gerych, W., Rizk, Y., Isahagian, V., Muthusamy, V., Duesterwald, E., & Venkateswaran, P. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29763 · Cited by 5
Large Language Models for Few-Shot Automatic Term Extraction
Banerjee, S., Chakravarthi, B. R., & McCrae, J. P. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-70239-6_10 · Cited by 5
Dental Loop Chatbot: A Prototype Large Language Model Framework for Dentistry
Arian, M. S. H., Sifat, F. A., Ahmed, S., Mohammed, N., Farook, T. H., & Dudley, J. (2024) · Software · doi:10.3390/software3040029 · Cited by 6
Han, L., Pan, S., Xing, Z., Sun, J., Yitagesu, S., Zhang, X., & Feng, Z. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3523284 · Cited by 5
Fan, C., Tian, J., Li, Y., Chen, W., He, H., & Jin, Y. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.913 · Cited by 8
LLM-enhanced multi-level knowledge distillation for molecular property prediction
Zhuang, L., Sun, Y., Jun, Z., Lu, Y., & Wang, H. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.114195 · Cited by 4
Variational Dehallucination via Retrieval-Augmented Prompt Learning
Lin, H.-Y., Chang, Y.-C., & Chien, J. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3646477 · Cited by 4
Automatic Evaluation of Programming Tasks Supported by Language Models
Karsa, Z. I., & Goldschmidt, B. (2025) · IEEE Access · doi:10.1109/access.2025.3601448 · Cited by 6
Structural chain of thoughts for radiology education
Awasthi, A., Chung, B., Vu, A. M., Khan, S. B., Le, N., Deng, Z., Agrawal, R., Wu, C. C., & Nguyen, H. V. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.114433 · Cited by 4
Generative Calibration for In-context Learning
Jiang, Z., Zhang, Y., Cao, L., Zhao, J., & Liu, K. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.152 · Cited by 14
Ye, S., Jang, J., Kim, D., Jo, Y., & Seo, M. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.822 · Cited by 10
Large Language Models for SoC Security
Tehranipoor, M. M., Azar, K. Z., Asadizanjani, N., Rahman, F., Kamali, H. M., & Farahmandi, F. (2024) · Springer eBooks · doi:10.1007/978-3-031-58687-3_6 · Cited by 5
Li, B., Liu, T., Ma, J., Dai, J., & Liao, P. (2025) · Computer Networks · doi:10.1016/j.comnet.2025.111074 · Cited by 4
Application of Large Language Model and In-Context Learning for Aviation Safety Prediction
Yang, Y., Shi, D., Zurada, J. M., & Guan, J. (2024) · International Conference on Advanced Computer Theory and Engineering · doi:10.1109/icacte62428.2024.10871713 · Cited by 4
Enhancements in Data Querying: Applying MMR-Integrated In-Context Learning to LLM-based Text-to-SQL
Li, J., Huang, M., Zhenyu, Z., & Chuniie, Y. (2024) · China Automation Congress (CAC) · doi:10.1109/cac63892.2024.10865575 · Cited by 4
Chochlakis, G., Pandiyan, N. M., Lerman, K., & Narayanan, S. S. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887804 · Cited by 15
Current Trends and Future Prospects of Large-Scale Foundation Model in K-12 Education
Zhu, Q., Wang, M., Zhang, T., & Huang, H. (2025) · Frontiers of digital education. · doi:10.1007/s44366-025-0059-6 · Cited by 5
Haji, S., Suekane, K., Sano, H., & Takagi, T. (2023) · IEEE International Conference on Semantic Computing (ICSC) · doi:10.1109/icsc56153.2023.00036 · Cited by 4
In-Context Demonstration Selection with Cross Entropy Difference
Iter, D., Pryzant, R., Xu, R., Wang, S., Liu, Y., Yi‐chong, X., & Zhu, C. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.81 · Cited by 13
CTQScorer: Combining Multiple Features for In-context Example Selection for Machine Translation
Aswanth, M., Puduppully, R., Dabre, R., & Kunchukuttan, A. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.519 · Cited by 9
Kunstmann, H., Ollier, J., Persson, J., & von Wangenheim, F. (2026) · ACM Transactions on Recommender Systems · doi:10.1145/3803546 · Cited by 3
Leveraging shortest dependency paths in low-resource biomedical relation extraction
Enayati, S., & Vučetić, S. (2024) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-024-02592-2 · Cited by 3
Pan, D., Sun, Y., Xu, B., Li, J., Yang, Z., Luo, L., Lin, H., & Wang, J. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3578781 · Cited by 3
Exploring the Role of Diversity in Example Selection for In-Context Learning
Kapuriya, J., Kaushik, M., Ganguly, D., & Bhatia, S. (2025) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3726302.3730194 · Cited by 5
LLMs as Test Generators: A Comparative Benchmarking Study
da Silva, E. C. H., Coelho, R. D. S., & da Silva, L. F. (2025) · Simpósio Brasileiro de Engenharia de Software (SBES) · doi:10.5753/sbes.2025.9618 · Cited by 3
DemoShapley: Valuation of Demonstrations for In-Context Learning
Xie, S., Luo, M., Stern, C., Du, M.-N., & Lu, C. (2024) · BigData Congress [Services Society] · doi:10.1109/bigdata66926.2025.11402298 · Cited by 8
RegaVAE: A Retrieval-Augmented Gaussian Mixture Variational Auto-Encoder for Language Modeling
Deng, J., Pang, L., Shen, H., & Cheng, X. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.164 · Cited by 9
Wang, Q., Ding, K., Luo, X., & Xu, R. (2024) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3626772.3657932 · Cited by 3
Defect Correction Method for Software Requirements Text Using Large Language Models
Zhang, L., Ouyang, L., & Xu, Z. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10651284 · Cited by 3
E-InMeMo: Enhanced Prompting for Visual In-Context Learning
Zhang, J., Wang, B., Liu, H., Li, L., Nakashima, Y., & Nagahara, H. (2025) · Journal of Imaging · doi:10.3390/jimaging11070232 · Cited by 4
Segment Anything in Context with Vision Foundation Models
Liu, Y., Zhu, M., Chen, H., Wang, X., Feng, B., Wang, H., Li, S., Vemulapalli, R., & Shen, C. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02517-0 · Cited by 3
Monotonicity Reasoning in the Age of Neural Foundation Models
Chen, Z., & Gao, Q. (2023) · Journal of Logic Language and Information · doi:10.1007/s10849-023-09411-3 · Cited by 3
Input-oriented demonstration learning for hybrid evidence fact verification
Chen, C., Chen, W., Zheng, J., Luo, A., Cai, F., & Zhang, Y. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.123191 · Cited by 5
Design and Development of a Log Management System Based on Cloud Native Architecture
Sun, Y., Chen, Y., Zhao, H., & Peng, S. (2023) · International Conference on Systems and Informatics (ICSAI) · doi:10.1109/icsai61474.2023.10423328 · Cited by 3
Domain-Specific Few-Shot Table Prompt Question Answering via Contrastive Exemplar Selection
Mo, T., Xiao, Q., Zhang, H., Li, R., & Wu, Y. (2024) · Algorithms · doi:10.3390/a17070278 · Cited by 3
Shahid, A. R., Hasan, S. M., Kankanamge, M. W., Hossain, M. Z., & Imteaj, A. (2024) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac61105.2024.00351 · Cited by 3
RAICL-DSC: Retrieval-Augmented In-Context Learning for Dialogue State Correction
Su, H., Xie, H., Shi, J., Wu, D., Jiang, L., Huang, H., He, Z., Li, Y., Fang, R., Zhao, J., et al. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113423 · Cited by 4
Long-Tailed Question Answering in an Open World
Dai, Y. Q., Lang, H., Zheng, Y., Huang, F., & Li, Y. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.351 · Cited by 6
Pu, J., Cheng, L., Fan, L., Lv, T., & Zhang, R. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.590 · Cited by 2
COSTELLO: Contrastive Testing for Embedding-Based Large Language Model as a Service Embeddings
Jiang, W., Zhai, J., Ma, S., Zhang, X., & Shen, C. Q. (2024) · Proceedings of the ACM on software engineering. · doi:10.1145/3643767 · Cited by 3
Guo, S., Liu, H., Chen, X., Xie, Y., Zhang, L., Han, T., Chen, H., Chang, Y., & Wang, Y.-X. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3711896.3737254 · Cited by 3
Zhao, Z., Qu, C., Dou, Z., Chen, H., & Jin, J. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3711896.3737104 · Cited by 2
GraphPrompter: Multi-Stage Adaptive Prompt Optimization for Graph In-Context Learning
Lv, R., Zhang, Z., Zhang, K., Liu, Q., Gao, W., Liu, J., Yan, J. X., Yue, L., & Yao, F. (2025) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde65448.2025.00292 · Cited by 2
Zero-Shot Knowledge-Based Visual Question Answering with Frozen Language Models
Liu, J., Zhang, L., Cao, C., Shi, Y., Mu, C., & Li, J. (2025) · Big Data Mining and Analytics · doi:10.26599/bdma.2025.9020032 · Cited by 2
Schuck, A. D. F., Garcia, G. L., Manesco, J. R. R., Paiola, P. H., & Papa, J. P. (2025) · Journal of the Brazilian Computer Society · doi:10.5753/jbcs.2025.5793 · Cited by 4
Lee, J., Shang, T., Baik, J. Y., Duong-Tran, D., Yang, S., Li, L., & Shen, L. (2026) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1007/s41666-026-00241-z · Cited by 16
Multi-Source Multi-Type Knowledge Exploration and Exploitation for Dialogue Generation
Ni, X., Dai, H., Ren, Z., & Li, P. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.771 · Cited by 2
Rajpoot, P. K., & Parikh, A. P. (2023) · doi:10.18653/v1/2023.pandl-1.1 · Cited by 2
HICL: Hashtag-Driven In-Context Learning for Social Media Natural Language Understanding
Tan, H., Xu, C., Li, J., Zhang, Y., Fang, Z., Chen, Z., & Lai, B. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3384987 · Cited by 5
Learning Chain of Counterfactual Thought for Bias-Robust Vision-Language Reasoning
Zhang, Y., Jiang, M. X., & Zhao, Q. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73242-3_19 · Cited by 2
MQuA: Multi-level Query-Video Augmentation for Multilingual Video Corpus Retrieval
Yu, G., Bi, X., Tang, J., Gu, M., Chen, T., Li, Z., & Zhu, M. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-9443-0_31 · Cited by 2
Lee, H., Yang, M., & Jeong, J. (2025) · International Conference on Advanced Communications Technology (ICACT) · doi:10.23919/icact63878.2025.10936654 · Cited by 2
PEDRO: Parameter-Efficient Fine-Tuning with Prompt DEpenDent Representation MOdification
Xie, T., Li, T., Zhu, W., & Han, W. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-6603-4_18 · Cited by 23
Hijacking Large Language Models via Adversarial In-Context Learning
Zhou, X., Yao, Q., Zade, S. Z., Khanduri, P., & Zhu, D. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37673-2_13 · Cited by 49
Incorporating Task-Specific Concept Knowledge into Script Learning
Sun, C., Xu, T. J., Zhai, C., & Ji, H. (2023) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.220 · Cited by 5
Span-Based Fine-Grained Entity-Relation Extraction via Sub-Prompts Combination
Yu, N., Liu, J., & Shi, Y. (2023) · Applied Sciences · doi:10.3390/app13021159 · Cited by 2
Distilling Mathematical Reasoning Capabilities into Small Language ModelsPreprint
Zhu, X., Li, J., Liu, Y., Ma, C., & Wang, W. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4782551 · Cited by 2
Combination Learning for Few-Shot SegmentationPreprint
Li, S., Liu, F., Jiao, L., Li, L., Liu, X., & Chen, P. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4815121 · Cited by 2
Leong, H. Y., & Wu, Y. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5276004 · Cited by 6
INMS: Memory Sharing for Large Language Model based Agents
Gao, H., & Zhang, Y. (2024) · arXiv · doi:10.48550/arxiv.2404.09982 · Cited by 2
Does Few-Shot Learning Help LLM Performance in Code Synthesis?
Xu, D., Xie, T., Xia, B., Li, H., Bai, Y., Sun, Y., & Wang, W. (2024) · arXiv · doi:10.48550/arxiv.2412.02906 · Cited by 3
“This has driven advances in example construction (Chan et al., 2022), mechanism exploration (Rubin et al., 2021), and reliability improvement (Gao and Das, 2024).”
Similarity-Based Prompt Construction for Large Language Model in Medical Tasks
Liu, G., Pan, M., Ma, Z., Gu, M., Yang, L., & Qin, J. (2024) · Communications in computer and information science · doi:10.1007/978-981-97-1717-0_6 · Cited by 1
Pragmatic inference and mapping for conversational implicature
Hu, J., Liu, Y., Ma, L., Zhang, W.-N., & Liu, T. (2025) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-025-02741-7 · Cited by 2
Tailoring the Shapley Value for In-Context Example Selection Towards Data Wrangling
Liang, Z., Wang, H., Ding, X., Liang, Z., Liang, C., Tang, Y., & Qi, J. (2025) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde65448.2025.00173 · Cited by 1
To Theoretically Understand Transformer-Based In-Context Learning for Optimizing CSMA
Hao, S., Li, H., & Duan, L. (2025) · ACM International Symposium on Theory, Algorithmic Foundations, and Protocol Design for Mobile Networks and Mobile Computing (MobiHoc) · doi:10.1145/3704413.3764423 · Cited by 1
Self-Relevance-Based Multimodal In-Context Learning for Multimodal Named Entity Recognition
Zhang, Z., Xu, B., Yang, M., Cao, H., Zhu, C., Lü, W., & Zhao, T. (2025) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme59968.2025.11209093 · Cited by 1
Guidelines-Enhanced ICL with Examples Selection for Document-Level Event Argument Extraction
Guo, Y., Liu, X., & Wu, B. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11228156 · Cited by 1
Word Structure Embedding and In-Context Learning for Chinese Segmentation
Xu, Z., & Xiang, Y. (2025) · IEEE Access · doi:10.1109/access.2025.3637299 · Cited by 1
Li, R., Cui, M., Wang, B., Wang, Y., & Miao, Q. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.112812 · Cited by 3
Zhou, Y., Zhang, S., & Wang, M. (2026) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2026.3654059 · Cited by 1
Dual-Channel Retrieval-Augmented In-Context Learning for Comparative Opinion Mining
Gui, W., Yang, Z., Xu, F., Yan, H., Xu, F., & Xia, R. (2026) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2026.3656970 · Cited by 1
Fair In-Context Learning via Latent Concept Variables
Bhaila, K., Van, M.-H., Edemacu, K., Zhao, C., Chen, F., & Wu, X.-T. (2024) · BigData Congress [Services Society] · doi:10.1109/bigdata66926.2025.11402286 · Cited by 7
Sakib, A. S., Hurst, A., & SAFAYENI, F. R. (2026) · Artificial intelligence for engineering design analysis and manufacturing · doi:10.1017/s0890060426100250 · Cited by 1
Ge, Y., Guo, Y., Das, S., & Sarker, A. (2026) · npj Artificial Intelligence · doi:10.1038/s44387-025-00062-2 · Cited by 6
Towards Language Model Guided $$\text {TLA}^{+}$$ Proof Automation
Zhou, Y., & Tripakis, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-26204-2_32 · Cited by 1
Ahmadpanah, S. H. (2026) · Scientific Reports · doi:10.1038/s41598-026-55561-2 · Cited by 1
Diaz-Santos, A., & Socha, K. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818313 · Cited by 1
Lovón-Melgarejo, J., Mouysset, M., Oleiwan, J., Moreno, J. G., Damase‐Michel, C., & Tamine, L. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-88711-6_10 · Cited by 6
Differentiable Instruction Optimization for Cross-Task Generalization
Isonuma, M., Mori, J., & Sakata, I. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.667 · Cited by 1
Event-Centric Opinion Mining via In-Context Learning with ChatGPT
Wu, L., Chen, Y., Yang, J., Shi, G., Qi, X., & Deng, S. (2023) · Communications in computer and information science · doi:10.1007/978-981-99-7224-1_7 · Cited by 1
SwarMind: Harnessing Large Language Models for Flock Dynamics
Mounsif, M., Zehnder, K., Motie, Y., & Adam-Gaxotte, Z. (2023) · International Conference on Soft Computing & Machine Intelligence (ISCMI) · doi:10.1109/iscmi59957.2023.10458573 · Cited by 1
Distilling Multi-Step Reasoning Capabilities into Smaller Language Model
Yim, Y., & Wang, Z. (2024) · International Conference on Machine Learning and Computing (ICMLC) · doi:10.1145/3651671.3651737 · Cited by 1
Du, Y., Zhang, Q., Fu, S., Hou, Y., & Han, H. (2025) · The Journal of Supercomputing · doi:10.1007/s11227-025-07214-w · Cited by 1
Lovón-Melgarejo, J., Mouysset, M., Oleiwan, J., Moreno, J. G., Damase‐Michel, C., & Tamine, L. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2501.09384 · Cited by 1
Liao, Y., Franco, Z., Lizarraga Mazaba, J. E., & Chen, K. (2026) · Proceedings of the 17th ACM International Conference on Bioinformatics, Computational Biology and Health Informatics · doi:10.1145/3807503.3819453 · Cited by 1
Post-Incorporating Code Structural Knowledge Into Pretrained Models via ICL for Code Translation
Du, Y., Sun, H., & Li, M. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3605768
Mounsif, M., Jauvion, B., & Medard, F. (2023) · International Conference on Artificial Intelligence, Soft Computing and Applications (AIAPP) · doi:10.5121/csit.2023.132210
Retrieval-Augmented Parsing for Complex Graphs by Exploiting Structure and Uncertainty
Zi, L., Yuan, Q., Pasupat, P., Liu, J. Z., & Shang, J. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.419
Machine Reading Comprehension using Case-based Reasoning
Thai, D., Agarwal, D., Chaudhary, M., Zhao, W., Das, R., Lee, J. Y., Hajishirzi, H., Zaheer, M., & McCallum, A. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.564 · Cited by 4
Improving Input-label Mapping with Demonstration Replay for In-context Learning
Gong, Z., Liu, J., Wang, Q., Wang, J., Cai, X., Zhao, D., & Yan, R. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.995 · Cited by 2
Enhancing Reasoning Pathways for Power Defect Analysis Using CoT and Role-Play Prompt
Xu, J., Cao, X., Li, T., He, F., Yao, S., Jia, B., Zhang, H., & Cai, S. (2024) · Communications in computer and information science · doi:10.1007/978-981-97-0827-7_30 · Cited by 1
Yan, T., Zhang, Y., Han, J., Liu, Z., Barnhart, W. R., Sun, S., Zhou, J., Ji, F., & He, J. (2024) · doi:10.2196/preprints.58054
Few-Shot Adaptation for Parsing Contextual Utterances with LLMs
Lin, K., Xia, P., & Fang, H. (2023) · doi:10.18653/v1/2023.findings-ijcnlp.31
Metadata
- Authors
- Rubin, O., Herzig, J., & Berant, J.
- Affiliations
- Tel Aviv University (IL)
- Venue
- Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
- Published
- 2022
- Pages
- 2655-2671
- OpenAlex
- W4287891464
- Semantic Scholar
- f9838a3be5c94bb2674a0e224de349b50e18f3c4
- Cited by
- 374
- References
- 54
- Citations by year
- 2026: 57 · 2025: 97 · 2024: 91 · 2023: 119 · 2022: 10
- FWCI
- 43.96
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Funders
- European Commission
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- in-context learning, dense retrievers, training data selection, pre-trained language models, annotated dataset, meaning representation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-06, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-06 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
