InsightPilot: An LLM-Empowered Automated Data Exploration System
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Exploring data is crucial in data analysis, as it helps users understand and interpret the data more effectively.However, performing effective data exploration requires in-depth knowledge of the dataset, the user intent and expertise in data analysis techniques.Not being familiar with either can create obstacles that make the process time-consuming and overwhelming.To address this issue, we introduce InsightPilot, an LLM (Large Language Model)-based, automated data exploration system designed to simplify the data exploration process.Insight-Pilot features a set of carefully designed analysis actions that streamline the data exploration process.Given a natural language question, In-sightPilot collaborates with the LLM to issue a sequence of analysis actions, explore the data and generate insights.We demonstrate the effectiveness of InsightPilot in a user study and a case study, showing how it can help users gain valuable insights from their datasets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Survey of Hallucination in Natural Language Generation
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Madotto, A., & Fung, P. (2023) · ACM Computing Surveys · doi:10.1145/3571730 · Cited by 5,025
Survey of Hallucination in Natural Language Generation
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y., Chen, D., Dai, W., et al. (2022) · arXiv · doi:10.48550/arxiv.2202.03629 · Cited by 4,981
Scaling Instruction-Finetuned Language Models
Chung, H. W., Hou, L., Longpre, S., Zoph, B., Tay, Y., Fedus, W., Li, Y., Wang, X., Dehghani, M., Brahma, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2210.11416 · Cited by 1,441
ReAct: Synergizing Reasoning and Acting in Language Models
Yao, S., Zhao, J., Yu, D., Du, N., Shafran, I., Narasimhan, K., & Cao, Y. (2022) · arXiv · doi:10.48550/arxiv.2210.03629 · Cited by 608
Yu, T., Zhang, R., Yang, K., Yasunaga, M., Wang, D., Li, Z., Ma, J., Li, I., Yao, Q., Roman, S., et al. (2018) · arXiv · doi:10.48550/arxiv.1809.08887 · Cited by 193
Large Language Models are not Fair Evaluators
Wang, P., Li, L., Chen, L., Cai, Z., Zhu, D., Lin, B., Cao, Y., Kong, L., Liu, Q., Liu, T., et al. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.511 · Cited by 138
Binding Language Models in Symbolic Languages
Cheng, Z., Xie, T., Shi, P., Li, C., Nadkarni, R., Hu, Y., Xiong, C., Radev, D., Ostendorf, M., Zettlemoyer, L., et al. (2022) · arXiv · doi:10.48550/arxiv.2210.02875 · Cited by 53 · cited 2×
“Recent studies have shown that with LLM, text-to-SQL can now be augmented to support non-SQL enquiries such as entity extraction (Cheng et al., 2023).”
Large Language Models are not Fair Evaluators
Wang, P., Li, L., Chen, L., Cai, Z., Zhu, D., Lin, B., Cao, Y., Liu, Q., Liu, T., & Sui, Z. (2023) · arXiv · doi:10.48550/arxiv.2305.17926 · Cited by 34
Split and Merge: Aligning Position Biases in LLM-based Evaluators
Li, Z., Wang, C., Ma, P., Wu, D., Wang, S., Gao, C., & Liu, Y. (2023) · arXiv · doi:10.48550/arxiv.2310.01432 · Cited by 26
Self-citation
Cited by
Toward Automated Simulation Research Workflow through LLM Prompt Engineering Design
Liu, Z., Chai, Y., & Li, J. (2025) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.4c01653 · Cited by 24
Developing a Framework for Auditing Large Language Models using Human-in-the-loop
Amirizaniani, M., Lavergne, A., Snell Okada, E., Chadha, A., Roosta, T., & Shah, C. (2025) · Proceedings of the 2025 Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region · doi:10.1145/3767695.3769514 · Cited by 16
Are Small Language Models Ready to Compete with Large Language Models for Practical Applications?
Sinha, N., Jain, V., & Chadha, A. (2025) · Proceedings of the 5th Workshop on Trustworthy NLP (TrustNLP 2025) · doi:10.18653/v1/2025.trustnlp-main.25 · Cited by 9
“Analyzing around 50 papers from 2024, we found that while 82.3% of meth-ods utilized GPT-family LMs, only 41.1% used Llama variants, and less than 11.8% experimented with other alternatives like Mistral (Jiang et al., 2023) and Falcon (Almazrouei et al., 2023).”
InfluentialChen, Y., Xiao, Y., Zinat, K. T., Yamashita, N., Gao, G., & Liu, Z. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713693 · Cited by 2
Metadata
- Authors
- Ma, P., Ding, R., Wang, S., Han, S., & Zhang, D.
- Venue
- Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
- Published
- 2023
- Pages
- 346-352
- OpenAlex
- W4389523621
- Cited by
- 69
- References
- 9
- FWCI
- 7.85
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: InsightPilot: An LLM-Empowered Automated Data Exploration System. https://app.cochat.ai/papers/10.18653/v1/2023.emnlp-demo.31
- The paper
- Ma, P., Ding, R., Wang, S., Han, S., & Zhang, D. (2023). InsightPilot: An LLM-Empowered Automated Data Exploration System. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: System Demonstrations. https://doi.org/10.18653/v1/2023.emnlp-demo.31
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.