CoChat
Sign Up
PreprintCited by 2

The DOI matches its DataCite record; 1 of the 1 references it cites were found in a registry or an index.

D-SMART: Enhancing LLM Dialogue Consistency via Dynamic Structured Memory And Reasoning Tree

Lei, Xiang, Li, Qin, Zhang, Min, Zhang, Min·2025·arXiv
DOI 10.48550/arxiv.2510.13363arXiv 2510.13363
Open this paper in CoChat — free account

Abstract

Large Language Models (LLMs) often exhibit factual inconsistencies and logical decay in extended, multi-turn dialogues, a challenge stemming from their reliance on static, pre-trained knowledge and an inability to reason adaptively over the dialogue history. Prevailing mitigation strategies, such as Retrieval-Augmented Generation (RAG) and agentic working memories, improve information recall but still engage with fundamentally static knowledge sources and follow pre-defined single reasoning path. This hinders their ability to preserve factual and logical consistency of their responses in multi-turn dialogues while the context evolves over time. To address this issue, we propose D-SMART, a model-agnostic framework designed to maintain multi-turn dialogue consistency by enabling LLMs to build and reason over a dynamic, structured representation of the conversational context. This is achieved via two synergistic components: (1) a Dynamic Structured Memory (DSM), which incrementally constructs and maintains an authoritative, OWL-compliant knowledge graph of the conversation; and (2) a Reasoning Tree (RT), which executes inferences as an explicit and traceable multi-step search over the graph. As the popular-used quality score (judged by GPT-4) can overlook logical flaws, we introduce new NLI-based metrics to better measure multi-turn dialogue consistency. Comprehensive experiments on the MT-Bench-101 benchmark show that D-SMART significantly outperforms state-of-the-art baselines, elevating the dialogue consistency score by over 48\% for both proprietary and open-source models, and notably improves the quality score of the latter by up to 10.1\%.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2510.13363

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

  • LLMs Get Lost In Multi-Turn Conversation

    Laban, P., Hayashi, H., Zhou, Y., & Neville, J. (2025) · arXiv · Cited by 419 · cited 1×

    “This can lead to difficulties in resolving context ambiguity, managing conflicts between the model’s internal knowledge and newly introduced dialogue-specific facts (Xu et al. 2024a), and preventing the propagation of errors from early misunderstandings (Laban et al. 2025).”

Show all 1 references

Research works printed but not linked: 37

  1. Agrawal, G.; Kumarage, T.; Alghamdi, Z.; and Liu, H. 2024. Can Knowledge Graphs Reduce Hallucinations in LLMs? : A Survey. In Duh, K.; Gomez, H.; and Bethard, S., eds., Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 3947-3960. Mexico City, Mexico: Association for Compu- tational Linguistics.
  2. Bai, G.; Liu, J.; Bu, X.; He, Y.; Liu, J.; Zhou, Z.; Lin, Z.; Su, W.; Ge, T.; Zheng, B.; and Ouyang, W. 2024. MT-Bench- 101: A Fine-Grained Benchmark for Evaluating Large Lan- guage Models in Multi-Turn Dialogues. In Ku, L.-W.; Mar- tins, A.; and Srikumar, V., eds., Proceedings of the 62nd An- nual Meeting of the Association for Computational Linguis- tics (Volume 1: Long Papers), 7421-7454. Bangkok, Thai- land: Association for Computational Linguistics.
  3. Bosselut, A.; Le Bras, R.; and Choi, Y. 2021. Dynamic neuro-symbolic knowledge graph construction for zero- shot commonsense question answering. In Proceedings of the AAAI conference on Artificial Intelligence, volume 35, 4923-4931.
  4. Chaudhuri, D.; Rony, M. R. A. H.; and Lehmann, J. 2021. Grounding dialogue systems via knowledge graph aware de- coding with pre-trained transformers. In European Semantic Web Conference, 323-339. Springer.
  5. Chen, N.; Li, H.; Chang, J.; Huang, J.; Wang, B.; and Li, J. 2025. Compress to Impress: Unleashing the Potential of Compressive Memory in Real-World Long-Term Conver- sations. In Rambow, O.; Wanner, L.; Apidianaki, M.; Al- Khalifa, H.; Eugenio, B. D.; and Schockaert, S., eds., Pro- ceedings of the 31st International Conference on Computa- tional Linguistics, 755-773. Abu Dhabi, UAE: Association for Computational Linguistics.
  6. Cheng, X.; Luo, D.; Chen, X.; Liu, L.; Zhao, D.; and Yan, R. 2023. Lift yourself up: Retrieval-augmented text gener- ation with self-memory. Advances in Neural Information Processing Systems, 36: 43780-43799.
  7. Chhikara, P.; Khant, D.; Aryan, S.; Singh, T.; and Yadav, D. 2025. Mem0: Building production-ready ai agents with scal- able long-term memory. arXiv preprint arXiv:2504.19413. · arXiv
  8. Das, R.; Munkhdalai, T.; Yuan, X.; Trischler, A.; and Mc- Callum, A. 2018. Building dynamic knowledge graphs from text using machine reading comprehension. arXiv preprint arXiv:1810.05682. · arXiv
  9. De Giorgis, S.; Gangemi, A.; and Russo, A. 2025. Neu- rosymbolic graph enrichment for Grounded World Models. Information Processing & Management, 62(4): 104127.
  10. Gangemi, A.; Graciotti, A.; Meloni, A.; Nuzzolese, A. G.; Presutti, V.; Reforgiato Recupero, D.; and Russo, A. 2025. py-amr2fred: A Python Library for Converting Text into OWL-Compliant RDF KGs. In Curry, E.; Acosta, M.; Poveda-Villalón, M.; van Erp, M.; Ojo, A.; Hose, K.; Shimizu, C.; and Lisena, P., eds., The Semantic Web, 65- 83. Cham: Springer Nature Switzerland. ISBN 978-3-031- 94578-6.
  11. Gao, Y.; Xiong, Y.; Gao, X.; Jia, K.; Pan, J.; Bi, Y.; Dai, Y.; Sun, J.; Wang, H.; and Wang, H. 2023. Retrieval-augmented generation for large language models: A survey. arXiv preprint arXiv:2312.10997, 2(1). · arXiv
  12. Hixon, B.; Clark, P.; and Hajishirzi, H. 2015. Learning Knowledge Graphs for Question Answering through Con- versational Dialog. In Mihalcea, R.; Chai, J.; and Sarkar, A., eds., Proceedings of the 2015 Conference of the North Amer- ican Chapter of the Association for Computational Linguis- tics: Human Language Technologies, 851-861. Denver, Col- orado: Association for Computational Linguistics.
  13. Hu, X.; Chen, J.; Li, X.; Guo, Y.; Wen, L.; Yu, P. S.; and Guo, Z. 2024. Towards understanding factual knowledge of large language models. In The Twelfth International Conference on Learning Representations.
  14. Huang, L.; Yu, W.; Ma, W.; Zhong, W.; Feng, Z.; Wang, H.; Chen, Q.; Peng, W.; Feng, X.; Qin, B.; and Liu, T. 2025. A Survey on Hallucination in Large Language Models: Prin- ciples, Taxonomy, Challenges, and Open Questions. ACM Trans. Inf. Syst., 43(2).
  15. Jiang, J.; Zhou, K.; Dong, Z.; Ye, K.; Zhao, X.; and Wen, J.- R. 2023. StructGPT: A General Framework for Large Lan- guage Model to Reason over Structured Data. In Bouamor, H.; Pino, J.; and Bali, K., eds., Proceedings of the 2023 Con- ference on Empirical Methods in Natural Language Pro- cessing, 9237-9251. Singapore: Association for Computa- tional Linguistics.
  16. Laird, J. E.; Newell, A.; and Rosenbloom, P. S. 1987. SOAR: An architecture for general intelligence. Artificial Intelli- gence, 33(1): 1-64.
  17. Li, J.; Yang, Y.; Bai, Y.; Zhou, X.; Li, Y.; Sun, H.; Liu, Y.; Si, X.; Ye, Y.; Wu, Y.; et al. 2024. Fundamental capabilities of large language models and their applications in domain sce- narios: A survey. In Proceedings of the 62nd Annual Meet- ing of the Association for Computational Linguistics (Vol- ume 1: Long Papers), 11116-11141.
  18. Liu, B.; Ash, J.; Goel, S.; Krishnamurthy, A.; and Zhang, C. 2023. Exposing attention glitches with flip-flop language modeling. Advances in Neural Information Processing Sys- tems, 36: 25549-25583.
  19. Liu, N. F.; Lin, K.; Hewitt, J.; Paranjape, A.; Bevilacqua, M.; Petroni, F.; and Liang, P. 2024. Lost in the Middle: How Language Models Use Long Contexts. Transactions of the Association for Computational Linguistics, 12: 157-173.
  20. Liu, Q.; Yogatama, D.; and Blunsom, P. 2022. Relational Memory-Augmented Language Models. Transactions of the Association for Computational Linguistics, 10: 555-572.
  21. Logan, R.; Liu, N. F.; Peters, M. E.; Gardner, M.; and Singh, S. 2019. Barack's Wife Hillary: Using Knowledge Graphs for Fact-Aware Language Modeling. In Korhonen, A.; Traum, D.; and Màrquez, L., eds., Proceedings of the 57th Annual Meeting of the Association for Computational Lin- guistics, 5962-5971. Florence, Italy: Association for Com- putational Linguistics.
  22. Lu, Y.; and Wang, J. 2025. KARMA: Leveraging Multi- Agent LLMs for Automated Knowledge Graph Enrichment. arXiv preprint arXiv:2502.06472. · arXiv
  23. Luo, L.; Li, Y.-F.; Haffari, G.; and Pan, S. 2023. Reasoning on graphs: Faithful and interpretable large language model reasoning. arXiv preprint arXiv:2310.01061. · arXiv
  24. Kawahara, T.; Demberg, V.; Ultes, S.; Inoue, K.; Mehri, S.; Howcroft, D.; and Komatani, K., eds., Proceedings of the 25th Annual Meeting of the Special Interest Group on Dis- course and Dialogue, 516-532. Kyoto, Japan: Association for Computational Linguistics.
  25. Modarressi, A.; Imani, A.; Fayyaz, M.; and Schütze, H. 2023. Ret-llm: Towards a general read-write memory for large language models. arXiv preprint arXiv:2305.14322. · arXiv
  26. Pan, S.; Luo, L.; Wang, Y.; Chen, C.; Wang, J.; and Wu, X. 2024. Unifying large language models and knowledge graphs: A roadmap. IEEE Transactions on Knowledge and Data Engineering, 36(7): 3580-3599.
  27. Pérez-Rosas, V.; Wu, X.; Resnicow, K.; and Mihalcea, R. 2019. What Makes a Good Counselor? Learning to Dis- tinguish between High-quality and Low-quality Counseling Conversations. In Korhonen, A.; Traum, D.; and Màrquez, L., eds., Proceedings of the 57th Annual Meeting of the As- sociation for Computational Linguistics, 926-935. Florence, Italy: Association for Computational Linguistics.
  28. She, S.; Huang, S.; Wang, X.; Zhou, Y.; and Chen, J. 2024. Exploring the Factual Consistency in Dialogue Comprehen- sion of Large Language Models. In Duh, K.; Gomez, H.; and Bethard, S., eds., Proceedings of the 2024 Conference of the North American Chapter of the Association for Computa- tional Linguistics: Human Language Technologies (Volume 1: Long Papers), 6087-6100. Mexico City, Mexico: Associ- ation for Computational Linguistics.
  29. Sun, J.; Xu, C.; Tang, L.; Wang, S.; Lin, C.; Gong, Y.; Ni, L. M.; Shum, H.-Y.; and Guo, J. 2023. Think-on-graph: Deep and responsible reasoning of large language model on knowledge graph. arXiv preprint arXiv:2307.07697. · arXiv
  30. Wei, J.; Wang, X.; Schuurmans, D.; Bosma, M.; Xia, F.; Chi, E.; Le, Q. V.; Zhou, D.; et al. 2022. Chain-of- thought prompting elicits reasoning in large language mod- els. Advances in neural information processing systems, 35: 24824-24837.
  31. Xu, R.; Qi, Z.; Guo, Z.; Wang, C.; Wang, H.; Zhang, Y.; and Xu, W. 2024a. Knowledge Conflicts for LLMs: A Survey. In Al-Onaizan, Y.; Bansal, M.; and Chen, Y.-N., eds., Pro- ceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 8541-8565. Miami, Florida, USA: Association for Computational Linguistics.
  32. Xu, Y.; He, S.; Chen, J.; Wang, Z.; Song, Y.; Tong, H.; Liu, G.; Zhao, J.; and Liu, K. 2024b. Generate-on-Graph: Treat LLM as both Agent and KG for Incomplete Knowl- edge Graph Question Answering. In Al-Onaizan, Y.; Bansal, M.; and Chen, Y.-N., eds., Proceedings of the 2024 Confer- ence on Empirical Methods in Natural Language Process- ing, 18410-18430. Miami, Florida, USA: Association for Computational Linguistics.
  33. Xue, T.; Wang, Z.; Wang, Z.; Han, C.; Yu, P.; and Ji, H. 2023. Rcot: Detecting and rectifying factual inconsistency in reasoning by reversing chain-of-thought. arXiv preprint arXiv:2305.11499. · arXiv
  34. Yao, S.; Yu, D.; Zhao, J.; Shafran, I.; Griffiths, T.; Cao, Y.; and Narasimhan, K. 2023. Tree of thoughts: Deliber- ate problem solving with large language models. Advances in neural information processing systems, 36: 11809-11822.
  35. Yi, Z.; Ouyang, J.; Liu, Y.; Liao, T.; Xu, Z.; and Shen, Y. 2024. A survey on recent advances in llm-based multi-turn dialogue systems. arXiv preprint arXiv:2402.18013. · arXiv
  36. Zhao, Z.; Monti, E.; Lehmann, J.; and Assem, H. 2024. En- hancing Contextual Understanding in Large Language Mod- els through Contrastive Decoding. In Duh, K.; Gomez, H.; and Bethard, S., eds., Proceedings of the 2024 Conference of the North American Chapter of the Association for Com- putational Linguistics: Human Language Technologies (Vol- ume 1: Long Papers), 4225-4237. Mexico City, Mexico: As- sociation for Computational Linguistics.
  37. Zhong, W.; Guo, L.; Gao, Q.; Ye, H.; and Wang, Y. 2024. MemoryBank: enhancing large language models with long- term memory. In Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence and Thirty-Sixth Con- ference on Innovative Applications of Artificial Intelligence and Fourteenth Symposium on Educational Advances in Artificial Intelligence, AAAI'24/IAAI'24/EAAI'24. AAAI Press. ISBN 978-1-57735-887-9.

Cited by

Sorted by citations

See all 2

Metadata

Authors
Lei, X., Li, Q., Zhang, M., & Zhang, M.
Venue
arXiv
Publisher
arXiv
Published
2025
DOI
10.48550/arxiv.2510.13363
arXiv
2510.13363
References
1
Type
Preprint
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: D-SMART: Enhancing LLM Dialogue Consistency via Dynamic Structured Memory And Reasoning Tree. https://app.cochat.ai/papers/10.48550/arxiv.2510.13363
The paper
Lei, X., Li, Q., Zhang, M., & Zhang, M. (2025). D-SMART: Enhancing LLM Dialogue Consistency via Dynamic Structured Memory And Reasoning Tree. arXiv. https://doi.org/10.48550/arxiv.2510.13363