Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 51 of the 53 references it cites were found in a registry or an index.

Integrating Machine Learning Data with Symbolic Knowledge from Collaboration Practices of Curators to Improve Conversational Systems

Pinhanez, Claudio Santos, Candello, Heloisa, Cavalin, Paulo, Pichiliani, Mauro Carlos, Appel, Ana Paula, Alves Ribeiro, Victor Henrique, Nogima, Julio, de Bayser, Maira, Guerra, Melina, Ferreira, Henrique, Malfatti, Gabriel · 2021 · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

Abstract

This paper describes how machine learning training data and symbolic knowledge from curators of conversational systems can be used together to improve the accuracy of those systems and to enable better curatorial tools. This is done in the context of a real-world practice of curators of conversational systems who often embed taxonomically-structured meta-knowledge into their documentation. The paper provides evidence that the practice is quite common among curators, that is used as part of their collaborative practices, and that the embedded knowledge can be mined by algorithms. Further, this meta-knowledge can be integrated, using neuro-symbolic algorithms, to the machine learning-based conversational system, to improve its run-time accuracy and to enable tools to support curatorial tasks. Those results point towards new ways of designing development tools which explore an integrated use of code and documentation by machines.

Overview

Integrity signals

Registry

Crossref · 10.1145/3411764.3445368

Cites

51 of 51 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Show all 53 references

Research works printed but not linked: 11

  1. 10.5555/324058.324059 · doi:10.5555/324058.324059
  2. Tarek R. Besold, Artur d’Avila Garcez, Sebastian Bader, Howard Bowman, Pedro Domingos, Pascal Hitzler, Kai-Uwe Kuehnberger, Luis C. Lamb, Daniel Lowd, Priscila Machado Vieira Lima, Leo de Penning, Gadi Pinkas, Hoifung Poon, and Gerson Zaverucha. 2017. Neural-Symbolic Learning and Reasoning: A Survey and Interpretation. arxiv:1711.03902 [cs.AI] · arXiv
  3. Harry Bunt. 2009. The DIT++ taxonomy for functional dialogue markup. In Proc. of the AAMAS 2009 Workshop, Towards a Standard Markup Language for Embodied Dialogue Acts, Dirk Heylen, Catherine Pelachaud, Roberta Catizone, and David Traum (Eds.). Hungarian John von Neumann Society, Budapest, Hungary, 13–24.
  4. Harry Bunt and Yann Girad. 2005. Designing an Open, Multidimensional Dialogue Act Taxonomy. In Proc. of the Ninth International Workshop on the Semantics and Pragmatics of Dialogue (DIALOR’05). LORIA-INRIA, Nancy, France, 13–24.
  5. Ole-Johan Dahl, Edsger Wybe Dijkstra, and Charles Antony Richard Hoare. 1972. Structured Programming. Academic Press Ltd., GBR.
  6. Lisa Ehrlinger and Wolfram Wöß. 2016. Towards a Definition of Knowledge Graphs. In Proc. of SEMANTICS’16 Posters and Demos Track. CEUR-WS, 1–4. http://ceur-ws.org
  7. Drew Hudson and Christopher D Manning. 2019. Learning by Abstraction: The Neural State Machine. In Advances in Neural Information Processing Systems, H. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alché-Buc, E. Fox, and R. Garnett (Eds.), Vol. 32. Curran Associates, Inc., Redhook, New York, USA, 5903–5916.
  8. 10.3233/978-1-61499-649-1-87 · DOI · Paper page
  9. Emilio Parisotto Abdel-rahman Mohamed Rishabh Singh Lihong Li Dengyong Zhou and Pushmeet Kohli. 2016. Neuro-Symbolic Program Synthesis. arxiv:1611.01855 [cs.LG] · arXiv
  10. Katrin Weller. 2007. Folksonomies and Ontologies: Two New Players in Indexing and Knowledge Representation. In Proc. of the 2007 Online Information Conference. Incisive Media, London, UK, 108–115.
  11. Ziwei Zhang Peng Cui and Wenwu Zhu. 2018. Deep Learning on Graphs: A Survey. arxiv:1812.04202 [cs.CL] · arXiv

Cited by

See all 7

Metadata

Authors
Pinhanez, C. S., Candello, H., Cavalin, P., Pichiliani, M. C., Appel, A. P., Alves Ribeiro, V. H., Nogima, J., de Bayser, M., Guerra, M., Ferreira, H., & Malfatti, G.
Affiliations
  • IBM Research - Brazil (BR)
  • IBM Research Brazil, Brazil
Venue
Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Published
2021-05-06
Pages
1-13
OpenAlex
W3162148497
Cited by
7
References
53
Citations by year
2025: 2 · 2023: 2 · 2021: 3
FWCI
1.04
Type
conference paper
Language
en
Open access
closed
Locations
CHI Conference on Human Factors in Computing Systems (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Information Systems › Software Engineering Research
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
  • Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
Keywords
dialogue systems, curators, neuro-symbolic learning, symbolic knowledge, machine learning training data, meta-knowledge, collaborative practice

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Integrating Machine Learning Data with Symbolic Knowledge from Collaboration Practices of Curators to Improve Conversational Systems. https://app.cochat.ai/papers/10.1145/3411764.3445368
The paper
Pinhanez, C. S., Candello, H., Cavalin, P., Pichiliani, M. C., Appel, A. P., Alves Ribeiro, V. H., Nogima, J., de Bayser, M., Guerra, M., Ferreira, H., & Malfatti, G. (2021). Integrating Machine Learning Data with Symbolic Knowledge from Collaboration Practices of Curators to Improve Conversational Systems. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3411764.3445368

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.