Log2Intent: Towards Interpretable User Modeling via Recurrent Semantics Memory Unit
The DOI matches its Crossref record; 37 of the 40 references it cites were found in a registry or an index.
Abstract
Modeling user behavior from unstructured software log-trace data is critical in providing personalized service (\emphe.g., cross-platform recommendation). Existing user modeling approaches cannot well handle the long-term temporal information in log data, or produce semantically meaningful results for interpreting user logs. To address these challenges, we propose a Log2Intent framework for interpretable user modeling in this paper. Log2Intent adopts a deep sequential modeling framework that contains a temporal encoder, a semantic encoder and a log action decoder, and it fully captures the long-term temporal information in user sessions. Moreover, to bridge the semantic gap between log-trace data and human language, a recurrent semantics memory unit (RSMU) is proposed to encode the annotation sentences from an auxiliary software tutorial dataset, and the output of RSMU is fed into the semantic encoder of Log2Intent. Comprehensive experiments on a real-world Photoshop log-trace dataset with an auxiliary Photoshop tutorial dataset demonstrate the effectiveness of the proposed Log2Intent framework over the state-of-the-art log-trace user modeling method in three different tasks, including log annotation retrieval, user interest detection and user next action prediction.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Some papers already optimize for interpretability by using a regularization term or objective function during training of the predictive model (e.g., [33,137,191,211,244,276,277,289]) or by relating rewards to explainability and presentation quality in reinforcement learning (e.g., [268]).”
From From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AI (2023) · cites this paper as [244]
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · cited 1×
“We implement our Log2Intentmodel with the Tensorflow framework, and employ theAdamoptimizer [18] with an initial learning rate of 0.”
MethodGlove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071 · cited 1×
“M and O are initialized by Glove [28] word embeddings and further fine-tuned in training.”
MethodEfficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568 · cited 1×
“We learnA by training word2vec [25] model on the entire User-Log data, and fix it during our training procedure to avoid overfitting.”
MethodSequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766 · cited 3×
“Recurrent neural network (RNN) has been widely used for modeling sequential data in a wide range of applications, such as neural machine translation [4, 30] and speech recognition [12].”
MethodNeural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213 · cited 2×
“Recurrent neural network (RNN) has been widely used for modeling sequential data in a wide range of applications, such as neural machine translation [4, 30] and speech recognition [12].”
MethodEmpirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008 · cited 9×
“Let c t be the output from RSUM for action a t , then we have our semantic encoder function as where v t = c t + h t , h ′ t denotes the semantic hidden state at time t , and f enc − S is also formulated by GRU with θ enc − S including all the related parameters in the semantics encoding pathway.”
MethodInfluentialSpeech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893 · cited 1×
“Recurrent neural network (RNN) has been widely used for modeling sequential data in a wide range of applications, such as neural machine translation [4, 30] and speech recognition [12].”
MethodOn the limited memory BFGS method for large scale optimization
Liu, D. C., & Nocedal, J. (1989) · Mathematical Programming · doi:10.1007/bf01589116 · Cited by 8,560 · cited 1×
“We trainWu by the sigmoid cross-entropy loss with limited-memory BFGS [22].”
MethodCollaborative Filtering for Implicit Feedback Datasets
Hu, Y., Koren, Y., & Volinsky, C. (2008) · 2008 Eighth IEEE International Conference on Data Mining · doi:10.1109/icdm.2008.22 · Cited by 3,170 · cited 1×
“Lots of research efforts have been made for this task by considering user data such as rating [5], contents [2, 17, 32], and reviews [39].”
Background
Research works printed but not linked: 5
- Kyunghyun Cho , Bart van Merrië nboer, c Ca?lar Gü lc cehre , Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014 . Learning Phrase Representations using RNN Encoder--Decoder for Statistical Machine Translation. In EMNLP. 1724--1734. Kyunghyun Cho, Bart van Merrië nboer, c Ca?lar Gü lc cehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning Phrase Representations using RNN Encoder--Decoder for Statistical Machine Translation. In EMNLP. 1724--1734.
- Ryan Kiros Yukun Zhu Ruslan R Salakhutdinov Richard Zemel Raquel Urtasun Antonio Torralba and Sanja Fidler. 2015. Skip-Thought Vectors. In NeurIPS. 3294--3302. Ryan Kiros Yukun Zhu Ruslan R Salakhutdinov Richard Zemel Raquel Urtasun Antonio Torralba and Sanja Fidler. 2015. Skip-Thought Vectors. In NeurIPS. 3294--3302.
- Quoc V. Le and Tomas Mikolov . 2014 . Distributed Representations of Sentences and Documents. In ICML . Quoc V. Le and Tomas Mikolov. 2014. Distributed Representations of Sentences and Documents. In ICML .
- Sainbayar Sukhbaatar , arthur szlam , Jason Weston, and Rob Fergus. 2015 . End-To-End Memory Networks. In NeurIPS. 2440--2448. Sainbayar Sukhbaatar, arthur szlam, Jason Weston, and Rob Fergus. 2015. End-To-End Memory Networks. In NeurIPS. 2440--2448.
- Jason Weston , Sumit Chopra , and Antoine Bordes . 2014. Memory Networks. CoRR , Vol. abs/ 1410 .3916 ( 2014 ). Jason Weston, Sumit Chopra, and Antoine Bordes. 2014. Memory Networks. CoRR , Vol. abs/1410.3916 (2014). · arXiv
Cited by
Nauta, M., Trienes, J., Pathak, S., Nguyen, E., Peters, M., Schmitt, Y., Schlötterer, J., van Keulen, M., & Seifert, C. (2023) · ACM Computing Surveys · doi:10.1145/3583558 · Cited by 590
Context-aware Graph Embedding for Session-based News Recommendation
Sheu, H.-S., & Li, S. (2020) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3383313.3418477 · Cited by 59
Self-citationA Survey on Representation Learning for User Modeling
Li, S., & Zhao, H. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/695 · Cited by 62
Self-citationHow Is the Stroke? Inferring Shot Influence in Badminton Matches via Long Short-term Dependencies
Wang, W., Chan, T.-F., Peng, W.-C., Yang, H.-K., Wang, C.-C., & Fan, Y.-C. (2022) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3551391 · Cited by 26
“[45] proposed variants of recurrent models aiming to give interpretable outcomes.”
BackgroundZhou, Z., Zheng, F., Jin, W., Chen, Y., Li, X., Liu, Y., Wang, Y., & Chen, W. (2023) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2023.3296692 · Cited by 10
Metadata
- Authors
- Tao, Z., Li, S., Wang, Z., Fang, C., Yang, L., Zhao, H., & Fu, Y.
- Affiliations
- Northeastern University (US)
- University of Georgia (US)
- Adobe Systems (United States) (US)
- ByteDance AI Lab, San Jose, CA, USA
- Cornell University (US)
- Venue
- Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining
- Publisher
- ACM
- Published
- 2019-07-25
- Pages
- 1055-1063
- OpenAlex
- W2950244811
- Cited by
- 16
- References
- 40
- Citations by year
- 2026: 1 · 2024: 4 · 2023: 2 · 2022: 3 · 2021: 2 · 2020: 4
- FWCI
- 1.79
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Information Systems › Web Data Mining and Analysis
- Keywords
- user modeling, semantic gap, next action prediction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Log2Intent: Towards Interpretable User Modeling via Recurrent Semantics Memory Unit. https://app.cochat.ai/papers/10.1145/3292500.3330889
- The paper
- Tao, Z., Li, S., Wang, Z., Fang, C., Yang, L., Zhao, H., & Fu, Y. (2019). Log2Intent: Towards Interpretable User Modeling via Recurrent Semantics Memory Unit. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. https://doi.org/10.1145/3292500.3330889
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.