A hybrid learning system for recognizing user tasks from desktop activities and email messages
Abstract
The TaskTracer system seeks to help multi-tasking users manage the resources that they create and access while carrying out their work activities. It does this by associating with each user-defined activity the set of files, folders, email messages, contacts, and web pages that the user accesses when performing that activity. The initial TaskTracer system relies on the user to notify the system each time the user changes activities. However, this is burdensome, and users often forget to tell TaskTracer what activity they are working on. This paper introduces TaskPredictor, a machine learning system that attempts to predict the user’s current activity. TaskPredictor has two components: one for general desktop activity and another specifically for email. TaskPredictor achieves high prediction precision by combining three techniques: (a) feature selection via mutual information, (b) classification based on a confidence threshold, and (c) a hybrid design in which a Naive Bayes classifier estimates the classification confidence but where the actual classification decision is made by a support vector machine. This paper provides experimental results on data collected from Task-Tracer users.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Previous automatic task switch detection approaches have a high deviation in time of 3 to 5 minutes between predicted and actual task switches.
“or that one has to accept a high deviation in time of 3 to 5 minutes between predicted and actual task switches [13], [14], [18].”
From Detecting Developers' Task Switches and Types (2022) · cites this paper as [18]
Cites
An algorithm for suffix stripping
Porter, M. F. (1980) · Program · doi:10.1108/eb046814 · Cited by 8,096 · see citing works
A Comparative Study on Feature Selection in Text Categorization
Yang, Y., & Pedersen, J. (1997) · Cited by 4,749 · see citing works
Probability Estimates for Multi-class Classification by Pairwise Coupling
Wu, T., Lin, C., & Weng, R. C. (2004) · Journal of Machine Learning Research · doi:10.5555/1005332.1016791 · Cited by 1,673 · see citing works
Learning to Classify Text Using Support Vector Machines
Joachims, T. (2002) · Springer eBooks · doi:10.1007/978-1-4615-0907-3 · Cited by 1,379 · see citing works
Learning to Classify Text Using Support Vector Machines: Methods, Theory and Algorithms
Joachims, T. (2002) · Cited by 933 · see citing works
The Enron Corpus: A New Dataset for Email Classification Research
Klimt, B., & Yang, Y. (2004) · European Conference on Machine Learning · doi:10.1007/978-3-540-30115-8_22 · Cited by 832 · see citing works
The Lumiere Project: Bayesian User Modeling for Inferring the Goals and Needs of Software UsersPreprint
Horvitz, E., Breese, J. S., Heckerman, D. E., Hovel, D., & Rommelse, K. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.7385 · Cited by 655 · see citing works
Hidden Markov support vector machines
Altün, Y., Tsochantaridis, I., & Hofmann, T. F. (2003) · Cited by 460 · see citing works
Fawcett, T. E., & Provost, F. J. (1999) · ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/312129.312195 · Cited by 422 · see citing works
Learning Rules that Classify E-Mail
Cohen, W. W. (1996) · Cited by 406 · see citing works
Attention-Sensitive AlertingPreprint
Horvitz, E., Jacobs, A., & Hovel, D. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.6707 · Cited by 317 · see citing works
Learning and reasoning about interruption
Horvitz, E., & Apacible, J. (2003) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/958432.958440 · Cited by 275 · see citing works
Probabilistic Independence Networks for Hidden Markov Probability Models
Smyth, P., Heckerman, D. E., & Jordan, M. I. (1997) · Neural Computation · doi:10.1162/neco.1997.9.2.227 · Cited by 255 · see citing works
TaskTracer: a desktop environment to support multi-tasking knowledge workers
Dragunov, A. N., Dietterich, T. G., Johnsrude, K., McLaughlin, M., Li, L., & Herlocker, J. L. (2005) · Proceedings of the 10th international conference on Intelligent user interfaces · doi:10.1145/1040830.1040855 · Cited by 240 · see citing works
Self-citationSegal, R. B., & Kephart, J. O. (1999) · doi:10.1145/301136.301209 · Cited by 164 · see citing works
Automatic Categorization of Email into Folders: Benchmark Experiments on Enron and SRI Corpora
Bekkerman, R., McCallum, A., & Huang, G. B. (2005) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 152 · see citing works
Automation as Caregiver: A Survey of Issues and Technologies
Haigh, K. Z., & Yanco, H. A. (2003) · Cited by 97 · see citing works
Challenges of the Email Domain for Text Classification
Brutlag, J. D., & Meek, C. (2000) · International Conference on Machine Learning · Cited by 83 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Using task context to improve programmer productivity
Kersten, M., & Murphy, G. C. (2006) · Proceedings of the 14th ACM SIGSOFT international symposium on Foundations of software engineering · doi:10.1145/1181775.1181777 · Cited by 452 · see citing works
Interacting meaningfully with machine learning systems: Three experiments
Stumpf, S., Rajaram, V., Li, L., Wong, W.-K., Burnett, M., Dietterich, T., Sullivan, E., & Herlocker, J. (2009) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.03.004 · Cited by 184 · see citing works
Self-citationCommunityCommands: command recommendations for software applications
Matejka, J., Li, W., Grossman, T., & Fitzmaurice, G. (2009) · Proceedings of the 22nd annual ACM symposium on User interface software and technology · doi:10.1145/1622176.1622214 · Cited by 125 · see citing works
Detecting and correcting user activity switches: algorithms and interfaces
Shen, J., Irvine, J., Bao, X., Goodman, M., Kolibaba, S., Tran, A., Carl, F., Kirschner, B., Stumpf, S., & Dietterich, T. G. (2009) · Proceedings of the 14th international conference on Intelligent user interfaces · doi:10.1145/1502650.1502670 · Cited by 37 · see citing works
Self-citationDetecting Developers' Task Switches and Types
Meyer, A. N., Satterfield, C., Zuger, M., Kevic, K., Murphy, G. C., Zimmermann, T., & Fritz, T. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2020.2984086 · Cited by 14 · see citing works
“After the first version [18], they further improved their approach to reduce the number of false positives and to be able to predict task switches online [13], [14].”
BackgroundA Study on Automatic Classification of Users’ Desktop Interactions
Mirza, H. T., Chen, L., Hussain, I., Majid, A., & Chen, G. (2015) · Cybernetics and Systems · doi:10.1080/01969722.2015.1012372 · Cited by 8 · see citing works
BUILDING USER TASK SPACE BY MINING TEMPORALLY PROXIMATE DESKTOP ACTIONS
Mirza, H. T., Chen, L., Majid, A., & Chen, G. (2011) · Cybernetics and Systems · doi:10.1080/01969722.2011.634675 · Cited by 2 · see citing works
- Authors
- Shen, J., Li, L., Dietterich, T. G., & Herlocker, J. L.
- Affiliations
- Oregon State University (US)
- Venue
- Proceedings of the 11th international conference on Intelligent user interfaces
- Publisher
- ACM
- Published
- 2006-01-29
- Pages
- 86-92
- OpenAlex
- W2078786834
- Cited by
- 109
- References
- 18
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 1 · 2021: 1 · 2020: 3 · 2019: 2 · 2017: 2 · 2016: 7 · 2015: 3 · 2014: 5 · 2013: 7 · 2012: 4
- FWCI
- 25.25
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM International Conference on Intelligent User Interfaces (IUI) (publishedVersion)
- Funders
- National Science Foundation
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Personal Information Management and User Behavior
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Keywords
- activity recognition, multitasking, feature selection, mutual information, Naive Bayes classifier, support vector machine, hybrid classifier
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review