Learning from a learning thermostat: lessons for intelligent systems for the home
The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
Everyday systems and devices in the home are becoming smarter. In order to better understand the challenges of deploying an intelligent system in the home, we studied the experience of living with an advanced thermostat, the Nest. The Nest utilizes machine learning, sensing, and networking technology, as well as eco-feedback features. We conducted interviews with 23 participants, ten of whom also participated in a three-week diary study. Our findings show that while the Nest was well-received overall, the intelligent features of the Nest were not perceived to be as useful or intuitive as expected, in particular due to the system's inability to understand the intent behind sensed behavior and users' difficulty in understanding how the Nest works. A number of participants developed workarounds for the shortcomings they encountered. Based on our observations, we propose three avenues for future development of interactive intelligent technologies for the home: exception flagging, incidental intelligibility, and constrained engagement.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
The Computer for the 21st Century
Weiser, M. (1991) · Scientific American · doi:10.1038/scientificamerican0991-94 · Cited by 10,017
The Duality of Technology: Rethinking the Concept of Technology in Organizations
Orlikowski, W. J. (1992) · Organization Science · doi:10.1287/orsc.3.3.398 · Cited by 4,957
(2006) · Cited by 2,256
The Aware Home: A Living Laboratory for Ubiquitous Computing Research
Kidd, C. D., Orr, R., Abowd, G. D., Atkeson, C. G., Essa, I. A., MacIntyre, B., Mynatt, E., Starner, T. E., & Newstetter, W. (1999) · Lecture Notes in Computer Science · doi:10.1007/10705432_17 · Cited by 1,035 · cited 2×
“, [9,10]), or with prototypes in experimental settings (e.”
The design of eco-feedback technology
Froehlich, J., Findlater, L., & Landay, J. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753629 · Cited by 813 · cited 2×
“, [7]), which will, in turn, motivate people to save more energy.”
(1935) · Economic Record · doi:10.1111/j.1475-4932.1935.tb02774.x · Cited by 712
Why and why not explanations improve the intelligibility of context-aware intelligent systems
Lim, B. Y., Dey, A. K., & Avrahami, D. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1519023 · Cited by 552 · cited 1×
“been done into how to design interfaces that render system behavior more intelligible [1,12,24], such research has yet”
BackgroundAt Home with Ubiquitous Computing: Seven Challenges
Edwards, W. K., & Grinter, R. E. (2001) · Cited by 535
MavHome: an agent-based smart home
Cook, D. J., Youngblood, M., Heierman, E. O., Gopalratnam, K., Rao, S., Litvin, A., & Khawaja, F. (2004) · Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003). · doi:10.1109/percom.2003.1192783 · Cited by 525 · cited 1×
“, [3,9,10,15]), but few such projects have provided insight into the lived experience of occupants.”
Intelligibility and Accountability: Human Considerations in Context-Aware Systems
Bellotti, V., & Edwards, K. (2001) · Human–Computer Interaction · doi:10.1207/s15327051hci16234_05 · Cited by 471 · cited 2×
“been done into how to design interfaces that render system behavior more intelligible [1,12,24], such research has yet”
Home automation in the wild: challenges and opportunities
Brush, A. J. B., Lee, B., Mahajan, R., Agarwal, S., Saroiu, S., & Dixon, C. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979249 · Cited by 468 · cited 2×
“, [2,14,26]), they have not provided insights into the mainstream user experience of adaptive home technologies that seek to learn about occupants’ behaviors and preferences and change their operation accordingly.”
Moving on from Weiser’s Vision of Calm Computing: Engaging UbiComp Experiences
Rogers, Y. (2006) · Lecture Notes in Computer Science · doi:10.1007/11853565_24 · Cited by 424 · cited 1×
“As Rogers points out, however, a strong stance on making computing invisible runs counter to visions of “smart” technologies that learn about and understand their users [21].”
PreHeat: controlling home heating using occupancy prediction
Scott, J., Bernheim Brush, A. J., Krumm, J., Meyers, B., Hazas, M., Hodges, S., & Villar, N. (2011) · Proceedings of the 13th international conference on Ubiquitous computing · doi:10.1145/2030112.2030151 · Cited by 379 · cited 2×
“, [7,8,22,23]) as well as commercial offerings [30].”
Designing a home of the future
Intille, S. S. (2002) · IEEE Pervasive Computing · doi:10.1109/mprv.2002.1012340 · Cited by 374 · cited 2×
“, [9,10]), or with prototypes in experimental settings (e.”
How people use thermostats in homes: A review
Peffer, T., Pritoni, M., Meier, A., Aragon, C., & Perry, D. (2011) · Building and Environment · doi:10.1016/j.buildenv.2011.06.002 · Cited by 342 · cited 1×
“Previous studies [18] investigated how people use their thermostat and concluded that poor usability of programmable thermostats is a critical barrier for their efficient use.”
Designing eco-feedback systems for everyday life
Strengers, Y. A. A. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979252 · Cited by 323 · cited 2×
“[23], however, pointed out that obtaining information did not always cause people to take action or change their behaviors.”
At home with the technology: an ethnographic study of a set-top-box trial
O'Brien, J., Rodden, T., Rouncefield, M., & Hughes, J. (1999) · ACM Transactions on Computer-Human Interaction · doi:10.1145/329693.329698 · Cited by 257
Interacting meaningfully with machine learning systems: Three experiments
Stumpf, S., Rajaram, V., Li, L., Wong, W.-K., Burnett, M., Dietterich, T., Sullivan, E., & Herlocker, J. (2009) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.03.004 · Cited by 184 · cited 2×
“been done into how to design interfaces that render system behavior more intelligible [1,12,24], such research has yet”
Mennicken, S., & Huang, E. M. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-31205-2_10 · Cited by 169
Mozer, M. C. (2004) · S.M.A.R.T. environments · doi:10.1002/047168659x.ch12 · Cited by 148 · cited 2×
“A notable exception is Mozer’s Adaptive House [15], in which the researcher deployed adaptive systems in his own home across several months.”
How it works: a field study of non-technical users interacting with an intelligent system
Tullio, J., Dey, A. K., Chalecki, J., & Fogarty, J. (2007) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240630 · Cited by 137 · cited 1×
“confusion, dissatisfaction, and abandonment of some features of the system [27].”
Gupta, M., INTILLE, S. S., & Larson, K. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-01516-8_8 · Cited by 112
The fuzzy felt ethnography?understanding the programming patterns of domestic appliances
Rode, J. A., Toye, E. F., & Blackwell, A. F. (2004) · Personal and Ubiquitous Computing · doi:10.1007/s00779-004-0272-0 · Cited by 102 · cited 1×
“studies have identified the importance of gender roles with respect to technology configuration and use [20], as well as”
Takayama, L. A., Pantofaru, C., Robson, D., Soto, B., & Barry, M. (2012) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2370216.2370292 · Cited by 96 · cited 1×
“, [2,14,26]), they have not provided insights into the mainstream user experience of adaptive home technologies that seek to learn about occupants’ behaviors and preferences and change their operation accordingly.”
Computer help at home: methods and motivations for informal technical support
Poole, E. S., Chetty, M., Morgan, T., Grinter, R. E., & Edwards, W. K. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518816 · Cited by 91 · cited 1×
“that of computer expertise and identity [19].”
Responding to cognitive overload : Co-adaptation between users and technology
Mackay, W. (2000) · Intellectica. Revue de l'Association pour la Recherche Cognitive · doi:10.3406/intel.2000.1597 · Cited by 85 · cited 1×
“Such coadaptation has been observed among users of configurable systems [13] and collaborative systems [17], and perhaps ought to be expected among users of intelligent systems as well.”
Fixing the program my computer learned: barriers for end users, challenges for the machine
Kulesza, T., Wong, W.-K., Stumpf, S., Perona, S., White, R., Burnett, M. M., Oberst, I., & Ko, A. J. (2009) · Proceedings of the 14th international conference on Intelligent user interfaces · doi:10.1145/1502650.1502678 · Cited by 83 · cited 1×
“, [11,24]) or on eliciting more and higher quality input from the user (e.”
Living with an intelligent thermostat: advanced control for heating and cooling systems
Yang, R., & Newman, M. (2012) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2370216.2370449 · Cited by 67
Self-citation
Research works printed but not linked: 4
- Dey A.K., 2009, Workshop on Intelligence and Interaction: IJCAI
- 10.5555/647987.741327 · doi:10.5555/647987.741327
- U.S. Energy Information Administration Annual Energy Review September 27 2012 U.S. Energy Information Administration Annual Energy Review September 27 2012
- 10.5555/645969.674887 · doi:10.5555/645969.674887
Cited by
Working with Machines: The Impact of Algorithmic and Data-Driven Management on Human Workers
Lee, M. K., Kusbit, D., Metsky, E., & Dabbish, L. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702548 · Cited by 823
“Interaction with intelligent machines Much research has investigated how people respond to intelligent machines such as automated manufacturing technologies [23, 36, 44], recommender systems [6], context-aware systems [3, 43], agents [35], and robots [30].”
BackgroundAbdul, A., Vermeulen, J., Wang, D., Lim, B. Y., & Kankanhalli, M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174156 · Cited by 743
“Research explored the need for [111] and provision of explanations in physical space, such as smart environments [177, 178, 179], the office [26], smart homes [18, 30, 131, 183] and on the move [90, 116].”
BackgroundInfluentialPrinciples of Explanatory Debugging to Personalize Interactive Machine Learning
Kulesza, T., Burnett, M., Wong, W.-K., & Stumpf, S. (2015) · Proceedings of the 20th International Conference on Intelligent User Interfaces · doi:10.1145/2678025.2701399 · Cited by 576
“As Yang and Newman found when studying users of learning thermostats [46], a system that appears to disregard user feedback deters users from continuing to provide feedback.”
BackgroundUser Perceptions of Smart Home IoT Privacy
Zheng, S., Apthorpe, N., Chetty, M., & Feamster, N. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274469 · Cited by 423
“More recently, Yang and Newman [64] investigated user experiences living with a Nest learning thermostat to inform the development of intelligent home technologies.”
BackgroundHalhoul Merabet, G., Essaaidi, M., Ben Haddou, M., Qolomany, B., Qadir, J., Anan, M., Al-Fuqaha, A., Abid, M. R., & Benhaddou, D. (2021) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2021.110969 · Cited by 422
Metadata
- Authors
- Yang, R., & Newman, M. W.
- Affiliations
- University of Michigan (US)
- Venue
- Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing
- Publisher
- ACM
- Published
- 2013-09-08
- Pages
- 93-102
- OpenAlex
- W2133270667
- Cited by
- 268
- References
- 28
- Citations by year
- 2026: 9 · 2025: 7 · 2024: 12 · 2023: 15 · 2022: 13 · 2021: 15 · 2020: 25 · 2019: 34 · 2018: 33 · 2017: 41 · 2016: 34 · 2015: 21 · 2014: 9
- FWCI
- 16.81
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) (publishedVersion)
- Funders
- University of Michigan
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Physical Sciences › Engineering › Electrical and Electronic Engineering › IoT-based Smart Home Systems
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- smart home devices, smart home technology, user experience, eco-feedback, user intent understanding, workarounds
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.