Learning from a learning thermostat: lessons for intelligent systems for the home
The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
Everyday systems and devices in the home are becoming smarter. In order to better understand the challenges of deploying an intelligent system in the home, we studied the experience of living with an advanced thermostat, the Nest. The Nest utilizes machine learning, sensing, and networking technology, as well as eco-feedback features. We conducted interviews with 23 participants, ten of whom also participated in a three-week diary study. Our findings show that while the Nest was well-received overall, the intelligent features of the Nest were not perceived to be as useful or intuitive as expected, in particular due to the system's inability to understand the intent behind sensed behavior and users' difficulty in understanding how the Nest works. A number of participants developed workarounds for the shortcomings they encountered. Based on our observations, we propose three avenues for future development of interactive intelligent technologies for the home: exception flagging, incidental intelligibility, and constrained engagement.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
The Computer for the 21st Century
Weiser, M. (1991) · Scientific American · doi:10.1038/scientificamerican0991-94 · Cited by 10,017
The Duality of Technology: Rethinking the Concept of Technology in Organizations
Orlikowski, W. J. (1992) · Organization Science · doi:10.1287/orsc.3.3.398 · Cited by 4,957
(2006) · Cited by 2,256
The Aware Home: A Living Laboratory for Ubiquitous Computing Research
Kidd, C. D., Orr, R., Abowd, G. D., Atkeson, C. G., Essa, I. A., MacIntyre, B., Mynatt, E., Starner, T. E., & Newstetter, W. (1999) · Lecture Notes in Computer Science · doi:10.1007/10705432_17 · Cited by 1,035 · cited 2×
“, [9,10]), or with prototypes in experimental settings (e.”
The design of eco-feedback technology
Froehlich, J., Findlater, L., & Landay, J. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753629 · Cited by 813 · cited 2×
“, [7]), which will, in turn, motivate people to save more energy.”
(1935) · Economic Record · doi:10.1111/j.1475-4932.1935.tb02774.x · Cited by 712
Why and why not explanations improve the intelligibility of context-aware intelligent systems
Lim, B. Y., Dey, A. K., & Avrahami, D. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1519023 · Cited by 552 · cited 1×
“been done into how to design interfaces that render system behavior more intelligible [1,12,24], such research has yet”
BackgroundAt Home with Ubiquitous Computing: Seven Challenges
Edwards, W. K., & Grinter, R. E. (2001) · Cited by 535
MavHome: an agent-based smart home
Cook, D. J., Youngblood, M., Heierman, E. O., Gopalratnam, K., Rao, S., Litvin, A., & Khawaja, F. (2004) · Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003). · doi:10.1109/percom.2003.1192783 · Cited by 525 · cited 1×
“, [3,9,10,15]), but few such projects have provided insight into the lived experience of occupants.”
Intelligibility and Accountability: Human Considerations in Context-Aware Systems
Bellotti, V., & Edwards, K. (2001) · Human–Computer Interaction · doi:10.1207/s15327051hci16234_05 · Cited by 471 · cited 2×
“been done into how to design interfaces that render system behavior more intelligible [1,12,24], such research has yet”
Research works printed but not linked: 4
- Dey A.K., 2009, Workshop on Intelligence and Interaction: IJCAI
- 10.5555/647987.741327 · doi:10.5555/647987.741327
- U.S. Energy Information Administration Annual Energy Review September 27 2012 U.S. Energy Information Administration Annual Energy Review September 27 2012
- 10.5555/645969.674887 · doi:10.5555/645969.674887
Cited by
Items 201–267 of 267
Teaching Things To Think: Bootstrapping Local Reasoning for Smart(er) Devices
King, E., Yu, H., Vartak, S., Jacob, J., Lee, S., & Julien, C. (2025) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom64205.2025.00027 · Cited by 3
“The opaque automated behaviors of e.g., smart thermostats, are also a cause of frustration, motivating a need for explainability [8], [19].”
Wyant, K., Sant'Ana, S. J. K., Punturieri, C., Yu, J., Fronk, G. E., Maggard, C. M., Janssen, C., Wanta, S. E., Kornfield, R., Swol, L. M. V., et al. (2025) · JMIR Research Protocols · doi:10.2196/81697 · Cited by 2
Evaluation of programmable domestic eco-systems
Coutaz, J., & Crowley, J. L. (2017) · Conference on l'Interaction Homme-Machine (IHM) · doi:10.1145/3132129.3132138 · Cited by 2
“Le thermostat Nest, incapable de reconnaître les exceptions, illustre au niveau d’un seul dispositif, les difficultés scientifique et technique à surmonter [53].”
BackgroundExploring End Users' Perceptions of Smart Lock Automation Within the Smart Home Environment
Hazazi, H., & Shehab, M. (2024) · European Symposium on Usable Security (EuroUSEC) · doi:10.1145/3688459.3688480 · Cited by 2
“Prior research [7, 8, 10, 28] explored the factors influencing the user’s decision to create smart home automation scenarios.”
Envisioning a smart home that can learn and negotiate the needs of multiple users
Chuang, Y., Chen, L.-L., & Lee, Y.-H. (2015) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2800835.2800934 · Cited by 2
Distributed Cognition: Assessing the Structure of Urban Scale Artificial Intelligence
Webb, A. (2017) · International Robotics & Automation Journal · doi:10.15406/iratj.2017.02.00034 · Cited by 3
An exploratory study to design constrained engagement in smart heating systems
Skrebe, S., & Stumpf, S. (2017) · Electronic workshops in computing · doi:10.14236/ewic/hci2017.47 · Cited by 3
“However, this might mean that these explanations might also overwhelm users, contrary to principles of constrained engagement (Yang and Newman 2013) and explanatory debugging (Kulesza et al.”
BackgroundInfluentialInterlinking the effect of thermal mass and temperature control strategies in dwellings
Verbeke, S., Audenaert, A., & Verhaert, I. (2019) · E3S Web of Conferences · doi:10.1051/e3sconf/201911104065 · Cited by 2
“Contemporary ‘smart’, or ‘selflearning’ thermostats will estimate the optimum timing based on analytics of former behaviour, sometimes enriched with weather data predictions or connections with smartphones or agendas of the occupants [14].”
BackgroundWhen Mental Models Grow (C)old: A Cognitive Perspective on Home Heating Automation
Bremer, C. (2020) · IEEE Pervasive Computing · doi:10.1109/mprv.2020.3019909 · Cited by 2
“Based on these observations, Yang and Newman suggested three pillars for the design of automated technology: 1) Exception flagging : Users can flag exceptional input that they do not want the system to take into account when building models and making predictions.”
BackgroundTeaching End-User Development in the Time of IoT and AI
Paternò, F. (2022) · Lecture notes in computer science · doi:10.1007/978-3-030-98388-8_23 · Cited by 4
Komenda, S., & Monroe, M. C. (2023) · Sustainability · doi:10.3390/su15118443 · Cited by 2
A dynamic approach to medical data for smart Indian healthcare
Shaikh, T. A., & Ali, R. (2017) · International Conference on Big Data Analytics and Computational Intelligence (ICBDAC) · doi:10.1109/icbdaci.2017.8070828 · Cited by 2
Chupong, C., & Plangklang, B. (2019) · International Electrical Engineering Congress (iEECON) · doi:10.1109/ieecon45304.2019.8938990 · Cited by 4
“Online incremental machine learning is enable the devices to adapt to individual user and environment especially in smart home system [2,3].”
BackgroundDancing with the AI Devil: Investigating the Partnership Between Lawyers and AI
Mikhail, M., Roegiest, A., Anello, K., & Wei, W. (2020) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3343413.3378014 · Cited by 4
Envisioning New Productivity Tools for Domestic Information Work Environments
Cho, J., & Voida, S. (2020) · Cited by 6
Supporting User Understanding and Engagement in Designing Intelligent Systems for the Home.
Yang, R. (2016) · Deep Blue (University of Michigan) · Cited by 2
Self-citationBrackley, C. (2020) · Carleton University's Institutional Repository (MacOdrum Library, Carleton University) · doi:10.22215/etd/2020-14323 · Cited by 2
Essays on Technology Paternalism : Paternalistic Effects of Smart Technologies on User Behavior
Rochi, M. (2024) · doi:10.20378/irb-98474 · Cited by 2
User Experience for Online Course Strategies: EduFlex Framework
Al-Sa’di, A., & Khrypko, Y. (2024) · International Conference on Business and Industrial Research (ICBIR) · doi:10.1109/icbir61386.2024.10875962 · Cited by 1
Blomkvist, J., Chu, W., & Chilufya, E. M. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3719936 · Cited by 2
Manser, R. P., Ancell, B. C., Lindquist, C. S., & Cleveland, T. G. (2026) · Environment Development and Sustainability · doi:10.1007/s10668-025-07285-y · Cited by 1
Han, J., & Mo, Y. (2026) · Energy and Buildings · doi:10.1016/j.enbuild.2026.117615 · Cited by 1
Seamful Design Considerations for Human-in-the-Loop Digital Phenotyping of Mental Health
Swain, V. D., Tongtawee, T., Wang, O., Hsu, J., Jacobson, N. C., & Mishra, V. (2026) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3832021 · Cited by 2
“To understand how users wanted to adjust DYMOND , we describe our findings via Yang and Newman’s framing [109]: users can appropriate technology through exception flagging —the user identifies the problems—and through constrained engagement —the user occasionally modifies the system.”
Dong, T., Newman, M., & Ackerman, M. S. (2014) · interactions · doi:10.1145/2654824 · Cited by 1
“There are thermostats that adjust temperatures based on occupancy [1], doors that alert us when we forget to close them, and “beacons” that track our indoor locations [2].”
BackgroundSelf-citationJoint Energy Demand Prediction and Control
Merai, M., & Yu, J. Y. (2017) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-319-67837-5_9 · Cited by 1
“By collecting indoor, outdoor and behaviour usage data [8], the JEPAC device will learn appliances configuration related to each ambient parameter combination (indoor measurements, outdoor measurements and other useful data like energy consumer behaviour).”
MethodExploring Physical Intelligibility and Control with Smart Speakers
Avdic, M. (2019) · ACM Conference Companion Publication on Designing Interactive Systems (DIS Companion) · doi:10.1145/3301019.3324880 · Cited by 1
“Similar to Yang and Newman’s observation of incidental intelligibility—a way for the system to explain itself as part of a user’s ongoing task [16]—my observations also seem to suggest an opportunity with respect to situational physical interactions and proximity during breakdowns: providing intelligibility in proximi…”
BackgroundLeonidis, A., Korozi, M., Antona, M., & Stephanidis, C. (2022) · Automation, collaboration, and e-services · doi:10.1007/978-3-031-10788-7_30 · Cited by 2
Toolkit Design for Building Camera Sensor-Driven DIY Smart Homes
Yun, S., & Lim, Y.-K. (2024) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3675094.3678363 · Cited by 1
Dynamics of Mental Models: Objective Vs. Subjective User Understanding of a Robot in the Wild
Gebellí, F., Garrell, A., Lemaignan, S., & Ros, R. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3579217 · Cited by 2
“Some works have studied the progression of understanding over time for users of XAI non-embodied intelligent systems [9], [15], [29].”
Popa, D., Dobre, C., & Pop, F. (2017) · IFIP/IEEE International Symposium on Integrated Network Management (IM) · doi:10.23919/inm.2017.7987457 · Cited by 1
Measuring the potential of zonal control in large open areas on reducing the heating/AC energy
Mohamed, M., Ibrahim, M. F., & Far, B. H. (2017) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2017.8123023 · Cited by 1
“The most popular commercial products on the market currently are smart thermostats, such as Nest thermostat [15, 16], Ecobee [11], ZWave [12], Honeywell [13], and X10 [14].”
BackgroundPoster: Everyday interaction with autonomous Internet of Things
Malik, O., & Ramchurn, S. D. (2018) · ePrints Soton (University of Southampton) · Cited by 1
A Critical Survey on Communication Protocols in IoT Domain
Aiswarya, M., & Thomas, M. V. (2019) · International Conference on Intelligent Computing, Instrumentation and Control Technologies (ICICICT) · doi:10.1109/icicict46008.2019.8993126 · Cited by 1
When Artificial Intelligence Alone is not Enough: End-User Creation and Control of Daily Automations
Paternò, F. (2021) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3411763.3445005 · Cited by 1
“The tutorial will start with an introduction to the main current technological trends (internet of things and artifcial intelligence), followed by a discussion of their problems when end user viewpoint is not considered (see for example the study reported in [12]), such as the learning system fails to understand user…”
BackgroundRobust and Lightweight Control System for IoT Networks: Enabling IoT for the Developing World
Panicker, J. G., & Azman, M. (2020) · Advances in intelligent systems and computing · doi:10.1007/978-981-15-7234-0_8 · Cited by 1
Urquhart, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.07185 · Cited by 1
“The A29 WP worries detailed inferences can be drawn about daily life where “analysis of usage patterns in such a context is likely to reveal the inhabitants’ lifestyle details, habits or choices or simply their presence at home”.(68) Similarly, Deakin et al.”
BackgroundA human centric approach to the Internet of Things
Cervantes-Solis, J. W. (2019) · University of Birmingham Institutional Research Archive (University of Birmingham) · Cited by 4
Huang, C.-C. (2019) · Deep Blue (University of Michigan) · Cited by 1
Breaching the Future: Understanding Human Challenges of Autonomous Systems for the HomePreprint
Nilsson, T., Crabtree, A., Fischer, J. E., & Koleva, B. N. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3220509 · Cited by 1
Deference and Demeanor: Exploring Interaction Design for Intelligent User Interface
Guo, H. (2016) · ACM Conference Companion Publication on Designing Interactive Systems (DIS Companion) · doi:10.1145/2908805.2909407
“For example, Yang and Newman [7] report in their field study of NEST thermostats usage that homeowners regarded this intelligent thermostat as ‘too controlling’, ‘not adaptive’ and confusing to use.”
BackgroundDecision Biases in User Agreement with Intelligent Decision Aids
Solomon, J. (2015) · Michigan State University Libraries · doi:10.25335/fsx1-c960
Considering Health and Family Dynamics: How is Home Temperature Decided?
Irwin, G. (2016) · Electronic workshops in computing · doi:10.14236/ewic/hci2016.66
“However, it doesn’t as yet do an effective job at learning within a multioccupant home (Yang and Newman, 2013).”
BackgroundA dynamic approach to medical data visualization and interaction
Bevilacqua, V., Cassano, F., Dimauro, G., Girardi, F., & Piccinno, A. (2016) · CINECA IRIS Institutional Research Information System (University of Bari Aldo Moro)
Learning User's Preferred Household Organization via Collaborative Filtering Methods.
Brawner, S., & Littman, M. L. (2016)
Using Shape-Change to Express Dynamic Affordances of Intelligent Systems
Nieto, J. E. G., & Chuang, Y. (2017) · InTech eBooks · doi:10.5772/intechopen.71116
Foster, D. (2017) · Lincoln Repository (University of Lincoln) · doi:10.24385/lincoln.24325801
Chen, Y.-S. A. (2017) · TU/e Research Portal · doi:10.7945/c28d7n
Studying Breakdowns in Interactions with Smart SpeakersPreprint
Avdic, M., & Vermeulen, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.01976
“It then becomes important to give users possibility to adjust autonomy as well as question the systems’ decision making processes in conjunction with users’ ongoing task [20].”
BackgroundEvaluation of Algorithmic Management of Digital Work Platform in Developing Countries
Ogunleye, O. S., & Kalema, B. M. (2020) · IntechOpen eBooks · doi:10.5772/intechopen.94524 · Cited by 2
Actions and their Consequences? Implicit Interactions with Workplace Knowledge Bases.
Lindley, S. E., Wilkins, D. J., & Burlin, B. (2021)
The Mondrian User Interface Pattern: Inspiring Eco-responsibility in Homes
Laurillau, Y., Coutaz, J., Calvary, G., & Nguyen, V. B. (2021) · Springer eBooks · doi:10.1007/978-3-030-76477-7_13
Katzburg, O., Roimi, M., Frenkel, A., Ilan, R., & Bitan, Y. (2022) · doi:10.2196/preprints.36186
User perceptions of a range-based thermostat
Rea, A. L., Corbit, L. H., & Shu, L. H. (2022) · Procedia CIRP · doi:10.1016/j.procir.2022.02.121 · Cited by 1
Anticipating the Dynamic Effects of the Learning Smart Home
Viaene, E. (2022) · Designing Interactive Systems Conference · doi:10.1145/3532107.3532881
Warren, C. (2023) · Goodfellow Publishers Ltd eBooks · doi:10.23912/9781911635659-5427
Ordonnancement dans l’habitat intelligent
Demeure, A., & Caffiau, S. (2023) · Revue Ouverte d Intelligence Artificielle · doi:10.5802/roia.50
Jain, P., Xu, A., Downes, T., Kim, I., Khan, T., Biehl, J. T., & Lee, A. J. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637432
Shaping Hidden Interfaces for Situated Interactions
Tolino, U., & Mariani, I. (2024) · SpringerBriefs in applied sciences and technology · doi:10.1007/978-3-031-67416-7_6
Wilkie, S., Cheng, Q., Mathews, C. W., Otify, A., Schofield, F. J., Weir, E., Marshall, P., & O’Kane, A. A. (2025) · ACM SIGCAS/SIGCHI Conference on Computing and Sustainable Societies (COMPASS) · doi:10.1145/3715335.3735461 · Cited by 2
“In Yang et al.’s research on thermostats [61, 62], we saw an improper delivery of a new technology leading to users ‘re-verting’ their practices to what was already familiar and embodied.”
Designing smart home services using machine learning and knowledge-based approaches
Qiu, M. (2023) · theses.fr (ABES) · doi:10.70675/91d484b0z239bz4bcbz939cze37dcafb860a
Dai, J., Aliakseyeu, D., & Funk, M. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791082
“Previous research has predominantly focused on multiple aspects of how devices impact a smart home environment, looking at connected “things” such as cameras[31], speakers [3], voice assistants [20, 43, 58, 69, 74], lighting systems [51, 57], and smart thermostats [90].”
AI and Sustainable Building Automation Systems (BAS): Envisioned Roles and Emerging Challenges
Rong, E. Z., Sabie, D., Liu, M., Zakaria, C., McEwen, R. N., & Sabie, S. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791126
Cho, J., Rahim, S., Wang, Y., Yu, J., Rheu, M., & Hoefer, M. J. D. (2026) · Designing Interactive Systems Conference · doi:10.1145/3800645.3812878 · Cited by 1
“HCI research has used a range of techniques to surface them, including interviews, metaphor elicitation, drawing and dia-gramming tasks, card-sorting activities, and hypothetical scenarios [46, 61, 94, 130].”
THE DESIGN AND DEVELOPMENT OF A MOBILE APP TO REMOTELY CONTROL A TEMPERATURE CONTROL SYSTEM
Niță, R. C., & Doicin, B. (2026) · Romanian Journal of Petroleum & Gas Technology · doi:10.51865/jpgt.2026.01.16
Designing for Security in Clever Domestic Computing
Urquhart, L. D. (2026) · Cambridge University Press eBooks · doi:10.1017/9781108985734.004
Cabitza, F., Gallazzi, E., & Papale, A. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3816965
Metadata
- Authors
- Yang, R., & Newman, M. W.
- Affiliations
- University of Michigan (US)
- Venue
- Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing
- Publisher
- ACM
- Published
- 2013-09-08
- Pages
- 93-102
- OpenAlex
- W2133270667
- Cited by
- 268
- References
- 28
- Citations by year
- 2026: 9 · 2025: 7 · 2024: 12 · 2023: 15 · 2022: 13 · 2021: 15 · 2020: 25 · 2019: 34 · 2018: 33 · 2017: 41 · 2016: 34 · 2015: 21 · 2014: 9
- FWCI
- 16.81
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) (publishedVersion)
- Funders
- University of Michigan
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Physical Sciences › Engineering › Electrical and Electronic Engineering › IoT-based Smart Home Systems
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- smart home devices, smart home technology, user experience, eco-feedback, user intent understanding, workarounds
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.