Learning from a learning thermostat: lessons for intelligent systems for the home
The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
Everyday systems and devices in the home are becoming smarter. In order to better understand the challenges of deploying an intelligent system in the home, we studied the experience of living with an advanced thermostat, the Nest. The Nest utilizes machine learning, sensing, and networking technology, as well as eco-feedback features. We conducted interviews with 23 participants, ten of whom also participated in a three-week diary study. Our findings show that while the Nest was well-received overall, the intelligent features of the Nest were not perceived to be as useful or intuitive as expected, in particular due to the system's inability to understand the intent behind sensed behavior and users' difficulty in understanding how the Nest works. A number of participants developed workarounds for the shortcomings they encountered. Based on our observations, we propose three avenues for future development of interactive intelligent technologies for the home: exception flagging, incidental intelligibility, and constrained engagement.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
The Computer for the 21st Century
Weiser, M. (1991) · Scientific American · doi:10.1038/scientificamerican0991-94 · Cited by 10,017
The Duality of Technology: Rethinking the Concept of Technology in Organizations
Orlikowski, W. J. (1992) · Organization Science · doi:10.1287/orsc.3.3.398 · Cited by 4,957
(2006) · Cited by 2,256
The Aware Home: A Living Laboratory for Ubiquitous Computing Research
Kidd, C. D., Orr, R., Abowd, G. D., Atkeson, C. G., Essa, I. A., MacIntyre, B., Mynatt, E., Starner, T. E., & Newstetter, W. (1999) · Lecture Notes in Computer Science · doi:10.1007/10705432_17 · Cited by 1,035 · cited 2×
“, [9,10]), or with prototypes in experimental settings (e.”
The design of eco-feedback technology
Froehlich, J., Findlater, L., & Landay, J. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753629 · Cited by 813 · cited 2×
“, [7]), which will, in turn, motivate people to save more energy.”
(1935) · Economic Record · doi:10.1111/j.1475-4932.1935.tb02774.x · Cited by 712
Why and why not explanations improve the intelligibility of context-aware intelligent systems
Lim, B. Y., Dey, A. K., & Avrahami, D. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1519023 · Cited by 552 · cited 1×
“been done into how to design interfaces that render system behavior more intelligible [1,12,24], such research has yet”
BackgroundAt Home with Ubiquitous Computing: Seven Challenges
Edwards, W. K., & Grinter, R. E. (2001) · Cited by 535
MavHome: an agent-based smart home
Cook, D. J., Youngblood, M., Heierman, E. O., Gopalratnam, K., Rao, S., Litvin, A., & Khawaja, F. (2004) · Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003). · doi:10.1109/percom.2003.1192783 · Cited by 525 · cited 1×
“, [3,9,10,15]), but few such projects have provided insight into the lived experience of occupants.”
Intelligibility and Accountability: Human Considerations in Context-Aware Systems
Bellotti, V., & Edwards, K. (2001) · Human–Computer Interaction · doi:10.1207/s15327051hci16234_05 · Cited by 471 · cited 2×
“been done into how to design interfaces that render system behavior more intelligible [1,12,24], such research has yet”
Research works printed but not linked: 4
- Dey A.K., 2009, Workshop on Intelligence and Interaction: IJCAI
- 10.5555/647987.741327 · doi:10.5555/647987.741327
- U.S. Energy Information Administration Annual Energy Review September 27 2012 U.S. Energy Information Administration Annual Energy Review September 27 2012
- 10.5555/645969.674887 · doi:10.5555/645969.674887
Cited by
Working with Machines: The Impact of Algorithmic and Data-Driven Management on Human Workers
Lee, M. K., Kusbit, D., Metsky, E., & Dabbish, L. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702548 · Cited by 823
“Interaction with intelligent machines Much research has investigated how people respond to intelligent machines such as automated manufacturing technologies [23, 36, 44], recommender systems [6], context-aware systems [3, 43], agents [35], and robots [30].”
BackgroundAbdul, A., Vermeulen, J., Wang, D., Lim, B. Y., & Kankanhalli, M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174156 · Cited by 743
“Research explored the need for [111] and provision of explanations in physical space, such as smart environments [177, 178, 179], the office [26], smart homes [18, 30, 131, 183] and on the move [90, 116].”
BackgroundInfluentialPrinciples of Explanatory Debugging to Personalize Interactive Machine Learning
Kulesza, T., Burnett, M., Wong, W.-K., & Stumpf, S. (2015) · Proceedings of the 20th International Conference on Intelligent User Interfaces · doi:10.1145/2678025.2701399 · Cited by 576
“As Yang and Newman found when studying users of learning thermostats [46], a system that appears to disregard user feedback deters users from continuing to provide feedback.”
BackgroundUser Perceptions of Smart Home IoT Privacy
Zheng, S., Apthorpe, N., Chetty, M., & Feamster, N. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274469 · Cited by 423
“More recently, Yang and Newman [64] investigated user experiences living with a Nest learning thermostat to inform the development of intelligent home technologies.”
BackgroundHalhoul Merabet, G., Essaaidi, M., Ben Haddou, M., Qolomany, B., Qadir, J., Anan, M., Al-Fuqaha, A., Abid, M. R., & Benhaddou, D. (2021) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2021.110969 · Cited by 422
UX Design Innovation: Challenges for Working with Machine Learning as a Design Material
Dove, G., Halskov, K., Forlizzi, J., & Zimmerman, J. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025739 · Cited by 391
“They may inadvertently display an inability to understand the intent behind users’ behavior, which results in “intelligent” features being perceived as useless and unintuitive [57].”
BackgroundIncremental on-line learning: A review and comparison of state of the art algorithms
Losing, V., Hammer, B., & Wersing, H. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.06.084 · Cited by 382
“This is particularly interesting for smart home products [2, 3].”
BackgroundA Privacy Preserving Communication Protocol for IoT Applications in Smart Homes
Song, T., Li, R., Mei, B., Yu, J., Xing, X., & Cheng, X. (2017) · IEEE Internet of Things Journal · doi:10.1109/jiot.2017.2707489 · Cited by 294
“Different than [3], [11], and [23], Jie et al.”
BackgroundMethodGram-Hanssen, K., & Darby, S. J. (2018) · Energy Research & Social Science · doi:10.1016/j.erss.2017.09.037 · Cited by 278
“…agent (Robles & Kim, 2010); moving beyond this , sensors and processors can also ‘acquire and apply knowledge’ about a home, acting independently of direct human agency to change control settings (Das & Cook, 2005, p. 337), in applications such as the ‘learning thermostat’ (Yang & Newman, 2013).”
BackgroundEdge Mesh: A New Paradigm to Enable Distributed Intelligence in Internet of Things
Sahni, Y., Cao, J., Zhang, S., & Yang, L. (2017) · IEEE Access · doi:10.1109/access.2017.2739804 · Cited by 221
“For example: Nest thermostat uses machines learning algorithms and sensing technology to generate personalized heating and cooling schedule [28].”
MethodWho's In Control?: Interactions In Multi-User Smart Homes
Geeng, C., & Roesner, F. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300498 · Cited by 195
From today's augmented houses to tomorrow's smart homes: new directions for home automation research
Mennicken, S., Vermeulen, J., & Huang, E. M. (2014) · Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2632048.2636076 · Cited by 194
“[16], Yang & Newman [58] as well as our own studies [35] suggest that in order to reduce the informational complexity and meet the requirements of inhabitants, interfaces with automation technologies should rather focus on deviations from routines.”
BackgroundInfluentialWorking Algorithms: Software Automation and the Future of Work
Shestakofsky, B. (2017) · Work and Occupations · doi:10.1177/0730888417726119 · Cited by 186
“Users do not always passively accept technological innovations; instead, they often develop interpretations of and adaptive responses to technol-ogy—also known as ‘‘workarounds’’—that can undermine designers’ intentions (Lee, Kusbit, Metsky, & Dabbish, 2015; Lim, Dey, & Avrahami, 2009; Yang & Newman, 2013; Zuboff, 1988…”
BackgroundSmart technology in the home: time for more clarity
Darby, S. J. (2018) · Building Research & Information · doi:10.1080/09613218.2017.1301707 · Cited by 174
“Another well-known example is the ‘learning thermostat’ (Yang and Newman, 2013)”
BackgroundDay, J. K., McIlvennie, C., Brackley, C., Tarantini, M., Piselli, C., Hahn, J., O'Brien, W., Rajus, V. S., De Simone, M., Kjærgaard, M. B., et al. (2020) · Building and Environment · doi:10.1016/j.buildenv.2020.106920 · Cited by 168
Evaluating saliency map explanations for convolutional neural networks: a user study
Alqaraawi, A., Schuessler, M., Weiß, P., Costanza, E., & Berthouze, N. (2020) · Proceedings of the 25th International Conference on Intelligent User Interfaces · doi:10.1145/3377325.3377519 · Cited by 163
“is may lead to over-reliance on a system [37], less vigilance towards system failures [61] and”
BackgroundHousehold occupancy monitoring using electricity meters
Kleiminger, W., Beckel, C., & Santini, S. (2015) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2750858.2807538 · Cited by 174
“As a result, users of such smart thermostats often turn off automatic control to regain authority over the system [32].”
BackgroundRethinking Access Control and Authentication for the Home Internet of Things (IoT)
He, W., Golla, M., Padhi, R., Ofek, J., Dürmuth, M., Fernandes, E., & Ur, B. (2018) · ePrints Soton (University of Southampton) · Cited by 141
Adibi, S., Rajabifard, A., Shojaei, D., & Wickramasinghe, N. S. (2024) · Sensors · doi:10.3390/s24092793 · Cited by 166
“Building management systems (BMS) focused on the centralized control of building infrastructure for energy efficiency and security, with early examples including programmable thermostats (e.g., the Nest Learning Thermostat) [31,32].”
BackgroundDoing the laundry with agents: a field trial of a future smart energy system in the home
Costanza, E., Fischer, J. E., Colley, J. A., Rodden, T., Ramchurn, S. D., & Jennings, N. R. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557167 · Cited by 120
“However, research has shown this comes not just at the cost of utility, due to incorrect predictions, but also at the cost of user trust, if the system is not legible and cannot be interrogated [36].”
BackgroundYang, R., Shin, E., Newman, M. W., & Ackerman, M. S. (2015) · Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2750858.2804269 · Cited by 119
“While a user needs a more detailed and deeper understanding of the system’s logic or reasoning, its components of processes, such as sensing, inference and machine learning techniques are concealed and difficult to understand for a novice user [6,14,21].”
BackgroundSelf-citationSpringer, A., & Whittaker, S. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3302322 · Cited by 115
“Providing system explanations may also undermine user perceptions when users lack the attentional capacity to process complex explanations, for example while they are executing a demanding task [12,84].”
Background“This has to be the cats”: Personal Data Legibility in Networked Sensing Systems
Tolmie, P., Crabtree, A., Rodden, T. A., Colley, J., & Luger, E. A. (2016) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2818048.2819992 · Cited by 131
“Evaluation of the Nest thermostat, for example, documents its inability to recognise interactional ‘context, situations and intent’ [20], and this is just one single sensor, what of a host of them embedded in the home?”
BackgroundMaking sustainability sustainable: challenges in the design of eco-interaction technologies
Yang, R., Newman, M., & Forlizzi, J. (2014) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557380 · Cited by 123
“We then report users’ initial experiences upon acquiring a Nest by reanalyzing the data originally collected for [23] from the perspective of the Product Ecology Framework [4].”
BackgroundMethodInfluentialSelf-citationExploring End User Programming Needs in Home Automation
Brich, J., Walch, M., Rietzler, M., Weber, M., & Schaub, F. (2017) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3057858 · Cited by 118
“This however conflicts with the reality that only part of the user population is both tech-savvy and interested enough to program their home from the ground up [Bartram et al. 2011; Bernheim Brush et al. 2011; Poole et al. 2008; Rodden et al. 2013; Rode et al. 2005; Yang and Newman 2013].”
BackgroundNagy, Z., Yong, F. Y., & Schlueter, A. (2016) · Energy and Buildings · doi:10.1016/j.enbuild.2016.05.075 · Cited by 96
Making Sense of Sleep Sensors: How Sleep Sensing Technologies Support and Undermine Sleep Health
Ravichandran, R., Sien, S.-W., Patel, S. N., Kientz, J. A., & Pina, L. R. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025557 · Cited by 95
Pritoni, M., Meier, A., Aragón, C., Perry, D., & Peffer, T. E. (2015) · Energy Research & Social Science · doi:10.1016/j.erss.2015.06.002 · Cited by 116
Designing the Desirable Smart Home: A Study of Household Experiences and Energy Consumption Impacts
Jensen, R. H., Strengers, Y., Kjeldskov, J., Nicholls, L., & Skov, M. B. (2018) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173578 · Cited by 116
“’s [71,72] extensive user study of the NEST Thermostat (a commercial smart thermostat that promotes energy savings by intelligently deducing households’ comfort needs).”
BackgroundProgressive Disclosure: When, Why, and How Do Users Want Algorithmic Transparency Information?
Springer, A., & Whittaker, S. (2020) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3374218 · Cited by 84
“There is a long history of studying transparency and intelligibility in automated systems [1, 6, 85, 89].”
BackgroundFostering Engagement with Personal Informatics Systems
Gulotta, R., Forlizzi, J., Yang, R., & Newman, M. W. (2016) · Proceedings of the 2016 ACM Conference on Designing Interactive Systems · doi:10.1145/2901790.2901803 · Cited by 81
Self-citationPopa, D., Pop, F., Serbanescu, C., & Castiglione, A. (2018) · Neural Computing and Applications · doi:10.1007/s00521-018-3724-6 · Cited by 82
RetractedEnabling process mining on sensor data from smart products
van Eck, M. L., Sidorova, N., & van der Aalst, W. M. P. (2016) · International Conference on Research Challenges in Information Science (RCIS) · doi:10.1109/rcis.2016.7549355 · Cited by 98
“Another part of this challenge is to not only learn about a small set of observed interactions between a user and a product, but to be able to infer what this means for possible interactions in general [4].”
BackgroundInfluentialA First-Person Experience with End-User Development for Smart Homes
Coutaz, J., & Crowley, J. L. (2016) · IEEE Pervasive Computing · doi:10.1109/mprv.2016.24 · Cited by 86
Evolving Needs in IoT Control and Accountability: A Longitudinal Study on Smart Home Intelligibility
Jakobi, T., Stevens, G., Castelli, N., Ogonowski, C., Schaub, F., Vindice, N., Randall, D. W., Tolmie, P., & Wulf, V. (2018) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3287049 · Cited by 86
“Yang and Newman have demonstrated how users demand Nest thermostats to provide incidental intelligibility in terms of their behavior and options [101].”
BackgroundChalhoub, G., Kraemer, M. J., Nthala, N., & Fléchais, I. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445691 · Cited by 105
“In other work, Yang and Newman [90] investigated experiences of thermostats, highlighting the importance of understanding user values and behaviors.”
Chasin, F., Paukstadt, U., Gollhardt, T., & Becker, J. (2020) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2020.122083 · Cited by 90
"Just whack it on until it gets hot": Working with IoT Data in the Home
Fischer, J. E., Crabtree, A., Rodden, T. A., Colley, J., Costanza, E., Jewell, M. O., & Ramchurn, S. D. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858518 · Cited by 82
Designing Human-Agent Collaborations: Commitment, responsiveness, and support
Cila, N. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517500 · Cited by 65
“Yang and Newman [163] demonstrated that the users of Nest overestimated its learning capabilities, which lead to some energy wastage.”
BackgroundInfluentialThe Illusion of Control: Placebo Effects of Control Settings
Vaccaro, K., Huang, D., Eslami, M., Sandvig, C., Hamilton, K., & Karahalios, K. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173590 · Cited by 65
“As a result of the important role sensemaking plays in user experience and design, many researchers have explored sensemaking around automated systems, in domains from thermostats and home sensors [58, 63] to self tracking devices [30, 47, 64] and other personal data [62] to classification algorithms [31].”
BackgroundMonsters, Metaphors, and Machine Learning
Dove, G., & Fayard, A.-L. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376275 · Cited by 59
“However, these artifacts may also encourage unrealistic expectations [99], or fail to respond in a way that follows user intent [176].”
BackgroundGarg, R., & Cui, H. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3485058 · Cited by 70
Tariff Agent: Interacting with a Future Smart Energy System at Home
Alan, A. T., Costanza, E., Ramchurn, S. D., Fischer, J., Rodden, T., & Jennings, N. R. (2016) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2943770 · Cited by 61
“Examples of the latter include “smart” thermostats that take into account our whereabouts and learn our heating preferences [Gupta et al. 2009; Yang and Newman 2013; Yang et al. 2014].”
BackgroundPrivacy, boundaries and smart homes for health: An ethnographic study
Burrows, A., Coyle, D., & Gooberman‐Hill, R. (2018) · Health & Place · doi:10.1016/j.healthplace.2018.01.006 · Cited by 72
“A suitable understanding of context remains a pitfall of smart systems (Yang and Newman, 2013).”
BackgroundA personalised thermal comfort model using a Bayesian network
Auffenberg, F., Stein, S., & Rogers, A. (2015) · ePrints Soton (University of Southampton) · Cited by 58
Explicating "Implicit Interaction": An Examination of the Concept and Challenges for Research
Serim, B., & Jacucci, G. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300647 · Cited by 55
“the use practices that emerge around a learning thermostat [105].”
BackgroundKurze, A., Bischof, A., Totzauer, S., Storz, M., Eibl, M., Brereton, M. F., & Berger, A. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376273 · Cited by 68
“Our focus was on studies undertaken in participants’ homes [3,5,7,11,13,22,23,29,30, 32] and investigating the relationship between users and data.”
BackgroundExploring Sound Awareness in the Home for People who are Deaf or Hard of Hearing
Jain, D., Lin, A. Z., Guttman, R., Amalachandran, M., Zeng, A., Findlater, L., & Froehlich, J. E. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300324 · Cited by 63
“Technology that best improves quality of life integrates into the domestic processes of household members [6,21,22], adapts to user feedback [18,23], uses environmental context to control displayed information [6,10], and hides private information [5,10].”
BackgroundKoupaei, D. M., Song, T., Cetin, K. S., & Im, J. (2019) · Building and Environment · doi:10.1016/j.buildenv.2019.106603 · Cited by 63
“This difference may also be due in part to the inclusion of a broader range of smart ther-mostat users in this data who may value other thermostat features, as compared to earlier studies that utilized a population more strongly dominated by more energy-conscious early adopters [16].”
BackgroundResultInfluentialAssessing Users’ Privacy and Security Concerns of Smart Home Technologies
Zimmermann, V., Gerber, P., Marky, K., Böck, L., & Kirchbuchner, F. (2019) · i-com · doi:10.1515/icom-2019-0015 · Cited by 75
Dynamic energy management with thermal comfort forecasting
Tsolkas, C., Spiliotis, E., Sarmas, E., Marinakis, V., & Doukas, H. (2023) · Building and Environment · doi:10.1016/j.buildenv.2023.110341 · Cited by 57
Understanding Motivators, Constraints, and Practices of Sharing Internet of Things
Garg, R., & Moreno, C. (2019) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3328915 · Cited by 61
van Oosterhout, A., Bruns, M., & Pyykko, S. J. (2018) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174229 · Cited by 53
“Expanding the capabilities and features of home appliances can cause a gap between users’ mental models causing inefficient use, confusion, dissatisfaction, and abandonment system’s features [37].”
BackgroundA Privacy Preserving Communication Protocol for IoT Applications in Smart Homes
Song, T., Li, R., Mei, B., Yu, J., Xing, X., & Cheng, X. (2016) · International Conference on Identification, Information and Knowledge in the Internet of Things (IIKI) · doi:10.1109/iiki.2016.3 · Cited by 50
“According to [3], the Nest Thermostat system was having trouble understanding the users’ intent when the users manually adjust the thermostat.”
BackgroundMethodHuman-Building Interaction: When the Machine Becomes a Building
Nembrini, J., & Lalanne, D. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-67684-5_21 · Cited by 54
“In the mixed-mode context, the use of machine learning techniques to infer user preferences has shown limited success [69], while user suggestions may achieve better performance as well as acceptance than automatic techniques [3, 20, 70].”
When Smart Devices Are Stupid: Negative Experiences Using Home Smart Devices
He, W., Martinez, J. J., Padhi, R., Zhang, L., & Ur, B. (2019) · IEEE Security and Privacy Workshops (SPW) · doi:10.1109/spw.2019.00036 · Cited by 45
Interactive online learning for obstacle classification on a mobile robot
Losing, V., Hammer, B., & Wersing, H. (2015) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2015.7280610 · Cited by 45
“The flexible adaptation of technical systems to user habits and preferences is very important for their acceptance, as noted for the lerning Nest thermostat [3].”
BackgroundDesign for reduced resource consumption during the use phase of products
Shu, L. H., Duflou, J. R., Herrmann, C. A., Sakao, T., Shimomura, Y., Bock, Y. D., & Srivastava, J. (2017) · CIRP Annals · doi:10.1016/j.cirp.2017.06.001 · Cited by 54
A Day in the Life of Things in the Home
Crabtree, A., & Tolmie, P. (2016) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2818048.2819954 · Cited by 57
It is too Hot: An In-Situ Study of Three Designs for Heating
Alan, A., Shann, M., Costanza, E., Ramchurn, S. D., & Seuken, S. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858222 · Cited by 64
“Yang and Newman [28] examined the real-world uptake of a smart thermostat with 23 participants.”
BackgroundA Comfort-Based Approach to Smart Heating and Air Conditioning
Auffenberg, F., Snow, S., Stein, S., & Rogers, A. (2017) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3057730 · Cited by 43
A review on smart home technology
Suresh, S., & Sruthi, P. (2015) · Online International Conference on Green Engineering and Technologies · doi:10.1109/get.2015.7453832 · Cited by 42
To trust or not to trust smart consumer products: a literature review of trust-building factors
Michler, O., Decker, R., & Stummer, C. (2019) · Management Review Quarterly · doi:10.1007/s11301-019-00171-8 · Cited by 65
“While installation, setup and use should be easy (Park et al. 2017; Rijsdijk and Hultink 2003), understanding how the solution works is key for establishing users’ trust in a smart home product (Rijsdijk and Hultink 2003; Yang and Newman 2013).”
BackgroundInfluentialConditions for a cost-effective application of smart thermostat systems in residential buildings
Schäuble, D., Marian, A., & Cremonese, L. (2020) · Applied Energy · doi:10.1016/j.apenergy.2020.114526 · Cited by 45
How household thermal routines shape UK home heating demand patterns
Hanmer, C., Shipworth, M., Shipworth, D., & Carter, E. (2018) · Energy Efficiency · doi:10.1007/s12053-018-9632-x · Cited by 40
“BLearning thermostats^ such as NEST (Yang and Newman 2013) and others, could change the patterns of operation. you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.”
BackgroundLocked or Not? Mental Models of IoT Feature Interaction
Yarosh, S., & Zave, P. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025617 · Cited by 54
“Some previous work in this domain has examined user perceptions and practices around existing systems, such as the Nest thermostat [19].”
BackgroundEhrenberg, N., & Keinonen, T. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445058 · Cited by 48
Smartphone-based augmented reality for end-user creation of home automations
Ariano, R., Manca, M., Paternò, F., & Santoro, C. (2022) · Behaviour and Information Technology · doi:10.1080/0144929x.2021.2017482 · Cited by 45
“He et al. (2019); Yang and Newman (2013)) there are various issues in intelligent systems for the home, such as the learning system failing to correctly capture user ’ s intent, or the system ’ s behaviour being hard to understand.”
BackgroundCatch my drift? achieving comfort more sustainably in conventionally heated buildings
Clear, A. K., Friday, A., Hazas, M., & Lord, C. (2014) · Designing Interactive Systems Conference · doi:10.1145/2598510.2598529 · Cited by 38
“However, the users’ motivation for adjusting the temperature is difficult for the system to gauge, leading to over-complex schedules and not necessarily energy savings [20].”
BigBlueBot: teaching strategies for successful human-agent interactions
Weisz, J. D., Jain, M., Joshi, N. N., Johnson, J., & Lange, I. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3302290 · Cited by 38
Adjustable Green Defaults Can Help Make Smart Homes More Sustainable
Sintov, N. D., & Schultz, P. W. (2017) · Sustainability · doi:10.3390/su9040622 · Cited by 44
“Well-intentioned individuals may forget, become distracted, or otherwise fail to make adjustments; they may select non-optimal settings; they may simply not be motivated to adjust to sustainable settings, or may be making trade-offs between sustainability and other objectives, such as comfort or convenience [1,2].”
BackgroundFrom Tools Towards Cooperative Assistants
Krüger, M., Wiebel, C. B., & Wersing, H. (2017) · International Conference on Human-Agent Interaction (HAI) · doi:10.1145/3125739.3125753 · Cited by 42
“[33] showed that users of this system found the intelligent learning functions hard to understand and the resulting schedules were often not matching the original user intent.”
BackgroundSmart Home Technologies: A Preliminary Review
Balakrishnan, S., Vasudavan, H., & Murugesan, R. K. (2018) · International Conference on Information Technology: IoT and Smart City (ICIT) · doi:10.1145/3301551.3301575 · Cited by 55
New Directions in Information Technology Law: Learning from Human Computer Interaction
Urquhart, L., & Rodden, T. A. (2016) · International Review of Law Computers & Technology · doi:10.1080/13600869.2017.1298501 · Cited by 38
“How legal interests, like control of personal data, manifest within such spaces may be shaped by domestic hierarchies, for example, between teenagers and parents, older relatives, student flatmates (Yang and Newman 2013).”
BackgroundExploring the Design Space of User-System Communication for Smart-home Routine Assistants
Chiang, Y.-S., Chang, R.-C., Chuang, Y.-L., Chou, S.-Y., Lee, H.-P., Lin, I.-J., Chen, J.-H. J., & Chang, Y.-J. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376501 · Cited by 40
“This could lead them to stop utilizing such systems’ predictive functions, or at worst, to abandon system use altogether [65, 47].”
BackgroundDanry, V., Pataranutaporn, P., Mao, Y., & Maes, P. (2020) · Augmented Humans International Conference (AHs) · doi:10.1145/3384657.3384799 · Cited by 55
The Comfstat - automatically sensing thermal comfort for smart thermostats
Barrios, L., & Kleiminger, W. (2017) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom.2017.7917872 · Cited by 32
“However, non-technical challenges like sensor placement, uncertainty about the choices made by the system and doubts regarding achievable savings mean that user acceptance for such smart thermostats is still quite low [6], [7], [8].”
BackgroundHeatDial: Beyond User Scheduling in Eco-Interaction
Jensen, R. H., Kjeldskov, J., & Skov, M. B. (2016) · Nordic Conference on Human-Computer Interaction · doi:10.1145/2971485.2971525 · Cited by 40
“However, related to the above discussion, our study of HeatDial also seems to confirm Yang and colleagues observations [28] that balancing automation while also engaging users to act sustainable, is a challenge, which not only concerns energy conserving actions of reducing energy, but also relates to intentions of shi…”
BackgroundInfluentialAssisted Shifting of Electricity Use: A Long-Term Study of Managing Residential Heating
Jensen, R. H., Kjeldskov, J., & Skov, M. B. (2018) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3210310 · Cited by 39
“Similarly, The Nest is a commercial thermostat that aims to reduce consumption related to heating and cooling by deriving user preferences intelligently.”
BackgroundMethodInfluentialMare, S., Girvin, L., Roesner, F., & Kohno, T. (2019) · IEEE Workshop on Mobile Computing Systems and Applications (WMCSA) · doi:10.1145/3301293.3302371 · Cited by 31
“conducted a user-experience study with people living with Nest smart thermostat, and found that participants had diculty understanding how the system worked, which lead to reduced interaction with the thermostat [23].”
BackgroundPisharoty, D., Yang, R., Newman, M., & Whitehouse, K. (2015) · ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys) · doi:10.1145/2821650.2821671 · Cited by 30
“Recently, “smart thermostats” have been introduced to simplify or eliminate programming altogether, but these approaches have introduced new usability problems even as they solve old ones [24,25].”
BackgroundSelf-citationCo-Performing Agent: Design for Building User-Agent Partnership in Learning and Adaptive Services
Kim, D.-J., & Lim, Y.-K. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300714 · Cited by 42
“…of interaction with the agent, because users often set an unreasonably high expectation of intelligent systems and such misled initial expectations increase the potential of users’ disappointment and early abandonment of the systems even before the systems acquire the knowledge of users [13,30,31].”
Backgroundde Oliveira, L. C. R., Mitchell, V., & May, A. J. (2019) · Personal and Ubiquitous Computing · doi:10.1007/s00779-019-01302-4 · Cited by 36
“Recent developments in SHT, for example with the Nest thermostat, are pursuing the simplification of user interactions through algorithms that learn occupancy patterns and energy use [38].”
MethodChen, W., Yu, C., Wang, H., Wang, Z., Yang, L., Wang, Y., Shi, W., & Shi, Y. (2023) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3586183.3606741 · Cited by 44
“Secondly, many context-aware systems act as black-box AI for users, making it difcult for them to understand the system’s behavior and participate in controlling it [3, 6, 17, 44].”
BackgroundFORTNIoT: Intelligible Predictions to Improve User Understanding of Smart Home Behavior
Coppers, S., Vanacken, D., & Luyten, K. (2020) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3432225 · Cited by 35
“…that developers of intelligible interfaces need to keep in mind: users are generally not interested in learning how the underlying technology works [73], can easily be overwhelmed by large amounts of well-intended information [38, 51], and their needs for intelligibility shifted over time from…”
BackgroundWashing with the Wind: A Study of Scripting towards Sustainability
Jensen, R. H., Raptis, D., Kjeldskov, J., & Skov, M. B. (2018) · Designing Interactive Systems Conference · doi:10.1145/3196709.3196779 · Cited by 36
FailureSense: Detecting Sensor Failure Using Electrical Appliances in the Home
Munir, S., & Stankovic, J. A. (2014) · IEEE International Conference on Mobile Ad-Hoc and Sensor Systems (MASS) · doi:10.1109/mass.2014.16 · Cited by 28
“To handle such exceptional cases, we plan to use Exception Flagging [17], where our solution just ignores the data collected during such period.”
MethodBreaching the future: understanding human challenges of autonomous systems for the home
Nilsson, T., Crabtree, A., Fischer, J., & Koleva, B. N. (2019) · Personal and Ubiquitous Computing · doi:10.1007/s00779-019-01210-7 · Cited by 35
“ial non-technical pitfalls that might impact mainstream adoption. Novel technology has the habit of introducing novel human problems, and domestic autonomous systems are no exception. Yang and Newman [5] found, for instance, that users of the NEST thermostat have frequent difficulties in understanding its behaviour. S…”
BackgroundEnergy advisors at work: charity work practices to support people in fuel poverty
Fischer, J. E., Costanza, E., Ramchurn, S. D., Colley, J., & Rodden, T. A. (2014) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2632048.2636081 · Cited by 29
“The use of air quality sensing [24,25], and occupancy sensing to control home heating [36,47] are also relevant.”
BackgroundCollaborative Map Making: A Reflexive Method for Understanding Matters of Concern in Design Research
Lee, H. R., Šabanović, S., & Kwak, S. S. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025535 · Cited by 34
“For example, in recent “in-the-wild” smart home studies, women became invisible actors because they were not the primary users of computing technologies [5,33,35].”
BackgroundPsychology and energy conservation: Contributions from theory and practice
Abrahamse, W., & Schuitema, G. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-818567-4.00001-6 · Cited by 28
Learning from the real practices of users of a smart carpooling app
Adelé, S., & Dionisio, C. (2020) · European Transport Research Review · doi:10.1186/s12544-020-00429-3 · Cited by 28
Sensorstation: Exploring Simple Sensor Data in the Context of a Shared Apartment
Denefleh, T., Berger, A., Kurze, A., Bischof, A., & Frauenberger, C. (2019) · Designing Interactive Systems Conference · doi:10.1145/3322276.3322309 · Cited by 32
“If we look at the “Smart Home”, we also see a range of research around data work on sensors in the home, e.g. energy advice, eco-feedback, ambient assisted living, or privacy concerns [4, 46, 44, 9, 49].”
BackgroundDesigning sensor sets for capturing energy events in buildings
Lovett, T., Lee, J. H., Gabe‐Thomas, E., Natarajan, S., Brown, M., Padget, J. A., & Coley, D. (2016) · Building and Environment · doi:10.1016/j.buildenv.2016.09.004 · Cited by 26
Framework for communicating with consumers using an expectation interface in smart thermostats
Ponce, P., Peffer, T. E., & Molina, A. (2017) · Energy and Buildings · doi:10.1016/j.enbuild.2017.03.065 · Cited by 25
A conversational agent for creating automations exploiting large language models
Gallo, S., Paternò, F., & Malizia, A. (2024) · Personal and Ubiquitous Computing · doi:10.1007/s00779-024-01825-5 · Cited by 25
“As a result, these issues discourage users from fully utilising their smart devices, making the technology less accessible and user-friendly [1–3].”
Zhang, L., He, W., Morkved, O., Zhao, V., Littman, M. L., Lu, S., & Ur, B. (2020) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3411838 · Cited by 25
“This finding, along with the principle of giving users control as rooted in ubicomp literature [4, 15, 16, 40, 60], highlights the benefits of Trace2TAP’s approach in involving the user even when the system automatically synthesizes automation from observed behaviors.”
BackgroundKnecht, K., Bryan–Kinns, N., & Shoop, K. (2016) · Electronic workshops in computing · doi:10.14236/ewic/hci2016.41 · Cited by 28
“Research on the smart thermostat Nest suggests that smart features are not as effective as one might expect, which, however, depends on the ability of the system to correctly classify the user actions it learns from as well as to render its processes legible to the user (Yang & Newman 2013).”
BackgroundDesign Vocabulary for Human--IoT Systems Communication
Chuang, Y., Chen, L.-L., & Liu, Y. (2018) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173848 · Cited by 23
“However, when something unexpected happens, users often feel frustrated because they don’t know how the problem occurred [25, 47].”
Choosing the Best Algorithm for an Incremental On-line Learning Task
Losing, V., Hammer, B., & Wersing, H. (2016) · Publikationen an der Universität Bielefeld (Universität Bielefeld) · Cited by 21
Metadata
- Authors
- Yang, R., & Newman, M. W.
- Affiliations
- University of Michigan (US)
- Venue
- Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing
- Publisher
- ACM
- Published
- 2013-09-08
- Pages
- 93-102
- OpenAlex
- W2133270667
- Cited by
- 268
- References
- 28
- Citations by year
- 2026: 9 · 2025: 7 · 2024: 12 · 2023: 15 · 2022: 13 · 2021: 15 · 2020: 25 · 2019: 34 · 2018: 33 · 2017: 41 · 2016: 34 · 2015: 21 · 2014: 9
- FWCI
- 16.81
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) (publishedVersion)
- Funders
- University of Michigan
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Physical Sciences › Engineering › Electrical and Electronic Engineering › IoT-based Smart Home Systems
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- smart home devices, smart home technology, user experience, eco-feedback, user intent understanding, workarounds
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.