“I Can’t Reply with That”: Characterizing Problematic Email Reply Suggestions
The DOI matches its Crossref record; 103 of the 103 references it cites were found in a registry or an index.
Abstract
In email interfaces, providing users with reply suggestions may simplify or accelerate correspondence. While the “success” of such systems is typically quantified using the number of suggestions selected by users, this ignores the impact of social context, which can change how suggestions are perceived. To address this, we developed a mixed-methods framework involving qualitative interviews and crowdsourced experiments to characterize problematic email reply suggestions. Our interviews revealed issues with over-positive, dissonant, cultural, and gender-assuming replies, as well as contextual politeness. In our experiments, crowdworkers assessed email scenarios that we generated and systematically controlled, showing that contextual factors like social ties and the presence of salutations impacts users’ perceptions of email correspondence. These assessments created a novel dataset of human-authored corrections for problematic email replies. Our study highlights the social complexity of providing suggestions for email correspondence, raising issues that may apply to all social messaging systems.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Indeed, various AIMC studies have shown that AI assistance (e.g., word-by-word suggestions or short-reply suggestions) can shift the characteristics of writing content, such as a more positive tone [22,48,59], or even affect topics addressed in writing [57].”
From 'It was 80% me, 20% AI': Seeking Authenticity in Co-Writing with Large Language Models (2025) · cites this paper as [59]
In the citing paper
“This is a surprising result given that previous AIMC work has found readers to hold negative opinions about messages and their writers once they become aware of the message being written with AI assistance [31,44,59].”
From 'It was 80% me, 20% AI': Seeking Authenticity in Co-Writing with Large Language Models (2025) · cites this paper as [59]
Citations
Cites
Politeness: Some Universals in Language Usage
Brown, P., Levinson, S. C., & Gumperz, J. J. (1987) · Cambridge University Press eBooks · doi:10.1017/cbo9780511813085 · Cited by 10,438
VADER: a parsimonious rule-based model for sentiment analysis of social media text
Hutto, C., & Gilbert, E. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14550 · Cited by 6,087
The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods
Tausczik, Y. R., & Pennebaker, J. W. (2010) · Journal of Language and Social Psychology · doi:10.1177/0261927x09351676 · Cited by 5,774 · cited 1×
“The second, Empath [47], is an adaptable emotion lexicon-based word embedding trained on 1.8 billion words from modern fction, and that strongly correlates with a popular psychometrically validated gold-standard [105].”
BackgroundInfluential(2017) · Macat Library eBooks · doi:10.4324/9781912281732 · Cited by 4,703
Tit for Tat? The Spiraling Effect of Incivility in the Workplace
Andersson, L. M., & Pearson, C. M. (1999) · The Academy of Management Review · doi:10.2307/259136 · Cited by 3,256
Algorithm aversion: People erroneously avoid algorithms after seeing them err.
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000033 · Cited by 3,232
Course in General Linguistics: Ferdinand de Saussure
(2013) · Bloomsbury Publishing Plc eBooks · doi:10.5040/9781350284968 · Cited by 2,695
Crystal, D. (2001) · Cambridge University Press eBooks · doi:10.1017/cbo9781139164771 · Cited by 2,233
Preston, C. C., & Colman, A. M. (2000) · Acta Psychologica · doi:10.1016/s0001-6918(99)00050-5 · Cited by 2,106
Incivility in the workplace: Incidence and impact.
Cortina, L. M., Magley, V. J., Williams, J. H., & Langhout, R. D. (2001) · Journal of Occupational Health Psychology · doi:10.1037//1076-8998.6.1.64 · Cited by 2,084
Aguinis, H., & Bradley, K. J. (2014) · Organizational Research Methods · doi:10.1177/1094428114547952 · Cited by 2,021
Likert scales: how to (ab)use them
Jamieson, S. (2004) · Medical Education · doi:10.1111/j.1365-2929.2004.02012.x · Cited by 1,602
The Use of Vignettes in Survey Research
Alexander, C. S., & Becker, H. J. (1978) · Public Opinion Quarterly · doi:10.1086/268432 · Cited by 1,169 · cited 1×
“For each of the seven categories, we developed a set of vignettes – carefully constructed and realistic experimental scenarios [1, 2] – that we could present to judges while experimentally manipulating the presence or absence of structural features and social ties.”
MethodHOW TO DO THINGS WITH WORDS. The William James Lectures delivered at Harvard University in 1955
MAYO, B. (1963) · Philosophical Books · doi:10.1111/j.1468-0149.1963.tb00768.x · Cited by 1,054
Personal and workgroup incivility: Impact on work and health outcomes.
Lim, S., Cortina, L. M., & Magley, V. J. (2008) · Journal of Applied Psychology · doi:10.1037/0021-9010.93.1.95 · Cited by 904
An Evaluation of a Cognitive Theory of Response-Order Effects in Survey Measurement
Krosnick, J. A., & Alwin, D. F. (1987) · Public Opinion Quarterly · doi:10.1086/269029 · Cited by 825
Temporal patterns of happiness and information in a global social network: hedonometrics and Twitter
Dodds, P. S., Harris, K. D., Kloumann, I. M., Bliss, C. A., & Danforth, C. M. (2011) · PLoS ONE · doi:10.1371/journal.pone.0026752 · Cited by 809 · cited 1×
“To systematically examine the adjustments, we used a method called word shifts,7 which are designed to show the relative differences in sentiment and other dictionary-based scores [40, 50].”
MethodRelational Aspects of Computer-Mediated Communication: Experimental Observations over Time
Walther, J. B. (1995) · Organization Science · doi:10.1287/orsc.6.2.186 · Cited by 796
Improving Fairness in Machine Learning Systems: What Do Industry Practitioners Need?
Holstein, K., Wortman Vaughan, J., Daumé, H., Dudik, M., & Wallach, H. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300830 · Cited by 777 · cited 1×
“Drawing from prior work, we developed a semi-structured interview format [46, 65], recruited participants to cover varying communication preferences [28, 29, 78], and analyzed interview transcripts using an approach rooted in grounded theory [99, 106].”
MethodSocial Data: Biases, Methodological Pitfalls, and Ethical Boundaries
Olteanu, A., Castillo, C., Diaz, F., & Kıcıman, E. (2019) · Frontiers in Big Data · doi:10.3389/fdata.2019.00013 · Cited by 763 · cited 1×
“Little is known about the long-term impacts of providing such automation [57], but predictive text systems are known to create feedback loops: behavioral and societal factors skew user behavior, these skews get embedded in the logged data and are reproduced by algorithms, users then interact with that output, which, i…”
BackgroundSelf-citationSocial Data: Biases, Methodological Pitfalls, and Ethical Boundaries
Olteanu, A., Castillo, C., Diaz, F., & Kiciman, E. (2016) · doi:10.2139/ssrn.2886526 · Cited by 763
Self-citationAI-Mediated Communication: Definition, Research Agenda, and Ethical Considerations
Hancock, J. T., Naaman, M., & Levy, K. (2020) · Journal of Computer-Mediated Communication · doi:10.1093/jcmc/zmz022 · Cited by 658
Eslami, M., Rickman, A., Vaccaro, K., Aleyasen, A., Vuong, A., Karahalios, K., Hamilton, K., & Sandvig, C. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702556 · Cited by 627
The quality of online social relationships
Cummings, J. N., Butler, B., & Kraut, R. (2002) · Communications of the ACM · doi:10.1145/514236.514242 · Cited by 578
The Impact of “No Opinion” Response Options on Data Quality
Krosnick, J. A., Holbrook, A. L., Berent, M. K., Carson, R. T., Hanemann, W. M., Kopp, R. J., Mitchell, R. C., Presser, S., Ruud, P. A., Smith, V. K., et al. (2001) · Public Opinion Quarterly · doi:10.1086/341394 · Cited by 546
Boucher, J., & Osgood, C. E. (1969) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(69)80002-2 · Cited by 541
Letters by phone or speech by other means: the linguistics of email
Baron, N. S. (1998) · Language & Communication · doi:10.1016/s0271-5309(98)00005-6 · Cited by 449
Baeza-Yates, R. (2018) · Communications of the ACM · doi:10.1145/3209581 · Cited by 432
Empath: Understanding Topic Signals in Large-Scale Text
Fast, E., Chen, B., & Bernstein, M. S. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858535 · Cited by 413
Human language reveals a universal positivity bias
Dodds, P. S., Clark, E. M., Desu, S., Frank, M. R., Reagan, A. J., Williams, J. R., Mitchell, L., Harris, K. D., Kloumann, I. M., Bagrow, J. P., et al. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1411678112 · Cited by 401
Cicchetti, D. V., Shoinralter, D., & Tyrer, P. J. (1985) · Applied Psychological Measurement · doi:10.1177/014662168500900103 · Cited by 291
Mind your E-manners: Impact of cyber incivility on employees’ work attitude and behavior
Lim, V. K. G., & Teo, T. S. H. (2009) · Information & Management · doi:10.1016/j.im.2009.06.006 · Cited by 287
The development of a method for the evaluation of interactive information retrieval systems
Borlund, P., & Ingwersen, P. (1997) · Journal of Documentation · doi:10.1108/eum0000000007198 · Cited by 282
Measuring the Happiness of Large-Scale Written Expression: Songs, Blogs, and Presidents
Dodds, P. S., Christopher, D. Æ., & Danforth, M. (2015) · Cited by 280
“I Just Google It”: Folk Theories of Distributed Discovery
Toff, B., & Nielsen, R. K. (2018) · Journal of Communication · doi:10.1093/joc/jqy009 · Cited by 270
Measuring the Happiness of Large-Scale Written Expression: Songs, Blogs, and Presidents
Dodds, P. S., & Danforth, C. M. (2010) · Journal of Happiness Studies · doi:10.1007/s10902-009-9150-9 · Cited by 260
Comparisons of Party Identification and Policy Preferences: The Impact of Survey Question Format
Krosnick, J. A., & Berent, M. K. (1993) · American Journal of Political Science · doi:10.2307/2111580 · Cited by 244
Email overload at work: an analysis of factors associated with email strain
Dabbish, L. A., & Kraut, R. E. (2006) · Proceedings of the 2006 20th anniversary conference on Computer supported cooperative work · doi:10.1145/1180875.1180941 · Cited by 238
Proceedings of the 35th Annual Hawaii International Conference on System Sciences HICSS-35
(2002) · Proceedings of the 35th Annual Hawaii International Conference on System Sciences HICSS-02 · doi:10.1109/hicss.2002.993840 · Cited by 222
AI as a moral crumple zone: The effects of AI-mediated communication on attribution and trust
Hohenstein, J., & Jung, M. (2020) · Computers in Human Behavior · doi:10.1016/j.chb.2019.106190 · Cited by 212 · cited 20×
“Together, these results suggest that AI-MC systems that ignore social context have the potential to turn otherwise appropriate replies into inappropriate ones.”
BackgroundInfluentialSelf-Disclosure and Perceived Trustworthiness of Airbnb Host Profiles
Ma, X., Hancock, J. T., Lim Mingjie, K., & Naaman, M. (2017) · Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/2998181.2998269 · Cited by 199
Jakesch, M., French, M., Ma, X., Hancock, J. T., & Naaman, M. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300469 · Cited by 190
Understanding email use: predicting action on a message
Dabbish, L. A., Kraut, R. E., Fussell, S., & Kiesler, S. (2005) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1054972.1055068 · Cited by 189
Smart Reply: Automated Response Suggestion for Email
Kannan, A., Kurach, K., Ravi, S., Kaufmann, T., Tomkins, A., Miklos, B., Corrado, G., Lukacs, L., Ganea, M., Young, P., et al. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939801 · Cited by 183
Conversations Gone Awry: Detecting Early Signs of Conversational Failure
Zhang, J., Chang, J., Danescu-Niculescu-Mizil, C., Dixon, L., Hua, Y., Taraborelli, D., & Thain, N. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1125 · Cited by 175
When is an email really offensive?: Argumentativity and variability in evaluations of impoliteness
Haugh, M. (2010) · Journal of Politeness Research. Language, Behaviour, Culture · doi:10.1515/jplr.2010.002 · Cited by 173
Greetings and Closings in Workplace Email
Waldvogel, J. (2007) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2007.00333.x · Cited by 160
Knobel, C., & Bowker, G. C. (2011) · Communications of the ACM · doi:10.1145/1965724.1965735 · Cited by 158
Vignovic, J. A., & Thompson, L. F. (2010) · Journal of Applied Psychology · doi:10.1037/a0018628 · Cited by 150
Two Sides of Emotion: Exploring Positivity and Negativity in Six Basic Emotions across Cultures
An, S., Ji, L.-J., Marks, M., & Zhang, Z. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00610 · Cited by 149
lol: new language and spelling in instant messaging
Varnhagen, C. K., McFall, G. P., Pugh, N. E., Routledge, L., Sumida-MacDonald, H., & Kwong, T. E. (2009) · Reading and Writing · doi:10.1007/s11145-009-9181-y · Cited by 148
Learning to Infer Social Ties in Large Networks
Tang, W., Zhuang, H., & Tang, J. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-23808-6_25 · Cited by 142
Focusing on the negative: Cultural differences in expressions of sympathy.
Koopmann‐Holm, B., & Tsai, J. L. (2014) · Journal of Personality and Social Psychology · doi:10.1037/a0037684 · Cited by 141
An Empirical Analysis of Formality in Online Communication
Pavlick, E., & Tetreault, J. (2016) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00083 · Cited by 136
Email flaming behaviors and organizational conflict
Turnage, A. K. (2007) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2007.00385.x · Cited by 134 · cited 1×
“However, linguistic features commonly employed in email and other types of digital communications, like abbreviation, non-standard combinations of punctuation and capitalization, and brevity, may violate this principle and be viewed as inappropriate [26, 41, 56, 67, 107].”
BackgroundIntroduction: Politeness and impoliteness in computer-mediated communication
Locher, M. A. (2010) · Journal of Politeness Research · doi:10.1515/jplr.2010.001 · Cited by 123
Information spreading in context
Wang, D., Wen, Z., Tong, H., Lin, C.-Y., Song, C., & Barabási, A.-L. (2011) · Proceedings of the 20th international conference on World wide web · doi:10.1145/1963405.1963508 · Cited by 114
Yu, M.-C. (2005) · Language and Speech · doi:10.1177/00238309050480010501 · Cited by 110
The Pollyanna Hypothesis in Business Writing: Initial Results, Suggestions for Research
Hildebrandt, H., & Snyder, R. D. (1981) · Journal of Business Communication · doi:10.1177/002194368101800102 · Cited by 106
Linguistic positivity in historical texts reflects dynamic environmental and psychological factors
Iliev, R. I., Hoover, J., Dehghani, M., & Axelrod, R. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1612058113 · Cited by 103
A Cost-Benefit Study of Text Entry Suggestion Interaction
Quinn, P., & Zhai, S. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858305 · Cited by 98
Politeness Accommodation in Electronic Mail
Bunz, U., & Campbell, S. W. (2004) · Communication Research Reports · doi:10.1080/08824090409359963 · Cited by 90
Predictive text encourages predictable writing
Arnold, K. C., Chauncey, K., & Gajos, K. Z. (2020) · Proceedings of the 25th International Conference on Intelligent User Interfaces · doi:10.1145/3377325.3377523 · Cited by 87
Cultural determinants of email communication styles
Holtbrügge, D., Weldon, A., & Rogers, H. (2012) · International Journal of Cross Cultural Management · doi:10.1177/1470595812452638 · Cited by 81
The effect of politeness and grammar on user perceptions of electronic mail.
Jessmer, S. L., & Anderson, D. R. (2001) · North American journal of psychology · Cited by 81
Evolution of Conversations in the Age of Email Overload
Kooti, F., Aiello, L. M., Grbovic, M., Lerman, K., & Mantrach, A. (2015) · International World Wide Web Conference (WWW) · doi:10.1145/2736277.2741130 · Cited by 76
Sentiment Analysis of Student Evaluations of Teaching
Newman, H., & Joyner, D. A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93846-2_45 · Cited by 71
The influence of workload and civility of treatment on the perpetration of email incivility
Francis, L., Holmvall, C. M., & O’Brien, L. E. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2014.12.044 · Cited by 70
Gallagher, R. J., Frank, M. R., Mitchell, L., Schwartz, A. J., Reagan, A. J., Danforth, C. M., & Dodds, P. S. (2021) · EPJ Data Science · doi:10.1140/epjds/s13688-021-00260-3 · Cited by 70 · cited 1×
“To systematically examine the adjustments, we used a method called word shifts,7 which are designed to show the relative differences in sentiment and other dictionary-based scores [40, 50].”
MethodOn Suggesting Phrases vs. Predicting Words for Mobile Text Composition
Arnold, K. C., Gajos, K. Z., & Kalai, A. T. (2016) · Proceedings of the 29th Annual Symposium on User Interface Software and Technology · doi:10.1145/2984511.2984584 · Cited by 69 · cited 3×
“These suggestions can help users avoid spelling errors, reduce keystrokes, and send brief replies with the click of a button [7, 97].”
BackgroundOn the Holm, Simes, and Hochberg multiple test procedures.
Levin, B. (1996) · American Journal of Public Health · doi:10.2105/ajph.86.5.628 · Cited by 61
The effects of response option order and question order on self-rated health
Garbarski, D., Schaeffer, N. C., & Dykema, J. (2014) · Quality of Life Research · doi:10.1007/s11136-014-0861-y · Cited by 59
Using Amazon Mechanical Turk and other compensated crowdsourcing sites
Schmidt, G. B., & Jettinghoff, W. (2016) · Business Horizons · doi:10.1016/j.bushor.2016.02.004 · Cited by 59
Groshek, J., & Cutino, C. M. (2016) · Social Media + Society · doi:10.1177/2056305116677137 · Cited by 57
Social Comparison and Facebook: Feedback, Positivity, and Opportunities for Comparison
Burke, M., Cheng, J., & de Gant, B. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376482 · Cited by 57
Characterizing and Predicting Enterprise Email Reply Behavior
Yang, L., Dumais, S. T., Bennett, P. N., & Awadallah, A. H. (2017) · Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3077136.3080782 · Cited by 55
Using Speech Acts to Categorize Email and Identify Email Genres
Goldstein, J., & Sabin, R. E. (2006) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2006.528 · Cited by 51
Handbook of Research on E-Learning Methodologies for Language Acquisition
Marriott, R. D. C. V., & Torres, P. L. (2009) · IGI Global eBooks · doi:10.4018/978-1-59904-994-6 · Cited by 50
Castro, D. D., Karnin, Z. S., Lewin-Eytan, L., & Maarek, Y. (2016) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/2835776.2835811 · Cited by 49
AI-Supported Messaging: An Investigation of Human-Human Text Conversation with AI Support
Hohenstein, J., & Jung, M. (2018) · Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3170427.3188487 · Cited by 48
Auditing Autocomplete: Suggestion Networks and Recursive Algorithm Interrogation
Robertson, R. E., Jiang, S., Lazer, D. M. J., & Wilson, C. (2019) · ACM Web Science Conference (WebSci) · doi:10.1145/3292522.3326047 · Cited by 46
Self-citationNigerian English in informal email messages
Chiluwa, I. E. (2010) · English World-Wide A Journal of Varieties of English · doi:10.1075/eww.31.1.02chi · Cited by 40
Emotional states vs. emotional words in social media
Beasley, A., & Mason, W. (2015) · Proceedings of the ACM Web Science Conference · doi:10.1145/2786451.2786473 · Cited by 38 · cited 1×
“1) – and because researchers from have used VADER to measure positivity in a wide variety of domains [11, 17, 88], including conversation analysis [115].”
BackgroundWhen Are Search Completion Suggestions Problematic?
Olteanu, A., Diaz, F., & Kazai, G. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415242 · Cited by 38
Self-citationSievers, B., & Mersky, R. R. (2006) · Human Relations · doi:10.1177/0018726706062735 · Cited by 37
Sentiment Bias in Predictive Text Recommendations Results in Biased Writing
Arnold, K., Chauncey, K., & Gajos, K. (2018) · Canadian Human-Computer Communications Society / Société canadienne du dialogue humain-machine · doi:10.20380/gi2018.07 · Cited by 31
Politeness at Work in the Clinton Email Corpus: A First Look at the Effects of Status and Gender
Felice, R. D., & Garretson, G. (2018) · Corpus Pragmatics · doi:10.1007/s41701-018-0034-2 · Cited by 30
Watt, H. J. (2010) · Contemporary Issues in Communication Science and Disorders · doi:10.1044/cicsd_36_f_141 · Cited by 27
Opportunities for Automating Email Processing
Park, S., Zhang, A. X., Murray, L. S., & Karger, D. R. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300604 · Cited by 23
Egelman, S., Ed, H., & Dow, S. P. (2014) · Springer eBooks · doi:10.1007/978-1-4939-0378-8_11 · Cited by 22
Stephens, K. K., Cowan, R. L., & Houser, M. L. (2011) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2011.01537.x · Cited by 20
A classification scheme for annotating speech acts in a business email corpus
Felice, R. D., Darby, J., Fisher, A. J., et al. (2013) · Open Research Online - ORO (The Open University) · Cited by 18
Meaner on Mobile: Incivility and impoliteness in communicating online
Groshek, J., & Cutino, C. M. (2016) · International Conference on Social Media and Society (SMSociety) · doi:10.1145/2930971.2930976 · Cited by 18
Evaluating a Computational Approach to Labeling Politeness
Hoffman, E. R., McDonald, D. W., & Zachry, M. R. (2017) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3134687 · Cited by 18
Characterizing and Predicting Email Deferral Behavior
Sarrafzadeh, B., Awadallah, A. H., Lin, C. H., Lee, C.-J., Shokouhi, M., & Dumais, S. (2019) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3289600.3291028 · Cited by 18
Self-citationCan You be More Social? Injecting Politeness and Positivity into Task-Oriented Conversational AgentsPreprint
Wang, Y., Papangelis, A., Wang, R., Feizollahi, Z., Tür, G., & Kraut, R. E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.14653 · Cited by 15
The Influence of Textual Cues on First Impressions of an Email Sender
Marlow, S. L., Lacerenza, C. N., & Iwig, C. (2017) · Business and Professional Communication Quarterly · doi:10.1177/2329490617723115 · Cited by 13
Virtual words: language on the edge of science and technology
(2011) · Choice Reviews Online · doi:10.5860/choice.49-2026 · Cited by 9
Developing Evaluation Metrics for Instant Search Using Mixed Methods Methods
Chandar, P., Garcia-Gathright, J. I., Hosey, C., et al. (2019) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3331184.3331293 · Cited by 8
PhotoReply: Automatically Suggesting Conversational Responses to Photos
Ye, N., Fuxman, A. D., Ramavajjala, V., Nazarov, S., McGregor, J. P., & Ravi, S. (2018) · International World Wide Web Conference (WWW) · doi:10.1145/3178876.3186164 · Cited by 5
G-IM: An Input Method of Chinese Characters for Character Amnesia Prevention
Nishimoto, K., & Wei, J. (2015) · Institutional Repositories DataBase (IRDB) · Cited by 4
Characterizing and Supporting Question Answering in Human-to-Human Communication
Yang, X., Awadallah, A. H., Khabsa, M., Wang, W., & Wang, M. (2018) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3209978.3210046 · Cited by 4
Research works printed but not linked: 24
- 10.5465/amr.1999.2202131 · doi:10.5465/amr.1999.2202131 · Paper page
- Boomerang. 2020. Respondable: Write Better Email. https://www.boomeranggmail.com/respondable.
- Robin Campbell and Roger Wales. 1970. The Study of Language Acquisition. In New Horizons in Linguistics, J. Lyons (Ed.). Penguin, Harmondsworth, 242–260.
- Christina Cauterucci. 2015. New Chrome App Helps Women Stop Saying “Just” and “Sorry” in Emails. https://slate.com/human-interest/2015/12/new-chrome-app-helps-women-stop-saying-just-and-sorry-in-emails.html.
- Mia Xu Chen, Benjamin N. Lee, Gagan Bansal, Yuan Cao, Shuyuan Zhang, Justin Lu, Jackie Tsay, Yinan Wang, Andrew M. Dai, Zhifeng Chen, Timothy Sohn, and Yonghui Wu. 2019. Gmail Smart Compose: Real-Time Assisted Writing. arXiv:1906.00080 [cs] (May 2019). arxiv:1906.00080 [cs] · arXiv
- Noam Chomsky. 1965. Aspects of the Theory of Syntax. Number 11 in Massachusetts Institute of Technology (Cambridge, Mass.). Research Laboratory of Electronics. Special Technical Report. MIT Press, Cambridge, MA. OCLC: 245876504.
- 10.1037/1076-8998.6.1.64 · doi:10.1037/1076-8998.6.1.64 · Paper page
- Budhaditya Deb, Peter Bailey, and Milad Shokouhi. 2019. Diversifying Reply Suggestions Using a Matching-Conditional Variational Autoencoder. arXiv:1903.10630 [cs, stat] (March 2019). arxiv:1903.10630 [cs, stat] · arXiv
- Christa Dürscheid, Carmen Frehner, Susan C Herring, Dieter Stein, and Tuija Virtanen. 2013. Email communication. Handbooks of Pragmatics [HOPS]9 (2013), 35–54.
- William H. Dutton, Bianca Christin Reisdorf, Elizabeth Dubois, and Grant Blank. 2017. Search and Politics: The Uses and Impacts of Search in Britain, France, Germany, Italy, Poland, Spain, and the United States. SSRN Electronic Journal(2017).
- Anne Edstrom and Jennifer D. Ewald. 2017. ”Out of the Office”: Conveying Politeness through Auto-Reply Email Messages.Language@Internet 14, 4 (2017).
- Anne Edstrom and Jennifer D. Ewald. 2019. Characteristics of Effective Auto-Reply Emails: Politeness and Perceptions. Technology in Society (Jan. 2019), S0160791X1730218X.
- Brenden Gallagher. 2018. Gmail’s Smart Reply blurs the line between people and brands. https://www.dailydot.com/debug/thanks-for-letting-me-know/. [Online; accessed Sept-2019].
- Gary W. Giumetti, Andrea L. Hatfield, Jenna L. Scisco, Amber N. Schroeder, Eric R. Muth, and Robin M. Kowalski. 2013. What a Rude E-Mail! Examining the Differential Effects of Incivility versus Support on Mood, Energy, Engagement, and Performance in an Online Context.Journal of Occupational Health Psychology 18, 3 (July 2013), 297–309.
- Paul H. Grice. 1975. Logic and Conversation. In Syntax and Semantics: Speech Acts, Peter Cole and J. Morgan (Eds.). Vol. 3. Academic Press, New York, 41–58.
- Danielle N. Gunraj, April M. Drumm-Hewitt, Erica M. Dashow, Sri Siddhi N. Upadhyay, and Celia M. Klin. 2016. Texting Insincerely: The Role of the Period in Text Messaging. Computers in Human Behavior 55 (Feb. 2016), 1067–1075.
- Matthew Henderson, Rami Al-Rfou, Brian Strope, Yun-hsuan Sung, Laszlo Lukacs, Ruiqi Guo, Sanjiv Kumar, Balint Miklos, and Ray Kurzweil. 2017. Efficient Natural Language Response Suggestion for Smart Reply. arXiv:1705.00652 [cs] (May 2017). arxiv:1705.00652 [cs] · arXiv
- Susan C Herring. 1994. Politeness in computer culture: Why women thank and men flame. In Cultural Performances: Proceedings of the Third Berkeley Women and Language Conference. Berkeley Women and Language Group Berkeley, CA, 278–294.
- Kenneth J. Houghton, Sri Siddhi N. Upadhyay, and Celia M. Klin. 2018. Punctuation in Text Messages May Convey Abruptness. Period. Computers in Human Behavior 80 (March 2018), 112–121.
- Dell Hymes. 1972. On Communicative Competence. In Sociolinguistics: Selected Readings, J.B. Pride and J. Holmes (Eds.). Penguin, Harmondsworth, 269–293.
- Jon A. Krosnick and Stanley Presser. 2010. Question and Questionnaire Design. In Handbook of Survey Research, Second Edition (2 edition ed.), Peter V. Marsden and James D. Wright (Eds.). Emerald Publishing, Bingley, UK.
- Séamas O’Reilly. 2019. How Smart Are Gmail’s ‘Smart Replies’?The Observer (Feb. 2019).
- Erin L. Spottswood and Jeffrey T. Hancock. 2016. The Positivity Bias and Prosocial Deception on Facebook. Computers in Human Behavior 65 (Dec. 2016), 252–259.
- Jocelyne Vincent. 2008. Netiquette Rules OK!...OK?: speculating on rhetorical cleansing and English linguistic and cultural imperialism through email netiquette style guides. In Threads in the complex fabric of language: linguistic and literary studies in honour of Lavinia Merlini Barbaresi Lavinia Merlini Barbaresi Marcella Bertuccelli-Papi Antonio Bertacca and Silvia Bruti (Eds.). Felici San Giuliano Terme (Pisa) 409–443.
Cited by
A Design Space for Intelligent and Interactive Writing Assistants
Lee, M., Gero, K. I., Chung, J. J. Y., Shum, S. B., Raheja, V., Shen, H., Venugopalan, S., Wambsganss, T., Zhou, D., Alghamdi, E. A., et al. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642697 · Cited by 136
Where to Hide a Stolen Elephant: Leaps in Creative Writing with Multimodal Machine Intelligence
Singh, N., Bernal, G., Savchenko, D., & Glassman, E. L. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3511599 · Cited by 119
Will AI Console Me when I Lose my Pet? Understanding Perceptions of AI-Mediated Email Writing
Liu, Y., Mittal, A., Yang, D., & Bruckman, A. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517731 · Cited by 92
'It was 80% me, 20% AI': Seeking Authenticity in Co-Writing with Large Language Models
Hwang, A. H.-C., Liao, Q. V., Blodgett, S. L., Olteanu, A., & Trischler, A. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711020 · Cited by 42
Self-citationCo-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process
Reza, M., Thomas-Mitchell, J., Dushniku, P., Laundry, N., Williams, J. J., & Kuzminykh, A. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757566 · Cited by 37
“Clark’s [24] work examining user experiences with AI writing prototypes revealed that while participants found AI collaboration satisfying, the resulting text quality did not surpass that of unaided human writers.”
Metadata
- Authors
- Robertson, R. E., Olteanu, A., Diaz, F., Shokouhi, M., & Bailey, P.
- Affiliations
- Northeastern University (US)
- Microsoft (United States) (US)
- Microsoft Research, Canada
- Venue
- Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2021-05-06
- Pages
- 1-18
- OpenAlex
- W3134747254
- Cited by
- 43
- References
- 103
- Citations by year
- 2026: 8 · 2025: 9 · 2024: 10 · 2023: 4 · 2022: 9 · 2021: 3
- FWCI
- 4.85
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Topics
- Social Sciences › Linguistics and Language › Digital Communication and Language
- Social Sciences › Decision Sciences › Information Systems and Management › Personal Information Management and User Behavior
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- social environment, politeness, gender assumptions, cultural differences, social ties, greetings, crowdsourced experiments, email correspondence, social messaging
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.