CoChat
Sign Up
Cited by 28Software Engineering Techniques and PracticesSoftware Engineering ResearchWorkaholism, burnout, and well-being

The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.

Using experience sampling to link software repositories with emotions and work well-being

Open access
Kuutila, Miikka, Mäntylä, Mika V., Claes, Maëlick, Elovainio, Marko, Adams, Bram·2018·Proceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement
DOI 10.1145/3239235.3239245
Open this paper in CoChat — free accountOpen PDF

Abstract

Background: The experience sampling method studies everyday experiences of humans in natural environments. In psychology it has been used to study the relationships between work well-being and productivity. To our best knowledge, daily experience sampling has not been previously used in software engineering. Aims: Our aim is to identify links between software developers self-reported affective states and work well-being and measures obtained from software repositories. Method: We perform an experience sampling study in a software company for a period of eight months, we use logistic regression to link the well-being measures with development activities, i.e. number of commits and chat messages. Results: We find several significant relationships between questionnaire variables and software repository variables. To our surprise relationship between hurry and number of commits is negative, meaning more perceived hurry is linked with a smaller number of commits. We also find a negative relationship between social interaction and hindered work well-being. Conclusions: The negative link between commits and hurry is counter-intuitive and goes against previous lab-experiments in software engineering that show increased efficiency under time pressure. Overall, our is an initial step in using experience sampling in software engineering and validating theories on work well-being from other fields in the domain of software engineering.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3239235.3239245

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Research on emotions during requirements engineering activities, including while handling RCs, is extremely limited.

    “However, research on emotions during requirements engineering activities, including while handling RCs is extremely limited [36], [14], [15].”

    From A Framework for Emotion-Oriented Requirements Change Handling in Agile Software Engineering (2023) · cites this paper as [36]

    The Introduction discusses research on software developers’ emotions and says that no prior study had linked daily self-reported emotions with repository measures. It does not assess how much research exists on emotions during requirements engineering or while handling RCs; searches for those topics found no passage addressing that claim. (LLM, conf=0.74)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Flagged first, then by citations

Research works printed but not linked: 58

  1. Hirotogu Akaike . 1973 . Information theory and an extension of the maximum likelihood principle . In 2nd International Symposium on Information Theory. Akademiai Kiado, 267--281 . Hirotogu Akaike. 1973. Information theory and an extension of the maximum likelihood principle. In 2nd International Symposium on Information Theory. Akademiai Kiado, 267--281.
  2. 10.1016/S0022-3999(02)00333-1 · DOI · Paper page
  3. 10.1111/j.1744-6570.1993.tb00883.x · DOI
  4. 10.1108/02683940710733115 · DOI · Paper page
  5. Barry W Boehm etal 1981. Software engineering economics. Vol. 197. Prentice-hall Englewood Cliffs (NJ). Barry W Boehm et al. 1981. Software engineering economics. Vol. 197. Prentice-hall Englewood Cliffs (NJ).
  6. 10.1016/S0031-3203(96)00142-2 · DOI · Paper page
  7. 10.1109/52.536456 · DOI
  8. 10.1007/b97636 · DOI
  9. Ann Frances Cameron and Jane Webster . 2005. Unintended consequences of emerging communication technologies: Instant messaging in the workplace. Computers in Human behavior 21, 1 ( 2005 ), 85--103. Ann Frances Cameron and Jane Webster. 2005. Unintended consequences of emerging communication technologies: Instant messaging in the workplace. Computers in Human behavior 21, 1 (2005), 85--103.
  10. 10.1109/52.605934 · DOI
  11. 10.1037/1072-5245.12.4.409 · DOI
  12. Anna-Liisa Elo , Anneli Leppänen , and Antti Jahkola . 2003. Validity of a single-item measure of stress symptoms. Scandinavian journal of work, environment & health ( 2003 ), 444--451. Anna-Liisa Elo, Anneli Leppänen, and Antti Jahkola. 2003. Validity of a single-item measure of stress symptoms. Scandinavian journal of work, environment & health (2003), 444--451.
  13. 10.1287/mnsc.46.12.1554.12072 · DOI · Paper page
  14. Susan Folkman . 2013. Stress: appraisal and coping . In Encyclopedia of behavioral medicine . Springer , 1913 --1915. Susan Folkman. 2013. Stress: appraisal and coping. In Encyclopedia of behavioral medicine. Springer, 1913--1915.
  15. John Fox , Sanford Weisberg , Daniel Adler , Douglas Bates , Gabriel Baud-Bovy , Steve Ellison , David Firth , Michael Friendly , Gregor Gorjanc , Spencer Graves , 2012 . Package `car'. Vienna: R Foundation for Statistical Computing (2012). John Fox, Sanford Weisberg, Daniel Adler, Douglas Bates, Gabriel Baud-Bovy, Steve Ellison, David Firth, Michael Friendly, Gregor Gorjanc, Spencer Graves, et al. 2012. Package `car'. Vienna: R Foundation for Statistical Computing (2012).
  16. Davide Fucci , Giuseppe Scanniello , Simone Romano , and Natalia Juristo . 2018. Need for Sleep: the Impact of a Night of Sleep Deprivation on Novice Developers' Performance. arXiv preprint arXiv:1805.02544 ( 2018 ). Davide Fucci, Giuseppe Scanniello, Simone Romano, and Natalia Juristo. 2018. Need for Sleep: the Impact of a Night of Sleep Deprivation on Novice Developers' Performance. arXiv preprint arXiv:1805.02544 (2018). · arXiv
  17. 10.1007/978-3-642-39259-7_7 · DOI
  18. 10.1145/2804381.2804386 · DOI
  19. Tarja Heponiemi , Hannele Hyppönen , Tuulikki Vehko , Sari Kujala , Anna-Mari Aalto , Jukka Vänskä , and Marko Elovainio . 2017. Finnish physicians? stress related to information systems keeps increasing: a longitudinal three-wave survey study. BMC medical informatics and decision making 17, 1 ( 2017 ), 147. Tarja Heponiemi, Hannele Hyppönen, Tuulikki Vehko, Sari Kujala, Anna-Mari Aalto, Jukka Vänskä, and Marko Elovainio. 2017. Finnish physicians? stress related to information systems keeps increasing: a longitudinal three-wave survey study. BMC medical informatics and decision making 17, 1 (2017), 147.
  20. Remus Ilies and Timothy A Judge. 2004. An experience-sampling measure of job satisfaction and its relationships with affectivity mood at work job beliefs and general job satisfaction. European journal of work and organizational psychology 13 3 (2004) 367--389. Remus Ilies and Timothy A Judge. 2004. An experience-sampling measure of job satisfaction and its relationships with affectivity mood at work job beliefs and general job satisfaction. European journal of work and organizational psychology 13 3 (2004) 367--389. · DOI
  21. 10.1109/MSR.2017.9 · DOI
  22. 10.1007/s10664-016-9493-x · DOI
  23. 10.1016/j.jpsychires.2005.09.007 · DOI
  24. Michiel Kompier and Cary L Cooper . 1999. Preventing stress, improving productivity: European case studies in the workplace . Psychology Press . Michiel Kompier and Cary L Cooper. 1999. Preventing stress, improving productivity: European case studies in the workplace. Psychology Press.
  25. Klaus Krippendorff . {n. d.}. Reliability . Wiley Online Library . Klaus Krippendorff. {n. d.}. Reliability. Wiley Online Library.
  26. 10.1371/journal.pone.0069841 · DOI · Paper page
  27. 10.1145/3194932.3194942 · DOI
  28. 10.1016/j.jss.2015.04.084 · DOI
  29. Bin Lin , Fiorella Zampetti , Gabriele Bavota , Massimiliano Di Penta , Michele Lanza, and Rocco Oliveto. 2018 . Sentiment Analysis for So ware Engineering : How Far Can We Go ? (2018). Bin Lin, Fiorella Zampetti, Gabriele Bavota, Massimiliano Di Penta, Michele Lanza, and Rocco Oliveto. 2018. Sentiment Analysis for So ware Engineering: How Far Can We Go? (2018).
  30. Stefan Linßen Dirk Basten and Janek Richter. 2018. Antecedents and Consequences of Time Pressure in Scrum Projects: Insights from a Qualitative Study. (2018). Stefan Linßen Dirk Basten and Janek Richter. 2018. Antecedents and Consequences of Time Pressure in Scrum Projects: Insights from a Qualitative Study. (2018). · DOI
  31. 10.1348/135910704773891005 · DOI
  32. 10.1016/j.infsof.2012.12.004 · DOI
  33. 10.1109/MSR.2017.47 · DOI
  34. 10.1145/2568225.2568245 · DOI
  35. Katherine I Miller , Beth Hartman Ellis , Eric G Zook, and Judith S Lyles. 1990 . An integrated model of communication, stress, and burnout in the workplace. Communication research 17, 3 (1990), 300--326. Katherine I Miller, Beth Hartman Ellis, Eric G Zook, and Judith S Lyles. 1990. An integrated model of communication, stress, and burnout in the workplace. Communication research 17, 3 (1990), 300--326.
  36. 10.1177/0893318989003002002 · DOI
  37. 10.1348/096317905X40105 · DOI
  38. 10.1145/567793.567795 · DOI · Paper page
  39. Harvey Motulsky and Arthur Christopoulos . 2004. Fitting models to biological data using linear and nonlinear regression: a practical guide to curve fitting . Oxford University Press . Harvey Motulsky and Arthur Christopoulos. 2004. Fitting models to biological data using linear and nonlinear regression: a practical guide to curve fitting. Oxford University Press.
  40. 10.1348/096317902167658 · DOI
  41. 10.1109/TSE.2009.18 · DOI
  42. 10.1145/3196398.3196403 · DOI
  43. 10.17705/1jais.00163 · DOI
  44. 10.1145/3202710.3203148 · DOI
  45. Christie Napa Scollon , Chu-Kim Prieto , and Ed Diener . 2009 . Experience sampling: promises and pitfalls, strength and weaknesses. In Assessing well-being. Springer , 157--180. Christie Napa Scollon, Chu-Kim Prieto, and Ed Diener. 2009. Experience sampling: promises and pitfalls, strength and weaknesses. In Assessing well-being. Springer, 157--180.
  46. 10.1111/j.2044-8325.1996.tb00616.x · DOI
  47. 10.1080/1359432X.2012.752898 · DOI
  48. 10.1111/j.1464-0597.2006.00270.x · DOI
  49. 10.1111/j.2044-8325.1994.tb00571.x · DOI
  50. Ola Svenson . 1993. Time pressure and stress in human judgment and decision making . Springer Science & Business Media . Ola Svenson. 1993. Time pressure and stress in human judgment and decision making. Springer Science & Business Media.
  51. 10.1016/j.ijinfomgt.2010.10.010 · DOI
  52. 10.1016/j.lrp.2016.04.001 · DOI
  53. Stefan Wagner and Melanie Ruhe . 2018. A systematic review of productivity factors in software development. arXiv preprint arXiv:1801.06475 ( 2018 ). Stefan Wagner and Melanie Ruhe. 2018. A systematic review of productivity factors in software development. arXiv preprint arXiv:1801.06475 (2018). · arXiv
  54. 10.1037/0021-9010.82.2.247 · DOI
  55. 10.1111/j.1467-6494.1991.tb00261.x · DOI
  56. Ian H Witten , Eibe Frank , Mark A Hall , and Christopher J Pal . 2016 . Data Mining: Practical machine learning tools and techniques. Morgan Kaufmann. Ian H Witten, Eibe Frank, Mark A Hall, and Christopher J Pal. 2016. Data Mining: Practical machine learning tools and techniques. Morgan Kaufmann.
  57. 10.1108/02683940710837714 · DOI · Paper page
  58. 10.1002/cne.920180503 · DOI · Paper page

Cited by

Sorted by citations

Metadata

Authors
Kuutila, M., Mäntylä, M. V., Claes, M., Elovainio, M., & Adams, B.
Affiliations
  • University of Oulu (FI)
  • University of Helsinki (FI)
  • Polytechnique Montréal (CA)
ORCID
Venue
Proceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement
Publisher
ACM
Published
2018-10-11
Pages
1-10
ISSN
1938-6451 (ISSN-L)
DOI
10.1145/3239235.3239245
OpenAlex
W2885610756
Cited by
28
References
4
Citations by year
2026: 2 · 2025: 4 · 2024: 1 · 2023: 1 · 2022: 4 · 2021: 9 · 2020: 3 · 2019: 3 · 2018: 1
FWCI
2.68
Type
conference paper
Language
en
Open access
Licence
www.acm.org/publications/policies/copyright_policy#Background (vor)
Locations
  • Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • PolyPublie (École Polytechnique de Montréal) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • KAUTE-Säätiö
  • Academy of Finland (298020)
Topics
  • Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
  • Physical Sciences › Computer Science › Information Systems › Software Engineering Research
  • Social Sciences › Psychology › Social Psychology › Workaholism, burnout, and well-being
Keywords
ecological momentary assessment, software repositories, employee well-being, affective states, software developers, chat messages, social interaction, time pressure, developer productivity

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review