Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.

A study on the prevalence of human values in software engineering publications, 2015 -- 2018

Open access
Perera, Harsha, Hussain, Waqar, Whittle, Jon, Nurwidyantoro, Arif, Mougouei, Davoud, Shams, Rifat Ara, Oliver, Gillian · 2020 · Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering

Abstract

Failure to account for human values in software (e.g., equality and fairness) can result in user dissatisfaction and negative socio-economic impact. Engineering these values in software, however, requires technical and methodological support throughout the development life cycle. This paper investigates to what extent top Software Engineering (SE) conferences and journals have included research on human values in SE. We investigate the prevalence of human values in recent (2015 -- 2018) publications in these top venues. We classify these publications, based on their relevance to different values, against a widely used value structure adopted from the social sciences. Our results show that: (a) only a small proportion of the publications directly consider values, classified as directly relevant publications; (b) for the majority of the values, very few or no directly relevant publications were found; and (c) the prevalence of directly relevant publications was higher in SE conferences compared to SE journals. This paper shares these and other insights that may motivate future research on human values in software engineering.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3377811.3380393

Cites

40 of 40 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Schwartz Values Structure [31] (adopted from [8]). Words in black boxes are values categories, each subdivided into values.
Figure 1 Schwartz Values Structure [31] (adopted from [8]). Words in black boxes are values categories, each subdivided into values.CC-BY-NC-SA · From the PDF
Figure 2 Relevance of SE publications to human values
Figure 2 Relevance of SE publications to human valuesCC-BY-NC-SA · From the PDF
Figure 3 Relevant Publications per year
Figure 3 Relevant Publications per yearCC-BY-NC-SA · From the PDF
Figure 4 The level of attention given to 58 values in the Schwartz Value Structure
Figure 4 The level of attention given to 58 values in the Schwartz Value StructureCC-BY-NC-SA · From the PDF
Figure 5 The number of directly relevant publications per value
Figure 5 The number of directly relevant publications per valueCC-BY-NC-SA · From the PDF
Figure 7 Differences in directly relevant publications across venues/tracks. Labels on the bars denote the number of papers in each category.
Figure 7 Differences in directly relevant publications across venues/tracks. Labels on the bars denote the number of papers in each category.CC-BY-NC-SA · From the PDF
Figure 8 Directly relevant publications per venue/track
Figure 8 Directly relevant publications per venue/trackCC-BY-NC-SA · From the PDF
Figure 9 The distribution of directly relevant publications by venue/track: directly relevant publications were found only for 23 out of 58 Schwartz values (Figure 1)
Figure 9 The distribution of directly relevant publications by venue/track: directly relevant publications were found only for 23 out of 58 Schwartz values (Figure 1)CC-BY-NC-SA · From the PDF
Figure 10 Publications directly relevant to different value categories across SE venues/tracks
Figure 10 Publications directly relevant to different value categories across SE venues/tracksCC-BY-NC-SA · From the PDF

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 40 references

Research works printed but not linked: 8

  1. Nick Baker. 2019. Molly Russell: Instagram Bans Graphic Self-Harm Images After Suicide of UK Teen. https://www.sbs.com.au/news/molly-russell-instagram-bans-graphic-self-harm-images-after-suicide-of-uk-teen
  2. Common Cause. 2011. The Common Cause Handbook-A Guide to Values and Frames for Campaigners, Community Organisers, Civil Servants, Fundraisers, Educators, Social Entrepreneurs, Activists, Funders, Politicians, and everyone in between. Public Interest Research Centre, Machynlleth, Wales (2011).
  3. ICSE. 2018. ICSE - Software Engineering in Society. https://www.icse2018.org/track/icse-2018-Software-Engineering-in-Society
  4. Md. Saddam Hossain Mukta, Euna Mehnaz Khan, Mohammed Eunus Ali, and Jalal Mahmud. 2017. Predicting Movie Genre Preferences from Personality and Values of Social Media Users. In Eleventh International AAAI Conference on Web and Social Media.
  5. Shalom H. Schwartz. 2005. Basic Human Values: Their Content and Structure Across Countries. Valores e Comportamento nas Organizações (2005), 21--55.
  6. Shalom H Schwartz. 2006. Basic Human Values: An Overview. Recuperado de http://www.yourmorals.org/schwartz (2006).
  7. 10.5555/2819303.2819319 · doi:10.5555/2819303.2819319
  8. Courtney Williams, Margaret-Anne Storey, Neil A Ernst, Alexey Zagalsky, and Eirini Kalliamvakou. 2019. Methodology Matters: How We Study Socio-Technical Aspects in Software Engineering. arXiv preprint arXiv:1905.12841 (2019). · arXiv

Cited by

See all 63

Metadata

Authors
Perera, H., Hussain, W., Whittle, J., Nurwidyantoro, A., Mougouei, D., Shams, R. A., & Oliver, G.
Affiliations
Monash University (AU)
Venue
Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering
Publisher
ACM
Published
2020-06-27
Pages
409-420
ISSN
0270-5257 (ISSN-L)
OpenAlex
W2959714675
Cited by
63
References
40
Citations by year
2026: 3 · 2025: 8 · 2024: 7 · 2023: 12 · 2022: 13 · 2021: 12 · 2020: 6
FWCI
8.15
Type
conference paper
Language
en
Open access
Locations
  • ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) (publishedVersion, cc-by-nc-sa)
  • arXiv (Cornell University) (submittedVersion)
  • Monash University Research Portal (Monash University) (submittedVersion, other-oa)
  • Figshare (submittedVersion, cc-by)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Physical Sciences › Computer Science › Software › Advanced Software Engineering Methodologies
Keywords
human values, software engineering, equality, fairness, software engineering conferences, value structure

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A study on the prevalence of human values in software engineering publications, 2015 -- 2018. https://app.cochat.ai/papers/10.1145/3377811.3380393
The paper
Perera, H., Hussain, W., Whittle, J., Nurwidyantoro, A., Mougouei, D., Shams, R. A., & Oliver, G. (2020). A study on the prevalence of human values in software engineering publications, 2015 -- 2018. Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering. https://doi.org/10.1145/3377811.3380393

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.