The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
A study on the prevalence of human values in software engineering publications, 2015 -- 2018
Open accessAbstract
Failure to account for human values in software (e.g., equality and fairness) can result in user dissatisfaction and negative socio-economic impact. Engineering these values in software, however, requires technical and methodological support throughout the development life cycle. This paper investigates to what extent top Software Engineering (SE) conferences and journals have included research on human values in SE. We investigate the prevalence of human values in recent (2015 -- 2018) publications in these top venues. We classify these publications, based on their relevance to different values, against a widely used value structure adopted from the social sciences. Our results show that: (a) only a small proportion of the publications directly consider values, classified as directly relevant publications; (b) for the majority of the values, very few or no directly relevant publications were found; and (c) the prevalence of directly relevant publications was higher in SE conferences compared to SE journals. This paper shares these and other insights that may motivate future research on human values in software engineering.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
![Figure 1 Schwartz Values Structure [31] (adopted from [8]). Words in black boxes are values categories, each subdivided into values.](https://figures.cochat.ai/paper-figures/6f3ed17a70e04d5b9caea84976b8c06d/a-study-on-the-prevalence-of-human-values-in-software-engineering-publications-figure-1.png)








Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A consideration of human values is largely lacking in software engineering [23]”
From Operationalising ethics in artificial intelligence for healthcare: a framework for AI developers (2023) · cites this paper as [23]
In the citing paper
“A literature review found four values to be the most frequently cited in 1,350 recently published software engineering publications: security, benevolence, universalism, and self-direction [23].”
From Operationalising ethics in artificial intelligence for healthcare: a framework for AI developers (2023) · cites this paper as [23]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148 · cited 3×
“The results of the Kappa measure are interpreted according to the agreement strengths introduced by Landis and Koch [19].”
MethodInfluentialSchwartz, S. H. (1992) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(08)60281-6 · Cited by 14,619 · cited 3×
“classification not only in the social sciences but also in other disciplines [11, 40]. In SVS, Schwartz introduced 10 motivationally-distinct value categories recognized across more than 30 cultures [27]. Each value category has underlying distinct motivational goals (see Table 1) which relate to three fundamental nee…”
BackgroundMethodInfluential(1973) · DigitalGeorgetown (Georgetown University Library) · Cited by 10,144
Are There Universal Aspects in the Structure and Contents of Human Values?
Schwartz, S. H. (1994) · Journal of Social Issues · doi:10.1111/j.1540-4560.1994.tb01196.x · Cited by 5,793 · cited 2×
“tegories (Universalism, Conformity and Tradition). This verifies the tensions discussed in the Schwartz Values Structure about the competing and contradicting nature of these bipolar value categories [28]. It is important to note that SVS served as an appropriate yet not ideal scheme for classifying human values in SE…”
BackgroundAn overview of the Schwartz theory of basic values
Schwartz, S. H. (2012) · Online Readings in Psychology and Culture · doi:10.9707/2307-0919.1116 · Cited by 4,147 · cited 2×
“We followed a methodology similar to that of prior classification work in SE Table 1: Value categories and descriptions [32]”
MethodEvaluating the structure of human values with confirmatory factor analysis
Schwartz, S. H., & Boehnke, K. (2004) · Journal of Research in Personality · doi:10.1016/s0092-6566(03)00069-2 · Cited by 1,092 · cited 1×
“Figure 1: Schwartz Values Structure [30, 33] (adopted from [17]).”
BackgroundLes valeurs de base de la personne : théorie, mesures et applications
Schwartz, S. H. (2006) · Revue française de sociologie · doi:10.3917/rfs.474.0929 · Cited by 970 · cited 1×
“Figure 1: Schwartz Values Structure [30, 33] (adopted from [17]).”
BackgroundFriedman, B. (1996) · Interactions · doi:10.1145/242485.242493 · Cited by 966
Requirements engineering paper classification and evaluation criteria: a proposal and a discussion
Wieringa, R., Maiden, N., Mead, N., & Rolland, C. (2006) · Requirements Engineering · doi:10.1007/s00766-005-0021-6 · Cited by 940 · cited 1×
“[43] developed a classification scheme to identify papers that belong to Requirements Engineering as a subdomain in SE.”
Artificial Intelligence and the ‘Good Society’: the US, EU, and UK approach
Cath, C., Wachter, S., Mittelstadt, B., Taddeo, M., & Floridi, L. (2017) · Science and Engineering Ethics · doi:10.1007/s11948-017-9901-7 · Cited by 733 · cited 1×
“Meanwhile, the rapid popularization of artificial intelligence (AI) and its potential negative impact on society have raised the awareness of human values in AI research [5, 9, 23].”
Background
Research works printed but not linked: 8
- Nick Baker. 2019. Molly Russell: Instagram Bans Graphic Self-Harm Images After Suicide of UK Teen. https://www.sbs.com.au/news/molly-russell-instagram-bans-graphic-self-harm-images-after-suicide-of-uk-teen
- Common Cause. 2011. The Common Cause Handbook-A Guide to Values and Frames for Campaigners, Community Organisers, Civil Servants, Fundraisers, Educators, Social Entrepreneurs, Activists, Funders, Politicians, and everyone in between. Public Interest Research Centre, Machynlleth, Wales (2011).
- ICSE. 2018. ICSE - Software Engineering in Society. https://www.icse2018.org/track/icse-2018-Software-Engineering-in-Society
- Md. Saddam Hossain Mukta, Euna Mehnaz Khan, Mohammed Eunus Ali, and Jalal Mahmud. 2017. Predicting Movie Genre Preferences from Personality and Values of Social Media Users. In Eleventh International AAAI Conference on Web and Social Media.
- Shalom H. Schwartz. 2005. Basic Human Values: Their Content and Structure Across Countries. Valores e Comportamento nas Organizações (2005), 21--55.
- Shalom H Schwartz. 2006. Basic Human Values: An Overview. Recuperado de http://www.yourmorals.org/schwartz (2006).
- 10.5555/2819303.2819319 · doi:10.5555/2819303.2819319
- Courtney Williams, Margaret-Anne Storey, Neil A Ernst, Alexey Zagalsky, and Eirini Kalliamvakou. 2019. Methodology Matters: How We Study Socio-Technical Aspects in Software Engineering. arXiv preprint arXiv:1905.12841 (2019). · arXiv
Cited by
Socio-Technical Grounded Theory for Software Engineering
Hoda, R. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3106280 · Cited by 204
“ues [44], [60], and the human-in-the-loop in order to”
BackgroundOperationalising ethics in artificial intelligence for healthcare: a framework for AI developers
Solanki, P., Grundy, J., & Hussain, W. (2023) · AI and Ethics · doi:10.1007/s43681-022-00195-z · Cited by 157
“Of the ten total human values in this theory, we reference only the four found to be most cited in software engineering literature [23].”
BackgroundSelf-citationTowards a roadmap on software engineering for responsible AI
Lu, Q., Zhu, L., Xu, X., Whittle, J., & Xing, Z. (2022) · IEEE/ACM International Conference on AI Engineering – Software Engineering for AI (CAIN) · doi:10.1145/3522664.3528607 · Cited by 91
“But these efforts are still limited to a small subset of human values [40].”
BackgroundSelf-citationHuman Values in Software Engineering: Contrasting Case Studies of Practice
Hussain, W., Perera, H., Whittle, J., Nurwidyantoro, A., Hoda, R., Shams, R. A., & Oliver, G. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2020.3038802 · Cited by 59
Self-citationAI and Ethics—Operationalizing Responsible AI
Zhu, L., Xu, X., Lu, Q., Guido Governatori, A., & Whittle, J. (2021) · Springer eBooks · doi:10.1007/978-3-030-72188-6_2 · Cited by 65
Self-citation
Metadata
- Authors
- Perera, H., Hussain, W., Whittle, J., Nurwidyantoro, A., Mougouei, D., Shams, R. A., & Oliver, G.
- Affiliations
- Monash University (AU)
- ORCID
- Venue
- Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering
- Publisher
- ACM
- Published
- 2020-06-27
- Pages
- 409-420
- ISSN
- 0270-5257 (ISSN-L)
- OpenAlex
- W2959714675
- Cited by
- 63
- References
- 40
- Citations by year
- 2026: 3 · 2025: 8 · 2024: 7 · 2023: 12 · 2022: 13 · 2021: 12 · 2020: 6
- FWCI
- 8.15
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) (publishedVersion, cc-by-nc-sa)
- arXiv (Cornell University) (submittedVersion)
- Monash University Research Portal (Monash University) (submittedVersion, other-oa)
- Figshare (submittedVersion, cc-by)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Software › Advanced Software Engineering Methodologies
- Keywords
- human values, software engineering, equality, fairness, software engineering conferences, value structure
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A study on the prevalence of human values in software engineering publications, 2015 -- 2018. https://app.cochat.ai/papers/10.1145/3377811.3380393
- The paper
- Perera, H., Hussain, W., Whittle, J., Nurwidyantoro, A., Mougouei, D., Shams, R. A., & Oliver, G. (2020). A study on the prevalence of human values in software engineering publications, 2015 -- 2018. Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering. https://doi.org/10.1145/3377811.3380393
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.