Linking Human And Machine Behavior: A New Approach to Evaluate Training Data Quality for Beneficial Machine Learning
Open accessThe DOI matches its Crossref record; 198 of the 198 references it cites were found in a registry or an index.
Abstract
Machine behavior that is based on learning algorithms can be significantly influenced by the exposure to data of different qualities. Up to now, those qualities are solely measured in technical terms, but not in ethical ones, despite the significant role of training and annotation data in supervised machine learning. This is the first study to fill this gap by describing new dimensions of data quality for supervised machine learning applications. Based on the rationale that different social and psychological backgrounds of individuals correlate in practice with different modes of human–computer-interaction, the paper describes from an ethical perspective how varying qualities of behavioral data that individuals leave behind while using digital technologies have socially relevant ramification for the development of machine learning applications. The specific objective of this study is to describe how training data can be selected according to ethical assessments of the behavior it originates from, establishing an innovative filter regime to transition from the big data rationale n = all to a more selective way of processing data for training sets in machine learning. The overarching aim of this research is to promote methods for achieving beneficial machine learning applications that could be widely useful for industry as well as academia.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinction: A Social Critique of the Judgement of Taste*
Bourdieu, P. (2018) · Food and Culture · doi:10.4324/9781315680347-10 · Cited by 20,289
(2011) · Cited by 14,317
Distinction: A Social Critique of the Judgement of Taste.
Warner, M., Bourdieu, P., & Nice, R. (1985) · MLN · doi:10.2307/2905454 · Cited by 14,091
A survey on Image Data Augmentation for Deep Learning
Shorten, C., & Khoshgoftaar, T. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0197-0 · Cited by 13,203
Machine learning: Trends, perspectives, and prospects
Jordan, M. I., & Mitchell, T. M. (2015) · Science · doi:10.1126/science.aaa8415 · Cited by 9,955 · cited 1×
“Big data lead to the success of today’s machine learning systems, which are heralded as the new gold standard of knowledge discovery since they are necessary to understand increasingly complex collections of data, especially in the sciences (Mjolsness and DeCoste 2001; Jordan and Mitchell 2015).”
BackgroundA Theory of Justice: Revised Edition
Rawls, J. (1999) · doi:10.4159/9780674042582 · Cited by 9,455
Rawls, J. (2018) · Princeton Readings in Political Thought · doi:10.2307/j.ctv19fvzzk.68 · Cited by 9,417
The emotional dog and its rational tail: A social intuitionist approach to moral judgment.
Haidt, J. (2001) · Psychological Review · doi:10.1037/0033-295x.108.4.814 · Cited by 8,048 · cited 1×
“Apart from a few complicated, dilemmatic cases, moral intuitions can appropriately guide ethical reasoning, or, to be more precise, ethical judgements are driven primarily by one’s intuitions (Haidt 2001).”
BackgroundPicard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382 · cited 1×
“Affective computing serves to detect emotions, mostly through text, voice, face, or posture processing techniques (Picard 1997).”
BackgroundOn the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988
Erikson, E. H. (1959) · Medical Entomology and Zoology · Cited by 6,863
An Introduction to the Five‐Factor Model and Its Applications
McCrae, R. R., & John, O. P. (1992) · Journal of Personality · doi:10.1111/j.1467-6494.1992.tb00970.x · Cited by 6,835
Opinion Mining and Sentiment Analysis
Pang, B., & Lee, L. (2008) · now publishers, Inc. eBooks · doi:10.1561/9781601981516 · Cited by 6,720
A Comprehensive Survey on Transfer Learning
Zhuang, F., Qi, Z., Duan, K., Xi, D., Zhu, Y., Zhu, H., Xiong, H., & He, Q. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3004555 · Cited by 6,678
Opinion mining and sentiment analysis
Pang, B., & Lee, L. (2008) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000011 · Cited by 6,372
The Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2014) · Foundations and Trends® in Theoretical Computer Science · doi:10.1561/0400000042 · Cited by 5,557
Dwork, C. (2006) · Lecture Notes in Computer Science · doi:10.1007/11787006_1 · Cited by 5,291 · cited 1×
“Hitherto, normatively oriented machine learning research is mainly concerned with fairness (Kearns and Roth 2020) or preventing discrimination (Hagendorff 2019c), robustness (Amodei et al. 2017), explainability (Mittelstadt et al. 2019), or preserving privacy (Dwork 2006).”
BackgroundFloridi, L., Cowls, J., Beltrametti, M., Chatila, R., Chazerand, P., Dignum, V., Luetge, C., Madelin, R., Pagallo, U., Rossi, F., et al. (2018) · Minds and Machines · doi:10.1007/s11023-018-9482-5 · Cited by 4,774 · cited 1×
“By following such an integrated approach, unintended cognitive biases in the selection off intended training data biases can be tracked, but it can also be ensured that the selection of values and traits stands in accordance with democratic consensuses (Floridi et al., 2018; Brundage et al. 2020; Daly et al. 2019b; Da…”
BackgroundBeyond Accuracy: What Data Quality Means to Data Consumers
Wang, R. Y., & Strong, D. M. (1996) · Journal of Management Information Systems · doi:10.1080/07421222.1996.11518099 · Cited by 4,672 · cited 1×
“Surveys found that data quality attributes comprise literally hundreds of variables (Wang and Strong 1996).”
BackgroundSocial Space and Symbolic Power
Bourdieu, P. (1989) · Sociological Theory · doi:10.2307/202060 · Cited by 4,420 · cited 1×
“Individuals occupy a certain position in “ social space ” which is the result of a contested distribution of resources, meaning economic, cultural, social, or symbolic capital (Bourdieu 1989).”
BackgroundThe Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2013) · doi:10.1561/9781601988195 · Cited by 3,856
Big data: a revolution that will transform how we live, work, and think
(2013) · Choice Reviews Online · doi:10.5860/choice.50-6804 · Cited by 3,630
Differential Privacy: A Survey of Results
Dwork, C. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-79228-4_1 · Cited by 3,542
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501
Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor
Lebovits, H. (2019) · Public Integrity · doi:10.1080/10999922.2018.1511671 · Cited by 3,279
Big other: Surveillance Capitalism and the Prospects of an Information Civilization
Zuboff, S. (2015) · Journal of Information Technology · doi:10.1057/jit.2015.5 · Cited by 3,205 · cited 1×
“Quite the opposite may be true (Zuboff 2015).”
BackgroundBarocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048 · cited 2×
“2 discriminative) behavior, so people’s behavior becomes machine (discriminative) behavior (Barocas and Selbst 2016).”
BackgroundActivity recognition using cell phone accelerometers
Kwapisz, J. R., Weiss, G. M., & Moore, S. A. (2011) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1964897.1964918 · Cited by 2,912
Private traits and attributes are predictable from digital records of human behavior
Kosinski, M., Stillwell, D., & Graepel, T. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1218772110 · Cited by 2,829
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daumé, H., & Crawford, K. (2018) · arXiv · doi:10.48550/arxiv.1803.09010 · Cited by 2,474 · cited 2×
“Current approaches to improve datasheets for datasets also do not include aspects that go beyond technical and organizational items like “Who funded the creation of the datasets?”, “Are there any errors, sources of noise, or redundancies in the dataset?”, “Will the datasets be updated?”, and so on (Gebru et al., 2018).”
BackgroundGebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., III, H. D., & Crawford, K. (2021) · Communications of the ACM · doi:10.1145/3458723 · Cited by 2,469 · cited 2×
“Current approaches to improve datasheets for datasets also do not include aspects that go beyond technical and organizational items like “Who funded the creation of the datasets?”, “Are there any errors, sources of noise, or redundancies in the dataset?”, “Will the datasets be updated?”, and so on (Gebru et al., 2018).”
BackgroundLife-Span Development and Behavior
(2014) · Psychology Press eBooks · doi:10.4324/9781315807584 · Cited by 2,380
(2016) · Cited by 2,334
Raji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., & Barnes, P. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372873 · Cited by 2,245
Haggerty, K. D., & Ericson, R. V. (2000) · The British Journal of Sociology · doi:10.1080/00071310020015280 · Cited by 2,244
Lunsky, L. L. (1966) · Archives of Internal Medicine · doi:10.1001/archinte.1966.00290150102025 · Cited by 2,239
Datafication, dataism and dataveillance: Big Data between scientific paradigm and ideology
Van Dijck, J. (2014) · Surveillance & Society · doi:10.24908/ss.v12i2.4776 · Cited by 2,203 · cited 1×
“Dataveillance (van Dijck 2014; Clarke 1988), in other words practices of recording and analyzing digitally mediated behavior, has at least three complications or downsides.”
BackgroundWestin, A. F. (1967) · Cited by 1,908
Westin, A. F. (1970) · CERN Document Server (European Organization for Nuclear Research) · Cited by 1,861
Life-Span Development and Behavior
Baltes, P. B., Featherman, D. L., Lerner, R. M., Brim, O. G., & Perlmutter, M. C. (1984) · Medical Entomology and Zoology · Cited by 1,805
Text Data Augmentation for Deep Learning
Shorten, C., Khoshgoftaar, T. M., & Furht, B. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00492-0 · Cited by 1,740
Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach
Schwartz, H. A., Eichstaedt, J. C., Kern, M. L., Dziurzynski, L., Ramones, S. M., Agrawal, M., Shah, A., Kosinski, M., Stillwell, D., Seligman, M. E. P., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0073791 · Cited by 1,700
Emotions and Information Diffusion in Social Media—Sentiment of Microblogs and Sharing Behavior
Stieglitz, S., & Dang-Xuan, L. (2013) · Journal of Management Information Systems · doi:10.2753/mis0742-1222290408 · Cited by 1,604 · cited 1×
“Hence, biases are technically perpetuated via recommendation systems (Stieglitz and Dang-Xuan 2012, 2013).”
BackgroundSocial networking sites and addiction: Ten lessons learned
Kuss, D., & Griffiths, M. (2017) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph14030311 · Cited by 1,603 · cited 1×
“This, in turn, shall raise the likelihood of advertisement contact and click-through-rates (Kuss and Griffiths 2017; Eyal and Hoover 2014; Hagendorff 2019b).”
BackgroundDie Erlebnisgesellschaft : Kultursoziologie der Gegenwart
Schulze, G. (2005) · Cited by 1,577
Rahwan, I., Cebrian, M., Obradovich, N., Bongard, J., Bonnefon, J.-F., Breazeal, C., Crandall, J. W., Christakis, N. A., Couzin, I. D., Jackson, M. O., et al. (2019) · Nature · doi:10.1038/s41586-019-1138-y · Cited by 1,364
Atlas of AI: Power, Politics, and the Planetary Costs of Artificial Intelligence
Crawford, K. (2021) · doi:10.12987/9780300252392 · Cited by 1,361
Handbook of Child Psychology and Developmental Science
(2015) · Wiley eBooks · doi:10.1002/9781118963418 · Cited by 1,345
Samarati, P., & Sweeney, L. (2018) · doi:10.1184/r1/6625469.v1 · Cited by 1,344
Samarati, P., & Sweeney, L. (2018) · doi:10.1184/r1/6625469 · Cited by 1,326
Concrete Problems in AI Safety
Amodei, D., Olah, C., Steinhardt, J., Christiano, P., Schulman, J., & Mané, D. (2016) · arXiv · doi:10.48550/arxiv.1606.06565 · Cited by 1,314
Intergenerational Class Mobility in Three Western European Societies: England, France and Sweden
Erikson, R., Goldthorpe, J. H., & Portocarero, L. (1979) · The British Journal of Sociology · doi:10.2307/589632 · Cited by 1,311
9 ‘Postscript on the Societies of Control’
Deleuze, G. (2009) · Media Studies · doi:10.1515/9781474473231-011 · Cited by 1,298
Marketing Analytics for Data-Rich Environments
Wedel, M., & Kannan, P. K. (2016) · Journal of Marketing · doi:10.1509/jm.15.0413 · Cited by 1,261
Friedman, B., & Nissenbaum, H. (1996) · ACM Transactions on Information Systems · doi:10.1145/230538.230561 · Cited by 1,203 · cited 2×
“480): they can be incorporated into applications by programmers making design choices in algorithms (Brey, 2010; Friedman and Nissenbaum 1996), by particular training stimuli (i.”
BackgroundThinking critically about and researching algorithms
Kitchin, R. (2017) · Information, Communication & Society · doi:10.1080/1369118x.2016.1154087 · Cited by 1,186 · cited 1×
“They do not work impassive, but shape how we understand the world in a performative manner (Kitchin 2017), while allowing probabilistic inferences on in situ behavior.”
Background(2018) · Cited by 1,167
Maltreatment and disabilities: a population-based epidemiological study
Sullivan, P. M., & Knutson, J. F. (2000) · Child Abuse & Neglect · doi:10.1016/s0145-2134(00)00190-3 · Cited by 1,092 · cited 2×
“…processing, self-concepts, knowledge, or language behavior and range from alcohol to stress during pregnancy, residential areas with high crime rates, low educational levels, emotional, physical or sexual abuse, as well as a neglectful parenting style (Sullivan and Knutson 2000; Spera 2005).”
BackgroundJain, A. (2017) · Business Economics · doi:10.1057/s11369-017-0027-3 · Cited by 1,058
Moral stages: A current formulation and a response to critics.
Kohlberg, L., Levine, C. G., & Hewer, A. (1983) · DigitalGeorgetown (Georgetown University Library) · Cited by 1,020
Spera, C. (2005) · Educational Psychology Review · doi:10.1007/s10648-005-3950-1 · Cited by 996 · cited 2×
“…processing, self-concepts, knowledge, or language behavior and range from alcohol to stress during pregnancy, residential areas with high crime rates, low educational levels, emotional, physical or sexual abuse, as well as a neglectful parenting style (Sullivan and Knutson 2000; Spera 2005).”
BackgroundPostscript on the Societies of Control*
Deleuze, G. (2017) · Surveillance, Crime and Social Control · doi:10.4324/9781315242002-3 · Cited by 996
Cognitive, sensory and physical factors enabling driving safety in older adults
Anstey, K. J., Wood, J., Lord, S., & Walker, J. G. (2005) · Clinical Psychology Review · doi:10.1016/j.cpr.2004.07.008 · Cited by 983
Code/Space: Software and Everyday Life
Kitchin, R., & Dodge, M. (2011) · doi:10.7551/mitpress/9780262042482.001.0001 · Cited by 964 · cited 1×
“Personal data from different sources and domains are li nked together in a form of a “dense rhizomatic assemblage” (Kitchin and Dodge 2011, p. 90).”
BackgroundNeuropsychiatric Disease and Treatment
Tóth-Czifra, E. (2017) · doi:10.14293/s2199-1006.1.sor-med.clwxpbd.v1 · Cited by 929
Tellegen, A., & Waller, N. G. (2008) · The SAGE Handbook of Personality Theory and Assessment: Volume 2 — Personality Measurement and Testing · doi:10.4135/9781849200479.n13 · Cited by 905 · cited 2×
“Amongst personality assessment tools are the widely used Five-Factor Model (John et al. 2008; McCrae and John 1992), non-scientific tests like the Myers-Briggs type indicator (Myers and Myers 1995), or less known methods like the Multidimensional Personality Questionnaire (Tellegen and Waller 2008), “PerformanSe” (Pat…”
MethodGifts Differing: Understanding Personality Type
Myers, I. B., & Myers, P. B. (1980) · CERN Document Server (European Organization for Nuclear Research) · Cited by 874
The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigation
Brundage, M., Avin, S., Clark, J., Toner, H., Eckersley, P., Garfinkel, B., Dafoe, A., Scharre, P., Zeitzoff, T., Filar, B., et al. (2018) · Apollo - University of Cambridge Repository · doi:10.17863/cam.22520 · Cited by 849
The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigation
Brundage, M., Avin, S., Clark, J., Toner, H., Eckersley, P., Garfinkel, B., Dafoe, A., Scharre, P., Zeitzoff, T., Filar, B., et al. (2018) · arXiv · doi:10.48550/arxiv.1802.07228 · Cited by 849
Social Stratification: Class, Race, and Gender in Sociological Perspective
Grusky, D. B. (1994) · Cited by 811
The master algorithm: how the quest for the ultimate learning machine will remake our world
(2016) · Choice Reviews Online · doi:10.5860/choice.194685 · Cited by 805
Mittelstadt, B., Russell, C., & Wachter, S. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287574 · Cited by 794 · cited 2×
“Hitherto, normatively oriented machine learning research is mainly concerned with fairness (Kearns and Roth 2020) or preventing discrimination (Hagendorff 2019c), robustness (Amodei et al. 2017), explainability (Mittelstadt et al. 2019), or preserving privacy (Dwork 2006).”
BackgroundMoral machines: teaching robots right from wrong
(2009) · Choice Reviews Online · doi:10.5860/choice.46-4493 · Cited by 793 · cited 2×
“Bottom-up approaches mean that a technical agent, in this case machine learning models, explores courses of action that represent morally praiseworthy examples (Wallach and Allen 2009).”
BackgroundInformation technology and dataveillance
Clarke, R. (1988) · Communications of the ACM · doi:10.1145/42411.42413 · Cited by 767 · cited 1×
“Dataveillance (van Dijck 2014; Clarke 1988), in other words practices of recording and analyzing digitally mediated behavior, has at least three complications or downsides.”
BackgroundSocial Data: Biases, Methodological Pitfalls, and Ethical Boundaries
Olteanu, A., Castillo, C., Diaz, F., & Kıcıman, E. (2019) · Frontiers in Big Data · doi:10.3389/fdata.2019.00013 · Cited by 763
Social Data: Biases, Methodological Pitfalls, and Ethical Boundaries
Olteanu, A., Castillo, C., Diaz, F., & Kiciman, E. (2016) · doi:10.2139/ssrn.2886526 · Cited by 763
The Atlas of AI: Power, Politics, and the Planetary Costs of Artificial Intelligence
CRAWFORD, K. (2021) · doi:10.2307/j.ctv1ghv45t · Cited by 742
Detecting depression and mental illness on social media: an integrative review
Guntuku, S. C., Yaden, D. B., Kern, M. L., Ungar, L. H., & Eichstaedt, J. C. (2017) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2017.07.005 · Cited by 722
Wallach, W., & Allen, C. (2009) · Oxford University Press · doi:10.1093/acprof:oso/9780195374049.001.0001 · Cited by 711
A Survey of Digital Map Processing Techniques
Chiang, Y.-Y., Leyk, S., & Knoblock, C. A. (2014) · ACM Computing Surveys · doi:10.1145/2557423 · Cited by 693
Autonomous Vehicle Safety: An Interdisciplinary Challenge
Koopman, P., & Wagner, M. (2017) · IEEE Intelligent Transportation Systems Magazine · doi:10.1109/mits.2016.2583491 · Cited by 688
A Social Critique of the Judgement of Taste
Bourdıeu, P., & Claudel, P. (1984) · Cited by 653
A Review and Meta-Analysis of Multimodal Affect Detection Systems
D'mello, S. K., & Kory, J. (2015) · ACM Computing Surveys · doi:10.1145/2682899 · Cited by 628
Digital Distinction: Status‐Specific Types of Internet Usage*
Zillien, N., & Hargittai, E. (2009) · Social Science Quarterly · doi:10.1111/j.1540-6237.2009.00617.x · Cited by 611
Code/space: software and everyday life
(2011) · Choice Reviews Online · doi:10.5860/choice.49-2108 · Cited by 570
Virtual inequality: beyond the digital divide
(2004) · Choice Reviews Online · doi:10.5860/choice.41-4342 · Cited by 548
The Woman Worked as a Babysitter: On Biases in Language Generation
Sheng, E., Chang, K.-W., Natarajan, P., & Peng, N. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1339 · Cited by 537 · cited 2×
“…violate social norms, discriminate against certain groups of people or perpetuate biases that are incorporated into training data (all of which is especially precarious in open domain conversations) (West et al. 2019; Danaher 2018; Silvervarg et al. 2012; Sheng et al. 2019; Bolukbasi et al. 2016).”
BackgroundData and Goliath: The Hidden Battles to Collect Your Data and Control Your World
Schneier, B. (2015) · Cited by 516
Veale, M., & Binns, R. (2017) · Big Data & Society · doi:10.1177/2053951717743530 · Cited by 512 · cited 2×
“(Dwork et al. 2011; Kleinberg et al. 2016; Veale and Binns 2017).”
BackgroundVeale, M., & Binns, R. (2017) · doi:10.31235/osf.io/ustxg · Cited by 512
Hofmann, W. (2016) · Klassiker der Sozialwissenschaften · doi:10.1007/978-3-658-13213-2_74 · Cited by 503
Soziale Milieus im gesellschaftlichen Strukturwandel : zwischen Integration und Ausgrenzung
Vester, M. (1993) · Suhrkamp eBooks · Cited by 499
The Web Never Forgets: Persistent Tracking Mechanisms in the Wild
Acar, G., Eubank, C., Englehardt, S., Juarez, M., Narayanan, A., & Diaz, C. (2014) · Proceedings of the 2014 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2660267.2660347 · Cited by 455 · cited 1×
“Some instances are listed hereafter: By analyzing clickstreams, browsing histories, or search queries , inferences on users’ demographic information can be made (Acar et al. 2014; Hu et al. 2007; Bi et al. 2013).”
Young, M. (2017) · Routledge eBooks · doi:10.4324/9781315134642 · Cited by 439
(2006) · Cited by 439
CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparison
Irvin, J., Rajpurkar, P., Ko, M., Yu, Y., Ciurea-Ilcus, S., Chute, C., Marklund, H., Haghgoo, B., Ball, R., Shpanskaya, K., et al. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.3301590 · Cited by 392
Code/Space: Software and Everyday Life
Zook, M. (2012) · Regional Studies · doi:10.1080/00343404.2012.696477 · Cited by 381
Machine Learning for Science: State of the Art and Future Prospects
Mjolsness, E., & DeCoste, D. (2001) · Science · doi:10.1126/science.293.5537.2051 · Cited by 379 · cited 1×
“Big data lead to the success of today’s machine learning systems, which are heralded as the new gold standard of knowledge discovery since they are necessary to understand increasingly complex collections of data, especially in the sciences (Mjolsness and DeCoste 2001; Jordan and Mitchell 2015).”
BackgroundData Derivatives: On the Emergence of a Security Risk Calculus for Our Times
Amoore, L. (2011) · Theory, Culture & Society · doi:10.1177/0263276411417430 · Cited by 374 · cited 1×
“Terms like “data subjects”, “data derivatives” (Amoore 2011) , “data double” (Los 2006), “shadow order” (Bogard 1996) , “digital persona” (Clarke 1994) , “dividuals” (Deleuze 1992), or “data doubles” (Lyon 2003) are used to describe the comprehensive compilation of personal data, the creation of…”
Algorithmic governance: Developing a research agenda through the power of collective intelligence
Danaher, J., Hogan, M. J., Noone, C., Kennedy, R., Behan, A., De Paor, A., Felzmann, H., Haklay, M., Khoo, S.-M., Morison, J., et al. (2017) · Big Data & Society · doi:10.1177/2053951717726554 · Cited by 369 · cited 1×
“By following such an integrated approach, unintended cognitive biases in the selection off intended training data biases can be tracked, but it can also be ensured that the selection of values and traits stands in accordance with democratic consensuses (Floridi et al., 2018; Brundage et al. 2020; Daly et al. 2019b; Da…”
BackgroundThe daily you: how the new advertising industry is defining your identity and your worth
(2012) · Choice Reviews Online · doi:10.5860/choice.49-6375 · Cited by 348
Zwischen Integration und Ausgrenzung
Burghartz, S. (1997) · L'Homme · doi:10.7767/lhomme.1997.8.1.30 · Cited by 348
Driver classification and driving style recognition using inertial sensors
Van Ly, M., Martin, S., & Trivedi, M. M. (2013) · 2013 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/ivs.2013.6629603 · Cited by 306 · cited 1×
“Those characteristics as well as additional cues like engine speed, pedal pressure, improper following, speaker volume, driver body posture, gestures, head movement, verbal outbursts, etc. can be digitally tracked in order to predict a driver’s safety lev el (van Ly et al. 2013).”
BackgroundToward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims
Brundage, M., Avin, S., Wang, J., Belfield, H., Krueger, G., Hadfield, G., Khlaaf, H., Yang, J., Toner, H., Fong, R., et al. (2020) · arXiv · doi:10.48550/arxiv.2004.07213 · Cited by 306 · cited 1×
“By following such an integrated approach, unintended cognitive biases in the selection off intended training data biases can be tracked, but it can also be ensured that the selection of values and traits stands in accordance with democratic consensuses (Floridi et al., 2018; Brundage et al. 2020; Daly et al. 2019b; Da…”
BackgroundD'Mello, S. (2013) · Journal of Educational Psychology · doi:10.1037/a0032674 · Cited by 300 · cited 1×
“…basic emotions (sadness, fear, anger, disgust, joy, surprise), while in practice, though, those basic emotions can be observed only seldom, instead engagement, confusion, boredom, curiosity, frustration, and happiness are more frequent affective states in human-computer-interaction (D'Mello 2013).”
BackgroundThe Simulation of Surveillance: Hypercontrol in Telematic Societies
Baldus, B., & Bogard, W. (1997) · Canadian Public Policy / Analyse de Politiques · doi:10.2307/3551496 · Cited by 287 · cited 1×
“Terms like “data subjects”, “data derivatives” (Amoore 2011) , “data double” (Los 2006), “shadow order” (Bogard 1996) , “digital persona” (Clarke 1994) , “dividuals” (Deleuze 1992), or “data doubles” (Lyon 2003) are used to describe the comprehensive compilation of personal data, the creation of…”
Manifestations of user personality in website choice and behaviour on online social networks
Kosinski, M., Bachrach, Y., Kohli, P., Stillwell, D., & Graepel, T. (2014) · Machine Learning · doi:10.1007/s10994-013-5415-y · Cited by 266
I'd blush if I could: closing gender divides in digital skills through education
UNESCO, & Coalition, E. S. (2019) · doi:10.54675/rapc9356 · Cited by 262 · cited 2×
“…violate social norms, discriminate against certain groups of people or perpetuate biases that are incorporated into training data (all of which is especially precarious in open domain conversations) (West et al. 2019; Danaher 2018; Silvervarg et al. 2012; Sheng et al. 2019; Bolukbasi et al. 2016).”
BackgroundDemographic prediction based on user's browsing behavior
Hu, J., Zeng, H.-J., Li, H., Niu, C., & Chen, Z. (2007) · Proceedings of the 16th international conference on World Wide Web · doi:10.1145/1242572.1242594 · Cited by 259
The daily you: How the new advertising industry is defining your identity and your worth
Peters, C. (2014) · New Media & Society · doi:10.1177/1461444814535723 · Cited by 259
The Ethical Algorithm: The Science of Socially Aware Algorithm Design
Kearns, M., & Roth, A. (2021) · Perspectives on Science and Christian Faith · doi:10.56315/pscf3-21kearns · Cited by 259 · cited 2×
“Hitherto, normatively oriented machine learning research is mainly concerned with fairness (Kearns and Roth 2020) or preventing discrimination (Hagendorff 2019c), robustness (Amodei et al. 2017), explainability (Mittelstadt et al. 2019), or preserving privacy (Dwork 2006).”
Smartphone sensing methods for studying behavior in everyday life
Harari, G. M., Müller, S. R., Aung, M. S., & Rentfrow, P. J. (2017) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2017.07.018 · Cited by 252
Lessons from archives: strategies for collecting sociocultural data in machine learning
Jo, E. S., & Gebru, T. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372829 · Cited by 240
Haggerty, K. D., & Ericson, R. V. (2017) · Surveillance, Crime and Social Control · doi:10.4324/9781315242002-5 · Cited by 238
The digital persona and its application to data surveillance
Clarke, R. (1994) · The Information Society · doi:10.1080/01972243.1994.9960160 · Cited by 234 · cited 1×
“Terms like “data subjects”, “data derivatives” (Amoore 2011) , “data double” (Los 2006), “shadow order” (Bogard 1996) , “digital persona” (Clarke 1994) , “dividuals” (Deleuze 1992), or “data doubles” (Lyon 2003) are used to describe the comprehensive compilation of personal data, the creation of…”
Surveillance as social sorting : Computer codes and mobile bodies
Lyon, D. G. (2005) · doi:10.4324/9780203994887-6 · Cited by 234
Small data in the era of big data
Kitchin, R., & Lauriault, T. P. (2015) · GeoJournal · doi:10.1007/s10708-014-9601-7 · Cited by 230
The Digital Reproduction of Inequality
Hargittai, E. (2018) · The Inequality Reader · doi:10.4324/9780429494468-69 · Cited by 219 · cited 2×
“By using terms like “media-based inequalities”, “digital divide” or “digital inequality”, several studies show the strong influence a user’s socioeconomic status has on media or Internet usage patterns (McCloud et al., 2016; Zillien & Hargittai, 2009; boyd 2012; Hargittai, 2008; Mossberger et al., 2003).”
BackgroundBad machines corrupt good morals
Köbis, N., Bonnefon, J.-F., & Rahwan, I. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01128-2 · Cited by 202 · cited 1×
“1 Machine Behavior Objectives Chatbots as well as speech assistants of all kinds are supposed to produce appropriate, sufficiently eloquent language that does not violate social norms, discriminate against certain groups of people or perpetuate biases that are incorporated into training data (all of which is especiall…”
BackgroundWhat Makes Good Synthetic Training Data for Learning Disparity and Optical Flow Estimation?
Mayer, N., Ilg, E., Fischer, P., Hazirbas, C., Cremers, D., Dosovitskiy, A., & Brox, T. (2018) · International Journal of Computer Vision · doi:10.1007/s11263-018-1082-6 · Cited by 191
Raji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., & Barnes, P. (2020) · arXiv · doi:10.48550/arxiv.2001.00973 · Cited by 179
Intergenerational class mobility and the convergence thesis: England, France and Sweden1
Erikson, R., Goldthorpe, J. H., & Portocarero, L. (2010) · The British Journal of Sociology · doi:10.1111/j.1468-4446.2009.01246.x · Cited by 174
Wolf, M. J., Miller, K., & Grodzinsky, F. S. (2017) · ACM SIGCAS Computers and Society · doi:10.1145/3144592.3144598 · Cited by 172
Using Big Data as a window into consumers’ psychology
Matz, S. C., & Netzer, O. (2017) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2017.05.009 · Cited by 166
Predictive privacy: towards an applied ethics of data analytics
Mühlhoff, R. (2021) · Ethics and Information Technology · doi:10.1007/s10676-021-09606-x · Cited by 164
STEFFENS, G. J. (2017) · Jahrbuch f??r P??dagogik · doi:10.3726/jp2017.21 · Cited by 160
Virtual Inequality: Beyond the Digital Divide
(2004) · The Electronic Library · doi:10.1108/02640470410520186 · Cited by 159
Risky driving behaviour in young people: prevalence, personal characteristics and traffic accidents
Fergusson, D., Swain‐Campbell, N., & Horwood, J. (2003) · Australian and New Zealand Journal of Public Health · doi:10.1111/j.1467-842x.2003.tb00404.x · Cited by 159
I'd blush if I could : closing gender divides in digital skills through education
(2019) · Singapore Management University Institutional Knowledge (InK) (Singapore Management University) · Cited by 158
Hart, D., Hofmann, V., Edelstein, W., & Keller, M. (1997) · Developmental Psychology · doi:10.1037/0012-1649.33.2.195 · Cited by 152
Hart, D. A., Hofmann, V., Edelstein, W., & Keller, M. (1997) · Developmental Psychology · doi:10.1037//0012-1649.33.2.195 · Cited by 146
Xu, C., Ding, Z., Wang, C., & Li, Z. (2019) · Journal of Safety Research · doi:10.1016/j.jsr.2019.09.001 · Cited by 145
Toward an Ethics of AI Assistants: an Initial Framework
Danaher, J. (2018) · Philosophy & Technology · doi:10.1007/s13347-018-0317-3 · Cited by 142 · cited 1×
“…violate social norms, discriminate against certain groups of people or perpetuate biases that are incorporated into training data (all of which is especially precarious in open domain conversations) (West et al. 2019; Danaher 2018; Silvervarg et al. 2012; Sheng et al. 2019; Bolukbasi et al. 2016).”
Background(2013) · Race After the Internet · doi:10.4324/9780203875063-16 · Cited by 142
Inferring the demographics of search users: social data meets search queries
Bi, B., Shokouhi, M., Kosinski, M., & Graepel, T. (2013) · Proceedings of the 22nd international conference on World Wide Web · doi:10.1145/2488388.2488401 · Cited by 136 · cited 4×
“Among them are a person’s gender, age, occupation, residence, religion, political views, favorite brands, personality, intelligence, literacy, and many more (Bi et al. 2013) .”
BackgroundInfluentialValues in technology and disclosive computer ethics
Brey, P. (2010) · The Cambridge Handbook of Information and Computer Ethics · doi:10.1017/cbo9780511845239.004 · Cited by 131 · cited 2×
“…hereditary and “ environmental ” information can be inscribed into algorithms: they can be incorporated into applications by programmers making design choices in algorithms (Brey 2010; Friedman and Nissenbaum 1996), by particular training stimuli (i. e. data), or by a machine’s own “experience s ”.”
BackgroundThe Role of Personality and Attitudes in Traffic Accident Risk
West, R., & Hall, J. S. (1997) · Applied Psychology · doi:10.1111/j.1464-0597.1997.tb01229.x · Cited by 122
Thinking critically about and researching algorithms
Kitchin, R. (2019) · The Social Power of Algorithms · doi:10.4324/9781351200677-2 · Cited by 122
Mühlhoff, R. (2020) · New Media & Society · doi:10.1177/1461444819885334 · Cited by 115 · cited 1×
“An extensive infrastructure for capturing human behavior in distributed networks builds the bedrock for a computational capacity ca lled “artificial intelligence” (Mühlhoff 2019).”
BackgroundInterdependent Privacy: Let Me Share Your Data
Biczók, G., & Chia, P. H. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39884-1_29 · Cited by 114
Artificial Intelligence, Governance and Ethics: Global PerspectivesPreprint
Daly, A., Hagendorff, T., Li, H., Mann, M., Marda, V., Wagner, B., Wang, W., & Witteborn, S. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3414805 · Cited by 107
Self-citationDumas, C. L., LaManna, D., Harrison, T. M., Ravi, S., Kotfila, C., Gervais, N., Hagen, L., & Chen, F. (2015) · Big Data & Society · doi:10.1177/2053951715598170 · Cited by 101
Stages of Personality Development
Loevinger, J. (1997) · Elsevier eBooks · doi:10.1016/b978-012134645-4/50009-3 · Cited by 101 · cited 1×
“…moral senses are developed, social norms are adopted, emotional intelligence is acquired, stereotypes are negotiated, role models are changed, self-reflection is learned, values are internalized, personal crises are overcome, and the like (Erikson 1980; Kohlberg et al. 1983; Loevinger 1997).”
BackgroundLessons from Archives: Strategies for Collecting Sociocultural Data in Machine Learning
Jo, E. S., & Gebru, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.10389 · Cited by 100
Engelmann, S., Chen, M., Fischer, F., Kao, C.-Y., & Grossklags, J. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287585 · Cited by 98 · cited 1×
“But besides these moral intuitions, the application of classification or scoring systems of all kinds on humans is common industry and government practice in many countries (Engelmann et al. 2019).”
BackgroundWhy We Should Have Seen That Coming
Wolf, M. J., Miller, K. W., & Grodzinsky, F. S. (2017) · The ORBIT Journal · doi:10.29297/orbit.v1i2.49 · Cited by 96 · cited 1×
“On the other hand, these texts can be infiltrated with aggressive, discriminatory, or offensive phrases (Wolf et al., 2017).”
BackgroundAutomata, Languages and Programming
Arge, L., Tarlecki, A., Jurdzinski, T., & Cachin, C. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-73420-8 · Cited by 96
Pullar, J., Allen, L. N., Townsend, N. P., Williams, J., Foster, C. E., Roberts, N. W., Rayner, M., Mikkelsen, B., Branca, F., & Wickramasinghe, K. K. (2018) · PLoS ONE · doi:10.1371/journal.pone.0193378 · Cited by 94
Kants Werke : Akademie-Textausgabe
Kant, I. (1968) · Cited by 90
(2019) · Nature Machine Intelligence · doi:10.1038/42256.2522-5839 · Cited by 84
What your Facebook Profile Picture Reveals about your Personality
Segalin, C., Celli, F., Polonio, L., Kosinski, M., Stillwell, D., Sebe, N., Cristani, M., & Lepri, B. (2017) · Proceedings of the 25th ACM international conference on Multimedia · doi:10.1145/3123266.3123331 · Cited by 83 · cited 1×
“Moreover, digital images, for instance social media profile pictures, can also be used to reveal personality attributes (Segalin et al. 2017).”
BackgroundBeyond data as representation: The performativity of Big Data in surveillance
Matzner, T. (2016) · Surveillance & Society · doi:10.24908/ss.v14i2.5831 · Cited by 81 · cited 1×
“Rather, different “ realities ” can be constructed from data and algorithms (Matzner 2016; Lewis 2015).”
BackgroundSocial Stratification, Class, Race, and Gender in Sociological Perspective, Second Edition
Grusky, D. B. (2019) · Routledge eBooks · doi:10.4324/9780429306419 · Cited by 73 · cited 1×
“Those environments are classified, for instance, with the help of theories of social stratification (Grusky 2019; Vester 2001; Schulze 1996; Erikson et al. 1979; Bourdieu 1984).”
BackgroundInformation technology and dataveillance
Highland, E. H. (1988) · Computers & Security · doi:10.1016/0167-4048(88)90649-9 · Cited by 66
Three fallacies of digital footprints
Lewis, K. (2015) · Big Data & Society · doi:10.1177/2053951715602496 · Cited by 65 · cited 1×
“Rather, different “ realities ” can be constructed from data and algorithms (Matzner 2016; Lewis 2015).”
BackgroundMarsaux, C. F. M., Celis-Morales, C. A., Livingstone, K. M., Fallaize, R., Kolossa, S., Hallmann, J., San-Cristóbal, R., Navas‐Carretero, S., O’Donovan, C. B., Woolhead, C., et al. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5198 · Cited by 65
What your Facebook Profile Picture Reveals about your Personality
Segalin, C., Celli, F., Polonio, L., Kosiński, M., Stillwell, D. J., Sebe, N., Cristani, M., & Lepri, B. (2017) · CaltechAUTHORS (California Institute of Technology) · Cited by 56
Towards a Model on the Factors Influencing Social App Users’ Valuation of Interdependent Privacy
Pu, Y., & Großklags, J. (2015) · Proceedings on Privacy Enhancing Technologies · doi:10.1515/popets-2016-0005 · Cited by 54
Measuring personality from keyboard and mouse use
Khan, I. A., Brinkman, W., Fine, N., & Hierons, R. M. (2008) · European Conference on Cognitive Ergonomics · doi:10.1145/1473018.1473066 · Cited by 51 · cited 2×
“User input via display touching behavior, mouse movements, or keyboard strokes can also be used to infer personality traits (Khan et al., 2008).”
Looking into the future: surveillance, globalization and the totalitarian potential
(2006) · Theorizing Surveillance · doi:10.4324/9781843926818-9 · Cited by 49
Malicious Use of Artificial Intelligence
Bazarkina, D., & Pashentsev, E. N. (2020) · Russia in Global Affairs · doi:10.31278/1810-6374-2020-18-4-154-177 · Cited by 49
IMPACT AND DIFFUSION OF SENTIMENT IN PUBLIC COMMUNICATION ON FACEBOOK
Stieglitz, S., & Dang-Xuan, L. (2012) · AIS Electronic Library (AISeL) · Cited by 43
The hidden faces of automation
Irani, L. (2016) · XRDS: Crossroads, The ACM Magazine for Students · doi:10.1145/3014390 · Cited by 43 · cited 1×
“Labels are most often the result of manual clickwork (Irani 2016), but they can have the form of genuine behavioral data, too.”
BackgroundAccident Vulnerability and Blood Alcohol Concentrations of Drivers by Demographic Characteristics
Hyman, M. M. (1968) · Quarterly Journal of Studies on Alcohol Supplement · doi:10.15288/qjsas.1968.s4.034 · Cited by 43 · cited 1×
“…of neuroticism, possibly raised blood alcohol concentration, lower driving experience, and show various forms of antisocial behavior or higher levels of social deviance (Čubranić -Dobrodolac et al. 2017; Vaughn et al. 2011; Abdoli et al. 2015; West and Hall 1997; Hyman 1968; Wang et al. 2019).”
BackgroundMaschinelles Lernen und Diskriminierung: Probleme und Lösungsansätze
Hagendorff, T. (2019) · Österreichische Zeitschrift für Soziologie · doi:10.1007/s11614-019-00347-2 · Cited by 39 · cited 3×
“Hitherto, normatively oriented machine learning research is mainly concerned with fairness (Kearns and Roth 2020) or preventing discrimination (Hagendorff 2019c), robustness (Amodei et al. 2017), explainability (Mittelstadt et al. 2019), or preserving privacy (Dwork 2006).”
BackgroundMethodSelf-citationAdvancing impact assessment for intelligent systems
Calvo, R. A., Peters, D., & Cave, S. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0151-z · Cited by 39 · cited 2×
“…personal data, the creation of increasingly detailed and fine-grained digital footprints of individuals, which are then later processed in machine learning applications, which in turn have various (and in some cases negative) ramifications for society (Calvo et al. 2020; Eubanks 2018; O'Neil 2016).”
BackgroundThe Effect of Visual Gender on Abuse in Conversation with ECAs
Silvervarg, A., Raukola, K., Haake, M., & Gulz, A. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33197-8_16 · Cited by 38
A classification of data quality assessment and improvement methods
Woodall, P., Oberhofer, M., & Borek, A. (2014) · International Journal of Information Quality · doi:10.1504/ijiq.2014.068656 · Cited by 37
An Information-Theoretic Quantification of Discrimination with Exempt Features
Dutta, S., Venkatesh, P., Mardziel, P., Datta, A., & Grover, P. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5794 · Cited by 37 · cited 1×
“Dutta et al. (2020) give the example of a hiring for fire fighters, where candidates should be able to lift heave weights, which leads to a preference for men rather than women.”
BackgroundArtificial Intelligence Governance and Ethics : Global Perspectives
Daly, A., Hagendorff, T., Hui, L., Mann, M., Marda, V., Wagner, B., Wang, W., & Witteborn, S. (2019) · Strathprints: The University of Strathclyde institutional repository (University of Strathclyde) · Cited by 35
Self-citationFrom privacy to anti-discrimination in times of machine learning
Hagendorff, T. (2019) · Ethics and Information Technology · doi:10.1007/s10676-019-09510-5 · Cited by 32 · cited 3×
“Hitherto, normatively oriented machine learning research is mainly concerned with fairness (Kearns and Roth 2020) or preventing discrimination (Hagendorff 2019c), robustness (Amodei et al. 2017), explainability (Mittelstadt et al. 2019), or preserving privacy (Dwork 2006).”
BackgroundMethodSelf-citationVaughn, M. G., Define, R. S., DeLisi, M., Perron, B. E., Beaver, K. M., Fu, Q. J., & Howard, M. O. (2010) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2010.06.016 · Cited by 31
Brand, S., Abdoli, N., Esmaeili, A., Shakeri, J., Holsboer‐Trachsler, E., Dortāj, F., Farrokhi, N., Karami, M., Delāvar, A., & Farnia, V. (2015) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s88835 · Cited by 30 · cited 2×
“…of neuroticism, possibly raised blood alcohol concentration, lower driving experience, and show various forms of antisocial behavior or higher levels of social deviance (Čubranić -Dobrodolac et al. 2017; Vaughn et al. 2011; Abdoli et al. 2015; West and Hall 1997; Hyman 1968; Wang et al. 2019).”
BackgroundNetwork Publicy Governance: On Privacy and the Informational Self
Belliger, A., & Krieger, D. J. (2018) · transcript Verlag eBooks · doi:10.1515/9783839442135 · Cited by 30
McCloud, R. F., Okechukwu, C. A., Sorensen, G., & Viswanath, K. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.4375 · Cited by 29
Anthikad, J. (2009) · Jaypee Brothers Medical Publishers (P) Ltd. eBooks · doi:10.5005/jp/books/10769_7 · Cited by 29
Minimizing Supervision for Free-Space Segmentation
Tsutsui, S., Kerola, T., Saito, S., & Crandall, D. (2018) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00145 · Cited by 28 · cited 1×
“As a cautionary tale how such ranking practices fail one could point at digital marketing, where marketers consider customers to be either “targets” or “waste” (Turow 2012) .”
BackgroundData Quality and its Impacts on Decision-Making: How Managers can benefit from Good Data
Samitsch, C. (2014) · Springer eBooks · doi:10.1007/978-3-658-08200-0 · Cited by 27 · cited 1×
“Nevertheless, discourses on data quality define it in terms of its suitability for a business purpose and decision-making efficiency in companies (Samitsch 2015), and are solely focused on particular technical dimensions like data cleanliness (how many errors do data sets contain?)”
BackgroundImpact of gender, organized athletics, and video gaming on driving skills in novice drivers
Wayne, N. L., & Miller, G. A. (2018) · PLoS ONE · doi:10.1371/journal.pone.0190885 · Cited by 24
Mühlhoff, R. (2019) · DepositOnce · doi:10.14279/depositonce-11329 · Cited by 24
Kearns, M., & Roth, A. (2020) · ACM SIGecom Exchanges · doi:10.1145/3440959.3440966 · Cited by 21 · cited 1×
“Hitherto, normatively oriented machine learning research is mainly concerned with fairness (Kearns and Roth 2020) or preventing discrimination (Hagendorff 2019c), robustness (Amodei et al. 2017), explainability (Mittelstadt et al. 2019), or preserving privacy (Dwork 2006).”
BackgroundSpindler, M., Booz, S., Gieseler, H., Runschke, S., Wydra, S., & Zinsmaier, J. (2020) · Springer eBooks · doi:10.1007/978-3-658-26342-3_11 · Cited by 19
Wang, X., Huang, K., & Yang, L. (2019) · Psychology Health & Medicine · doi:10.1080/13548506.2019.1567928 · Cited by 18
Perrons, R. K., & McAuley, D. (2015) · Resources Policy · doi:10.1016/j.resourpol.2015.10.007 · Cited by 17
A Model for Traffic Accidents Prediction Based on Driver Personality Traits Assessment
Čubranić-Dobrodolac, M., Lipovac, К., Čičević, S., & Antić, B. (2017) · PROMET - Traffic&Transportation · doi:10.7307/ptt.v29i6.2495 · Cited by 17
Predictive Privacy: Towards an Applied Ethics of Data AnalyticsPreprint
Mühlhoff, R. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3724185 · Cited by 16
Brand, U., & Wissen, M. (2022) · Edition Politik · doi:10.14361/9783839456279-037 · Cited by 16
Computational Psychiatry for Computers
Schulz, E., & Dayan, P. (2020) · iScience · doi:10.1016/j.isci.2020.101772 · Cited by 14
Inferring the Demographics of Search Users
Ucla, B. B., Shokouhi, M., Kosiński, M., & Graepel, T. (2013) · Cited by 10
The Role of Personality and Attitudes in Traffic Accident Risk
West, R., & Hall, J. P. (1997) · Applied Psychology · doi:10.1080/026999497378359 · Cited by 9
Patel, T. (2006) · Global Business Review · doi:10.1177/097215090600700202 · Cited by 8 · cited 2×
“Amongst personality assessment tools are the widely used Five-Factor Model (John et al. 2008; McCrae and John 1992), non-scientific tests like the Myers-Briggs type indicator (Myers and Myers 1995), or less known methods like the Multidimensional Personality Questionnaire (Tellegen and Waller 2008), “PerformanSe” (Pat…”
MethodNetwork Publicy Governance: On Privacy and the Informational Self
Belliger, A., & Krieger, D. J. (2018) · Cited by 7
Jenseits der puren Datenökonomie - Social-Media-Plattformen besser designen
Hagendorff, T. (2019) · Medienkulturen im digitalen Zeitalter · doi:10.1007/978-3-658-27511-2_15 · Cited by 3 · cited 3×
“Hitherto, normatively oriented machine learning research is mainly concerned with fairness (Kearns and Roth 2020) or preventing discrimination (Hagendorff 2019c), robustness (Amodei et al. 2017), explainability (Mittelstadt et al. 2019), or preserving privacy (Dwork 2006).”
BackgroundMethodSelf-citationWhat Is (in) Good DataPreprint
Mann, M., Devitt, S. K., & Daly, A. (2018) · SSRN Electronic Journal · Cited by 2
Kant, I. (1977) · De Gruyter eBooks · doi:10.1515/9783110855906 · Cited by 1
(2013)
(2019)
Research works printed but not linked: 14
- 6. Asimov, I. (2004).
- 18. Bolukbasi, Tolga; Chang, Kai-Wei; Zou, James; Saligrama, Venkatesh; Kalai, Adam (2016): Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings. In arXiv, pp. 1-25.
- 22. Chui, Michael; Harryson, Martin; Manyika, James; Roberts, Roger; Chung, Rita; van Heteren, Ashley; Nel, Pieter (2018): Notes from the AI Frontier. Applying AI for Social Good. McKinsey Global Institute: McKinsey&Company, pp. 1-52.
- 30. Daly, A., Devitt, K. S., & Mann, M. (Eds.). (2019a). Good Data. Institute of Network Cultures.
- 48. Eyal, Nir; Hoover, Ryan (2014): Hooked. How to build Habit-Forming Products. Princeton, NJ: Prince- ton University Press.
- 53. Ghani, Rayid; Schierholz, Malte (2017): Machine Learning. In Ian Foster, Rayid Ghani, Ron S. Jarmin, Frauke Kreuter, Julia Lane (Eds.): Big Data and Social Science. A Practical Guide to Methods and Tools. Boca Raton: CRC Press, pp. 147-186.
- 56. Gudivada, V., Apon, A., & Ding, J. (2017). Data quality considerations for big data and machine learn- ing: going beyond data cleaning and transformations. In International Journal on Advances in Soft- ware, 10, 1-20.
- 68. Heaven, Douglas Will (2020): Our weird behavior during the pandemic is messing with AI models (MIT Technology Review). Available online at https:// www. techn ology review. com/ 2020/ 05/ 11/ 10015 63/ covid-pande mic-broken-ai-machi ne-learn ing-amazon-retail-fraud-humans-in-the-loop/, checked on 6/15/2020.
- 74. John, Oliver P.; Naumann, Laura P.; Soto, Christopher J. (2008): Paradigm Shift to the Integrative Big Five Trait Taxonomy. History, Measurement, and Conceptual Issues. In Oliver P. John, Richard W. Robins, Lawrence A. Pervin (Eds.): Handbook of Personality. Theory and Research. New York: The Guilford Press, pp. 114-158.
- 94. Lischka, Konrad; Stöcker, Christian (2017): Digitale Öffentlichkeit. Wie algorithmische Prozesse den gesellschaftlichen Diskurs beeinflussen. Arbeitspapier. Gütersloh: Bertelsmann Stiftung, pp. 1-88.
- 97. Luhmann, N. (1995). Social Systems. Stanford University Press.
- 123. Roßnagel, A. (2007). Datenschutz in einem informatisierten Alltag. Gutachten im Auftrag der Friedrich-Ebert-Stiftung.
- 126. Sartorius, R. (Ed.). (1983). Paternalism. University of Minnesota Press.
- 160. Wendehorst, Christiane; Woopen, Christiane; Haberer, Johanna; Heckmann, Dirk; Hansen, Marit; Kelber, Ulrich et al. (2019): Opinion of the Date Ethics Commission. Berlin: Data Ethics Commission of the Federal Government, pp. 1-240. Available online at https:// www. bmjv. de/ Share dDocs/ Downl oads/ DE/ Themen/ Fokus themen/ Gutac hten_ DEK_ EN. pdf?__ blob= publi catio nFile &v=2, checked on 7/4/2021.
Cited by
Bad machines corrupt good morals
Köbis, N., Bonnefon, J.-F., & Rahwan, I. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01128-2 · Cited by 202
A Virtue-Based Framework to Support Putting AI Ethics into Practice
Hagendorff, T. (2022) · Philosophy & Technology · doi:10.1007/s13347-022-00553-z · Cited by 123
“Moreover, even when AI applications fulfill all ethical requirements stipulated, it does not necessarily mean that the application itself is “ethically approved” when used in the wrong contexts or when developed by organizations that follow unethical intentions (Hagendorff, 2021a; Lauer, 2020).”
BackgroundSelf-citationHagendorff, T., Bossert, L. N., Tse, Y. F., & Singer, P. (2023) · AI and Ethics · doi:10.1007/s43681-022-00199-9 · Cited by 84
“However, biases are not problematic in and of themselves [141].”
BackgroundSelf-citationA Survey of Data Quality Requirements That Matter in ML Development Pipelines
Priestley, M., O’donnell, F., & Simperl, E. (2023) · Journal of Data and Information Quality · doi:10.1145/3592616 · Cited by 86
Attention Measurement of an Autism Spectrum Disorder User Using EEG Signals: A Case Study
Esqueda-Elizondo, J. J., Juárez‐Ramírez, R., López-Bonilla, O. R., García-Guerrero, E. E., Galindo-Aldana, G., Jiménez-Beristáin, L., Serrano-Trujillo, A., Tlelo‐Cuautle, E., & Inzunza-González, E. (2022) · Mathematical and Computational Applications · doi:10.3390/mca27020021 · Cited by 56
“Recent studies have a focus on the relationship between human and machine behavior, based on the premise that diverse social and psychological backgrounds correspond in practice with different modalities of human–computer interaction [34].”
Background
Metadata
- Authors
- Hagendorff, T.
- Affiliations
- University of Tübingen (DE)
- Corresponding author
- Hagendorff, Thilo
- ORCID
- Hagendorff, Thilo
- Venue
- Minds and Machines
- Published
- 2021-09-26
- Volume
- 31
- Issue
- 4
- Pages
- 563-593
- ISSN
- 0924-6495 (ISSN-L)
- 1572-8641
- PMC
- PMC8475847
- OpenAlex
- W3202435389
- Semantic Scholar
- e936eaeb17d4e2738dfb7488513a7e1f7808b9cd
- Cited by
- 47
- References
- 198
- Citations by year
- 2026: 6 · 2025: 11 · 2024: 13 · 2023: 7 · 2022: 9 · 2021: 1
- FWCI
- 9.38
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Minds and Machines (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Deutsche Forschungsgemeinschaft (EXC 2064/1, 390727645)
- Eberhard Karls Universität Tübingen
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › AI and HR Technologies
- Keywords
- training data quality, supervised learning, human-computer interaction, behavioral data, big data, data selection, annotation data
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.