The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Privacy and analytics: it's a DELICATE issue a checklist for trusted learning analytics
Abstract
The widespread adoption of Learning Analytics (LA) and Educational Data Mining (EDM) has somewhat stagnated recently, and in some prominent cases even been reversed following concerns by governments, stakeholders and civil rights groups about privacy and ethics applied to the handling of personal data. In this ongoing discussion, fears and realities are often indistinguishably mixed up, leading to an atmosphere of uncertainty among potential beneficiaries of Learning Analytics, as well as hesitations among institutional managers who aim to innovate their institution's learning support by implementing data and analytics with a view on improving student success. In this paper, we try to get to the heart of the matter, by analysing the most common views and the propositions made by the LA community to solve them. We conclude the paper with an eight-point checklist named DELICATE that can be applied by researchers, policy makers and institutional managers to facilitate a trusted implementation of Learning Analytics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies
Venkatesh, V., & Davis, F. D. (2000) · Management Science · doi:10.1287/mnsc.46.2.186.11926 · Cited by 23,066
Cook, R. J., Dickens, B. M., & Fathalla, M. F. (2003) · Reproductive Health and Human Rights · doi:10.1093/acprof:oso/9780199241323.003.0025 · Cited by 10,769
Warren, S. D., & Brandeis, L. D. (2012) · Information Ethics · doi:10.1515/9780295803661-014 · Cited by 4,081
Experimental evidence of massive-scale emotional contagion through social networks
Kramer, A. D. I., Guillory, J. E., & Hancock, J. T. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1320040111 · Cited by 3,687
Big data: a revolution that will transform how we live, work, and think
(2013) · Choice Reviews Online · doi:10.5860/choice.50-6804 · Cited by 3,630
(2003) · Manual for Research Ethics Committees · doi:10.1017/cbo9780511550089.028 · Cited by 3,413
Westin, A. F. (1967) · Cited by 1,908
Westin, A. F. (1970) · CERN Document Server (European Organization for Nuclear Research) · Cited by 1,861
World Medical Association Declaration of Helsinki
(2003) · Psychopharmacology · doi:10.1002/047086947x.oth1 · Cited by 1,332
Learning Analytics: Ethical Issues and Dilemmas
Slade, S., & Prinsloo, P. (2013) · American Behavioral Scientist · doi:10.1177/0002764213479366 · Cited by 1,078
Broken Promises of Privacy: Responding to the Surprising Failure of AnonymizationPreprint
Ohm, P. (2009) · SSRN Electronic Journal · Cited by 997
Fuchs, C. (2014) · doi:10.4324/9781315880075 · Cited by 853
(2012) · DSpace (Open University in the Netherlands) · Cited by 754
Ethical and privacy principles for learning analytics
Pardo, A., & Siemens, G. (2014) · British Journal of Educational Technology · doi:10.1111/bjet.12152 · Cited by 710 · cited 1×
“, [8][9][10][11][12]), and, even fewer policies or guidelines regarding privacy, legal protection or ethical implications [14][15] were developed and publicised.”
BackgroundSimple Demographics Often Identify People Uniquely
Sweeney, L. (2018) · Figshare · doi:10.1184/r1/6625769 · Cited by 455
Human values and the design of computer technology
Friedman, B. (1997) · Cited by 321
Flaherty, D. H. (1989) · Cited by 294
Mantelero, A. (2013) · Computer Law & Security Review · doi:10.1016/j.clsr.2013.03.010 · Cited by 264
OECD Guidelines on the Protection of Privacy and Transborder Flows of Personal Data
OECD (2002) · OECD eBooks · doi:10.1787/9789264196391-en · Cited by 261
Privacy in the Age of Big Data: A Time for Big Decisions
Tene, O. (2012) · Cited by 260
Han, B.-C. (2015) · doi:10.1515/9780804797511 · Cited by 235 · cited 1×
“The Korean-born German philosopher Byung-Chul Han [50] states that transparency turns social systems of trust into control systems because information is too readily available.”
BackgroundBottom of the Data Pyramid: Big Data and the Global South
Arora, P. (2016) · International journal of communication · Cited by 235
Profiling the European Citizen
(2008) · Springer eBooks · doi:10.1007/978-1-4020-6914-7 · Cited by 215
Student Vulnerability, Agency and Learning Analytics: An Exploration
Prinsloo, P., & Slade, S. (2016) · Journal of Learning Analytics · doi:10.18608/jla.2016.31.10 · Cited by 207
Back to basics: checklists in aviation and healthcare
Clay-Williams, R., & Colligan, L. (2015) · BMJ Quality & Safety · doi:10.1136/bmjqs-2015-003957 · Cited by 196
Rössler, B. (2004) · UvA-DARE (University of Amsterdam) · Cited by 175
Quality Indicators for Learning Analytics.
Scheffel, M., Drachsler, H., Slavi Stoyanov, A., & Specht, M. M. (2014) · DSpace (Open University in the Netherlands) · Cited by 172
Self-citationKirsch, W. J. (1982) · Legal Issues of Economic Integration · doi:10.54648/leie1982006 · Cited by 161
Koops, B.-J. (2011) · SCRIPTed: A Journal of Law, Technology & Society · doi:10.2966/scrip.080311.229 · Cited by 156
The pulse of learning analytics understandings and expectations from the stakeholders
Drachsler, H., & Greller, W. (2012) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2330601.2330634 · Cited by 135
Self-citationStudent privacy self-management: implications for learning analytics
Prinsloo, P., & Slade, S. (2015) · Proceedings of the Fifth International Conference on Learning Analytics And Knowledge · doi:10.1145/2723576.2723585 · Cited by 119
Reflections on the Stanford Prison Experiment: Genesis, Transformations, Consequences
Zimbardo, P. G., Maslach, C., & Haney, C. W. (1999) · Psychology Press eBooks · doi:10.4324/9781410602022-15 · Cited by 111
An evaluation of policy frameworks for addressing ethical considerations in learning analytics
Prinsloo, P., & Slade, S. (2013) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2460296.2460344 · Cited by 109
LEA in Private: A Privacy and Data Protection Framework for a Learning Analytics Toolbox
Steiner, C., Kickmeier-Rust, M., & Albert, D. (2016) · Journal of Learning Analytics · doi:10.18608/jla.2016.31.5 · Cited by 50
Koops, B. (2011) · Data Archiving and Networked Services (DANS) · Cited by 44
Facebook Study: A Little Bit Unethical But Worth It?
Kleinsman, J., & Buckley, S. (2015) · Journal of Bioethical Inquiry · doi:10.1007/s11673-015-9621-0 · Cited by 40
Heerde, V. H. (2010) · doi:10.3990/1.9789036530026 · Cited by 7
Research works printed but not linked: 4
- Hoel, T. & Chen, W. (2015). Privacy in Learning Analytics -- Implications for System Architecture. In: Watanabe, T. and Seta, K. (Eds.) (2015). Proceedings of the 11th International Conference on Knowledge Management.
- European Commission (2014). New modes of learning and teaching in higher education. Luxembourg: Publications Office of the European Union 2014, 68 pp. ISBN 978-92-79-39789-9 DOI:10.2766/81897 http://ec.europa.eu/education/library/reports/modernisation-universities_en.pdf · doi:10.2766/81897
- Casey, J., & Greller, W. (2015). Jane Austen and the Belly of the Beast Part 2 - Language and Power: Commodification, Technology and the Open Agenda in Higher Education. In: ISIS Summit Vienna 2015---The Information Society at the Crossroads. Multidisciplinary Digital Publishing Institute. Available at: http://sciforum.net/conference/isis-summit-vienna-2015/paper/2910/download/pdf · doi:10.3390/isis-summit-vienna-2015-s3030
- Narayanan, A., Shmatikov, V. (2008). Robust Deanonymization of Large Datasets (How to Break Anonymity of the Netflix Prize Dataset). The University of Texas at Austin February 5, 2008. http://arxiv.org/pdf/cs/0610105.pdf · arXiv
Cited by
Ethics of AI in Education: Towards a Community-Wide Framework
Holmes, W., Porayska-Pomsta, K., Holstein, K., Sutherland, E., Baker, T., Shum, S. B., Santos, O. C., Rodrigo, M. T., Cukurova, M., Bittencourt, I. I., et al. (2022) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-021-00239-1 · Cited by 1,437
“…is genuinely informed and freely given, ensuring that data is truly anonymised, establishing and implementing procedures to guarantee individual privacy, and adopting clear and transparent obligations with any external agencies that might be involved with the data (Drachsler and Greller 2016).”
BackgroundState of the art and practice in AI in education
Holmes, W., & Tuomi, I. (2022) · European Journal of Education · doi:10.1111/ejed.12533 · Cited by 1,093
Post-Covid-19 Education and Education Technology ‘Solutionism’: a Seller’s Market
Teräs, M., Suoranta, J., Teräs, H., & Curcher, M. (2020) · Postdigital Science and Education · doi:10.1007/s42438-020-00164-x · Cited by 594
Human-centred learning analytics and AI in education: A systematic literature review
Alfredo, R., Echeverria, V., Jin, Y., Yan, L., Swiecki, Z., Gašević, D., & Martinez-Maldonado, R. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100215 · Cited by 281
“When users, especially students, feel that their data is protected and that the system operates within safe parameters, their trust in the system will likely increase (Drachsler and Greller, 2016).”
BackgroundAgainst All Odds: Education in Germany Coping with Covid-19
Kerres, M. (2020) · Postdigital Science and Education · doi:10.1007/s42438-020-00130-7 · Cited by 254
Metadata
- Authors
- Drachsler, H., & Greller, W.
- Venue
- Proceedings of the Sixth International Conference on Learning Analytics & Knowledge - LAK '16
- Publisher
- ACM Press
- Published
- 2016
- Pages
- 89-98
- OpenAlex
- W2336314092
- Cited by
- 367
- References
- 37
- FWCI
- 19.53
- Type
- conference paper
- Language
- en
- Open access
- closed
- Funders
- Seventh Framework Programme (LACE project: grant number 619424)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.