The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Predicting judicial decisions of the European Court of Human Rights: a Natural Language Processing perspective
Open accessAbstract
Recent advances in Natural Language Processing and Machine Learning provide us with the tools to build predictive models that can be used to unveil patterns driving judicial decisions. This can be useful, for both lawyers and judges, as an assisting tool to rapidly identify cases and extract patterns which lead to certain decisions. This paper presents the first systematic study on predicting the outcome of cases tried by the European Court of Human Rights based solely on textual content. We formulate a binary classification task where the input of our classifiers is the textual content extracted from a case and the target output is the actual judgment as to whether there has been a violation of an article of the convention of human rights. Textual information is represented using contiguous word sequences, i.e., N-grams, and topics. Our models can predict the court’s decisions with a strong accuracy (79% on average). Our empirical analysis indicates that the formal facts of a case are the most important predictive factor. This is consistent with the theory of legal realism suggesting that judicial decision-making is significantly affected by the stimulus of the facts. We also observe that the topical content of a case is another important feature in this classification task and explore this relationship further by conducting a qualitative analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
A tutorial on spectral clustering
von Luxburg, U. (2007) · Statistics and Computing · doi:10.1007/s11222-007-9033-z · Cited by 10,349
Introduction to Modern Information Retrieval
Salton, G., & McGill, M. J. (1983) · Virtual Defense Library (Ministerio de Defensa) · Cited by 9,680
A vector space model for automatic indexing
Salton, G., Wong, A., & Yang, C. S. (1975) · Communications of the ACM · doi:10.1145/361219.361220 · Cited by 7,521
Introduction to modern information retrieval
Dillon, M. (1983) · Information Processing & Management · doi:10.1016/0306-4573(83)90062-6 · Cited by 5,909
From Frequency to Meaning: Vector Space Models of Semantics
Turney, P. D., & Pantel, P. (2010) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2934 · Cited by 2,866
Learning to Classify Text Using Support Vector Machines
Joachims, T. (2002) · Springer eBooks · doi:10.1007/978-1-4615-0907-3 · Cited by 1,366
The Selection of Disputes for Litigation
Priest, G. L., & Klein, B. (1984) · The Journal of Legal Studies · doi:10.1086/467732 · Cited by 1,277
The Supreme Court and the Attitudinal Model Revisited
Segal, J. A., & Spaeth, H. J. (2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511615696 · Cited by 1,165
Baselines and Bigrams: Simple, Good Sentiment and Topic Classification
Wang, S. I., & Manning, C. D. (2012) · Cited by 1,006
Cited by
LEGAL-BERT: The Muppets straight out of Law School
Chalkidis, I., Fergadiotis, M., Malakasiotis, P., Aletras, N., & Androutsopoulos, I. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.261 · Cited by 994
Self-citationA general approach for predicting the behavior of the Supreme Court of the United States
Katz, D. M., Bommarito, M. J., & Blackman, J. (2017) · PLOS ONE · doi:10.1371/journal.pone.0174698 · Cited by 528
Artificial Intelligence in Society
OECD (2019) · doi:10.1787/eedfee77-en · Cited by 487
Using machine learning to predict decisions of the European Court of Human Rights
Medvedeva, M., Vols, M., & Wieling, M. (2020) · Artificial Intelligence and Law · doi:10.1007/s10506-019-09255-y · Cited by 429
How Does NLP Benefit Legal System: A Summary of Legal Artificial Intelligence
Zhong, H., Xiao, C., Tu, C., Zhang, T., Liu, Z., & Sun, M. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.466 · Cited by 367
Neural Legal Judgment Prediction in English
Chalkidis, I., Androutsopoulos, I., & Aletras, N. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1424 · Cited by 352
Legal Judgment Prediction via Topological Learning
Zhong, H., Guo, Z., Tu, C., Xiao, C., Liu, Z., & Sun, M. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1390 · Cited by 344
AI generates covertly racist decisions about people based on their dialect
Hofmann, V., Kalluri, P. R., Jurafsky, D., & King, S. (2024) · Nature · doi:10.1038/s41586-024-07856-5 · Cited by 233
Algorithmic regulation and the rule of law
Hildebrandt, M. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2017.0355 · Cited by 222
Legal requirements on explainability in machine learning
Bibal, A., Lognoul, M., de Streel, A., & Frénay, B. (2021) · Artificial Intelligence and Law · doi:10.1007/s10506-020-09270-4 · Cited by 165
(2021) · doi:10.1145/3462757.3466088 · Cited by 151
Algorithmic Decision-Making and the Control Problem
Zerilli, J., Knott, A., Maclaurin, J., & Gavaghan, C. (2019) · Minds and Machines · doi:10.1007/s11023-019-09513-7 · Cited by 145
Human Judgment in algorithmic loops: Individual justice and automated decision‐making
Binns, R. (2022) · Regulation & Governance · doi:10.1111/rego.12358 · Cited by 134
Iteratively Questioning and Answering for Interpretable Legal Judgment Prediction
Zhong, H., Wang, Y., Tu, C., Zhang, T., Liu, Z., & Sun, M. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i01.5479 · Cited by 113
LexGLUE: A Benchmark Dataset for Legal Language Understanding in English
Chalkidis, I., Jana, A., Hartung, D., Bommarito, M. J., Androutsopoulos, I., Katz, D. M., & Aletras, N. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3936759 · Cited by 111
Predicting risk in criminal procedure: Actuarial tools, algorithms, AI and judicial decision-making
McKay, C. (2020) · Current Issues in Criminal Justice · doi:10.1080/10345329.2019.1658694 · Cited by 85
Chalkidis, I., Fergadiotis, M., Tsarapatsanis, D., Aletras, N., Androutsopoulos, I., & Malakasiotis, P. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.22 · Cited by 78
Self-citationPrediction, persuasion, and the jurisprudence of behaviourism
Pasquale, F., & Cashwell, G. (2018) · University of Toronto Law Journal · doi:10.3138/utlj.2017-0056 · Cited by 44
Semi-Supervised Methods for Explainable Legal Prediction
Branting, K., Weiss, B., Brown, B., Pfeifer, C., Chakraborty, A., Ferro, L., Pfaff, M., & Yeh, A. (2019) · Proceedings of the Seventeenth International Conference on Artificial Intelligence and Law · doi:10.1145/3322640.3326723 · Cited by 43
Artificial Intelligence and Legal Tech: Challenges to the Rule of Law
Buchholtz, G. (2020) · Regulating Artificial Intelligence · doi:10.1007/978-3-030-32361-5_8 · Cited by 27
Noise induced hearing loss: Building an application using the ANGELIC methodology
Al-Abdulkarim, L., Atkinson, K., Bench-Capon, T., Whittle, S., Williams, R., & Wolfenden, C. (2018) · Argument & Computation · doi:10.3233/aac-181005 · Cited by 21
On the Role of Negative Precedent in Legal Outcome Prediction
Valvoda, J., Cotterell, R., & Teufel, S. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00532 · Cited by 19
Measuring and Mitigating Gender Bias in Legal Contextualized Language Models
Bozdag, M., Sevim, N., & Koç, A. (2024) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3628602 · Cited by 15
Measuring and Modeling the U.S. Regulatory Ecosystem
Bommarito II, M. J., & Katz, D. M. (2017) · Journal of Statistical Physics · doi:10.1007/s10955-017-1846-3 · Cited by 13
Porębski, A. (2023) · Research Handbook on Law and Technology · doi:10.4337/9781803921327.00037 · Cited by 4
Metadata
- Authors
- Aletras, N., Tsarapatsanis, D., Preoţiuc-Pietro, D., & Lampos, V.
- Venue
- PeerJ Computer Science
- Publisher
- PeerJ
- Published
- 2016-10-24
- Volume
- 2
- Pages
- e93
- ISSN
- 2376-5992 (ISSN-L)
- OpenAlex
- W2536769020
- Cited by
- 810
- References
- 24
- FWCI
- 211.88
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.