Neural Legal Judgment Prediction in English
Open accessAbstract
Legal judgment prediction is the task of automatically predicting the outcome of a court case, given a text describing the case's facts.Previous work on using neural models for this task has focused on Chinese; only featurebased models (e.g., using bags of words and topics) have been considered in English.We release a new English legal judgment prediction dataset, containing cases from the European Court of Human Rights.We evaluate a broad variety of neural models on the new dataset, establishing strong baselines that surpass previous feature-based models in three tasks: (1) binary violation classification; (2) multi-label classification; (3) case importance prediction.We also explore if models are biased towards demographic information via data anonymization.As a side-product, we propose a hierarchical version of BERT, which bypasses BERT's length limitation.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Training Transformers with longer sequences with FlashAttention improves performance on the MIMIC-III and ECtHR datasets.
“Training Transformers with longer sequences with FlashAttention improves performance on the MIMIC-III [47] and ECtHR [6, 7] datasets.”
From FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness (2022) · cites this paper as [6]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · see citing works
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · see citing works
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 48,293 · see citing works
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071 · see citing works
(2010) · Cited by 14,134 · see citing works
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248 · see citing works
Hierarchical Attention Networks for Document Classification
Yang, Z., Yang, D., Dyer, C., He, X., Smola, A. J., & Hovy, E. H. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1174 · Cited by 4,874 · see citing works
Towards A Rigorous Science of Interpretable Machine Learning
Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121 · see citing works
Jain, S., & Wallace, B. C. (2019) · North American Chapter of the Association for Computational Linguistics · doi:10.18653/v1/n19-1357 · Cited by 2,287 · see citing works
Αλέτρας, Ν., Tsarapatsanis, D., Preoțiuc-Pietro, D., & Lampos, V. (2016) · PeerJ Computer Science · doi:10.7717/peerj-cs.93 · Cited by 813 · see citing works
Explainable Prediction of Medical Codes from Clinical Text
Mullenbach, J., Wiegreffe, S., Duke, J., Sun, J., & Eisenstein, J. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1100 · Cited by 597 · see citing works
Legal Judgment Prediction via Topological Learning
Zhong, H., Guo, Z., Tu, C., Xiao, C., Liu, Z., & Sun, M. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1390 · Cited by 369 · see citing works
Learning to Predict Charges for Criminal Cases with Legal Basis
Luo, B., Feng, Y., Xu, J., Zhang, X., & Zhao, D. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1289 · Cited by 329 · see citing works
Few-Shot Charge Prediction with Discriminative Legal Attributes
Hu, Z., Li, X., Tu, C., Liu, Z., & Sun, M. (2018) · International Conference on Computational Linguistics · Cited by 171 · see citing works
Ye, H., Jiang, X., Luo, Z., & Chao, W. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-1168 · Cited by 152 · see citing works
Chalkidis, I., Androutsopoulos, I., & Michos, A. (2017) · doi:10.1145/3086512.3086515 · Cited by 132 · see citing works
Self-citationPredicting the Law Area and Decisions of French Supreme Court Cases
Şulea, O.-M., Zampieri, M., Vela, M., & van Genabith, J. (2017) · International conference Recent advances in natural language processing · doi:10.26615/978-954-452-049-6_092 · Cited by 114 · see citing works
Obligation and Prohibition Extraction Using Hierarchical RNNs
Chalkidis, I., Androutsopoulos, I., & Michos, A. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-2041 · Cited by 65 · see citing works
Self-citationExtreme Multi-Label Legal Text Classification: A Case Study in
Chalkidis, I., Fergadiotis, E., Malakasiotis, P., Αλέτρας, Ν., & Androutsopoulos, I. (2019) · Natural Legal Language Processing Workshop (NLLP) · doi:10.18653/v1/w19-2209 · Cited by 52 · see citing works
Self-citationLegal docket-entry classification
Nallapati, R. M., & Manning, C. D. (2008) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/1613715.1613771 · Cited by 47 · see citing works
Legal NERC with ontologies, Wikipedia and curriculum learning
Cardellino, C., Teruel, M., Alemany, L. A., & Villata, S. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-2041 · Cited by 37 · see citing works
Historical Analysis of Legal Opinions with a Sparse Mixed-Effects Latent Variable Model
Wang, W. Y., Mayfield, E., Naidu, S., & Dittmar, J. E. (2012) · London School of Economics and Political Science Research Online (London School of Economics and Political Science) · Cited by 22 · see citing works
Bargaining in the Shadow of Big DataPreprint
Stevenson, D. D., & Wagoner, N. J. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2325137 · Cited by 15 · see citing works
Judicial decisions of the European Court of Human Rights: looking into the crystall ball
Medvedeva, M., Vols, M., & Wieling, M. B. (2018) · University of Groningen research database (University of Groningen / Centre for Information Technology) · Cited by 12 · see citing works
Flagged first, then by citations
1 of the 26 references couldn’t be matched to a known paper.
Research works printed but not linked: 3
- Daniel Martin Katz. 2012. Quantitative legal prediction-or-how I learned to stop worrying and start preparing for the data-driven future of the le- gal services industry. Emory Law Journal, 62:909.
- Reed C Lawlor. 1963. What computers can do: Anal- ysis and prediction of judicial decisions. American Bar Association Journal, pages 337-344.
- Ramesh Nallapati and Christopher D. Manning. 2008. Legal docket classification: Where machine learn- ing stumbles. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (Conference on Empirical Methods in Natural Lan- guage Processing (EMNLP)), pages 438-446.
Cited by
Sorted by citations
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676 · see citing works
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
Dao, T., Fu, D. Y., Ermon, S., Rudra, A., & Ré, C. (2022) · arXiv · doi:10.48550/arxiv.2205.14135 · Cited by 1,214 · see citing works
“ECtHR contains legal cases from the European Court of Human Rights, each of which is mapped to articles of the Convention of Human Rights that were allegedly violaged.”
BackgroundMethodInfluentialLEGAL-BERT: The Muppets straight out of Law School
Chalkidis, I., Fergadiotis, M., Malakasiotis, P., Αλέτρας, Ν., & Androutsopoulos, I. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.261 · Cited by 1,197 · see citing works
Self-citationHow Does NLP Benefit Legal System: A Summary of Legal Artificial Intelligence
Zhong, H., Xiao, C., Tu, C., Zhang, T., Liu, Z., & Sun, M. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.466 · Cited by 420 · see citing works
Lawformer: A pre-trained language model for Chinese legal long documents
Xiao, C., Hu, X., Liu, Z., Tu, C., & Sun, M. (2021) · AI Open · doi:10.1016/j.aiopen.2021.06.003 · Cited by 301 · see citing works
A comparative study of automated legal text classification using random forests and deep learning
Chen, H., Wu, L., Chen, J., Lu, W. P., & Ding, J. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102798 · Cited by 248 · see citing works
Analyzing Leakage of Personally Identifiable Information in Language Models
Lukas, N., Salem, A., Sim, R., Tople, S., Wutschitz, L., & Zanella-Béguelin, S. (2023) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp46215.2023.10179300 · Cited by 181 · see citing works
ILDC for CJPE: Indian Legal Documents Corpus for Court Judgment Prediction and Explanation
Malik, V., Sanjay, R., Nigam, S. K., Ghosh, K., Guha, S. K., Bhattacharya, A., & Modi, A. (2021) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2021.acl-long.313 · Cited by 176 · see citing works
(2021) · doi:10.1145/3462757.3466088 · Cited by 151 · see citing works
Exploring LLMs Applications in Law: A Literature Review on Current Legal NLP Approaches
Siino, M., Falco, M., Croce, D., & Rosso, P. (2025) · IEEE Access · doi:10.1109/access.2025.3533217 · Cited by 130 · see citing works
LexGLUE: A Benchmark Dataset for Legal Language Understanding in English
Chalkidis, I., Jana, A., Hartung, D., Bommarito, M. J., Androutsopoulos, I., Katz, D. M., & Aletras, N. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3936759 · Cited by 111 · see citing works
Self-citationA Survey on Legal Judgment Prediction: Datasets, Metrics, Models and Challenges
Cui, J., Shen, X., & Wen, S. (2023) · IEEE Access · doi:10.1109/access.2023.3317083 · Cited by 117 · see citing works
Scalable and explainable legal prediction
Branting, L. K., Pfeifer, C., Brown, B. C., Ferro, L., Aberdeen, J. S., Weiss, B., Pfaff, M. S., & Liao, B. (2020) · Artificial Intelligence and Law · doi:10.1007/s10506-020-09273-1 · Cited by 102 · see citing works
Interpretable Long-Form Legal Question Answering with Retrieval-Augmented Large Language Models
Louis, A., DIJCK, G. V., & Spanakis, G. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i20.30232 · Cited by 108 · see citing works
PLM-ICD: Automatic ICD Coding with Pretrained Language Models
Huang, C.-W., Tsai, S.-C., & Chen, Y.-N. (2022) · Clinical Natural Language Processing Workshop (ClinicalNLP) · doi:10.18653/v1/2022.clinicalnlp-1.2 · Cited by 98 · see citing works
Rethinking the field of automatic prediction of court decisions
Medvedeva, M., Wieling, M. B., & Vols, M. (2022) · Artificial Intelligence and Law · doi:10.1007/s10506-021-09306-3 · Cited by 89 · see citing works
Explainable AI tools for legal reasoning about cases: A study on the European Court of Human Rights
Collenette, J., Atkinson, K. M., & Bench-Capon, T. J. M. (2023) · Artificial Intelligence · doi:10.1016/j.artint.2023.103861 · Cited by 81 · see citing works
Song, D., Vold, A., Madan, K., & Schilder, F. (2021) · Information Systems · doi:10.1016/j.is.2021.101718 · Cited by 84 · see citing works
Chalkidis, I., Fergadiotis, M., Tsarapatsanis, D., Aletras, N., Androutsopoulos, I., & Malakasiotis, P. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.22 · Cited by 78 · see citing works
Self-citationDe-Biased Court’s View Generation with Causality
Wu, Y., Kuang, K., Zhang, Y., Liu, X., Sun, C., Xiao, J., Zhuang, Y., Si, L., & Wu, F. Q. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.56 · Cited by 76 · see citing works
Legal Judgment Prediction via Event Extraction with Constraints
Feng, Y., Li, C., & Ng, V. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.48 · Cited by 76 · see citing works
Neural natural language processing for long texts: A survey on classification and summarization
Tsirmpas, D., Gkionis, I., Papadopoulos, G. T., & Mademlis, I. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.108231 · Cited by 73 · see citing works
Text Segmentation by Cross Segment Attention
Lukasik, M., Dadachev, B., Papineni, K., & Simões, G. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.380 · Cited by 68 · see citing works
Pre-trained Language Models for the Legal Domain
Paul, S., Mandal, A., Goyal, P., & Ghosh, S. (2023) · International Conference on Artificial Intelligence and Law · doi:10.1145/3594536.3595165 · Cited by 67 · see citing works
Legal Judgement Prediction for UK Courts
Strickson, B., & de la Iglesia, B. (2020) · International Conference on Information Science and Systems (ICISS) · doi:10.1145/3388176.3388183 · Cited by 66 · see citing works
Predicting Brazilian Court Decisions
Freitas, A. L., Allende‐Cid, H., Santana, O., & de Oliveira-Lage, L. (2022) · PeerJ Computer Science · doi:10.7717/peerj-cs.904 · Cited by 60 · see citing works
Swiss-Judgment-Prediction: A Multilingual Legal Judgment Prediction Benchmark
Niklaus, J., Chalkidis, I., & Stuermer, M. (2021) · Natural Legal Language Processing Workshop (NLLP) · doi:10.18653/v1/2021.nllp-1.3 · Cited by 70 · see citing works
Self-citationAn end-to-end joint model for evidence information extraction from court record document
Ji, D., Tao, P., Fei, H., & Ren, Y. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2020.102305 · Cited by 59 · see citing works
Thirty years of artificial intelligence and law: the third decade
Villata, S., Araszkiewicz, M., Ashley, K. D., Bench-Capon, T. J. M., Branting, L. K., Conrad, J. G., & Wyner, A. (2022) · Artificial Intelligence and Law · doi:10.1007/s10506-022-09327-6 · Cited by 57 · see citing works
Greco, C. M., & Tagarelli, A. (2023) · Artificial Intelligence and Law · doi:10.1007/s10506-023-09374-7 · Cited by 71 · see citing works
Legal Judgment Prediction with Multi-Stage Case Representation Learning in the Real Court Setting
Ma, L., Zhang, Y., Wang, T., Liu, X., Ye, W., Sun, C., & Zhang, S. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462945 · Cited by 56 · see citing works
Tagarelli, A., & Simeri, A. (2021) · Artificial Intelligence and Law · doi:10.1007/s10506-021-09301-8 · Cited by 55 · see citing works
Alghazzawi, D., Bamasag, O. O., Albeshri, A. A., Sana, I., Ullah, H., & Asghar, M. Z. (2022) · Mathematics · doi:10.3390/math10050683 · Cited by 55 · see citing works
Precedent-Enhanced Legal Judgment Prediction with LLM and Domain-Model Collaboration
Wu, Y., Zhou, S., Liu, Y., Lü, W., Liu, X., Zhang, Y., Sun, C., Wu, F., & Kuang, K. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.740 · Cited by 80 · see citing works
Paul, S., Goyal, P., & Ghosh, S. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i10.21363 · Cited by 53 · see citing works
DeepRhole: deep learning for rhetorical role labeling of sentences in legal case documents
Bhattacharya, P., Paul, S., Ghosh, K., Ghosh, S., & Wyner, A. (2021) · Artificial Intelligence and Law · doi:10.1007/s10506-021-09304-5 · Cited by 54 · see citing works
Legal case document similarity: You need both network and text
Bhattacharya, P., Ghosh, K., Pal, A., & Ghosh, S. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.103069 · Cited by 50 · see citing works
SemEval-2023 Task 6: LegalEval - Understanding Legal Texts
Modi, A., Kalamkar, P., Karn, S., Tiwari, A. K., Joshi, A., Tanikella, S. K., Guha, S. K., Malhan, S., & Raghavan, V. (2023) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2023.semeval-1.318 · Cited by 45 · see citing works
Scenario based Deep Learning Prediction for Legal Judgment using LSTM and CNN
Pandi, S. S., Farook, A. M., & Kingston, W. S. (2023) · International Conference on Smart Technologies, Communication and Robotics (STCR) · doi:10.1109/stcr59085.2023.10397023 · Cited by 45 · see citing works
Legal Judgment Prediction: A Survey of the State of the Art
Feng, Y., Li, C., & Ng, V. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/765 · Cited by 44 · see citing works
Effectively Leveraging BERT for Legal Document Classification
Limsopatham, N. (2021) · Natural Legal Language Processing Workshop (NLLP) · doi:10.18653/v1/2021.nllp-1.22 · Cited by 44 · see citing works
Recurrent Chunking Mechanisms for Long-Text Machine Reading Comprehension
Gong, H., Shen, Y., Yu, D., Chen, J., & Yu, D. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.603 · Cited by 42 · see citing works
Towards Interactivity and Interpretability: A Rationale-based Legal Judgment Prediction Framework
Wu, Y., Liu, Y., Lü, W., Zhang, Y., Feng, J., Sun, C., Wu, F. Q., & Kuang, K. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.316 · Cited by 40 · see citing works
A deep neural network model for speakers coreference resolution in legal texts
Ji, D., Gao, J., Fei, H., Teng, C., & Ren, Y. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2020.102365 · Cited by 37 · see citing works
Wang, X., Zhang, X., Hoo, V., Shao, Z., & Zhang, X. (2024) · IEEE Access · doi:10.1109/access.2024.3496666 · Cited by 37 · see citing works
Processing Long Legal Documents with Pre-trained Transformers: Modding LegalBERT and Longformer
Mamakas, D., Tsotsi, P., Androutsopoulos, I., & Chalkidis, I. (2022) · Natural Legal Language Processing Workshop (NLLP) · doi:10.18653/v1/2022.nllp-1.11 · Cited by 44 · see citing works
Self-citationLicari, D., & Comandé, G. (2023) · Computer law & security review · doi:10.1016/j.clsr.2023.105908 · Cited by 36 · see citing works
A Comprehensive Evaluation of Large Language Models on Legal Judgment Prediction
Shui, R., Cao, Y., Wang, X., & Chua, T. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.490 · Cited by 43 · see citing works
A hybrid CNN + BILSTM deep learning-based DSS for efficient prediction of judicial case decisions
Ahmad, S., Asghar, M. Z., Alotaibi, F. M., & Al‐Otaibi, Y. D. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118318 · Cited by 35 · see citing works
CAIL2019-SCM: A Dataset of Similar Case Matching in Legal DomainPreprint
Xiao, C., Zhong, H., Guo, Z., Tu, C., Liu, Z., Sun, M., Zhang, T., Han, X., Hu, Z., Wang, H., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.08962 · Cited by 60 · see citing works
Fine-grained legal entity annotation: A case study on the Brazilian Supreme Court
Correia, F., Almeida, A. A. A., Nunes, J. L., Santos, K. G., Hartmann, I. A., Silva, F. A., & Lopes, H. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102794 · Cited by 34 · see citing works
Chen, H., Pieptea, L. F., & Ding, J. (2022) · IEEE Transactions on Reliability · doi:10.1109/tr.2022.3156126 · Cited by 31 · see citing works
HLDC: Hindi Legal Documents Corpus
Kapoor, A., Dhawan, M., Goel, A., Arjun, T. H., Bhatnagar, A., Agrawal, V., Agrawal, A., Bhattacharya, A., Kumaraguru, P., & Modi, A. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.278 · Cited by 30 · see citing works
Learning Fine-Grained Fact-Article Correspondence in Legal Cases
Ge, J., huang, Y., Shen, X., Li, C., & Hu, W. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3130992 · Cited by 29 · see citing works
On the Ethical Limits of Natural Language Processing on Legal Text
Tsarapatsanis, D., & Αλέτρας, Ν. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.314 · Cited by 29 · see citing works
TaSbeeb: A judicial decision support system based on deep learning framework
Almuzaini, H. A., & Azmi, A. M. (2023) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2023.101695 · Cited by 36 · see citing works
A Statutory Article Retrieval Dataset in French
Louis, A., & Spanakis, G. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.468 · Cited by 41 · see citing works
Song, D., Gao, S., He, B., & Schilder, F. (2022) · IEEE Access · doi:10.1109/access.2022.3190408 · Cited by 30 · see citing works
Performance analysis of large language models in the domain of legal argument mining
Zubaer, A. A., Granitzer, M., & Mitrović, J. (2023) · Frontiers Artif. Intell. · doi:10.3389/frai.2023.1278796 · Cited by 44 · see citing works
A Meta Analysis of Attention Models on Legal Judgment Prediction System
Sukanya, G., & Priyadarshini, J. (2021) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2021.0120266 · Cited by 28 · see citing works
Quevedo, E., Cerny, T., Rodríguez, A., Rivas, P., Yero, J., Sooksatra, K., Zhakubayev, A., & Taibi, D. (2023) · IEEE Access · doi:10.1109/access.2023.3333946 · Cited by 34 · see citing works
Large Language Models in Legal Systems: A Survey
Dehghani, F., Dehghani, R., Ardebili, Y. N., & Rahnamayan, S. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-05924-3 · Cited by 26 · see citing works
Thirty years of Artificial Intelligence and Law: the second decade
Giovanni Sartor, B., Araszkiewicz, M., Atkinson, K. M., Bex, F., van Engers, T., Francesconi, E., Prakken, H., Sileno, G., Schilder, F., Wyner, A., et al. (2022) · Artificial Intelligence and Law · doi:10.1007/s10506-022-09326-7 · Cited by 28 · see citing works
High-level implementable methods for automated building code compliance checking
Lee, J.-K., Cho, K., Choi, H., Choi, S., Kim, S., & Cha, S. H. (2023) · Developments in the Built Environment · doi:10.1016/j.dibe.2023.100174 · Cited by 26 · see citing works
Syllogistic Reasoning for Legal Judgment Analysis
Deng, W., Pei, J., Kong, K., Chen, Z., Wei, F., Li, Y., Ren, Z., Chen, Z., & Ren, P. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.864 · Cited by 25 · see citing works
Paragraph Similarity Scoring and Fine-Tuned BERT for Legal Information Retrieval and Entailment
Westermann, H., Šavelka, J., & Benyekhlef, K. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-79942-7_18 · Cited by 25 · see citing works
Multi-granular Legal Topic Classification on Greek Legislation
Papaloukas, C., Chalkidis, I., Athinaios, K., Pantazi, D.-A., & Koubarakis, M. (2021) · Natural Legal Language Processing Workshop (NLLP) · doi:10.18653/v1/2021.nllp-1.6 · Cited by 25 · see citing works
Self-citationFEDLEGAL: The First Real-World Federated Learning Benchmark for Legal NLP
Zhang, Z., Hu, X., Zhang, J., Zhang, Y., Wang, H., Qu, L., & Xu, Z. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.193 · Cited by 22 · see citing works
Chinese legal judgment prediction via knowledgeable prompt learning
Sun, J., Huang, S., & Wei, C. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122177 · Cited by 24 · see citing works
On the relevance of algorithmic decision predictors for judicial decision making
Bex, F., & Prakken, H. (2021) · International Conference on Artificial Intelligence and Law · doi:10.1145/3462757.3466069 · Cited by 22 · see citing works
Automatic Charge Identification from Facts: A Few Sentence-Level Charge Annotations is All You Need
Paul, S., Goyal, P., & Ghosh, S. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.88 · Cited by 20 · see citing works
Digital Transformation of Legal Services and Access to Justice: Challenges and Possibilities
Kiršienė, J., Amilevičius, D., & Stankevičiūtė, D. (2022) · Baltic Journal of Law & Politics · doi:10.2478/bjlp-2022-0007 · Cited by 28 · see citing works
Semo, G., Bernsohn, D., Hagag, B., Hayat, G., & Niklaus, J. (2022) · Natural Legal Language Processing Workshop (NLLP) · doi:10.18653/v1/2022.nllp-1.3 · Cited by 23 · see citing works
On the Role of Negative Precedent in Legal Outcome Prediction
Valvoda, J., Cotterell, R., & Teufel, S. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00532 · Cited by 19 · see citing works
He, C., Tan, T.-P., Xue, S., & Tan, Y. (2023) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2023.101868 · Cited by 19 · see citing works
Deception detection in text and its relation to the cultural dimension of individualism/collectivism
Papantoniou, K., Papadakos, P., Patkos, T., Flouris, G., Androutsopoulos, I., & Plexousakis, D. (2021) · Natural Language Engineering · doi:10.1017/s1351324921000152 · Cited by 20 · see citing works
Self-citationDeep Learning Algorithm for Judicial Judgment Prediction Based on BERT
Wang, Y., Gao, J., & Chen, J. (2020) · International Conference on Computing, Communication and Security (ICCCS) · doi:10.1109/icccs49678.2020.9277068 · Cited by 18 · see citing works
Enhancing Legal Argument Mining with Domain Pre-training and Neural Networks
Zhang, G., Nulty, P., & Lillis, D. (2022) · Journal of Data Mining & Digital Humanities · doi:10.46298/jdmdh.9147 · Cited by 17 · see citing works
de Oliveira, L. F., Gomes, A. D. S., Enes, Y. D. S. O., Branco, T. V. C., Pires, R. P., Bolzon, A., & Demo, G. (2022) · SN Social Sciences · doi:10.1007/s43545-022-00482-w · Cited by 17 · see citing works
A topic discovery approach for unsupervised organization of legal document collections
Vianna, D., de Moura, E. S., & da Silva, A. S. (2023) · Artificial Intelligence and Law · doi:10.1007/s10506-023-09371-w · Cited by 18 · see citing works
Chen, P., Zhang, A., Zhang, S., Dong, T., Zeng, X. R., Chen, S., Shi, P., Wong, Y. D., & Zhou, Q. (2025) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2025.110845 · Cited by 17 · see citing works
Classifying European Court of Human Rights Cases Using Transformer-Based Techniques
Imran, A. S., Hodnefjeld, H., Kastrati, Z., Fatima, N., Daudpota, S. M., & Wani, M. A. (2023) · IEEE Access · doi:10.1109/access.2023.3279034 · Cited by 18 · see citing works
Legal Knowledge and Information Systems
Saarbrücken, J. (. 2., Francesconi, E., Borges, G., & Sorge, C. (2022) · Frontiers in artificial intelligence and applications · doi:10.3233/faia362 · Cited by 16 · see citing works
The Unreasonable Effectiveness of the Baseline: Discussing SVMs in Legal Text Classification
Clavié, B., & Alphonsus, M. (2021) · Frontiers in artificial intelligence and applications · doi:10.3233/faia210317 · Cited by 16 · see citing works
Identification, Categorisation and Forecasting of Court Decisions
Medvedeva, M. (2022) · doi:10.33612/diss.236807643 · Cited by 15 · see citing works
Measuring and Mitigating Gender Bias in Legal Contextualized Language Models
Bozdag, M., Sevim, N., & Koç, A. (2024) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3628602 · Cited by 15 · see citing works
Gray, M., Šavelka, J., Oliver, W. M., & Ashley, K. D. (2024) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2023.0155 · Cited by 15 · see citing works
Boosting court judgment prediction and explanation using legal entities
Benedetto, I., Koudounas, A., Vaiani, L., Pastor, E., Cagliero, L., Tarasconi, F., & Baralis, E. (2024) · Artificial Intelligence and Law · doi:10.1007/s10506-024-09397-8 · Cited by 17 · see citing works
An LLMs-based neuro-symbolic legal judgment prediction framework for civil cases
Wei, B., Yu, Y., Gan, L., & Wu, F. Q. (2025) · Artificial Intelligence and Law · doi:10.1007/s10506-025-09433-1 · Cited by 15 · see citing works
Extracting Outcomes from Appellate Decisions in US State Courts
Petrova, A., Armour, J. H., & Lukasiewicz, T. (2020) · Frontiers in artificial intelligence and applications · doi:10.3233/faia200857 · Cited by 15 · see citing works
T.y.s.s, S., Xu, S., Ichim, O., & Grabmair, M. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.74 · Cited by 18 · see citing works
Dina, N. Z., Ravana, S. D., & Idris, N. B. (2025) · SAGE Open · doi:10.1177/21582440251329663 · Cited by 14 · see citing works
Exploiting Contrastive Learning and Numerical Evidence for Confusing Legal Judgment Prediction
Gan, L., Li, B., Kuang, K., Zhang, Y., Wang, L., Luu, A., Yang, Y., & Wu, F. Q. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.814 · Cited by 14 · see citing works
An Empirical Study on Explanations in Out-of-Domain Settings
Chrysostomou, G., & Αλέτρας, Ν. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.477 · Cited by 14 · see citing works
He, C., Tan, T.-P., Xue, S., & Tan, Y. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125462 · Cited by 13 · see citing works
Wang, N., Wang, S., Li, M., Wu, L., Zhang, Z., Guan, Z., & Zhu, L. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3516579 · Cited by 14 · see citing works
Investigating the State-of-the-Art Performance and Explainability of Legal Judgment Prediction
Bhambhoria, R. V., Dahan, S., & Zhu, X. (2021) · doi:10.21428/594757db.a66d81b6 · Cited by 12 · see citing works
When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD DatasetPreprint
Zheng, L., Guha, N., Anderson, B., Henderson, P., & Ho, D. E. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.08671 · Cited by 13 · see citing works
Discovering Explanatory Sentences in Legal Case Decisions Using Pre-trained Language Models
Šavelka, J., & Ashley, K. D. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.361 · Cited by 12 · see citing works
peng, Y. T., & Lei, C. (2024) · PeerJ Computer Science · doi:10.7717/peerj-cs.1841 · Cited by 14 · see citing works
- Authors
- Chalkidis, I., Androutsopoulos, I., & Aletras, N.
- Affiliations
- Athens University of Economics and Business (GR)
- Venue
- Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics
- Published
- 2019
- Pages
- 4317-4323
- ISSN
- 0736-587X (ISSN-L)
- OpenAlex
- W2948586190
- Cited by
- 352
- References
- 26
- Citations by year
- 2026: 53 · 2025: 62 · 2024: 53 · 2023: 69 · 2022: 46 · 2021: 46 · 2020: 22 · 2019: 1
- FWCI
- 198.12
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Proceedings of the conference - Association for Computational Linguistics. Meeting (publishedVersion, cc-by)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Athens University of Economics and Business
- Topics
- Social Sciences › Political Science and International Relations › Artificial Intelligence in Law
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- legal judgment prediction, European Court of Human Rights, English legal texts, multi-label classification, demographic bias, data anonymization, neural language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review