Hofmann, Valentin

AI generates covertly racist decisions about people based on their dialect

Hofmann, V., Kalluri, P. R., Jurafsky, D., & King, S. (2024) · Nature

Ethics and Social Impacts of AILinguistic Variation and Morphology

Cited by 233

Measuring what Matters: Construct Validity in Large Language Model Benchmarks

Bean, A. M., Kearns, R. O., Romanou, A., Hafner, F. S., Mayne, H., Batzner, J., Foroutan Eghlidi, N., Schmitz, C., Korgul, K., Batra, H., et al. (2025) · Advances in Neural Information Processing Systems 38

Topic ModelingNatural Language Processing Techniques

Cited by 110

Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Models

Röttger, P., Hofmann, V., Pyatkin, V., Hinck, M., Kirk, H., Schuetze, H., & Hovy, D. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

Sentiment Analysis and Opinion MiningTopic Modeling

Cited by 89

Dolma: an open corpus of three trillion tokens for language model pretraining research

Soldaini, L., Kinney, R., Bhagia, A., Schwenk, D., Atkinson, D., Authur, R., Bogin, B., Chandu, K., Dumas, J., Elazar, Y., et al. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

Topic ModelingNatural Language Processing Techniques

Cited by 56

Dialect prejudice predicts AI decisions about people's character, employability, and criminality

Hofmann, V., Kalluri, P. R., Jurafsky, D., & King, S. (2024) · arXiv

Ethics and Social Impacts of AILinguistic Variation and Morphology

Cited by 33

Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research

Soldaini, L., Kinney, R., Bhagia, A., Schwenk, D., Atkinson, D., Authur, R., Bogin, B., Chandu, K., Dumas, J., Elazar, Y., et al. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 10

Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Models

Röttger, P., Hofmann, V., Pyatkin, V., Hinck, M., Kirk, H. R., Schütze, H., & Hovy, D. (2024) · arXiv

Ethics and Social Impacts of AISentiment Analysis and Opinion Mining

Cited by 7

Paloma: A Benchmark for Evaluating Language Model Fit

Magnusson, I., Bhagia, A., Hofmann, V., Soldaini, L., Jha, A. H., Tafjord, O., Schwenk, D., Walsh, E. P., Elazar, Y., Lo, K., et al. (2023) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 1

Signal and Noise: A Framework for Reducing Uncertainty in Language Model Evaluation

Heineman, D., Hofmann, V., Magnusson, I., Gu, Y., Smith, N. A., Hajishirzi, H., Lo, K., & Dodge, J. (2025) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 0