Heineman, David

Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfaces

Merrill, M. A., Shaw, A. G., Carlini, N., Li, B., Raj, H., Bercovich, I., Shi, L., Shin, J. Y., Walshe, T., Buchanan, E. K., et al. (2026) · arXiv

AI-based Problem Solving and PlanningArtificial Intelligence Applications

Cited by 392

DataDecide: How to Predict Best Pretraining Data with Small Experiments

Magnusson, I., Tai, N., Bogin, B., Heineman, D., Hwang, J. D., Soldaini, L., Bhagia, A., Liu, J., Groeneveld, D., Tafjord, O., et al. (2025) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 1

Signal and Noise: A Framework for Reducing Uncertainty in Language Model Evaluation

Heineman, D., Hofmann, V., Magnusson, I., Gu, Y., Smith, N. A., Hajishirzi, H., Lo, K., & Dodge, J. (2025) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 0