Kinniment, Megan

RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human experts

Wijk, H., Lin, T., Becker, J., Jawhar, S., Parikh, N., Broadley, T., Chan, L., Chen, M., Clymer, J., Dhyani, J., et al. (2024) · arXiv

Artificial Intelligence ApplicationsAI-based Problem Solving and Planning

Cited by 187

Measuring AI Ability to Complete Long Software Tasks

Kwa, T., West, B., Becker, J., Deng, A., Garcia, K., Hasin, M., Jawhar, S., Kinniment, M., Rush, N., Von Arx, S., et al. (2025) · Advances in Neural Information Processing Systems 38

Software Engineering ResearchSoftware Engineering Techniques and Practices

Cited by 21

Evaluating Language-Model Agents on Realistic Autonomous Tasks

Kinniment, M., Sato, L. J. K., Du, H., Goodrich, B., Hasin, M., Chan, L., Miles, L. H., Lin, T. R., Wijk, H., Burget, J., et al. (2023) · arXiv

Ethics and Social Impacts of AIPsychiatry, Mental Health, Neuroscience

Cited by 15

Measuring AI Ability to Complete Long Software Tasks

Kwa, T., West, B., Becker, J., Deng, A., Garcia, K., Hasin, M., Jawhar, S., Kinniment, M., Rush, N., Von Arx, S., et al. (2025) · arXiv

Artificial Intelligence ApplicationsSoftware Engineering Research

Cited by 14

HCAST: Human-Calibrated Autonomy Software Tasks

Rein, D., Becker, J., Deng, A., Nix, S., Canal, C., O'Connel, D., Arnott, P., Bloom, R., Broadley, T., Garcia, K., et al. (2025) · arXiv

Artificial Intelligence ApplicationsEthics and Social Impacts of AI

Cited by 0