Mirhoseini, Azalia

Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer

Shazeer, N., Mirhoseini, A., Maziarz, K., Davis, A., Le, Q., Hinton, G., & Dean, J. (2017) · arXiv

Topic ModelingAdvanced Neural Network Applications

Cited by 933

A graph placement methodology for fast chip design

Mirhoseini, A., Goldie, A., Yazgan, M., Jiang, J. W., Songhori, E., Wang, S., Lee, Y.-J., Johnson, E., Pathak, O., Nova, A., et al. (2021) · Nature

VLSI and FPGA Design TechniquesEmbedded Systems Design Techniques

Cited by 618

CHESS: Contextual Harnessing for Efficient SQL Synthesis

Talaei, S., Pourreza, M., Chang, Y.-C., Mirhoseini, A., & Saberi, A. (2024) · arXiv

Natural Language Processing TechniquesTopic Modeling

Cited by 119

Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities

Comanici, G., Bieber, E., Schaekermann, M., Pasupat, I., Sachdeva, N., Dhillon, I., Blistein, M., Ram, O., Zhang, D., Rosen, E., et al. (2025) · arXiv

Multimodal Machine Learning ApplicationsTopic Modeling

Cited by 69

The Capacity for Moral Self-Correction in Large Language Models

Ganguli, D., Askell, A., Schiefer, N., Liao, T. I., Lukošiūtė, K., Chen, A., Goldie, A., Mirhoseini, A., Olsson, C., Hernandez, D., et al. (2023) · arXiv

Ethics and Social Impacts of AITopic Modeling

Cited by 53

Measuring Progress on Scalable Oversight for Large Language Models

Bowman, S. R., Hyun, J., Perez, E., Chen, E., Pettit, C., Heiner, S., Lukošiūtė, K., Askell, A., Jones, A., Chen, A., et al. (2022) · arXiv

Ethics and Social Impacts of AINatural Language Processing Techniques

Cited by 34

Large Language Monkeys: Scaling Inference Compute with Repeated Sampling

Brown, B., Juravsky, J., Ehrlich, R., Clark, R., Le, Q. V., Ré, C., & Mirhoseini, A. (2024) · arXiv

Topic ModelingSoftware Engineering Research

Cited by 14

KernelBench-Verified: Do LLM-Generated Kernels Actually Beat PyTorch?

Zhang, Y., Yu, P., Wang, J., Max, Fan, Reed, J., Mirhoseini, A., & Su, W. (2026) · arXiv

Parallel Computing and Optimization TechniquesSoftware Engineering Research

Cited by 12

Specific versus General Principles for Constitutional AI

Kundu, S., Bai, Y., Kadavath, S., Askell, A., Callahan, A., Chen, A., Goldie, A., Balwit, A., Mirhoseini, A., McLean, B., et al. (2023) · arXiv

Ethics and Social Impacts of AISpeech and dialogue systems

Cited by 7

Hydragen: High-Throughput LLM Inference with Shared Prefixes

Juravsky, J., Brown, B., Ehrlich, R., Fu, D. Y., Ré, C., & Mirhoseini, A. (2024) · arXiv

Parallel Computing and Optimization TechniquesTopic Modeling

Cited by 2

KernelBench: Can LLMs Write Efficient GPU Kernels?

Ouyang, A., Guo, S., Arora, S., Zhang, A. L., Hu, W., Ré, C., & Mirhoseini, A. (2025) · arXiv

Parallel Computing and Optimization TechniquesSoftware Engineering Research

Cited by 2

Decentralized Multi-Agent Systems with Shared Context

Mao, Y., Gu, J., Chauhan, A., Zhang, Q., Kang, H., & Mirhoseini, A. (2026) · arXiv

Multi-Agent Systems and NegotiationSoftware Engineering Research

Cited by 0

Synthetic Data Generation & Multi-Step RL for Reasoning & Tool Use

Goldie, A., Mirhoseini, A., Zhou, H., Cai, I., & Manning, C. D. (2025) · arXiv

Reinforcement Learning in RoboticsTopic Modeling

Cited by 0

Archon: An Architecture Search Framework for Inference-Time Techniques

Saad-Falcon, J., Lafuente, A. G., Natarajan, S., Maru, N., Todorov, H., Guha, E., Buchanan, E. K., Chen, M., Guha, N., Ré, C., et al. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 0

LLM-as-a-Verifier: A General-Purpose Verification Framework

Kwok, J., Li, S., Atreya, P., Liu, Y., Jiang, Y., Finn, C., Pavone, M., Stoica, I., & Mirhoseini, A. (2026) · arXiv

Topic ModelingAI-based Problem Solving and Planning

Cited by 0

Cartridges: Lightweight and general-purpose long context representations via self-study

Eyuboglu, S., Ehrlich, R., Arora, S., Guha, N., Zinsley, D., Liu, E., Tennien, W., Rudra, A., Zou, J., Mirhoseini, A., et al. (2025) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 0