Azalia Mirhoseini
Founder and CTO of Ricursive Intelligence and Assistant Professor of Computer Science at Stanford University, known for co-leading AlphaChip and for work on AI systems for chip design, self-improving AI, and scalable machine learning.
Verification Is the Bottleneck for Self-Improving AI Agents
Stanford’s Aakanksha Chowdhery and Azalia Mirhoseini argue that progress in AI is shifting beyond scaling model training toward using more computation at inference time, selecting among candidate outputs, and feeding verified successes back into training. In the opening lecture of CS329A, they trace how post-training made large language models usable assistants and how reasoning models and agents extend that capability into multi-step work. Their central constraint is verification: self-improvement is most tractable where systems can reliably tell whether an answer or action is correct.
LATS, SPRINT, and SWiRL Target Different Bottlenecks in Agent Reasoning
Stanford’s Azalia Mirhoseini argues that improving multi-step AI agents requires more than extending a chain of thought: agents must plan, act, use feedback and revise their course. In this CS329A lecture, she examines three approaches to that problem—LATS, which searches alternative action paths at inference; SPRINT, which identifies work that can run in parallel; and SWiRL, which trains next-action choices from offline tool-use trajectories. Each shifts the trade-off among accuracy, latency, inference cost and the reliability of feedback.
Verification, Not Sampling, Limits Test-Time Scaling for AI Agents
Stanford’s Azalia Mirhoseini argues that repeated sampling improves reasoning-model performance only when a system can reliably identify correct candidates—and that verification cannot recover answers the generator never produces. In this CS329A lecture, she examines outcome-based and process-based reward models, rollout-generated labels and verifier ensembles as approaches to the gap between producing a correct solution and selecting it. The central systems question is how to spend a fixed inference budget among generating more candidates, using stronger or more numerous verifiers, and verifying each candidate more deeply.
Test-Time Scaling Depends on Verifying Rare Correct Answers
Stanford computer scientist Azalia Mirhoseini argues that test-time compute can turn an existing language model into a more capable system by generating, revising and evaluating many candidate answers after a query arrives, rather than relying on a single response or additional training. The approach works best where outputs can be reliably verified—through formal checkers, unit tests or comparable signals—and where the value of better results justifies added cost and latency. But she cautions that extra inference cannot substitute for stronger pre-training on the hardest problems, and that weak verification can leave correct answers buried among more plausible wrong ones.
Ricursive Wants AI to Design the Chips That Train AI
At AI Ascent 2026, Ricursive Intelligence co-founders Anna Goldie and Azalia Mirhoseini argued that the next bottleneck in AI is the chip-design process itself, and that AI should be used to design the hardware that trains and serves it. Drawing on their AlphaChip work, which Goldie said has shipped in four generations of Google TPUs, they described Ricursive’s plan to rebuild chip-design tools for fast AI feedback loops and turn that tooling into a platform for custom silicon. Their larger claim is that workload-specific chips, and eventually co-designed chips and models, require moving chip design from yearlong expert workflows to automated optimization.