Eugene Yan
Member of Technical Staff at Anthropic working on safe, reliable AI systems at scale; previously led ML/AI teams at Amazon, Alibaba, Lazada, and a healthtech startup, and writes about LLMs, recommender systems, and engineering.
AI Security Scanning Shifts the Bottleneck to Verification and Patching
Anthropic’s Eugene Yan argues that frontier models have made vulnerability discovery abundant, shifting the practical security bottleneck to verifying, triaging, routing, and patching findings. Drawing on Mozilla’s jump in Firefox fixes and Anthropic’s scan of more than 1,000 open-source repositories, he proposes a six-step harness built around threat models, isolated sandboxes, independent exploit verification, and human-owned remediation. The aim is not to automate scanning alone, Yan says, but to turn model-generated candidates into reproducible, prioritized fixes.
Agentic AI Is Turning Model Quality Into a Systems Problem
At AI Engineer Singapore’s second day, speakers from Google DeepMind, Cloudflare, Arize, OpenClaw, Adaption and other teams made a shared engineering case: as AI systems become more agentic, model quality is no longer separable from the systems around the model. Richard Ngo framed the risk as long-horizon, situationally aware agents whose goals cannot be inspected, while practitioners argued that production AI now depends on continuous evaluation, traces, deterministic execution boundaries, routing, memory, fine-tuning and test-time search. The source’s central claim is that useful and safe agentic AI is becoming a systems problem, not just a model-selection problem.