Orply.
Topic

AI Infrastructure and Compute

The hardware and cloud stack behind AI, including GPUs, accelerators, data centers, networking, inference chips, and compute supply constraints.

Apple Explores Intel and Samsung for U.S. Chip Production

Mark Gurman said Apple has held early talks with Intel and Samsung about using new U.S. fabs to make future A-series and M-series processors, an exploratory move he framed as a supply-chain redundancy question rather than only a political one. Apple still relies heavily on TSMC, primarily in Taiwan, and Gurman described that geographic and supplier concentration as one of the company’s biggest risks. Across the rest of the broadcast, executives and analysts described a similar shift from exposure to execution: AI companies are giving Washington early model access for review, while enterprise adoption is being tested by security, deployment cost and proprietary data advantages.

Caroline Hyde · Mark Gurman · Lauren Webster · Hannah Miller · Seth Boro · Dani Burger · Josh Harris · Bill Ready · Romaine Bostick · Maggie Eastland · Lizette Chapman · Ian King · Peter Oey · Erin Price-WrightBloomberg TechnologyMay 7, 202614 min read

Samsung Reaches $1 Trillion Valuation on AI Chip Demand

Bloomberg’s Sangmi Cha argues Samsung’s move past a $1tn market value is more than a symbolic milestone: traders are reading it as a direct expression of the AI infrastructure trade, driven by tight memory-chip supply and helped by news of an Apple partnership. Cha says the rally still has room in investors’ eyes because Samsung trades at about 5.3 times forward earnings, while the company’s surge is also feeding a broader foreign-led rally in Korean equities.

Sangmi Cha · Shery AhnBloomberg TechnologyMay 7, 20263 min read

Data Scarcity, Not Compute, Is the Next AI Bottleneck

At AI Ascent 2026, Flapping Airplanes co-founders Ben and Asher Spector argued that data scarcity, more than compute alone, will determine where AI can create value next. They said the biggest gains so far have come in unusually data-rich domains such as search and coding, while much of the economy — including robotics, trading, science and narrow industrial workflows — lacks comparable datasets. Their proposed answer is to make models far more data-efficient by developing new GPU-level primitives that current frameworks such as PyTorch make hard to express.

Asher Spector · Ben SpectorSequoia CapitalMay 7, 20266 min read

Orbital Compute Becomes Cheaper If Launch Costs Fall Below $500/kg

Philip Johnston, Starcloud’s co-founder and chief executive, argues that AI data centers could become cheaper in orbit than on Earth if launch costs fall to about $500 per kilogram. His case rests on continuous solar power in a dawn-dusk orbit, avoiding land and battery costs, and using constellations of optically linked satellites for inference workloads. Starcloud’s plan, he said, starts with an orbital GPU proof point and points toward an 88,000-satellite network delivering roughly 20 gigawatts of compute capacity.

Philip JohnstonSequoia CapitalMay 7, 20266 min read

Ricursive Wants AI to Design the Chips That Train AI

At AI Ascent 2026, Ricursive Intelligence co-founders Anna Goldie and Azalia Mirhoseini argued that the next bottleneck in AI is the chip-design process itself, and that AI should be used to design the hardware that trains and serves it. Drawing on their AlphaChip work, which Goldie said has shipped in four generations of Google TPUs, they described Ricursive’s plan to rebuild chip-design tools for fast AI feedback loops and turn that tooling into a platform for custom silicon. Their larger claim is that workload-specific chips, and eventually co-designed chips and models, require moving chip design from yearlong expert workflows to automated optimization.

Azalia Mirhoseini · Anna GoldieSequoia CapitalMay 7, 20266 min read

AI Scaling Faces an Energy Wall Without Physics-First Hardware

At AI Ascent 2026, Unconventional AI founder and CEO Naveen Rao argued that the current AI compute stack is approaching an energy wall because it is built on an 80-year-old digital computing model poorly suited to intelligence. Rao’s case is that GPUs and matrix math cannot close the efficiency gap with biological brains fast enough, and that AI hardware must instead be rebuilt around physical dynamics, time-domain computation, and architectures that blur memory and processing. He presented Unconventional AI’s coupled-oscillator chip prototype as an attempt to move compute closer to the thermodynamic limits of intelligence per watt.

Naveen RaoSequoia CapitalMay 7, 20266 min read

Luma Is Rebuilding Video AI Around a Unified Multimodal Transformer

In a Stanford CS153 guest lecture, Luma AI co-founder and chief executive Amit Jain argues that generative video is only a staging point toward “unified intelligence”: models that understand and generate across text, images, video, audio, code and tools in a single work loop. Jain traces Luma’s path from Apple-era LiDAR and 3D capture to internet-scale video, saying the company followed the data but now sees prettier clips as insufficient. The destination, he says, is a multimodal AI factory for professional creative and physical work, where human skills, tool use, feedback and unified transformer architectures produce full campaigns, schematics, productions and eventually robotics workflows.

Anjney Midha · Amit JainStanford OnlineMay 7, 202619 min read

Multipath Reliable Connection Keeps Massive GPU Training Clusters in Sync

OpenAI’s Mark Handley and Greg Steinbrecher argue that frontier AI training has outgrown conventional data-center networking because synchronized GPU clusters are constrained by their worst congestion or failure, not average throughput. They present Multipath Reliable Connection, developed with major hardware and cloud partners, as OpenAI’s answer: a protocol that spreads traffic across many paths, detects loss quickly, routes around failures from the endpoints, and is being pushed as an open standard for the wider industry.

Andrew Mayne · Mark Handley · Greg SteinbrecherOpenAIMay 7, 202610 min read

Small-Model Inference Needs Infrastructure Beyond Model Servers

Filip Makraduli of Superlinked argues that the hard part of small-model inference is no longer simply serving a model, but operating many embeddings, rerankers, extractors and multimodal models efficiently in production. In his account, conventional one-model-per-container deployments waste GPU capacity and leave teams to rebuild routing, autoscaling, monitoring, hot-swapping and eviction themselves. Superlinked’s SIE is presented as an open-source attempt to provide that missing infrastructure layer for AI search and document-processing workloads.

Filip MakraduliAI EngineerMay 7, 20269 min read

Gemma 4 Moves On-Device AI From Chatbots to Local Agents

Chintan Parikh of Google DeepMind argues that on-device AI is moving from local chatbots toward local agents, as smaller Gemma 4 edge models become capable of tool calling, structured output and reasoning on phones, laptops and embedded hardware. With Weiyi Wang joining the Q&A, Parikh presents LiteRT as the deployment layer for that shift across Android, iOS, desktop, web and IoT. His case is pragmatic rather than absolute: edge inference can improve latency, privacy, offline use and cost, but teams still have to manage memory, quantization, accelerator support and when to call the cloud.

Weiyi Wang · Chintan ParikhAI EngineerMay 7, 202611 min read