Orply.
Topic

AI Infrastructure and Compute

The hardware and cloud stack behind AI, including GPUs, accelerators, data centers, networking, inference chips, and compute supply constraints.

Pre-Training Scale Is Losing Ground to Adaptive AI Systems

Sara Hooker, co-founder of Adaption Labs, argues in a Hugging Face ML Club India talk that AI progress is moving away from ever-larger pre-training runs as the default path and toward systems that adapt more efficiently after deployment. She says compute still matters, but the higher-return questions now concern data curation, post-training, test-time compute, interfaces, routing, and how cheaply models can learn from new information. Her case is that monolithic, one-size-fits-all models push the cost of adaptation onto users and concentrate participation among labs with the largest compute clusters.

Sayak Paul · Aritra Gosthipaty · Sara HookerHugging FaceMay 21, 202620 min read

Google’s I/O Pitch Put Distribution Ahead of Model Breakthroughs

John Coogan and Jordi Hays read Google I/O as a mixed signal: Google’s smart-glasses strategy looks stronger where it combines Gemini with eyewear distribution and Google’s own services, but its model launches exposed the risk of tying AI progress to a fixed conference calendar. On TBPN, they argued that Street View may be an underappreciated AI training asset and that AI video still has to move from impressive short clips to coherent long-form outputs. The episode also framed a potential SpaceX IPO and Nvidia’s latest results as evidence that the financial returns from space and AI infrastructure are already arriving at exceptional scale.

John Coogan · Jordi Hays · Tyler Cosgrove · Steve WozniakTBPNMay 21, 202614 min read

Kled Founder Alleges Luel Copied Its Human Data Marketplace

This Week in Startups put two founder arguments side by side: Mercury chief executive Immad Akhund said the fintech’s new $200mn round is meant to create strategic flexibility for a profitable company seeking a bank charter, while Kled founder Avi Patel argued that an alleged copycat in the human-data marketplace category threatens trust in a business built on consent and compliance. Jason Calacanis treated Patel’s dispute with Luel, Y Combinator and General Catalyst less as an intellectual-property case than as an ethics and diligence signal for investors.

Jason Calacanis · Alex Wilhelm · Immad Akhund · Avi PatelThis Week in StartupsMay 21, 202623 min read

Agent-Native Clouds Need Faster Primitives, Not New Ones

Railway founder Jake Cooper argues that software infrastructure does not need to abandon its old primitives for agents, but must make them much faster, cheaper, safer and more observable. In a wide-ranging interview with swyx and Alessio, Cooper lays out Railway’s attempt to build an agent-native cloud through own-metal data centers, production forks, progressive rollouts and deployment loops that assume thousands of concurrent software-producing actors rather than one human pushing a pull request.

Shawn Wang · Alessio Fanelli · Jake CooperLatent SpaceMay 20, 202624 min read

Generative AI’s Revenue Stack Is Still Inverted Toward Chips

Stanford adjunct lecturer and Altimeter partner Apoorv Agrawal argues in MS&E435 that generative AI’s economics still look unlike the software and cloud cycles investors often use to value it. In his estimates, AI revenue has grown sharply, but gross profit remains concentrated in semiconductors, while applications face inference costs, thin monetization and uncertain paths to mass-market utility. The question he puts to students is not whether AI demand exists, but how long the stack’s inverted shape can persist before applications and infrastructure capture more of the value.

Apoorv AgrawalStanford OnlineMay 20, 202611 min read

Google’s AI Assets Are Becoming a Product Coherence Problem

John Coogan and Jordi Hays read Google’s I/O as evidence that the company’s AI advantage is becoming a product-navigation problem: it has data, distribution, models and hardware partnerships, but its demos and product names left questions about coherence and pace. Across the source, that same pressure appears in more operational forms, as AI pushes companies to turn technical capability into usable workflows, secure software dependencies and faster product systems. Tae Kim’s Nvidia argument and the expected SpaceX IPO make the capital-market version of the question explicit: whether investors will keep paying for scarce infrastructure, extreme scale and growth curves that may take years to prove out.

Jordi Hays · John Coogan · Dylan Field · Immad Akhund · Brian Chesky · Marcus Milione · Feross Aboukhadijeh · Tae KimTBPNMay 20, 202632 min read

Nvidia Earnings Become a Test of the AI Infrastructure Boom

Bloomberg Technology framed Nvidia’s earnings as a test of whether the company can keep turning AI infrastructure spending into growth, rather than simply whether demand remains strong. Ed Ludlow and Bloomberg reporters said investors were looking for reassurance on supply constraints, China exposure and Nvidia’s moat as workloads shift toward inference, while the same program treated SpaceX’s prospective IPO and SoftBank’s $65 billion OpenAI exposure as evidence that AI is driving larger bets across public markets, private capital and the chip supply chain.

Ed Ludlow · Maggie Eastland · Jensen Huang · Jai Malik · Paulina McPadden · Peter Elstrom · Campbell Brown · Kunjan Sobhani · Anthony Hughes · Carmen Reinicke · Rachel MetzBloomberg TechnologyMay 20, 202614 min read

Nvidia’s Upside Case No Longer Depends on China Access

Baillie Gifford investment manager Paulina McPadden argues that Nvidia’s long-term case does not depend on renewed access to China, where domestic high-power chips still trail Nvidia’s leading products by a wide margin. Speaking to Bloomberg’s Ed Ludlow, she said the more important question is whether China can recreate the complex semiconductor supply chain behind AI hardware, while identifying TSMC, SK hynix and ASML as non-US companies with durable roles in that ecosystem.

Ed Ludlow · Paulina McPaddenBloomberg TechnologyMay 20, 20266 min read

SoftBank’s $65 Billion OpenAI Bet Raises Concentration Risk

Bloomberg’s Peter Elstrom reports that Masayoshi Son has made OpenAI SoftBank’s largest single-company wager, committing more than $60 billion while selling assets and borrowing to fund it. Elstrom says the scale has raised concern inside and outside SoftBank that Son may be too dependent on Sam Altman’s company, especially as OpenAI faces strategic pressure and SoftBank lacks board-level influence or clear control over major projects such as Stargate.

Ed Ludlow · Peter ElstromBloomberg TechnologyMay 20, 20263 min read

TSMC’s Wafer Scarcity May Be Preventing an AI Overbuild

Investor Gavin Baker argues on Invest Like The Best that the AI boom is being organized less by software adoption than by scarcity: compute demand is outrunning power, wafers, and frontier-model access. In his account, Anthropic’s growth, Nvidia’s position, TSMC’s capacity discipline, and even SpaceX’s possible orbital compute are all expressions of the same constraint. Baker’s central claim is that the AI cycle may avoid a classic infrastructure bubble only if physical bottlenecks, especially leading-edge wafer supply, keep capital from building far ahead of demand.

Patrick O'Shaughnessy · Gavin BakerInvest Like The BestMay 20, 202625 min read

AI’s Value Is Shifting From Model Demos to Distribution and Measurement

Google’s problem at I/O, Jordi Hays argued, was no longer proving that its AI models are impressive, but making Gemini useful rather than redundant across products investors now increasingly view as part of a full-stack AI business. The TBPN discussion extended that framing across the rest of the show: AI’s value, the hosts and guests argued, depends less on model spectacle than on distribution, workflow integration, economics and adoption by institutions. That distinction ran from Google’s risk of crowding users with Gemini entry points to SendCutSend’s physical capacity constraints, Commure’s push to automate healthcare administration, and METR’s effort to turn frontier-model risk into something auditable.

Jordi Hays · John Coogan · Ajeya Cotra · Jim Belosic · Tanay Tandon · Aidan Dewar · Fai Nur · Philip InghelbrechtTBPNMay 19, 202631 min read

Google Turns TPU Capacity Into a Blackstone-Backed Neocloud

Bloomberg Technology’s Caroline Hyde and Ed Ludlow frame Google’s new venture with Blackstone as an attempt to turn Google’s TPU capacity into an AI cloud business outside Google Cloud. Bloomberg Intelligence’s Mandeep Singh argues the structure could help Google meet external demand for its chips by shifting more of the data-center burden to Blackstone, creating a TPU-based rival to Nvidia-centered neocloud providers.

Ed Ludlow · Caroline Hyde · Mandeep Singh · Jensen Huang · Madlin Mekelburg · Parag Agrawal · Lisa Abramowicz · Lori Beer · Michael Dell · Marta Norton · Riley Griffin · Dan Wright · Dorothy LundBloomberg TechnologyMay 19, 202614 min read

Retrofitting Sovereign AI Turns Compliance Rules Into Architecture Rework

Bilge Yücel of deepset argues that AI sovereignty is an engineering constraint that has to be designed into a system, not a legal or procurement requirement applied after deployment. She frames sovereign AI around control of data, models, infrastructure, and operations, and shows how retrofits expose hidden dependencies: jurisdiction-crossing data flows, model APIs embedded in application logic, managed services that masked operational work, and systems that cannot be traced or audited.

Bilge YücelAI EngineerMay 19, 202612 min read

AI Data Centers Face a Local Legitimacy Fight Over Power and Water

John Coogan and Jordi Hays use the day’s OpenAI verdict, Leopold Aschenbrenner’s 13F filing and fights over new data centers to argue that AI’s next constraint is political as much as technical. On Diet TBPN, they treat Musk’s loss to OpenAI as a procedural win, read Aschenbrenner’s filing as an ambiguous signal about the AI-infrastructure trade, and frame the data-center backlash as a widening legitimacy problem over power, water, land and local benefit. The clearest proposed answer they surface, via Ben Thompson, is direct payment to communities asked to host the buildout.

John Coogan · Jordi Hays · Tyler CosgroveTBPNMay 19, 202616 min read

AI Backlash Reaches Commencement as Graduates Face a Reshaped Job Market

Jason Calacanis and Alex Wilhelm argue that the boos greeting pro-AI commencement speeches are a visible sign of AI’s legitimacy problem with new graduates entering the workforce. On This Week in Startups, they frame the reaction less as technophobia than as distrust: students have already seen AI weaken academic norms, threaten entry-level work, concentrate wealth around frontier labs, and expand systems of surveillance and data capture. Their discussion returns to a central question: whether workers, founders, consumers, and citizens have any meaningful control over the AI systems now reshaping their choices.

Jason Calacanis · Alex Wilhelm · Gloria Caulfield · Eric SchmidtThis Week in StartupsMay 19, 202621 min read

AI Growth Is Running Into Power, Memory, and Inference Bottlenecks

TBPN’s discussion recast the AI boom around physical and economic bottlenecks — power, cooling, chip scarcity, inference cost and memory — rather than model ambition alone. Mike Isaac, Rowan Trollope and Dean Leitersdorf described an industry where local utilities, low-level inference optimization and fast state management are becoming central constraints, a capacity problem the hosts also saw in the whey protein shortage. Everlane’s reported sale to Shein pointed to a different limit: Hays argued that venture-backed ethical basics struggled against price pressure, brand preference and the demand for sustained growth. Joanna Stern supplied the adoption constraint, arguing from her reporting that AI’s progress will be judged through trust, job anxiety, children’s safety and whether new devices ease or deepen phone dependence.

John Coogan · Jordi Hays · Joanna Stern · Rowan Trollope · Dean Leitersdorf · Mike IsaacTBPNMay 18, 202624 min read

AI Infrastructure Demand Is Still Outrunning Dell and Nvidia’s Supply Chain

Dell Technologies chief executive Michael Dell and Nvidia chief executive Jensen Huang told Bloomberg’s Ed Ludlow that enterprise demand for local AI factories is outpacing supply even as the AI infrastructure supply chain expands rapidly. Dell argued that companies are seeking on-premises systems because AI can produce order-of-magnitude workflow gains, while Huang said the build-out is only beginning and could strain supply for at least a decade, with memory remaining a live constraint.

Ed Ludlow · Jensen Huang · Michael DellBloomberg TechnologyMay 18, 20265 min read

AI Demand Pushes Beyond Nvidia Into Power, Memory, and Compute Markets

Bloomberg Technology framed Nvidia’s earnings as a test of the wider AI infrastructure trade rather than a simple chip-demand story. Caroline Hyde, Ed Ludlow and Bloomberg Intelligence’s Mandeep Singh said investors were looking past headline growth to constraints around China access, margins, memory prices, inference workloads and supply, while a $67 billion NextEra-Dominion deal showed how the data-center boom is already reshaping power markets. The program’s broader argument was that AI demand remains strong, but the bottlenecks have moved across the physical and financial stack.

Caroline Hyde · Ed Ludlow · Carmen Li · Mark Gurman · Peter Elstrom · Richard Socher · Hema Parmar · Mandeep Singh · Norah Mulinda · Julia Love · Liana Baker · Elon Musk · Daniel RobertsBloomberg TechnologyMay 18, 202615 min read

CME and Silicon Data Plan Futures Market for AI Compute

Silicon Data CEO Carmen Li told Bloomberg Technology that AI compute is becoming a commodity market large and volatile enough to require futures and options. She said Silicon Data’s planned work with CME would create a regulated hedging layer for GPU-price exposure, using Silicon Data’s indices to normalize fragmented pricing across chip types, locations and contract terms. Li argued that banks, data centers, cloud providers and AI companies need those tools because on-demand GPU prices can swing sharply and bottlenecks keep moving across the supply chain.

Caroline Hyde · Carmen LiBloomberg TechnologyMay 18, 20266 min read

Recursive Emerges From Stealth at $4.65 Billion Valuation

Recursive CEO Richard Socher told Bloomberg that the newly disclosed startup is trying to build AI systems that can automate the research loop: proposing ideas, implementing them, testing them, and using the results to improve AI itself. The company emerged from stealth with more than $650 million raised, a $4.65 billion valuation, and backers including GV, Greycroft, Nvidia, and AMD. Socher argued Recursive’s edge is an organization built around open-ended AI experimentation, while Bloomberg’s Caroline Hyde pressed him on compute costs, safety, hiring, and why the work belongs in a separate lab.

Caroline Hyde · Richard SocherBloomberg TechnologyMay 18, 20265 min read

U.S.-China Diplomacy Can Manage Risk but Not Resolve the Systems Contest

At a Hoover Institution discussion on U.S. strategy toward China, Sarah Beran, Matt Turpin and Miles Yu argued that diplomacy with Beijing remains necessary but cannot resolve the deeper contest between the two countries. Beran framed the task as risk management through leader channels, alliances and domestic renewal; Turpin described a long hostile rivalry that will run through trade, technology and economic statecraft; and Yu said the problem is systemic incompatibility that Washington should confront more directly.

Elizabeth Economy · Sarah Beran · Robert Bloom · Miles Yu · Matt Turpin · Stanley Kober · Erin CarterHoover InstitutionMay 18, 202621 min read

The AI Hardware Boom Depends on Magnets, Memory, and Manufacturing Scale

Caitlin Kalinowski, the former Apple, Meta and OpenAI hardware leader, argues that AI’s next frontier is moving from digital work into the physical world. In Lenny Rachitsky’s interview, she says the coming hardware boom will depend less on flashy humanoid demos than on manufacturing discipline, supply chains, safety, actuators, memory, and the hard limits of building products that have to work in real environments.

Lenny Rachitsky · Caitlin KalinowskiLenny's PodcastMay 17, 202626 min read

Agentic AI Is Turning Model Quality Into a Systems Problem

At AI Engineer Singapore’s second day, speakers from Google DeepMind, Cloudflare, Arize, OpenClaw, Adaption and other teams made a shared engineering case: as AI systems become more agentic, model quality is no longer separable from the systems around the model. Richard Ngo framed the risk as long-horizon, situationally aware agents whose goals cannot be inspected, while practitioners argued that production AI now depends on continuous evaluation, traces, deterministic execution boundaries, routing, memory, fine-tuning and test-time search. The source’s central claim is that useful and safe agentic AI is becoming a systems problem, not just a model-selection problem.

Shawn Wang · Eugene Yan · Philip Vollet · Haotian Zhang · Eugene Evstafev · Jason Liu · Pratik Desai · Michelle Chen · Jason Lopatecki · Amr Ahmed · Rita Zhang · Harris Snyder · Adarsh Shah · Eric Zhang · Ricky Robinett · Linoy Bitan · Wei Sheng · Richard NgoAI EngineerMay 17, 202626 min read

AI Competition Shifts From Models to Chips, Power, and Supply Chains

Bloomberg Technology framed the latest AI race less as a contest over individual products than as a fight over infrastructure constraints, from Nvidia chip export politics and U.S. semiconductor labor to cloud spending, energy, memory and data-center capacity. Ed Ludlow, Caroline Hyde and Bloomberg reporters treated Donald Trump’s discussion of Nvidia’s H200 chips with Xi Jinping as emblematic of that shift: significant for markets, but short of any clear export deal. The program’s interviews with Goldman Sachs’ Eric Sheridan, OpenAI CFO Sarah Friar and Figma CEO Dylan Field similarly argued that compute, distribution and ownership of the stack are becoming the decisive limits on AI growth.

Ed Ludlow · Caroline Hyde · Donald Trump · Tyler Kendall · Shari Liss · Rebecca Torrence · Dylan Field · Brett Adcock · Madlin Mekelburg · Sarah Friar · Matt Day · Dana Wollman · Eric SheridanBloomberg TechnologyMay 16, 202613 min read