Orply.
Topic

Image and Video Generation

Generative image and video models, editing tools, creative workflows, media production, synthetic content, and visual AI product launches.

Useful AI Systems Are Emerging Inside Controlled Enterprise Workflows

TBPN’s latest discussion framed the commercial AI moment less as a race to looser autonomy than as a shift toward bounded systems. Across Microsoft’s Build announcements, Suno’s funding, creator films, stablecoins, crypto markets, cybersecurity, and workflow software, the central argument was that AI becomes useful when it is embedded in infrastructure that can price, route, audit, secure, or constrain it. John Coogan and guests applied that lens most directly to Microsoft’s agent strategy, where Azure and Microsoft 365, not a new phone, become the controlled operating environment for enterprise agents.

John Coogan · Jordi Hays · Mikey Shulman · Nikesh Arora · Satya Nadella · Alex Good · Eric Glyman · Samir Chaudry · Henri Stern · Alex Heath · Tom Farley · Martin ScorseseTBPNJun 3, 202633 min read

NVIDIA Frames Cosmos 3 as Compute-Generated Data for Physical AI

NVIDIA presents Cosmos 3 as an open foundation model for physical AI, built to address what it frames as a data-scaling problem in robotics, autonomous vehicles and other systems that operate in the physical world. The company argues that real-world data cannot capture enough variability on its own, so compute must generate usable training and evaluation signals: synthetic video, predicted sensor outputs, simulation loops and action plans. Cosmos 3 is positioned as a post-trainable mixture-of-transformers system that combines multimodal reasoning with generation to support perception, prediction, simulation and action.

NVIDIAJun 2, 20265 min read

RTX Spark Agent Moves Architectural Designs From Brief to Photoreal Render

NVIDIA’s RTX Spark demonstration argues that an architectural AI agent is most useful as a workflow operator, not as a standalone design tool. Running locally on RTX Spark and connected to tools including Rhino, Blender, ComfyUI, OpenShell and Claude Sonnet, the agent turns a residential brief into massing options, editable layouts, validated geometry and photoreal renders. NVIDIA frames the speedup as orchestration across existing applications, with the designer still approving directions, resolving tradeoffs and controlling materials and shots.

NVIDIAJun 2, 20265 min read

YouTube Is Becoming Hollywood’s Talent Market and IP Proving Ground

TBPN’s John Coogan and Jordi Hays argue that YouTube is moving from Hollywood competitor to Hollywood’s talent market, where creator-led films prove creative judgment, production ability and audience response before studio capital arrives. The episode extends that pattern to AI policy, software and prediction markets: established institutions are trying to absorb signals formed outside their usual channels, from internet-proven filmmakers and frontier AI labs to traders and startups testing demand before regulators, studios or public markets have settled their response.

Jordi Hays · John Coogan · Marc Benioff · Nico Ferreyra · Mike Schroepfer · Graham Stephan · Bernie Su · Sue Khim · Scott Trinkham · Adam Iscoe · Jason Oppenheim · Danial Jameel · Tyler BohallTBPNJun 1, 202627 min read

Open Image Models Converge on Flow Matching and DiT Architectures

Stanford adjunct lecturer Shervine Amidi uses Lecture 8 of CME296 to argue that modern visual generation is best understood as a stack of choices for transporting noise into data: the paradigm, representation, architecture, training procedure, and evaluation method. He presents flow matching as the current default for image-generation systems, diffusion transformers as the dominant architectural direction, and latent spaces as a practical compression tradeoff now being challenged by scaled pixel-space models.

Shervine AmidiStanford OnlineJun 1, 202623 min read

NVIDIA Positions RTX Spark as a 128 GB Local AI Workstation

NVIDIA’s Computex preview positioned RTX Spark as a compact Windows platform for local AI, creative production and RTX gaming, built around a new superchip pairing a Blackwell RTX GPU with a Grace CPU. Jacob Freeman and other NVIDIA presenters argued that its 128 GB of unified memory and RTX acceleration allow slim laptops and small desktops to run larger local agents, handle heavy creative scenes and support modern ray-traced games with DLSS 4.5.

Gerardo Delgado · Joel Pennington · Jacob FreemanNVIDIAJun 1, 20265 min read

State-of-the-Art AI Models Are a Pareto Frontier, Not a Ranking

Bertrand Charpentier, cofounder and chief scientist at Pruna AI, argues that state-of-the-art image generation should not be defined by a single leaderboard rank. Using Design Arena-style evaluation as his example, he says a slow top model can require 20 days of compute, about $5,300 and 556 kWh to evaluate, while a fast compressed model can run the same test in 7 hours for $265. His broader case is that model selection should be based on a Pareto frontier of quality, latency, cost and energy, not a podium that treats efficiency as secondary.

Bertrand CharpentierAI EngineerJun 1, 202611 min read

Language Models Are Becoming the Bottleneck in Video Generation

Ethan He, who worked on NVIDIA’s Cosmos world model and xAI’s Grok Imagine, argues that the next major gains in video generation will come less from diffusion models alone than from language models, agents, and context management around them. In an interview with swyx and Vibhu Sapra, He describes Grok Imagine as a fast-built example of that shift: diffusion renders pixels, while language systems increasingly rewrite prompts, plan clips, call tools, manage memory, and turn short generations into longer, editable video.

Shawn Wang · Vibhu Sapra · Ethan HeLatent SpaceJun 1, 202628 min read

Loblaw Says AI Now Generates 46.9% of Its Code

Lauren Steinberg, Loblaw’s chief digital officer, argues that OpenAI tools are already changing both employee work and customer-facing retail flows at Canada’s largest retailer. She says ChatGPT Enterprise is available to every Loblaw colleague, Codex is contributing to internal code-generation and pull-request-linked productivity gains, and ChatGPT-powered PC Express can move a shopper from a dinner question to a local, priced basket. The case is supported by Loblaw’s own on-screen examples and internal data, rather than an independent audit.

Lauren SteinbergOpenAIMay 29, 20265 min read

AI Photo Analysis Is Moving From Skin Care to Cosmetic Advice

George Mack, Nirav Savjani, Tim Ferriss and Chris Williamson argue that image-capable AI is moving from practical skin-care triage into cosmetic judgment. Mack says Gemini identified a fungal skin treatment that years of doctors and lifestyle changes had missed; Savjani says the same photo-upload pattern is now driving looksmaxing tools that recommend facial changes, procedures and appearance edits. The discussion turns on a boundary the speakers see becoming harder to police: when AI advises what to do to a face, it can also normalize a version of that face that no longer matches reality.

Chris Williamson · Nirav Savjani · George Mack · Tim FerrissChris WilliamsonMay 29, 20267 min read

Text-to-Image Evaluation Requires Metrics Matched to Specific Failure Modes

Stanford adjunct lecturers Afshine Amidi and Shervine Amidi argue that evaluating text-to-image models starts with separating aesthetic quality from prompt adherence, then choosing metrics suited to the failure being tested. In Lecture 7 of Stanford’s CME296 course on diffusion and large vision models, they treat human ratings, FID, CLIPScore, reference-based measures, multimodal judges, and benchmarks as imperfect instruments rather than substitutes for a universal image-quality score. Their central warning is practical: automated and qualitative evaluations can be useful, but only when their assumptions, calibration, and failure modes are made explicit.

Shervine AmidiStanford OnlineMay 28, 202619 min read

Meta Flow Maps Cut Reward-Alignment Costs With One-Step Posterior Sampling

Peter Potaptchik presents Meta Flow Maps as an amortized way to remove a costly inner loop in reward-aligning generative models: repeatedly simulating trajectories to estimate expected future reward from a noisy state. The method trains stochastic flow maps to produce differentiable, one-step samples from the clean-data posterior conditioned on any time and noisy state, enabling value-gradient estimates for inference-time steering and an off-policy objective for fine-tuning. In ImageNet experiments, Potaptchik argues, this lets a single-particle steered sampler outperform Best-of-1000 baselines across several rewards with far less compute.

Peter PotaptchikMicrosoft ResearchMay 26, 202616 min read

Diffusion Models Generate Images Through Critical Instability Windows

Luca Ambrogioni argues that trained diffusion models generate images through brief instability windows rather than uniform step-by-step denoising. In a Microsoft Research generative modeling seminar, he links score dynamics, conditional entropy and statistical-physics phase transitions to show how low-frequency spatial modes soften at critical times, allowing noise to organize into coherent structure. Experiments on patch models, Fashion-MNIST and ImageNet models are presented as evidence that these critical windows govern both pattern formation and the timing of effective guidance.

Carles Domingo-Enrich · Sasank Edara · Luca AmbrogioniMicrosoft ResearchMay 26, 202617 min read

Wavelet Score Models Show Local Interactions Drive Diffusion Denoising

Emma Finn argues that the memorization puzzle in diffusion models can be probed by replacing a black-box score network with an analytically solvable wavelet parameterization. In her Microsoft Research New England seminar, Finn presents the method as a way to isolate which data moments and dependency structures matter across noise scales. Her reported experiments on MNIST suggest that local same-scale wavelet interactions improve denoising more consistently than independent coefficient models or orientation-only coupling, while the larger question of whether the framework explains generative novelty remains unresolved.

Emma FinnMicrosoft ResearchMay 26, 202612 min read

Synthetic Intimacy, Surveillance, and Stimulation Are Raising the Cost of Impulse

Chris Williamson’s inaugural Mostly Wise conversation with Andrew Huberman, Matt McCusker and Tom Segura uses health advice, comedy, AI replicas and conspiracy talk to examine where useful tools become distortions. Huberman repeatedly argues for moderation and mechanism over slogans — from low-dose tadalafil and sleep protocols to cannabis, sunscreen and self-control — while Segura and McCusker test those claims against comedy, parenting and lived experience. The broader case is that modern life increasingly requires judgment about thresholds: when optimization becomes rumination, evidence becomes pattern-seeking, and synthetic intimacy or surveillance starts to reshape ordinary behavior.

Chris Williamson · Matt McCusker · Andrew Huberman · Tom SeguraChris WilliamsonMay 25, 202635 min read

Google’s GenAI Stack Turns Multimodal Prompts Into Application Pipelines

Google DeepMind’s Paige Bailey and Guillaume Vernade argue that Google’s generative AI stack is being organized as an application pipeline rather than a set of isolated models. In a three-hour workshop, Bailey showed AI Studio turning multimodal Gemini prompts into inspectable API calls and generated apps with auth and Firestore, while Vernade used Gemini, Nano Banana, Veo and Lyria to illustrate, animate and score The Wind in the Willows. Their case is that builders can now orchestrate prompt, code, media generation and deployment in one workflow, even as the demos exposed seams that still require engineering discipline.

Paige Bailey · Guillaume Vernade · Ian ValentineAI EngineerMay 23, 202623 min read

AI’s Bottlenecks Shift From Model Demos to Compute, Rights, and Institutions

AI, in TBPN’s latest discussion, is no longer treated mainly as a product demo but as a question of infrastructure, financing and institutional adoption. The strongest evidence came from SpaceX’s AI-heavy IPO framing, Anthropic’s reported move toward operating profit, and OpenAI’s claimed Erdős breakthrough, which the speakers used to challenge the “AI is a scam” critique. The unresolved issue is not whether the technology matters, but how quickly compute capacity, rights regimes, regulation and existing institutions can absorb it.

John Coogan · Jordi Hays · Tyler Cosgrove · Alex Tabarrok · Bill Clerico · Christina Storm · Erik Bernhardsson · Alex Norström · Jordan SchneiderTBPNMay 21, 202627 min read

Google’s AI Strategy Emphasizes Scale Over Frontier Model Leadership

Kevin Roose and Casey Newton read Google’s I/O announcements as evidence of a company that has regained operational confidence in AI without yet proving frontier leadership. Roose argues Google is leaning on speed, cost, distribution and infrastructure — putting capable models across search, coding, video and cloud tools at enormous scale. Newton is more skeptical: fast and cheap, he says, is not the same as best, and many of Google’s most important product claims remain untested until users can rely on them in real workflows.

Kevin Roose · Casey Newton · Demis HassabisHard ForkMay 21, 20267 min read

Gemini Omni Flash Replaces Veo as Google’s Default Video Model

ElevenLabs’ breakdown of Google’s I/O 2026 launch presents Gemini Omni as a major reset of Google’s AI video stack, with Omni Flash already replacing Veo as the default video model in the Gemini app. The source argues that the significance is not just better text-to-video generation, but a shift toward multimodal, conversational video creation: users can combine text, images, audio, video, and reference photos, then revise clips through successive instructions while preserving characters and scenes.

ElevenLabsMay 21, 20266 min read

Google’s I/O Pitch Put Distribution Ahead of Model Breakthroughs

John Coogan and Jordi Hays read Google I/O as a mixed signal: Google’s smart-glasses strategy looks stronger where it combines Gemini with eyewear distribution and Google’s own services, but its model launches exposed the risk of tying AI progress to a fixed conference calendar. On TBPN, they argued that Street View may be an underappreciated AI training asset and that AI video still has to move from impressive short clips to coherent long-form outputs. The episode also framed a potential SpaceX IPO and Nvidia’s latest results as evidence that the financial returns from space and AI infrastructure are already arriving at exceptional scale.

John Coogan · Jordi Hays · Tyler Cosgrove · Steve WozniakTBPNMay 21, 202614 min read

Google’s AI Assets Are Becoming a Product Coherence Problem

John Coogan and Jordi Hays read Google’s I/O as evidence that the company’s AI advantage is becoming a product-navigation problem: it has data, distribution, models and hardware partnerships, but its demos and product names left questions about coherence and pace. Across the source, that same pressure appears in more operational forms, as AI pushes companies to turn technical capability into usable workflows, secure software dependencies and faster product systems. Tae Kim’s Nvidia argument and the expected SpaceX IPO make the capital-market version of the question explicit: whether investors will keep paying for scarce infrastructure, extreme scale and growth curves that may take years to prove out.

Jordi Hays · John Coogan · Dylan Field · Immad Akhund · Brian Chesky · Marcus Milione · Feross Aboukhadijeh · Tae KimTBPNMay 20, 202632 min read

Any-to-Any Agents Rely on Orchestrated Multimodal Models, Not One Network

Google DeepMind’s Patrick Löber presents “any-to-any” agents as an orchestration problem rather than a claim that one model already handles every modality. In his architecture, Gemini reads and reasons across PDFs, images, audio, video and other sources, then uses function calling to invoke specialized native models for images, speech, live audio, video or embeddings. Löber argues that the useful shift is not generating every possible format, but letting an agent decide when a diagram, spoken explanation or other output is warranted.

Patrick LoeberAI EngineerMay 20, 202610 min read

Gemini’s Strategy Shifts From Frontier Leaderboards to Deployable AI Infrastructure

Google DeepMind executives Tulsee Doshi and Logan Kilpatrick argue that Google’s current Gemini strategy is built less around a single frontier model than around a deployable AI stack. In their account, Gemini 3.5 Flash, the Anti-Gravity agent harness and new multimodal products such as Omni are meant to make models fast, cheap and integrated enough to run across Search, the Gemini app, AI Studio, YouTube and enterprise tools. The deeper shift, Kilpatrick says, is that the model is increasingly absorbing the scaffolding that once surrounded it, while Google standardizes the remaining agent infrastructure across its products.

Nathan Labenz · Logan Kilpatrick · Tulsee DoshiThe Cognitive RevolutionMay 20, 202619 min read

Google’s AI Repricing Turns on Product Restraint and Developer Adoption

John Coogan and Jordi Hays use Google I/O to argue that Alphabet is being repriced less as a search incumbent threatened by AI than as a full-stack AI company, though they say Google still has to prove it can turn models such as Gemini Omni and Flash into useful products without cluttering every surface. The Diet TBPN episode also treats distribution as the common pressure point behind several unrelated fights: whether smartphones help explain the timing of global fertility decline, why a small Spotify icon change provoked backlash, and whether podcasts or childcare are eroding the market for serious nonfiction.

John Coogan · Jordi HaysTBPNMay 20, 202615 min read