Voice and Audio AI
Speech recognition, voice agents, text-to-speech, audio generation, dubbing, call automation, and voice-first AI interfaces.
GPT-6 Astra Extends Higgsfield’s AI Videos From One Minute to Over 10
Higgsfield says GPT-6 Astra has extended the videos it can generate from around one minute to more than 10, addressing what founder Alex Mashrabov calls one of creative AI’s hardest problems: maintaining consistency over longer work. He presents the gain as part of a broader effort to help smaller teams make more ambitious projects, alongside tools for producing images with readable text and working through 3D revisions.
India’s Language Diversity Makes Human-Like Voice AI a Product Challenge
ElevenLabs co-founder and CEO Mati Staniszewski argues that the central challenge for voice AI is not just intelligence but the ability to interact naturally with people. In his keynote at the ElevenLabs Summit in Bengaluru, he points to India’s many languages and dialects as a demanding test of that capability—and a place to develop it. He presents the company’s speech and agent tools as attempts to meet that challenge, while emphasizing that deploying them in industries such as healthcare and government requires work tailored to each setting.
AI-RAN Puts Network Functions and AI Services on Shared Infrastructure
Nokia and NVIDIA argue that telecom operators can turn network infrastructure into a shared platform for radio access and AI workloads, creating a path from programmable 5G toward 6G. Their AI-RAN collaboration pairs Nokia software with NVIDIA accelerated computing; the companies say it can improve network performance, support AI services at the network edge and help automate network operations.
ChatGPT Voice Lets Users Interrupt, Revise Requests, and Resume Conversations
OpenAI presents the new ChatGPT Voice, powered by GPT Live, as a more fluid way to talk with an assistant: users can interrupt it, add requests before it answers, and revise what they want translated. Its demonstrations show those interactions in a word puzzle, travel planning and a Spanish message. They illustrate conversational flexibility, but do not establish how accurately or reliably the system performs beyond the scripted exchanges.
ChatGPT Voice Soll Ergänzungen Während Des Sprechens Aufnehmen
OpenAI presents the new ChatGPT Voice as a system that can listen while speaking and respond to interruptions without waiting for a clean handoff between speakers. Its demonstration argues that this lets users add or correct instructions mid-request, move between tasks and continue a conversation without starting over. Several examples stop at a promise or planning step, however, rather than showing a completed result.
Build an AI Ad Around a Jingle That People Remember
ElevenLabs’ tutorial argues that the jingle should be settled before an AI-made ad’s visuals, because the product, music and edit need to work as one piece. It demonstrates a five-step workflow using a fictional chocolate bar: develop a simple product concept, write and choose a roughly 30-second jingle, create consistent product references, animate storyboard images and cut the clips to the music. The company also presents The Search, a competition that scores catchiness most heavily and offers $100,000 in prizes.
Eleven v4 Turbo Brings ~100-Millisecond Voice Responses to ElevenAgents
ElevenLabs says its v4 Turbo voice model, now available in ElevenAgents, combines a median inference latency of about 100 milliseconds with a wider emotional range and improved reliability on long calls. The company argues that those capabilities can help agents respond to sensitive customer needs with practical next steps, not just sympathetic language, while supporting conversations in more than 90 languages. Its demonstrations show agents offering a service-outage workaround, gathering details about a damaged order and presenting options for a parking citation.
Eleven v4 Adds Inline Direction for More Expressive Speech
ElevenLabs presents v4 as a text-to-speech model that makes delivery part of the prompt: inline tags can direct emotion, pacing, reactions and style, shaping how the words are performed. The company says the model is also designed to preserve speaker identity across long-form narration, dialogue and regenerated lines. For live applications such as agents, ElevenLabs positions v4 Turbo as the low-latency option, with a reported median inference latency of about 100 milliseconds.
ChatGPT Voice Adds Connected-Service Actions and Voice-Driven Work Creation
OpenAI is positioning ChatGPT Voice as a way to act on connected services and create or revise work through spoken requests. Its launch description says Voice can use plugins such as email, calendar and Slack, and that ChatGPT Work users can make documents, decks, sites and spreadsheets on web and mobile. The examples include checking for duplicate charges, contacting a marina and building a pottery storefront; the source presents these as demonstrations, not evidence that every task is completed end to end.
Natural Voice Agents Must Balance Latency, Intelligence, and Cost
Boson AI co-founder and chief executive Alex Smola argues that voice agents will not become useful simply by producing accurate speech: they must respond, pause, handle interruptions and use tools at the pace and emotional register of human conversation. That makes latency, audio representation and inference cost product constraints rather than back-end engineering details, he says. As systems add vision and avatar-like presence, Smola contends, they will need to manage those trade-offs while learning when and how to adapt to individual users.
Full-Duplex Voice Agents Must Separate Conversation From Reasoning
Neil Zeghidour, co-founder and CEO of Gradium, argues that most real-time voice agents remain “walkie-talkies”: however quickly they respond, they can only listen or speak, not handle the overlapping signals that make human conversation work. Full-duplex speech models can represent simultaneous talk and backchanneling, he says, but they still sacrifice reasoning and tool-use capability relative to text-based agents. His proposed answer is a split architecture in which a lightweight speech model manages the live conversation while a separate text model handles harder reasoning and actions.
Claude Turns Product Links Into Editable AI Ad Workflows
ElevenLabs presents its MCP for Claude as a way to manage AI ad production through chat while retaining access to the underlying ElevenCreative Flows workflow. In a tutorial demonstrated by Alec Wilcock, users can start with a product link, approve stills and voice takes, revise motion or narration, and reformat a finished ad, while Flows exposes the separate image, video, voice and composition steps. The process still depends on user decisions—and on manual product details when a linked page cannot be retrieved.
Voice Agents Should Act Through Interfaces, Not Just Speak
OpenAI developer-experience lead Charlie Guo argues that voice agents should not be designed to answer every spoken request with speech. The underused model, he says, is speech to action: a user states an intent, the system calls tools and changes the interface or completes a workflow, using audio only where conversation, hands-free operation or escalation warrants it. For developers, Guo’s practical case is that many of those tools already exist as application endpoints, handlers and workflows.
GPT-Live-1 Separates Live Voice From Agent Reasoning
OpenAI has released GPT-Live-1 in its API as a full-duplex voice frontend designed to keep spoken interactions moving through interruptions and background noise. The company positions the model as one layer of a broader application architecture: GPT-Live-1 handles live conversation, while a separately chosen backend provides reasoning, tool use and actions. Its listed price of 5 cents per minute applies only to that voice layer, not to backend inference or tool services.
MiniMax H3 Unifies Video, Image, and Audio References in One Generation
MiniMax argues that video generation’s separate tools for motion, subjects, frames and audio can be consolidated into H3, a model that takes text, image, video and audio references in a single generation. Presented by ElevenLabs in its ElevenCreative platform, H3 produces five- to 15-second clips with generated audio, timecoded multi-shot prompts and a 2K regeneration pass that retains the original instructions and references. H3 Max, built by fal from MiniMax’s published weights, trades that 2K option for a claimed roughly three-second generation time for a five-second 768p clip.
Apple Cuts Vision Pro Teams to Expand Siri AI Infrastructure
Apple is cutting more than 200 jobs across Vision Pro, Siri and Intelligent Systems Experiences as it redirects resources toward AI, Bloomberg’s Mark Gurman reports. He characterizes the Vision Pro reductions as a conventional retrenchment—including the elimination of its gaming-initiatives team and less in-house immersive-video production—while the software cuts are intended to make room for engineers building Siri’s new AI infrastructure, voice assistant and upgraded Apple Intelligence.
ElevenLabs Adds Agent Monitoring and Context-Preserving Voice Tools
ElevenLabs’ monthly changelog argues that its latest releases are less about adding generation models than about making AI voice workflows more controllable in production. The company has introduced Spotlight to identify recurring problems in live agent conversations, Character Casting and consistent vocals to standardize creative choices, and API updates intended to preserve performance in dubbing and structure in real-time transcription.
ElevenLabs Launches Realtime Voice Model With Audio Tags in 70+ Languages
ElevenLabs says its generally available Eleven v3 Conversational model is built for realtime voice applications where delivery is part of the response, not merely a rendering of text. The company pitches audio tags for fine-grained expressive control, consistent streaming quality, and support for more than 70 languages, positioning the model for support agents, assistants and interactive characters that need to convey reassurance, urgency or tension as an exchange unfolds. ElevenLabs offers it through ElevenAgents and its API from $0.05 per 1,000 characters, with lower rates at scale.
FLUX 3 Launches Multimodal Video Generation With Native Audio
Black Forest Labs presents FLUX 3 as its first video model, trained jointly on images, video and audio to generate up to 20-second clips with dialogue, sound effects and ambience created alongside the frames. The source argues that its Self-Flow training approach improves semantic understanding without a separate vision model, underpinning claimed gains in motion, faces, hands and in-scene text. It positions video continuation and low-cost Draft mode as the most practical workflow features, while noting that the preview release lacks editing and reference support.
Character Reference Sheets Make AI Film Workflows Reusable
ElevenLabs’ Alec Wilcock argues that AI short films should be built around continuity rather than motion: establish the character, visual style and composition in still images before spending credits on video. His *Little Wanderer* workflow uses a reusable character reference sheet, narration-led story beats, and start and end frames to constrain each shot, then assembles and trims the results in Studio. The node-based Flows canvas, he says, makes the project reusable by allowing an upstream character change to regenerate the same film structure with a new protagonist.
Durable Agency Depends on Options, Attention, Relationships, and Exercise
Tim Ferriss argues that rapid technological change and personal uncertainty call less for constant reinvention than for durable agency: expanding one’s options, testing assumptions with reversible experiments, and protecting attention, relationships, and physical capacity. In this Q&A, the author and investor identifies learning, communication, negotiation, and close in-person relationships as skills that remain valuable alongside AI, while making the case that sustainable work and health depend on repeatable practices rather than maximal optimization.
New Transcription Models Separate Batch Processing From Live Speech
OpenAI introduces gpt-transcribe for completed audio files and gpt-live-transcribe for streaming speech, arguing that the choice depends on when an application needs the text rather than on a general performance hierarchy. The company says both models support 57 languages and can be guided with custom vocabulary and language hints, while handling accents, multilingual speech, names, numbers and background noise. It positions the batch model for recordings that feed search, summaries and follow-on workflows, and the live model for captions, dictation and voice interfaces.
Apple Prepares Siri AI Smart-Home Hub for Fall
Apple is preparing a smart-home hub with a roughly seven-inch display that would put Siri AI at the centre of voice control, video calls and connected-device management, Bloomberg’s Dana Wollman reports. Wollman says Apple delayed its entry into the category while its software teams caught up on AI, but now expects the company to unveil new home devices this fall. The reported hub would target the shared household-screen role established by Amazon Echo and Google Nest products.
RAM, Not Compute, Is Constraining Edge AI Deployment
Cormac Brick of Google AI Edge argues that RAM—not compute—is becoming the binding constraint on local AI, forcing developers to fit models within the memory budgets of phones, robots and low-cost devices. Models in the one-to-four-billion-parameter range can support prompt-based features on better-equipped hardware, he says, but broader deployment requires 50-million-to-500-million-parameter models fine-tuned for specific tasks. The trade is less generality for faster, cheaper offline capabilities such as voice control and dictation.