Jason Wei

AI researcher at Meta Superintelligence Labs. Previously at OpenAI and Google Brain, where his work helped popularize chain-of-thought prompting, instruction tuning, and emergent abilities in large language models.

OpenAI Splits Audio API Into Translation, Transcription, and Voice-Agent Models

OpenAI is presenting three new API audio models as infrastructure for voice applications that can translate, transcribe, reason and act in real time. Romain Huet’s demonstration centered on GPT-Realtime-Translate, which keeps pace with multilingual speech, and GPT-Realtime-2, a voice-agent model that can follow turn-taking instructions, use business context and call tools while explaining its work. GPT-Realtime-Whisper completes the set as a streaming speech-to-text model for live transcription.

OpenAIMay 7, 20266 min read