Open source framework OpenAI uses for Advanced Voice
Hey HN, we've been working with OpenAI for the past few months on the new Realtime API. The goal is to give everyone access to the same stack that underpins Advanced Voice in the ChatGPT app. Under the hood it works like this: - A user's speech is captured by a LiveKit client SDK in the ChatGPT app - Their speech is streamed using WebRTC to OpenAI’s voice agent - The agent relays the speech prompt over websocket to GPT-4o - GPT-4o runs inference and streams speech packets (over websocket) back to the agent - The agent relays generated speech using WebRTC back to the user’s device The…
Open source framework OpenAI uses for Advanced Voice launched on October 4, 2024 with 266 votes, #150 of 5,185 launches that month and more than 95% of that year's launches. The site was still online in September 2026, 2 years on.
In plain words
This open source framework powers the voice agent infrastructure that OpenAI uses for Advanced Voice in ChatGPT. It handles the backend logic for converting WebRTC streams to WebSocket connections, enabling real-time voice conversations with GPT-4o. The framework includes function calling capabilities and manages speech capture, relay, and response generation. It is designed for developers building voice-enabled AI applications who want to use the same architecture underlying ChatGPT's voice features.
written from the facts on this page · September 2026
From the sources
A framework for building realtime voice AI agents 🤖🎙️📹 - GitHub - livekit/agents: A framework for building realtime voice AI agents 🤖🎙️📹
In the maker’s words, at launch
Hey HN, we've been working with OpenAI for the past few months on the new Realtime API. The goal is to give everyone access to the same stack that underpins Advanced Voice in the ChatGPT app. Under the hood it works like this: - A user's speech is captured by a LiveKit client SDK in the ChatGPT app - Their speech is…
Does a similar job
all alternatives →
gpt-realtime-1.5 by OpenAIFeb 2026 · developers.openai.com · ▲304Tighter instruction adherence in speech agents
YakGPT – A locally running, hands-free ChatGPT UI2023 · yakgpt.vercel.app · ▲287Greetings! YakGPT is a simple, frontend-only, ChatGPT UI you can use to either chat normally, or, more excitingly, use your mic + OpenAI's Whisper API to chat hands-free. Some features: * A few fun characters pre-installed * No tracking or analytics, OpenAI is the only thing it calls out to * Optimized for mobile use via hands-free mode and cross-platform compressed audio recording * Your API key and chat history are stored in browser local storage only * Open-source, you can either use the deployed version at Vercel, or run it locally Planned features: * Integrate Eleven Labs & other TTS…
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 20d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 28d ago · world.pixverse.video
Source: Show HN post ↗ · launch text quoted in part
Launched alongside, October 2024
the whole month →
bolt.new▲1,230Build and scale high-performing websites & apps using your words. Join millions and start building today.
AI · 2024 · bolt.new
Softr for Notion▲923Turn Notion databases into portals & apps with no code
Dev tools · 2024 · softr.io
One inbox for all your work discussions
Work · 2024 · generalcollaboration.com