openai-realtime-embedded-SDK Build AI assistants on microcontrollers
Hi HN! This is an SDK for ESP32s (microcontrollers) that runs against OpenAI's new WebRTC service [0] My hope is that people can easily add AI to lots of 'real' devices. Wearable devices, speakers around the house, toys etc... You don't have to write any code, just buy a device and set some env variables. If you have any feedback/questions I would love to hear! I hope this kicks off a generation of new interesting devices. If you aren't familiar with WebRTC it can do some magical things. Check out WebRTC for the Curious[1] and would love to talk about all the cool things that does also.…
openai-realtime-embedded-SDK Build AI assistants on microcontrollers launched on December 18, 2024 with 63 votes, #451 of 5,365 launches that month and more than 90% of that year's launches. The site was still online in September 2026, 1 year on.
In plain words
The openai-realtime-embedded-SDK is a software package that enables developers to add AI capabilities to ESP32 microcontrollers using OpenAI's WebRTC service. It targets creators building internet-connected devices like wearables, smart speakers, and toys. The SDK requires minimal coding—users can set environment variables without writing code. It uses WebRTC technology to handle real-time communication between the microcontroller and OpenAI's AI services.
written from the facts on this page · September 2026
From the sources
Instructions on how to use the Realtime API on Microcontrollers and Embedded Platforms - openai/openai-realtime-embedded
This repo contains links to use the OpenAI Realtime API with WebRTC on different embedded platforms. The original implementation of the OpenAI Embedded SDK is still available on the esp32from github.com
In the maker’s words, at launch
Hi HN! This is an SDK for ESP32s (microcontrollers) that runs against OpenAI's new WebRTC service [0] My hope is that people can easily add AI to lots of 'real' devices. Wearable devices, speakers around the house, toys etc... You don't have to write any code, just buy a device and set some env variables. If you have…
Does a similar job
all alternatives →
I open-sourced my AI toy company that runs on ESP32 and OpenAI realtime2025 · github.com · ▲177Hi HN! Last year the project I launched here got a lot of good feedback on creating speech to speech AI on the ESP32. Recently I revamped the whole stack, iterated on that feedback and made our project fully open-source—all of the client, hardware, firmware code. This Github repo turns an ESP32-S3 into a realtime AI speech companion using the OpenAI Realtime API, Arduino WebSockets, Deno Edge Functions, and a full-stack web interface. You can talk to your own custom AI character, and it responds instantly. I couldn't find a resource that helped set up a reliable, secure websocket (WSS) AI…
Open-Source Voice AI Badge Powered by ESP32+WebRTC2025 · github.com · ▲48hi! video[0] The idea is you could carry around this hardware and ask it any questions about the conference. Who is speaking, what are they speaking about etc... it connects via WebRTC to a LLM and you get a bunch of info. This is a workshop/demo project I did for a conference. When I was talking to the organizers I mentioned that I enjoy doing hardware + WebRTC projects. They thought that was cool and so we ran with it. I have been doing these ESP32 + voice ai projects for a bit now. Started with an embedded sdk for livekit[1] that jul 2024 and been noodling with it since then. This…
Pure C WebRTC implementation for embedded devices2020 · github.com · ▲251Amazon Kinesis Video Streams Webrtc SDK is for developers to install and customize realtime communication between devices and enable secure streaming of video, audio to Kinesis Video Streams. - awslabs/amazon-kinesis-video-streams-webrtc-sdk-c
OpenAI/reflect – Physical AI Assistant that illuminates your life2025 · github.com · ▲92I have been working on making WebRTC + Embedded Devices easier for a few years. This is a hackathon project that pulled some of that together. I hope others build on it/it inspires them to play with hardware. I worked on it with two other people and I had a lot of fun with some of the ideas that came out of it. * Extendable/hackable - I tried to keep the code as simple as possible so others can fork/modify easily. * Communicate with light. With function calling it changes the light bulb, so it can match your mood or feelings. * Populate info from clients you control. I wanted…
- LHLearn how WebRTC actually works. A book on the protocols, not just APIs2020 · webrtcforthecurious.com · ▲667
WebRTC For The Curious # Introduction # WebRTC For The Curious is an open-source book created by WebRTC implementers to share their hard-earned knowledge with the world. It’s written for those who are always looking for more and don’t settle for abstraction. Key features # Focus on protocols and API
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 21d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 30d ago · world.pixverse.video
Source: Show HN post ↗ · launch text quoted in part
