Open-Source Voice AI Badge Powered by ESP32+WebRTC
hi! video[0] The idea is you could carry around this hardware and ask it any questions about the conference. Who is speaking, what are they speaking about etc... it connects via WebRTC to a LLM and you get a bunch of info. This is a workshop/demo project I did for a conference. When I was talking to the organizers I mentioned that I enjoy doing hardware + WebRTC projects. They thought that was cool and so we ran with it. I have been doing these ESP32 + voice ai projects for a bit now. Started with an embedded sdk for livekit[1] that jul 2024 and been noodling with it since then. This…
Open-Source Voice AI Badge Powered by ESP32+WebRTC launched on October 9, 2025 with 48 votes, #418 of 8,178 launches that month and more than 90% of that year's launches. The site was still online in September 2026, 1 year on.
In plain words
This is a portable hardware device built on ESP32 that lets users ask voice questions about conference topics, speakers, and schedules. It connects via WebRTC to a large language model to retrieve information in real time. Designed as a workshop demonstration project, it combines microcontroller hardware with voice AI capabilities, intended for conference attendees who want quick access to event information through natural conversation.
written from the facts on this page · September 2026
From the sources
Contribute to VapiAI/vapicon-2025-hardware-workshop development by creating an account on GitHub.
# Install prerequisites (macOS) brew install cmake ninja dfu-util # Install prerequisites (Ubuntu/Debian) # sudo apt-get install git wget flex bison gperf python3 python3-venv cmake ninja-build ccache libffi-dev libssl-dev dfu-util libusb-1.0-0 # Clone ESP-IDF repository mkdir -p ~ /esp cd ~ /esp git clone -b v5.5.1 --recursive https://github.com/espressif/esp-idf.git # Install ESP-IDF tools cd ~ /esp/esp-idf ./install.sh esp32s3 # Set up environment (run this each time you open a new terminal) source ~ /esp/esp-idf/export.sh Windows # Download and run the ESP-IDF installer from: # https://dl.espressif.com/dl/esp-idf/ # Or use the ESP-IDF command prompt installed by the installer # Then…from github.com
In the maker’s words, at launch
hi! video[0] The idea is you could carry around this hardware and ask it any questions about the conference. Who is speaking, what are they speaking about etc... it connects via WebRTC to a LLM and you get a bunch of info. This is a workshop/demo project I did for a conference. When I was talking to the…
Does a similar job
all alternatives →
I open-sourced my AI toy company that runs on ESP32 and OpenAI realtime2025 · github.com · ▲177Hi HN! Last year the project I launched here got a lot of good feedback on creating speech to speech AI on the ESP32. Recently I revamped the whole stack, iterated on that feedback and made our project fully open-source—all of the client, hardware, firmware code. This Github repo turns an ESP32-S3 into a realtime AI speech companion using the OpenAI Realtime API, Arduino WebSockets, Deno Edge Functions, and a full-stack web interface. You can talk to your own custom AI character, and it responds instantly. I couldn't find a resource that helped set up a reliable, secure websocket (WSS) AI…
openai-realtime-embedded-SDK Build AI assistants on microcontrollers2024 · github.com · ▲63Hi HN! This is an SDK for ESP32s (microcontrollers) that runs against OpenAI's new WebRTC service [0] My hope is that people can easily add AI to lots of 'real' devices. Wearable devices, speakers around the house, toys etc... You don't have to write any code, just buy a device and set some env variables. If you have any feedback/questions I would love to hear! I hope this kicks off a generation of new interesting devices. If you aren't familiar with WebRTC it can do some magical things. Check out WebRTC for the Curious[1] and would love to talk about all the cool things that does also.…
Port of OpenAI's Whisper model in C/C++2022 · github.com · ▲399Hi HN, OpenAI recently released a model for automatic speech recognition called Whisper [0]. I decided to reimplement the inference of the model from scratch using C/C++. To achieve this I implemented a minimalistic tensor library in C and ported the high-level architecture of the model in C++. The entire code is less than 8000 lines of code and is contained in just 2 source files without any third-party dependencies. The Github project is here: https://github.com/ggerganov/whisper.cpp With this implementation I can very easily build and run the model - “make…
Open source framework OpenAI uses for Advanced Voice2024 · github.com · ▲266Hey HN, we've been working with OpenAI for the past few months on the new Realtime API. The goal is to give everyone access to the same stack that underpins Advanced Voice in the ChatGPT app. Under the hood it works like this: - A user's speech is captured by a LiveKit client SDK in the ChatGPT app - Their speech is streamed using WebRTC to OpenAI’s voice agent - The agent relays the speech prompt over websocket to GPT-4o - GPT-4o runs inference and streams speech packets (over websocket) back to the agent - The agent relays generated speech using WebRTC back to the user’s device The…
WhisperFusion – Low-latency conversations with an AI chatbot2024 · github.com · ▲272WhisperFusion builds upon the capabilities of open source tools WhisperLive and WhisperSpeech to provide a seamless conversations with an AI chatbot.
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 21d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 30d ago · world.pixverse.video
Source: Show HN post ↗ · launch text quoted in part
Launched alongside, October 2025
the whole month →
I went down the rabbit hole on a side project and ended up building this: Strange Attractors(https://blog.shashanktomar.com/posts/strange-attractors). It’s built with three.js. Working on it reminded me of the little "maths for fun" exercises I used to do while learning programming in early days. Just trying things out, getting fascinated and geeky, and being surprised by the results. I spent way too much time on this, but it was extreme fun. My favorite part: someone pointed me to the Simone Attractor on Threads. It is a 2D attractor and I asked GPT to extrapolate it to…
AI · Oct 2025 · blog.shashanktomar.com
Autism Simulator▲779Hey all, I built this. It’s not trying to capture every autistic experience (that’d be impossible). It’s based on my own lived experience as well as that of friends on the spectrum. I'm trying to give people a feel for what masking, decision fatigue, and burnout can look like day-to-day. That’s hard to explain in words, but easier to show through choices and stats. I'm not trying to "define autism". I’ve gotten good feedback here about resilience, meds, and difficulty tuning. I’ll keep tweaking it. If even a few people walk away thinking, "ah, maybe that’s why my coworker struggles in those…
Life & fun · 2025 · autism-simulator.vercel.app
