OSS voice based conversational API with <1sec latency and other nuances
Hi Hackernews, we're Maitreya, Prateek and Marmik. Over the past few months we've been working on building a platform to build, scale and monitor voice based LLM applications. Demo (https://www.youtube.com/watch?v=OSrOmyR7oQs) 1⃣ Open Source orchestration: We're open-sourcing our orchestration to quickly setup and create LLM based voice driven conversational applications https://github.com/bolna-ai/bolna/ 2⃣ Hosted API Platform: Exposing our managed solution via APIs to build voice driven applications…
What it does
In the maker’s words, at launch
Hi Hackernews, we're Maitreya, Prateek and Marmik. Over the past few months we've been working on building a platform to build, scale and monitor voice based LLM applications. Demo (https://www.youtube.com/watch?v=OSrOmyR7oQs) 1⃣ Open Source orchestration: We're open-sourcing our orchestration to quickly setup and create LLM based voice driven conversational applications https://github.com/bolna-ai/bolna/ 2⃣ Hosted API Platform: Exposing our managed solution via APIs to build voice driven applications https://docs.bolna.dev/api-reference/introduction 3⃣ Normal LLM telemetry tools won't work in giving visibility for audio bytes in and out of the system across multiple models. So, we've build our own observability layer fully integrated with the dashboard as well. 4⃣ 3 different modes for creating agents - Lite (Intent classification based) (useful for basic calls and really pocket friendly). Normal (<2sec latency but only one llm call means it's cheaper than nitro), Nitro (<1sec latency and but multiple llm calls means really expensive) 5⃣ Follow up tasks like webhook integration, summarisation, and extraction. 6⃣ Modular and extensible architecture, which means connecting two different llms yet parallel paths(for example code and english to automate leetcode screening interviews) is really easy, albeit you'll initially need some hacking until we're able to release that to both hosted and open source versions) Over the next weeks we'd be doing a lot of small releases here starting with a hindi SLM for lead qualification and sales within next 10 days. We'd love to welcome you guys to our community, give us feedback and together build "langchain for voice first AI applications".
Pricing, as stated on its site
Free tier, paid plans from $0.06/mo — Pay-as-you-go credits ($10-$5000 minimum), Pilot plan at $0.06/min (6¢/min), Enterprise custom pricing. Free $5 credit on signup.
checked September 2026 · prices change
Does the same job
all alternatives →
- PGProduction grade end to end open source stack for Voice AI2024 · github.com · ▲5
we have been building an open source orchestration which enables you to plug in your own TTS/ASR/LLM for end-to-end voice conversations at -> https://github.com/bolna-ai/bolna. Few days back, was having a discussion here in HN about the possibilities of having a complete open source stack for ASR+LLM+TTS. Today, we are releasing a complete open sourced Dockerized stack by merging Bolna with Whisper ASR, Llama3 and Melo TTS.
- BBBolna – build and ship enterprise grade voice AI in minutes2024 · github.com · ▲5
Hi Hacker News! This is Maitreya, Marmik and Prateek, co-founders of Bolna (https://github.com/bolna-ai/bolna). With Bolna, developers can create end-to-end conversational voice agents. They can connect to their own custom LLMs, their own Telephony, their own models etc. and create application features requiring voice AI. Here’s a small video: https://github.com/bolna-ai/bolna/assets/1313096/2237f64f-1c.... Our product originates from building an AI interviewer bot which can be used for practising coding interviews like Leetcode. By…
More ai this month
the category →
I trained a 125M-parameter transformer to autocomplete piano performances in real time (~108 notes/sec on an iPhone 15). The idea is basically GitHub Copilot or Tabnine, except instead of prompting it with code, you prompt it by playing a few notes on a MIDI piano. The model then continues what you played, entirely on-device. The app is free if anyone wants to try it. Happy to answer questions about the model, training, Core ML, or the many things that didn't work.
AI · 17d ago · simedw.com
Astute▲585Automate your B2B brand going viral, with new media creators
AI · 18d ago · company-app.joinastute.com
Hey HN, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots and microcontrollers. We got really great feedback here, and have now incorporated the suggestions to release Needle 2. The whole model is a single 14MB binary that runs a full session in 28MB of RAM; 45m parameters at 2bit compression. Needle hits 500 tokens/sec decode speed on a Raspberry Pi 5, sits between 400-1,500 tokens/sec on VR devices like Meta Quest 3S and Apple Vision Pro, and ranges…
AI · 26d ago · cactuscompute.com
Launched alongside, March 2024
the whole month →
- 3Y
Life & fun · 2024 · github.com
Microlaunch▲1,116Launch and get feedback on both the idea and product
Dev tools · 2024 · microlaunch.net
