Enabling end-to-end LLM-based voice driven conversational applications
Hey everyone on HN! We recently spent the past couple of weeks building out an end-to-end platform which can plug-in multiple models (both open/closed-source) to create voice driven conversational applications. We've tried to make the process simple & concise through documentation. Feel free to try it out and provide feedback. We will be launching a dashboard in the coming week for monitoring and analytics alongwith more open source models. Let us know what you all think. (if you want to contribute, we have tons of features planned - do let us know)
Does the same job
all alternatives →
- SHShow HN2011 · tonecheck.com · ▲14
Hi, i was wondering what the HN community thinks of this email tone check application? Do you think this can be done better with open-source? Disclaimer: I am neither a founder or an employee at the company. Just someone who had a similar idea.
- OVOSS voice based conversational API with <1sec latency and other nuances2024 · bolna.dev · ▲8
Hi Hackernews, we're Maitreya, Prateek and Marmik. Over the past few months we've been working on building a platform to build, scale and monitor voice based LLM applications. Demo (https://www.youtube.com/watch?v=OSrOmyR7oQs) 1⃣ Open Source orchestration: We're open-sourcing our orchestration to quickly setup and create LLM based voice driven conversational applications https://github.com/bolna-ai/bolna/ 2⃣ Hosted API Platform: Exposing our managed solution via APIs to build voice driven applications…
- PGProduction grade end to end open source stack for Voice AI2024 · github.com · ▲5
we have been building an open source orchestration which enables you to plug in your own TTS/ASR/LLM for end-to-end voice conversations at -> https://github.com/bolna-ai/bolna. Few days back, was having a discussion here in HN about the possibilities of having a complete open source stack for ASR+LLM+TTS. Today, we are releasing a complete open sourced Dockerized stack by merging Bolna with Whisper ASR, Llama3 and Melo TTS.
- MCMamba-Chat – A Chat LLM Based on State Space Models2023 · github.com · ▲9
Hey everyone! Many of you might have come across the Mamba paper a few days ago, which introduced an LLM based on a state space model architecture. The Mamba architecture is quite useful as its complexity scales subquadratically with input length and is therefore way more efficient than transformer models: https://github.com/state-spaces/mamba I got really excited about the paper, so I decided to fine-tune the model on a chat dataset. It turns that this actually worked quite well! The model is quite suitable for casual chatting, which honestly surprised me given that it…
- CCCallhackernews.com – The missing voice interface for Hacker News2024 · callhackernews.com · ▲9
Hey there HN! I believe the future of AI communication will be more voice and less text. Low-latency realistic voice interactions are finally becoming feasible. I've built a few voice-first apps on Retell AI using Elevenlabs voices. This one uses Claude Haiku for responses and Mixtral to switch between posts and comments. The AI knows about the top 30 posts and their comments on Hacker News right now. After a Google sign-in you can try it free for 10 minutes. I'd love to hear your thoughts!
More ai this month
the category →
I trained a 125M-parameter transformer to autocomplete piano performances in real time (~108 notes/sec on an iPhone 15). The idea is basically GitHub Copilot or Tabnine, except instead of prompting it with code, you prompt it by playing a few notes on a MIDI piano. The model then continues what you played, entirely on-device. The app is free if anyone wants to try it. Happy to answer questions about the model, training, Core ML, or the many things that didn't work.
AI · 17d ago · simedw.com
Astute▲585Automate your B2B brand going viral, with new media creators
AI · 18d ago · company-app.joinastute.com
Hey HN, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots and microcontrollers. We got really great feedback here, and have now incorporated the suggestions to release Needle 2. The whole model is a single 14MB binary that runs a full session in 28MB of RAM; 45m parameters at 2bit compression. Needle hits 500 tokens/sec decode speed on a Raspberry Pi 5, sits between 400-1,500 tokens/sec on VR devices like Meta Quest 3S and Apple Vision Pro, and ranges…
AI · 27d ago · cactuscompute.com
Launched alongside, December 2023
the whole month →- BM
Hi HN! I’m proud to share that we have built a real 3rd party iMessage client for Android. We did it by reverse engineering the iMessage protocol and encryption system. It's available to download today (no waitlist): https://play.google.com/store/apps/details?id=com.beeper.ima and there's a technical writeup here: https://blog.beeper.com/p/how-beeper-mini-works. Unlike every other attempt to build an iMessage app for Android (including our first gen app), Beeper Mini does not use a Mac server relay in the cloud. The app connects directly to Apple…
Commerce · 2023 · beeper.com
- HA
Hey! I made Heynote entirely for my own use case. For many years, I always had an Emacs instance running with the scratch buffer open, even long after I had abandoned Emacs as my programming editor in favor of more recent IDE:s. The simplicity of having just one big scratch buffer appeals to me, but I still want to separate the different things I jot down somehow (without using tabs or similar). Previously, my solution was to insert a bunch of blank lines between the notes, but hitting C-A would still select the entire buffer. That's why I came up with the concept of "blocks", which turned…
Work · 2023 · heynote.com
FuseBase▲941Client collaboration platform for professional services
Dev tools · 2023 · thefusebase.com
Beep! 2.0▲871Fastest tool to assign and share visual tasks with your team
Work · 2023 · justbeepit.com
