AI · alternatives · 2026
24 alternatives to Multimodal perception system for real-time conversation
I work on real-time voice/video AI at Tavus and for the past few years, I’ve mostly focused on how machines respond in a conversation. One thing that’s always bothered me is that almost all conversational systems still reduce everything to transcripts, and throw away a ton of signals that need to be used downstream. Some existing emotion understanding models try to analyze and classify into small sets of arbitrary boxes, but they either aren’t fast / rich enough to do this with conviction in real-time. So I built a multimodal perception system which gives us a way to encode visual…
This multimodal perception system processes real-time voice and video during conversations, capturing visual and audio signals that traditional text-based systems discard. Rather than forcing emotions into predefined… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Prices are shown for the 1 we have checked on their own sites, 1 of them free or with a free tier.
- 1
Luke from ElevenLabs here. We just released Scribe Realtime v2, our new real-time Speech to Text model. We rebuilt it from the ground up around a new architecture that uses predictive transcription – it anticipates the next likely word before it’s spoken. That makes it both fast (around 150 ms latency) and highly accurate. Scribe v2 Realtime outperforms every low latency transcription model across 30 commonly used EU and Asian languages – 93.5% accuracy, compared to Gemini 2.5 Flash (91.4%), GPT-4o MiniTranscribe (90.7%), and Deepgram Nova 3 (85%). It supports 90+ languages including…
2025 · elevenlabs.io · its alternatives →
- 2
Hey there, I’m Brian. I've been shipping conversational models over here at Tavus for the past two years. I want to tell you about our new audio-understanding model: Sparrow-2! It’s a new category of model and a unique new approach to conversational audio. Earlier this year we launched Sparrow-1, (at the time) our SoTA turn taking model. Since our Sparrow-1 launch, I’ve spent a lot of time listening to humans talking and trying to really understand how people know when to talk, when to listen, and when to wait. I’ve also been hunting down failure modes of the current SoTA models. And while…
2024 · tavus.io · its alternatives →
- 3
Have a natural, spoken conversation with AI! Contribute to KoljaB/RealtimeVoiceChat development by creating an account on GitHub.
2025 · github.com · its alternatives →
- 4
Video SDK 3.0▲770Build and integrate real-time multimodal AI characters.
2024 · videosdk.live · its alternatives →
- 5AR
Hey it’s Hassaan & Quinn – co-founders of Tavus, an AI research company and developer platform for video APIs. We’ve been building AI video models for ‘digital twins’ or ‘avatars’ since 2020. We’re sharing some of the challenges we faced building an AI video interface that has realistic conversations with a human, including getting it to under 1 second of latency. To try it, talk to Hassaan’s digital twin: https://www.hassaanraza.com, or to our "demo twin" Carter: https://www.tavus.io We built this because until now, we've had to adapt communication to the limits of…
2024 · its alternatives →
- 6
A multimodal agent to create, share and rehearse scenarios
2025 · toughtongueai.com · its alternatives →
- 7
Research teams trust. Conversations customers love.
2025 · getperspective.ai · its alternatives →
- 8IR
Hey HN, this is Lina, Andrew, and Sidney from Infinity AI (https://infinity.ai/). We've trained our own foundation video model focused on people. As far as we know, this is the first time someone has trained a video diffusion transformer that’s driven by audio input. This is cool because it allows for expressive, realistic-looking characters that actually speak. Here’s a blog with a bunch of examples: https://toinfinityai.github.io/v2-launch-page/ If you want to try it out, you can either (1) go to https://studio.infinity.ai/try-inf2, or (2)…
2024 · its alternatives →
- 9
Pinch▲535Hey HN! I’m Christian, daily lurker and some might remember our original launch post (https://news.ycombinator.com/item?id=42935355). Today we're launching Pinch for Mac, which we believe is a step-change improvement in real-time AI translation. Our vision is to make cross-lingual conversations feel as natural as regular conversations. TL:DR During an online meeting, the app instantly transcribes and translates all audio you hear, and allows you to decide when you translate your voice and when you don't. It's invisible to others (like Granola), and works everywhere without any…
2025 · startpinch.com · its alternatives →
- 10
Inworld TTSfree tier, from $25/mo▲318Hey HN, this is Igor, one of the engineers behind Inworld Runtime, which we're releasing today in public preview. We built it to solve the common problem we and our customers had: engineers spend more time on AI ops and plumbing than on actual feature development. This was often due to the challenge of using Python for I/O-bound, high-concurrency workloads and complexity maintaining pipelines with streams that use always-changing ML models. Our solution is a high-performance runtime written in C++ with the core idea of defining AI logic as graphs. For instance, a basic voice-to-voice…
2025 · inworld.ai · its alternatives →
- 11
WhisperFusion builds upon the capabilities of open source tools WhisperLive and WhisperSpeech to provide a seamless conversations with an AI chatbot.
2024 · github.com · its alternatives →
- 12
Related: https://news.ycombinator.com/item?id=47653752
Apr 2026 · github.com · its alternatives →
- 13
- 14
- 15
Pushing the boundaries of conversational AI
2025 · rapport.cloud · its alternatives →
- 16
Character AI▲393Building the next generation of conversational AI
2023 · character.ai · its alternatives →
- 17
Qwen3.5▲288The 397B native multimodal agent with 17B active params
Feb 2026 · qwen.ai · its alternatives →
- 18
Wavel AI▲289Most realistic and natural AI voiceover & dubbing for videos
2023 · wavel.ai · its alternatives →
- 19
Second Brain▲281Hi HN, I'm Dom, a solo founder. I built Second Brain to solve a common issue I had with AI chats: the knowledge disappears. There’s no structure, no memory, and no way to reuse or build on them. So I built a tool that combines AI chat with a visual, interconnected knowledge system. Key features: - Save AI responses into editable docs (Notion-style Pages). - AI Visual board with multiple content & chat nodes (like Miro meets ChatGPT). - Add and chat with YouTubes, TikToks, Audio, PDFs, GitHub repos, Looms, websites, etc. - Organize using Projects and Smart Tags — then chat with full contexts.…
2025 · second-brain-lac-ten.vercel.app · its alternatives →
- 20
MulmoChat▲88Modular Interface for visually interactive AI responses
Mar 2026 · github.com · its alternatives →
- 21IB
Hello Hacker News, When learning foreign languages, I made the most progress by speaking them throughout the day, every day. So I made a site where you can *speak* to an AI language teacher to practice both listening and speaking. # The product *What I have now:* * Multilingual speech recognition: You can ask a question in English and get an answer in your target language. * Feedback on your grammar. * Suggestions: See examples of what to say next to keep the conversation flowing. * Speed: Choose a lower speed for beginners or a faster one for advanced levels. * Translations: Click to see a…
2023 · gliglish.com · its alternatives →
- 22
- 23
Hi, I built TalkBits because most language apps focus on vocabulary or exercises, but not actual conversation. The hard part of learning a language is speaking naturally under pressure. TalkBits lets you have real-time spoken conversations with an AI that acts like a native speaker. You can choose different scenarios (travel, daily life, work, etc.), speak naturally, and the AI responds with natural speech back. The goal is to make it feel like talking to a real person rather than doing lessons. Techwise, it uses realtime speech input, transcription, LLM responses, and tts streaming to keep…
Jan 2026 · apps.apple.com · its alternatives →
- 24
Our goal with this project is to build a completely open source, state of the art turn detection model that can be used in any voice AI application. I've been experimenting with LLM voice conversations since GPT-4 was first released. (There's a previous front page Show HN about Pipecat, the open source voice AI orchestration framework I work on. [1]) It's been almost two years, and for most of that time, I've been expecting that someone would "solve" turn detection. We all built initial, pretty good 80/20 versions of turn detection on top of VAD (voice activity detection) models. And…
2025 · github.com · its alternatives →
Also compare
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →