Stream-Omni: GPT-4o-like Chatbot

What it does

Stream-Omni is an GPT-4o-like language-vision-speech chatbot that simultaneously supports interaction across any modality combinations.

Stream-Omni is a GPT-4o-like language-vision-speech chatbot that simultaneously supports interaction across various modality combinations. - ictnlp/Stream-Omni

Stream-Omni can produce intermediate textual results (ASR transcription and text response) during speech interaction, offering users a seamless "see-while-hear" experience. from modelscope import snapshot_download snapshot_download ( 'iic/CosyVoice-300M-25Hz' , local_dir = './CosyVoice-300M-25Hz' ) Run these scripts to launch the API and interface, and then interact through the browser ( http://localhost:7860 ): # controller python stream_omni/serve/controller.py --host 0.0.0.0 --port 10000 # CosyVoice worker COSYVOICE_CKPT=path_to_CosyVoice-300M-25Hz # e.g., ./CosyVoice-300M-25Hz WAV_DIR=path_to_save_generated_audio CUDA_VISIBLE_DEVICES=0 PYTHONPATH=CosyVoice/third_party/Matcha-TTS python…from github.com

• 
  Omni Channel Custom GPT Chatbot 2023 · botsify.com · ▲124

  Create GPT chatbots for your data & publish on all platforms

• 
  GPT-4 Vision Chatbot2023 · thesamur.ai · ▲310

  Train AI chatbot on images and text

• 
  Qwen2.5-Omni2025 · github.com · ▲165

  The end-to-end model powering multimodal chat

• 
  Open source framework OpenAI uses for Advanced Voice2024 · github.com · ▲266

  Hey HN, we've been working with OpenAI for the past few months on the new Realtime API. The goal is to give everyone access to the same stack that underpins Advanced Voice in the ChatGPT app. Under the hood it works like this: - A user's speech is captured by a LiveKit client SDK in the ChatGPT app - Their speech is streamed using WebRTC to OpenAI’s voice agent - The agent relays the speech prompt over websocket to GPT-4o - GPT-4o runs inference and streams speech packets (over websocket) back to the agent - The agent relays generated speech using WebRTC back to the user’s device The…

• 
  Floatbot2017 · floatbot.ai · ▲78

  Omni-channel customer engagement AI chatbot

• 
  Qwen3-Omni2025 · github.com · ▲137

  Native end-to-end multilingual omni-modal LLM

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 17d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 17d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 19d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 20d ago · stillwet.art

• 
  PixVerse R2▲381

  A real-time world model you can explore and change

  AI · 29d ago · world.pixverse.video

• 
  Hemory▲381

  Keep listening. Searchable memory for your AI agents.

  AI · 30d ago · hemory.com

• IM
  I'm an airline pilot – I built interactive graphs/globes of my flights▲1,539

  Hey HN! Pilots everywhere are required to keep a logbook of all their flying hours, aircraft, airports, and so on. Since I track everything digitally (some people still just use paper logbooks!), I put together some data visualizations and a few 3D globes to show my flying history. This globe is probably my favourite so far: https://jameshard.ing/pilot/globes/all If you’ve got ideas for other graphs or ways to show this kind of data, I’d love to hear them!

  Life & fun · 2025 · jameshard.ing

• 
  Chronicle: Cursor for Slides▲1,212

  Stunning presentations with AI. No design skills required.

  AI · 2025 · chroniclehq.com

• 
  Bubble for native mobile apps (beta)▲1,026

  Build native mobile apps for iOS and Android without code.

  Dev tools · 2025 · bble.io

• 
  Twenty▲989

  Build your Enterprise CRM with an AI-friendly SDK

  Dev tools · 2025 · twenty.com

• 
  Pally - AI Relationship Management▲949

  All your connections, across all your socials.

  AI · 2025 · pally.com

• 
  Workout.cool – Open-source fitness coaching platform▲827

  I was the main contributor to workout.lol, an open-source fitness app to easily build a workout routine. The project had traction (1.4k GitHub stars, 95 forks, ~20K visits/month), but was eventually sold due to video licensing hurdles. The new owner stopped maintaining it, and the repo went abandoned. Over the next 9 months, I sent 15 emails to try to save it : no replies. Feature requests & issues were ignored. The community was left with a "broken" tool let's say. I couldn't just let it die So I built the new version from scratch with the same open-source spirit, but a better…

  Dev tools · 2025 · github.com