Self-hosted gateway to access LLMs, Ollama, ComfyUI and FFmpeg servers

In plain words

This self-hosted gateway allows developers to access multiple AI and media processing services through a unified interface, including LLMs, Ollama, ComfyUI, and FFmpeg servers. It enables local deployment and management of these tools without relying on external cloud services. The product is designed for developers who need to integrate various AI models and media processing capabilities into their applications while maintaining control over their infrastructure.

written from the facts on this page · September 2026

• 
  LLM Gateway2025 · llmgateway.io · ▲296

  I built an OpenAI-compatible LLM gateway that routes requests to OpenAI, Anthropic, Ollama, vLLM, llama-server, SGLang... anything that speaks /v1/chat/completions. Single Go binary, one YAML config file, no infrastructure. It does the things you'd expect from this kind of gateway... semantic routing via a three-layer cascade (keyword heuristics, embedding similarity, LLM classifier) that picks the best model when clients omit the model field, weighted round-robin load balancing across local inference servers with health checks and failover. The part I think is most…

• 
  TrueFoundry AI GatewayDec 2025 · truefoundry.com · ▲315

  Many teams connecting LLMs to external tools eventually encounter the same architectural issue: as more tools and agents are added, the integration pattern becomes an N×M mesh of direct connections. Each agent implements its own auth, retries, rate limiting, and logging; each tool needs credentials distributed to multiple places and observability becomes fragmented. We built LLM gateway with this goal to provide a single place to manage authentication, authorization, routing, and observability for MCP servers, with a path toward a more general agent-gateway architecture in the future. The…

• 
  ngrok AI GatewayAug 2026 · ngrok.ai · ▲277

  One private gateway for every AI model

• 
  SUB/WAVEJul 2026 · getsubwave.com · ▲102

  Self-hosted radio with an AI DJ and one shared stream

• 
  Open Source AI Gateway2025 · ai-gateway.dev · ▲11

  Talk to multiple LLMs thru a unified API

• 
  ModelRiverJan 2026 · modelriver.com · ▲37

  Connect once to every major AI model. Run AI workflows in the background while your backend controls what AI sees.

Questions this answers

• hosted api gateway for claude opus 4.6 or fable 5 with free trial credits

• 
  Run full iOS 16.5 firmware on Android Devices▲513

  Contribute to oosexgang/hackios-xnu-kernel development by creating an account on GitHub.

  Dev tools · 1d ago · github.com

• 
  /dev/null▲492

  a social network for devs

  Dev tools · 4d ago · dev-null.sh

• 
  Whiteboard (YC W26) – an open-source IDE for thoughtful software design▲423

  open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.

  Dev tools · 29d ago · github.com

• 
  Reladraw – A diagram language where you decide where to place things▲411

  Contribute to reladraw/reladraw development by creating an account on GitHub.

  Dev tools · 27d ago · github.com

• 
  OpenBot▲362

  Grok Bot alternative: free, local, open-source, multiplayer

  Dev tools · 24d ago · openbot.run

• 
  Talanoa▲346

  Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…

  Dev tools · 22d ago · talanoa.email

• 
  Lovable▲1,477

  Hey HN! Previous CERN physicist turned hacker here. We've developed a way to make AI coding actually work by systematically identifying and fixing places where LLMs typically fail in full-stack development. Today we're launching as Lovable (previously gptengineer.app) since it's such a big change. The problem? AI writing code typically make small mistakes and then get stuck. Those who tried know the frustration. We fixed most of this by mapping out where LLMs fail in full-stack dev and engineering around those pitfalls with prompt chains. Thanks to this, in all comparisons I found with: v0,…

  AI · 2024 · lovable.dev

• 
  Superchat▲1,427

  AI Agents for WhatsApp Business, Instagram & Co

  Growth · 2024 · superchat.com

• 
  Postiz▲1,188

  Streamline your social media with Postiz. Schedule posts, analyze performance, and manage all accounts in one place.

  Dev tools · 2024 · postiz.com

• 
  I built a(nother) house optimized for LAN parties▲1,117

  I wasn't quite sure if this qualified as "Show HN" given you can't really download it and try it out. However, dang said[0]: > If it's hardware or something that's not so easy to try out over the internet, find a different way to show how it actually works—a video, for example, or a detailed post with photos. Hopefully I did that? Additionally, I've put code and a detailed guide for the netboot computer management setup on GitHub: https://github.com/kentonv/lanparty Anyway, if this shouldn't have been Show HN, I apologize! [0]…

  Dev tools · 2024 · lanparty.house

• 
  Raycast Notes▲1,058

  Unlock a new level productivity with AI, Cloud Sync and more

  Work · 2024 · raycast.com

• 
  Cap▲1,047

  Beautiful screen recordings, owned by you. 100% open source.

  Dev tools · 2024 · cap.so