Bifrost

In plain words

Bifrost is an open-source LLM gateway designed for developers working with large language models. It features built-in MCP support, a dynamic plugin architecture, and integrated governance tools. The platform includes a clean user interface and claims significant performance advantages. It integrates with Maxim for end-to-end evaluations and observability of AI products, helping teams monitor and optimize their AI implementations.

written from the facts on this page · September 2026

From the sources

Bifrost is the fastest, open-source LLM gateway with built-in MCP support, dynamic plugin architecture, and integrated governance. With a clean UI, Bifrost is 40x faster than LiteLLM, and plugs in with Maxim for e2e evals and observability of your AI products.

The fastest, most resilient, enterprise-grade LLM, MCP, and agent gateway. Routing, governance, guardrails, and observability via one control plane. Open source.

• 
  LLM Gateway2025 · llmgateway.io · ▲296

  I built an OpenAI-compatible LLM gateway that routes requests to OpenAI, Anthropic, Ollama, vLLM, llama-server, SGLang... anything that speaks /v1/chat/completions. Single Go binary, one YAML config file, no infrastructure. It does the things you'd expect from this kind of gateway... semantic routing via a three-layer cascade (keyword heuristics, embedding similarity, LLM classifier) that picks the best model when clients omit the model field, weighted round-robin load balancing across local inference servers with health checks and failover. The part I think is most…

• 
  FastRouter.ai21d ago · fastrouter.ai · ▲364

  Route requests to the right LLM for cost, latency & quality

• 
  TrueFoundry AI GatewayDec 2025 · truefoundry.com · ▲315

  Many teams connecting LLMs to external tools eventually encounter the same architectural issue: as more tools and agents are added, the integration pattern becomes an N×M mesh of direct connections. Each agent implements its own auth, retries, rate limiting, and logging; each tool needs credentials distributed to multiple places and observability becomes fragmented. We built LLM gateway with this goal to provide a single place to manage authentication, authorization, routing, and observability for MCP servers, with a path toward a more general agent-gateway architecture in the future. The…

• 
  TensorZero2025 · github.com · ▲307

  Hi HN! We're Gabriel & Viraj, and we're excited to open source TensorZero. To be a little cheeky, TensorZero is an open-source platform that helps LLM applications graduate from API wrappers into defensible AI products. 1. Integrate our model gateway 2. Send metrics or feedback 3. Unlock compounding improvements in quality, cost, and latency It enables a data & learning flywheel for LLMs by unifying: • Inference: one API for all LLMs, with <1ms P99 overhead • Observability: inference & feedback → your database • Optimization: better prompts, models, inference strategies • Experimentation:…

• 
  Laminar – Open-Source DataDog + PostHog for LLM Apps, Built in Rust2024 · github.com · ▲203

  Hey HN, we’re Robert, Din and Temirlan from Laminar (https:&#x2F;&#x2F;www.lmnr.ai), an open-source observability and analytics platform for complex LLM apps. It’s designed to be fast, reliable, and scalable. The stack is RabbitMQ for message queues, Postgres for storage, Clickhouse for analytics, Qdrant for semantic search - all powered by Rust. How is Laminar different from the swarm of other “LLM observability” platforms? On the observability part, we’re focused on handling full execution traces, not just LLM calls. We built a Rust ingestor for OpenTelemetry (Otel) spans with GenAI…

• 
  Bifrost2025 · bifrost.nativephp.com · ▲52

  Bifrost compiles, signs, and ships SuperNative apps for iOS and Android. Trigger builds from GitHub, the API, or your AI agent. No Mac required.

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 17d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 16d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 18d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 20d ago · stillwet.art

• 
  Onepin▲384

  AI voiceover with every name, price and date said right

  AI · 30d ago · onepin.ai

• 
  PixVerse R2▲381

  A real-time world model you can explore and change

  AI · 28d ago · world.pixverse.video

• 
  Trace▲1,555

  Workflow Automations for the Human 👾 AI Workforce

  AI · 2025 · trace.so

• 
  I spent 6 years building a ridiculous wooden pixel display▲1,145

  I built the world's most impractical 1000-pixel display and anyone in the world can draw on it. It draws a single pixel at a time and takes 30-60 minutes to complete a single image. Anyone can participate in the project by voting for the next image to be drawn, and submitting images. https:&#x2F;&#x2F;kilopx.com&#x2F;

  Work · 2025 · benholmen.com

• 
  Indy AI by Contra▲1,070

  Job boards are dead. Your network is alive

  AI · 2025 · contra.com

• 
  Kitten TTS – 25MB CPU-Only, Open-Source TTS Model▲1,003

  Kitten TTS is an open-source series of tiny and expressive text-to-speech models for on-device applications. We are excited to launch a preview of our smallest model, which is less than 25 MB. This model has 15M parameters. This release supports English text-to-speech applications in eight voices: four male and four female. The model is quantized to int8 + fp16, and it uses onnx for runtime. The model is designed to run literally anywhere eg. raspberry pi, low-end smartphones, wearables, browsers etc. No GPU required! We're releasing this to give early users a sense of the latency and voices…

  AI · 2025 · github.com

• 
  I was curious about spherical helix, ended up making this visualization▲865

  I was wondering how I can arrange objects along a spherical helix path, and read some articles on it. I ended up learning about parametric equations again, and make this visualization to document what I learned: https:&#x2F;&#x2F;visualrambling.space&#x2F;moving-objects-in-3d&#x2F; feel free to visit and let me know what you think!

  Life & fun · 2025 · visualrambling.space

• 
  The current sky at your approximate location, as a CSS gradient▲788

  For HTML Day 2025 [1], I made a web service that displays the current sky at your approximate location as a CSS gradient. Colours are simulated on-demand using atmospheric absorption and scattering coefficients. Updates every minute, without the use of client-side JavaScript. Source code and additional information is available on GitHub: https:&#x2F;&#x2F;github.com&#x2F;dnlzro&#x2F;horizon [1] https:&#x2F;&#x2F;html.energy&#x2F;html-day&#x2F;2025&#x2F;index.html

  Dev tools · 2025 · sky.dlazaro.ca