Provara

What it does

Provara is an gateway that routes LLM requests across providers and learns which model works best for each type of task. Adaptive quality-based routing with LLM-as-judge A/B testing between models on real traffic Full observability Guardrails for content Spend and latency alerting Self-hosted with Docker Who it's for: Teams using multiple LLM providers who want one dashboard Anyone optimizing LLM costs without sacrificing quality Companies that need self-hosted AI infrastructure

Routes every request. Learns from every response. Catch provider regressions, cut spend at equal quality, and answer 'why did our bill double?' in one screen. Self-host or Cloud.

Know when a provider silently ships a regression. Cut model spend at equal quality — automatically. Answer "why did our bill double?" in one screen, not a grep. Built for teams shipping AI-powered products who've outgrown raw API access. Replay bank + judge re-eval flags quality drops the moment they appear. Nightly cost migration with rollback. Judge-score gated — no quality cliff. Per-user + per-token attribution. MTD + forecast + anomaly. CSV export. Adaptive routing is the foundation. Regression detection, auto cost migration, and spend intelligence are what you actually buy it for. Most LLM regressions are invisible until a customer complains. Not here. A replay bank of your top…from provara.xyz

• 
  LLM Gateway2025 · llmgateway.io · ▲296

  I built an OpenAI-compatible LLM gateway that routes requests to OpenAI, Anthropic, Ollama, vLLM, llama-server, SGLang... anything that speaks /v1/chat/completions. Single Go binary, one YAML config file, no infrastructure. It does the things you'd expect from this kind of gateway... semantic routing via a three-layer cascade (keyword heuristics, embedding similarity, LLM classifier) that picks the best model when clients omit the model field, weighted round-robin load balancing across local inference servers with health checks and failover. The part I think is most…

• 
  TrustMRRNov 2025 · trustmrr.com · ▲833

  LLM Gateway is a b2b artificial intelligence based in United States, founded in 2025. $259,539/month in verified Stripe revenue. $78,764 MRR. Ahrefs Domain Rating 52/100. growing 55% month-over-month. Track LLM Gateway's verified metrics on TrustMRR.

• 
  FastRouter.ai23d ago · fastrouter.ai · ▲364

  Route requests to the right LLM for cost, latency & quality

• RY
  Route your prompts to the best LLM2024 · unify.ai · ▲298

  Hey HN, we've just finished building a dynamic router for LLMs, which takes each prompt and sends it to the most appropriate model and provider. We'd love to know what you think! Here is a quick(ish) screen-recroding explaining how it works: https://youtu.be/ZpY6SIkBosE Best results when training a custom router on your own prompt data: https://youtu.be/9JYqNbIEac0 The router balances user preferences for quality, speed and cost. The end result is higher quality and faster LLM responses at lower cost. The quality for each candidate LLM is predicted ahead of time…

• 
  We built open OpenRouter that turns usage into a better modelAug 2026 · github.com · ▲222

  Hi HN, we built an open source model gateway. It's a single place to manage our own self hosted, frontier, and open source models in one place. It’s is rust native, built for concurrency, and implements all the config quirks across models and providers (streaming formats, tool calls, model parameters, rate limits, and different error behavior). The gateway adds under 1 ms for BYOK requests and under 2 ms when Experiential supplies the provider key. It has every major inference provider, and 1000+ models refreshed daily via a codex agent that opens a PR. Compared to other similar projects…

• 
  Foreman, a self-hosted LLM gateway for cost aware model routingJul 2026 · github.com · ▲15

  Self-hosted LLM router. Cost effective, deterministic, and fast. Secure and private by default. - Northwood-Systems/millwright

• 
  Lofi Cities – Pixel-art city nights with browser-generated lofi▲319

  Endless lofi beats composed live in your browser, over pixel-art nights in Paris, Tokyo, New York, Hong Kong, Sydney, San Francisco and more. Free, no sign-up.

  Work · 26d ago · loficities.com

• 
  Smooth Recorder▲257

  Mac screen recordings that look edited when you hit stop

  Work · 20d ago · smoothrecorder.com

• 
  Figma Specs▲225

  A container for your context that lives on the Figma canvas

  Work · 5d ago · figma.com

• 
  The rarest tech books and docs you've probably never read▲190

  Work · 14d ago · readrare.com

• 
  Brila▲1,364

  One-page websites from real Google Maps reviews

  AI · Apr 2026 · brila.ai

• AG
  A game where you build a GPU▲964

  Thought the resources for GPU arch were lacking, so here we are

  Life & fun · Apr 2026 · jaso1024.com

• 
  I built a tiny LLM to demystify how language models work▲915

  Built a ~9M param LLM from scratch to understand how they actually work. Vanilla transformer, 60K synthetic conversations, ~130 lines of PyTorch. Trains in 5 min on a free Colab T4. The fish thinks the meaning of life is food. Fork it and swap the personality for your own character.

  AI · Apr 2026 · github.com

• 
  Fathom 3.0▲800

  AI meeting notes: now bot-free, in ChatGPT & Claude + more

  AI · Apr 2026 · fathom.ai

• 
  Brutalist Concrete Laptop Stand (2024)▲786

  I made a laptop stand out of solid concrete, in the style of brutalist architecture, with themes of urbex and urban decay

  Life & fun · Apr 2026 · sam-burns.com

• 
  I built a frontpage for personal blogs▲783

  With social media and now AI, its important to keep the indie web alive. There are many people who write frequently. Blogosphere tries to highlight them by fetching the recent posts from personal blogs across many categories. There are two versions: Minimal (HN-inspired, fast, static): https://text.blogosphere.app/ Non-minimal: https://blogosphere.app/ If you don't find your blog (or your favorite ones), please add them. I will review and approve it.

  AI · Apr 2026 · text.blogosphere.app