modelchain
Cost-aware LLM router with streaming and tool calls
modelchain launched on June 30, 2026 with 4 votes, #3,322 of 22,647 launches that month and more than 75% of that year's launches.
What it does
Drop-in, zero-dependency LLM router that routes prompts across OpenAI, Anthropic, Gemini and any HTTP endpoint by cost, latency and observed quality.
You hold keys for OpenAI, Anthropic, and Gemini. Which one should answer this request? The cheapest that clears your quality bar? The fastest? The one that has not started failing yet? modelchain declares a pool of models, picks the best one per request by cost, latency, and observed quality, streams the tokens, normalises tool calls, scores the answer, and feeds that score into the next decision. You give modelchain a list of models for one or more providers (OpenAI, Anthropic, Gemini, or any OpenAI-compatible HTTP endpoint), each with its cost and a key resolver. It hands each request to the model your strategy selects, retries with backoff on a transient failure, fails over to the next…from davccavalcante.github.io
Does a similar job
all alternatives →
LLM Gateway2025 · llmgateway.io · ▲296I built an OpenAI-compatible LLM gateway that routes requests to OpenAI, Anthropic, Ollama, vLLM, llama-server, SGLang... anything that speaks /v1/chat/completions. Single Go binary, one YAML config file, no infrastructure. It does the things you'd expect from this kind of gateway... semantic routing via a three-layer cascade (keyword heuristics, embedding similarity, LLM classifier) that picks the best model when clients omit the model field, weighted round-robin load balancing across local inference servers with health checks and failover. The part I think is most…
OpenRouter Model FusionApr 2026 · openrouter.ai · ▲144Hey HN, We've been building a multi-model API for LLMs called OpenRouter since we launched the Window AI extension in April this year [0]. The events of the last week make it clear the LLM landscape is unpredictable, so LLM aggregators are picking up interest. Unlike others, we're making a router on top of a public, explorable dataset. We recently built a way to rank and visualize this data, including the token counts we see going to and from different models, both open-sourced (like Llama, Mistral, finetunes, and variants) and closed-sourced (OpenAI, Anthropic). The API supports - 50+…
Any-LLM – Lightweight router to access any LLM Provider2025 · github.com · ▲125We built any-llm because we needed a lightweight router for LLM providers with minimal overhead. Switching between models is just a string change : update "openai/gpt-4" to "anthropic/claude-3" and you're done. It uses official provider SDKs when available, which helps since providers handle their own compatibility updates. No proxy or gateway service needed either, so getting started is pretty straightforward - just pip install and import. Currently supports 20+ providers including OpenAI, Anthropic, Google, Mistral, and AWS Bedrock. Would love to hear what you think!
IQ RoutingAug 2026 · iq-routing.com · ▲100Route every LLM call to the cheapest model that holds quality. Chatbots, RAG, agent loops, and finance. Cut spend 40 to 80 percent, measured on our own traffic, live in thirty seconds.
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 20d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 29d ago · world.pixverse.video
Source: Product Hunt launch ↗
Launched alongside, June 2026
the whole month →
Fundraisly▲1,537AI fundraising agent that finds investors and books meetings
AI · Jun 2026 · fundraisly.com
Homebrew 6.0.0▲1,481Today, I’m proud to announce Homebrew 6.0.0. The most significant changes since 5.1.0 are a new tap trust security mechanism, the new faster, smaller, default internal Homebrew JSON API, sandboxing on Linux, better defaults informed by our user survey, many brew bundle improvements, improved performance and initial support for macOS 27 (Golden Gate). Happy to discuss any questions here!
Dev tools · Jun 2026 · brew.sh
Hi HN! I was super frustrated at apps like tiktok and wechat preventing me from saving or downloading the animated gifs, so I made a little tool to turn a screen recording into a slack-sized emoji. Hope you get some value from this!
Life & fun · Jun 2026 · vorpus.github.io
Search 18 years of Hacker News and chart how any topic, tool, or person trended. Overlay terms to compare their rise and fall across 45M posts and comments.
Life & fun · Jun 2026 · hackernewstrends.com