FreeLLM · free LLM tiers into 1 endpoint
OpenAI-compatible gateway aggregating 8 free LLM providers
FreeLLM · free LLM tiers into 1 endpoint launched on May 30, 2026 with 3 votes, #3,449 of 20,538 launches that month and more than 50% of that year's launches.
What it does
OpenAI-compatible gateway aggregating 8 free LLM providers (Groq, Gemini, Mistral, Cerebras, NVIDIA NIM, Cloudflare Workers AI, GitHub Models, Ollama) with automatic failover, multi-key rotation, and a real-time dashboard. Zero cost.
One OpenAI-compatible endpoint. Eight free LLM providers. One rate-limits, the next one answers. Stack 3 keys per provider and hit ~450 free requests per minute . All $0. Routing, failover, caching, and observability built around the constraints of free-tier providers. Every feature solves a real free-tier problem. Change one line. Your base URL. Your existing OpenAI SDK code keeps working against eight providers. Groq rate-limited? Your request silently routes to Gemini, then Mistral, then Cerebras. You stop seeing 429s. Set GROQ_API_KEY=k1,k2,k3 and stack multiple keys per provider. Each key gets its own rate-limit budget. Rolling 24-hour token counts per provider. Always know how much of…from freellms.vercel.app
Does a similar job
all alternatives →
LLM Gateway2025 · llmgateway.io · ▲296I built an OpenAI-compatible LLM gateway that routes requests to OpenAI, Anthropic, Ollama, vLLM, llama-server, SGLang... anything that speaks /v1/chat/completions. Single Go binary, one YAML config file, no infrastructure. It does the things you'd expect from this kind of gateway... semantic routing via a three-layer cascade (keyword heuristics, embedding similarity, LLM classifier) that picks the best model when clients omit the model field, weighted round-robin load balancing across local inference servers with health checks and failover. The part I think is most…
Any-LLM – Lightweight router to access any LLM Provider2025 · github.com · ▲125We built any-llm because we needed a lightweight router for LLM providers with minimal overhead. Switching between models is just a string change : update "openai/gpt-4" to "anthropic/claude-3" and you're done. It uses official provider SDKs when available, which helps since providers handle their own compatibility updates. No proxy or gateway service needed either, so getting started is pretty straightforward - just pip install and import. Currently supports 20+ providers including OpenAI, Anthropic, Google, Mistral, and AWS Bedrock. Would love to hear what you think!
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 21d ago · stillwet.art
FastRouter.ai▲364Route requests to the right LLM for cost, latency & quality
AI · 23d ago · fastrouter.ai
Source: Product Hunt launch ↗
Launched alongside, May 2026
the whole month →
Parallel agents, diff reviewer, and multi-model comparisons
Dev tools · May 2026 · kilo.ai
Hey HN, Henry here from Cactus. We open-sourced Needle, a 26M parameter function-calling (tool use) model. It runs at 6000 tok/s prefill and 1200 tok/s decode on consumer devices. We were always frustrated by the little effort made towards building agentic models that run on budget phones, so we conducted investigations that led to an observation: agentic experiences are built upon tool calling, and massive models are overkill for it. Tool calling is fundamentally retrieval-and-assembly (match query to tool name, extract argument values, emit JSON), not reasoning. Cross-attention…
Life & fun · May 2026 · github.com
🌱 Private, quiet space for thinking. Simple app for .md files. - zakirullin/files.md
Dev tools · May 2026 · github.com