Relay
Reliable delivery layer for LLM APIs
Relay launched on June 16, 2026 with 4 votes, #3,322 of 22,647 launches that month and more than 75% of that year's launches.
What it does
Drop-in SDK that adds auto retry, provider failover (Anthropic ↔ OpenAI), and smart caching to every LLM call. One line keeps your AI agents online even when providers don't. BYOK, edge-native, $0 to start.
Auto retry, provider failover and smart caching for LLM API calls. One import keeps your agents up when Anthropic and OpenAI don't.
I rewrote retry-and-failover for LLM APIs in four projects, each time with a new bug. Relay is the version you import instead — same SDK shape, plus auto-retry, provider failover, and a cache that stops you paying twice. Live stream from a relay account — same shape you see in your dashboard. Newest event types in at the top, older ones fade out of the bottom of the window. Anthropic drops thirty minutes. Your agent stops mid-task. Your user closes the tab. Your churn ticks up. Repeat next month when OpenAI has its own bad day. Peak hours are exactly when you can't afford retries you don't have. Every 529 you don't catch is a request that quietly dies and a user who quietly leaves. Every…from relay-sdk.vercel.app
Does a similar job
all alternatives →
LLM Gateway2025 · llmgateway.io · ▲296I built an OpenAI-compatible LLM gateway that routes requests to OpenAI, Anthropic, Ollama, vLLM, llama-server, SGLang... anything that speaks /v1/chat/completions. Single Go binary, one YAML config file, no infrastructure. It does the things you'd expect from this kind of gateway... semantic routing via a three-layer cascade (keyword heuristics, embedding similarity, LLM classifier) that picks the best model when clients omit the model field, weighted round-robin load balancing across local inference servers with health checks and failover. The part I think is most…
LLM Ops Toolkit by Lamatic.aiApr 2026 · tools.lamatic.ai · ▲96Aggregate uptime monitoring across OpenAI, Claude, and more
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 20d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 29d ago · world.pixverse.video
Source: Product Hunt launch ↗
Launched alongside, June 2026
the whole month →
Fundraisly▲1,537AI fundraising agent that finds investors and books meetings
AI · Jun 2026 · fundraisly.com
Homebrew 6.0.0▲1,481Today, I’m proud to announce Homebrew 6.0.0. The most significant changes since 5.1.0 are a new tap trust security mechanism, the new faster, smaller, default internal Homebrew JSON API, sandboxing on Linux, better defaults informed by our user survey, many brew bundle improvements, improved performance and initial support for macOS 27 (Golden Gate). Happy to discuss any questions here!
Dev tools · Jun 2026 · brew.sh
Hi HN! I was super frustrated at apps like tiktok and wechat preventing me from saving or downloading the animated gifs, so I made a little tool to turn a screen recording into a slack-sized emoji. Hope you get some value from this!
Life & fun · Jun 2026 · vorpus.github.io
Search 18 years of Hacker News and chart how any topic, tool, or person trended. Overlay terms to compare their rise and fall across 45M posts and comments.
Life & fun · Jun 2026 · hackernewstrends.com