ngrok AI Gateway
One private gateway for every AI model
ngrok AI Gateway launched on August 5, 2026 with 303 votes, #82 of 23,274 launches that month and more than 99% of that year's launches.
In plain words
ngrok AI Gateway is a unified routing platform that lets developers access multiple AI models—including OpenAI, Anthropic, and self-hosted options—through a single API key and URL. It's designed for software engineers and AI development teams who need to manage diverse model endpoints. The service includes built-in observability, access control, and automatic fallbacks, while keeping private models secure through ngrok's network infrastructure rather than exposing them publicly.
written from the facts on this page · September 2026
From the sources
ngrok AI Gateway provides one hosted gateway for every model: public providers, custom endpoints, and the models you run yourself. Use one key and one URL to route across OpenAI, Anthropic, and self-hosted models with observability, access control, and fallbacks built in. Your private models connect through ngrok’s network, so they sit beside hosted providers without being exposed to the public internet.
Route, secure, and manage traffic to any LLM—cloud or local—with one unified platform. Monitor usage, optimize costs, and keep your AI products online.
Bring the models you run yourself and every frontier provider into a managed gateway, with observability and access control built in. Change your baseURL to https://gateway.ngrok.ai and swap your API key. That’s it. Start routing, not deploying infrastructure. 1 import OpenAI from "openai" ; 2 3 const client = new OpenAI ({ ⋯ 4 baseURL : "https://gateway.ngrok.ai" , 5 apiKey : process . env . NGROK_AI_ACCESS_KEY , 6 }); 7 8 const completion = await client . chat . completions .create ({ ⋯ 9 // Route to a self-hosted model first 10 model : "unsloth/Qwen3.5-1228-A10B-GGUF" , 11 // Fallback to public providers 12 models : [ "gpt-5.4" , "claude-opus-4-6" ] , 13 messages : [ ⋯ 14 { role :…from ngrok.ai
Does a similar job
all alternatives →
ngrok – secure introspectable tunnels to localhost2013 · ngrok.com · ▲66ngrok is developer infrastructure that routes and secures traffic to your apps, APIs, and AI models, wherever they run. Start on localhost, ship to prod.
LLM Gateway2025 · llmgateway.io · ▲296I built an OpenAI-compatible LLM gateway that routes requests to OpenAI, Anthropic, Ollama, vLLM, llama-server, SGLang... anything that speaks /v1/chat/completions. Single Go binary, one YAML config file, no infrastructure. It does the things you'd expect from this kind of gateway... semantic routing via a three-layer cascade (keyword heuristics, embedding similarity, LLM classifier) that picks the best model when clients omit the model field, weighted round-robin load balancing across local inference servers with health checks and failover. The part I think is most…
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 20d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 29d ago · world.pixverse.video
Source: Product Hunt launch ↗
Launched alongside, August 2026
the whole month →- TL
Life & fun · Aug 2026 · louisabraham.github.io
Clipto MCP▲655Hey HN, We recently built Clipto. It’s a tool that lets you search over terabytes of video, audio, and images on your computer, without relying on the cloud. Motivation: we probably all had this similar experience, we know a moment exists in a video or audio, but finding it takes hours scrubbing the timeline. You can send all the media to process in the cloud, but it’s slow, expensive and raises privacy concerns. So we decided to build our own on-device media search engine. How it works (high level): 1. We ingest video, audio, image; normalize formats via ffmpeg; run content analysis to…
Work · Aug 2026 · clipto.com
Hello HN! I found that picking out plausible but diverse skin tones for my digital art and game development projects was kind of difficult, and I got curious about if there was a way to define a color space that made it easy. I've built a color picker and procedural generation algorithm based on the space as well as a bunch of other fun js features and demos throughout the page that use the equations. If you find it interesting, I have lots of explanations of how I built it and what properties the space has. The methodology might be a bit shaky, but hopefully the result is as helpful for…
Life & fun · Aug 2026 · toneyalexander.github.io
Astute▲606Automate your B2B brand going viral, with new media creators
AI · Aug 2026 · company-app.joinastute.com