nowfound

AI · August 4, 2026

ModelPointer

Open-source AI Gateway for enterprise LLM infrastructure

ModelPointer launched on August 4, 2026 with 3 votes, #2,940 of 23,274 launches that month and more than 50% of that year's launches.

What it does

Unlike traditional API gateways or simple LLM proxies, ModelPointer is an enterprise AI Gateway built in Rust for high performance. It is designed natively for LLM traffic with model-aware routing, API key management, RPM/TPM rate limiting, and observability. Hybrid-cloud ready, it can automatically burst traffic from self-hosted models to cloud providers when local capacity is exhausted.

Manage AI model access, governance, routing, and costs efficiently with a user-friendly interface designed for organizations to optimize their AI resources.

Does a similar job

all alternatives →
  • LLM Gateway2025 · llmgateway.io · ▲296

    I built an OpenAI-compatible LLM gateway that routes requests to OpenAI, Anthropic, Ollama, vLLM, llama-server, SGLang... anything that speaks /v1/chat/completions. Single Go binary, one YAML config file, no infrastructure. It does the things you'd expect from this kind of gateway... semantic routing via a three-layer cascade (keyword heuristics, embedding similarity, LLM classifier) that picks the best model when clients omit the model field, weighted round-robin load balancing across local inference servers with health checks and failover. The part I think is most…

  • We built open OpenRouter that turns usage into a better modelAug 2026 · github.com · ▲222

    Hi HN, we built an open source model gateway. It's a single place to manage our own self hosted, frontier, and open source models in one place. It’s is rust native, built for concurrency, and implements all the config quirks across models and providers (streaming formats, tool calls, model parameters, rate limits, and different error behavior). The gateway adds under 1 ms for BYOK requests and under 2 ms when Experiential supplies the provider key. It has every major inference provider, and 1000+ models refreshed daily via a codex agent that opens a PR. Compared to other similar projects…

  • FastRouter.ai21d ago · fastrouter.ai · ▲364

    Route requests to the right LLM for cost, latency & quality

  • OpenRouter Model FusionApr 2026 · openrouter.ai · ▲144

    Hey HN, We've been building a multi-model API for LLMs called OpenRouter since we launched the Window AI extension in April this year [0]. The events of the last week make it clear the LLM landscape is unpredictable, so LLM aggregators are picking up interest. Unlike others, we're making a router on top of a public, explorable dataset. We recently built a way to rank and visualize this data, including the token counts we see going to and from different models, both open-sourced (like Llama, Mistral, finetunes, and variants) and closed-sourced (OpenAI, Anthropic). The API supports - 50+…

  • TrueFoundry AI GatewayDec 2025 · truefoundry.com · ▲315

    Many teams connecting LLMs to external tools eventually encounter the same architectural issue: as more tools and agents are added, the integration pattern becomes an N×M mesh of direct connections. Each agent implements its own auth, retries, rate limiting, and logging; each tool needs credentials distributed to multiple places and observability becomes fragmented. We built LLM gateway with this goal to provide a single place to manage authentication, authorization, routing, and observability for MCP servers, with a path toward a more general agent-gateway architecture in the future. The…

  • Arch2024 · github.com · ▲314

    Hey HN — I’m Adil from Katanemo (with Salman, Shuguang, and Meiyu) We previously shared an early version of this project as ArchGW. Based on customer feedback, the scope expanded from “LLM routing and model access” into something broader: delivery infrastructure for agentic applications. We renamed it to Plano and reworked the architecture accordingly. The problem On-the-ground AI practitioners will tell you that calling an LLM is not the hard part. The really hard part is delivering agentic applications to production quickly and reliably, then iterating without rewriting system code every…

More ai this month

the category →
  • Video model that turns script into viral social media videos

    AI · 17d ago · spira.ai

  • The browser where Claude Code and Codex work beside you

    AI · 16d ago · rill.love

  • Kolibri is Aleph Alpha

    AI · 18d ago · tej.as

  • Paintings by AI models: programs run through a simulation of oil paint.

    AI · 20d ago · stillwet.art

  • Onepin▲384

    AI voiceover with every name, price and date said right

    AI · 30d ago · onepin.ai

  • A real-time world model you can explore and change

    AI · 28d ago · world.pixverse.video

Source: Product Hunt launch ↗

Launched alongside, August 2026

the whole month →
  • TL

    Life & fun · Aug 2026 · louisabraham.github.io

  • Hey Noah▲656

    A proactive AI executive assistant for founders

    AI · Aug 2026 · heynoah.io

  • Hey HN, We recently built Clipto. It’s a tool that lets you search over terabytes of video, audio, and images on your computer, without relying on the cloud. Motivation: we probably all had this similar experience, we know a moment exists in a video or audio, but finding it takes hours scrubbing the timeline. You can send all the media to process in the cloud, but it’s slow, expensive and raises privacy concerns. So we decided to build our own on-device media search engine. How it works (high level): 1. We ingest video, audio, image; normalize formats via ffmpeg; run content analysis to…

    Work · Aug 2026 · clipto.com

  • Hello HN! I found that picking out plausible but diverse skin tones for my digital art and game development projects was kind of difficult, and I got curious about if there was a way to define a color space that made it easy. I've built a color picker and procedural generation algorithm based on the space as well as a bunch of other fun js features and demos throughout the page that use the equations. If you find it interesting, I have lots of explanations of how I built it and what properties the space has. The methodology might be a bit shaky, but hopefully the result is as helpful for…

    Life & fun · Aug 2026 · toneyalexander.github.io

  • AdAnt AI▲620

    Claude for viral, high-converting social ads

    AI · Aug 2026 · adant.ai

  • Astute▲606

    Automate your B2B brand going viral, with new media creators

    AI · Aug 2026 · company-app.joinastute.com