nowfound

Dev tools · June 18, 2026

maslul

Smart LLM router — one call, the right model.

What it does

Smart LLM router — one call, the right model. Async and fully typed, across Anthropic, Gemini, xAI Grok, and OpenAI — routing each request to the right model tier by difficulty. Stop hardcoding model choices and stop re-writing the tool-use / structured-output / web-search / retry plumbing for every provider. Contribute to iliatankelevich/maslul development by creating an account on GitHub.

Does a similar job

all alternatives →
  • AL
    Any-LLM – Lightweight router to access any LLM Provider2025 · github.com · ▲125

    We built any-llm because we needed a lightweight router for LLM providers with minimal overhead. Switching between models is just a string change : update "openai/gpt-4" to "anthropic/claude-3" and you're done. It uses official provider SDKs when available, which helps since providers handle their own compatibility updates. No proxy or gateway service needed either, so getting started is pretty straightforward - just pip install and import. Currently supports 20+ providers including OpenAI, Anthropic, Google, Mistral, and AWS Bedrock. Would love to hear what you think!

  • Unify - Router2024 · ▲304

    The best LLM on every prompt

  • AR
    Arch-Router – 1.5B model for LLM routing by preferences, not benchmarks2025 · ▲66

    Hi HN — we're the team behind Arch (https://github.com/katanemo/archgw), an open-source proxy for LLMs written in Rust. Today we're releasing Arch-Router (https://huggingface.co/katanemo/Arch-Router-1.5B), a 1.5B router model for preference-based routing, now integrated into the proxy. As teams integrate multiple LLMs - each with different strengths, styles, or cost/latency profiles — routing the right prompt to the right model becomes a critical part of the application design. But it's still an open problem. Most routing systems fall into two…

  • LLM Gateway2025 · ▲296

    Use any AI model with just one API

  • ModelPilotNov 2025 · ▲94

    Optimize Performance, Cost, Speed & Carbon for each prompt

  • RY
    Route your prompts to the best LLM2024 · unify.ai · ▲298

    Hey HN, we've just finished building a dynamic router for LLMs, which takes each prompt and sends it to the most appropriate model and provider. We'd love to know what you think! Here is a quick(ish) screen-recroding explaining how it works: https://youtu.be/ZpY6SIkBosE Best results when training a custom router on your own prompt data: https://youtu.be/9JYqNbIEac0 The router balances user preferences for quality, speed and cost. The end result is higher quality and faster LLM responses at lower cost. The quality for each candidate LLM is predicted ahead of time…

More dev tools this month

the category →
  • Dograh592

    The open source VAPI alternative

    Dev tools · 26d ago · dograh.com

  • Meridian530

    Don't let your work go unnoticed. Get promoted!

    Dev tools · 21d ago · meridiona.com

  • x1516

    Lovable for iPhone apps go from idea to App Store

    Dev tools · 12d ago · x1.new

  • OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.

    Dev tools · 2d ago · opentrailpaper.com

  • Open-source GTM skills for technical founders

    Dev tools · 30d ago · gtmcofounder.com

  • Nuphos380

    The AI-Native DevOps Workspace.

    Dev tools · 25d ago · nuphos.ai

Launched alongside, June 2026

the whole month →
  • Fundraisly1,544

    AI fundraising agent that finds investors and books meetings

    AI · Jun 2026 · fundraisly.com

  • H6

    Today, I’m proud to announce Homebrew 6.0.0. The most significant changes since 5.1.0 are a new tap trust security mechanism, the new faster, smaller, default internal Homebrew JSON API, sandboxing on Linux, better defaults informed by our user survey, many brew bundle improvements, improved performance and initial support for macOS 27 (Golden Gate). Happy to discuss any questions here!

    Dev tools · Jun 2026 · brew.sh

  • PU

    hope you enjoy

    Life & fun · Jun 2026 · vorpus.github.io

  • Upstream977

    The inbox designed for humans and agents

    AI · Jun 2026 · upstream.do

  • Goldfish962

    Press Option. It knows your work and replies like you

    AI · Jun 2026 · goldfish.sh

  • IM

    Life & fun · Jun 2026 · hackernewstrends.com