nowfound

AI · alternatives · 2026

24 alternatives to Liquid Inference

LLM router where providers compete for every prompt

Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes.

  1. 1RY

    Hey HN, we've just finished building a dynamic router for LLMs, which takes each prompt and sends it to the most appropriate model and provider. We'd love to know what you think! Here is a quick(ish) screen-recroding explaining how it works: https://youtu.be/ZpY6SIkBosE Best results when training a custom router on your own prompt data: https://youtu.be/9JYqNbIEac0 The router balances user preferences for quality, speed and cost. The end result is higher quality and faster LLM responses at lower cost. The quality for each candidate LLM is predicted ahead of time…

    2024 · unify.ai · its alternatives →

  2. 2

    A simple calculator that estimates how many concurrent requests your GPU can handle for a given LLM, with shareable results.

    2025 · selfhostllm.org · its alternatives →

  3. 3
  4. 4

    Intelligent model routing for code, agents and workflows

    20d ago · asterwise.dev · its alternatives →

  5. 5

    Spot market API for cheaper LLM inference

    May 2026 · thegrid.ai · its alternatives →

  6. 6

    Cost effective LLM inference API for startups & developers

    2024 · awanllm.com · its alternatives →

  7. 7

    Pool compute to run powerful open models

    Apr 2026 · anarchai.org · its alternatives →

  8. 8

    Nowadays, a common AI tech stack has hundreds of different prompts running across different LLMs. Three key problems: - Choices, picking from 100s of LLMs the best LLM for that 1 prompt is gonna be challenging, you're probably not picking the most optimized LLM for a prompt you wrote. - Scaling/Upgrading, similar to choices but you want to keep consistency of your output even when models depreciate or configurations change. - Prompt management is scary, if something works, you'll never want to touch it but you should be able to without fear of everything breaking. So we launched Prompt…

    2024 · jigsawstack.com · its alternatives →

  9. 9

    A fast decision layer for smarter AI tool routing.

    25d ago · harness-router.vercel.app · its alternatives →

  10. 10

    An AI Cost Optimization Infrastructure for LLM Applications

    Mar 2026 · getpromptly.in · its alternatives →

  11. 11

    Hey HN, I've been building AutoAgents, an AI agent framework in Rust. Today I'm sharing a feature I haven't seen done well elsewhere: composable middleware layers for LLM inference pipelines. The problem Every agent framework lets you swap LLM providers. Almost none of them give you a structured way to enforce safety, caching, or data sanitization in the inference path itself. You end up with guardrails as application-level if-statements, caching bolted on as a separate service, and PII handling as a "we'll add it later" TODO that never ships. This gets worse with local models. Cloud APIs…

    Mar 2026 · github.com · its alternatives →

  12. 12

    Run local LLMs across heterogeneous clusters

    Jul 2026 · github.com · its alternatives →

  13. 13
  14. 14CO
  15. 15

    Witness-Centered Filter Layer for LLM Applications - SpecStudio-net/Vivek

    Jun 2026 · github.com · its alternatives →

  16. 16

    Token-efficiency linter for LLM prompts and payloads - ritenv/tokensift

    Aug 2026 · github.com · its alternatives →

  17. 17
    Narev▲7

    Hey! I want to get your feedback on our A/B testing platform for LLMs. Giving a 100 day Pro trial to anyone who signs up this week. The premise: in 10 minutes compare a bunch of model/parameter/prompt combos to find the best point on the quality-latency-cost tradeoff. Enter your data manually or sync from your tracing platform. ~300 models to select from. Here is a 1 minute Loom: https://www.loom.com/share/39b7cd24166c4e1fafd5e7fbd12a9d4d?...

    2025 · narev.ai · its alternatives →

  18. 18

    The agent-native LLM router for autonomous agents. Every frontier model behind one wallet, <1ms local routing, USDC payments on Base & Solana via x402. - BlockRunAI/ClawRouter

    Feb 2026 · github.com · its alternatives →

  19. 19
  20. 20

    Smart LLM routing to cut AI costs by up to 90%

    Jan 2026 · decisor.io · its alternatives →

  21. 21

    The Smartest AI Gateway for Developers

    Jun 2026 · megallm.io · its alternatives →

  22. 22

    Open-weight models, fully deterministic. The same answer every time, byte for byte, at the floor price.

    Sep 2026 · tokendelivery.ai · its alternatives →

  23. 23CL
  24. 24

    Hi HN, I'm pleased to share Promptspot, an open-source (Apache License 2.0) project that helps automate testing of large language model (LLM) prompts against an array of input data. Modern LLMs offer an enormous amount of leverage if you "teach the bot to fish" — i.e. simply prompt it with both a "system prompt" (which typically doesn't change often) and a dynamic input, which is often application state, search results, recent activity, user profile data, etc. Existing playgrounds and prompt management systems often lack the rigor and flexibility required for this dynamic approach — and as…

    2023 · github.com · its alternatives →

Also compare

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →