nowfound

AI · alternatives · 2026

24 alternatives to The Grid

Spot market API for cheaper LLM inference

Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Prices are shown for the 1 we have checked on their own sites, 1 of them free or with a free tier.

  1. 1

    Hi HN! We're Gabriel & Viraj, and we're excited to open source TensorZero. To be a little cheeky, TensorZero is an open-source platform that helps LLM applications graduate from API wrappers into defensible AI products. 1. Integrate our model gateway 2. Send metrics or feedback 3. Unlock compounding improvements in quality, cost, and latency It enables a data & learning flywheel for LLMs by unifying: • Inference: one API for all LLMs, with <1ms P99 overhead • Observability: inference & feedback → your database • Optimization: better prompts, models, inference strategies • Experimentation:…

    2025 · github.com · its alternatives →

  2. 2
    LLM Stats▲293

    I was overspending on GPT-4o. It was really hard to compare different models I could switch to, so I built this LLM comparison tool. It shows leaderboards, pricing, and performance data across 100+ LLMs (including all major providers and open-source models). Key features: - Live pricing comparisons - Benchmark Scores (MMLU, HumanEval, GPQA, etc.) - Context length vs cost analysis - Speed&#x2F;throughput tests across providers - Quality vs price visualizations - Open source (all data verifiable) Try it out: https:&#x2F;&#x2F;llmstats.com I'd like to know your opinion :) Tech stack: Next.js,…

    Oct 2025 · llm-stats.com · its alternatives →

  3. 3

    Cost effective LLM inference API for startups & developers

    2024 · awanllm.com · its alternatives →

  4. 4

    LLMs price comparison tool developed and updated by LLM

    2024 · ailesson.io · its alternatives →

  5. 5

    Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM - jmaczan/tiny-vllm

    May 2026 · github.com · its alternatives →

  6. 6

    Find your best LLM for a local inference

    2023 · its alternatives →

  7. 7
    LLM Gatewayfree tier▲296

    I built an OpenAI-compatible LLM gateway that routes requests to OpenAI, Anthropic, Ollama, vLLM, llama-server, SGLang... anything that speaks &#x2F;v1&#x2F;chat&#x2F;completions. Single Go binary, one YAML config file, no infrastructure. It does the things you'd expect from this kind of gateway... semantic routing via a three-layer cascade (keyword heuristics, embedding similarity, LLM classifier) that picks the best model when clients omit the model field, weighted round-robin load balancing across local inference servers with health checks and failover. The part I think is most…

    2025 · llmgateway.io · its alternatives →

  8. 8

    G'day, HN! I'm one of the maintainers of `llm`. I've been working alongside a trusty group of contributors to bring this project to life, and we're now at a point where we're ready to share it with the world. Large language models (LLMs) are taking the computing world by storm due to their emergent abilities that allow them to perform a wide variety of tasks, including translation, summarization, code generation, and even some degree of reasoning. However, the ecosystem around LLMs is still in its infancy, and it can be difficult to get started with these models. `llm` is a one-stop shop for…

    2023 · github.com · its alternatives →

  9. 9

    Looking for the cheapest place to deploy llama 3.1 model? Don't worry we have found it so you don't have to.

    2024 · github.com · its alternatives →

  10. 10

    LLM Provider arbitrage to get the best performance for the $

    2025 · makehub.ai · its alternatives →

  11. 11

    LLM router where providers compete for every prompt

    15d ago · liquidinference.ai · its alternatives →

  12. 12

    A simple calculator that estimates how many concurrent requests your GPU can handle for a given LLM, with shareable results.

    2025 · selfhostllm.org · its alternatives →

  13. 13

    Test LLM prompts & models side-by-side against many inputs

    2024 · its alternatives →

  14. 14

    Christmas project from a personal need to find ideal locations.

    2024 · godview.ai · its alternatives →

  15. 15

    Hi HN! Excited to show off the project we've been working on for the last couple months. We started with an idea for a crazy twist on prediction markets: You come up with a question for traders to predict, and then decide the outcome yourself. For example, you could create a market on “Will my date with [X] go well?” Anyone can bet on it, and the bets create a forecast on the chance your date goes well. After the date is over, you get to judge the result and reward the traders who picked the correct side. There are so many ways for this mechanism to go wrong: the creator of the market can be…

    2022 · manifold.markets · its alternatives →

  16. 16

    Free open-source GEO tracker for LLM visibility

    Apr 2026 · oneglanse.com · its alternatives →

  17. 17AT

    I recently built a small open-source tool to benchmark different LLM API endpoints — including OpenAI, Claude, and self-hosted models (like llama.cpp). It runs a configurable number of test requests and reports two key metrics: • First-token latency (ms): How long it takes for the first token to appear • Output speed (tokens&#x2F;sec): Overall output fluency Demo: https:&#x2F;&#x2F;llmapitest.com&#x2F; Code: https:&#x2F;&#x2F;github.com&#x2F;qjr87&#x2F;llm-api-test The goal is to provide a simple, visual, and reproducible way to evaluate performance across different LLM providers, including…

    2025 · llmapitest.com · its alternatives →

  18. 18

    Track and improve your visibility on AI Search

    Dec 2025 · llmpulse.ai · its alternatives →

  19. 19

    Hi HN, We’re building https:&#x2F;&#x2F;www.switchpoint.dev – a drop-in replacement for OpenAI’s API that reduces LLM cost by smartly routing across models (e.g., Claude, Gemini, GPT-4) depending on subject and difficulty of the task. Why we built this: LLM costs are spiraling—especially for products doing retrieval, agentic reasoning, or even just high-volume chat. We were frustrated with paying GPT-4 rates when most queries didn’t need it. So we built a router that: - Starts with cheaper&#x2F;free models (like Llama 8B, 4o-mini, 2.0 flash) - Streams responses and upgrades on failure - Acts…

    2025 · switchpoint.dev · its alternatives →

  20. 20

    An open source Next app template to monitor your AI apps

    2025 · github.com · its alternatives →

  21. 21

    The context manager and skills library for marketing teams

    Apr 2026 · promptr.ai · its alternatives →

  22. 22AL

    Hi HN! We partnered with the Atlas team to build a tool called AI Predict [0] that allows anyone to ask any question about the future and get a thoroughly researched, AI-generated prediction on how likely it is to be true. How it works: Atlas replicated a Berkeley paper [1] that showed LLMs could make predictions as accurate as the crowd. We’re using a mix of models from OpenAI and Anthropic, with information retrieval powered by NewsCatcher [2]. The system is live and fully functional, though it might struggle with hyper-local questions outside of the public domain (e.g., “Will I have…

    2024 · aipredict.fun · its alternatives →

  23. 23

    Current AI-assisted CLI tools are often part of larger systems and work better on Linux. I built llm-term to address these. It's a Rust-based tool that compiles into a single binary file. You only need to download the binary, add it to your PATH, and configure your OpenAI key to get started. While llm-term offers an option for gpt-4o, it works great with gpt-4o-mini. So it's not costly. I appreciate any feedback or suggestions.

    2024 · github.com · its alternatives →

  24. 24

    LLM powered stock predictions

    Oct 2025 · its alternatives →

Also compare

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →