Costco for LLM Tokens

What it does

Blazing fast inference for open-source, custom, and fine-tuned AI models at massive scale. Automatically capture and optimize your LLM performance in production. Serve frontier AI models with confidence. Switch from OpenAI , Anthropic and Gemini to open-source models running on infrastructure optimized specifically for your workload. Everything you need to monitor existing providers, evaluate new models, and deploy at scale. Learn how teams like GravityAds and Cal AI use Inference.net to deploy, observe, evaluate, and train GPT-5 quality models at low cost and lightening fast speed. We handle the infrastructure, so you don't have to. Learn how Gravity Ads used Cataylst Train and Deploy to…from inference.net

• 
  General ComputeMay 2026 · generalcompute.com · ▲315

  AI models that run on an inference cloud optimized for speed

• 
  Awan LLM2024 · awanllm.com · ▲95

  Cost effective LLM inference API for startups & developers

• 
  TensorZero2025 · github.com · ▲307

  Hi HN! We're Gabriel & Viraj, and we're excited to open source TensorZero. To be a little cheeky, TensorZero is an open-source platform that helps LLM applications graduate from API wrappers into defensible AI products. 1. Integrate our model gateway 2. Send metrics or feedback 3. Unlock compounding improvements in quality, cost, and latency It enables a data & learning flywheel for LLMs by unifying: • Inference: one API for all LLMs, with <1ms P99 overhead • Observability: inference & feedback → your database • Optimization: better prompts, models, inference strategies • Experimentation:…

• 
  LLM Explorer2023 · ▲152

  Find your best LLM for a local inference

• 
  SelfHostLLM2025 · selfhostllm.org · ▲134

  A simple calculator that estimates how many concurrent requests your GPU can handle for a given LLM, with shareable results.

• 
  LLM, a Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)2023 · github.com · ▲45

  G'day, HN! I'm one of the maintainers of `llm`. I've been working alongside a trusty group of contributors to bring this project to life, and we're now at a point where we're ready to share it with the world. Large language models (LLMs) are taking the computing world by storm due to their emergent abilities that allow them to perform a wide variety of tasks, including translation, summarization, code generation, and even some degree of reasoning. However, the ecosystem around LLMs is still in its infancy, and it can be difficult to get started with these models. `llm` is a one-stop shop for…

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 17d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 17d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 19d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 20d ago · stillwet.art

• 
  PixVerse R2▲381

  A real-time world model you can explore and change

  AI · 29d ago · world.pixverse.video

• 
  Hemory▲381

  Keep listening. Searchable memory for your AI agents.

  AI · 29d ago · hemory.com

• 
  buzzabout▲1,267

  Audience insights from 1B+ online discussions in 2 mins

  AI · 2024 · buzzabout.ai

• 
  bolt.new▲1,230

  Build and scale high-performing websites & apps using your words. Join millions and start building today.

  AI · 2024 · bolt.new

• 
  Feta▲1,217

  Run smarter stand-ups, build better products

  AI · 2024 · feta.io

• 
  Trag▲955

  AI code review companion

  AI · 2024 · usetrag.com

• 
  Softr for Notion▲923

  Turn Notion databases into portals & apps with no code

  Dev tools · 2024 · softr.io

• 
  General Collaboration▲910

  One inbox for all your work discussions

  Work · 2024 · generalcollaboration.com