Townsend AI Platform

What it does

GPU inference API on owned hardware. No cloud markup. - Emotion detection: 16ms P50 (Azure: 200-400ms, same price) - CRISPR design: $1/1k (Benchling: $20k+/yr, sales call required) - Protein folding: sub-10s vs hours on AlphaFold - LLM: 97% cheaper than OpenAI, data never leaves server - Compression: 5-8x ratios, no competitor offers this as API Free tier, no credit card.

• 
  I've built a locally running Perplexity clone2024 · github.com · ▲669

  The video demo runs a 7b Model on a normal gaming GPU. I think it already works quite well (accounting for the limited hardware power). :)

• 
  General ComputeMay 2026 · generalcompute.com · ▲315

  AI models that run on an inference cloud optimized for speed

• 
  TensorZero2025 · github.com · ▲307

  Hi HN! We're Gabriel & Viraj, and we're excited to open source TensorZero. To be a little cheeky, TensorZero is an open-source platform that helps LLM applications graduate from API wrappers into defensible AI products. 1. Integrate our model gateway 2. Send metrics or feedback 3. Unlock compounding improvements in quality, cost, and latency It enables a data & learning flywheel for LLMs by unifying: • Inference: one API for all LLMs, with <1ms P99 overhead • Observability: inference & feedback → your database • Optimization: better prompts, models, inference strategies • Experimentation:…

• WM
  We made glhf.chat – run almost any open-source LLM, including 405B2024 · glhf.chat · ▲161

  Try it out! https:&#x2F;&#x2F;glhf.chat&#x2F; Hey HN! We’ve been working for the past few months on a website to let you easily run (almost) any open-source LLM on autoscaling GPU clusters. It’s free for now while we figure out how to price it, but we expect to be cheaper than most GPU offerings since we can run the models multi-tenant. Unlike Together AI, Fireworks, etc, we’ll run any model that the open-source vLLM project supports: we don’t have a hardcoded list. If you want a specific model or finetune, you don’t have to ask us for it: you can just paste the Hugging Face link in and…

• 
  Netmind Power2023 · netmind.ai · ▲272

  Hi HN, We just opened public access to Qwen3‑Coder‑480B‑A35B‑Instruct via a REST&#x2F;SDK API. Why it might be interesting: - Fully open-source (Apache‑2.0): https:&#x2F;&#x2F;github.com&#x2F;QwenLM&#x2F;Qwen3-Coder - 480B params (35B active MoE), long context up to 1M tokens with YaRN - Matches Claude Sonnet&#x2F;GPT‑4o on SWE-Bench Verified (81.6%) - Free tier: 100K tokens&#x2F;month

• SS
  sllm – Split a GPU node with other developers, unlimited tokensApr 2026 · sllm.cloud · ▲188

  Running DeepSeek V3 (685B) requires 8×H100 GPUs which is about $14k&#x2F;month. Most developers only need 15-25 tok&#x2F;s. sllm lets you join a cohort of developers sharing a dedicated node. You reserve a spot with your card, and nobody is charged until the cohort fills. Prices start at $5&#x2F;mo for smaller models. The LLMs are completely private (we don't log any traffic). The API is OpenAI-compatible (we run vLLM), so you just swap the base URL. Currently offering a few models.

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 20d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 20d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 22d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 23d ago · stillwet.art

• 
  Beam.win▲377

  Run AI agents on one Mac and use its windows on another

  AI · 6d ago · beam.win

• 
  FastRouter.ai▲364

  Route requests to the right LLM for cost, latency & quality

  AI · 24d ago · fastrouter.ai

• 
  Brew ▲900

  Like Claude design for email marketing

  AI · May 2026 · brew.new

• 
  Kilo Code for VS Code▲896

  Parallel agents, diff reviewer, and multi-model comparisons

  Dev tools · May 2026 · kilo.ai

• 
  StoreClaw▲806

  Grow your store profits with agents that know how to sell

  AI · May 2026 · storeclaw.ai

• 
  PollyReach▲795

  Give your agent a real number and voice to make calls.

  AI · May 2026 · pollyreach.ai

• 
  Needle: We Distilled Gemini Tool Calling into a 26M Model▲776

  Hey HN, Henry here from Cactus. We open-sourced Needle, a 26M parameter function-calling (tool use) model. It runs at 6000 tok&#x2F;s prefill and 1200 tok&#x2F;s decode on consumer devices. We were always frustrated by the little effort made towards building agentic models that run on budget phones, so we conducted investigations that led to an observation: agentic experiences are built upon tool calling, and massive models are overkill for it. Tool calling is fundamentally retrieval-and-assembly (match query to tool name, extract argument values, emit JSON), not reasoning. Cross-attention…

  Life & fun · May 2026 · github.com

• 
  Files.md – Open-source alternative to Obsidian▲730

  🌱 Private, quiet space for thinking. Simple app for .md files. - zakirullin/files.md

  Dev tools · May 2026 · github.com