Raptor

What it does

Rust-powered AI gateway that actually slaps. Semantic caching: 500ms → 8ms. Semantic firewall: catches jailbreaks/malicious actors by intent, not keywords. Hot-patch: fix hallucinations without redeploying. One line change. Free tier. Your API bill will thank you.

Protect your LLM applications with intelligent security and caching

Secure, accelerate, and monitor every move your AI makes in one secure platform. Get security, caching, observability and more without changing a single line of business logic by routing your AI traffic through Raptor. Every feature in Raptor works together - the intelligent layer that understands your traffic, protects your data, and delivers insights in real-time. Automatically detects prompt injections, jailbreaks, and malicious inputs. Highlights threats in real-time with detailed explanations. Uses embedding-based similarity to cache responses - not just exact matches. Reduces API costs by 50%+ with sub-millisecond lookups. See latency breakdowns, token usage, and cost per request.…from raptordata.dev

• 
  TensorZero2025 · github.com · ▲307

  Hi HN! We're Gabriel & Viraj, and we're excited to open source TensorZero. To be a little cheeky, TensorZero is an open-source platform that helps LLM applications graduate from API wrappers into defensible AI products. 1. Integrate our model gateway 2. Send metrics or feedback 3. Unlock compounding improvements in quality, cost, and latency It enables a data & learning flywheel for LLMs by unifying: • Inference: one API for all LLMs, with <1ms P99 overhead • Observability: inference & feedback → your database • Optimization: better prompts, models, inference strategies • Experimentation:…

• 
  The Cloud for AI AgentsNov 2025 · hopx.ai · ▲128

  Spin up secure sandboxes in ~100 ms

• 
  SelfHostLLM2025 · selfhostllm.org · ▲134

  A simple calculator that estimates how many concurrent requests your GPU can handle for a given LLM, with shareable results.

• 
  LLM-Term – Simple Rust-based CLI assist tool2024 · github.com · ▲32

  Current AI-assisted CLI tools are often part of larger systems and work better on Linux. I built llm-term to address these. It's a Rust-based tool that compiles into a single binary file. You only need to download the binary, add it to your PATH, and configure your OpenAI key to get started. While llm-term offers an option for gpt-4o, it works great with gpt-4o-mini. So it's not costly. I appreciate any feedback or suggestions.

• AC
  Agent-cache – Multi-tier LLM/tool/session caching for Valkey and RedisApr 2026 · ▲18

  Multi-tier exact-match cache for AI agents backed by Valkey or Redis. LLM responses, tool results, and session state behind one connection. Framework adapters for LangChain, LangGraph, and Vercel AI SDK. OpenTelemetry and Prometheus built in. No modules required - works on vanilla Valkey 7+ and Redis 6.2+. Shipped v0.1.0 yesterday, v0.2.0 today with cluster mode. Streaming support coming next. Existing options locked you into one tier (LangChain = LLM only, LangGraph = state only) or one framework. This solves both. npm:…

• 
  SemanticGuardMay 2026 · semanticguard.dev · ▲7

  Cuts your LLM API costs by 40-70%. One line of code.

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 17d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 17d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 19d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 20d ago · stillwet.art

• 
  PixVerse R2▲381

  A real-time world model you can explore and change

  AI · 29d ago · world.pixverse.video

• 
  Hemory▲381

  Keep listening. Searchable memory for your AI agents.

  AI · 30d ago · hemory.com

• 
  Guideflow▲1,338

  Create interactive product demos and step-by-step guides in seconds with Guideflow, the leading AI-powered demo automation tool.

  AI · Nov 2025 · guideflow.com

• 
  I built a synth for my daughter▲1,278

  Hardware and software projects by Ali Roberts

  Life & fun · Nov 2025 · bitsnpieces.dev

• 
  Welltory▲1,028

  Measure your wellness. Use data to feel great every day.

  Work · Nov 2025 · welltory.com

• 
  Gemini 3▲1,016

  Bring any idea to life with multimodal capabilities

  AI · Nov 2025 · blog.google

• 
  TrustMRR▲833

  LLM Gateway is a b2b artificial intelligence based in United States, founded in 2025. $259,539/month in verified Stripe revenue. $78,764 MRR. Ahrefs Domain Rating 52/100. growing 55% month-over-month. Track LLM Gateway's verified metrics on TrustMRR.

  Growth · Nov 2025 · trustmrr.com

• 
  Boing▲782

  Life & fun · Nov 2025 · boing.greg.technology