Dev tools · alternatives · 2026
24 alternatives to Open-source project – HTTP cache and reverse proxy
Why advCache? Throughput: 160–170k RPS locally; ~250k RPS sustained on 24‑core bare‑metal with a 50GB cache. Memory safety: 1.5–3GB overhead at 50GB (no traces); ~7GB at 100% OTEL sampling. Hot path discipline: zero allocations, sharded counters, per‑shard LRU, TinyLFU admission. Control plane: runtime API for toggles (admission, eviction, refresh, compression, observability). Observability: Prometheus/VictoriaMetrics metrics + OpenTelemetry tracing. Kubernetes‑friendly: health probes, config via ConfigMap, Docker image.
Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes.
- 1
Hello folks, We are launching OpenObserve. An open source Elasticsearch/Splunk/Datadog alternative written in rust and vue that is super easy to get started with and has 140x lower storage cost compared to elasticsearch. It offers logs, metrics, traces, dashboards, alerts, functions (run aws lambda like functions during ingestion and query to enrich, redact, transform, normalize and whatever else you want to do. Think redacting email IDs from logs, adding geolocation based on IP address, etc). You can do all of this from the UI, no messing up with configuration files. OpenObserve…
2023 · github.com · its alternatives →
- 2
Hey HN, we’re the developers of OpenLake, an open source storage engine for offloading LLM KV caches from GPU memory into a shared tier of RAM and NVMe. We built OpenLake because KV caches are outgrowing GPU memory. A single 256K token conversation on Gemma 4 31B produces approximately 43GB of KV state, more than half the memory of an 80GB H100. The problem becomes even harder across a cluster: a prefix cached on one GPU host is unavailable when the next request lands on a different GPU, forcing the new GPU to repeat work the fleet has already completed. Once the KV cache is offloaded,…
Jul 2026 · github.com · its alternatives →
- 3
Hey all, I recently published this Go package, and would like to show off as well as get feedback!
2024 · github.com · its alternatives →
- 42F
oatpp benchmark for 2 Million fully-loaded concurrent websocket connections.
2019 · oatpp.io · its alternatives →
- 5
Over the past few months, we've been building Prism; a fast, developer-first observability UI that's deeply integrated with our open-source database, Parseable. Prism is designed for engineers who debug distributed systems, sometimes at odd hours, and need answers right now, without having to deal with five different tools. Backstory: We spoke to dozens of observability practitioners in large enterprises. Across the board, we heard two things: (1)The RoI on observability tools is hard to justify. (2)OSS leads to tool sprawl, metrics in Grafana, logs in ELK, traces… somewhere. We wanted a…
2022 · parseable.com · its alternatives →
- 6
- 7
Fast caching software with a focus on low latency and cpu efficiency. - tidwall/pogocache
2025 · github.com · its alternatives →
- 8
Fast(est), sharded Go cache with lock-free reads, self-adaptive SieveTinyLFU, batched async writes and HTTP middleware. - unkn0wn-root/kioshun
2025 · github.com · its alternatives →
- 9
A high performance HTTP proxy cache server and RESTful NoSQL cache server based on HAProxy - jiangwenyuan/nuster
2018 · github.com · its alternatives →
- 10
A minimal library for building scalable TCP servers in Erlang - sinasamavati/condor
2018 · github.com · its alternatives →
- 11
Kubernetes cost optimization - catch expensive resource changes before they merge - WozzHQ/wozz
Dec 2025 · github.com · its alternatives →
- 12
Fast PUT/GET/DELETE in-memory key-value store for lookaside caching - jonhoo/cucache
2015 · github.com · its alternatives →
- 13
An ultra-fast, single-binary MCP server written in Rust as a lightweight alternative to Node.js/Python. - StamManif/mcp-stama
Aug 2026 · github.com · its alternatives →
- 14
High-performance cache policies and supporting data structures for Rust systems, with optional metrics and benchmarks. - OxidizeLabs/cachekit
Jan 2026 · github.com · its alternatives →
- 15
Open source security data lake for threat hunting, detection & response, and cybersecurity analytics at petabyte scale on AWS - matanolabs/matano
2022 · github.com · its alternatives →
- 16
Caching reverse proxy for testing written in Go. Contribute to nickpresta/chameleon development by creating an account on GitHub.
2015 · github.com · its alternatives →
- 17
Self-hosted OAuth2 + OIDC auth infrastructure in Rust. Multi-tenant PostgreSQL RLS, WebAuthn passkeys, per-tenant SMTP, AES-256-GCM field-level encryption, <50MB RAM.
May 2026 · ovlt.tech · its alternatives →
- 18
99.9% DeepSeek cache hit, 3-tier context proxy
Jun 2026 · haoyun18881-beep.github.io · its alternatives →
- 19
HTTP load balancer and cache. Contribute to CoderCookE/goaround development by creating an account on GitHub.
2019 · github.com · its alternatives →
- 20
Raymond here from Butter.dev, an LLM response cache built as a chat-completions proxy. Today we're launching a key feature for the platform: the ability to generalize on dynamic, templated inputs. Caching at the HTTP request level has the obvious problem of generalizability. Nearly no request is identical, due to templated variables (like names) and metadata (like timestamps), so exact-match cache lookups rarely hit. We solve this at Butter by using LLMs to detect dynamic content in requests and derive their inter-relationships, allowing the cache entry to be stored as a template + variables…
Jan 2026 · blog.butter.dev · its alternatives →
- 21RC
Hello HN! We're building a caching solution for LLMs (ChatGPT, Claude). By combining cutting-edge approaches, such as edge computing, prompt compression, vectorization, and others - it can reduce your AI bills by up to 10x and significantly lower response times. Key Features: - cost efficiency: our system stores frequent queries, reducing the number of upstream (paid) API calls - fast responses: with various nodes globally, we reduce latency by serving data from the nearest location - scalability: designed to handle increasing loads and data sizes without degrading performance. The cache…
2024 · edgematic.dev · its alternatives →
- 22
Hey folks, As much as we love GPT-4, it's expensive and can be slow at times. That's why we built GPTCache - a semantic cache for autoregressive LMs - atop the vector database Milvus and SQLite. GPTCache provides several benefits: 1) reduced expenses due to minimizing the number of requests and tokens sent to the LLM service 2) enhanced performance by fetching cached query results directly 3) improved scalability and availability by avoiding rate limits, and 4) a flexible development environment that allows developers to verify their application's features without connecting to LLM APIs or…
2023 · github.com · its alternatives →
- 23
Speed up local dev & eliminate external API rate limits
Jun 2026 · github.com · its alternatives →
- 24
Simple and efficient way to show information about Memcache. - hyperia-sk/memcache-info
2017 · github.com · its alternatives →
Also compare
- OpenObserve – Elasticsearch/Datadog alternative alternatives
- Cuts Long Horizon Inference Costs by 50% via external KV Cache Offload alternatives
- Pocache, preemptive optimistic caching for Go alternatives
- 2M fully loaded concurrent WebSockets alternatives
- Parseable Log Storage alternatives
- Turbocache alternatives
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →