AI · alternatives · 2026

24 alternatives to Metrik

Real-Time LLM Latency Tracker and Fastest-Model Router

Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Prices are shown for the 2 we have checked on their own sites, 2 of them free or with a free tier.

1
I built a sub-500ms latency voice agent from scratch▲570
I built a voice agent from scratch that averages ~400ms end-to-end latency (phone stop → first syllable). That’s with full STT → LLM → TTS in the loop, clean barge-ins, and no precomputed responses. What moved the needle: Voice is a turn-taking problem, not a transcription problem. VAD alone fails; you need semantic end-of-turn detection. The system reduces to one loop: speaking vs listening. The two transitions - cancel instantly on barge-in, respond instantly on end-of-turn - define the experience. STT → LLM → TTS must stream. Sequential pipelines are dead on arrival for natural…
Mar 2026 · ntik.me · its alternatives →
2
Kitten TTS – 25MB CPU-Only, Open-Source TTS Model▲1,003
Kitten TTS is an open-source series of tiny and expressive text-to-speech models for on-device applications. We are excited to launch a preview of our smallest model, which is less than 25 MB. This model has 15M parameters. This release supports English text-to-speech applications in eight voices: four male and four female. The model is quantized to int8 + fp16, and it uses onnx for runtime. The model is designed to run literally anywhere eg. raspberry pi, low-end smartphones, wearables, browsers etc. No GPU required! We're releasing this to give early users a sense of the latency and voices…
2025 · github.com · its alternatives →
3
Moonshine Open-Weights STT models – higher accuracy than WhisperLargev3▲316
I wanted to share our new speech to text model, and the library to use them effectively. We're a small startup (six people, sub-$100k monthly GPU budget) so I'm proud of the work the team has done to create streaming STT models with lower word-error rates than OpenAI's largest Whisper model. Admittedly Large v3 is a couple of years old, but we're near the top the HF OpenASR leaderboard, even up against Nvidia's Parakeet family. Anyway, I'd love to get feedback on the models and software, and hear about what people might build with it.
Feb 2026 · github.com · its alternatives →
4
Llmspeed – feel how fast a local LLM runs before you buy the hardware▲330
Pick hardware and a model, and feel the real speed of a local LLM before you buy. Simulates tokens/sec and time-to-first-token from verified benchmarks for GPUs, Macs, and more.
6d ago · llmspeed.dev · its alternatives →
5
Conversational AI 2.0 From ElevenLabs▲652
Luke from ElevenLabs here. We just released Scribe Realtime v2, our new real-time Speech to Text model. We rebuilt it from the ground up around a new architecture that uses predictive transcription – it anticipates the next likely word before it’s spoken. That makes it both fast (around 150 ms latency) and highly accurate. Scribe v2 Realtime outperforms every low latency transcription model across 30 commonly used EU and Asian languages – 93.5% accuracy, compared to Gemini 2.5 Flash (91.4%), GPT-4o MiniTranscribe (90.7%), and Deepgram Nova 3 (85%). It supports 90+ languages including…
2025 · elevenlabs.io · its alternatives →
6
FastRouter.aifree tier, from $199/mo▲364
Route requests to the right LLM for cost, latency & quality
23d ago · fastrouter.ai · its alternatives →
7AT
A tool to benchmark LLM APIs (OpenAI, Claude, local/self-hosted)▲55
I recently built a small open-source tool to benchmark different LLM API endpoints — including OpenAI, Claude, and self-hosted models (like llama.cpp). It runs a configurable number of test requests and reports two key metrics: • First-token latency (ms): How long it takes for the first token to appear • Output speed (tokens/sec): Overall output fluency Demo: https://llmapitest.com/ Code: https://github.com/qjr87/llm-api-test The goal is to provide a simple, visual, and reproducible way to evaluate performance across different LLM providers, including…
2025 · llmapitest.com · its alternatives →
8
traceAI▲273
Open-source LLM tracing that speaks GenAI, not HTTP.
Apr 2026 · github.com · its alternatives →
9
LLM Stats▲293
I was overspending on GPT-4o. It was really hard to compare different models I could switch to, so I built this LLM comparison tool. It shows leaderboards, pricing, and performance data across 100+ LLMs (including all major providers and open-source models). Key features: - Live pricing comparisons - Benchmark Scores (MMLU, HumanEval, GPQA, etc.) - Context length vs cost analysis - Speed/throughput tests across providers - Quality vs price visualizations - Open source (all data verifiable) Try it out: https://llmstats.com I'd like to know your opinion :) Tech stack: Next.js,…
Oct 2025 · llm-stats.com · its alternatives →
10
gpt-realtime-1.5 by OpenAI▲300
Tighter instruction adherence in speech agents
Feb 2026 · developers.openai.com · its alternatives →
11
KugelAudio▲106
Real-time text-to-speech model you can self-host
May 2026 · kugelaudio.com · its alternatives →
12
An open source framework for voice assistants▲346
I've been obsessed for the past ~year with the possibilities of talking to LLMs. I built a bunch of one-off prototypes, shared code on X, started a Meetup group in SF, and co-hosted a big hackathon. It turns out that there are a few low-level problems that everybody building conversational/real-time AI needs to solve on the way to building/shipping something that works well: low-latency media transport, echo cancellation, voice activity detection, phrase endpointing, pipelining data between models/services, handling voice interruptions, swapping out different…
2024 · github.com · its alternatives →
13
Open-source, native audio turn detection model▲126
Our goal with this project is to build a completely open source, state of the art turn detection model that can be used in any voice AI application. I've been experimenting with LLM voice conversations since GPT-4 was first released. (There's a previous front page Show HN about Pipecat, the open source voice AI orchestration framework I work on. [1]) It's been almost two years, and for most of that time, I've been expecting that someone would "solve" turn detection. We all built initial, pretty good 80/20 versions of turn detection on top of VAD (voice activity detection) models. And…
2025 · github.com · its alternatives →
14
AI Observability by OpenObserve▲317
OpenTelemetry-native observability for agents and LLMs
Aug 2026 · openobserve.ai · its alternatives →
15
LLM Gatewayfree tier▲296
I built an OpenAI-compatible LLM gateway that routes requests to OpenAI, Anthropic, Ollama, vLLM, llama-server, SGLang... anything that speaks /v1/chat/completions. Single Go binary, one YAML config file, no infrastructure. It does the things you'd expect from this kind of gateway... semantic routing via a three-layer cascade (keyword heuristics, embedding similarity, LLM classifier) that picks the best model when clients omit the model field, weighted round-robin load balancing across local inference servers with health checks and failover. The part I think is most…
2025 · llmgateway.io · its alternatives →
16
Chert▲210
Vapi for FaceTime: AI video agents in a few lines
Aug 2026 · trychert.com · its alternatives →
17
Nari Qwen3-TTS and Qwen3-ASR – High accuracy, low latency and cost▲91
Nari ranks first in STT latency, second in STT WER, second in TTS latency, and first in TTS WER in Coval’s September 14, 2026 benchmarks.
Sep 2026 · narilabs.com · its alternatives →
18
Kyutai TTS▲181
The voice for your real-time AI applications
2025 · kyutai.org · its alternatives →
19
Nemotron 3 Ultra by NVIDIA▲179
Powers faster, efficient reasoning for long-running agents
Jun 2026 · developer.nvidia.com · its alternatives →
20
Voice Agent API▲118
One API to build production-ready voice agents
Apr 2026 · assemblyai.com · its alternatives →
21
Open Source LLM Performance Tracker▲28
An open source Next app template to monitor your AI apps
2025 · github.com · its alternatives →
22
LLM Region Speed Tester
Measure real-world AI response speed from your country in 3m
Feb 2026 · github.com · its alternatives →
23LI
LLM Inference Calculator – Estimate VRAM, Latency, and Throughput▲6
LLM Inference Calculator — Estimate throughput, latency, TTFT, TPOT, and GPU memory usage for large language model inference. LLM 推理计算器 — 估算大模型推理吞吐量 (throughput)、延迟 (latency)、TTFT、TPOT 与 GPU 显存占用。
Aug 2026 · llm-inference-calculator-delta.vercel.app · its alternatives →
24
A personalised AI tutor with < 1s voice responses▲72
TLDR: We created a personalised Andrej Karpathy tutor that can response to questions about his Youtube videos in sub 1 second responses (voice-to-voice). We do this using a voice enabled RAG agent. See later in the post for demo link, Github Repo and blog write up. A few weeks ago we released the worlds fastest voice bot, achieving 500ms voice-to-voice response times, including a 200ms delay waiting for a user to stop speaking. After reaching the front page of HN, we thought about how we could take this a step further based on feedback we were getting from the community. Many companies were…
2024 · educationbot.cerebrium.ai · its alternatives →

Also compare

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →