AI · alternatives · 2026
24 alternatives to Open Source LLM Performance Tracker
An open source Next app template to monitor your AI apps
Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes.
- 1
traceAI▲273Open-source LLM tracing that speaks GenAI, not HTTP.
Apr 2026 · github.com · its alternatives →
- 2
LLM Stats▲293I was overspending on GPT-4o. It was really hard to compare different models I could switch to, so I built this LLM comparison tool. It shows leaderboards, pricing, and performance data across 100+ LLMs (including all major providers and open-source models). Key features: - Live pricing comparisons - Benchmark Scores (MMLU, HumanEval, GPQA, etc.) - Context length vs cost analysis - Speed/throughput tests across providers - Quality vs price visualizations - Open source (all data verifiable) Try it out: https://llmstats.com I'd like to know your opinion :) Tech stack: Next.js,…
Oct 2025 · llm-stats.com · its alternatives →
- 3AT
I recently built a small open-source tool to benchmark different LLM API endpoints — including OpenAI, Claude, and self-hosted models (like llama.cpp). It runs a configurable number of test requests and reports two key metrics: • First-token latency (ms): How long it takes for the first token to appear • Output speed (tokens/sec): Overall output fluency Demo: https://llmapitest.com/ Code: https://github.com/qjr87/llm-api-test The goal is to provide a simple, visual, and reproducible way to evaluate performance across different LLM providers, including…
2025 · llmapitest.com · its alternatives →
- 4
- 5
OneGlanse▲77Free open-source GEO tracker for LLM visibility
Apr 2026 · oneglanse.com · its alternatives →
- 6
LLMWare▲358Dev tool to make AI apps to deploy privately or locally
2024 · llmware.ai · its alternatives →
- 7
LLM SEO Monitor▲526Monitor what ChatGPT, Google Gemini and Claude recommend
2025 · llmseomonitor.com · its alternatives →
- 8
Deepmark AI▲97LLM benchmarking tool for task-specific metrics on your data
2023 · github.com · its alternatives →
- 9Langtrace AI▲119
Improve your LLM apps with open-source observability tool
2024 · langtrace.ai · its alternatives →
- 10
Breadcrumb▲163Open-source LLM tracing for agent visibility
Mar 2026 · breadcrumb.sh · its alternatives →
- 11
LLMrefs▲314AI SEO Keyword Rank Tracker for LLM Search Engines
2025 · llmrefs.com · its alternatives →
- 12
Vibe-check many open-source and proprietary LLMs at once
2024 · its alternatives →
- 13
TensorZero▲307Hi HN! We're Gabriel & Viraj, and we're excited to open source TensorZero. To be a little cheeky, TensorZero is an open-source platform that helps LLM applications graduate from API wrappers into defensible AI products. 1. Integrate our model gateway 2. Send metrics or feedback 3. Unlock compounding improvements in quality, cost, and latency It enables a data & learning flywheel for LLMs by unifying: • Inference: one API for all LLMs, with <1ms P99 overhead • Observability: inference & feedback → your database • Optimization: better prompts, models, inference strategies • Experimentation:…
2025 · github.com · its alternatives →
- 14
If you've built any web-based app in the last 15 years, you probably used something like Datadog, New Relic, Sentry, etc. to monitor and trace your app, right? Why should it be different when the app you're building happens to be using LLMs? So today we're open-sourcing OpenLLMetry-JS. It's an open protocol and SDK, based on OpenTelemetry, that provides traces and metrics for LLM JS/TS applications and can be connected to any of the 15+ tools that already support OpenTelemetry. Here's the repo: https://github.com/traceloop/openllmetry-js A few months ago we launched…
2024 · github.com · its alternatives →
- 15
Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly. - Andyyyy64/whichllm
May 2026 · github.com · its alternatives →
- 16
Hey Folks! I've been building an open source benchmark for measuring local LLM performance on your own hardware. The benchmarking tool is a CLI written on top of Llamafile to allow for portability across different hardware setups and operating systems. The website is a database of results from the benchmark, allowing you to explore the performance of different models and hardware configurations. Please give it a try! Any feedback and contribution is much appreciated. I'd love for this to serve as a helpful resource for the local AI community. For more check out: - Website:…
2025 · localscore.ai · its alternatives →
- 17
Aggregate uptime monitoring across OpenAI, Claude, and more
Apr 2026 · tools.lamatic.ai · its alternatives →
- 18
- 19
Open source APM: OpenTelemetry traces, metrics, and logs - uptrace/uptrace
2023 · github.com · its alternatives →
- 20
Validate, monitor, and safeguard LLM-based apps
2023 · deepchecks.com · its alternatives →
- 21UD
Hey HN! I’m the founder of Unify, and we’ve just released our Model Hub, which provides a collection of LLM endpoints with live runtime benchmarks all plotted across time: https://unify.ai/hub A key finding is that static tabular runtime benchmarks for LLMs simply do not work. It’s necessary to take a time-series perspective, and plot the variations through time. We currently have 21 models provided by: Anyscale, Perplexity AI, Replicate, Together AI, OctoAI, Mistral AI and OpenAI, with more on the roadmap. We test across different regions (Asia, US, Europe), with varied…
2024 · its alternatives →
- 22
Open source Google Reviews analyzer project using LLM
2023 · github.com · its alternatives →
- 23
- 24
Also compare
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →