Open Source LLM Performance Tracker
An open source Next app template to monitor your AI apps
Open Source LLM Performance Tracker launched on April 3, 2025 with 28 votes, #752 of 7,818 launches that month and more than 90% of that year's launches. The site was still online in September 2026, 1 year on.
What it does
The LLM Performance Tracker is an open source Next + Tinybird app template built by the engineers at Tinybird to capture LLM call traces and analyze them in real-time.
Contribute to tinybirdco/llm-performance-tracker development by creating an account on GitHub.
This is a template for an LLM performance tracker dashboard and cost calculator. It is built with Next.js and Tinybird . Use this template to bootstrap a multi-tenant, user-facing LLM analytics dashboard and cost calculator. Fork it and make it your own! You can track your own metrics and dimensions. Deploy the template, instrument and use the hosted version to track. # install the tinybird CLI curl https://tinybird.co | sh # select or create a new workspace tb login # deploy the template tb --cloud deploy --template https://github.com/tinybirdco/llm-performance-tracker/tree/main/tinybird Instrumentation Send your data to Tinybird using the Events API . Some examples: # copy the token to…from github.com
Does a similar job
all alternatives →
LLM StatsOct 2025 · llm-stats.com · ▲293I was overspending on GPT-4o. It was really hard to compare different models I could switch to, so I built this LLM comparison tool. It shows leaderboards, pricing, and performance data across 100+ LLMs (including all major providers and open-source models). Key features: - Live pricing comparisons - Benchmark Scores (MMLU, HumanEval, GPQA, etc.) - Context length vs cost analysis - Speed/throughput tests across providers - Quality vs price visualizations - Open source (all data verifiable) Try it out: https://llmstats.com I'd like to know your opinion :) Tech stack: Next.js,…
- ATA tool to benchmark LLM APIs (OpenAI, Claude, local/self-hosted)2025 · llmapitest.com · ▲55
I recently built a small open-source tool to benchmark different LLM API endpoints — including OpenAI, Claude, and self-hosted models (like llama.cpp). It runs a configurable number of test requests and reports two key metrics: • First-token latency (ms): How long it takes for the first token to appear • Output speed (tokens/sec): Overall output fluency Demo: https://llmapitest.com/ Code: https://github.com/qjr87/llm-api-test The goal is to provide a simple, visual, and reproducible way to evaluate performance across different LLM providers, including…
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 21d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 30d ago · world.pixverse.video
Source: Product Hunt launch ↗
Launched alongside, April 2025
the whole month →
Hi everyone, I built PyXL — a hardware processor that executes a custom assembly generated from Python programs, without using a traditional interpreter or virtual machine. It compiles Python -> CPython Bytecode -> Instruction set designed for direct hardware execution. I’m sharing an early benchmark: a GPIO test where PyXL achieves a 480ns round-trip toggle — compared to 14-25 micro seconds on a MicroPython Pyboard - even though PyXL runs at a lower clock (100MHz vs. 168MHz). The design is stack-based, fully pipelined, and preserves Python's dynamic typing without static type restrictions.…
Dev tools · 2025 · runpyxl.com
The Unsure Calculator is an online tool that lets you calculate with numbers you’re not sure about.
Life & fun · 2025 · filiph.github.io
https://the-pocket.github.io/Tutorial-Codebase-Knowledge/
AI · 2025 · github.com
