Dev tools · alternatives · 2026
24 alternatives to Benchi – A benchmarking tool written in Go
Benchi is a CLI tool for running benchmarks and collecting metrics. It's using Docker Compose to orchestrate the infrastructure and tools being benchmarked, making it repeatable and runnable on different machines. It allows you to run the same benchmark for different tools and compare the collected results. The repository contains a simple example. For a more elaborate example see how we use Benchi to compare data pipelines running on Conduit and Kafka Connect, two data streaming tools (still work in progress): https://github.com/ConduitIO/streaming-benchmarks
Benchi is a command-line benchmarking tool written in Go that runs performance tests and collects metrics across different software tools. It uses Docker Compose to set up and manage the infrastructure being tested… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes.
- 1
I built BenchFlow, an open-source framework that lets you integrate and evaluate AI tasks using Docker-based benchmarks. You can try it out right now by cloning the repo and running a benchmark in minutes. As an AI researcher, I was frustrated with how much time my team spent setting up benchmark environments rather than actually improving our models. We'd spend weeks configuring environments, only to find inconsistencies when comparing results with other teams. BenchFlow started as an internal tool to standardize our evaluation process, and we decided to open-source it after seeing how much…
2025 · github.com · its alternatives →
- 2
Go HTTP request router and web framework benchmark - julienschmidt/go-http-routing-benchmark
2014 · github.com · its alternatives →
- 3
A generic latency benchmarking library. Contribute to tylertreat/bench development by creating an account on GitHub.
2015 · github.com · its alternatives →
- 4
A command-line benchmarking tool. Contribute to sharkdp/hyperfine development by creating an account on GitHub.
2018 · github.com · its alternatives →
- 5
I built a CLI to benchmark DNS resolvers after discovering DNS was adding 300ms to my API requests. v0.3.0 just released with new features: compare: Test single domain across all resolvers top: Rank resolvers by latency/reliability/balanced monitor: Continuous tracking with threshold alerts 1,400+ downloads in first week. Quick start: pip install dns-benchmark-tool dns-benchmark compare --domain google.com CLI stays free forever. Hosted version (multi-region, historical tracking, alerts) coming Q1 2026. GitHub: https://github.com/frankovo/dns-benchmark-tool…
Nov 2025 · github.com · its alternatives →
- 6
Hey Folks! I've been building an open source benchmark for measuring local LLM performance on your own hardware. The benchmarking tool is a CLI written on top of Llamafile to allow for portability across different hardware setups and operating systems. The website is a database of results from the benchmark, allowing you to explore the performance of different models and hardware configurations. Please give it a try! Any feedback and contribution is much appreciated. I'd love for this to serve as a helpful resource for the local AI community. For more check out: - Website:…
2025 · localscore.ai · its alternatives →
- 7
A command-line benchmarking tool. Contribute to sharkdp/hyperfine development by creating an account on GitHub.
2019 · github.com · its alternatives →
- 8
speed-test-cli▲315Test your download speed using SpeedTest on the command-line
2017 · github.com · its alternatives →
- 9
- 10
Every data pipeline job I had to tackle required quite a few components to set up: - One tool to ingest data - Another one to transform it - If you wanted to run Python, set up an orchestrator - If you need to check the data, a data quality tool Let alone this being hard to set up and taking time, it is also pretty high-maintenance. I had to do a lot of infra work, and while this being billable hours for me I didn’t enjoy the work at all. For some parts of it, there were nice solutions like dbt, but in the end for an end-to-end workflow, it didn’t work. That’s why I decided to build an…
2024 · github.com · its alternatives →
- 11
oqoqo▲325Most benchmarks today exist in curated environments and do not translate well to the real world. We built Oqoqo to bridge this gap. Oqoqo makes it super simple to build realistic evals and custom benchmarks for tasks users actually care about. Oqoqo can: - Reliably measure how agent friendly your product surfaces are against Codex, Claude Code, OpenClaw, Hermes, Pi, Opencode, Cursor, GitHub Copilot - Regression test MCP, CLI, skills, SDK, and any agent facing interface (we are continuously using Oqoqo to dogfood and improve our own MCP/CLI) - Create and share custom benchmarks for how…
Aug 2026 · oqoqo.ai · its alternatives →
- 12
DEPRECATED StackImpact Python Profiler - Production-Grade Performance Profiler: CPU, memory allocations, blocking calls, exceptions, metrics, and more - stackimpact/stackimpact-python
2017 · github.com · its alternatives →
- 13
Middleware▲257Open-source DORA metrics for software engineering teams
2024 · github.com · its alternatives →
- 14
App by Supabase team to run benchmarks automatically in CI
2023 · github.com · its alternatives →
- 15
Bucket DX▲294Co-founder here Reflag is designed for SaaS products that run on TypeScript. We've been working on this for a few years (team of 6). Feedback welcome!
2025 · reflag.com · its alternatives →
- 16
- 17AT
I recently built a small open-source tool to benchmark different LLM API endpoints — including OpenAI, Claude, and self-hosted models (like llama.cpp). It runs a configurable number of test requests and reports two key metrics: • First-token latency (ms): How long it takes for the first token to appear • Output speed (tokens/sec): Overall output fluency Demo: https://llmapitest.com/ Code: https://github.com/qjr87/llm-api-test The goal is to provide a simple, visual, and reproducible way to evaluate performance across different LLM providers, including…
2025 · llmapitest.com · its alternatives →
- 18
Benchmark your SaaS metrics with other startups
2018 · baremetrics.com · its alternatives →
- 19
Speedometer 3.0▲131Benchmarking app performance on the modern web
2024 · github.com · its alternatives →
- 20
Shell GPT▲62CLI tool for developers, helps you accomplish tasks faster
2023 · github.com · its alternatives →
- 21CB
2021 · beta.rocketcompute.com · its alternatives →
- 22
I always had a sweet tooth for how easy it is to use google/benchmark, but when working with js, current libraries didn't feel right and some were not even accurate enough, so I decided to create my own library to make JavaScript benchmarking tooling better. With more free time, I finally implemented all features I wished for in 1.0.0 and made a lightweight C++ single-header version for moments when google/benchmark is too much. Hope this library helps you as much as it does me.
2024 · github.com · its alternatives →
- 23
I wanted to make my own evaluation of what kind of performance I could expect from SQLite on a server and investigate the experimental `BEGIN CONCURRENT` branch vs the inbuilt `DEFERRED` and `IMMEDIATE` behaviors. Explanatory blog post: https://reorchestrate.com/posts/sqlite-transactions/
2024 · github.com · its alternatives →
- 24
Calibre CLI▲38Automating monitoring and improving web performance
2018 · calibreapp.com · its alternatives →
Also compare
- BenchFlow – run AI benchmarks as an API alternatives
- Go HTTP Request Router Benchmark alternatives
- Bench – A generic latency benchmarking library alternatives
- Hyperfine – a command-line benchmarking tool alternatives
- DNS Benchmark Tool – Compare and monitor resolvers alternatives
- LocalScore – Local LLM Benchmark alternatives
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →