AI · alternatives · 2026
24 alternatives to LLM 100k portfolio management benchmark
PoC for something some the potential to yield some interesting results eventually.
LLM 100k Portfolio Management Benchmark is a proof of concept for testing large language models on portfolio management tasks. Available on GitHub, it provides a benchmark dataset or framework for evaluating how well… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes.
- 1
LLM Stats▲293I was overspending on GPT-4o. It was really hard to compare different models I could switch to, so I built this LLM comparison tool. It shows leaderboards, pricing, and performance data across 100+ LLMs (including all major providers and open-source models). Key features: - Live pricing comparisons - Benchmark Scores (MMLU, HumanEval, GPQA, etc.) - Context length vs cost analysis - Speed/throughput tests across providers - Quality vs price visualizations - Open source (all data verifiable) Try it out: https://llmstats.com I'd like to know your opinion :) Tech stack: Next.js,…
Oct 2025 · llm-stats.com · its alternatives →
- 2
Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly. - Andyyyy64/whichllm
May 2026 · github.com · its alternatives →
- 3
Hey Folks! I've been building an open source benchmark for measuring local LLM performance on your own hardware. The benchmarking tool is a CLI written on top of Llamafile to allow for portability across different hardware setups and operating systems. The website is a database of results from the benchmark, allowing you to explore the performance of different models and hardware configurations. Please give it a try! Any feedback and contribution is much appreciated. I'd love for this to serve as a helpful resource for the local AI community. For more check out: - Website:…
2025 · localscore.ai · its alternatives →
- 4
Pick hardware and a model, and feel the real speed of a local LLM before you buy. Simulates tokens/sec and time-to-first-token from verified benchmarks for GPUs, Macs, and more.
6d ago · llmspeed.dev · its alternatives →
- 5
Deepmark AI▲97LLM benchmarking tool for task-specific metrics on your data
2023 · github.com · its alternatives →
- 6AT
I recently built a small open-source tool to benchmark different LLM API endpoints — including OpenAI, Claude, and self-hosted models (like llama.cpp). It runs a configurable number of test requests and reports two key metrics: • First-token latency (ms): How long it takes for the first token to appear • Output speed (tokens/sec): Overall output fluency Demo: https://llmapitest.com/ Code: https://github.com/qjr87/llm-api-test The goal is to provide a simple, visual, and reproducible way to evaluate performance across different LLM providers, including…
2025 · llmapitest.com · its alternatives →
- 7
- 8PT
2024 · adamgrant.info · its alternatives →
- 9
LLM Pricing▲178LLMs price comparison tool developed and updated by LLM
2024 · ailesson.io · its alternatives →
- 10UD
Hey HN! I’m the founder of Unify, and we’ve just released our Model Hub, which provides a collection of LLM endpoints with live runtime benchmarks all plotted across time: https://unify.ai/hub A key finding is that static tabular runtime benchmarks for LLMs simply do not work. It’s necessary to take a time-series perspective, and plot the variations through time. We currently have 21 models provided by: Anyscale, Perplexity AI, Replicate, Together AI, OctoAI, Mistral AI and OpenAI, with more on the roadmap. We test across different regions (Asia, US, Europe), with varied…
2024 · its alternatives →
- 11
Dream 7B▲191Powerful Open Diffusion LLM, Beyond Autoregressive
2025 · hkunlp.github.io · its alternatives →
- 12
Recently I've been working on making LLM evaluations fast by using bayesian optimization to select a sensible subset. Bayesian optimization is used because it’s good for exploration / exploitation of expensive black box (paraphrase, LLM). I would love to hear your thoughts and suggestions on this!
2024 · github.com · its alternatives →
- 13
Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM - jmaczan/tiny-vllm
May 2026 · github.com · its alternatives →
- 14
Unlock your knowledge with 2000 LLM prompts
2023 · miguelanticonam.gumroad.com · its alternatives →
- 15
Hi HN community, I have been working on benchmarking publicly available LLMs these past couple of weeks. More precisely, I am interested on the finetuning piece since a lot of businesses are starting to entertain the idea of self-hosting LLMs trained on their proprietary data rather than relying on third party APIs. To this point, I am tracking the following 4 pillars of evaluation that businesses are typically look into: - Performance - Time to train an LLM - Cost to train an LLM - Inference (throughput / latency / cost per token) For each LLM, my aim is to benchmark them for…
2023 · github.com · its alternatives →
- 16
- 17
G'day, HN! I'm one of the maintainers of `llm`. I've been working alongside a trusty group of contributors to bring this project to life, and we're now at a point where we're ready to share it with the world. Large language models (LLMs) are taking the computing world by storm due to their emergent abilities that allow them to perform a wide variety of tasks, including translation, summarization, code generation, and even some degree of reasoning. However, the ecosystem around LLMs is still in its infancy, and it can be difficult to get started with these models. `llm` is a one-stop shop for…
2023 · github.com · its alternatives →
- 18
PokerBench is my attempt at a new LLM benchmark wherein frontier models play Texas Hold'em in an arena setting. It also features a simulator to view individual games and observe how the different models reason about poker strategy. Opus/Haiku, Gemini Pro/Flash, GPT-5.2/5 mini, and Grok 4.1 Fast Reasoning have all been included. All code -> https://github.com/JoeAzar/pokerbench
Jan 2026 · pokerbench.adfontes.io · its alternatives →
- 19
PKC MARK▲5A local AI benchmark tool for testing LLM, Diffusers, and Transformers models. - PKC0412/pkc-mark-benchmark
Dec 2025 · github.com · its alternatives →
- 20
Test and compare results from Large Language Models (LLMs) simultaneously, including Anthropic's Claude 1.2, OpenAI's GPT-4, GPT-3.5 turbo, and Cohere's CommandXL Nightly. Analyze the results side-by-side in a single UI on top of LLM APIs.
2023 · retool.com · its alternatives →
- 21
The LLM Evaluation Framework. Contribute to confident-ai/deepeval development by creating an account on GitHub.
2023 · github.com · its alternatives →
- 22
Deepmark AI enables a unique testing environment for language models (LLM) assessment on task-specific metrics and on your own data so your GenAI-powered solution has predictable and reliable performance. - IngestAI/deepmark
2023 · github.com · its alternatives →
- 23
An open source Next app template to monitor your AI apps
2025 · github.com · its alternatives →
- 24WM
Pick a Mac and a model, get the memory it needs and the tokens/sec to expect. Covers M1 to M6, every unified memory size, Q4 to FP16. Formula fitted and validated on our own measurements on two machines.
6d ago · macyou.co · its alternatives →
Also compare
- LLM Stats alternatives
- Find the best local LLM for your hardware, ranked by benchmarks alternatives
- LocalScore – Local LLM Benchmark alternatives
- Llmspeed – feel how fast a local LLM runs before you buy the hardware alternatives
- Deepmark AI alternatives
- A tool to benchmark LLM APIs (OpenAI, Claude, local/self-hosted) alternatives
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →