nowfound

AI · February 10, 2025

Ollama LLM Throughput Benchmark

Measure & Maximize Ollama LLM Performance Across Hardware

Ollama LLM Throughput Benchmark launched on February 10, 2025 with 9 votes, #2,586 of 5,999 launches that month and more than 50% of that year's launches. The site was still online in September 2026, 1 year on.

What it does

LLM Benchmark for Throughput via Ollama (Local LLMs) 🚀 Benefits: 🔹 IT Teams – Simplify LLM deployment with real insights. 🔹 Decision Makers – Choose hardware confidently with data-driven metrics. 🔹 Developers – Optimize models with precise benchmarks.

LLM Benchmark - Measure throughput performance of local large language models via Ollama

Measure throughput performance of local large language models via Ollama. Compare results across hardware configurations and model variants. Make data-driven decisions about hardware and model selection for your AI infrastructure. One command to benchmark. Results automatically submitted to the community database. Compare performance across Apple Silicon, NVIDIA GPUs, and various CPU configurations. Community-contributed benchmarks from actual hardware setups, not syntheticfrom llm.aidatatools.com

Does a similar job

all alternatives →
  • Find the best local LLM for your hardware, ranked by benchmarksMay 2026 · github.com · ▲283

    Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly. - Andyyyy64/whichllm

  • LocalScore – Local LLM Benchmark2025 · localscore.ai · ▲124

    Hey Folks! I've been building an open source benchmark for measuring local LLM performance on your own hardware. The benchmarking tool is a CLI written on top of Llamafile to allow for portability across different hardware setups and operating systems. The website is a database of results from the benchmark, allowing you to explore the performance of different models and hardware configurations. Please give it a try! Any feedback and contribution is much appreciated. I'd love for this to serve as a helpful resource for the local AI community. For more check out: - Website:…

  • AT
    A tool to benchmark LLM APIs (OpenAI, Claude, local/self-hosted)2025 · llmapitest.com · ▲55

    I recently built a small open-source tool to benchmark different LLM API endpoints — including OpenAI, Claude, and self-hosted models (like llama.cpp). It runs a configurable number of test requests and reports two key metrics: • First-token latency (ms): How long it takes for the first token to appear • Output speed (tokens/sec): Overall output fluency Demo: https://llmapitest.com/ Code: https://github.com/qjr87/llm-api-test The goal is to provide a simple, visual, and reproducible way to evaluate performance across different LLM providers, including…

  • Ollama – Run LLMs on your Mac2023 · github.com · ▲284

    Hi HN A few folks and I have been working on this project for a couple weeks now. After previously working on the Docker project for a number of years (both on the container runtime and image registry side), the recent rise in open source language models made us think something similar needed to exist for large language models too. While not exactly the same as running linux containers, running LLMs shares quite a few of the same challenges. There are "base layers" (e.g. models like Llama 2), specific configuration to run correctly (parameters, temperature, context window sizes etc). There's…

  • LLM StatsOct 2025 · llm-stats.com · ▲293

    I was overspending on GPT-4o. It was really hard to compare different models I could switch to, so I built this LLM comparison tool. It shows leaderboards, pricing, and performance data across 100+ LLMs (including all major providers and open-source models). Key features: - Live pricing comparisons - Benchmark Scores (MMLU, HumanEval, GPQA, etc.) - Context length vs cost analysis - Speed/throughput tests across providers - Quality vs price visualizations - Open source (all data verifiable) Try it out: https://llmstats.com I'd like to know your opinion :) Tech stack: Next.js,…

  • Ollama v0.19Apr 2026 · ollama.com · ▲410

    Massive local model speedup on Apple Silicon with MLX

More ai this month

the category →
  • Video model that turns script into viral social media videos

    AI · 17d ago · spira.ai

  • The browser where Claude Code and Codex work beside you

    AI · 16d ago · rill.love

  • Kolibri is Aleph Alpha

    AI · 18d ago · tej.as

  • Paintings by AI models: programs run through a simulation of oil paint.

    AI · 20d ago · stillwet.art

  • Onepin▲384

    AI voiceover with every name, price and date said right

    AI · 30d ago · onepin.ai

  • A real-time world model you can explore and change

    AI · 28d ago · world.pixverse.video

Source: Product Hunt launch ↗

Launched alongside, February 2025

the whole month →
  • Beautiful screen recordings with instant shareable links

    Growth · 2025 · screen.studio

  • Tana▲1,665

    Put your notes to work with voice and AI

    AI · 2025 · tana.inc

  • IG

    I was at FB/Meta from late 2013 to early 2023, mostly working in the compiler/runtime spaces. I got hit in the spring 2023 layoff wave. I immediately started making games in my newfound free time (a lifelong interest, and I even worked in AA(A?) back ca. ~2000), and in October 2023 I stumbled upon the idea of a roguelike pachinko/plinko game inspired by Luck Be A Landlord. Things snowballed quickly, I started talking to publishers, then worked like crazy through all of 2024, almost the hardest I've ever worked in my career, and launched the game in December 2024. It's sold…

    Work · 2025

  • Tanka▲1,410

    AI Messenger with smart reply & long term memory for teams

    AI · 2025 · tanka.ai

  • Tool Finder▲1,327

    Your shortcut to better software

    AI · 2025 · toolfinder.com

  • i wanted to change the habit of reaching for my phone in the morning and doomscrolling away an hour so i built an app to help me. now i have to literally touch grass before accessing my most distracting apps the app is built in swiftui, uses the screen time apis provided by apple and google vision to recognise grass or not i'd love to get your thoughts on the concept.

    Life & fun · 2025 · touchgrass.now