nowfound

AI · August 15, 2026

Inferock Bench

Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini, and pinned OpenRouter calls with token usage, failure, and billing-integrity receipts. - inferock/inferock-bench

Inferock Bench launched on August 15, 2026 with 295 votes, #86 of 23,274 launches that month and more than 99% of that year's launches.

In plain words

Inferock Bench is a local proxy that sits between applications and LLM API providers like OpenAI, Anthropic, and Gemini. It tracks token usage, failures, and retries for each API call, then generates receipts showing actual billing charges and overpayment amounts. The tool helps developers understand their LLM spending patterns and identify billing discrepancies across multiple API providers.

written from the facts on this page · September 2026

From the sources

Inferock-bench is a local proxy that sits between your app and OpenAI, Anthropic, Gemini, or OpenRouter shaped calls. It captures per-call token usage, failures, and retries, then generates an independent receipt showing what you were billed and how much you're actually overpaying for.

Does a similar job

all alternatives →
  • Inferock22d ago · inferock.ai · ▲263

    Serverless inference, with credits back for failed calls.

  • TokenwiseJun 2026 · tokenwisehq.com · ▲143

    A smart LLM proxy that shows where you're overpaying

  • ReliAPIDec 2025 · kikuai-lab.github.io · ▲87

    Stop losing money on failed OpenAI and Anthropic API calls.

  • AT
    A tool to benchmark LLM APIs (OpenAI, Claude, local/self-hosted)2025 · llmapitest.com · ▲55

    I recently built a small open-source tool to benchmark different LLM API endpoints — including OpenAI, Claude, and self-hosted models (like llama.cpp). It runs a configurable number of test requests and reports two key metrics: • First-token latency (ms): How long it takes for the first token to appear • Output speed (tokens/sec): Overall output fluency Demo: https://llmapitest.com/ Code: https://github.com/qjr87/llm-api-test The goal is to provide a simple, visual, and reproducible way to evaluate performance across different LLM providers, including…

  • InferbenchAug 2026 · github.com · ▲2

    Benchmarks local LLM engines on your hardware

  • LLMTraceMay 2026 · github.com · ▲7

    Know which commit blew up your LLM bill

More ai this month

the category →
  • Video model that turns script into viral social media videos

    AI · 17d ago · spira.ai

  • The browser where Claude Code and Codex work beside you

    AI · 16d ago · rill.love

  • Kolibri is Aleph Alpha

    AI · 18d ago · tej.as

  • Paintings by AI models: programs run through a simulation of oil paint.

    AI · 20d ago · stillwet.art

  • Onepin▲384

    AI voiceover with every name, price and date said right

    AI · 30d ago · onepin.ai

  • A real-time world model you can explore and change

    AI · 28d ago · world.pixverse.video

Source: Product Hunt launch ↗

Launched alongside, August 2026

the whole month →
  • TL

    Life & fun · Aug 2026 · louisabraham.github.io

  • Hey Noah▲656

    A proactive AI executive assistant for founders

    AI · Aug 2026 · heynoah.io

  • Hey HN, We recently built Clipto. It’s a tool that lets you search over terabytes of video, audio, and images on your computer, without relying on the cloud. Motivation: we probably all had this similar experience, we know a moment exists in a video or audio, but finding it takes hours scrubbing the timeline. You can send all the media to process in the cloud, but it’s slow, expensive and raises privacy concerns. So we decided to build our own on-device media search engine. How it works (high level): 1. We ingest video, audio, image; normalize formats via ffmpeg; run content analysis to…

    Work · Aug 2026 · clipto.com

  • Hello HN! I found that picking out plausible but diverse skin tones for my digital art and game development projects was kind of difficult, and I got curious about if there was a way to define a color space that made it easy. I've built a color picker and procedural generation algorithm based on the space as well as a bunch of other fun js features and demos throughout the page that use the equations. If you find it interesting, I have lots of explanations of how I built it and what properties the space has. The methodology might be a bit shaky, but hopefully the result is as helpful for…

    Life & fun · Aug 2026 · toneyalexander.github.io

  • AdAnt AI▲620

    Claude for viral, high-converting social ads

    AI · Aug 2026 · adant.ai

  • Astute▲606

    Automate your B2B brand going viral, with new media creators

    AI · Aug 2026 · company-app.joinastute.com