Alternatives
Products that do what tokmon – CLI to monitor your program's OpenAI token costs does
- 1
- 2
- 3
I started leaning in on AI heavily this year, as I wanted to get more done autonomously, but then my token usage climbed dramatically to the point where my weekly quota would run out before the end of the week, sometimes a couple of days into the week. I realised I had to do something about it else I'd have to double my spend. So I decided to start tracking my cost per task type. This revealed that a lot of my spend went to searches/scans or simple things like scouting tasks. I then decided to turn this into a simple CLI tool that can be used to read your OpenAI-style logs locally, and…
Jul 2026 · github.com
- 4
- 5
- 6TA
TokenDagger is a drop-in replacement for OpenAI’s Tiktoken (the tokenizer behind Llama 3, Mistral, GPT-3.*, etc.). It’s written in C++ 17 with thin Python bindings, keeps the exact same BPE vocab/special-token rules, and focuses on raw speed. I’m teaching myself LLM internals by re-implementing the stack from first principles. Profiling TikToken’s Python/Rust implementation showed a lot of time was spent doing regex matching. Most of my perf gains come from a) using a faster jit-compiled regex engine; and b) simplifying the algorithm to forego regex matching special tokens at all.…
2025 · github.com
- 7
- 8
- 9
- 10
- 11AT
I recently built a small open-source tool to benchmark different LLM API endpoints — including OpenAI, Claude, and self-hosted models (like llama.cpp). It runs a configurable number of test requests and reports two key metrics: • First-token latency (ms): How long it takes for the first token to appear • Output speed (tokens/sec): Overall output fluency Demo: https://llmapitest.com/ Code: https://github.com/qjr87/llm-api-test The goal is to provide a simple, visual, and reproducible way to evaluate performance across different LLM providers, including…
2025 · llmapitest.com
- 12
- 13FT
May 2026 · botcost.dev
- 14
- 15
- 16
- 17
It just tracks how many tokens you have burn across platform
Jun 2026 · addons.mozilla.org
- 18
- 19
Count AI tokens and API costs before you ship a prompt
Jun 2026 · freetokencounter.com
- 20LR
Hi! My OpenAI costs started going up recently and I hated how I couldn't figure out which model was costing me more? The OpenAI usage page (https://platform.openai.com/account/usage) gives a nice overall breakdown, but it doesn't go into detail about cost / model, token usage, and # requests. So I reverse engineered their API to make a better dashboard, and then made it free to use. Try it out and let me know what you think. Also please tell me what other features you wish existed here https://platform.openai.com/account/usage but doesn't yet.
2023 · llm.report
- 21
- 22OC
Hi HN, My name is Ben Schaechter and I’m Co-Founder and CEO of https://vantage.sh - a cloud cost visibility and optimization platform. We just added support for monitoring OpenAI costs and usage to Vantage and I wanted to share a demo we put together with HN as I thought people might find it interesting: https://www.youtube.com/watch?v=CzAOU1-uMrM In early April we started getting requests from customers to add OpenAI cost support specifically as it was a bit opaque as to what exactly was driving costs. The way this works is that it uses an undocumented API available…
2023
- 23
- 24LR
Hi hacker news, My name is Dillion and I'm the creator of llm.report. A few months ago, I was frustrated by the lack of observability into the OpenAI API. All of us are left in the dark about API performance, latency, cost calculation, cost breakdown, and more. I just wanted to know more about how my AI app is performing in production and make data-driven decisions to improve the product. So I ended up just building it myself. There are three parts to the platform: 1. OpenAI API Dashboard (no-code) - Enter your OpenAI key and get access to detailed insights straight from the OpenAI API…
2023 · github.com
Ranked by how close each launch is in meaning, then by votes. Refine with a description →