TokenScope

What it does

TokenScope is a lightweight browser extension that quietly watches the LLM API calls made by any tab - ChatGPT, Claude, Gemini, or any OpenAI-compatible endpoint - and shows you in real time exactly how many tokens went in and out. Zero config. No account needed. 100% local - nothing ever leaves your browser. Works with ChatGPT, Claude, Gemini, OpenRouter, DeepSeek, and any custom gateway.

• 
  LLM SEO Monitor2025 · ▲526

  Monitor what ChatGPT, Google Gemini and Claude recommend

• AM
  A MitM proxy to see what your LLM tools are sendingJan 2026 · github.com · ▲218

  I built this out of curiosity about what Claude Code was actually sending to the API. Turns out, watching your tokens tick up in real-time is oddly satisfying. Sherlock sits between your LLM tools and the API, showing you every request with a live dashboard, and auto-saved copies of every prompt as markdown and json.

• 
  LLM Token CounterMay 2026 · singhajit.com · ▲3

  Estimate prompt cost before you call the LLM API

• LT
  LLaMA tokenizer that runs in browser2023 · github.com · ▲115
• YD
  You don't need to adopt new tools for LLM observability2024 · github.com · ▲102

  If you've built any web-based app in the last 15 years, you probably used something like Datadog, New Relic, Sentry, etc. to monitor and trace your app, right? Why should it be different when the app you're building happens to be using LLMs? So today we're open-sourcing OpenLLMetry-JS. It's an open protocol and SDK, based on OpenTelemetry, that provides traces and metrics for LLM JS/TS applications and can be connected to any of the 15+ tools that already support OpenTelemetry. Here's the repo: https://github.com/traceloop/openllmetry-js A few months ago we launched…

• AT
  A tool to benchmark LLM APIs (OpenAI, Claude, local/self-hosted)2025 · llmapitest.com · ▲55

  I recently built a small open-source tool to benchmark different LLM API endpoints — including OpenAI, Claude, and self-hosted models (like llama.cpp). It runs a configurable number of test requests and reports two key metrics: • First-token latency (ms): How long it takes for the first token to appear • Output speed (tokens/sec): Overall output fluency Demo: https://llmapitest.com/ Code: https://github.com/qjr87/llm-api-test The goal is to provide a simple, visual, and reproducible way to evaluate performance across different LLM providers, including…

• 
  I trained a 125M model to autocomplete piano on-device▲598

  I trained a 125M-parameter transformer to autocomplete piano performances in real time (~108 notes/sec on an iPhone 15). The idea is basically GitHub Copilot or Tabnine, except instead of prompting it with code, you prompt it by playing a few notes on a MIDI piano. The model then continues what you played, entirely on-device. The app is free if anyone wants to try it. Happy to answer questions about the model, training, Core ML, or the many things that didn't work.

  AI · 17d ago · simedw.com

• 
  Astute▲585

  Automate your B2B brand going viral, with new media creators

  AI · 19d ago · company-app.joinastute.com

• 
  Grok Bot▲547

  AI teammates that you can give real work to

  AI · 26d ago · x.ai

• 
  Needle2: 14MB agentic LLM for phones, wearables, smart home and robots▲537

  Hey HN, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots and microcontrollers. We got really great feedback here, and have now incorporated the suggestions to release Needle 2. The whole model is a single 14MB binary that runs a full session in 28MB of RAM; 45m parameters at 2bit compression. Needle hits 500 tokens/sec decode speed on a Raspberry Pi 5, sits between 400-1,500 tokens/sec on VR devices like Meta Quest 3S and Apple Vision Pro, and ranges…

  AI · 27d ago · cactuscompute.com

• 
  Monid▲475

  One wallet, every paid tool your agent needs

  AI · 7d ago · monid.ai

• 
  Clara AI SDR▲460

  Turn website visitors into qualified pipeline

  AI · 20d ago · clarasdr.ai

• 
  Brew ▲905

  Like Claude design for email marketing

  AI · May 2026 · brew.new

• 
  Kilo Code for VS Code▲897

  Parallel agents, diff reviewer, and multi-model comparisons

  Dev tools · May 2026 · kilo.ai

• 
  StoreClaw▲805

  Grow your store profits with agents that know how to sell

  AI · May 2026 · storeclaw.ai

• 
  PollyReach▲796

  Give your agent a real number and voice to make calls.

  AI · May 2026 · pollyreach.ai

• NW
  Needle: We Distilled Gemini Tool Calling into a 26M Model▲776

  Hey HN, Henry here from Cactus. We open-sourced Needle, a 26M parameter function-calling (tool use) model. It runs at 6000 tok/s prefill and 1200 tok/s decode on consumer devices. We were always frustrated by the little effort made towards building agentic models that run on budget phones, so we conducted investigations that led to an observation: agentic experiences are built upon tool calling, and massive models are overkill for it. Tool calling is fundamentally retrieval-and-assembly (match query to tool name, extract argument values, emit JSON), not reasoning. Cross-attention…

  Life & fun · May 2026 · github.com

• FM
  Files.md – Open-source alternative to Obsidian▲730

  Dev tools · May 2026 · github.com