Reducing LLM input tokens by 70%
Run GPT-OSS, Qwen, Llama, and DeepSeek through one OpenAI-compatible API with streaming and clear usage-based pricing.
Reducing LLM input tokens by 70% launched on May 12, 2026 with 56 votes, #752 of 20,538 launches that month and more than 95% of that year's launches.
In plain words
Adola is an AI tool designed to reduce the number of input tokens sent to large language models by up to 70%. It helps developers and organizations lower their API costs and improve processing speed when working with LLMs. The tool is aimed at anyone using language models for applications and looking to optimize their token usage without sacrificing output quality.
written from the facts on this page · September 2026
From the sources
Run GPT-OSS, Qwen, Llama, and DeepSeek through one OpenAI-compatible API. Stream responses, switch models with one parameter, and see exactly what each request costs. Usage-based pricing. No recurring subscription, seat fee, or monthly minimum spend. Keep the request shape your application already understands. Choose the model in the request, stream the answer, and read standard token usage in the response. Use a public model ID in every request. The model you select is the model that responds. OpenAI open-weight 120B MoE for capable reasoning, coding, and general-purpose work. Fast multilingual MoE with strong tool use and agentic performance. Meta's proven 70B instruction model for…from adola.app
Does a similar job
all alternatives →
TensorZero2025 · github.com · ▲307Hi HN! We're Gabriel & Viraj, and we're excited to open source TensorZero. To be a little cheeky, TensorZero is an open-source platform that helps LLM applications graduate from API wrappers into defensible AI products. 1. Integrate our model gateway 2. Send metrics or feedback 3. Unlock compounding improvements in quality, cost, and latency It enables a data & learning flywheel for LLMs by unifying: • Inference: one API for all LLMs, with <1ms P99 overhead • Observability: inference & feedback → your database • Optimization: better prompts, models, inference strategies • Experimentation:…
- ATA tool to benchmark LLM APIs (OpenAI, Claude, local/self-hosted)2025 · llmapitest.com · ▲55
I recently built a small open-source tool to benchmark different LLM API endpoints — including OpenAI, Claude, and self-hosted models (like llama.cpp). It runs a configurable number of test requests and reports two key metrics: • First-token latency (ms): How long it takes for the first token to appear • Output speed (tokens/sec): Overall output fluency Demo: https://llmapitest.com/ Code: https://github.com/qjr87/llm-api-test The goal is to provide a simple, visual, and reproducible way to evaluate performance across different LLM providers, including…
Build AI DAGs with Memory; Run and Validate LLM Tools in Containers2023 · github.com · ▲48I am working on a modular open source framework called Griptape that allows Python developers to create LLM pipelines and DAGs for complex workflows that use rules and memory. Griptape can be thought of as "Airflow for LLMs," providing an alternative to the agent-based LangChain approach. Developers can also build reusable LLM tools with explicit JSON schemas that can be executed in any environment (local, containerized, cloud, etc.) and integrated into Griptape workflows. They can also be easily converted into ChatGPT Plugin APIs and LangChain tools via adapters. Tools can be thought of as…
Superflows – open-source AI Copilot for SaaS products2023 · github.com · ▲37Henry, Matt and James here – we’re building an open source toolkit that makes it easy to integrate an LLM-powered copilot that talks to your API into software products. It works by calling API endpoints which you choose to expose to it. This lets the chatbot complete tasks within your software in response to natural language queries. It’s also open source, so you don’t have to send user data to another 3rd party. We support Llama 2, but we haven’t fine-tuned Llama 2 yet (coming soon) so highest accuracy is seen with GPT-4 or fine-tuned GPT-3.5 (much faster). We started working together 2…
Deepmark AI- LLM assessment tool for task-specific metrics on your data2023 · github.com · ▲36Deepmark AI enables a unique testing environment for language models (LLM) assessment on task-specific metrics and on your own data so your GenAI-powered solution has predictable and reliable performance. - IngestAI/deepmark
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 20d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 28d ago · world.pixverse.video
Source: Show HN post ↗
Launched alongside, May 2026
the whole month →
Parallel agents, diff reviewer, and multi-model comparisons
Dev tools · May 2026 · kilo.ai
Hey HN, Henry here from Cactus. We open-sourced Needle, a 26M parameter function-calling (tool use) model. It runs at 6000 tok/s prefill and 1200 tok/s decode on consumer devices. We were always frustrated by the little effort made towards building agentic models that run on budget phones, so we conducted investigations that led to an observation: agentic experiences are built upon tool calling, and massive models are overkill for it. Tool calling is fundamentally retrieval-and-assembly (match query to tool name, extract argument values, emit JSON), not reasoning. Cross-attention…
Life & fun · May 2026 · github.com
🌱 Private, quiet space for thinking. Simple app for .md files. - zakirullin/files.md
Dev tools · May 2026 · github.com