Compress Long LLM Prompt, Right in your web browser
I tried to port LLMLingua-2's official Python implementation into TypeScript. For best performance, open the URL with a WebGPU enabled web browser. Learn More: https://github.com/atjsh/llmlingua-2-js
Does the same job
all alternatives →
- TL`tc` like `wc` but for LLM tokensJan 2026 · github.com · ▲8
Little tool that I made to understand how (un)reasonable my prompts are.
- ECErgonomically call LLM in bulk from CLI2025 · github.com · ▲7
Hi! I've found myself repeatedly writing little scripts to do bulk calls to LLMs for various tasks. For example, run some analysis on a large list of records. There are a few "gotchas" to doing this. For example, some service providers have rate limits, and some models will not reliably return JSON (if you're asking for it). So, I've written a command for this. What I've tried to do here is let the user break up prompts and configuration as they see fit. For example, you can have a prompt file which includes the API key, rate limit, settings, etc. all together, or break these up into…
- PAPromptL, a templating language designed for LLM prompting2024 · promptl.ai · ▲7
Hey HN! We just launched PromptL: a templating language built to simplify writing complex prompts for LLMs like GPT-4 and Claude. Why PromptL? Creating dynamic prompts for LLMs can get tricky, even with standardized APIs that use lists of messages and settings. While these formats are consistent, building complex interactions with custom logic or branching paths can quickly become repetitive and hard to manage as prompts grow. PromptL steps in to make this simple. It allows you to define and manage LLM conversations in a readable, single-file format, with support for control flow and…
- APApply plugins to LLMs in one line of code with PlugnPlai and Langchain2023 · twitter.com · ▲5
Hey HackerNews, I'm building an open-source library aiming to make it very easy for anyone to use plugins with any LLM (plugins as defined by OpenAI). I just finished this very simple tutorial: https://github.com/edreisMD/plugnplai/blob/master/examples/a.... And would love to get some feedback, and suggestions on how to improve it / make it useful for you. Steps: 1. Load plugins from https://plugnplai.com directory (now with ~150 plugins) 2. Install and activate: Load specifications and build a default prompt describing the plugins to…
- IBI Built a UI to finetune LLMs x100 faster2024 · finetuna-ui.com · ▲7
After fine-tuning GPT for a personal project, I realized how tedious it is to write plain text in a massive JSON file. That's why I built this app for my own use, and I want to see if others could benefit from a tool like this as well ;)
More ai this month
the category →
I trained a 125M-parameter transformer to autocomplete piano performances in real time (~108 notes/sec on an iPhone 15). The idea is basically GitHub Copilot or Tabnine, except instead of prompting it with code, you prompt it by playing a few notes on a MIDI piano. The model then continues what you played, entirely on-device. The app is free if anyone wants to try it. Happy to answer questions about the model, training, Core ML, or the many things that didn't work.
AI · 17d ago · simedw.com
Astute▲585Automate your B2B brand going viral, with new media creators
AI · 18d ago · company-app.joinastute.com


Hey HN, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots and microcontrollers. We got really great feedback here, and have now incorporated the suggestions to release Needle 2. The whole model is a single 14MB binary that runs a full session in 28MB of RAM; 45m parameters at 2bit compression. Needle hits 500 tokens/sec decode speed on a Raspberry Pi 5, sits between 400-1,500 tokens/sec on VR devices like Meta Quest 3S and Apple Vision Pro, and ranges…
AI · 26d ago · cactuscompute.com


Launched alongside, May 2025
the whole month →
- C9
Life & fun · 2025 · felixrieseberg.github.io



