nowfound

AI · May 17, 2025

CL

Compress Long LLM Prompt, Right in your web browser

I tried to port LLMLingua-2's official Python implementation into TypeScript. For best performance, open the URL with a WebGPU enabled web browser. Learn More: https://github.com/atjsh/llmlingua-2-js

Does the same job

all alternatives →
  • 2000 Large Language Models (LLM) Prompts2023 · ▲106

    Unlock your knowledge with 2000 LLM prompts

  • TL
    `tc` like `wc` but for LLM tokensJan 2026 · github.com · ▲8

    Little tool that I made to understand how (un)reasonable my prompts are.

  • EC
    Ergonomically call LLM in bulk from CLI2025 · github.com · ▲7

    Hi! I've found myself repeatedly writing little scripts to do bulk calls to LLMs for various tasks. For example, run some analysis on a large list of records. There are a few "gotchas" to doing this. For example, some service providers have rate limits, and some models will not reliably return JSON (if you're asking for it). So, I've written a command for this. What I've tried to do here is let the user break up prompts and configuration as they see fit. For example, you can have a prompt file which includes the API key, rate limit, settings, etc. all together, or break these up into…

  • PA
    PromptL, a templating language designed for LLM prompting2024 · promptl.ai · ▲7

    Hey HN! We just launched PromptL: a templating language built to simplify writing complex prompts for LLMs like GPT-4 and Claude. Why PromptL? Creating dynamic prompts for LLMs can get tricky, even with standardized APIs that use lists of messages and settings. While these formats are consistent, building complex interactions with custom logic or branching paths can quickly become repetitive and hard to manage as prompts grow. PromptL steps in to make this simple. It allows you to define and manage LLM conversations in a readable, single-file format, with support for control flow and…

  • AP
    Apply plugins to LLMs in one line of code with PlugnPlai and Langchain2023 · twitter.com · ▲5

    Hey HackerNews, I'm building an open-source library aiming to make it very easy for anyone to use plugins with any LLM (plugins as defined by OpenAI). I just finished this very simple tutorial: https://github.com/edreisMD/plugnplai/blob/master/examples/a.... And would love to get some feedback, and suggestions on how to improve it / make it useful for you. Steps: 1. Load plugins from https://plugnplai.com directory (now with ~150 plugins) 2. Install and activate: Load specifications and build a default prompt describing the plugins to…

  • IB
    I Built a UI to finetune LLMs x100 faster2024 · finetuna-ui.com · ▲7

    After fine-tuning GPT for a personal project, I realized how tedious it is to write plain text in a massive JSON file. That's why I built this app for my own use, and I want to see if others could benefit from a tool like this as well ;)

More ai this month

the category →
  • I trained a 125M-parameter transformer to autocomplete piano performances in real time (~108 notes/sec on an iPhone 15). The idea is basically GitHub Copilot or Tabnine, except instead of prompting it with code, you prompt it by playing a few notes on a MIDI piano. The model then continues what you played, entirely on-device. The app is free if anyone wants to try it. Happy to answer questions about the model, training, Core ML, or the many things that didn't work.

    AI · 17d ago · simedw.com

  • Astute585

    Automate your B2B brand going viral, with new media creators

    AI · 18d ago · company-app.joinastute.com

  • Grok Bot547

    AI teammates that you can give real work to

    AI · 25d ago · x.ai

  • Hey HN, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots and microcontrollers. We got really great feedback here, and have now incorporated the suggestions to release Needle 2. The whole model is a single 14MB binary that runs a full session in 28MB of RAM; 45m parameters at 2bit compression. Needle hits 500 tokens/sec decode speed on a Raspberry Pi 5, sits between 400-1,500 tokens/sec on VR devices like Meta Quest 3S and Apple Vision Pro, and ranges…

    AI · 26d ago · cactuscompute.com

  • Make your software self-driving

    AI · 30d ago · coldtea.ai

  • Soloop472

    Approval-first Agent OS for solo founders

    AI · 30d ago · soloop.io

Launched alongside, May 2025

the whole month →