Promptloop – create, run, and improve prompt evals from the terminal

In plain words

Promptloop is a command-line tool that helps developers create, execute, and refine prompt evaluations. It enables users to set up evaluation loops for testing and improving prompts directly from the terminal. The tool is designed for those working with AI models who need to systematically assess and iterate on prompt performance without leaving their development environment.

written from the facts on this page · September 2026

From the sources

Claude Code for prompt eval . Contribute to Bella3202019/promptloop development by creating an account on GitHub.

An interactive CLI agent for the full prompt-eval loop: create test cases, run evals, generate reports, and approve prompt diffs without leaving your terminal. Agent harnesses are getting better, but prompts still shape what they do. promptloop turns a prompt and eval intent into a repeatable loop: It saves the methodology, test cases, reports, prompt history, and chat checkpoints under .evals/ in the target project. .evals/ prompts/ # registered prompts + version history test_cases/ # per-prompt test suites eval_configs/ # methodology (metrics, models, judges) results/ # eval runs and reports chat.db # SQLite checkpoint of conversation threads Example metrics: git clone < this repo > cd…from github.com

• 
  Prompt2016 · ▲259

  The command line for the real world

• 
  Promptui – Rich UI elements for cli prompts in Go2017 · github.com · ▲196

  Interactive prompt for command-line applications. Contribute to manifoldco/promptui development by creating an account on GitHub.

• 
  PromptCompose - Beta2025 · ▲153

  The command center for your AI prompts.

• 
  Promptr, let GPT operate on your codebase and other useful goodies2023 · github.com · ▲109

  Hi HN, I've been working on an experimental tool that helps you use GPT to work on your codebase. I'd love to improve the tool if there's interest. New ideas welcome! I think this could also be useful for experimenting with other types of recursive prompts. It’s a little bit Swiss Army knife and a little bit skynet: https:&#x2F;&#x2F;github.com&#x2F;ferrislucas&#x2F;promptr From the README: Promptr is a CLI tool for operating on your codebase using GPT. Promptr dynamically includes one or more files into your GPT prompts, and it can optionally parse and apply the changes that GPT suggests to…

• 
  PreloopJan 2026 · preloop.ai · ▲121

  Hey HN, I’m Yannis, co-founder of Preloop. We’ve built a proxy for the Model Context Protocol (MCP) that lets you add human approval gates to your AI agents without changing your agent code. We’re building agents that use tools (Claude Desktop, Cursor, etc.), but we were terrified to give them write-access to sensitive systems (Stripe, Prod DBs, AWS). We didn't want to rewrite our agents to wrap every tool call in complex "ask_user" logic, especially since we use different agent runtimes. We built Preloop as a middleware layer. It acts as a standard MCP server proxy.You point your agent to…

• 
  PromptOps: IDE for CLI AI Coding AgentsAug 2026 · promptops.it · ▲6

  Orchestrate every AI coding agent from one desktop

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 18d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 18d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 19d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 21d ago · stillwet.art

• 
  PixVerse R2▲381

  A real-time world model you can explore and change

  AI · 29d ago · world.pixverse.video

• 
  Beam.win▲377

  Run AI agents on one Mac and use its windows on another

  AI · 4d ago · beam.win

• 
  Brew ▲900

  Like Claude design for email marketing

  AI · May 2026 · brew.new

• 
  Kilo Code for VS Code▲896

  Parallel agents, diff reviewer, and multi-model comparisons

  Dev tools · May 2026 · kilo.ai

• 
  StoreClaw▲806

  Grow your store profits with agents that know how to sell

  AI · May 2026 · storeclaw.ai

• 
  PollyReach▲795

  Give your agent a real number and voice to make calls.

  AI · May 2026 · pollyreach.ai

• 
  Needle: We Distilled Gemini Tool Calling into a 26M Model▲776

  Hey HN, Henry here from Cactus. We open-sourced Needle, a 26M parameter function-calling (tool use) model. It runs at 6000 tok&#x2F;s prefill and 1200 tok&#x2F;s decode on consumer devices. We were always frustrated by the little effort made towards building agentic models that run on budget phones, so we conducted investigations that led to an observation: agentic experiences are built upon tool calling, and massive models are overkill for it. Tool calling is fundamentally retrieval-and-assembly (match query to tool name, extract argument values, emit JSON), not reasoning. Cross-attention…

  Life & fun · May 2026 · github.com

• 
  Files.md – Open-source alternative to Obsidian▲730

  🌱 Private, quiet space for thinking. Simple app for .md files. - zakirullin/files.md

  Dev tools · May 2026 · github.com