Promptspot

What it does

Promptspot is an open-source (Apache License 2.0) project that helps automate testing of large language model (LLM) prompts against an array of input data, automating the process of "teaching the bot to fish".

Prompt testing made easy. Contribute to jordanful/Promptspot development by creating an account on GitHub.

• 
  I built an open-source “unit testing” suite for prompts ⮂ inputs2023 · github.com · ▲5

  Hi HN, I'm pleased to share Promptspot, an open-source (Apache License 2.0) project that helps automate testing of large language model (LLM) prompts against an array of input data. Modern LLMs offer an enormous amount of leverage if you "teach the bot to fish" — i.e. simply prompt it with both a "system prompt" (which typically doesn't change often) and a dynamic input, which is often application state, search results, recent activity, user profile data, etc. Existing playgrounds and prompt management systems often lack the rigor and flexibility required for this dynamic approach — and as…

• 
  PromptTools – open-source tools for evaluating LLMs and vector DBs2023 · github.com · ▲211

  Hey HN! We’re Kevin and Steve. We’re building PromptTools (https://github.com/hegelai/prompttools): open-source, self-hostable tools for experimenting with, testing, and evaluating LLMs, vector databases, and prompts. Evaluating prompts, LLMs, and vector databases is a painful, time-consuming but necessary part of the product engineering process. Our tools allow engineers to do this in a lot less time. By “evaluating” we mean checking the quality of a model's response for a given use case, which is a combination of testing and benchmarking. As examples: - For generated…

• 
  PromptForge2025 · github.com · ▲474

  PromptForge: Open-source AI prompt engineering workbench with systematic evaluation I built PromptForge after getting frustrated with the manual trial-and-error approach to prompt engineering. Most tools are just text editors, but I wanted something that brings software engineering discipline to prompt development. Key technical features: - AI-assisted prompt generation (stop starting from scratch) - Systematic evaluation engine that auto-generates test suites - Multi-model support (Claude, GPT-4, Azure OpenAI) - Go backend with SQLite for performance and simplicity - One-line Docker…

• 
  PromptChainer2024 · mindpal.space · ▲333

  Free & fast chain of prompts generator

• 
  Prompto2024 · prompto.asanchez.dev · ▲202

  Interact with various LLMs in your browser

• 
  Prompt Hippo2024 · ▲128

  LLM prompt testing suite

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 17d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 17d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 19d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 20d ago · stillwet.art

• 
  PixVerse R2▲381

  A real-time world model you can explore and change

  AI · 29d ago · world.pixverse.video

• 
  Hemory▲381

  Keep listening. Searchable memory for your AI agents.

  AI · 29d ago · hemory.com

• 
  Non.io, a Reddit-like platform Ive been working on for the last 4 years▲1,943

  Heya HN, I've been working on a reddit-like platform as my primary side project for the last few years. Doing a (very) soft launch today, mainly because I want to use it to encourage discussion of alternatives. How non.io works: 1. Free to browse, paid to interact. 2. Minimum subscription is $2 (though you can choose more). I take $1 to run the servers, everything left gets split evenly between everything you upvote that month. It's a simple model, but I hope it's a better one than the freemium model we've been relying on for the last few years. Fundamentally I feel like any ad-supported…

  Commerce · 2023 · non.io

• 
  Sivi AI▲938

  Generative AI to magically turn text to visual designs

  AI · 2023 · sivi.ai

• 
  Typefully 2.0▲931

  Effortlessly publish on Twitter and LinkedIn, now with AI

  Growth · 2023 · typefully.com

• 
  Olvy 2.0▲826

  Analyze user feedback 10x faster with AI

  AI · 2023 · olvy.co

• 
  SlashPage▲755

  Create websites in seconds to build your first 1K community

  Growth · 2023 · slashpage.com

• 
  Unicorn Platform AI▲751

  Easy to use AI-powered, drag-and-drop website, SAAS landing, directory, and blog builder for startups, mobile apps, and SaaS. 100% no code, no design skills needed.

  AI · 2023 · unicornplatform.com