Alternatives
Products that do what Identa – CLI to calibrate prompts across local LLMs does
A prompt tuned for Llama 3 often degrades on Mistral or Qwen — same task, different behavioral surface. Identa automates the recalibration. It implements two things from the PromptBridge paper (arXiv:2512.01420): A transfer engine that learns a mapping between model behaviors using source/target prompt pairs A MAP-RPE evolutionary loop that iteratively improves candidates against a scoring function until behavioral parity is reached Works fully local via Ollama. Also supports OpenRouter for cross-hosted runs. No telemetry, no cloud dependency. Built with Python, Typer, Pydantic. Happy…
- 1
- 2
- 3
- 4
- 5
- 6
- 7OS
Hi HN, Matvey, Ildar, Joey, and Dominik here. If you're building LLM agents that use tools, you're probably worried about prompt injection attacks that can hijack those tools. We were too, and found that solutions like prompt-based filtering or secondary "guard" LLMs can be unreliable. Our thesis is that agent security should be handled at the network level between the agent and the LLM, just like a traditional web application firewall. So we built Archestra Platform: an open-source gateway that acts as a secure proxy for your AI agents. It's designed to be a deterministic firewall against…
Oct 2025 · archestra.ai
- 8GP
Hi HN, Today we're launching a tool to help you evaluate and test prompts for Generative AI. We have been building different GPT3 apps and noticed a gap in tooling to help developers assess the quality of different prompts. Our tool helps you template and test on different datasets and LLM models like GPT-3, GPT-3.5 and open source models like flan-t5-xxl. We are just getting started and would be delighted to receive your feedback.
2023 · trywale.com
- 9LB
For the past few months I've been building a lot of things with LLMs (GPT-3, Codex, etc.) as I've been trying to push them to their limits (especially towards applying them to the tabular data domain) When working on this, I've found there are some common patterns for solving problems (templating, chaining, functional-programming style operations, etc.) As I've iterated, I've come to believe that a functional style interface is likely going to power a new wave of systems I'm calling "prompt-machines"(systems where the core new unit of work is a "named" LLM prompt, extending the "function"…
2022 · github.com
- 10IB
Hi HN, I'm pleased to share Promptspot, an open-source (Apache License 2.0) project that helps automate testing of large language model (LLM) prompts against an array of input data. Modern LLMs offer an enormous amount of leverage if you "teach the bot to fish" — i.e. simply prompt it with both a "system prompt" (which typically doesn't change often) and a dynamic input, which is often application state, search results, recent activity, user profile data, etc. Existing playgrounds and prompt management systems often lack the rigor and flexibility required for this dynamic approach — and as…
2023 · github.com
- 11AC
There's LLM Council and similar tools, but they use predefined model lineups. This one is different in a few ways that mattered to me: *Bring your own models.* Mix Ollama (local), OpenAI, Anthropic, Groq, Google — or any OpenAI-compatible endpoint — in whatever combination you want. A council of DeepSeek-R1 + llama2-uncensored + mistral-nemo is a very different deliberation than GPT-4o + Claude + Gemini. *Zero server, zero account, zero storage.* The app is purely static. API calls go directly from your browser to providers. Nothing touches a backend. No tokens, no sessions, no analytics.…
Feb 2026 · github.com
- 12PA
Hey HN, I built a tool to solve my biggest LLM workflow frustration: context switching. The idea came from trying to meta-prompt in Cursor, I found myself constantly jumping to a browser or dedicated AI app just to improve a prompt. This copy/paste/tweak cycle was a huge productivity killer. I wanted AI to integrate seamlessly into my workflow, not disrupt it. That's why I built Promptive. It's a native macOS app that lets you select any text, in any application, and run a custom LLM prompt on it with a global keyboard shortcut or right-click and select the action in the…
2025 · promptiveai.app
- 13LI
Hey HN! We built Lunon to make LLM development way less of a headache. Ever wanted to see how different models handle the same prompt without all the setup hassle? That's what we fixed. Our API lets you compare Claude, GPT, Mistral and others in real-time with just a few lines of code. No more complex infrastructure or managing multiple API connections - we handle all that boring stuff behind the scenes. Plus, you can cut costs by intelligently routing requests to the right model for each task. Use the powerful (expensive) models only when you really need them. If you're building with LLMs…
2025 · lunon.com
- 14HP
Hi HN. I heard you like dev tools and AI, so we wanted to share our project that we’ve been working on. We’re working on Horizon [1] - a higher level abstraction for LLMs so that developers can spend less time trying to grapple with LLMs to make them work and more time with users. This is the starting feature set which takes an auto-ML approach to identify the optimal LLM model, hyperparameters, and prompt - instead of just giving you the tooling to figure it out yourself. You can read more about it in our documentations. Our view is that as LLMs become increasingly commoditized and prompts…
2023 · gethorizon.ai
- 15AO
I've built an airgapped Retrieval-Augmented Generation (RAG) system for question-answering on documents, running entirely offline with local inference. Using Llama 3, Mistral, and Gemini, this setup allows secure, private NLP on your own machine. Perfect for researchers, data scientists, and developers who need to process sensitive data without cloud dependencies. Built with Llama C++, LangChain, and Streamlit, it supports quantized models and provides a sleek UI for document processing. Check it out, contribute, or suggest new features!
2024 · github.com
- 16LO
Hey HN, Ola and Karthik here. We are working on Langtrace(https://github.com/Scale3-Labs/langtrace), an open source, open telemetry based SDK and monitoring/evaluations client for LLM based applications. The SDK generates OTEL standard spans and traces for popular LLMs like OpenAI, Anthropic and Cohere, popular frameworks like Langchain and LlamaIndex and vectorDBs like ChromaDB and Pinecone. The LLM monitoring/evaluations space has seen a number of products off late, both open source and closed source ones. But, a couple of things we have observed are: lack of…
2024
- 17CV
I built Codag because I kept getting lost in my own AI code. You're chaining 3 LLM calls across 5 files. A prompt change breaks something downstream. Which call? Which branch? You grep for "openai.chat", open 8 tabs, trace the flow manually. Codag automates this: - Point it at your codebase and it extracts every LLM call, decision branch, and processing step - Renders an interactive and shareable DAG with clickable nodes that link back to source - Live updates as you edit using tree-sitter — no waiting for re-analysis Supports OpenAI, Anthropic, Gemini, LangChain, LangGraph, CrewAI, and…
Feb 2026 · github.com
- 18AF
I’ve always been looking for a solution to communicate larger technical systems faster. This includes a lot of known details and a technical de-risking plan. It is clear that LLMs need that structure and are capable of digesting it well. I’ve built MCP server for guiding the Cursor IDE through the plan that comes from the LLM assisted pipeline: PRD → TRD → Project files tree → Implementation Plan 1. The whole chain comes from one end-to-end solution 2. Codebase produced is easy to navigate by the automatically managed tracebility 3. Specification updates get reflected in tasks, so the flow…
2025 · github.com
- 19IB
hey hn, I built an open-source Perplexity clone that can run local LLMs and cloud LLMs. It's fully self-hostable through Docker and uses ollama to support local LLMs. The demo video in the repository shows me running it locally with llama3 on my M1 Macbook Pro. I'm open to any suggestions or feedback, thanks!
2024 · github.com
- 20PA
Hey HN! We just launched PromptL: a templating language built to simplify writing complex prompts for LLMs like GPT-4 and Claude. Why PromptL? Creating dynamic prompts for LLMs can get tricky, even with standardized APIs that use lists of messages and settings. While these formats are consistent, building complex interactions with custom logic or branching paths can quickly become repetitive and hard to manage as prompts grow. PromptL steps in to make this simple. It allows you to define and manage LLM conversations in a readable, single-file format, with support for control flow and…
2024 · promptl.ai
- 21AM
Hi everyone! I built Allein, a Markdown editor powered by Ollama — use your own LLMs locally for AI-assisted writing, completely private, no account required, and works offline. What it does: - Context-aware autocompletion (think GitHub Copilot for Markdown) - Writing improvements (spelling, grammar, readability) - Flexible model selection—swap between different LLMs based on your needs and your device's capabilities - Full-featured Markdown editor with live preview Why I built it: I wanted GitHub Copilot-like autocompletion in a lightweight text editor—something between Apple Notes' basic…
Nov 2025 · github.com
- 22SA
Hi HN, We’re building https://www.switchpoint.dev – a drop-in replacement for OpenAI’s API that reduces LLM cost by smartly routing across models (e.g., Claude, Gemini, GPT-4) depending on subject and difficulty of the task. Why we built this: LLM costs are spiraling—especially for products doing retrieval, agentic reasoning, or even just high-volume chat. We were frustrated with paying GPT-4 rates when most queries didn’t need it. So we built a router that: - Starts with cheaper/free models (like Llama 8B, 4o-mini, 2.0 flash) - Streams responses and upgrades on failure - Acts…
2025 · switchpoint.dev
- 23TO
I built DevClaw, an OpenClaw plugin that turns each Telegram group into an isolated, autonomous dev team: planner/orchestrator, DEVs, and QA all running on their own. I use it for all my development now. Issues on GitLab/GitHub are the single source of truth, and three things compound to save around 70% on tokens: model tiering (Haiku for typos, Opus for architecture), session reuse across tasks, and token-free scheduling that burns zero LLM calls for orchestration. Please try it and give some feedback. Also keen to hear from anyone running autonomous coding agents, especially what…
Feb 2026 · github.com
Ranked by how close each launch is in meaning, then by votes. Refine with a description →