Dev tools · alternatives · 2026
24 alternatives to NotHotDog (Alpha)
Test your LLM powered APIs & AI agents
Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. NotHotDog (Alpha) launched in 2024; newer entries below may have overtaken it.
- 1
Apidog▲570Development teams often struggle with using multiple tools like Postman and Swagger for API design, development, and testing. This fragmented approach leads to outdated API specs and chaotic collaboration. So we built Apidog: a single, unified API platform for team collaboration. It has a beautiful interface that makes it easy to create API spec, generate request data from API spec, validate responses, create mock data, orchestrate test scenarios, and publish API documentation. Apidog = Postman + Swagger + Mock + JMeter.
2024 · apidog.com · its alternatives →
- 2
Noty.ai 2.0▲261ChatGPT powered AI assistant for Zoom & Google Meet calls
2023 · noty.ai · its alternatives →
- 3
Breadcrumb▲163Open-source LLM tracing for agent visibility
Mar 2026 · breadcrumb.sh · its alternatives →
- 4
Fine-tune LLM agents with online reinforcement learning - KhoomeiK/LlamaGym
2024 · github.com · its alternatives →
- 5
I built this out of curiosity about what Claude Code was actually sending to the API. Turns out, watching your tokens tick up in real-time is oddly satisfying. Sherlock sits between your LLM tools and the API, showing you every request with a live dashboard, and auto-saved copies of every prompt as markdown and json.
Jan 2026 · github.com · its alternatives →
- 6
APIEval-20▲121An open benchmark for AI agents that test APIs
May 2026 · resources.kusho.ai · its alternatives →
- 7
- 8
- 9
MockAPI Dog▲122Instant mock REST & LLM APIs - free, no signup required
Feb 2026 · mockapi.dog · its alternatives →
- 10AT
I recently built a small open-source tool to benchmark different LLM API endpoints — including OpenAI, Claude, and self-hosted models (like llama.cpp). It runs a configurable number of test requests and reports two key metrics: • First-token latency (ms): How long it takes for the first token to appear • Output speed (tokens/sec): Overall output fluency Demo: https://llmapitest.com/ Code: https://github.com/qjr87/llm-api-test The goal is to provide a simple, visual, and reproducible way to evaluate performance across different LLM providers, including…
2025 · llmapitest.com · its alternatives →
- 11
We built any-llm because we needed a lightweight router for LLM providers with minimal overhead. Switching between models is just a string change : update "openai/gpt-4" to "anthropic/claude-3" and you're done. It uses official provider SDKs when available, which helps since providers handle their own compatibility updates. No proxy or gateway service needed either, so getting started is pretty straightforward - just pip install and import. Currently supports 20+ providers including OpenAI, Anthropic, Google, Mistral, and AWS Bedrock. Would love to hear what you think!
2025 · github.com · its alternatives →
- 12
An awesome audio & video transcription tool for Chrome
2021 · chromewebstore.google.com · its alternatives →
- 13
An open source Next app template to monitor your AI apps
2025 · github.com · its alternatives →
- 14
> "In a world without nil safety, one gem dares to ask: 'What if we just guessed?'"
Oct 2025 · github.com · its alternatives →
- 15
G'day, HN! I'm one of the maintainers of `llm`. I've been working alongside a trusty group of contributors to bring this project to life, and we're now at a point where we're ready to share it with the world. Large language models (LLMs) are taking the computing world by storm due to their emergent abilities that allow them to perform a wide variety of tasks, including translation, summarization, code generation, and even some degree of reasoning. However, the ecosystem around LLMs is still in its infancy, and it can be difficult to get started with these models. `llm` is a one-stop shop for…
2023 · github.com · its alternatives →
- 16
Hi HN, I built this open-source LLM red teaming tool based on my experience scaling LLMs at a big co to millions of users... and seeing all the bad things people did. How it works: - Uses an unaligned model to create toxic inputs - Runs these inputs through your app using different techniques: raw, prompt injection, and a chain-of-thought jailbreak that tries to re-frame the request to trick the LLM. - Probes a bunch of other failure cases (e.g. will your customer support bot recommend a competitor? Does it think it can process a refund when it can't? Will it leak your user's address?) -…
2024 · promptfoo.dev · its alternatives →
- 17
- 18
- 19
- 20
Current AI-assisted CLI tools are often part of larger systems and work better on Linux. I built llm-term to address these. It's a Rust-based tool that compiles into a single binary file. You only need to download the binary, add it to your PATH, and configure your OpenAI key to get started. While llm-term offers an option for gpt-4o, it works great with gpt-4o-mini. So it's not costly. I appreciate any feedback or suggestions.
2024 · github.com · its alternatives →
- 21
Hi HN, I built a CLI for uploading documents and querying them with an LLM agent that uses search tools rather than stuffing everything into the context window. I recorded a demo using the CrossFit 2025 rulebook that shows how this approach compares to traditional RAG and direct context injection[1]. The core insight is that LLMs running in loops with tool access are unreasonably effective at this kind of knowledge retrieval task[2]. Instead of hoping the right chunks make it into your context, the agent can iteratively search, refine queries, and reason about what it finds. The CLI handles…
2025 · github.com · its alternatives →
- 22
2024 · app.wiz.chat · its alternatives →
- 23
- 24
Discover, test, and integrate APIs/LLMs to accelerate agents
2025 · astropods.com · its alternatives →
Also compare
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →