nowfound

AI · October 22, 2026

LLM Test Server

Your LLM tests, without the provider

LLM Test Server launched on October 22, 2026 with 22 votes, #564 of 3,509 launches that month and more than 95% of that year's launches.

Visit llmtest.managed-code.com ↗LLM Test Server alternativestop 16% of October 2026

What it does

LLM Test Server is a local, deterministic stand-in for 13 LLM provider APIs. Your app keeps its official SDK and points it at namespaced routes like /openai/v1; answers, tool calls, streams and failures come from fixtures your test sets up. The dashboard shows where every token goes: system prompt, tool schemas, conversation turns, prompt-cache reads and writes. Built forNET and Aspire, and shipped as a Docker image so any stack can use it. Free and open source.

A deterministic LLM API mock server for .NET and Aspire. Script responses, streaming, tool calls and failures, then inspect every request and where its tokens went.

A deterministic LLM API server for your tests — in .NET, Python, Node, Go or any language that speaks HTTP. Script responses, streaming, tool calls and failures. Call it with your regular provider SDK, then see exactly what your application sent and where every token went. Keep your real provider integration in the test. Choose the behavior on the other side. Point your provider SDK or IChatClient at the namespaced route. Provider, model, status, latency and token usage stay with each request. Select a call to read the response, the conversation behind it and the wire payloads. Hover any chart for exact values; JSON payloads and tool-call arguments are highlighted. Providers, models,…from llmtest.managed-code.com

Does a similar job

all alternatives →
  • LLM Gateway2025 · llmgateway.io · ▲296

    I built an OpenAI-compatible LLM gateway that routes requests to OpenAI, Anthropic, Ollama, vLLM, llama-server, SGLang... anything that speaks /v1/chat/completions. Single Go binary, one YAML config file, no infrastructure. It does the things you'd expect from this kind of gateway... semantic routing via a three-layer cascade (keyword heuristics, embedding similarity, LLM classifier) that picks the best model when clients omit the model field, weighted round-robin load balancing across local inference servers with health checks and failover. The part I think is most…

  • LLMWare2024 · llmware.ai · ▲358

    Dev tool to make AI apps to deploy privately or locally

  • Open-Source Alternative to OpenAI Platform, for Local Models2025 · github.com · ▲93

    Hi everyone, we’re a small team, supported by Mozilla, who are working on re-imagining a UI for training, tuning and testing local LLMs. Everything is open source. If you’ve been training your own LLMs or have always wanted to, we’d love for you to play with the tool and give feedback on what the future development experience for LLM engineering could look like.

  • LM Studio2025 · lmstudio.ai · ▲209

    Discover, download, and run local LLMs (incl. DeepSeek R1)

  • AT
    A tool to benchmark LLM APIs (OpenAI, Claude, local/self-hosted)2025 · llmapitest.com · ▲55

    I recently built a small open-source tool to benchmark different LLM API endpoints — including OpenAI, Claude, and self-hosted models (like llama.cpp). It runs a configurable number of test requests and reports two key metrics: • First-token latency (ms): How long it takes for the first token to appear • Output speed (tokens/sec): Overall output fluency Demo: https://llmapitest.com/ Code: https://github.com/qjr87/llm-api-test The goal is to provide a simple, visual, and reproducible way to evaluate performance across different LLM providers, including…

  • MockAPI DogFeb 2026 · mockapi.dog · ▲122

    Instant mock REST & LLM APIs - free, no signup required

More ai this month

the category →
  • Spira Maxima▲578

    Video model that turns script into viral social media videos

    AI · 18d ago · spira.ai

  • Rill Browser▲540

    The browser where Claude Code and Codex work beside you

    AI · 18d ago · rill.love

  • Germany's new sovereign AI model Kolibri▲424

    Kolibri is Aleph Alpha

    AI · 20d ago · tej.as

  • Giving Opus 5.5 a simulated paint canvas▲392

    Paintings by AI models: programs run through a simulation of oil paint.

    AI · 21d ago · stillwet.art

  • Beam.win▲378

    Run AI agents on one Mac and use its windows on another

    AI · 5d ago · beam.win

  • FastRouter.ai▲364

    Route requests to the right LLM for cost, latency & quality

    AI · 23d ago · fastrouter.ai

Source: Product Hunt launch ↗

Launched alongside, October 2026

the whole month →