Any-LLM chat demo – switch between ChatGPT, Claude, Ollama, in one chat
any-llm is a library that provides unified access to multiple LLM providers. switching between providers like OpenAI, Anthropic, Google, Mistral, and even Ollama is just a string change. This demo makes it easy to look at and compare responses from different models. Interesting to see how ChatGPT, Claude, Gemini, and local models each reason through the same problems. Let us know what you think!
In plain words
Any-LLM chat demo is a web interface that lets users compare responses from multiple language models in a single conversation. It supports ChatGPT, Claude, Gemini, Mistral, and local models like Ollama. Users can switch between providers by changing a string parameter, making it easy to see how different models approach the same problems. The tool is designed for developers and researchers who want to evaluate and contrast the reasoning capabilities of various LLMs.
written from the facts on this page · September 2026
Does the same job
all alternatives →
- ALAny-LLM – Lightweight router to access any LLM Provider2025 · github.com · ▲125
We built any-llm because we needed a lightweight router for LLM providers with minimal overhead. Switching between models is just a string change : update "openai/gpt-4" to "anthropic/claude-3" and you're done. It uses official provider SDKs when available, which helps since providers handle their own compatibility updates. No proxy or gateway service needed either, so getting started is pretty straightforward - just pip install and import. Currently supports 20+ providers including OpenAI, Anthropic, Google, Mistral, and AWS Bedrock. Would love to hear what you think!
- IBI built a free in-browser Llama 3 chatbot powered by WebGPU2024 · github.com · ▲547
I spent the last few days building out a nicer ChatGPT-like interface to use Mistral 7B and Llama 3 fully within a browser (no deps and installs). I’ve used the WebLLM project by MLC AI for a while to interact with LLMs in the browser when handling sensitive data but I found their UI quite lacking for serious use so I built a much better interface around WebLLM. I’ve been using it as a therapist and coach. And it’s wonderful knowing that my personal information never leaves my local computer. Should work on Desktop with Chrome or Edge. Other browsers are adding WebGPU support as well - see…
- IBI built an LLM chat app because we shouldn't need 10 AI subscriptions2025 · prismharmony.com · ▲58
I'm lost between ChatGPT vs Claude vs Gemini... which subscriptions to take? With Cursor and all these specific AI tools, I just wanted one simple chat app where I can use any model and pay only when I use it. Couldn't find one, so I built one. Pay only for what you use. Your prompts and docs, knowledge bases work with every model - no more copy-pasting between apps. Started as a personal project, but thought someone else might benefit from this too. https://prismharmony.com/chat What do you think?
- ACAnyLM – ChatGPT-Like UI for Local LLMs2025 · anylm.app · ▲13
Hey HN, I'm excited to share AnyLM, a desktop app I've been working on. I love tinkering with local LLMs (via Ollama and LMStudio) but often found myself wishing for a more polished, unified UI similar to what ChatGPT offers, where all my conversations are in one place. Out of that frustration I've built AnyLM, which aims to solve that by providing a single, native application (currently for Windows, with macOS and more planned) to interact with your local models from LM Studio/Ollama but also models from api providers like OpenAI, Anthropic and Google. This has been a fun (and…
More ai this month
the category →
I trained a 125M-parameter transformer to autocomplete piano performances in real time (~108 notes/sec on an iPhone 15). The idea is basically GitHub Copilot or Tabnine, except instead of prompting it with code, you prompt it by playing a few notes on a MIDI piano. The model then continues what you played, entirely on-device. The app is free if anyone wants to try it. Happy to answer questions about the model, training, Core ML, or the many things that didn't work.
AI · 17d ago · simedw.com
Astute▲585Automate your B2B brand going viral, with new media creators
AI · 18d ago · company-app.joinastute.com
Hey HN, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots and microcontrollers. We got really great feedback here, and have now incorporated the suggestions to release Needle 2. The whole model is a single 14MB binary that runs a full session in 28MB of RAM; 45m parameters at 2bit compression. Needle hits 500 tokens/sec decode speed on a Raspberry Pi 5, sits between 400-1,500 tokens/sec on VR devices like Meta Quest 3S and Apple Vision Pro, and ranges…
AI · 27d ago · cactuscompute.com
Launched alongside, August 2025
the whole month →
- IS
I built the world's most impractical 1000-pixel display and anyone in the world can draw on it. It draws a single pixel at a time and takes 30-60 minutes to complete a single image. Anyone can participate in the project by voting for the next image to be drawn, and submitting images. https://kilopx.com/
Work · 2025 · benholmen.com
- KT
Kitten TTS is an open-source series of tiny and expressive text-to-speech models for on-device applications. We are excited to launch a preview of our smallest model, which is less than 25 MB. This model has 15M parameters. This release supports English text-to-speech applications in eight voices: four male and four female. The model is quantized to int8 + fp16, and it uses onnx for runtime. The model is designed to run literally anywhere eg. raspberry pi, low-end smartphones, wearables, browsers etc. No GPU required! We're releasing this to give early users a sense of the latency and voices…
Dev tools · 2025 · github.com
- IW
I was wondering how I can arrange objects along a spherical helix path, and read some articles on it. I ended up learning about parametric equations again, and make this visualization to document what I learned: https://visualrambling.space/moving-objects-in-3d/ feel free to visit and let me know what you think!
Life & fun · 2025 · visualrambling.space
- TC
For HTML Day 2025 [1], I made a web service that displays the current sky at your approximate location as a CSS gradient. Colours are simulated on-demand using atmospheric absorption and scattering coefficients. Updates every minute, without the use of client-side JavaScript. Source code and additional information is available on GitHub: https://github.com/dnlzro/horizon [1] https://html.energy/html-day/2025/index.html
Dev tools · 2025 · sky.dlazaro.ca