AI · alternatives · 2026

glhf.chat lets users run open-source large language models on autoscaling GPU clusters through a web interface. It supports any model compatible with the vLLM project, including models up to 405B parameters, by… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Prices are shown for the 2 we have checked on their own sites, 2 of them free or with a free tier. We made glhf.chat – run almost any open-source LLM, including 405B launched in 2024; newer entries below may have overtaken it.

1. 1
   Getting GLM 5.2 running on my slow computer▲937

   A few days ago I found myself trying out GLM 5.2 and was really positively impressed. The capabilities and security I was getting from this LLM are similar to those I've gotten from models like Claude or GPT, and this really surprised me. But then I thought, "I wonder how it would work on a normal computer like mine," and above all, "I wonder if it would work without going into OOM on a computer like mine." So I started working with the help of agents to test this possibility. I started converting the model to int4, understanding MTP usage, and if possible implementing DSA for long context.…

   Jul 2026 · github.com · its alternatives →

2. 2
   I built a free in-browser Llama 3 chatbot powered by WebGPU▲547

   I spent the last few days building out a nicer ChatGPT-like interface to use Mistral 7B and Llama 3 fully within a browser (no deps and installs). I’ve used the WebLLM project by MLC AI for a while to interact with LLMs in the browser when handling sensitive data but I found their UI quite lacking for serious use so I built a much better interface around WebLLM. I’ve been using it as a therapist and coach. And it’s wonderful knowing that my personal information never leaves my local computer. Should work on Desktop with Chrome or Edge. Other browsers are adding WebGPU support as well - see…

   2024 · github.com · its alternatives →

3. 3
   I built a tiny LLM to demystify how language models work▲915

   Built a ~9M param LLM from scratch to understand how they actually work. Vanilla transformer, 60K synthetic conversations, ~130 lines of PyTorch. Trains in 5 min on a free Colab T4. The fish thinks the meaning of life is food. Fork it and swap the personality for your own character.

   Apr 2026 · github.com · its alternatives →

4. 4SS
   sllm – Split a GPU node with other developers, unlimited tokens▲188

   Running DeepSeek V3 (685B) requires 8×H100 GPUs which is about $14k/month. Most developers only need 15-25 tok/s. sllm lets you join a cohort of developers sharing a dedicated node. You reserve a spot with your card, and nobody is charged until the cohort fills. Prices start at $5/mo for smaller models. The LLMs are completely private (we don't log any traffic). The API is OpenAI-compatible (we run vLLM), so you just swap the base URL. Currently offering a few models.

   Apr 2026 · sllm.cloud · its alternatives →

5. 5
   I've built a locally running Perplexity clonefree▲669

   The video demo runs a 7b Model on a normal gaming GPU. I think it already works quite well (accounting for the limited hardware power). :)

   2024 · github.com · its alternatives →

6. 6
   Open source alternative to ChatGPT and ChatPDF-like AI tools▲234

   Hey everyone, We have been building SecureAI Tools -- an open-source application layer for ChatGPT and ChatPDF-like AI tools. It works with locally running LLMs as well as with OpenAI-compatible APIs. For local LLMs, it supports Ollama which supports all the gguf/ggml models. Currently, it has two features: Chat-with-LLM, and Chat-with-PDFs. It is optimized for self-hosting use cases and comes with basic user management features. Here are some quick demos: * Chat with documents using OpenAI's GPT3.5 model: https://www.youtube.com/watch?v=Br2D3G9O47s * Chat with documents…

   2023 · github.com · its alternatives →

7. 7
   TensorZero▲307

   Hi HN! We're Gabriel & Viraj, and we're excited to open source TensorZero. To be a little cheeky, TensorZero is an open-source platform that helps LLM applications graduate from API wrappers into defensible AI products. 1. Integrate our model gateway 2. Send metrics or feedback 3. Unlock compounding improvements in quality, cost, and latency It enables a data & learning flywheel for LLMs by unifying: • Inference: one API for all LLMs, with <1ms P99 overhead • Observability: inference & feedback → your database • Optimization: better prompts, models, inference strategies • Experimentation:…

   2025 · github.com · its alternatives →

8. 8
   Tiny-vLLM – high performance LLM inference engine in C++ and CUDA▲205

   Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM - jmaczan/tiny-vllm

   May 2026 · github.com · its alternatives →

9. 9
   Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPU▲395

   Hi everyone, I'm kinda involved in some retrogaming and with some experiments I ran into the following question: "It would be possible to run transformer models bypassing the cpu&#x2F;ram, connecting the gpu to the nvme?" This is the result of that question itself and some weekend vibecoding (it has the linked library repository in the readme as well), it seems to work, even on consumer gpus, it should work better on professional ones tho

   Feb 2026 · github.com · its alternatives →

10. 10
    Finetune LLaMA-7B on commodity GPUs using your own text▲449

    I've been playing around with https:&#x2F;&#x2F;github.com&#x2F;zphang&#x2F;minimal-llama&#x2F; and https:&#x2F;&#x2F;github.com&#x2F;tloen&#x2F;alpaca-lora&#x2F;blob&#x2F;main&#x2F;finetune.py, and wanted to create a simple UI where you can just paste text, tweak the parameters, and finetune the model quickly using a modern GPU. To prepare the data, simply separate your text with two blank lines. There's an inference tab, so you can test how the tuned model behaves. This is my first foray into the world of LLM finetuning, Python, Torch, Transformers, LoRA, PEFT, and Gradio. Enjoy!

    2023 · github.com · its alternatives →

11. 11
    Parallax by Gradient▲334

    Host LLMs across devices sharing GPU to make your AI go brrr

    Oct 2025 · github.com · its alternatives →

12. 12
    nanochat▲349

    Build your won ChatGPT for $100 on a single GPU

    2025 · github.com · its alternatives →

13. 13
    Fine-tune an 8B model on a 4 GB laptop GPU▲139

    Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU. - MakazhanAlpamys/Soup

    Aug 2026 · github.com · its alternatives →

14. 14
    80% faster, 50% less memory, 0% loss of accuracy Llama finetuning▲385

    Hi HN! I'm just sharing a project I've been working on during the LLM Efficiency Challenge - you can now finetune Llama with QLoRA 5x faster than Huggingface's original implementation on your own local GPU. Some highlights: 1. Manual autograd engine - hand derived backprop steps. 2. QLoRA &#x2F; LoRA 80% faster, 50% less memory. 3. All kernels written in OpenAI's Triton language. 4. 0% loss in accuracy - no approximation methods - all exact. 5. No change of hardware necessary. Supports NVIDIA GPUs since 2018+. CUDA 7.5+. 6. Flash Attention support via Xformers. 7. Supports 4bit and 16bit…

    2023 · github.com · its alternatives →

15. 15
    LM Studio▲209

    Discover, download, and run local LLMs (incl. DeepSeek R1)

    2025 · lmstudio.ai · its alternatives →

16. 16
    Dolly▲113

    Democratizing the magic of ChatGPT with open models

    2023 · github.com · its alternatives →

17. 17WE
    WebGPU enables local LLM in the browser – demo site with AI chat▲145

    Browser LLM demo working on JavaScript and WebGPU. WebGPU is already supported in Chrome, Safari, Firefox, iOS (v26) and Android. Demo, similar to ChatGPT https:&#x2F;&#x2F;andreinwald.github.io&#x2F;browser-llm&#x2F; Code https:&#x2F;&#x2F;github.com&#x2F;andreinwald&#x2F;browser-llm - No need to use your OPENAI_API_KEY - its local model that runs on your device - No network requests to any API - No need to install any program - No need to download files on your device (model is cached in browser) - Site will ask before downloading large files (llm model) to browser cache - Hosted on Github…

    2025 · andreinwald.github.io · its alternatives →

18. 18
    Moonshine Open-Weights STT models – higher accuracy than WhisperLargev3▲316

    I wanted to share our new speech to text model, and the library to use them effectively. We're a small startup (six people, sub-$100k monthly GPU budget) so I'm proud of the work the team has done to create streaming STT models with lower word-error rates than OpenAI's largest Whisper model. Admittedly Large v3 is a couple of years old, but we're near the top the HF OpenASR leaderboard, even up against Nvidia's Parakeet family. Anyway, I'd love to get feedback on the models and software, and hear about what people might build with it.

    Feb 2026 · github.com · its alternatives →

19. 19
    LLM Gatewayfree tier▲296

    I built an OpenAI-compatible LLM gateway that routes requests to OpenAI, Anthropic, Ollama, vLLM, llama-server, SGLang... anything that speaks &#x2F;v1&#x2F;chat&#x2F;completions. Single Go binary, one YAML config file, no infrastructure. It does the things you'd expect from this kind of gateway... semantic routing via a three-layer cascade (keyword heuristics, embedding similarity, LLM classifier) that picks the best model when clients omit the model field, weighted round-robin load balancing across local inference servers with health checks and failover. The part I think is most…

    2025 · llmgateway.io · its alternatives →

20. 20
    Luminal – Open-source, search-based GPU compiler▲153

    Hi HN, I’m Joe. My friends Matthew, Jake and I are building Luminal (https:&#x2F;&#x2F;luminalai.com&#x2F;), a GPU compiler for automatically generating fast GPU kernels for AI models. It uses search-based compilation to achieve high performance. We take high level model code, like you'd have in PyTorch, and generate very fast GPU code. We do that without using LLMs or AI - rather, we pose it as a search problem. Our compiler builds a search space, generates millions of possible kernels, and then searches through it to minimize runtime. You can try out a demo in `demos&#x2F;matmul` on mac to…

    2025 · github.com · its alternatives →

21. 21
    Ollama – Run LLMs on your Mac▲284

    Hi HN A few folks and I have been working on this project for a couple weeks now. After previously working on the Docker project for a number of years (both on the container runtime and image registry side), the recent rise in open source language models made us think something similar needed to exist for large language models too. While not exactly the same as running linux containers, running LLMs shares quite a few of the same challenges. There are "base layers" (e.g. models like Llama 2), specific configuration to run correctly (parameters, temperature, context window sizes etc). There's…

    2023 · github.com · its alternatives →

22. 22CI
    Can I run this LLM? (locally)▲42

    One of the most frequent questions one faces while running LLMs locally is: I have xx RAM and yy GPU, Can I run zz LLM model ? I have vibe coded a simple application to help you with just that. Update: A lot of great feedback for me to improve the app. Thank you all.

    2025 · can-i-run-this-llm-blue.vercel.app · its alternatives →

23. 23
    ChattyUI▲149

    Run open-source LLMs locally in the browser using WebGPU

    2024 · its alternatives →

24. 24
    RunInfra▲156

    Describe the AI model you need and get an optimized AI

    Jul 2026 · runinfra.ai · its alternatives →

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →