AI · alternatives · 2026

ZigFormer is a small language model implemented entirely in Zig without external ML framework dependencies. Built as an educational project following textbook LLM architecture similar to GPT-2, it functions both as a… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Prices are shown for the 1 we have checked on their own sites, 1 of them free or with a free tier.

1. 1
   I built a tiny LLM to demystify how language models work▲915

   Built a ~9M param LLM from scratch to understand how they actually work. Vanilla transformer, 60K synthetic conversations, ~130 lines of PyTorch. Trains in 5 min on a free Colab T4. The fish thinks the meaning of life is food. Fork it and swap the personality for your own character.

   Apr 2026 · github.com · its alternatives →

2. 2
   TensorZero▲307

   Hi HN! We're Gabriel & Viraj, and we're excited to open source TensorZero. To be a little cheeky, TensorZero is an open-source platform that helps LLM applications graduate from API wrappers into defensible AI products. 1. Integrate our model gateway 2. Send metrics or feedback 3. Unlock compounding improvements in quality, cost, and latency It enables a data & learning flywheel for LLMs by unifying: • Inference: one API for all LLMs, with <1ms P99 overhead • Observability: inference & feedback → your database • Optimization: better prompts, models, inference strategies • Experimentation:…

   2025 · github.com · its alternatives →

3. 3
   I made an app to use local AI as daily driver▲637

   Hi Hackers, Excited to share a macOS app I've been working on: https:&#x2F;&#x2F;recurse.chat&#x2F; for chatting with local AI. While it's amazing that you can run AI models locally quite easily these days (through llama.cpp &#x2F; llamafile &#x2F; ollama &#x2F; llm CLI etc.), I missed feature complete chat interfaces. Tools like LMStudio are super powerful, but there's a learning curve to it. I'd like to hit a middleground of simplicity and customizability for advanced users. Here's what separates RecurseChat out from similar apps: - UX designed for you to use local AI as a daily driver.…

   2024 · recurse.chat · its alternatives →

4. 4
   Z80-μLM, a 'Conversational AI' That Fits in 40KB▲514

   How small can a language model be while still doing something useful? I wanted to find out, and had some spare time over the holidays. Z80-μLM is a character-level language model with 2-bit quantized weights ({-2,-1,0,+1}) that runs on a Z80 with 64KB RAM. The entire thing: inference, weights, chat UI, it all fits in a 40KB .COM file that you can run in a CP&#x2F;M emulator and hopefully even real hardware! It won't write your emails, but it can be trained to play a stripped down version of 20 Questions, and is sometimes able to maintain the illusion of having simple but terse conversations…

   Dec 2025 · github.com · its alternatives →

5. 5
   Open-Source Alternative to OpenAI Platform, for Local Models▲93

   Hi everyone, we’re a small team, supported by Mozilla, who are working on re-imagining a UI for training, tuning and testing local LLMs. Everything is open source. If you’ve been training your own LLMs or have always wanted to, we’d love for you to play with the tool and give feedback on what the future development experience for LLM engineering could look like.

   2025 · github.com · its alternatives →

6. 6
   Tiny-vLLM – high performance LLM inference engine in C++ and CUDA▲205

   Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM - jmaczan/tiny-vllm

   May 2026 · github.com · its alternatives →

7. 7
   LLM Gatewayfree tier▲296

   I built an OpenAI-compatible LLM gateway that routes requests to OpenAI, Anthropic, Ollama, vLLM, llama-server, SGLang... anything that speaks &#x2F;v1&#x2F;chat&#x2F;completions. Single Go binary, one YAML config file, no infrastructure. It does the things you'd expect from this kind of gateway... semantic routing via a three-layer cascade (keyword heuristics, embedding similarity, LLM classifier) that picks the best model when clients omit the model field, weighted round-robin load balancing across local inference servers with health checks and failover. The part I think is most…

   2025 · llmgateway.io · its alternatives →

8. 8WM
   We made glhf.chat – run almost any open-source LLM, including 405B▲161

   Try it out! https:&#x2F;&#x2F;glhf.chat&#x2F; Hey HN! We’ve been working for the past few months on a website to let you easily run (almost) any open-source LLM on autoscaling GPU clusters. It’s free for now while we figure out how to price it, but we expect to be cheaper than most GPU offerings since we can run the models multi-tenant. Unlike Together AI, Fireworks, etc, we’ll run any model that the open-source vLLM project supports: we don’t have a hardcoded list. If you want a specific model or finetune, you don’t have to ask us for it: you can just paste the Hugging Face link in and…

   2024 · glhf.chat · its alternatives →

9. 9
   Smolmodels – open-source tool to build ML models using natural language▲37

   Hi HN - Marcello and Vaibhav here. We built smolmodels to experiment with using LLMs for ML development. It's a fully open-source library that generates complete model training and inference code from natural language descriptions. It combines graph search with LLM code generation to find a model that gives as good predictions as possible. The core idea is that LLMs are overkill for a lot of predictive tasks. Smolmodels automates the trial-and-error process of finding the right model architecture and training approach, letting you build small, specialised models. You can either provide your…

   2025 · github.com · its alternatives →

10. 10IB
    I built an open source dynamic and cheaper TypeForm using AI▲15

    Hi everyone, I recently built a tool called Ziggy. Ziggy is a alternative to tools like Typeform except Ziggy uses AI to ask dynamic questions like you would ask when doing an interview with a user with some pretty powerful analytics. It's completely open source and was made to help save time and money doing 1-on-1 interviews with a lot of users in a short amount of time. We're also looking for any and all feedback so let me know what you think! Give it a try here by doing a feedback survey for Ziggy: https:&#x2F;&#x2F;www.useziggy.com&#x2F;zy&#x2F;MtAp-d7ebzylr

    2024 · useziggy.com · its alternatives →

11. 11
    LLM, a Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)▲45

    G'day, HN! I'm one of the maintainers of `llm`. I've been working alongside a trusty group of contributors to bring this project to life, and we're now at a point where we're ready to share it with the world. Large language models (LLMs) are taking the computing world by storm due to their emergent abilities that allow them to perform a wide variety of tasks, including translation, summarization, code generation, and even some degree of reasoning. However, the ecosystem around LLMs is still in its infancy, and it can be difficult to get started with these models. `llm` is a one-stop shop for…

    2023 · github.com · its alternatives →

12. 12IB
    In-Browser Graph RAG with Kuzu-WASM and WebLLM▲158

    We show the potential of modern, embedded graph databases in the browser by demonstrating a fully in-browser chatbot that can perform Graph RAG using Kuzu (the graph database we're building) and WebLLM, a popular in-browser inference engine for LLMs. The post retrieves from the graph via a Text-to-Cypher pipeline that translates a user question into a Cypher query, and the LLM uses the retrieved results to synthesize a response. As LLMs get better, and WebGPU and Wasm64 become more widely adopted, we expect to be able to do more and more in the browser in combination with LLMs, so a lot of…

    2025 · blog.kuzudb.com · its alternatives →

13. 13
    Dolly▲113

    Democratizing the magic of ChatGPT with open models

    2023 · github.com · its alternatives →

14. 14
    LLM Explorer▲152

    Find your best LLM for a local inference

    2023 · its alternatives →

15. 15
    Learn LLMs LeetCode Style▲181

    LeetCode for PyTorch — 65 ML/AI interview problems from real interviews at Google, Meta, Anthropic. Jupyter notebooks, an auto-grader, and an MCP AI tutor. - Exorust/TorchLeet

    2025 · github.com · its alternatives →

16. 16WE
    WebGPU enables local LLM in the browser – demo site with AI chat▲145

    Browser LLM demo working on JavaScript and WebGPU. WebGPU is already supported in Chrome, Safari, Firefox, iOS (v26) and Android. Demo, similar to ChatGPT https:&#x2F;&#x2F;andreinwald.github.io&#x2F;browser-llm&#x2F; Code https:&#x2F;&#x2F;github.com&#x2F;andreinwald&#x2F;browser-llm - No need to use your OPENAI_API_KEY - its local model that runs on your device - No network requests to any API - No need to install any program - No need to download files on your device (model is cached in browser) - Site will ask before downloading large files (llm model) to browser cache - Hosted on Github…

    2025 · andreinwald.github.io · its alternatives →

17. 17
    KTransformers–236B Model and 1M Context LLM Inference on Local Machines▲20

    Hey Hacker News! We are excited to share our open-source project, KTransformers, a flexible framework designed for cutting-edge LLM inference optimizations! Leveraging state-of-the-art kernels from llamafile and marlin, KTransformers seamlessly enhances the performance of HuggingFace Transformers, making it possible to operate large 236B MoE models or extremely long 1M context locally with promising speed. KTransformers is a Python-centric framework designed with extensibility at its core. By implementing and injecting an optimized module with a single line of code, users gain access to a…

    2024 · github.com · its alternatives →

18. 18
    Fine-grained stylistic control of LLMs using model arithmetic▲85

    We developed a new framework that enables flexible control of generated text in language models. By combining several models and&#x2F;or system prompts in one mathematical formula, it lets you tweak your style and combine model outputs with ease. A handy tool for those working with LLMs, looking for more fine-grained control of stylistic output. More details in our paper: https:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;2311.14479. Feedback and potential applications are welcome.

    2023 · github.com · its alternatives →

19. 19
    Arkor▲142

    Fine-tune and Deploy Open-weight Models in TypeScript

    Jul 2026 · arkor.ai · its alternatives →

20. 20
    Zig Topological Sort Library for Parallel Processing▲114

    I believe the best way to learn a language is by doing an in-depth project. This is my first Zig project intended for learning the ropes on publishing a Zig package. It turns out to be quite solid and performant. It might be a bit over-engineered. This little library is packed with the following features: - Building dependency graph from dependency data. - Performing topological sort on the dependency graph. - Generating dependence-free subsets for parallel processing. - Cycle detection and cycle reporting.

    2025 · github.com · its alternatives →

21. 21
    Local LLMs by Sttabot AI▲112

    Build local LLMs using top data science libraries

    2023 · its alternatives →

22. 22
    BrowserAI – Run LLMs directly in browser using WebGPU (open source)▲85

    Check out this impressive project that enables running LLMs entirely in the browser using WebGPU. Key features: - Zero token costs, no cloud infrastructure required - Complete data privacy through local processing - Simple 3-line code integration - Built on MLC and Transformer.js The benchmarks show smaller models can effectively handle many common tasks. Currently the project roadmap includes: - No-code AI pipeline builder - Browser-based RAG for document chat - Analytics&#x2F;logging - Model fine-tuning interface

    2025 · github.com · its alternatives →

23. 23
    Create-LLM – Train your own LLM in 60 seconds▲54

    https:&#x2F;&#x2F;medium.com&#x2F;@theaniketgiri&#x2F;three-months-ago-i-wanted-...

    Oct 2025 · github.com · its alternatives →

24. 24
    Open Codex – OpenAI Codex CLI with open-source LLMs▲106

    Hey HN, I’ve built Open Codex, a fully local, open-source alternative to OpenAI’s Codex CLI. My initial plan was to fork their project and extend it. I even started doing that. But it turned out their code has several leaky abstractions, which made it hard to override core behavior cleanly. Shortly after, OpenAI introduced breaking changes. Maintaining my customizations on top became increasingly difficult. So I rewrote the whole thing from scratch using Python. My version is designed to support local LLMs. Right now, it only works with phi-4-mini (GGUF) via…

    2025 · github.com · its alternatives →

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →