Life & fun · alternatives · 2026
24 alternatives to Llama Running on a Microcontroller
A "large" language model running on a microcontroller - maxbbraun/llama4micro
Llama Running on a Microcontroller is an open-source project that enables large language models to run on embedded devices with limited computing power. The project brings AI inference capabilities to microcontrollers… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Prices are shown for the 1 we have checked on their own sites, 1 of them free or with a free tier. Llama Running on a Microcontroller launched in 2023; newer entries below may have overtaken it.
- 1
Llama▲3123.1-405B: an open source model to rival GPT-4o / Claude-3.5
2024 · developer.meta.com · its alternatives →
- 2
Ollama▲235The easiest way to run large language models locally
2023 · github.com · its alternatives →
- 3
Llama 2▲263The next generation of Meta's open source LLM
2023 · developer.meta.com · its alternatives →
- 4
Llama 4▲422A new era of natively multimodal AI innovation
2025 · developer.meta.com · its alternatives →
- 5
Hi HN A few folks and I have been working on this project for a couple weeks now. After previously working on the Docker project for a number of years (both on the container runtime and image registry side), the recent rise in open source language models made us think something similar needed to exist for large language models too. While not exactly the same as running linux containers, running LLMs shares quite a few of the same challenges. There are "base layers" (e.g. models like Llama 2), specific configuration to run correctly (parameters, temperature, context window sizes etc). There's…
2023 · github.com · its alternatives →
- 6
- 7
Some early results and next steps in adapting DeepMind's Genie world model for creating the music player of my dreams.
2025 · matthieulc.com · its alternatives →
- 8
Llama 3.3 70B▲347Llama 405B-level performance, at a fraction of the cost
2024 · developer.meta.com · its alternatives →
- 9
Hi Hackers, Excited to share a macOS app I've been working on: https://recurse.chat/ for chatting with local AI. While it's amazing that you can run AI models locally quite easily these days (through llama.cpp / llamafile / ollama / llm CLI etc.), I missed feature complete chat interfaces. Tools like LMStudio are super powerful, but there's a learning curve to it. I'd like to hit a middleground of simplicity and customizability for advanced users. Here's what separates RecurseChat out from similar apps: - UX designed for you to use local AI as a daily driver.…
2024 · recurse.chat · its alternatives →
- 10
I spent a lot of time and money on this rather big side project of mine that attempts to replicate the mechanistic interpretability research on proprietary LLMs that was quite popular this year and produced great research papers by Anthropic [1], OpenAI [2] and Deepmind [3]. I am quite proud of this project and since I consider myself the target audience for HackerNews did I think that maybe some of you would appreciate this open research replication as well. Happy to answer any questions or face any feedback. Cheers [1]…
2024 · github.com · its alternatives →
- 11
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support! - getumbrel/llama-gpt
2023 · github.com · its alternatives →
- 12
Llamao▲496Private & offline alternative to ChatGPT on your device
2025 · llamao.app · its alternatives →
- 13
Run leading vision models locally with the new engine
2025 · ollama.com · its alternatives →
- 14
High-speed download of LLaMA, Facebook's 65B parameter GPT model - shawwn/llama-dl
2023 · github.com · its alternatives →
- 15
We believe that AI should be fully open source and part of the collective knowledge. The original LLaMA code is GPL licensed which means any project using it must also be released under GPL. This "taints" any other code and prevents meaningful academic and commercial use. Lit-LLaMA solves that for good.
2023 · github.com · its alternatives →
- 16
The easiest way to do output iteration with Llama 3.1 405B
2024 · respan.ai · its alternatives →
- 17
We wrote our inference engine on Rust, it is faster than llama cpp in all of the use cases. Your feedback is very welcomed. Written from scratch with idea that you can add support of any kernel and platform.
2025 · github.com · its alternatives →
- 18
Explore large language models in 512MB of RAM. Contribute to jncraton/languagemodels development by creating an account on GitHub.
2023 · github.com · its alternatives →
- 19
Hey HN, Henry and Roman here - we've been building a cross-platform framework for deploying LLMs, VLMs, Embedding Models and TTS models locally on smartphones. Ollama enables deploying LLMs models locally on laptops and edge severs, Cactus enables deploying on phones. Deploying directly on phones facilitates building AI apps and agents capable of phone use without breaking privacy, supports real-time inference with no latency, we have seen personalised RAG pipelines for users and more. Apple and Google actively went into local AI models recently with the launch of Apple Foundation Frameworks…
2025 · github.com · its alternatives →
- 20
LLM Gatewayfree tier▲296I built an OpenAI-compatible LLM gateway that routes requests to OpenAI, Anthropic, Ollama, vLLM, llama-server, SGLang... anything that speaks /v1/chat/completions. Single Go binary, one YAML config file, no infrastructure. It does the things you'd expect from this kind of gateway... semantic routing via a three-layer cascade (keyword heuristics, embedding similarity, LLM classifier) that picks the best model when clients omit the model field, weighted round-robin load balancing across local inference servers with health checks and failover. The part I think is most…
2025 · llmgateway.io · its alternatives →
- 21RL
You can now build serverless AI inference web application with ggml.js's LM backends.
2023 · rahuldshetty.github.io · its alternatives →
- 22
Tiny Aya▲211Local, open-weight AI designed for real-world languages
Apr 2026 · cohere.com · its alternatives →
- 23
Marsha is a functional, higher-level, English-based programming language that gets compiled into tested Python software by an LLM - alantech/marsha
2023 · github.com · its alternatives →
- 24
Code Llama 70B▲144New, performant version of Meta's LLM for code generation
2024 · developer.meta.com · its alternatives →
Also compare
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →