Alternatives
Products that do what QuantaLLM does
Intelligence. Powered by Your Handhelds. Anywhere
- 1ZΜ
How small can a language model be while still doing something useful? I wanted to find out, and had some spare time over the holidays. Z80-μLM is a character-level language model with 2-bit quantized weights ({-2,-1,0,+1}) that runs on a Z80 with 64KB RAM. The entire thing: inference, weights, chat UI, it all fits in a 40KB .COM file that you can run in a CP/M emulator and hopefully even real hardware! It won't write your emails, but it can be trained to play a stripped down version of 20 Questions, and is sometimes able to maintain the illusion of having simple but terse conversations…
Dec 2025 · github.com
- 2
- 3
- 4
- 5LS
2023 · github.com
- 6L3
I spent a lot of time and money on this rather big side project of mine that attempts to replicate the mechanistic interpretability research on proprietary LLMs that was quite popular this year and produced great research papers by Anthropic [1], OpenAI [2] and Deepmind [3]. I am quite proud of this project and since I consider myself the target audience for HackerNews did I think that maybe some of you would appreciate this open research replication as well. Happy to answer any questions or face any feedback. Cheers [1]…
2024 · github.com
- 7
- 8
- 9
- 10
- 11
- 12
- 13
- 14
- 15
- 16
- 17LR
2023 · github.com
- 18
- 19
- 20LA
A simple mobile web app inspired by Fuzzy-Search/realtime-bakllava that uses llama.cpp server backend with multimodal mode to describe and narrate what the phone camera sees. I built this thing in a few hours using a single ChatGPT thread to generate most things for me and iterate on this project. Here's the workflow: https://chat.openai.com/share/ea84ec69-5617-45e8-8772-ac2dcf...
2023 · github.com
- 21OG
Your phone has a GPU more powerful than most 2018 laptops. Right now it sits idle while you pay monthly subscriptions to run AI on someone else's server, sending your conversations, your photos, your voice to companies whose privacy policy you've never read. Off Grid is an open-source app that puts that hardware to work. Text generation, image generation, vision AI, voice transcription — all running on your phone, all offline, nothing ever uploaded. That means you can use AI on a flight with no wifi. In a country with internet censorship. In a hospital where cloud services are a compliance…
Feb 2026 · github.com
- 22
Q3AS, deployment & execution of quantum algorithms by Aqora
2024
- 23
- 24Q3
Qwen 3.5 Small dropped two days ago. I had it running on a mid-tier Android phone within hours. It's great seeing the on-device AI community light up around this release. Off Grid brings it to Android: phones with 6GB RAM in the $200-300 range, ~8 tok/sec on the 2B model. Fully offline. Text generation, vision AI, image gen, voice transcription, tool calling, document analysis — all on-device, nothing uploaded, ever. Works in airplane mode. 780+ GitHub stars. ~2,000 downloads across Android and iOS. Early days. GitHub:…
Mar 2026 · github.com
Ranked by how close each launch is in meaning, then by votes. Refine with a description →