AI · alternatives · 2026
24 alternatives to Local text, image, video, music and 3D from one CLI, no Python
Hi HN! I'm the author of mere.run a local first inference runtime built around an installable CLI. I believe that whenever possible we should use the stuff we already own (like our Mac laptops, decent machines gathering dust, our gaming PC) and the limited electrical power we have easy access to, like the socket in the wall next to most of us. We shouldn't have to send our data to the cloud hoping some T&C will prevent it from being used in a way that we'd regret. Most of the local AI solutions are technical, involved, and land a curious body in some package hell. People are optimizing for…
Mere.run is a command-line tool for running AI inference locally on personal devices without sending data to the cloud. It supports text, images, video, music, and 3D models through a single CLI interface that requires… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Prices are shown for the 1 we have checked on their own sites, 1 of them free or with a free tier.
- 1
The video demo runs a 7b Model on a normal gaming GPU. I think it already works quite well (accounting for the limited hardware power). :)
2024 · github.com · its alternatives →
- 2
Local▲107Super excited to launch our new app Local today. What we’ve learned at Base Compute over the last months is that running AI directly on your laptop or workstation gives you maximum privacy and it’s free, but it’s also a massive headache to configure. So we’ve decided what matters is making the experience completely frictionless for users. Local analyses the hardware of your laptop, optimises the AI for it, and recommends the best models for your specific device. It let’s you do what you’re doing with cloud AI already, just for free and on your own machine: Chatting with PDF’s, Recording and…
Aug 2026 · basecompute.co · its alternatives →
- 3
I built LocalGPT over 4 nights as a Rust reimagining of the OpenClaw assistant pattern (markdown-based persistent memory, autonomous heartbeat tasks, skills system). It compiles to a single ~27MB binary — no Node.js, Docker, or Python required. Key features: - Persistent memory via markdown files (MEMORY, HEARTBEAT, SOUL markdown files) — compatible with OpenClaw's format - Full-text search (SQLite FTS5) + semantic search (local embeddings, no API key needed) - Autonomous heartbeat runner that checks tasks on a configurable interval - CLI + web interface + desktop GUI - Multi-provider:…
Feb 2026 · github.com · its alternatives →
- 4
We wrote our inference engine on Rust, it is faster than llama cpp in all of the use cases. Your feedback is very welcomed. Written from scratch with idea that you can add support of any kernel and platform.
2025 · github.com · its alternatives →
- 5
Cai▲179Hi HN, Cai runs actions on your selection via ⌥C, pick an action (AI, shell, GitHub issue, Linear ticket), done. Bundled local model (MLX Community), create custom actions with prompts, scripts and more. Free, MIT. Built after my Raycast extension sat in review queue for 3+ months. Wanted no typing, no app switching, no cloud. Repo: https://github.com/cai-layer/cai Demo: https://youtu.be/LH2MYNQ_wsk
Apr 2026 · getcai.app · its alternatives →
- 6
Replicas▲239Hey HN! I'm Connor, creator of Replicas. I'm a heavy Codex/Claude Code user, and I wanted to hand off tasks to agents like I would to an engineer - kick something off before work, let it scaffold while I'm at lunch, even come back to a ready PR. The problem: existing alternatives use workspace VMs that are black boxes. I have no access to any of them - they can't run tests, read logs, or use tools like the Playwright MCP (which I use to verify agents actually fixed what they claim to fix). Replicas gives agents real cloud workspaces where they can: - Run your test suite and read the…
Jun 2026 · replicas.dev · its alternatives →
- 7
Viberia▲146Hey HN, This is my take on the agent harness. Everything on an isometric map. Agents are grouped into "buildings" that run in a sequence or a loop; e.g., the CodeForge has an agent that writes a PRD, another one that implements, and a third that reviews. Everything is customizable, you build your own buildings/teams however you want. It's a Tauri app, really light (about 8x less energy than the closest competitor I benchmarked, so it actually runs from a coffee shop on battery). It's macOS only for now, but ping me if you are willing to test the Windows or Linux version. I've been…
May 2026 · getviberia.com · its alternatives →
- 8
YepCode▲157Hey HN, We’re excited to introduce YepCode Run, a serverless runtime and SDK for executing code in secure sandboxes. Built on top of YepCode (https://yepcode.io), it allows you to execute code without any setup or installation. Perfect for: * Running AI-generated code – Securely in a sandbox environment, enabling fully autonomous AI agents. * Package Exploration – Try npm or PyPI packages without installing them locally. * Code Sharing – Easily share runnable code examples with others. * Quick Prototyping – Test snippets and algorithms on the fly. Just write or paste your code, and…
2022 · yepcode.io · its alternatives →
- 9
local.ai▲104Free, local & offline AI with zero technical setup
2023 · localai.app · its alternatives →
- 10RL
Hello Hacker News! We're Yangqing, Xiang and JJ from lepton.ai. We are building a platform to run any AI models as easy as writing local code, and to get your favorite models in minutes. It's like container for AI, but without the hassle of actually building a docker image. We built and contributed to some of the world's most popular AI software - PyTorch 1.0, ONNX, Caffe, etcd, Kubernetes, etc. We also managed hundreds of thousands of computers in our previous jobs. And we found that the AI software stack is usually unnecessarily complex - and we want to change that. Imagine if you are a…
2023 · lepton.ai · its alternatives →
- 11
Hi HN, I'm thrilled to share with you think, a command-line tool that I developed while diving back into the programming scene. For the past few years, my focus had shifted from hands-on programming to managerial roles, my last one being at Affirm (I started Affirm's Polish office). However, I recently left my job to revisit my passion for coding and see if I could still write code that works. Not to mention that with what is currently going on in AI if you are a developer this probably the best possible time for a sabbatical in human history :) My first attempt was with LangChain, but I…
2023 · github.com · its alternatives →
- 12CI
One of the most frequent questions one faces while running LLMs locally is: I have xx RAM and yy GPU, Can I run zz LLM model ? I have vibe coded a simple application to help you with just that. Update: A lot of great feedback for me to improve the app. Thank you all.
2025 · can-i-run-this-llm-blue.vercel.app · its alternatives →
- 13
Hi HN, I built OpenGraviton, an open-source AI inference engine that pushes the limits of running extremely large LLMs on consumer hardware. By combining 1.58-bit ternary quantization, dynamic sparsity with Top-K pruning and MoE routing, and mmap-based layer streaming, OpenGraviton can run models far larger than your system RAM—even on a Mac Mini. Early benchmarks: TinyLlama-1.1B drops from ~2GB (FP16) to ~0.24GB with ternary quantization. At 140B scale, models that normally require ~280GB fit within ~35GB packed. Optimized for Apple Silicon with Metal + C++ tensor unpacking, plus…
Mar 2026 · github.com · its alternatives →
- 14
Hi HN! My name is Marko and I am working on a CI/CD system at harmont.dev, a CI/CD system that sucks slightly less. As I've been working on the cloud, I realized that the CLI might be generally useful as a task runner, even if you don't care for our CI/CD, and that's what I'm sharing here! Every CI system I've used at Tesla, Bun, and mesa.dev has had the same problems: stateless and slow (GHA), or stateful and horizontally unscalable (Jenkins), with YAML on top of either. The straw that broke the camel's back for me was the realization that all my Claudes are waiting upwards…
May 2026 · github.com · its alternatives →
- 15
I got tired of the overhead required to run even a simple data analysis - cloud setup, ETL pipelines, orchestration, cost monitoring - so I built a fully local data-stack/IDE where I can write SQL/Py, run it, see results, and iterate quickly and interactively. You get data lake like catalog, zero-ETL, lineage, versioning, and analytics running entirely on your machine. You can import from a database, webpage, CSV, etc. and query in natural language or do your own work in SQL/Pyspark. Connect to local models like Gemma or cloud LLMs like Claude for querying and analysis. You…
Apr 2026 · stream-sock-3f5.notion.site · its alternatives →
- 16IB
I had 14,000 photos sitting on a drive and wanted an excuse to play with local vision models and Elixir/Phoenix. I originally tried to get LLaVA to tell me if a photo was 'good' or matched my style, but quickly learned that LLMs have terrible taste. I ended up demoting the LLM to just extract metadata, and built a custom CLIP/Ridge Regression pipeline to actually learn my preferences based on how I rate things. The stack is Phoenix/Oban on the orchestrator side, and Python/FastAPI/Instructor for the AI workers. Happy to answer any questions about the architecture,…
Apr 2026 · qwelian.com · its alternatives →
- 17
Hi there, looking for feedback on my new project "Featherless.AI" The idea is to allow users to run all the models on hugging face instantly. Via the OpenAI API compatible endpoint. Why? Because its a real chore to download models and spin up GPUs, especially if you want to test multiple models. Not to mention GPUs cost multiple dollars an hour to rent. And if we want more people to use open source AI, we got to make it easier for them to try and play with all of them. So what if instead of spinning up dedicated GPUs per model (which is what every provider is doing) We can startup a LLM…
2024 · featherless.ai · its alternatives →
- 18
Cause "You're absolutely right" is probably absolutely wrong
Apr 2026 · npmjs.com · its alternatives →
- 19
Powerful Simulations & AI Notebooks - Without the Cloud
2025 · snapthinkllm.com · its alternatives →
- 20
I made my first macOS utility app that ships with a bundled Gemma 4 model, specifically the Gemma E4B one. It made my app DMG have 5.3 GB in size, but I think it is a small size for the power that this free local model can provide. It runs fine on CPU, but can also run on Apple Silicon GPU, although I did not notice any performance improvements with GPU (tested on a M5 chip). I think these local lightweight and multimodal models will open multiple possibilities for new software tools where privacy is essential.
May 2026 · snapname.app · its alternatives →
- 21
Read an article about analyzing Garmin data with AI. Sounded great — except I didn't want to send my health data to any cloud service. So I asked Claude to write me 2-3 scripts and a dashboard. This escalated a bit. 30 days and 20$ later I have this: A local-first Garmin archive with interactive HTML dashboards, Excel exports, weather and pollen context, AES-256 encrypted token storage, and a self-healing data pipeline with 515 automated tests. Windows desktop app, no terminal needed. Nothing leaves your machine. I never wrote a line of Python. I understood the problems and made the…
Apr 2026 · github.com · its alternatives →
- 22
Your Mac can run AI that holds its own against cloud models for the everyday stuff: chatting, making images, reading documents, transcribing voice. The hardware got there a while ago. The software to actually use it locally mostly didn't, so I built Off Grid. Download a model and it all runs on your machine. Ask it something on a flight with no wifi. Summarize a confidential document that never leaves your laptop. Run a hundred image generations in a loop and pay nothing, because it's your own GPU doing the work. Swap your paid dictation app for local Whisper. Talk through a coding problem…
Jun 2026 · github.com · its alternatives →
- 23
I wanted a file management tool that actually understands what my files are about. Previous projects like LlamaFS (https://github.com/iyaja/llama-fs) aren't 100% local and require an AI API. So, I created a Python script that leverages AI to organize local files, running entirely on your device for complete privacy. It uses Google Gemma2 2B and llava-v1.6-vicuna-7b models for processing. Note: You won't need any API key and internet connection to run this project, it runs models entirely on your device. What it does: - Scans a specified input directory for files -…
2024 · github.com · its alternatives →
- 24
Local In-Browser LLM inference for private, fast, and secure chat - no server required.
2025 · private-ai-chat.vercel.app · its alternatives →
Also compare
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →