AI · alternatives · 2026
24 alternatives to Alpaca.cpp – Run an Instruction-Tuned Chat-Style LLM on a MacBook
Locally run an Instruction-Tuned Chat-Style LLM . Contribute to antimatter15/alpaca.cpp development by creating an account on GitHub.
Alpaca.cpp is a software tool that enables users to run an instruction-tuned chat-style large language model directly on a MacBook without requiring external servers. It is designed for Mac users who want to experiment… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Alpaca.cpp – Run an Instruction-Tuned Chat-Style LLM on a MacBook launched in 2023; newer entries below may have overtaken it.
- 1
Hi Hackers, Excited to share a macOS app I've been working on: https://recurse.chat/ for chatting with local AI. While it's amazing that you can run AI models locally quite easily these days (through llama.cpp / llamafile / ollama / llm CLI etc.), I missed feature complete chat interfaces. Tools like LMStudio are super powerful, but there's a learning curve to it. I'd like to hit a middleground of simplicity and customizability for advanced users. Here's what separates RecurseChat out from similar apps: - UX designed for you to use local AI as a daily driver.…
2024 · recurse.chat · its alternatives →
- 2
ChatLLaMA is an experimental chatbot interface for interacting with variants of Facebook's LLaMA. Currently, we support the 7 billion parameter variant that was fine-tuned on the Alpaca dataset. This early versions isn't as conversational as we'd like, but over the next week or so, we're planning on adding support for the 30 billion parameter variant, another variant fine-tuned on LAION's OpenAssistant dataset and more as we explore what this model is capable of. If you want deploy your own instance is the model powering the chatbot and build something similar we've open sourced the Truss…
2023 · chatllama.baseten.co · its alternatives →
- 3WD
2023 · lama.nbnl.uk · its alternatives →
- 4
Dalai Alpaca is here! https://t.co/lm6Kx7QExs Now you can run the Alpaca LLM on your computer (Mac, Windows, Linux) with just ONE command! Best of all, all you need is just around 4.2GB of disk space! Just run this:
2023 · twitter.com · its alternatives →
- 5
I've been playing around with https://github.com/zphang/minimal-llama/ and https://github.com/tloen/alpaca-lora/blob/main/finetune.py, and wanted to create a simple UI where you can just paste text, tweak the parameters, and finetune the model quickly using a modern GPU. To prepare the data, simply separate your text with two blank lines. There's an inference tab, so you can test how the tuned model behaves. This is my first foray into the world of LLM finetuning, Python, Torch, Transformers, LoRA, PEFT, and Gradio. Enjoy!
2023 · github.com · its alternatives →
- 6
Hi HN, OpenAI recently released a model for automatic speech recognition called Whisper [0]. I decided to reimplement the inference of the model from scratch using C/C++. To achieve this I implemented a minimalistic tensor library in C and ported the high-level architecture of the model in C++. The entire code is less than 8000 lines of code and is contained in just 2 source files without any third-party dependencies. The Github project is here: https://github.com/ggerganov/whisper.cpp With this implementation I can very easily build and run the model - “make…
2022 · github.com · its alternatives →
- 7
- 8
Github: https://github.com/Arthur-Ficial/apfel
Apr 2026 · apfel.franzai.com · its alternatives →
- 9
A CLI for stock trading with Alpaca written in Go
2020 · gitlab.com · its alternatives →
- 10
Hi HN A few folks and I have been working on this project for a couple weeks now. After previously working on the Docker project for a number of years (both on the container runtime and image registry side), the recent rise in open source language models made us think something similar needed to exist for large language models too. While not exactly the same as running linux containers, running LLMs shares quite a few of the same challenges. There are "base layers" (e.g. models like Llama 2), specific configuration to run correctly (parameters, temperature, context window sizes etc). There's…
2023 · github.com · its alternatives →
- 11
We wrote our inference engine on Rust, it is faster than llama cpp in all of the use cases. Your feedback is very welcomed. Written from scratch with idea that you can add support of any kernel and platform.
2025 · github.com · its alternatives →
- 12
GPT4All▲107A chatbot trained on a massive collection of clean data
2023 · github.com · its alternatives →
- 13
Alpie Core▲177A 4-bit reasoning model with frontier-level performance
Dec 2025 · playground.169pi.ai · its alternatives →
- 14
Ollama v0.19▲410Massive local model speedup on Apple Silicon with MLX
Apr 2026 · ollama.com · its alternatives →
- 15
Hey HN, Henry and Roman here - we've been building a cross-platform framework for deploying LLMs, VLMs, Embedding Models and TTS models locally on smartphones. Ollama enables deploying LLMs models locally on laptops and edge severs, Cactus enables deploying on phones. Deploying directly on phones facilitates building AI apps and agents capable of phone use without breaking privacy, supports real-time inference with no latency, we have seen personalised RAG pipelines for users and more. Apple and Google actively went into local AI models recently with the launch of Apple Foundation Frameworks…
2025 · github.com · its alternatives →
- 16
Ollama▲235The easiest way to run large language models locally
2023 · github.com · its alternatives →
- 17
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support! - getumbrel/llama-gpt
2023 · github.com · its alternatives →
- 18
Llama 2▲263The next generation of Meta's open source LLM
2023 · developer.meta.com · its alternatives →
- 19MG
Hello HN, I've been working on this project for a while, and it has been in an "open" beta for some time. I finally believe it's ready for its first release. I hope you like it. Here are some potential questions that may arise: 1. How does it compare to LM Studio? It's likely that if you're already using LM Studio, you'll continue to do so. This project is designed to be more user-friendly. 2. Is it open-source? No, it is not. 3. Does it use any open-source libraries? Yes, it uses llama.cpp and a few others, as indicated in the license information included with the application. 4. Why is not…
2023 · avapls.com · its alternatives →
- 20
ManePaw▲85Find documents on your Mac using natural language
Feb 2026 · github.com · its alternatives →
- 21
Claunnector▲78Connect your Mac's Mail, Calendar, and more to AI
Apr 2026 · claunnector.com · its alternatives →
- 22
Simple REST API for commission-free stock trading
2018 · alpaca.markets · its alternatives →
- 23
flock▲79Run a flock of Claude Code (or other agents) in one window.
Apr 2026 · baahaus.github.io · its alternatives →
- 24
Welcome to Project S.A.T.U.R.D.A.Y. This is a project that allows anyone to easily build their own self-hosted J.A.R.V.I.S-like voice assistant. In my mind vocal computing is the future of human-computer interaction and by open sourcing this code I hope to expedite us on that path. I have had a blast working on this so far and I'm excited to continue to build with it. It uses whisper.cpp [1], Coqui TTS [2] and OpenAI [3] to do speech-to-text, text-to-text and text-to-speech inference all 100% locally (except for text-to-text). In the future I plan to swap out OpenAI for llama.cpp [4]. It is…
2023 · github.com · its alternatives →
Also compare
- I made an app to use local AI as daily driver alternatives
- ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA alternatives
- Web demo of 13B Alpaca-LLaMA trained on improved Stanford dataset alternatives
- Dalai Alpaca – Instant Alpaca web UI and API for windows, Linux and Mac alternatives
- Finetune LLaMA-7B on commodity GPUs using your own text alternatives
- Port of OpenAI's Whisper model in C/C++ alternatives
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →