Alpaca.cpp – Run an Instruction-Tuned Chat-Style LLM on a MacBook

In plain words

Alpaca.cpp is a software tool that enables users to run an instruction-tuned chat-style large language model directly on a MacBook without requiring external servers. It is designed for Mac users who want to experiment with AI chatbots locally. The software brings language model capabilities to personal computers, allowing for private conversations without relying on cloud-based services.

written from the facts on this page · September 2026

• 
  I made an app to use local AI as daily driver2024 · recurse.chat · ▲637

  Hi Hackers, Excited to share a macOS app I've been working on: https://recurse.chat/ for chatting with local AI. While it's amazing that you can run AI models locally quite easily these days (through llama.cpp / llamafile / ollama / llm CLI etc.), I missed feature complete chat interfaces. Tools like LMStudio are super powerful, but there's a learning curve to it. I'd like to hit a middleground of simplicity and customizability for advanced users. Here's what separates RecurseChat out from similar apps: - UX designed for you to use local AI as a daily driver.…

• 
  ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA2023 · chatllama.baseten.co · ▲402

  ChatLLaMA is an experimental chatbot interface for interacting with variants of Facebook's LLaMA. Currently, we support the 7 billion parameter variant that was fine-tuned on the Alpaca dataset. This early versions isn't as conversational as we'd like, but over the next week or so, we're planning on adding support for the 30 billion parameter variant, another variant fine-tuned on LAION's OpenAssistant dataset and more as we explore what this model is capable of. If you want deploy your own instance is the model powering the chatbot and build something similar we've open sourced the Truss…

• WD
  Web demo of 13B Alpaca-LLaMA trained on improved Stanford dataset2023 · lama.nbnl.uk · ▲42
• 
  Dalai Alpaca – Instant Alpaca web UI and API for windows, Linux and Mac2023 · twitter.com · ▲11

  Dalai Alpaca is here! https://t.co/lm6Kx7QExs Now you can run the Alpaca LLM on your computer (Mac, Windows, Linux) with just ONE command! Best of all, all you need is just around 4.2GB of disk space! Just run this:

• 
  Finetune LLaMA-7B on commodity GPUs using your own text2023 · github.com · ▲449

  I've been playing around with https://github.com/zphang/minimal-llama/ and https://github.com/tloen/alpaca-lora/blob/main/finetune.py, and wanted to create a simple UI where you can just paste text, tweak the parameters, and finetune the model quickly using a modern GPU. To prepare the data, simply separate your text with two blank lines. There's an inference tab, so you can test how the tuned model behaves. This is my first foray into the world of LLM finetuning, Python, Torch, Transformers, LoRA, PEFT, and Gradio. Enjoy!

• 
  Port of OpenAI's Whisper model in C/C++2022 · github.com · ▲399

  Hi HN, OpenAI recently released a model for automatic speech recognition called Whisper [0]. I decided to reimplement the inference of the model from scratch using C/C++. To achieve this I implemented a minimalistic tensor library in C and ported the high-level architecture of the model in C++. The entire code is less than 8000 lines of code and is contained in just 2 source files without any third-party dependencies. The Github project is here: https://github.com/ggerganov/whisper.cpp With this implementation I can very easily build and run the model - “make…

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 18d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 18d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 20d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 21d ago · stillwet.art

• 
  PixVerse R2▲381

  A real-time world model you can explore and change

  AI · 30d ago · world.pixverse.video

• 
  Beam.win▲378

  Run AI agents on one Mac and use its windows on another

  AI · 4d ago · beam.win

• 
  GPT-4▲1,160

  More accurate, less cringe, smoother & useful daily chats!

  AI · 2023 · openai.com

• 
  Collato▲972

  One AI search to find anything instantly, across all apps

  AI · 2023

• 
  Typing Mind▲826

  Chat with AI using your API keys. Pay only for what you use. ChatGPT, Gemini, Claude, and other LLMs supported. The best chat LLM frontend UI for all AI models.

  AI · 2023 · typingmind.com

• 
  Arc for iOS▲825

  Meet the internet again

  Work · 2023 · apps.apple.com

• 
  Sequoia▲726

  Personalized men's sexual health with on-demand experts

  Life & fun · 2023 · sequoia.health

• BI
  BBC “In Our Time”, categorised by Dewey Decimal, heavy lifting by GPT▲688

  I'm a big fan of the BBC podcast In Our Time -- and (like most people) I've been playing with the OpenAI APIs. In Our Time has almost 1,000 episodes on everything from Cleopatra to the evolution of teeth to plasma physics, all still available, so it's my starting point to learn about most topics. But it's not well organised. So here are the episodes sorted by library code. It's fun to explore. Web scraping is usually pretty tedious, but I found that I could send the minimised HTML to GPT-3 and get (almost) perfect JSON back: the prompt includes the Typescript definition. At the same time I…

  AI · 2023 · genmon.github.io