Gerbil – an open source desktop app for running LLMs locally

In plain words

Gerbil is an open source desktop application that runs large language models locally on a user's computer. It uses llama.cpp backends and integrates with popular LLM frontends including Open WebUI, SillyTavern, and ComfyUI, with StableUI and KoboldAI Lite built in. The application handles both text and image generation tasks, designed to eliminate the need for managing multiple separate tools. Development is now focused on bug fixes and quality-of-life improvements rather than major new features.

written from the facts on this page · September 2026

From the sources

A desktop app for running Large Language Models locally. - GitHub - lone-cloud/gerbil: A desktop app for running Large Language Models locally.

In the maker’s words, at launch

Gerbil is an open source app that I've been working on for the last couple of months. The development now is largely done and I'm unlikely to add anymore major features. Instead I'm focusing on any bug fixes, small QoL features and dependency upgrades. Under the hood it runs llama.cpp (via koboldcpp) backends and…

• 
  I built a free in-browser Llama 3 chatbot powered by WebGPU2024 · github.com · ▲547

  I spent the last few days building out a nicer ChatGPT-like interface to use Mistral 7B and Llama 3 fully within a browser (no deps and installs). I’ve used the WebLLM project by MLC AI for a while to interact with LLMs in the browser when handling sensitive data but I found their UI quite lacking for serious use so I built a much better interface around WebLLM. I’ve been using it as a therapist and coach. And it’s wonderful knowing that my personal information never leaves my local computer. Should work on Desktop with Chrome or Edge. Other browsers are adding WebGPU support as well - see…

• 
  ChattyUI2024 · ▲149

  Run open-source LLMs locally in the browser using WebGPU

• 
  Langtail Public Beta2024 · langtail.com · ▲525

  Ship AI apps with fewer surprises

• 
  Langtail 1.02024 · langtail.com · ▲495

  The low-code platform for testing AI apps

• 
  Khoj – Chat offline with your second brain using Llama 22023 · github.com · ▲565

  Hi folks, we're Debanjum and Saba. We created Khoj as a hobby project 2+ years ago because: (1) Search on the desktop sucked; we just had keyword search on the desktop vs google for the internet; and (2) Natural language search models had become good and easy to run on consumer hardware by this point. Once we made Khoj search incremental, I completely stopped using the default incremental search (C-s) in Emacs. Since then Khoj has grown to support more content types, deeper integrations and chat (using ChatGPT). With Llama 2 released last week, chat models are finally good and easy enough to…

• 
  OpenUIMar 2026 · openui.com · ▲322

  Thesys just open-sourced their generative UI rendering engine. Interesting timing given where Google a2ui and Vercel's json-render are headed. The difference worth noting: a2ui and json-render both treat JSONL as the contract between the LLM and the renderer. Thesys is betting that's the wrong primitive. Their engine uses a code-like syntax (OpenUI Lang) instead — LLM writes it, renderer executes it. The argument is that LLMs are fundamentally better at generating code than generating structured data, so you get cleaner output and ~67% fewer tokens. The broader vision seems to be a…

• 
  /dev/null▲468

  a social network for devs

  Dev tools · 2d ago · dev-null.sh

• 
  Whiteboard (YC W26) – an open-source IDE for thoughtful software design▲423

  open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.

  Dev tools · 27d ago · github.com

• 
  Reladraw – A diagram language where you decide where to place things▲411

  Contribute to reladraw/reladraw development by creating an account on GitHub.

  Dev tools · 25d ago · github.com

• 
  OpenBot▲362

  Grok Bot alternative: free, local, open-source, multiplayer

  Dev tools · 22d ago · openbot.run

• 
  Talanoa▲340

  Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…

  Dev tools · 20d ago · talanoa.email

• 
  CoreSpeed▲332

  One MCP for everything your agents need: apps, memory, tools

  Dev tools · 27d ago · corespeed.io

• 
  Guideflow▲1,338

  Create interactive product demos and step-by-step guides in seconds with Guideflow, the leading AI-powered demo automation tool.

  AI · Nov 2025 · guideflow.com

• 
  I built a synth for my daughter▲1,278

  Hardware and software projects by Ali Roberts

  Life & fun · Nov 2025 · bitsnpieces.dev

• 
  Welltory▲1,028

  Measure your wellness. Use data to feel great every day.

  Work · Nov 2025 · welltory.com

• 
  Gemini 3▲1,016

  Bring any idea to life with multimodal capabilities

  AI · Nov 2025 · blog.google

• 
  TrustMRR▲833

  LLM Gateway is a b2b artificial intelligence based in United States, founded in 2025. $259,539/month in verified Stripe revenue. $78,764 MRR. Ahrefs Domain Rating 52/100. growing 55% month-over-month. Track LLM Gateway's verified metrics on TrustMRR.

  Growth · Nov 2025 · trustmrr.com

• 
  Boing▲782

  Life & fun · Nov 2025 · boing.greg.technology