docker/model-runner – an open-source tool for local LLMs

In plain words

Docker Model-Runner is an open-source tool that provides a unified interface for downloading and running large language models locally. It works with multiple model backends, including llama.cpp, and allows users to transport and share models through OCI registries like Docker Hub. Designed for developers who want to run LLMs on their own infrastructure, it simplifies model management and distribution through standardized packaging and a curated collection of pre-configured models.

written from the facts on this page · September 2026

From the sources

Docker Model Runner. Contribute to docker/model-runner development by creating an account on GitHub.

In the maker’s words, at launch

Hey Hacker News, We're the maintainers of docker/model-runner and wanted to share some major updates we're excited about. Link: https://github.com/docker/model-runner We are rebooting the community: https://www.docker.com/blog/rebooting-model-runner-community... At its…

• 
  Ollama – Run LLMs on your Mac2023 · github.com · ▲284

  Hi HN A few folks and I have been working on this project for a couple weeks now. After previously working on the Docker project for a number of years (both on the container runtime and image registry side), the recent rise in open source language models made us think something similar needed to exist for large language models too. While not exactly the same as running linux containers, running LLMs shares quite a few of the same challenges. There are "base layers" (e.g. models like Llama 2), specific configuration to run correctly (parameters, temperature, context window sizes etc). There's…

• 
  ModelHubMay 2026 · studio.consciousengines.com · ▲317

  The missing menu bar app for local LLMs on Mac.

• MO
  ModelRunner – open source, speech-enabled data management platform2022 · modelrunner.org · ▲42

  Warning: this whole post is a blatant plug for my Open Source project https://github.com/etiennesillon/ModelRunner There is lot of discussion around no code platforms and why developers don’t like them. My view is that they can be very useful to quickly get through the boring parts of a project, like creating master data management screens for example. So I’ve built my own version which interprets models at run time and, it turns out, understands natural language queries too! Hi, my name is Etienne, I love coding and I’ve been doing it for a few decades now so I’d rather…

• 
  Ollama multimodal engine2025 · ollama.com · ▲277

  Run leading vision models locally with the new engine

• 
  Ollama2023 · github.com · ▲235

  The easiest way to run large language models locally

• 
  GoModel – an open-source AI gateway in GoApr 2026 · github.com · ▲217

  Hi, I’m Jakub, a solo founder based in Warsaw. I’ve been building GoModel since December with a couple of contributors. It's an open-source AI gateway that sits between your app and model providers like OpenAI, Anthropic or others. I built it for my startup to solve a few problems: - track AI usage and cost per client or team - switch models without changing app code - debug request flows more easily - reduce AI spendings with exact and semantic caching How is it different? - ~17MB docker image - LiteLLM's image is more than 44x bigger ("docker.litellm.ai/berriai/litellm:latest" ~…

• 
  /dev/null▲468

  a social network for devs

  Dev tools · 2d ago · dev-null.sh

• 
  Whiteboard (YC W26) – an open-source IDE for thoughtful software design▲423

  open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.

  Dev tools · 27d ago · github.com

• 
  Reladraw – A diagram language where you decide where to place things▲411

  Contribute to reladraw/reladraw development by creating an account on GitHub.

  Dev tools · 25d ago · github.com

• 
  OpenBot▲362

  Grok Bot alternative: free, local, open-source, multiplayer

  Dev tools · 22d ago · openbot.run

• 
  Talanoa▲340

  Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…

  Dev tools · 20d ago · talanoa.email

• 
  CoreSpeed▲332

  One MCP for everything your agents need: apps, memory, tools

  Dev tools · 27d ago · corespeed.io

• 
  Cursor 2.0▲957

  Our first coding model and new interface for agents

  AI · Oct 2025 · cursor.com

• 
  Flask▲806

  Notion + Loom, for video collaboration.

  AI · 2025 · flask.do

• 
  Strange Attractors▲804

  I went down the rabbit hole on a side project and ended up building this: Strange Attractors(https://blog.shashanktomar.com/posts/strange-attractors). It’s built with three.js. Working on it reminded me of the little "maths for fun" exercises I used to do while learning programming in early days. Just trying things out, getting fascinated and geeky, and being surprised by the results. I spent way too much time on this, but it was extreme fun. My favorite part: someone pointed me to the Simone Attractor on Threads. It is a 2D attractor and I asked GPT to extrapolate it to…

  AI · Oct 2025 · blog.shashanktomar.com

• 
  Orchestra▲793

  A chat-centric workspace for builders and modern teams

  Work · 2025 · orch.so

• 
  Autism Simulator▲779

  Hey all, I built this. It’s not trying to capture every autistic experience (that’d be impossible). It’s based on my own lived experience as well as that of friends on the spectrum. I'm trying to give people a feel for what masking, decision fatigue, and burnout can look like day-to-day. That’s hard to explain in words, but easier to show through choices and stats. I'm not trying to "define autism". I’ve gotten good feedback here about resilience, meds, and difficulty tuning. I’ll keep tweaking it. If even a few people walk away thinking, "ah, maybe that’s why my coworker struggles in those…

  Life & fun · 2025 · autism-simulator.vercel.app

• 
  Director▲768

  Lovable for web automation

  AI · 2025 · director.ai