Alternatives
Products that do what Run LLMs in Docker for any language without prebuilding containers does
I've been looking for a way to run LLMs safely without needing to approve every command. There are plenty of projects out there that run the agent in docker, but they don't always contain the dependencies that I need. Then it struck me. I already define project dependencies with mise. What if we could build a container on the fly for any project by reading the mise config? I've been using agent-en-place for a couple of weeks now, and it's working great! I'd love to hear what y'all think
- 1OR
Hi HN A few folks and I have been working on this project for a couple weeks now. After previously working on the Docker project for a number of years (both on the container runtime and image registry side), the recent rise in open source language models made us think something similar needed to exist for large language models too. While not exactly the same as running linux containers, running LLMs shares quite a few of the same challenges. There are "base layers" (e.g. models like Llama 2), specific configuration to run correctly (parameters, temperature, context window sizes etc). There's…
2023 · github.com
- 2AS
WASM sandbox for running LLM-generated code safely. Agents get a bash-like shell and can only call tools you provide, with constraints you define. No Docker, no subprocess, no SaaS — just pip install amla-sandbox
Jan 2026 · github.com
- 3
- 4RL
Hello Hacker News! We're Yangqing, Xiang and JJ from lepton.ai. We are building a platform to run any AI models as easy as writing local code, and to get your favorite models in minutes. It's like container for AI, but without the hassle of actually building a docker image. We built and contributed to some of the world's most popular AI software - PyTorch 1.0, ONNX, Caffe, etcd, Kubernetes, etc. We also managed hundreds of thousands of computers in our previous jobs. And we found that the AI software stack is usually unnecessarily complex - and we want to change that. Imagine if you are a…
2023 · lepton.ai
- 5RA
Hi HN folks, I have been building AI agents for quite some time now. The shift has gone from LLM + Tools → LLM Workflows → Agent + Tools + Memory, and now we are finally seeing true agency emerge: agents as systems composed of tools, command-line access, fine-grained system capabilities, and memory. This way of building agents is powerful, and I believe it is here to stay. But the real question is: are the systems powering these agents ready for that future? I do not think so. Using Docker for a single agent is not going to scale well, because agents need to be lightweight and fast. LLMs…
Mar 2026 · github.com
- 6
- 7
- 8UL
Recently featured in a LangChain blog https://blog.langchain.dev/empowering-development-with-flowt... , use LLMs to construct an API first runnable workflow with an IDE experience.
2024 · github.com
- 92C
Single-agent LLMs suck at long-running complex tasks. We’ve open-sourced a multi-agent orchestrator that we’ve been using to handle long-running LLM tasks. We found that single LLM agents tend to stall, loop, or generate non-compiling code, so we built a harness for agents to coordinate over shared context while work is in progress. How it works: 1. Orchestrator agent that manages task decomposition 2. Sub-agents for parallel work 3. Subscriptions to task state and progress 4. Real-time sharing of intermediate discoveries between agents We tested this on a Putnam-level math problem, but the…
Feb 2026 · github.com
- 10
- 11AR
So, it feels like this should exist. But I couldn't find it. So I tried to build it. Agentflow lets you run complex LLM workflows from a simple JSON file. This can be as little as a list of tasks. Tasks can include variables, so you can reuse workflows for different outputs by providing different variable values. They can also include custom functions, so you can go beyond text generation to do anything you want to write a function for. Someone might say: "Why not just use ChatGPT?" Among other reasons, I'd say that you can't template a workflow with ChatGPT, trigger it with different…
2023 · github.com
- 12LA
G'day, HN! I'm one of the maintainers of `llm`. I've been working alongside a trusty group of contributors to bring this project to life, and we're now at a point where we're ready to share it with the world. Large language models (LLMs) are taking the computing world by storm due to their emergent abilities that allow them to perform a wide variety of tasks, including translation, summarization, code generation, and even some degree of reasoning. However, the ecosystem around LLMs is still in its infancy, and it can be difficult to get started with these models. `llm` is a one-stop shop for…
2023 · github.com
- 13AL
Hi HN, I built agentspace because I kept seeing tmux recommended for keeping Claude Code sessions alive over SSH. I find multiplexers painful because they subtly change shell behavior in ways I always forget. They also do not offer a standardized way to run highly permissive agents in a safe way. I also tried worktrees, but it just feels awkward to manage work in that way. Docker can help with all of this, so I thought up a workflow and used some shell aliases to automate spawning Claude/Codex agents into docker containers. I ended up creating a cli to wrap all these methods and would…
Jun 2026 · github.com
- 14DM
Hey Hacker News, We're the maintainers of docker/model-runner and wanted to share some major updates we're excited about. Link: https://github.com/docker/model-runner We are rebooting the community: https://www.docker.com/blog/rebooting-model-runner-community... At its core, model-runner is a simple, backend-agnostic tool for downloading and running local large language models. Think of it as a consistent interface to interact with different model backends. One of our main backends is llama.cpp, and we make it a point to contribute any…
Oct 2025 · github.com
- 15
- 16RA
Hi, founder of Okteto here! We’ve been experimenting with AI agents in our workflows at Okteto. Running them locally worked at first, but quickly became painful. git worktrees, multiple terminals, and messy context switches slowed us down. So we built Agent Fleets: ephemeral, fully managed environments for AI agents, built on top of Okteto’s development platform. Each agent runs in its own containerized environment on your infrastructure, with the services, tools, and policies it needs. You can spin up agents with a single click or API call. No local setup. No git worktrees. The beta…
2025 · okteto.com
- 17BA
I am working on a modular open source framework called Griptape that allows Python developers to create LLM pipelines and DAGs for complex workflows that use rules and memory. Griptape can be thought of as "Airflow for LLMs," providing an alternative to the agent-based LangChain approach. Developers can also build reusable LLM tools with explicit JSON schemas that can be executed in any environment (local, containerized, cloud, etc.) and integrated into Griptape workflows. They can also be easily converted into ChatGPT Plugin APIs and LangChain tools via adapters. Tools can be thought of as…
2023 · github.com
- 18CI
One of the most frequent questions one faces while running LLMs locally is: I have xx RAM and yy GPU, Can I run zz LLM model ? I have vibe coded a simple application to help you with just that. Update: A lot of great feedback for me to improve the app. Thank you all.
2025 · can-i-run-this-llm-blue.vercel.app
- 19CK
Hi HN, for quite some time I've been thinking how LLMs are missing the knowledge base, where I can dump CSVs, PDFs, and most important, inline web app. running on Claude Code (bring your own agent) with agents with heartbeats and jobs https://runcabinet.com It runs locally and is installable via npm. GitHub (open source): https://github.com/hilash/cabinet This is still very early. I put the first version together quickly after seeing a post by Andrej Karpathy about LLM knowledge bases, which matched closely with what I’d been building. Some people have already…
Apr 2026 · runcabinet.com
- 20RC
Claude Code's --dangerously-skip-permissions flag lets agents run without interruption, but it needs a sandboxed environment to be safe. dangerously is an open source tool that spins up an isolated container and runs Claude Code inside it — file system changes are restricted to your project directory. The new version detects your docker-compose.yml and spins up your full service stack alongside Claude Code, so the agent can test against real dependencies — databases, queues, whatever your app needs. npm install -g dangerously
Apr 2026 · github.com
- 211C
We’ve just released Berri AI - a Python package https://github.com/ClerkieAI/berri_ai that makes it easy for developers to quickly deploy their LLM Agent from Google Colab to production (Web App and API Endpoint). Building LLM Apps can require working in online coding environments, like Colab, due to local environment limitations (e.g. running pytorch on older Macs). This can cause long dev cycles when deploying the app to production, as ported changes can only be tested once it is deployed after lengthy (>20min+) Docker builds. Berri lets you deploy directly from your…
2023 · github.com
- 22TO
2025 · github.com
- 23IB
Hi HN, I’m the creator of Cordum. I’ve been working in DevOps and infrastructure for years (currently in the fintech/security space), and as I started playing with AI agents, I noticed a scary pattern. Most "safety" mechanisms rely on system prompts ("Please don't do X") or flimsy Python logic inside the agent itself. If we treat agents as autonomous employees, giving them root access and hoping they listen to instructions felt insane to me. I wanted a way to enforce hard constraints that the LLM cannot override, no matter how "jailbroken" it gets. So I built Cordum. It’s an open-source…
Jan 2026 · github.com
- 24AM
I built a browser-only studio for designing and orchestrating MCP agent systems for development and experimental purposes. The whole stack — tool authoring, multi-agent orchestration, RAG, code execution — runs from a single static HTML file via WebAssembly. No backend. The bet: WASM is a hard sandbox for free. When you generate tools with an LLM (or write them by hand), the studio AST-validates the source, registers it lazily, and JIT-compiles into Pyodide on first call. SQL tools run in DuckDB-WASM in a Web Worker. The built-in RAG uses Xenova/all-MiniLM-L6-v2 via Transformers.js for…
Apr 2026 · agentmcp.studio
Ranked by how close each launch is in meaning, then by votes. Refine with a description →