Running LLMs in one line of Python without Docker
Hello Hacker News! We're Yangqing, Xiang and JJ from lepton.ai. We are building a platform to run any AI models as easy as writing local code, and to get your favorite models in minutes. It's like container for AI, but without the hassle of actually building a docker image. We built and contributed to some of the world's most popular AI software - PyTorch 1.0, ONNX, Caffe, etcd, Kubernetes, etc. We also managed hundreds of thousands of computers in our previous jobs. And we found that the AI software stack is usually unnecessarily complex - and we want to change that. Imagine if you are a…
Running LLMs in one line of Python without Docker launched on October 4, 2023 with 68 votes, #1,180 of 4,393 launches that month and more than 90% of that year's launches.
In plain words
Lepton.ai is a platform that simplifies running AI models by allowing developers to deploy them with a single line of Python code, without needing Docker or containers. It's designed for developers who want to take models from GitHub or Hugging Face and turn them into production-ready services quickly, eliminating the complexity of traditional containerization. The platform targets AI engineers and developers seeking faster model deployment with minimal setup overhead.
written from the facts on this page · September 2026
From the sources
In the maker’s words, at launch
Hello Hacker News! We're Yangqing, Xiang and JJ from lepton.ai. We are building a platform to run any AI models as easy as writing local code, and to get your favorite models in minutes. It's like container for AI, but without the hassle of actually building a docker image. We built and contributed to some of the…
Does a similar job
all alternatives →
SimplAI2025 · simplai.ai · ▲589Hey HN, I've been building SimplAI for the past several months — it's a platform for building, testing, and deploying LLM-powered agents and multi-step workflows. The problem I kept running into: spinning up an AI agent pipeline means stitching together prompt management, tool calling, memory, evals, and deployment — often from scratch every time. SimplAI tries to be the layer that handles all of that so you can focus on what your agent actually does. What it does: - Visual + code-first workflow builder for chaining LLM calls, tools, and APIs - Built-in prompt versioning and A/B testing…
Cerebrium2024 · cerebrium.ai · ▲300If you haven’t noticed, GPUs are scarce right now. The global boom in inference has demand growing faster than supply can keep up, and at Cerebrium ...

Engine – A multi-LLM alternative to Codex2025 · enginelabs.ai · ▲16Please forgive the sign up. It means we can give away and keep track of free inference usage/no API keys needed. Happy to send sign in credentials on request if you prefer.
Running AI agents across environments needs a proper solutionMar 2026 · github.com · ▲8Hi HN folks, I have been building AI agents for quite some time now. The shift has gone from LLM + Tools → LLM Workflows → Agent + Tools + Memory, and now we are finally seeing true agency emerge: agents as systems composed of tools, command-line access, fine-grained system capabilities, and memory. This way of building agents is powerful, and I believe it is here to stay. But the real question is: are the systems powering these agents ready for that future? I do not think so. Using Docker for a single agent is not going to scale well, because agents need to be lightweight and fast. LLMs…
N0x – LLM inference, agents, RAG, Python exec in browser, no back endMar 2026 · n0xth.vercel.app · ▲9Built this because I was tired of every AI tool shipping my data to someone else server n0x runs the full stack LLM inference via WebGPU, autonomous ReAct agents, RAG over your own docs, sandboxed Python execution via Pyodide all inside a single browser tab. No account No keys No backend Models download once, cache in IndexedDB permanently. Biggest challenge was context window budgeting for the agent loop and making the WASM vector search non-blocking. Happy to talk architecture. GitHub: https://github.com/ixchio/n0x | Live demo: https://n0x-three.vercel.app
More ai this month
the category →



Paintings by AI models: programs run through a simulation of oil paint.
AI · 20d ago · stillwet.art

PixVerse R2▲381A real-time world model you can explore and change
AI · 29d ago · world.pixverse.video
Source: Show HN post ↗ · launch text quoted in part
Launched alongside, October 2023
the whole month →
Nudge 2.0▲1,051In-app experiences to activate, retain, & understand users
Growth · 2023 · nudgenow.com


Unlock AI magic for elevated customer engagement, fast
AI · 2023 · tiledesk.com


Effortlessly discover API behaviour with a Chrome extension that automatically generates OpenAPI specifications in real time for any app or website.
Dev tools · 2023 · github.com