nowfound

AI · October 4, 2023

RL

Running LLMs in one line of Python without Docker

Hello Hacker News! We're Yangqing, Xiang and JJ from lepton.ai. We are building a platform to run any AI models as easy as writing local code, and to get your favorite models in minutes. It's like container for AI, but without the hassle of actually building a docker image. We built and contributed to some of the world's most popular AI software - PyTorch 1.0, ONNX, Caffe, etcd, Kubernetes, etc. We also managed hundreds of thousands of computers in our previous jobs. And we found that the AI software stack is usually unnecessarily complex - and we want to change that. Imagine if you are a…

Running LLMs in one line of Python without Docker launched on October 4, 2023 with 68 votes, #1,180 of 4,393 launches that month and more than 90% of that year's launches.

In plain words

Lepton.ai is a platform that simplifies running AI models by allowing developers to deploy them with a single line of Python code, without needing Docker or containers. It's designed for developers who want to take models from GitHub or Hugging Face and turn them into production-ready services quickly, eliminating the complexity of traditional containerization. The platform targets AI engineers and developers seeking faster model deployment with minimal setup overhead.

written from the facts on this page · September 2026

From the sources

In the maker’s words, at launch

Hello Hacker News! We're Yangqing, Xiang and JJ from lepton.ai. We are building a platform to run any AI models as easy as writing local code, and to get your favorite models in minutes. It's like container for AI, but without the hassle of actually building a docker image. We built and contributed to some of the…

Does a similar job

all alternatives →
  • SimplAI2025 · simplai.ai · ▲589

    Hey HN, I've been building SimplAI for the past several months — it's a platform for building, testing, and deploying LLM-powered agents and multi-step workflows. The problem I kept running into: spinning up an AI agent pipeline means stitching together prompt management, tool calling, memory, evals, and deployment — often from scratch every time. SimplAI tries to be the layer that handles all of that so you can focus on what your agent actually does. What it does: - Visual + code-first workflow builder for chaining LLM calls, tools, and APIs - Built-in prompt versioning and A/B testing…

  • Cerebrium2024 · cerebrium.ai · ▲300

    If you haven’t noticed, GPUs are scarce right now. The global boom in inference has demand growing faster than supply can keep up, and at Cerebrium ...

  • The Cloud for AI AgentsNov 2025 · hopx.ai · ▲128

    Spin up secure sandboxes in ~100 ms

  • Engine – A multi-LLM alternative to Codex2025 · enginelabs.ai · ▲16

    Please forgive the sign up. It means we can give away and keep track of free inference usage/no API keys needed. Happy to send sign in credentials on request if you prefer.

  • Running AI agents across environments needs a proper solutionMar 2026 · github.com · ▲8

    Hi HN folks, I have been building AI agents for quite some time now. The shift has gone from LLM + Tools → LLM Workflows → Agent + Tools + Memory, and now we are finally seeing true agency emerge: agents as systems composed of tools, command-line access, fine-grained system capabilities, and memory. This way of building agents is powerful, and I believe it is here to stay. But the real question is: are the systems powering these agents ready for that future? I do not think so. Using Docker for a single agent is not going to scale well, because agents need to be lightweight and fast. LLMs…

  • N0x – LLM inference, agents, RAG, Python exec in browser, no back endMar 2026 · n0xth.vercel.app · ▲9

    Built this because I was tired of every AI tool shipping my data to someone else server n0x runs the full stack LLM inference via WebGPU, autonomous ReAct agents, RAG over your own docs, sandboxed Python execution via Pyodide all inside a single browser tab. No account No keys No backend Models download once, cache in IndexedDB permanently. Biggest challenge was context window budgeting for the agent loop and making the WASM vector search non-blocking. Happy to talk architecture. GitHub: https://github.com/ixchio/n0x | Live demo: https://n0x-three.vercel.app

More ai this month

the category →
  • Video model that turns script into viral social media videos

    AI · 17d ago · spira.ai

  • The browser where Claude Code and Codex work beside you

    AI · 17d ago · rill.love

  • Kolibri is Aleph Alpha

    AI · 18d ago · tej.as

  • Paintings by AI models: programs run through a simulation of oil paint.

    AI · 20d ago · stillwet.art

  • Onepin▲384

    AI voiceover with every name, price and date said right

    AI · 30d ago · onepin.ai

  • A real-time world model you can explore and change

    AI · 29d ago · world.pixverse.video

Source: Show HN post ↗ · launch text quoted in part

Launched alongside, October 2023

the whole month →
  • AI autopilot for content creation & marketing

    AI · 2023 · typeface.ai

  • Nudge 2.0▲1,051

    In-app experiences to activate, retain, & understand users

    Growth · 2023 · nudgenow.com

  • World's first open source AI scheduling assistant

    AI · 2023 · cal.com

  • Unlock AI magic for elevated customer engagement, fast

    AI · 2023 · tiledesk.com

  • TalkNotes▲854

    Turn your thoughts into actionable notes, fast

    AI · 2023 · talknotes.io

  • Effortlessly discover API behaviour with a Chrome extension that automatically generates OpenAPI specifications in real time for any app or website.

    Dev tools · 2023 · github.com