nowfound

Life & fun · July 30, 2026

Run Full Kimi K3 with 29 GB of RAM

Run the full 2.78-trillion-parameter Kimi K3 model or GLM-5.3-Flash beyond available RAM by streaming activated weights directly from NVMe. A dependency-free, embeddable C inference engine. - sqliteai/warp

Run Full Kimi K3 with 29 GB of RAM launched on July 30, 2026 with 9 votes, #1,899 of 24,623 launches that month and more than 75% of that year's launches.

Visit github.com ↗Alternativestop 8% of July 2026

Does a similar job

all alternatives →
  • Warp – Run DeepSeek v4.1 Flash with 5 GB of RAM at 3.77 tok/sSep 2026 · github.com · ▲16

    Run the full 2.78-trillion-parameter Kimi K3 model, DeepSeek V4.1 Flash or GLM-5.3-Flash beyond available RAM by streaming activated weights directly from NVMe. A dependency-free, embeddable C inference engine. - sqliteai/warp

  • Kimi K3Jul 2026 · kimi.ai · ▲442

    Your AI assistant for deep thinking and productivity

  • AN
    A new engine to run Kimi K3 on a laptopJul 2026 · ▲7

    Kimi K3 has 2.78 trillion parameters and ships as 1.42 TB of weights. It clearly does not fit in the memory of a laptop. But K3 is a Mixture-of-Experts model. For each token, only a small fraction of its 896 experts per layer is activated. That changes the problem: the entire model does not need to be resident in RAM, as long as the weights required by each token can be reached quickly enough. We built WASTE — the Weight-Aware Streaming Tensor Engine — to explore that idea. WASTE keeps the dense, repeatedly used part of the model resident in memory, stores the routed experts in an…

  • Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series MacJul 2026 · github.com · ▲919

    Hi HN, I built a specialized inference engine for running 4-bit Gemma 4 26B-A4B-IT on any M-series Mac using about 2 GB of RAM. It is called TurboFieldfare and is written in Swift and Metal. I have always adored on-device AI. It feels like magic that you can run a powerful NN on your Mac or iPhone. So I wanted to push the limits a bit and run a model whose weights don’t fit in memory. The model’s 4-bit quantized weights occupy roughly 14 GB, which makes running it with conventional inference tools almost impossible on an 8 GB or even 16 GB Mac once the OS, applications, and KV cache are…

  • Kimi K22025 · moonshotai.github.io · ▲345

    The 1T parameter open model for agentic intelligence

  • Kimi K2.6Apr 2026 · kimi.ai · ▲339

    Open-source SOTA for long-horizon coding and agent swarms

More life & fun this month

the category →

Source: Show HN post ↗

Launched alongside, July 2026

the whole month →
  • IR

    I might be the only SRE on Earth with his own bowling center. It's a more in-depth gig than you'd think. My family and I bought an abandoned 8-lane bowling center in the rural mid-west. In our small town there weren't many recreation options for families. You've heard of a food desert? This is an R&R desert. It had been abandoned for a good reason. The roof leaks, the electrical system was constantly surging, and my 70-year-old bowling equipment (still) doesn't work perfectly. The system that keeps your score is particularly interesting to me. It's the thing you watch during your game, but…

    Life & fun · Jul 2026

  • Elevators▲1,680

    How elevators push your buttons

    Life & fun · Jul 2026 · john.fun

  • 18 Words▲1,160

    Play 18 Words, the free daily word puzzle. The official home is 18words.com. Tap Play now to open today

    Life & fun · Jul 2026 · 18words.com

  • BA

    Over the past few months, our team has been building more and more slidedecks using web frontend technologies with coding harnesses like Claude Code, but a common complaint is to make even small edits we need to edit the code either manually or via the harness. To avoid this loop, I ended up creating Bento, a single HTML file with everything you need in a slide tool including animations and shared editing. There's no install or cloud login, everything works offline. The default deck is around 560 KB and it doesn't need to fetch anything once you got it. Open it in a browser and then you can…

    Dev tools · Jul 2026 · bento.page

  • A few days ago I found myself trying out GLM 5.2 and was really positively impressed. The capabilities and security I was getting from this LLM are similar to those I've gotten from models like Claude or GPT, and this really surprised me. But then I thought, "I wonder how it would work on a normal computer like mine," and above all, "I wonder if it would work without going into OOM on a computer like mine." So I started working with the help of agents to test this possibility. I started converting the model to int4, understanding MTP usage, and if possible implementing DSA for long context.…

    AI · Jul 2026 · github.com

  • OpenSEO▲928

    Hello! For the last 2 months, I've been building OpenSEO. It's a user friendly UI wrapping the DataForSEO API which has high quality SEO data for keywords, backlinks, AI SEO and competitor research. Instead of paying $100+ per month, you buy DataForSEO credits and pay only for usage. The coolest thing about the project so far has been hearing about what people are building on top of it. People are using coding agents to quickly integrate with Google Search Console, Google Ads and building their own AI SEO and reporting features. Many were already building their own custom solutions around…

    Dev tools · Jul 2026 · openseo.so