NightRun, bare metal LLM inference, no OS, boots from USB

What it does

A local LLM runtime that boots from USB and runs without a conventional operating system. Real boot, one cut: loading and prefill sped up, generation at actual speed (Llama 3.2 1B, QEMU/KVM, 8 cores). There is no Linux userspace hiding underneath. Your machine's firmware starts NightRun directly, NightRun copies a quantized model into RAM, draws its own terminal on the framebuffer, and you chat. No kernel, no browser, no network stack, no host process. The machine does exactly one thing. Written in Rust. no_std where it counts. Runs on ordinary x86_64 PCs from a USB stick and on a Raspberry Pi 5 from an SD card. git clone https://github.com/hardrave/NIGHTRUN.git cd NIGHTRUN less install.sh…from github.com

• 
  A DOS-like hobby OS written in Rust and x86 assembly2025 · github.com · ▲207

  To try it out, simply build the project yourself from source, or use attached bootable ISO image of the system (in Releases on Github) and run it in QEMU. https://blog.vxn.dev/rou2exos-rusted-edition

• 
  We made our own inference engine for Apple Silicon2025 · github.com · ▲186

  We wrote our inference engine on Rust, it is faster than llama cpp in all of the use cases. Your feedback is very welcomed. Written from scratch with idea that you can add support of any kernel and platform.

• BC
  Bootrino.com – Netboot Run-From-RAM OS's on AWS, Google and Digital Ocean2018 · bootrino.com · ▲109
• CI
  Can I run this LLM? (locally)2025 · can-i-run-this-llm-blue.vercel.app · ▲42

  One of the most frequent questions one faces while running LLMs locally is: I have xx RAM and yy GPU, Can I run zz LLM model ? I have vibe coded a simple application to help you with just that. Update: A lot of great feedback for me to improve the app. Thank you all.

• 
  Unbug – Rust macros for programmatically invoking breakpoints2024 · github.com · ▲96

  This project is inspired by some of the asserts in Unreal engine. Due to reliance on core_intrinsics it is necessary to develop using nightly Rust, but there are stubs in place so a production build will not require nightly. I recently released version 0.2 which includes no_std support and adds optional log message arguments to the ensure macro.

• 
  LLM, a Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)2023 · github.com · ▲45

  G'day, HN! I'm one of the maintainers of `llm`. I've been working alongside a trusty group of contributors to bring this project to life, and we're now at a point where we're ready to share it with the world. Large language models (LLMs) are taking the computing world by storm due to their emergent abilities that allow them to perform a wide variety of tasks, including translation, summarization, code generation, and even some degree of reasoning. However, the ecosystem around LLMs is still in its infancy, and it can be difficult to get started with these models. `llm` is a one-stop shop for…

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 19d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 19d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 21d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 22d ago · stillwet.art

• 
  Beam.win▲379

  Run AI agents on one Mac and use its windows on another

  AI · 5d ago · beam.win

• 
  FastRouter.ai▲364

  Route requests to the right LLM for cost, latency & quality

  AI · 23d ago · fastrouter.ai

• IR
  I replaced a $120k bowling center system with $1,600 in ESP32s▲2,935

  I might be the only SRE on Earth with his own bowling center. It's a more in-depth gig than you'd think. My family and I bought an abandoned 8-lane bowling center in the rural mid-west. In our small town there weren't many recreation options for families. You've heard of a food desert? This is an R&R desert. It had been abandoned for a good reason. The roof leaks, the electrical system was constantly surging, and my 70-year-old bowling equipment (still) doesn't work perfectly. The system that keeps your score is particularly interesting to me. It's the thing you watch during your game, but…

  Life & fun · Jul 2026

• 
  Elevators▲1,680

  How elevators push your buttons

  Life & fun · Jul 2026 · john.fun

• 
  18 Words▲1,160

  Play 18 Words, the free daily word puzzle. The official home is 18words.com. Tap Play now to open today

  Life & fun · Jul 2026 · 18words.com

• BA
  Bento - An entire PowerPoint in one HTML file (edit+view+data+collab)▲1,033

  Over the past few months, our team has been building more and more slidedecks using web frontend technologies with coding harnesses like Claude Code, but a common complaint is to make even small edits we need to edit the code either manually or via the harness. To avoid this loop, I ended up creating Bento, a single HTML file with everything you need in a slide tool including animations and shared editing. There's no install or cloud login, everything works offline. The default deck is around 560 KB and it doesn't need to fetch anything once you got it. Open it in a browser and then you can…

  Dev tools · Jul 2026 · bento.page

• 
  Getting GLM 5.2 running on my slow computer▲937

  A few days ago I found myself trying out GLM 5.2 and was really positively impressed. The capabilities and security I was getting from this LLM are similar to those I've gotten from models like Claude or GPT, and this really surprised me. But then I thought, "I wonder how it would work on a normal computer like mine," and above all, "I wonder if it would work without going into OOM on a computer like mine." So I started working with the help of agents to test this possibility. I started converting the model to int4, understanding MTP usage, and if possible implementing DSA for long context.…

  AI · Jul 2026 · github.com

• 
  OpenSEO▲928

  Hello! For the last 2 months, I've been building OpenSEO. It's a user friendly UI wrapping the DataForSEO API which has high quality SEO data for keywords, backlinks, AI SEO and competitor research. Instead of paying $100+ per month, you buy DataForSEO credits and pay only for usage. The coolest thing about the project so far has been hearing about what people are building on top of it. People are using coding agents to quickly integrate with Google Search Console, Google Ads and building their own AI SEO and reporting features. Many were already building their own custom solutions around…

  Dev tools · Jul 2026 · openseo.so