nowfound

AI · alternatives · 2026

24 alternatives to NightRun, bare metal LLM inference, no OS, boots from USB

Boot your PC straight into an LLM. Rust, UEFI-resident, no operating system underneath. - hardrave/NIGHTRUN

Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Prices are shown for the 1 we have checked on their own sites, 1 of them free or with a free tier.

  1. 1

    To try it out, simply build the project yourself from source, or use attached bootable ISO image of the system (in Releases on Github) and run it in QEMU. https://blog.vxn.dev/rou2exos-rusted-edition

    2025 · github.com · its alternatives →

  2. 2

    We wrote our inference engine on Rust, it is faster than llama cpp in all of the use cases. Your feedback is very welcomed. Written from scratch with idea that you can add support of any kernel and platform.

    2025 · github.com · its alternatives →

  3. 3

    A Simple Unix-like operating system. Contribute to ozkl/soso development by creating an account on GitHub.

    2019 · github.com · its alternatives →

  4. 4

    Hello HN! Showing off the first version of Munal OS, an experimental operating system I have been writing in Rust on and off for the past few years. https://github.com/Askannz/munal-os It's an unikernel design that is compiled as a single EFI binary and does not use virtual address spaces for process isolation. Instead, applications are compiled to WASM and run inside of an embedded WASM engine. Other features: * Fully graphical interface in HD resolution with mouse and keyboard support * Desktop shell with window manager and contextual radial menus * PCI and VirtIO…

    2025 · github.com · its alternatives →

  5. 5

    Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly. - Andyyyy64/whichllm

    May 2026 · github.com · its alternatives →

  6. 6
    OpenFang▲255

    Open-Source Agent Operating System

    Mar 2026 · openfang.sh · its alternatives →

  7. 7BC
  8. 8CI

    One of the most frequent questions one faces while running LLMs locally is: I have xx RAM and yy GPU, Can I run zz LLM model ? I have vibe coded a simple application to help you with just that. Update: A lot of great feedback for me to improve the app. Thank you all.

    2025 · can-i-run-this-llm-blue.vercel.app · its alternatives →

  9. 9

    Hello HN, I've been working on a simple OS for tinkering and running bare metal apps on vintage PCs. Since I couldn't quite decide whether to target pure 16-bit, or slightly more capable 32-bit machines, I ended up with two separate versions: - GentleOS/32 (https://github.com/luke8086/gentleos32) works on i386+, requires 4MB of RAM and VGA display supporting 640x480x16 mode or any 256-color VESA mode. - GentleOS/16 (https://github.com/luke8086/gentleos) works on 80186+, requires less than 192KB of RAM and a CGA display supporting 320x200x4…

    Jun 2026 · github.com · its alternatives →

  10. 10

    I started writing Thoreau BASIC because I wanted a small, old-fashioned BASIC interpreter: line numbers, immediate mode, simple graphics, strings, arrays, the sort of environment where the computer starts with a "Ready" prompt and you can immediately make it do something. Then I wondered: why should it need an operating system? So I made it boot directly on x64 machines using UEFI. The UEFI version uses the Graphics Output Protocol for its framebuffer and gets its keyboard input directly from the firmware. There is no Windows or Linux underneath it. The machine boots into BASIC. It supports…

    Aug 2026 · tarjan.itch.io · its alternatives →

  11. 11

    This project is inspired by some of the asserts in Unreal engine. Due to reliance on core_intrinsics it is necessary to develop using nightly Rust, but there are stubs in place so a production build will not require nightly. I recently released version 0.2 which includes no_std support and adds optional log message arguments to the ensure macro.

    2024 · github.com · its alternatives →

  12. 12

    VEKOS(Verified Experimental Kernel OS) is a Rust-based experimental kernel that focuses on runtime verification and security. Every filesystem operation and memory allocation generates cryptographic proofs that can be verified in real-time, ensuring system integrity. Think of it like a blockchain for OS operations rather than just storage verification. Key features: - Merkle tree-backed filesystem with operation verification - Memory manager with CoW and proof generation - Buddy allocator with zone-based memory management - Shell with VT100 support - Verified boot sequence with stage…

    2024 · github.com · its alternatives →

  13. 13

    This project contains no code from Linux, BSD, Minix, or any other OS. Everything up until this point is written entirely from scratch, including a pure microkernel (that only implements multiprocessor priority scheduling, memory management, and interprocess communication), a work-in-progress implementation of the standard C library, and a variety of servers that provide drivers and other essential OS functionality. At the time of writing this post, the servers provide drivers for the keyboard, NVMe SSDs (that works on real hardware), a Unix-like virtual file system (with a single root…

    2024 · github.com · its alternatives →

  14. 14

    G'day, HN! I'm one of the maintainers of `llm`. I've been working alongside a trusty group of contributors to bring this project to life, and we're now at a point where we're ready to share it with the world. Large language models (LLMs) are taking the computing world by storm due to their emergent abilities that allow them to perform a wide variety of tasks, including translation, summarization, code generation, and even some degree of reasoning. However, the ecosystem around LLMs is still in its infancy, and it can be difficult to get started with these models. `llm` is a one-stop shop for…

    2023 · github.com · its alternatives →

  15. 15

    If I have this hardware, Can I run that LLM model ?

    2025 · can-i-run-this-llm-blue.vercel.app · its alternatives →

  16. 16

    Built a simple web app that tells you which open-source LLMs will work on your hardware. It auto-detects your specs, shows compatible models from Hugging Face, gives realistic performance estimates (tokens/sec), and recommends quantization settings. You can also manually input specs to see "what if I upgraded my RAM?" Made this after wasting time downloading giant models only to find they crawled on my hardware. Hope it saves you some frustration!

    2025 · caniusellm.com · its alternatives →

  17. 17

    How puffnfresh, my coworker, made a single command to download, assemble, and boot the VM image is arguably as cool as the port itself!

    Mar 2026 · github.com · its alternatives →

  18. 18

    What it is A single 45 MB Windows .exe that embeds llama.cpp and a minimal Tk UI. Copy it (plus any .gguf model) to a flash drive, double-click on any Windows PC, and you’re chatting with an LLM—no admin rights, Cloud, or network. Why I built it Existing “local LLM” GUIs assume you can pip install, pass long CLI flags, or download GBs of extras. I wanted something my less-technical colleagues could run during a client visit by literally plugging in a USB drive. How it works PyInstaller one-file build → bundles Python runtime, llama_cpp_python, and the UI into a single PE. On first launch, it…

    2025 · github.com · its alternatives →

  19. 19

    How often do you screw up the system so much you have to reformat the disk (without losing data) to fix it? Well, sometimes I do, and sometimes I can't be bothered to burn a live ISO onto a USB stick. There's initramfs, but it's hardly a pleasant environment, with network configuration and all. My go-to solution has typically been to create a chroot with busybox and a few utilities in /tmp, chroot into it, and then kill services that use the solid drive so that I can unmount it. That's an error-prone process, and sometimes systemd itself uses disk, so you can't unmount the drive despite…

    2024 · github.com · its alternatives →

  20. 20
    LLM OS▲12

    No Subscription Own your AI

    2025 · etsy.com · its alternatives →

  21. 21

    Emulator of the IBM PC running DOS written in Rust - Lichtso/DOS-Emulator

    2020 · github.com · its alternatives →

  22. 22

    Current AI-assisted CLI tools are often part of larger systems and work better on Linux. I built llm-term to address these. It's a Rust-based tool that compiles into a single binary file. You only need to download the binary, add it to your PATH, and configure your OpenAI key to get started. While llm-term offers an option for gpt-4o, it works great with gpt-4o-mini. So it's not costly. I appreciate any feedback or suggestions.

    2024 · github.com · its alternatives →

  23. 23

    An educational Rust project for exporting and running inference on Qwen3 LLM family - reinterpretcat/qwen3-rs

    2025 · github.com · its alternatives →

  24. 24

    I wrote an article about how to get Nix on your Steam Deck! Big takeaways for me: * Steam Decks are very fun to hack on * Linux Consoles are good * There are more knobs in systemd units than I remember * Flatcar Linux is a thing that exists * Remoting into a console is fun * A/B boots are less interesting than one might expect when you're used to NixOS

    2022 · determinate.systems · its alternatives →

Also compare

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →