An educational Local Qwen3 LLM Inference project written in Rust
An educational Rust project for exporting and running inference on Qwen3 LLM family - reinterpretcat/qwen3-rs
An educational Local Qwen3 LLM Inference project written in Rust launched on July 12, 2025 with 15 votes, #939 of 9,223 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 1 year on.
In plain words
An educational project for running Qwen3 language model inference locally using Rust. It enables developers and students to experiment with large language models on their own machines without relying on cloud services. The project emphasizes learning through implementation, making it suitable for those interested in understanding how LLM inference works at a practical level. Code and documentation are available on GitHub.
written from the facts on this page · September 2026
From the sources
qwen3-rs is an educational Rust project for exploring and running Qwen3 language family models. It is designed to be clear, modular, and approachable for learners, with minimal dependencies and many core algorithms reimplemented from scratch for transparency. Note: Parts of this codebase, including documentation and core algorithms, were generated or assisted by large language models (LLMs) to accelerate development and improve educational clarity. As a starting reference, the project qwen3.c was used for understanding model internals and file formats. qwen3-rs/ ├── docs # LLM generated docs for key components ├── Cargo.toml # Workspace configuration ├── qwen3-cli/ # Command-line interface…from github.com
Does a similar job
all alternatives →
Qwen3.5 SmallMar 2026 · huggingface.co · ▲3550.8B-9B native multimodal w/ more intelligence, less compute
We made our own inference engine for Apple Silicon2025 · github.com · ▲186We wrote our inference engine on Rust, it is faster than llama cpp in all of the use cases. Your feedback is very welcomed. Written from scratch with idea that you can add support of any kernel and platform.
Llama 3.2 Interpretability with Sparse Autoencoders2024 · github.com · ▲579I spent a lot of time and money on this rather big side project of mine that attempts to replicate the mechanistic interpretability research on proprietary LLMs that was quite popular this year and produced great research papers by Anthropic [1], OpenAI [2] and Deepmind [3]. I am quite proud of this project and since I consider myself the target audience for HackerNews did I think that maybe some of you would appreciate this open research replication as well. Happy to answer any questions or face any feedback. Cheers [1]…
LLM, a Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)2023 · github.com · ▲45G'day, HN! I'm one of the maintainers of `llm`. I've been working alongside a trusty group of contributors to bring this project to life, and we're now at a point where we're ready to share it with the world. Large language models (LLMs) are taking the computing world by storm due to their emergent abilities that allow them to perform a wide variety of tasks, including translation, summarization, code generation, and even some degree of reasoning. However, the ecosystem around LLMs is still in its infancy, and it can be difficult to get started with these models. `llm` is a one-stop shop for…
Tiny-vLLM – high performance LLM inference engine in C++ and CUDAMay 2026 · github.com · ▲205Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM - jmaczan/tiny-vllm
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 22d ago · stillwet.art
FastRouter.ai▲364Route requests to the right LLM for cost, latency & quality
AI · 23d ago · fastrouter.ai
Source: Show HN post ↗
Launched alongside, July 2025
the whole month →
Trickle - Magic Canvas ▲1,064Hey HN! Introducing Trickle Magic Canvas: the world’s first Agentic Canvas, where you can visually co-create apps and websites with AI, from idea to production. Why is a canvas better? Most AI tools today rely on linear chats or text prompts. We believe that limits creativity and clarity. Canvas changes the game. 1. Every version & page at a glance. Each page and sub-page lives on a timeline. You can quickly browse, edit, and preview progress like a living, visual document — no more digging through chat logs or scattered states. 2. The canvas is the context. Unlike linear chats, you can…
AI · 2025 · trickle.so
- TB
Life & fun · 2025 · trytender.app
Today marks ten years, 3653 consecutive days, of running at least one mile every day under the USRSA rules [1]. To celebrate, I built an interactive dashboard that turns a decade of GPX files into charts you can explore. Running has truly changed my life: I've made lifelong friends, explored beautiful places, and more importantly invested into my own health and fitness, which I'm starting to see the positive benefits as I get older. The stack is pretty simple: a NextJS app, with a Postgres database to keep all my running data, and all the stats are pre-computed and cached in Redis, so I…
Dev tools · 2025 · nodaysoff.run
Made this website as an exercise in vibe-coding and GCP. It was posted about a few times around the internet, on sites like Morning Brew (https://www.morningbrew.com/issues/business-buzzkill), MetaFilter (https://www.metafilter.com/209703/Draw-A-Fish), boingboing.net, etc. I think it's cute! I built a basic CNN trained against penises and swastikas, and then anything that doesn't hit the 63% confidence score gets sent to a mod queue, a vibe-coded fish-tinder…
AI · 2025 · drawafish.com
Hi HN - I made a site that takes a UK postcode, grabs the local MP's information and generates an AI mockup of what their ID might look like. It's a small, silly protest at the stupidity of the Online Safety Act that just came into force. edit - My open AI credits got hugged to death, please use a known postcode (like one from Kier Starmer's constituency, WC2B6NH) in the meantime.
AI · 2025 · use-their-id.com