TrnRT
The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.
Launched as “TrnRT – An open-source LLM inference engine for AWS Trainium”
TrnRT launched on November 17, 2026 with 54 votes, #503 of 3,753 launches that month and more than 95% of that year's launches.
In plain words
TrnRT is an open-source inference engine designed for running large language models on AWS Trainium hardware. It features NKI megakernels for optimized performance, supports context windows up to 1 million tokens, and provides an OpenAI-compatible API for easy integration. The tool is intended for developers and organizations looking to deploy LLMs efficiently on AWS infrastructure.
written from the facts on this page · November 2026
From the sources
The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere. - RunanywhereAI/trnrt
Pricing, as stated on its site
Free — Free and open source
checked November 2026 · prices change
Does a similar job
free ones →all alternatives →
LLM Gateway2025 · llmgateway.io · ▲286LLM Gateway is an open-source API platform that lets users access multiple AI models through a single unified interface.
LLM2023 · github.com · ▲45LLM is an open-source Rust crate and command-line tool for running large language models like LLaMA and GPT-NeoX on CPUs.
DB-GPT2023 · github.com · ▲156open-source agentic AI data assistant for the next generation of AI + Data products.
DeepSeek-R1-05282025 · huggingface.co · ▲218New open-source LLM that rivals o3 in coding & reasoning
uzu2025 · github.com · ▲186This is a Rust-based inference engine designed for Apple Silicon, built from scratch to run large language models.

More ai this month
the category →
Free, open-source embroidery software for Mac and Windows. Turn SVG artwork into machine embroidery, edit stitches visually, and create designs with AI agents via MCP.
AI · 10d ago · github.com



Keep your coding agent up to date with the latest web best practices
AI · 12d ago · github.com


A simulated world that makes your agent improve on every run
AI · 17d ago · simulation.plurai.ai
Is TrnRT yours? Feature it on the home page: $19, or free with the badge →
Launched alongside, November 2026
the whole month →- HHackerBooks▲1,868
Browse thousands of books recommended in Hacker News comments, 2006–2026. Ranked by how many different people recommend them.
Life & fun · 21d ago · hackerbooks.org

Meet Subvocal. Silent text input for your computer, at the speed of speech. Built by The Subvocal Company.
Life & fun · 20d ago · subvocal.company

Free, open-source embroidery software for Mac and Windows. Turn SVG artwork into machine embroidery, edit stitches visually, and create designs with AI agents via MCP.
AI · 10d ago · github.com

Enter any place on Earth. See every satellite that passed over it this week, and the actual pictures they took.
Life & fun · 13d ago · watched.earth
Hacker Times▲476Hacker Times is a newspaper-style publication that curates and reformats stories from Hacker News with original headlines and sources, updated hourly.
Life & fun · 20d ago · hackertimes.ca

Keep your coding agent up to date with the latest web best practices
AI · 12d ago · github.com