nowfound

AI · November 17, 2026

TrnRT

The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.

Launched as “TrnRT – An open-source LLM inference engine for AWS Trainium”

TrnRT launched on November 17, 2026 with 54 votes, #503 of 3,753 launches that month and more than 95% of that year's launches.

Visit github.com ↗TrnRT alternativestop 13% of November 2026

In plain words

TrnRT is an open-source inference engine designed for running large language models on AWS Trainium hardware. It features NKI megakernels for optimized performance, supports context windows up to 1 million tokens, and provides an OpenAI-compatible API for easy integration. The tool is intended for developers and organizations looking to deploy LLMs efficiently on AWS infrastructure.

written from the facts on this page · November 2026

From the sources

The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere. - RunanywhereAI/trnrt

Pricing, as stated on its site

Free — Free and open source

checked November 2026 · prices change

  • LLM Gateway2025 · llmgateway.io · ▲286

    LLM Gateway is an open-source API platform that lets users access multiple AI models through a single unified interface.

  • LLM2023 · github.com · ▲45

    LLM is an open-source Rust crate and command-line tool for running large language models like LLaMA and GPT-NeoX on CPUs.

  • DB-GPT2023 · github.com · ▲156

    open-source agentic AI data assistant for the next generation of AI + Data products.

  • DeepSeek-R1-05282025 · huggingface.co · ▲218

    New open-source LLM that rivals o3 in coding & reasoning

  • uzu2025 · github.com · ▲186

    This is a Rust-based inference engine designed for Apple Silicon, built from scratch to run large language models.

  • Inference Engine by GMI CloudDec 2025 · gmicloud.ai · ▲180

    Fast multimodal-native inference at scale

More ai this month

the category →
  • Free, open-source embroidery software for Mac and Windows. Turn SVG artwork into machine embroidery, edit stitches visually, and create designs with AI agents via MCP.

    AI · 10d ago · github.com

  • Make and publish 3D games with the first AI game engine

    AI · 25d ago · wanaka.app

  • Empacer▲468

    The voice-first assistant for small business owners

    AI · 26d ago · empacer.com

  • Keep your coding agent up to date with the latest web best practices

    AI · 12d ago · github.com

  • The community you trust in the assistant you use

    AI · 16d ago

  • A simulated world that makes your agent improve on every run

    AI · 17d ago · simulation.plurai.ai

Is TrnRT yours? Feature it on the home page: $19, or free with the badge →

Launched alongside, November 2026

the whole month →
  • H
    HackerBooks▲1,868

    Browse thousands of books recommended in Hacker News comments, 2006–2026. Ranked by how many different people recommend them.

    Life & fun · 21d ago · hackerbooks.org

  • Meet Subvocal. Silent text input for your computer, at the speed of speech. Built by The Subvocal Company.

    Life & fun · 20d ago · subvocal.company

  • Free, open-source embroidery software for Mac and Windows. Turn SVG artwork into machine embroidery, edit stitches visually, and create designs with AI agents via MCP.

    AI · 10d ago · github.com

  • Enter any place on Earth. See every satellite that passed over it this week, and the actual pictures they took.

    Life & fun · 13d ago · watched.earth

  • Hacker Times is a newspaper-style publication that curates and reformats stories from Hacker News with original headlines and sources, updated hourly.

    Life & fun · 20d ago · hackertimes.ca

  • Keep your coding agent up to date with the latest web best practices

    AI · 12d ago · github.com