Janus – Go binary that runs GGUF models via Vulkan on AMD/Intel/Nvidia

In plain words

Janus is a Go-based API router for AI models that includes a Vulkan model runner capable of executing GGUF models across AMD, Intel, and Nvidia GPUs. It enables developers to route requests to AI models while leveraging hardware acceleration through Vulkan, providing cross-platform GPU support. The tool is designed for developers who need flexible model serving infrastructure with broad GPU compatibility.

written from the facts on this page · October 2026

• 
  Janus2025 · github.com · ▲224

  Unified Multi-Modal AI by DeepSeek

• 
  Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPUFeb 2026 · github.com · ▲395

  Hi everyone, I'm kinda involved in some retrogaming and with some experiments I ran into the following question: "It would be possible to run transformer models bypassing the cpu/ram, connecting the gpu to the nvme?" This is the result of that question itself and some weekend vibecoding (it has the linked library repository in the readme as well), it seems to work, even on consumer gpus, it should work better on professional ones tho

• 
  vGPU and SR-IOV on consumer GPUs2021 · arccompute.com · ▲203

  Insights on GPU and AI infrastructure from Arc Compute. Read hardware deep-dives, deployment playbooks, and analysis of where the AI compute market is heading.

• 
  General ComputeMay 2026 · generalcompute.com · ▲315

  AI models that run on an inference cloud optimized for speed

• 
  Janus2025 · withkairos.co · ▲268

  Simulation testing for AI agents

• 
  Open-source GeForce NOW alternative with Stadia's social features2024 · github.com · ▲176

  [Experimental] Deploy and stream games/apps in the cloud. Use our GPUs or bring your own. - nestrilabs/nestri

• 
  An e-ink frame that hears birds and draws them as 1800s illustrations▲2,389

  E-ink bird frame for Raspberry Pi - real-time bird detection by audio, fully local AI, rendered as real, hand-cut 1800s bird illustrations. - arnegiacomo/fugleramme

  AI · 17d ago · github.com

• 
  Jev▲544

  Fast, structured AI decisions for software automation

  AI · 12d ago · console.typesafe.ai

• 
  AINA▲497

  Find your job search blind spots with an AI coach

  AI · 15d ago · aina-tech.io

• 
  Solid▲471

  Agents with their own computers, accounts, and budgets.

  AI · 12d ago · solid.tech

• 
  iFixAi▲440

  Independent auditing of AI agents to uncover misalignment

  AI · 16d ago · ifixai.ai

• 
  PixVerse R2▲381

  A real-time world model you can explore and change

  AI · 10d ago · world.pixverse.video

• VO
  Vote on which of Hacker News' challenges for AI have been met▲195

  AI · 1d ago · stoppels.ch

• 
  Giving Opus 5.5 a simulated paint canvas▲160

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 21h ago · stillwet.art

• 
  ShipHQ▲140

  Build your own app studio, powered by your real apps

  Growth · 1d ago · apps.apple.com

• 
  Audionaut – an open-source cross-platform multitrack audio editor▲131

  Dev tools · 14h ago · github.com

• 
  Bambu Lab R1▲123

  CO2 laser cutting with Bambu-style automation

  Life & fun · 1d ago · bambulab.com

• 
  Clef▲114

  Open-source decision models from Cloudflare

  AI · 1d ago · blog.cloudflare.com