nowfound

AI · July 28, 2025

Red Candle – Run LLMs Natively in Ruby with Rust

I've been working on Red Candle, a Ruby gem that runs LLMs (Llama, Mistral, Gemma, Phi) directly in your Ruby process through Rust bindings (based on the candle crate from Hugging Face). No Python, no servers - just FFI with Metal/CUDA acceleration. It's been useful for adding AI features to Rails apps without the complexity of managing separate services. Would love feedback from anyone working with LLMs in Ruby.

Red Candle – Run LLMs Natively in Ruby with Rust launched on July 28, 2025 with 5 votes and more than 75% of that year's launches. The site was still online in September 2026, 1 year on.

What it does

Ruby gem for running state-of-the-art language models locally. Access LLMs, embeddings, rerankers, and NER models directly from Ruby using Rust-powered Candle with Metal/CUDA acceleration. - scientist-labs/red-candle

Does a similar job

all alternatives →
  • LLM Rescuer – Fixing the billion dollar mistake in RubyOct 2025 · github.com · ▲96

    > "In a world without nil safety, one gem dares to ask: 'What if we just guessed?'"

  • Unsloth2025 · unsloth.ai · ▲241

    Finetune LLMs 2x faster, 80% less memory

  • ChattyUI2024 · ▲149

    Run open-source LLMs locally in the browser using WebGPU

  • A MitM proxy to see what your LLM tools are sendingJan 2026 · github.com · ▲218

    I built this out of curiosity about what Claude Code was actually sending to the API. Turns out, watching your tokens tick up in real-time is oddly satisfying. Sherlock sits between your LLM tools and the API, showing you every request with a live dashboard, and auto-saved copies of every prompt as markdown and json.

  • RatatuiRuby wraps Rust Ratatui as a RubyGem – TUIs with the joy of RubyJan 2026 · ratatui-ruby.dev · ▲152

    Terminal user interfaces in Ruby. RatatuiRuby wraps Rust

  • LLM, a Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)2023 · github.com · ▲45

    G'day, HN! I'm one of the maintainers of `llm`. I've been working alongside a trusty group of contributors to bring this project to life, and we're now at a point where we're ready to share it with the world. Large language models (LLMs) are taking the computing world by storm due to their emergent abilities that allow them to perform a wide variety of tasks, including translation, summarization, code generation, and even some degree of reasoning. However, the ecosystem around LLMs is still in its infancy, and it can be difficult to get started with these models. `llm` is a one-stop shop for…

More ai this month

the category →
  • Video model that turns script into viral social media videos

    AI · 18d ago · spira.ai

  • The browser where Claude Code and Codex work beside you

    AI · 18d ago · rill.love

  • Kolibri is Aleph Alpha

    AI · 20d ago · tej.as

  • Paintings by AI models: programs run through a simulation of oil paint.

    AI · 21d ago · stillwet.art

  • A real-time world model you can explore and change

    AI · 30d ago · world.pixverse.video

  • Beam.win▲378

    Run AI agents on one Mac and use its windows on another

    AI · 5d ago · beam.win

Source: Show HN post ↗

Launched alongside, July 2025

the whole month →
  • Clueso▲1,300

    Create stunning product videos in minutes with AI

    AI · 2025 · clueso.io

  • Hey HN! Introducing Trickle Magic Canvas: the world’s first Agentic Canvas, where you can visually co-create apps and websites with AI, from idea to production. Why is a canvas better? Most AI tools today rely on linear chats or text prompts. We believe that limits creativity and clarity. Canvas changes the game. 1. Every version & page at a glance. Each page and sub-page lives on a timeline. You can quickly browse, edit, and preview progress like a living, visual document — no more digging through chat logs or scattered states. 2. The canvas is the context. Unlike linear chats, you can…

    AI · 2025 · trickle.so

  • TB
  • Today marks ten years, 3653 consecutive days, of running at least one mile every day under the USRSA rules [1]. To celebrate, I built an interactive dashboard that turns a decade of GPX files into charts you can explore. Running has truly changed my life: I've made lifelong friends, explored beautiful places, and more importantly invested into my own health and fitness, which I'm starting to see the positive benefits as I get older. The stack is pretty simple: a NextJS app, with a Postgres database to keep all my running data, and all the stats are pre-computed and cached in Redis, so I…

    Dev tools · 2025 · nodaysoff.run

  • Made this website as an exercise in vibe-coding and GCP. It was posted about a few times around the internet, on sites like Morning Brew (https://www.morningbrew.com/issues/business-buzzkill), MetaFilter (https://www.metafilter.com/209703/Draw-A-Fish), boingboing.net, etc. I think it's cute! I built a basic CNN trained against penises and swastikas, and then anything that doesn't hit the 63% confidence score gets sent to a mod queue, a vibe-coded fish-tinder…

    AI · 2025 · drawafish.com

  • Hi HN - I made a site that takes a UK postcode, grabs the local MP's information and generates an AI mockup of what their ID might look like. It's a small, silly protest at the stupidity of the Online Safety Act that just came into force. edit - My open AI credits got hugged to death, please use a known postcode (like one from Kier Starmer's constituency, WC2B6NH) in the meantime.

    AI · 2025 · use-their-id.com