nowfound

Life & fun · May 27, 2025

I made a VRAM Calculator in Hugging Face

It's a chrome extension that automatically loads the specs from the Hugging Face model card into the calculation. > To test it, install the extension (no registration/key needed) and navigate to a HF model page. Then click the "VRAM" icon on the top right to open the sidepanel. You can specify quantization, batch size, sequence length, etc. Works for inference & fine-tuning. If it does not fit on the specified GPUs, it gives you an advise on how to still run it (e.g. lowering precision). It is inspired at my work, where we were constantly exporting metrics from HF to estimate required…

I made a VRAM Calculator in Hugging Face launched on May 27, 2025 with 9 votes, #2,448 of 7,905 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 1 year on.

What it does

In the maker’s words, at launch

It's a chrome extension that automatically loads the specs from the Hugging Face model card into the calculation. > To test it, install the extension (no registration/key needed) and navigate to a HF model page. Then click the "VRAM" icon on the top right to open the sidepanel. You can specify quantization…

Does a similar job

all alternatives →
  • IM
  • Interactive, animated architecture of any HuggingFace modelsAug 2026 · modelmap.cc · ▲113

    Interactive, animated architecture maps for any Hugging Face model — and whether it fits on your GPU.

  • WM
    We made glhf.chat – run almost any open-source LLM, including 405B2024 · glhf.chat · ▲161

    Try it out! https://glhf.chat/ Hey HN! We’ve been working for the past few months on a website to let you easily run (almost) any open-source LLM on autoscaling GPU clusters. It’s free for now while we figure out how to price it, but we expect to be cheaper than most GPU offerings since we can run the models multi-tenant. Unlike Together AI, Fireworks, etc, we’ll run any model that the open-source vLLM project supports: we don’t have a hardcoded list. If you want a specific model or finetune, you don’t have to ask us for it: you can just paste the Hugging Face link in and…

  • Soup CLIAug 2026 · trysoup.dev · ▲107

    Fine-tune an 8B LLM on a 4 GB laptop GPU

  • EW
  • Shoehorn, a library to quantize an LLM to fit your Mac's VRAMAug 2026 · github.com · ▲6

    I made this after seeing someone posit the idea online yesterday over lunch then spent some time refining it. So far it's pretty impressive IMO! Right now I am running Qwen3-30B-A3B on my 24gb unified memory m4 MacBook Pro at 50 tok/sec and this should definitely not be working for such a large model on my middling hardware. Things are detailed in the README to get up and running and DESIGN.md has details on all the choices and such made along the way.

More life & fun this month

the category →

Source: Show HN post ↗ · launch text quoted in part

Launched alongside, May 2025

the whole month →
  • Tapflow 2.0▲1,125

    We built Tapflow for devs, designers, PMs, and tech folks who’ve been sitting on internal docs, templates, and systems — but never productized them. Upload a PDF, notes, or workshop deck, and Tapflow drafts a structured product (with chapters, teaser and pricing plans). It’s good for AI kits, onboarding guides, design systems, and frameworks. You can sell through Stripe, LemonSqueezy, or PayPal. Real-time collaboration is in early beta. No site builder, no LMS — clean design and just focused tools to ship. Fully bootstrapped and just launched on PH today →…

    Work · 2025 · tapflow.ai

  • C9

    Life & fun · 2025 · felixrieseberg.github.io

  • Appwrite 2.0 brings a new engine, a rebuilt Console, five database types, an S3 API, an OAuth 2.1 server, and organization-level Domains and Firewall.

    Dev tools · 2025 · appwrite.io

  • Perfect meeting memory in Notion

    AI · 2025 · notion.com

  • Den▲948

    Multiplayer AI agent builder

    AI · 2025 · getden.io

  • Powerful productivity on the go

    AI · 2025 · raycast.com