nowfound

AI · May 8, 2026

UltraCompress – first mathematically lossless 5-bit LLM compression

Verified AI infrastructure for regulated deployment. UltraCompress (our wedge): near-lossless 5-bit compression with SHA-256-reproducible reconstruction - prove the model in production is the one you validated. 23 architectures (0.6B-405B), Hermes-3-405B @ 1.0066x. OpenAI-compatible API. pip install

UltraCompress – first mathematically lossless 5-bit LLM compression launched on May 8, 2026 with 6 votes, #1,742 of 20,538 launches that month and more than 75% of that year's launches.

Visit github.com ↗Alternativestop 8% of May 2026

What it does

Verified AI infrastructure for regulated deployment. UltraCompress (our wedge): near-lossless 5-bit compression with SHA-256-reproducible reconstruction - prove the model in production is the one you validated. 23 architectures (0.6B-405B), Hermes-3-405B @ 1.0066x. OpenAI-compatible API. pip install ultracompress - sipsalabs/ultracompress

Does a similar job

all alternatives →
  • Qwen3.6-35B-A3BApr 2026 · qwen.ai · ▲124

    The open sparse MoE model for agentic coding

  • Llama 3.2 Interpretability with Sparse Autoencoders2024 · github.com · ▲579

    I spent a lot of time and money on this rather big side project of mine that attempts to replicate the mechanistic interpretability research on proprietary LLMs that was quite popular this year and produced great research papers by Anthropic [1], OpenAI [2] and Deepmind [3]. I am quite proud of this project and since I consider myself the target audience for HackerNews did I think that maybe some of you would appreciate this open research replication as well. Happy to answer any questions or face any feedback. Cheers [1]…

  • TurboQuantMar 2026 · research.google · ▲295

    New LLM compression algorithm by Google

  • 1-Bit Bonsai, the First Commercially Viable 1-Bit LLMsMar 2026 · prismml.com · ▲430

    PrismML builds 1-bit and ternary Bonsai models that pack advanced reasoning, tool use, and multimodal AI into phones, laptops, and efficient data centers.

  • AT
    A tiny LLM running at 21,000 tok/s on a $250 FPGA (Live Demo)Aug 2026 · mikeayles.com · ▲79

    A 3.16M-parameter INT4 transformer running entirely in the on-chip memory of a Xilinx Kria KV260. Zero DRAM in the token loop, 59,965 tok/s on the fabric, bit-exact. Chat with it live.

  • How to store a set of four 5-bit values in one 16-bit value2018 · github.com · ▲188

    Cool trick to store 4 5-bit values in one 16-bit value. - jaamesd/BucketCompressionTrick

More ai this month

the category →
  • Video model that turns script into viral social media videos

    AI · 18d ago · spira.ai

  • The browser where Claude Code and Codex work beside you

    AI · 18d ago · rill.love

  • Kolibri is Aleph Alpha

    AI · 20d ago · tej.as

  • Paintings by AI models: programs run through a simulation of oil paint.

    AI · 21d ago · stillwet.art

  • A real-time world model you can explore and change

    AI · 30d ago · world.pixverse.video

  • Beam.win▲378

    Run AI agents on one Mac and use its windows on another

    AI · 4d ago · beam.win

Source: Show HN post ↗

Launched alongside, May 2026

the whole month →
  • Brew ▲900

    Like Claude design for email marketing

    AI · May 2026 · brew.new

  • Parallel agents, diff reviewer, and multi-model comparisons

    Dev tools · May 2026 · kilo.ai

  • StoreClaw▲806

    Grow your store profits with agents that know how to sell

    AI · May 2026 · storeclaw.ai

  • Give your agent a real number and voice to make calls.

    AI · May 2026 · pollyreach.ai

  • Hey HN, Henry here from Cactus. We open-sourced Needle, a 26M parameter function-calling (tool use) model. It runs at 6000 tok/s prefill and 1200 tok/s decode on consumer devices. We were always frustrated by the little effort made towards building agentic models that run on budget phones, so we conducted investigations that led to an observation: agentic experiences are built upon tool calling, and massive models are overkill for it. Tool calling is fundamentally retrieval-and-assembly (match query to tool name, extract argument values, emit JSON), not reasoning. Cross-attention…

    Life & fun · May 2026 · github.com

  • 🌱 Private, quiet space for thinking. Simple app for .md files. - zakirullin/files.md

    Dev tools · May 2026 · github.com