nowfound

Dev tools · October 24, 2023

Beating GCC 12 – 118x Speedup for Jensen Shannon D. Via AVX-512FP16

SIMD-accelerated distances, dot products, matrix ops, geospatial & geometric kernels for 16 numeric types — from 6-bit floats to 64-bit complex — across x86, Arm, RISC-V, and WASM, with bindings for Python, Rust, C, C++, Swift, JS, and Go 📐 - Release Beating GCC 12 - 118x Speedup for Jensen Shannon

Beating GCC 12 – 118x Speedup for Jensen Shannon D. Via AVX-512FP16 launched on October 24, 2023 with 8 votes, #1,529 of 4,393 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 2 years on.

What it does

SIMD-accelerated distances, dot products, matrix ops, geospatial & geometric kernels for 16 numeric types — from 6-bit floats to 64-bit complex — across x86, Arm, RISC-V, and WASM, with bindings for Python, Rust, C, C++, Swift, JS, and Go 📐 - Release Beating GCC 12 - 118x Speedup for Jensen Shannon Divergence via AVX-512FP16 · ashvardanian/NumKong

Divergence functions are a bit more complex than the Cosine Similarity, primarily because they have to compute logarithms, which are relatively slow when using LibC's logf . So, aside from minor patches, in this PR, I've rewritten the Jensen Shannon distances leveraging several optimizations, mainly focusing on AVX-512 and AVX-512FP16 extensions, which resulted in 4.6x improvement over the auto-vectorized single-precision variant and a whopping 118x improvement over the half-precision code produced by GCCfrom github.com

Does a similar job

all alternatives →
  • Accelerate SHA256 Computations in Go Using AVX512 instructions2017 · github.com · ▲74

    Accelerate SHA256 computations in pure Go using AVX512, SHA Extensions for x86 and ARM64 for ARM. On AVX512 it provides an up to 8x improvement (over 3 GB/s per core). SHA Extensions give a performance boost of close to 4x over native. - minio/sha256-simd

  • AS
    Accelerating SHA256 by 100x in Golang on ARM2016 · blog.minio.io · ▲156
  • A Fast, Malloc-Free C++14 Json Parser and Encoder2014 · github.com · ▲98

    Meta programming utilities for C++14. Merged in matt-42/lithium - matt-42/iod

  • AG
    A GPU-accelerated binary vector index2025 · rlafuente.com · ▲65

    This is a vector index I built that supports insertion and k-nearest neighbors (k-NN) querying, optimized for GPUs. It operates entirely in CUDA and can process queries on half a billion vectors in under 200 milliseconds. The codebase is structured as a standalone library with an HTTP API for remote access. It’s intended for high-performance search tasks—think similarity search, AI model retrieval, or reinforcement learning replay buffers. The codebase is located at https://github.com/rodlaf/BinaryGPUIndex.

  • 10-40% faster LZMA decoder using x86 CMOVcc2021 · gist.github.com · ▲205

    Faster LZMA decoder for x86 CPUs (patch for XZ Utils). - faster_lzma_decoder_x86.patch

  • Run TRELLIS.2 Image-to-3D generation natively on Apple SiliconApr 2026 · github.com · ▲202

    I ported Microsoft's TRELLIS.2 (4B parameter image-to-3D model) to run on Apple Silicon via PyTorch MPS. The original requires CUDA with flash_attn, nvdiffrast, and custom sparse convolution kernels: none of which work on Mac. I replaced the CUDA-specific ops with pure-PyTorch alternatives: a gather-scatter sparse 3D convolution, SDPA attention for sparse transformers, and a Python-based mesh extraction replacing CUDA hashmap operations. Total changes are a few hundred lines across 9 files. Generates ~400K vertex meshes from single photos in about 3.5 minutes on M4 Pro (24GB). Not as fast as…

More dev tools this month

the category →
  • Contribute to oosexgang/hackios-xnu-kernel development by creating an account on GitHub.

    Dev tools · 2d ago · github.com

  • /dev/null▲492

    a social network for devs

    Dev tools · 5d ago · dev-null.sh

  • open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.

    Dev tools · 29d ago · github.com

  • Contribute to reladraw/reladraw development by creating an account on GitHub.

    Dev tools · 27d ago · github.com

  • OpenBot▲362

    Grok Bot alternative: free, local, open-source, multiplayer

    Dev tools · 25d ago · openbot.run

  • Talanoa▲346

    Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…

    Dev tools · 22d ago · talanoa.email

Source: Show HN post ↗

Launched alongside, October 2023

the whole month →
  • AI autopilot for content creation & marketing

    AI · 2023 · typeface.ai

  • Nudge 2.0▲1,051

    In-app experiences to activate, retain, & understand users

    Growth · 2023 · nudgenow.com

  • World's first open source AI scheduling assistant

    AI · 2023 · cal.com

  • Unlock AI magic for elevated customer engagement, fast

    AI · 2023 · tiledesk.com

  • TalkNotes▲854

    Turn your thoughts into actionable notes, fast

    AI · 2023 · talknotes.io

  • Effortlessly discover API behaviour with a Chrome extension that automatically generates OpenAPI specifications in real time for any app or website.

    Dev tools · 2023 · github.com