nowfound

Life & fun · March 27, 2026

Forkrun – NUMA-aware shell parallelizer (50×–400× faster than parallel)

forkrun is the culmination of a 10-year-long journey focused on "how to make shell parallelization fast". What started as a standard "fork jobs in a loop" has turned into a lock-free, CAS-retry-loop-free, SIMD-accelerated, self-tuning, NUMA aware shell-based stream parallelization engine that is (mostly) a drop-in replacement for xargs -P and GNU parallel. On my 14-core/28-thread i9-7940x, forkrun achieves: * 200,000+ batch dispatches/sec (vs ~500 for GNU Parallel) * ~95–99% CPU utilization across all 28 logical cores, even when the workload is non-existant (bash no-ops / `:`)…

Forkrun – NUMA-aware shell parallelizer (50×–400× faster than parallel) launched on March 27, 2026 with 151 votes, #232 of 23,380 launches that month and more than 95% of that year's launches.

Visit github.com ↗Alternativestop 1% of March 2026

In plain words

Forkrun is a shell parallelization tool that runs commands across multiple processors faster than traditional alternatives like GNU Parallel and xargs. Built with NUMA awareness, lock-free design, and SIMD optimization, it functions as a drop-in replacement for existing parallelization tools. It is designed for users who need to process large batches of shell commands efficiently on multi-core systems, achieving significantly higher throughput and CPU utilization on batch processing workloads.

written from the facts on this page · September 2026

From the sources

NUMA-Aware Contention-Free Dynamically-Auto-Tuning Bash-Native Streaming Parallelization Engine - jkool702/forkrun

forkrun is a self-tuning, drop-in replacement for GNU Parallel and xargs -P that accelerates shell-based data preparation by 50×–400× on modern CPUs and scales linearly on NUMA architectures. forkrun is built for high-frequency, low-latency workloads on deep NUMA hardware — a regime where existing tools leave most cores idle due to IPC overhead and cross-socket data migration. forkrun is distributed as a single bash file with an embedded, self-extracting compiled C extension. There are no external dependencies (no Perl, no Python). # Option 1: download and source wget https://raw.githubusercontent.com/jkool702/forkrun/main/frun.bash source ./frun.bash # Option 2: source curl stream source…from github.com

In the maker’s words, at launch

forkrun is the culmination of a 10-year-long journey focused on "how to make shell parallelization fast". What started as a standard "fork jobs in a loop" has turned into a lock-free, CAS-retry-loop-free, SIMD-accelerated, self-tuning, NUMA aware shell-based stream parallelization engine that is (mostly) a drop-in…

Does a similar job

all alternatives →
  • Sub-millisecond VM sandboxes using CoW memory forkingMar 2026 · github.com · ▲311

    I wanted to see how fast an isolated code sandbox could start if I never had to boot a fresh VM. So instead of launching a new microVM per execution, I boot Firecracker once with Python and numpy already loaded, then snapshot the full VM state. Every execution after that creates a new KVM VM backed by a `MAP_PRIVATE` mapping of the snapshot memory, so Linux gives me copy-on-write pages automatically. That means each sandbox starts from an already-running Python process inside a real VM, runs the code, and exits. These are real KVM VMs, not containers: separate guest kernel, separate guest…

  • Whirlwind – Async concurrent hashmap for Rust2024 · github.com · ▲140

    Hey HN, this is Will and David from Fortress (https://news.ycombinator.com/item?id=41426998). We use a lot of async Rust internally, and created this library out of a need for an async-aware concurrent hashmap since there weren’t many available in the Rust ecosystem. Whirlwind is a sharded HashMap with a fully asynchronous API. Just as dashmap is a replacement for std::sync::RwLock, whirlwind aims to be a replacement for tokio::sync::RwLock. It has a similar design and performance characteristics to dashmap, but seems to perform better in read-heavy workloads with tokio's…

  • A “living” Linux process with no memory2020 · github.com · ▲312

    A "living" Linux process with no memory. Contribute to izabera/zeromaps development by creating an account on GitHub.

  • WarpBuild – x86-64 and arm GitHub Action runners for 30% faster builds2023 · warpbuild.com · ▲154

    Hey HN, I’m Surya and I’m excited to show you WarpBuild! WarpBuild provides fast, secure `x86-64` and `arm64` Github actions runners. This speeds up your workloads by 30%, at half the cost, and takes ~2mins to get started. We’ve been seeing pretty good results since we opened up signups a week ago and I’ve shared some numbers publicly here [1]. Currently, we support linux runners for Github organizations (not personal accounts) and MacOS support is coming soon (~Jan). The way the runners work is deceptively simple: Runners are assigned to hardware that is ideal for build workloads with fast…

  • Run – a CLI universal code runner I built while learning Rust2025 · github.com · ▲96

    Hi HN — I’m learning Rust and decided to build a universal CLI for running code in many languages. The tool, Run, aims to be a single, minimal dependency utility for: running one-off snippets (from CLI flags), running files, reading and executing piped stdin, and providing language-specific REPLs that you can switch between interactively. I designed it to support both interpreted languages (Python, JS, Ruby, etc.) and compiled languages (Rust, Go, C/C++). It detects languages from flags or file extensions, can compile temporary files for compiled languages, and exposes a unified REPL…

  • I missed the moving blocks, so I built a real Linux disk defragmenterAug 2026 · github.com · ▲97

    Linux filesystem defragger written in Rust and Qt Quick/Kirigami - gbin/defragger

More life & fun this month

the category →

Source: Show HN post ↗ · launch text quoted in part

Launched alongside, March 2026

the whole month →
  • AI-native CRM that builds itself and does work for you

    AI · Mar 2026 · lightfield.app

  • Tobira.ai▲728

    A network where AI agents find deals for their humans

    AI · Mar 2026 · tobira.ai

  • Switch from ChatGPT to Claude with import memory feature

    AI · Mar 2026 · claude.com

  • Littlebird remembers everything across your meetings, messages, docs, and apps, then takes action so you can recall any detail and never lose context.

    AI · Mar 2026 · littlebird.ai

  • Your AI Coworker that proactively executes tasks

    AI · Mar 2026 · viktor.com

  • Jupid▲659

    File your taxes with Claude Code

    Commerce · Mar 2026 · jupid.com