Life & fun · alternatives · 2026

24 alternatives to Samchika – A Java Library for Fast, Multithreaded File Processing

Hi HN, I built a Java library called SmartFileProcessor to make high-performance, multi-threaded file processing simpler and more maintainable. Most Java file processing solutions either involve a lot of boilerplate or don’t handle concurrency, backpressure, or metrics well out of the box. I needed something fast, clean, and production-friendly — so I built this. Key features: Multi-threaded line/batch processing using a configurable thread pool Producer/consumer model with built-in backpressure Buffered, asynchronous writing with optional auto-flush Live metrics: memory usage,…

Samchika is a Java library for processing large files with multiple threads simultaneously. It handles concurrent file reading and writing using a producer-consumer model with built-in backpressure to prevent memory… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes.

1IW
I Wrote a Book on Java▲586
https://www.manning.com/books/data-oriented-programming-in-j... This book is a distillation of everything I’ve learned about what effective development looks like in Java (so far!). It's about how to organize programs around data "as plain data" and the surprisingly benefits that emerge when we do. Programs that are built around the data they manage tend to be simpler, smaller, and significantly easier understand. Java has changed radically over the last several years. It has picked up all kinds of new language features which support data oriented programming (records,…
2024 · its alternatives →
2
DuckDB for Kafka Stream Processing▲77
Hello Everyone! We built SQLFlow as a lightweight stream processing engine. We leverage DuckDB as the stream processing engine, which gives SQLFlow the ability to process 10's of thousands of messages a second using ~250MiB of memory! DuckDB also supports a rich ecosystem of sinks and connectors! https://sql-flow.com/docs/category/tutorials/ https://github.com/turbolytics/sql-flow We were tired of running JVM's for simple stream processing, and also of bespoke one off stream processors I would love your feedback, criticisms and/or…
Dec 2025 · sql-flow.com · its alternatives →
3OA
Obelisk – a WASM-based deterministic workflow engine▲103
A lightweight engine for durable execution / deterministic workflows I built with Rust, wasmtime and the WASM Component Model. Its main use is running reliable, long-running workflows that can automatically resume after failures. Looking for feedback on the approach and potential use cases!
2025 · obeli.sk · its alternatives →
4IB
IPC between multiple Java processes/JVMs with nanosecond latency▲114
2015 · mappedbus.io · its alternatives →
5
Restate – Low-latency durable workflows for JavaScript/Java, in Rust▲185
We'd love to share our work with you: Restate, a system for workflows-as-code (durable execution). With SDKs in JS/Java/Kotlin and a lightweight runtime built in Rust/Tokio. https://github.com/restatedev/ https://restate.dev/ It is free and open, SDKs are MIT-licensed, runtime permissive BSL (basically just the minimal Amazon defense). We worked on that for a bit over a year. A few points I think are worth mentioning: - Restate's runtime is a single binary, self-contained, no dependencies aside from a durable disk. It contains basically a…
2024 · restate.dev · its alternatives →
6LT
Lightweight Threads, Channels and Actors for the JVM▲116
2013 · blog.paralleluniverse.co · its alternatives →
7
Riko – A Python stream processing engine modeled after Yahoo! Pipes▲283
A Python stream processing engine modeled after Yahoo! Pipes - nerevu/riko
2016 · github.com · its alternatives →
8
Tail Recursion Optimization for the JVM▲107
Optimizer library for tail recursive calls in Java bytecode - Sipkab/jvm-tail-recursion
2020 · github.com · its alternatives →
9
Jacinda, a functional Awk (text stream processing on the comamnd-line)▲81
Typed, functional (folds, scans) stream processing backed by Andrew Gallant/burntsushi's regular expressions library. There's a guide here! https://vmchale.github.io/jacinda/
2024 · hackage.haskell.org · its alternatives →
10
Jet – in-memory, fault-tolerant, distributed stream processing▲129
Distributed Stream and Batch Processing. Contribute to hazelcast/hazelcast-jet development by creating an account on GitHub.
2020 · github.com · its alternatives →
11
A thread hierarchy management library in C▲53
Non-preemptive Thread Hierarchy Manager. Contribute to gueststar/nthm development by creating an account on GitHub.
2020 · github.com · its alternatives →
12
Forkrun – NUMA-aware shell parallelizer (50×–400× faster than parallel)▲151
forkrun is the culmination of a 10-year-long journey focused on "how to make shell parallelization fast". What started as a standard "fork jobs in a loop" has turned into a lock-free, CAS-retry-loop-free, SIMD-accelerated, self-tuning, NUMA aware shell-based stream parallelization engine that is (mostly) a drop-in replacement for xargs -P and GNU parallel. On my 14-core/28-thread i9-7940x, forkrun achieves: * 200,000+ batch dispatches/sec (vs ~500 for GNU Parallel) * ~95–99% CPU utilization across all 28 logical cores, even when the workload is non-existant (bash no-ops / `:`)…
Mar 2026 · github.com · its alternatives →
13
Kameo – Fault-tolerant async actors built on Tokio▲105
Hi HN, I’m excited to share Kameo, a lightweight Rust library that helps you build fault-tolerant, distributed, and asynchronous actors. If you're working on distributed systems, microservices, or real-time applications, Kameo offers a simple yet powerful API for handling concurrency, panic recovery, and remote messaging between nodes. Key Features: - Async Rust: Each actor runs as a separate Tokio task, making concurrency management simple. - Remote Messaging: Seamlessly send messages to actors across different nodes. - Supervision and Fault Tolerance: Create self-healing systems with actor…
2024 · github.com · its alternatives →
14
Pyper – Concurrent Python Made Simple▲156
Hello and happy new year! We're excited to introduce the Pyper package for concurrency & parallelism in Python. Pyper is a flexible framework for concurrent / parallel data processing, following the functional paradigm. Source code can be found on [github](https://github.com/pyper-dev/pyper) Key features: Intuitive API: Easy to learn, easy to think about. Implements clean abstractions to seamlessly unify threaded, multiprocessed, and asynchronous work. Functional Paradigm: Python functions are the building blocks of data pipelines. Let's you write clean, reusable…
2025 · github.com · its alternatives →
15
I wrote a Java decompiler in pure C language▲172
The world's fastest apk (android)/java open source decompiler - neocanable/garlic
2025 · github.com · its alternatives →
16
Denormalized – Embeddable Stream Processing in Rust and DataFusion▲125
tl;dr we built an embeddable stream processing engine in Rust using apache DataFusion, check us out at https://github.com/probably-nothing-labs/denormalized Hey HN, We’d like to showcase a very early version of our embeddable stream processing engine called Denormalized. The rise of DuckDB has abundantly made it clear that even for many workloads of Terabyte scale, a single node system outshines the distributed query engines of previous generation such as Spark, Snowflake etc in terms of both performance and cost. Now a lot of workloads DuckDB is used for were normally…
2024 · github.com · its alternatives →
17
Minibatch – Python stream processing▲50
Python stream processing for humans. Contribute to omegaml/minibatch development by creating an account on GitHub.
2020 · github.com · its alternatives →
18
Todool, a full blown environment for managing large trees of task lists▲71
Currently an alpha is available in their Discord server. I'm not the creator, if you have any questions about the program feel free to join the Discord server.
2022 · todool.handmade.network · its alternatives →
19
Fahmatrix – A Lightweight, Pandas-Like DataFrame Library for Java▲46
Hey HN, I’ve built Fahmatrix, a minimal, fast Java library for working with tabular data — inspired by Python’s pandas, but designed for performance and simplicity on the JVM. After working extensively with Python’s data stack, I often ran into limitations related to speed, especially in larger or long-running data workflows. So I built Fahmatrix from scratch to offer similar APIs for manipulating CSVs, performing summary statistics, slicing rows/columns, and more — but all in Java. Features: Lightweight and dependency-free CSV/TSV import with auto-headers Series/DataFrame…
2025 · github.com · its alternatives →
20
Goka – distributed stream processing library for Kafka written in Go▲105
Goka is a compact yet powerful distributed stream processing library for Apache Kafka written in Go. - lovoo/goka
2017 · github.com · its alternatives →
21
MCP-stama – An ultra-fast Rust MCP server with no dependencies▲73
An ultra-fast, single-binary MCP server written in Rust as a lightweight alternative to Node.js/Python. - StamManif/mcp-stama
Aug 2026 · github.com · its alternatives →
22
Bringing multithreading to Python's async event loop▲82
This project explores the integration of multithreading into the asyncio event loop in Python. While this was initially built with enhancing CPU utilization for FastAPI servers in mind, the approach can be used with more general async programs too. If you’re interested in diving deeper into the details, I’ve written a blog post about it here: https://www.neilbotelho.com/blog/multithreaded-async.html
2024 · github.com · its alternatives →
23
DBOS Java – Postgres-Backed Durable Workflows▲114
Hi HN - I’m Peter, here with Harry (devhawk), and we’re building DBOS Java, an open-source Java library for durable workflows, backed by Postgres. https://github.com/dbos-inc/dbos-transact-java Essentially, DBOS helps you write long-lived, reliable code that can survive failures, restarts, and crashes without losing state or duplicating work. As your workflows run, it checkpoints each step they take in a Postgres database. When a process stops (fails, restarts, or crashes), your program can recover from those checkpoints to restore its exact state and continue from where…
Nov 2025 · github.com · its alternatives →
24
Iceoryx2 – Fast IPC Library for Rust, C++, and C▲122
Hello everyone, Today we released iceoryx2 v0.4! iceoryx2 is a service-based inter-process communication (IPC) library designed to make communication between processes as fast as possible - like Unix domain sockets or message queues, but orders of magnitude faster and easier to use. It also comes with advanced features such as circular buffers, history, event notifications, publish-subscribe messaging, and a decentralized architecture with no need for a broker. For example, if you're working in robotics and need to process frames from a camera across multiple processes, iceoryx2 makes it…
2024 · ekxide.io · its alternatives →

Also compare

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →