Dev tools · alternatives · 2026
24 alternatives to Distributed MapReduce framework in Go
This is a distributed MapReduce framework written in Go, designed for developers who need to process large datasets across multiple machines. It implements the MapReduce programming model, allowing users to write… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Distributed MapReduce framework in Go launched in 2015; newer entries below may have overtaken it.
- 1
I can't tell if HN is the right kind of place for this stuff anymore since people are so advanced in their use but I thought it was interesting to leverage my existing Go microservices framework and turn it into the core of what would provide tools for an agent cli or whatever beyond that. Extensibility is key. Thought I'd share and get a conversation going.
2020 · go-micro.dev · its alternatives →
- 2MI
2016 · shagunsodhani.in · its alternatives →
- 3
I started thinking about this approach after working on a large-scale project for a major financial company where our group developed a distributed in-house data processing solution. On a regular basis, it ingested a few gigabytes of financial data and, within a tight SLA time limit, produced a lot of enriched/aggregated/validated data for a number of customers. Sometimes, source data had errors, so operators with domain knowledge had to verify data validity at some checkpoints, immediately make corrections, and re-run parts of the workflow manually. The solution involved complex…
2023 · capillaries.io · its alternatives →
- 4
Recently created a minimal persistent relational database in Go. Main focus was on implementing & understanding working the of database, storage management & transaction handling. Use of B+ Tree for storage engine(support for indexing), managing a Free List (for reusing nodes), Support for transactions, Concurrent Reads. Still have many things to add & fix like query processing being one of the main & fixing some bugs Repo link - https://github.com/Sahilb315/AtomixDB Would love to hear your thoughts
2025 · github.com · its alternatives →
- 5
🐎 A serverless MapReduce framework written for AWS Lambda - bcongdon/corral
2018 · github.com · its alternatives →
- 6
Go Library for distributing work to workers. Contribute to ryanskidmore/GoWork development by creating an account on GitHub.
2015 · github.com · its alternatives →
- 7
The infrastructure platform for the intelligence era - encoredev/encore
2021 · github.com · its alternatives →
- 8
🍐 The enterprise REST API framework. Contribute to go-goyave/goyave development by creating an account on GitHub.
2020 · github.com · its alternatives →
- 9
LBADD: An experimental, distributed SQL database. Contribute to tomarrell/lbadd development by creating an account on GitHub.
2019 · github.com · its alternatives →
- 10
Globe wireframe visualizations in Golang. Contribute to mmcloughlin/globe development by creating an account on GitHub.
2017 · github.com · its alternatives →
- 11
Every data pipeline job I had to tackle required quite a few components to set up: - One tool to ingest data - Another one to transform it - If you wanted to run Python, set up an orchestrator - If you need to check the data, a data quality tool Let alone this being hard to set up and taking time, it is also pretty high-maintenance. I had to do a lot of infra work, and while this being billable hours for me I didn’t enjoy the work at all. For some parts of it, there were nice solutions like dbt, but in the end for an end-to-end workflow, it didn’t work. That’s why I decided to build an…
2024 · github.com · its alternatives →
- 12
Goka is a compact yet powerful distributed stream processing library for Apache Kafka written in Go. - lovoo/goka
2017 · github.com · its alternatives →
- 13
go generate based graphql server library. Contribute to 99designs/gqlgen development by creating an account on GitHub.
2018 · github.com · its alternatives →
- 14
- 15
I'd like to share a project I've been working on for the past few months. It's a distributed workflow engine written entirely in Go. Some highlights: * Tasks are executed in a Docker container * Can run stand-alone or distributed * Highly extensible * Able to enforce limits (CPU/RAM) per task * Web UI Would love the get your feedback on it, and find out if this could be useful.
2023 · github.com · its alternatives →
- 16
Hi HN community, I’m Nick, co-founder/CEO of Transform.co. I’m thrilled to share MetricFlow, an open-source metric creation framework: https://github.com/transform-data/metricflow MetricFlow strives to make what has historically been an extremely repetitive process, writing SQL queries on core normalized data models, much more DRY. MetricFlow consolidates the definitions for joins, aggregations, filters, etc., and programmatically generates SQL to construct data marts. You can think of it like LookML, but more powerful and ergonomic (and open source!). The project…
2022 · github.com · its alternatives →
- 17
Fast, efficient, and scalable distributed map/reduce system, DAG execution, in memory or on disk, written in pure Go, runs standalone or distributedly. - chrislusf/gleam
2016 · github.com · its alternatives →
- 18
In which I rewrite my toy pygit client in Go to see how suitable Go is for simple scripts.
2023 · benhoyt.com · its alternatives →
- 19
Job server in Go. Contribute to iamduo/workq development by creating an account on GitHub.
2016 · github.com · its alternatives →
- 20
Hello HN! My name is Paras and I am building this project called Slashbase. It's an open-source collaborative IDE for databases in browser. Connect to your database, browse data, run a bunch of queries or share queries within your team, right from your browser. Works with two types of databases: PostgreSQL and MongoDB. It's written in Golang and Nextjs React Framework and runs as a single binary. Features: - Cloud based: Setup on your server. Works in browser. - Easy to use: with minimal interface it is simple to use. - Collaborative: Works with your teams. Easy sharing queries within team.…
2022 · github.com · its alternatives →
- 21
An Open Source Machine Learning Framework for Everyone - tensorflow/tensorflow/core/distributed_runtime at master · tensorflow/tensorflow
2016 · github.com · its alternatives →
- 22
go-storage▲86An application-oriented unified storage layer for Golang.
2021 · github.com · its alternatives →
- 23
A highly configurable Google Cloud Dataflow pipeline that writes data into Google Big Query table from Pub/Sub - bomboradata/pubsub-to-bigquery
2017 · github.com · its alternatives →
- 24
Hi all, I wanted to reshare this after some time. I've been working on evolving my service framework into an agent harness. As all of this AI tooling has evolved its become clear to me that agents, services and workflows are part of a core system of operations which would benefit from a single framework. Previously Go Micro only enabled service development. But now it includes Agents and Workflows. What does that mean? Well firstly services which are registered in a central registry automatically become tools for agents. The service endpoints individually become callable tools via MCP.…
2019 · go.micro.mu · its alternatives →
Also compare
- Go Micro – A distributed systems development framework alternatives
- MapReduce Implementation of Spatial Co-Location Mining Algorithm alternatives
- Capillaries: Distributed data processing with Go and Cassandra alternatives
- A Database Written in Golang alternatives
- Corral – A Serverless MapReduce Framework alternatives
- GoWork – A Go Distributed Work Library alternatives
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →