Dev tools · alternatives · 2026
24 alternatives to I built an open-source data pipeline tool in Go
Every data pipeline job I had to tackle required quite a few components to set up: - One tool to ingest data - Another one to transform it - If you wanted to run Python, set up an orchestrator - If you need to check the data, a data quality tool Let alone this being hard to set up and taking time, it is also pretty high-maintenance. I had to do a lot of infra work, and while this being billable hours for me I didn’t enjoy the work at all. For some parts of it, there were nice solutions like dbt, but in the end for an end-to-end workflow, it didn’t work. That’s why I decided to build an…
Bruin is an open-source data pipeline framework built in Go that consolidates data ingestion, transformation, and Python orchestration into a single tool. Designed for data engineers tired of managing multiple separate… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. I built an open-source data pipeline tool in Go launched in 2024; newer entries below may have overtaken it.
- 1
We are building Quary (https://quary.dev), an engineer-first BI/analytics product. You can find our repo at https://github.com/quarylabs/quary and our website at https://www.quary.dev/. There’s a demo video here: https://www.youtube.com/watch?v=o3hO65_lkGU As engineers who have worked on data at startups and Amazon, we were frustrated by self-serve BI tools. They seemed dumbed down and they always required us to abandon our local dev tools we know and love (e.g. copilot, git). For us and for everyone we speak to, they end up…
2024 · github.com · its alternatives →
- 2
- 3
Hi HN community, I’m Nick, co-founder/CEO of Transform.co. I’m thrilled to share MetricFlow, an open-source metric creation framework: https://github.com/transform-data/metricflow MetricFlow strives to make what has historically been an extremely repetitive process, writing SQL queries on core normalized data models, much more DRY. MetricFlow consolidates the definitions for joins, aggregations, filters, etc., and programmatically generates SQL to construct data marts. You can think of it like LookML, but more powerful and ergonomic (and open source!). The project…
2022 · github.com · its alternatives →
- 4IM
2017 · xyz.insightdataengineering.com · its alternatives →
- 5
Hi there, Burak here. I built an open-source data copy tool called ingestr (https://github.com/bruin-data/ingestr) I did build quite a few data warehouses both for the companies I worked at, as well as for consultancy projects. One of the more common pain points I observed was that everyone had to rebuild the same data ingestion bit over and over again, and each in different ways: - some wrote code for the ingestion from scratch to various degrees - some used off-the-shelf data ingestion tools like Fivetran / Airbyte I have always disliked both of these approaches,…
2024 · github.com · its alternatives →
- 6
Recently created a minimal persistent relational database in Go. Main focus was on implementing & understanding working the of database, storage management & transaction handling. Use of B+ Tree for storage engine(support for indexing), managing a Free List (for reusing nodes), Support for transactions, Concurrent Reads. Still have many things to add & fix like query processing being one of the main & fixing some bugs Repo link - https://github.com/Sahilb315/AtomixDB Would love to hear your thoughts
2025 · github.com · its alternatives →
- 7
Hey HN! We are building *open source infrastructure for deploying customer-facing data pipelines.* Here’s our repo https://github.com/pipebird/pipebird and website https://pipebird.com/. Pipebird (YC W22) is designed to enable companies that generate important data to offer secure data pushes to their customers’ warehouses, directly from their products. Our team was previously building in fintech, where we heard from many of our peers that their customers wanted data pushed directly to their warehouses. Customers wanted to bring data into their source of…
2022 · github.com · its alternatives →
- 8
Mozart Data▲112The easiest way for teams to build a Modern Data Stack
2021 · mozartdata.com · its alternatives →
- 9
Hey Show HN! I’m Toby and over the last few months, I’ve been working with a team of engineers from Airbnb, Apple, Google, and Netflix, to simplify developing data pipelines with SQLMesh (https://github.com/TobikoData/sqlmesh). We’re tired of fragile pipelines, untested SQL queries, and expensive staging environments for data. Software engineers have reaped the benefits of DevOps through unit tests, continuous integration, and continuous deployment for years. We felt like it was time for data teams to have the same confidence and efficiency in development as their peers.…
2023 · github.com · its alternatives →
- 10
A highly configurable Google Cloud Dataflow pipeline that writes data into Google Big Query table from Pub/Sub - bomboradata/pubsub-to-bigquery
2017 · github.com · its alternatives →
- 11
node-based editor for exploring, analyzing and transforming data without code
2021 · datablocks.pro · its alternatives →
- 12
Prefect is a workflow orchestration framework for building resilient data pipelines in Python. - PrefectHQ/prefect
2019 · github.com · its alternatives →
- 13
- 14
🧙 Build, run, and manage data pipelines for integrating and transforming data. - mage-ai/mage-ai
2022 · github.com · its alternatives →
- 15
Bruin▲84The AI data agent that collaborates with your team
May 2026 · getbruin.com · its alternatives →
- 16
Orchest▲112An open source tool for creating data science pipelines
2020 · orchest.io · its alternatives →
- 17
Mage AI helps data teams build, orchestrate, monitor, and repair production data pipelines with editable SQL and Python for analytics, applications, and AI.
2022 · mage.ai · its alternatives →
- 18
- 19
I started thinking about this approach after working on a large-scale project for a major financial company where our group developed a distributed in-house data processing solution. On a regular basis, it ingested a few gigabytes of financial data and, within a tight SLA time limit, produced a lot of enriched/aggregated/validated data for a number of customers. Sometimes, source data had errors, so operators with domain knowledge had to verify data validity at some checkpoints, immediately make corrections, and re-run parts of the workflow manually. The solution involved complex…
2023 · capillaries.io · its alternatives →
- 20
DevLake▲188An open-source data-lake & dashboard for your dev tools
2021 · github.com · its alternatives →
- 21OD
Hello Hacker News! We are Rick & Yannick from Orchest (https://www.orchest.io - https://github.com/orchest/orchest). We're building a visual pipeline tool for data scientists. The tool can be considered to be high-code because you write your own Python/R notebooks and scripts, but we manage the underlying infrastructure to make it 'just work™'. You can think of it as a simplified version of Kubeflow. We created Orchest to free data scientists from the tedious engineering related tasks of their job. Similar to how companies like Netflix, Uber and Booking.com…
2020 · its alternatives →
- 22
Supercharged GitHub pipelines with observability & insights
2023 · its alternatives →
- 23
Masthead Data▲122Know compute cost of every pipeline & model in your BigQuery
2023 · mastheadata.com · its alternatives →
- 24
Hey HN, I am Alex. I am open sourcing Data Studio, a lightweight data exploration IDE in your browser that runs locally. Try it: https://local.dataspren.com (no account needed, runs locally) More information: https://github.com/dataspren-analytics/data-studio I love working with data (Postgres, SQL, DuckDB, DBT, Iceberg, ...). I always wanted a data exploration tool that runs in my browser and just works. Without any infra or privacy concerns (DuckDB UI came quite close). Features: - Data Notebooks - SQL cells work like DBT models (they materialize to views) -…
Feb 2026 · github.com · its alternatives →
Also compare
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →