Alternatives
Products that do what Airflow is cool but have you tried this for data pipelines? does
- 1FH
2020 · cloud.titanoboa.io
- 2AC
2020 · github.com
- 3SL
2020 · systemflow.co
- 4KO
Hey HN, I'm really proud to share with you my new open source project: Kestra https://github.com/kestra-io/kestra I created a few years ago a successful open source AKHQ project: https://github.com/tchiotludo/akhq (renamed from KafkaHQ) which has been adopted by big companies like Best Buy, Pipedrive, BMW, Decathlon and many more. 2300 stars, 120 contributors, 10M docker downloads, much more than I expected. Now let's talk about Kestra, an infinitely scalable orchestration and scheduling platform for creating, running, scheduling and monitoring…
2022 · github.com
- 5
- 6
- 7IB
Every data pipeline job I had to tackle required quite a few components to set up: - One tool to ingest data - Another one to transform it - If you wanted to run Python, set up an orchestrator - If you need to check the data, a data quality tool Let alone this being hard to set up and taking time, it is also pretty high-maintenance. I had to do a lot of infra work, and while this being billable hours for me I didn’t enjoy the work at all. For some parts of it, there were nice solutions like dbt, but in the end for an end-to-end workflow, it didn’t work. That’s why I decided to build an…
2024 · github.com
- 8
- 9AI
Hi HN, I’m Sean, the founder of Ascend.io (https://www.ascend.io). I’m really excited to post here and announce the launch of Ascend.io, a radical new way of designing, scaling, and automating data pipelines. Ascend is the result of nearly 4 years of development effort for a team that is now 30-strong, and I would love for you to give it a test drive and let me what you think. I’ve felt this pain since I wrote my first MapReduce in 2004 (using Sawzall @ Google), and in the 15 years since, things have not improved at the pace of other parts of the technology ecosystem. When I went…
2019
- 10TZ
2017 · gpestana.gitbooks.io
- 11
- 12
- 13
- 14FO
2022 · medium.com
- 15PA
2019 · github.com
- 16OS
Hey HN! We are building *open source infrastructure for deploying customer-facing data pipelines.* Here’s our repo https://github.com/pipebird/pipebird and website https://pipebird.com/. Pipebird (YC W22) is designed to enable companies that generate important data to offer secure data pushes to their customers’ warehouses, directly from their products. Our team was previously building in fintech, where we heard from many of our peers that their customers wanted data pushed directly to their warehouses. Customers wanted to bring data into their source of…
2022 · github.com
- 17DF
Hello Everyone! We built SQLFlow as a lightweight stream processing engine. We leverage DuckDB as the stream processing engine, which gives SQLFlow the ability to process 10's of thousands of messages a second using ~250MiB of memory! DuckDB also supports a rich ecosystem of sinks and connectors! https://sql-flow.com/docs/category/tutorials/ https://github.com/turbolytics/sql-flow We were tired of running JVM's for simple stream processing, and also of bespoke one off stream processors I would love your feedback, criticisms and/or…
Dec 2025 · sql-flow.com
- 18PL
2019 · github.com
- 19VA
2020 · github.com
- 20BR
2015 · blog.memsql.com
- 21AJ
I have created a Cron alternative that runs DAGs (Directed acyclic graph) defined in a simple YAML format. Why not Airflow? Airflow and other similar tools are powerful and valuable, but in most cases, they require writing code to manage workflows. Our ETL pipeline is already hundreds of thousands of lines of complex code in Perl and shell scripts. Adding another layer of Python on top of this would make it difficult to maintain. Instead, we needed a more lightweight solution. So we developed Dagu, which requires no coding, and is easy-to-use and self-contained, making it ideal for smaller…
2022 · github.com
- 22AR
2025 · github.com
- 23PP
2015 · pipeglade.boundp.org
- 24WB
Think Workflowy meets OSS with the plugin extensibility of Obsidian and beauty of Linear
Jul 2026 · twitter.com
Ranked by how close each launch is in meaning, then by votes. Refine with a description →