nowfound

Life & fun · alternatives · 2026

TZ

The Zen of Data Pipelines is a book about building and managing data pipelines. It was published in 2017 and is available online. The book covers principles and practices for designing efficient data workflows. It's… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. The Zen of Data Pipelines (Book) launched in 2017; newer entries below may have overtaken it.

  1. 1SP

    Hi HN, Over the past 6 months I've been working on a technical book focused on helping aspiring data scientists to get hands-on experience with cloud computing environments using the Python ecosystem. The book is targeted at readers already familiar with libraries such as Pandas and scikit-learn that are looking to build out a portfolio of applied projects. To author the book, I used the Leanpub platform to provide drafts of the text as I completed each chapter. To typeset the book, I used the R bookdown package by Yihui Xie to translate my markdown into a PDF format. I also used Google docs…

    2020 · its alternatives →

  2. 2

    Mage AI helps data teams build, orchestrate, monitor, and repair production data pipelines with editable SQL and Python for analytics, applications, and AI.

    2022 · mage.ai · its alternatives →

  3. 3

    Hi HN! I'm currently a Master's student at USTC (University of Science and Technology of China). I've been diving deep into Data Engineering, especially in the context of Large Language Models (LLMs). The Problem: I found that learning resources for modern data engineering are often fragmented and scattered across hundreds of medium articles or disjointed tutorials. It's hard to piece everything together into a coherent system. The Solution: I decided to open-source my learning notes and build them into a structured book. My goal is to help developers fast-track their learning curve. Key…

    Feb 2026 · github.com · its alternatives →

  4. 4IM

    2017 · xyz.insightdataengineering.com · its alternatives →

  5. 5

    Every data pipeline job I had to tackle required quite a few components to set up: - One tool to ingest data - Another one to transform it - If you wanted to run Python, set up an orchestrator - If you need to check the data, a data quality tool Let alone this being hard to set up and taking time, it is also pretty high-maintenance. I had to do a lot of infra work, and while this being billable hours for me I didn’t enjoy the work at all. For some parts of it, there were nice solutions like dbt, but in the end for an end-to-end workflow, it didn’t work. That’s why I decided to build an…

    2024 · github.com · its alternatives →

  6. 6

    An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform. - san089/goodreads_etl_pipeline

    2020 · github.com · its alternatives →

  7. 7

    🧙 Build, run, and manage data pipelines for integrating and transforming data. - mage-ai/mage-ai

    2022 · github.com · its alternatives →

  8. 8IW

    https://www.manning.com/books/data-oriented-programming-in-j... This book is a distillation of everything I’ve learned about what effective development looks like in Java (so far!). It's about how to organize programs around data "as plain data" and the surprisingly benefits that emerge when we do. Programs that are built around the data they manage tend to be simpler, smaller, and significantly easier understand. Java has changed radically over the last several years. It has picked up all kinds of new language features which support data oriented programming (records,…

    2024 · its alternatives →

  9. 9

    🧙 Build, run, and manage data pipelines for integrating and transforming data. - mage-ai/mage-ai

    2022 · github.com · its alternatives →

  10. 10
    Zenkit▲252

    The project management tool that grows with you

    2016 · zenkit.com · its alternatives →

  11. 11WW

    Restructure your knowledge of the complex data analytics landscape, and learn how to build scalable analytics & BI stacks in the modern cloud era

    2020 · holistics.io · its alternatives →

  12. 12

    Get and manipulate data with a visual programming interface.

    2017 · pipes.digital · its alternatives →

  13. 13
    buildpipe▲116

    Compose, run and automate multi step AI developer workflows

    May 2026 · buildpipe.com · its alternatives →

  14. 14

    The spreadsheet for creative growth

    2024 · databar.ai · its alternatives →

  15. 15

    Fall in love with CI/CD again

    2024 · jetbrains.com · its alternatives →

  16. 16

    The easiest way for teams to build a Modern Data Stack

    2021 · mozartdata.com · its alternatives →

  17. 17

    The perfect multi-project management tool, whether you use Agile, traditional, or both methodologies! Project success begins here.

    2016 · zenkit.com · its alternatives →

  18. 18

    Open source unstructured data ETL for AI first applications

    2024 · instill-ai.com · its alternatives →

  19. 19

    Enhance productivity, processes, & sales visibility pipeline

    2018 · zendesk.com · its alternatives →

  20. 20MO
  21. 21

    Build powerful pipelines in any programming language. - gaia-pipeline/gaia

    2018 · github.com · its alternatives →

  22. 22
    ZenML▲84

    Create reproducible machine learning pipelines

    2020 · github.com · its alternatives →

  23. 23

    Hi HN, I’ve been working on an OCR pipeline specifically optimized for machine learning dataset preparation. It’s designed to process complex academic materials — including math formulas, tables, figures, and multilingual text — and output clean, structured formats like JSON and Markdown. Some features: • Multi-stage OCR combining DocLayout-YOLO, Google Vision, MathPix, and Gemini Pro Vision • Extracts and understands diagrams, tables, LaTeX-style math, and multilingual text (Japanese/Korean/English) • Highly tuned for ML training pipelines, including dataset generation and…

    2025 · github.com · its alternatives →

  24. 24

    A guide for anyone who works with data

    2017 · leanpub.com · its alternatives →

Also compare

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →