nowfound

Work · alternatives · 2026

24 alternatives to Data Engineering Project for Beginners

Data engineering project for beginners, using AWS Redshift, Apache Spark in AWS EMR, Postgres and orchestrated by Apache Airflow.

Data Engineering Project for Beginners is a work resource launched in 2020 that teaches foundational data engineering concepts through hands-on projects. It's designed for people new to the field who want practical… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Data Engineering Project for Beginners launched in 2020; newer entries below may have overtaken it.

  1. 1

    Hi HN! I'm currently a Master's student at USTC (University of Science and Technology of China). I've been diving deep into Data Engineering, especially in the context of Large Language Models (LLMs). The Problem: I found that learning resources for modern data engineering are often fragmented and scattered across hundreds of medium articles or disjointed tutorials. It's hard to piece everything together into a coherent system. The Solution: I decided to open-source my learning notes and build them into a structured book. My goal is to help developers fast-track their learning curve. Key…

    Feb 2026 · github.com · its alternatives →

  2. 2IW

    https://www.manning.com/books/data-oriented-programming-in-j... This book is a distillation of everything I’ve learned about what effective development looks like in Java (so far!). It's about how to organize programs around data "as plain data" and the surprisingly benefits that emerge when we do. Programs that are built around the data they manage tend to be simpler, smaller, and significantly easier understand. Java has changed radically over the last several years. It has picked up all kinds of new language features which support data oriented programming (records,…

    2024 · its alternatives →

  3. 3
    nao▲498

    AI data IDE for 10x faster data work

    Nov 2025 · getnao.io · its alternatives →

  4. 4

    Every data pipeline job I had to tackle required quite a few components to set up: - One tool to ingest data - Another one to transform it - If you wanted to run Python, set up an orchestrator - If you need to check the data, a data quality tool Let alone this being hard to set up and taking time, it is also pretty high-maintenance. I had to do a lot of infra work, and while this being billable hours for me I didn’t enjoy the work at all. For some parts of it, there were nice solutions like dbt, but in the end for an end-to-end workflow, it didn’t work. That’s why I decided to build an…

    2024 · github.com · its alternatives →

  5. 51G
  6. 6

    node-based editor for exploring, analyzing and transforming data without code

    2021 · datablocks.pro · its alternatives →

  7. 7

    Learn programming by building real systems from scratch. Redis, Git, a database, a compiler — every lesson is choose, write, run.

    Jul 2026 · shipthatcode.com · its alternatives →

  8. 8DE
  9. 9
    Velvet▲166

    Make everyone a data engineer

    2024 · usevelvet.com · its alternatives →

  10. 10

    Codecademy for Data Science

    2015 · dataquest.io · its alternatives →

  11. 11
  12. 12SP

    Hi HN, Over the past 6 months I've been working on a technical book focused on helping aspiring data scientists to get hands-on experience with cloud computing environments using the Python ecosystem. The book is targeted at readers already familiar with libraries such as Pandas and scikit-learn that are looking to build out a portfolio of applied projects. To author the book, I used the Leanpub platform to provide drafts of the text as I completed each chapter. To typeset the book, I used the R bookdown package by Yihui Xie to translate my markdown into a PDF format. I also used Google docs…

    2020 · its alternatives →

  13. 13

    Hi HN, We're Luke and Phillip, and we're building Spice.ai OSS - a lightweight, portable runtime, built in Rust and powered by Apache DataFusion to locally materialize, accelerate, and query data tables sourced from any database, data warehouse or data lake. Phillip and I first introduced Spice on Show HN in September 2021. Since then, we’ve been schooled and humbled in every way building 100TB+ data and ML systems for the https://spice.ai cloud platform. Along with our customers, we struggled with getting fast, low-latency, high-concurrency SQL query within a budget, accessing and…

    2024 · github.com · its alternatives →

  14. 14

    The easiest way for teams to build a Modern Data Stack

    2021 · mozartdata.com · its alternatives →

  15. 15

    I created a web page to compare different analytical databases (both self-managed and services, open-source and proprietary) on a realistic dataset. It contains 20+ databases, each with installation and data loading scripts. And they can be compared to each other on a set of 43 queries, by data load time or by storage size. There are switches to select different types of databases for comparison - for example, only MySQL compatible or PostgreSQL compatible. If you play with the switches, many interesting details will be uncovered. Full description:…

    2022 · benchmark.clickhouse.com · its alternatives →

  16. 16

    With the OpenDataDiscovery Platform, you can collect metadata from any data source, regardless of format or location. This powerful platform provides data discovery, observability, and trust for your entire data pipeline.

    2022 · opendatadiscovery.org · its alternatives →

  17. 17

    A practical book on Data Analysis with Rust Notebooks that teaches you the concepts and how they’re implemented in practice.

    2020 · datacrayon.com · its alternatives →

  18. 18

    The Open Source Data Science Masters. Contribute to datasciencemasters/go development by creating an account on GitHub.

    2014 · github.com · its alternatives →

  19. 19

    Hi HN! A few months ago, EntICOnc shared a blog post I wrote about using Rust from the perspective of a Python developer [0] which was well received, with some positive as well as mixed feedback. One thing I didn’t foresee would happen, is this little post getting a lot of attention, especially from the data engineering crowd which I consider myself a part of. Looking at the feedback, it was clear that there are some resources missing for a specific use case for which I think Rust is a perfect candidate: Data Engineering. Currently, Data Engineering is dominated by languages like Java, Scala…

    2023 · datawithrust.com · its alternatives →

  20. 20

    (educational) build your own disk based KV store. Contribute to avinassh/py-caskdb development by creating an account on GitHub.

    2022 · github.com · its alternatives →

  21. 21

    Hi HN, I’ve been a data engineer for over a decade and have slowly been working on a way for 1 person to run a data platform (mostly to automate my job) When I was starting, I found the wide range of tools required to build data products overwhelming. Infrastructure setup, app deployment, pipeline development, creating metrics, dashboards and finally, integrating ML into product. No wonder companies have 100s of people working on this. So last year I quit the best job in the world to figure this out. I’d like to introduce Phidata: Building Blocks for Data Engineering It works like this: 1.…

    2023 · docs.phidata.com · its alternatives →

  22. 22

    No-code visual data transformation software tool for Windows & Mac. Download a free trial.

    2019 · easydatatransform.com · its alternatives →

  23. 23
    Parse.dev▲134

    Your AI powered data analyst

    2023 · its alternatives →

  24. 24
    Etleap▲70

    Build your AWS Redshift data warehouse without coding

    2015 · etleap.com · its alternatives →

Also compare

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →