nowfound

Work · June 7, 2020

Data Engineering Project for Beginners

Data engineering project for beginners, using AWS Redshift, Apache Spark in AWS EMR, Postgres and orchestrated by Apache Airflow.

Data Engineering Project for Beginners launched on June 7, 2020 with 12 votes, #1,032 of 4,317 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 6 years on.

Visit startdataengineering.com ↗Alternativestop 24% of June 2020

In plain words

Data Engineering Project for Beginners is a work resource launched in 2020 that teaches foundational data engineering concepts through hands-on projects. It's designed for people new to the field who want practical experience building data systems. The platform provides structured learning materials and project-based exercises to help beginners develop real-world skills in data engineering practices and tools.

written from the facts on this page · September 2026

From the sources

An actual data engineering project usually involves multiple components. Setting up a data engineering project while conforming to best practices can be highly time-consuming. If you are A data analyst, student, scientist, or engineer looking to gain data engineering experience but cannot find a good starter project. Wanting to work on a data engineering project that simulates a real-life project. Looking for a good project to get data engineering experience for job interviews. Set up Apache Airflow, Apache Spark, DuckDB, and Minio (OSS S3). Learn how to spot failure points in data pipelines and build systems resistant to failures. Learn how to design and build a data pipeline from business…from startdataengineering.com

Does a similar job

all alternatives →
  • Data Engineering Book – An open source, community-driven guideFeb 2026 · github.com · ▲251

    Hi HN! I'm currently a Master's student at USTC (University of Science and Technology of China). I've been diving deep into Data Engineering, especially in the context of Large Language Models (LLMs). The Problem: I found that learning resources for modern data engineering are often fragmented and scattered across hundreds of medium articles or disjointed tutorials. It's hard to piece everything together into a coherent system. The Solution: I decided to open-source my learning notes and build them into a structured book. My goal is to help developers fast-track their learning curve. Key…

  • IW
    I Wrote a Book on Java2024 · ▲586

    https://www.manning.com/books/data-oriented-programming-in-j... This book is a distillation of everything I’ve learned about what effective development looks like in Java (so far!). It's about how to organize programs around data "as plain data" and the surprisingly benefits that emerge when we do. Programs that are built around the data they manage tend to be simpler, smaller, and significantly easier understand. Java has changed radically over the last several years. It has picked up all kinds of new language features which support data oriented programming (records,…

  • naoNov 2025 · getnao.io · ▲498

    AI data IDE for 10x faster data work

  • I built an open-source data pipeline tool in Go2024 · github.com · ▲200

    Every data pipeline job I had to tackle required quite a few components to set up: - One tool to ingest data - Another one to transform it - If you wanted to run Python, set up an orchestrator - If you need to check the data, a data quality tool Let alone this being hard to set up and taking time, it is also pretty high-maintenance. I had to do a lot of infra work, and while this being billable hours for me I didn’t enjoy the work at all. For some parts of it, there were nice solutions like dbt, but in the end for an end-to-end workflow, it didn’t work. That’s why I decided to build an…

  • 1G
    1000 GitHub Data Science projects, now executable in 1 click2020 · cloud.blobcity.com · ▲125
  • A flow based data processing editor2021 · datablocks.pro · ▲188

    node-based editor for exploring, analyzing and transforming data without code

More work this month

the category →

Source: Show HN post ↗

Launched alongside, June 2020

the whole month →