nowfound

Dev tools · July 2, 2024

DataForge Core – Pure functional SQL data transforms

Hey HN, A few friends and I have spent the past 6 years or so developing a way to write data transformation code in a way that can easily adapt to changes in logic or data elements both upstream and downstream without the need major refactoring, regression testing, or re-orchestration. We decided to open source the project about two months ago and published a CLI tool after we realized how big of a task it was to take on incumbents like stored procedures, dbt, and psyspark. It is early days for our community and we are looking to grow and engage with others to poke holes and contribute…

DataForge Core – Pure functional SQL data transforms launched on July 2, 2024 with 7 votes, #1,887 of 5,184 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 2 years on.

What it does

DataForge helps data teams write functional transformation pipelines by leveraging software engineering principles - dataforgelabs/dataforge-core

In the maker’s words, at launch

Hey HN, A few friends and I have spent the past 6 years or so developing a way to write data transformation code in a way that can easily adapt to changes in logic or data elements both upstream and downstream without the need major refactoring, regression testing, or re-orchestration. We decided to open source the…

Does a similar job

all alternatives →
  • We open sourced our entire text-to-SQL product2024 · github.com · ▲464

    Long story short: We (Dataherald) just open-sourced our entire codebase, including the core engine, the clients that interact with it and the backend application layer for authentication and RBAC. You can now use the full solution to build text-to-SQL into your product. The Problem: modern LLMs write syntactically correct SQL, but they struggle with real-world relational data. This is because real world data and schema is messy, natural language can often be ambiguous and LLMs are not trained on your specific dataset. Solution: The core NL-to-SQL engine in Dataherald is an LLM based agent…

  • I built an open-source data pipeline tool in Go2024 · github.com · ▲200

    Every data pipeline job I had to tackle required quite a few components to set up: - One tool to ingest data - Another one to transform it - If you wanted to run Python, set up an orchestrator - If you need to check the data, a data quality tool Let alone this being hard to set up and taking time, it is also pretty high-maintenance. I had to do a lot of infra work, and while this being billable hours for me I didn’t enjoy the work at all. For some parts of it, there were nice solutions like dbt, but in the end for an end-to-end workflow, it didn’t work. That’s why I decided to build an…

  • Transform Data Without Programming2019 · easydatatransform.com · ▲114

    No-code visual data transformation software tool for Windows & Mac. Download a free trial.

  • MetricFlow – open-source metric framework2022 · github.com · ▲98

    Hi HN community, I’m Nick, co-founder/CEO of Transform.co. I’m thrilled to share MetricFlow, an open-source metric creation framework: https://github.com/transform-data/metricflow MetricFlow strives to make what has historically been an extremely repetitive process, writing SQL queries on core normalized data models, much more DRY. MetricFlow consolidates the definitions for joins, aggregations, filters, etc., and programmatically generates SQL to construct data marts. You can think of it like LookML, but more powerful and ergonomic (and open source!). The project…

  • Write universally accessible SQL, not library-specific ORM wrapper APIs2021 · github.com · ▲112

    A pure ORM for writing native SQL queries yielding pure business objects - craigmichaelmartin/pure-orm

  • DBOSify – Drop-in Temporal replacement built on PostgresJun 2026 · github.com · ▲91

    Postgres-Backed Drop-in Temporal Replacement. Contribute to dbos-inc/dbosify-py development by creating an account on GitHub.

More dev tools this month

the category →
  • /dev/null▲489

    a social network for devs

    Dev tools · 3d ago · dev-null.sh

  • open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.

    Dev tools · 28d ago · github.com

  • Contribute to reladraw/reladraw development by creating an account on GitHub.

    Dev tools · 26d ago · github.com

  • OpenBot▲362

    Grok Bot alternative: free, local, open-source, multiplayer

    Dev tools · 23d ago · openbot.run

  • Talanoa▲346

    Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…

    Dev tools · 21d ago · talanoa.email

  • CoreSpeed▲332

    One MCP for everything your agents need: apps, memory, tools

    Dev tools · 29d ago · corespeed.io

Source: Show HN post ↗ · launch text quoted in part

Launched alongside, July 2024

the whole month →
  • Sugar detox app

    AI · 2024 · apps.apple.com

  • Mobbin 2.0▲1,657

    Discover real-world design inspiration

    Work · 2024 · mobbin.com

  • folk 3.0▲1,591

    The CRM for companies who care about people

    Dev tools · 2024 · folk.app

  • SuperGPT▲1,206

    Use ChatGPT on Google Sheets

    AI · 2024 · superjoin.ai

  • Many years ago, I made VJ softwares (to mix live visuals in clubs) for unexpected platforms like the Game Boy Advance, the Playstation 2 and the Raspberry Pi. This year, I’m back with a new web-app: Pikimov. Inspired by Photopea (a free Photoshop clone), I created this web-based motion design & video editor as an alternative to After Effects, to fill empty void. It's free, without signup, without cloud uploads (your files stay on your machine), and your projects are not used for AI models training.

    AI · 2024 · pikimov.com

  • Motiff▲1,147

    AI powered professional UI design tool

    AI · 2024 · motiff.com