Alternatives
Products that do what DataForge Core – Pure functional SQL data transforms does
Hey HN, A few friends and I have spent the past 6 years or so developing a way to write data transformation code in a way that can easily adapt to changes in logic or data elements both upstream and downstream without the need major refactoring, regression testing, or re-orchestration. We decided to open source the project about two months ago and published a CLI tool after we realized how big of a task it was to take on incumbents like stored procedures, dbt, and psyspark. It is early days for our community and we are looking to grow and engage with others to poke holes and contribute…
- 1PI
Hi HN! I’m Alex from Parabola (https://parabola.io). Parabola is a visual programming tool for creating functional data flows that everyone can use. It’s entirely drag-and-drop, handles data sizes much larger than a traditional spreadsheet, calculates everything live, and can run your flows on a schedule of your choosing. I used to work in strategy consulting, doing data analytics for SMBs and Fortune 500 companies. The amount of time wasted on menial tasks was astounding. Things like cleaning data, generating custom reports, creating human workflows to solve shortcomings in third…
2018 · parabola.io
- 2DC
2017 · simonwillison.net
- 3DO
2021 · dbgate.org
- 4
- 5
- 6DS
2019 · dbml-lang.org
- 7DM
2014 · github.com
- 8WM
Hey HN — We're excited to share Trellis — a snowflake for unstructured data. We've built an AI engine that turns unstructured data into structured SQL-format based on the schema you define in natural language. We spent a lot of time building ML infrastructure and realized that most data warehouses and data pipelines are not designed for unstructured data (documents, PDFs, calls). While something like a Vector database and RAG are great at search tasks, they really struggle with aggregation and SQL type queries such as 1. How many emails in the past 6 months contain complaints about the…
2024 · demo.runtrellis.com
- 9PA
2021 · github.com
- 10AO
A couple of years ago, we had an interesting idea. When a development team within an organization consists of around 10 members or fewer, controlling the risks associated with database changes might be achieved through trust and real-time communication. However, as the team grows, the responsibilities within the team become more specialized. Imagine a scenario where different branches of the business exist, each with its own set of developers, team leads, testers, testing leads, DBAs, and more. Relying solely on traditional communication methods becomes increasingly challenging when it comes…
2023 · github.com
- 11AI
Hi HN, I’m Sean, the founder of Ascend.io (https://www.ascend.io). I’m really excited to post here and announce the launch of Ascend.io, a radical new way of designing, scaling, and automating data pipelines. Ascend is the result of nearly 4 years of development effort for a team that is now 30-strong, and I would love for you to give it a test drive and let me what you think. I’ve felt this pain since I wrote my first MapReduce in 2004 (using Sawzall @ Google), and in the 15 years since, things have not improved at the pace of other parts of the technology ecosystem. When I went…
2019
- 12ZO
Hello HN, I am Sonal, a data consultant from India. For the past few months(and years!), I have been working on an entity resolution tool to build a single source of truth for customers, suppliers, products and parts. Here is a short demo of Zingg in action https://www.youtube.com/watch?v=zOabyZxN9b0 As a data consultant, I often struggled to build unified views of core entities on the datalake and the warehouse. Data spread across different systems has variations and consistencies making Customer 360, KYC, AML, segmentation, personalization and other analytics difficult. As I…
2022
- 13RO
As a software engineer, it's frustrating to see those who can't code stuck with spreadsheets as their most powerful data tool. This is especially true when there is such a thin layer that exists to access arbitrarily powerful data and AI/ML tools (typically just Python and pandas/SQL). I built Regrail last year to demonstrate a visual, procedural tool that abstracts the primitives of data engineering. It uses a block-based editor that allows users to see the changes they are making to tables step by step. You can think of it like a visual DAG builder. I believe that data literacy…
2023 · regrail.io
- 14GA
Hello HN! These last few months I've been working on my first open source project: an embedded database written in pure-go. That took me some months, as I had to learn how to deal with such large packages. Until then, all packages I had made were quite small an did not require much. I usually did not have to worry about things like allocation optimization and instance pools until This project. It started when I wanted to make a port of a tool to a TUI environment. I'm actually used to working with TUIs in golang, so that was my language of choice. The tool I wanted to port is written in…
Feb 2026
- 15SS
I'm a couple years late to the party but DuckDB is blowing my mind. I couldn't find an good embedded DuckDB stream processing solution so I hacked my own, calling it SQLFlow: https://github.com/turbolytics/sql-flow SQLFlow enables writing stream transformations in pure sql, executed using DuckDB. The goal was to create a lightweight, performant stream processing engine using pure SQL transformations, DuckDB didn't disappoint! I'd love your feedback, feature requests, impressions, or just comments. I'd love to turn this into a stable, usable project that people are…
2023 · github.com
- 16GC
Copilot has proven quite handy as a "smarter Intellisense" tool for me. It often accurately predicts the arguments I need for functions, including their types. Occasionally, when I start typing `a.map(`, it automatically fills in the transformation code I intended to write. The key enabler is the ability to ignore most suggestion. They don't get in my way. The simpler the task I'm working on, the higher the likelihood it gets it right. This is where I get the most benefit from Copilot, as I already understand what I'm coding, why I'm coding it, and how it should appear. Copilot sometimes…
2024
- 17IB
Hey HN! Over the past few weeks, I’ve been working on DataBridge, an open-source solution for data ingestion and querying across text, PDFs, images, and videos. In our latest update, we’ve added a fully local deployment option: - No internet required – Runs entirely offline. - Customizable Models – Supports any LLM and embedding model via Ollama (with options for any other private providers) - Extensibility – You can plug in your own models or tools easily. This local-first approach ensures better privacy, security, and flexibility, especially for teams dealing with sensitive data. You can…
2025 · github.com
- 18TD
Hey Everyone, I built https://querysimple.com, its a tool that allows you to transform data directly in the PostgreSQL with just SQL skills. - Creation of tables - Data syncs - Error and status reporting - Scheduling queries All of this is taken care by the application. You just write your select SQL queries. I would love some feedback from the community on the tool. You can watch a video demo, there is no need to signup. Of course, if you want to signup and give it a try that would be great!
2023 · querysimple.com
- 19TF
Hi All! We've spent a few months on getting an MVP together, and would love to get some feedback on whether this tool meets you needs. Here is a link to a demo video: https://www.youtube.com/watch?v=FBLi3vdKB-4&feature=emb_rel_pause Here's a link to our website: https://www.structure.rest And here's a blog article, I published today in the space: https://www.structure.rest/blog/using-a-data-analytics-stack-to-gain-business-insights
2020
- 20PA
Hey everyone! Like many data analysts and engineers, I love SQL and the dbt ecosystem. So it bothers me that we have to use separate tools for product analytics. We do our transformations, BI work, and ad-hoc queries in SQL, but when it's time to look at funnels and flows, we have to use (and procure) a separate platform like Mixpanel or Amplitude. This dbt package is a (very rough) start at fixing that. With it, you can create event streams and run funnel analyses via dbt[0]. More features like flows and retention are coming soon! But I'm mostly curious how you all are doing product…
2022 · github.com
- 21KA
2017 · github.com
- 22GA
I started working on this back in 2019, mostly as a design idea. Over the last month I made a big push to make it 100% usable and replace C# in all my personal projects. I now feel it's solid enough to gather feedback from other developers. If you take it for a spin, I hope you enjoy it and send your thoughts!
Jun 2026 · davidobando.github.io
- 23AV
Hi everyone, I’d like to introduce Amphi, a free and source-available visual data transformation tool. Amphi is a low-code tool designed for data preparation, manipulation and ETL tasks, whether you're working with files or databases, and it supports a wide range of data transformation operations. The main difference from tools like Alteryx or Knime is that Amphi is based on Python and generates native Python code (pandas and DuckDB) that you can export and run anywhere. You also have the flexibility to use any Python libraries and integrate custom code directly into your pipeline. It is…
2024 · github.com
- 24AI
Hi HN, We are launching Denormalized (www.denormalized.io), a serverless real-time data platform built on Kafka and Pinot. We felt a bit burnt out by the sheer developer toil we faced when building application around the real-time data stack and set out to create a platform to allow small teams to be very productive with realtime data without having to glue together an elaborate system to serve real-time as well as time series queries. Here is our motivating post. Would appreciate any and all feedback.
2023 · teamdenormalized.substack.com
Ranked by how close each launch is in meaning, then by votes. Refine with a description →