
data-diff
Compare tables of any size across databases
What it does
Data Diff is an open-source package that can be run in a CLI or wrapped into any data orchestrator such as Airflow, Dagster, etc. Compare datasets quickly (seconds/minutes) at a large (millions/billions of rows) scale across different databases.
Does a similar job
all alternatives →- DDData Diff – compare tables of any size across databases2022 · ▲127
Gleb, Alex, Erez and Simon here – we are building an open-source tool for comparing data within and across databases at any scale. The repo is at https://github.com/datafold/data-diff, and our home page is https://datafold.com/. As a company, Datafold builds tools for data engineers to automate the most tedious and error-prone tasks falling through the cracks of the modern data stack, such as data testing and lineage. We launched two years ago with a tool for regression-testing changes to ETL code…

- PDPDF-Diff - Visualize any differences between two PDFs2022 · github.com · ▲169
- ABA benchmark for analytical databases (Snowflake, Druid, Redshift)2022 · benchmark.clickhouse.com · ▲137
I created a web page to compare different analytical databases (both self-managed and services, open-source and proprietary) on a realistic dataset. It contains 20+ databases, each with installation and data loading scripts. And they can be compared to each other on a set of 43 queries, by data load time or by storage size. There are switches to select different types of databases for comparison - for example, only MySQL compatible or PostgreSQL compatible. If you play with the switches, many interesting details will be uncovered. Full description:…
- DIDiff.io2015 · diff.io · ▲194

More dev tools this month
the category →



OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.
Dev tools · 4d ago · opentrailpaper.com

Lettertrace▲375Track your AI visibility for free (using your own API keys!)
Dev tools · 28d ago · lettertrace.com
Source: Product Hunt launch ↗
Launched alongside, June 2022
the whole month →- AF
I've seen some interests in (simulation) video games here on HN so I thought I'd share a short version of our story. More than 6 years ago, me and my friend from university were playing around with an idea of making a game we always wanted to play. We worked on it on weekends but the progress was quite slow, especially due to so many dead ends and wasted effort. Eventually however, we solidified our direction and decided to take the risk to resign from our well paid SWE jobs and work on it full time. It took more than a year but yesterday we have finally released it on Steam:…
Life & fun · 2022
- AC
Life & fun · 2022 · benoitessiambre.com
- IS
Life & fun · 2022 · github.com


