nowfound

Dev tools · June 23, 2022

data-diff

Compare tables of any size across databases

What it does

Data Diff is an open-source package that can be run in a CLI or wrapped into any data orchestrator such as Airflow, Dagster, etc. Compare datasets quickly (seconds/minutes) at a large (millions/billions of rows) scale across different databases.

Does a similar job

all alternatives →
  • DD
    Data Diff – compare tables of any size across databases2022 · ▲127

    Gleb, Alex, Erez and Simon here – we are building an open-source tool for comparing data within and across databases at any scale. The repo is at https://github.com/datafold/data-diff, and our home page is https://datafold.com/. As a company, Datafold builds tools for data engineers to automate the most tedious and error-prone tasks falling through the cracks of the modern data stack, such as data testing and lineage. We launched two years ago with a tool for regression-testing changes to ETL code…

  • data-diff2022 · ▲10

    Efficiently diff data in or across relational databases

  • PD
  • AB
    A benchmark for analytical databases (Snowflake, Druid, Redshift)2022 · benchmark.clickhouse.com · ▲137

    I created a web page to compare different analytical databases (both self-managed and services, open-source and proprietary) on a realistic dataset. It contains 20+ databases, each with installation and data loading scripts. And they can be compared to each other on a set of 43 queries, by data load time or by storage size. There are switches to select different types of databases for comparison - for example, only MySQL compatible or PostgreSQL compatible. If you play with the switches, many interesting details will be uncovered. Full description:…

  • DI
    Diff.io2015 · diff.io · ▲194
  • Diffchecker 2.02020 · ▲153

    Check the differences between two text files, images or PDFs

More dev tools this month

the category →
  • Dograh592

    The open source VAPI alternative

    Dev tools · 28d ago · dograh.com

  • Meridian530

    Don't let your work go unnoticed. Get promoted!

    Dev tools · 23d ago · meridiona.com

  • x1516

    Lovable for iPhone apps go from idea to App Store

    Dev tools · 14d ago · x1.new

  • OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.

    Dev tools · 4d ago · opentrailpaper.com

  • Nuphos380

    The AI-Native DevOps Workspace.

    Dev tools · 27d ago · nuphos.ai

  • Track your AI visibility for free (using your own API keys!)

    Dev tools · 28d ago · lettertrace.com

Source: Product Hunt launch

Launched alongside, June 2022

the whole month →