Commerce · alternatives · 2026
24 alternatives to I simulated Bigtable in BigQuery as a Type 2 SCD
I hit a wall recently where we needed to design a data store that can both (1) ingest schema-less updates at scale and (2) allow for large analytical queries. GCP native doesn't have something that does both of these out-of-the-box, so we kinda hacked our own solution by replicating updates from Bigtable into a Type 2 SCD table in BigQuery. i couldn't find many resources online on this sort of trick when I was building it out, so I wrote up this blog with the details. Hope it's helpful and curious if anyone has used or built something similar. Will stick around for comments, happy to answer…
This is a technical guide documenting how to replicate Bigtable data into BigQuery using Type 2 Slowly Changing Dimensions to handle both schema-less data ingestion at scale and large analytical queries. It's for… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes.
- 1
A fast, fully managed, scalable NoSQL database service
2015 · cloud.google.com · its alternatives →
- 2OS
2019 · mprove.io · its alternatives →
- 3
A highly configurable Google Cloud Dataflow pipeline that writes data into Google Big Query table from Pub/Sub - bomboradata/pubsub-to-bigquery
2017 · github.com · its alternatives →
- 4DD
Gleb, Alex, Erez and Simon here – we are building an open-source tool for comparing data within and across databases at any scale. The repo is at https://github.com/datafold/data-diff, and our home page is https://datafold.com/. As a company, Datafold builds tools for data engineers to automate the most tedious and error-prone tasks falling through the cracks of the modern data stack, such as data testing and lineage. We launched two years ago with a tool for regression-testing changes to ETL code…
2022 · its alternatives →
- 5
Hi HN! We're Evgeny and Arjun, and we’re building a better way to do analytics with Postgres. We love Postgres for its simplicity, power, and rich ecosystem. But engineers have to still get bogged down with heavyweight and expensive OLAP systems when connecting an analytics data stack. Postgres is amazing at OLTP queries, but not for OLAP queries (large data scans and aggregations). Even in this case, we’ve still heard from countless scaling startups that they still try to use only a read replica to run analytics workloads since they don’t want to deal with the data engineering complexity of…
2024 · github.com · its alternatives →
- 6
A Go SQL query builder and struct mapper. Contribute to samonzeweb/godb development by creating an account on GitHub.
2016 · github.com · its alternatives →
- 7
TABLUM.IO▲159Turn CSV, XML & JSON into a live analysis-ready SQL database
2023 · tablum.io · its alternatives →
- 8
Hey! I'm Andrei. I got frustrated by how people tend to build overcomplicated backend systems, being "motivated" by big tech case studies and popular books. So, I started exploring lean architecture, and building my digital garden of ideas, approaches and data that align with this direction. Here I want to present one of the tools – Sizing tool for PostgreSQL. I've benchmarked PostgreSQL on different EC2 instances and disks, with different initial data sets to see performance that these instances can give you. And I've built a tool to visualize this data, which I welcome you to explore. So,…
Jul 2026 · postgres.saneengineer.com · its alternatives →
- 9
I've always been curious about how SQL engines actually work. So I built a minimum viable SQL engine in Go. - Supports CSV files as tables - Supports SELECT, FROM, WHERE, LIMIT It's very simple: 1. Parses query string 2. Converts it into an AST representation 3. Executes the query against the CSV 4. Returns the results
2024 · github.com · its alternatives →
- 10
A grid library for instant big data processing
2022 · datatable.dev · its alternatives →
- 11HA
Hi all, we recently open sourced the first version of Hashquery, a Python library which lets you model analytics, DRY up common logic, and execute it against a database or warehouse. We were originally rendering SQL directly for all our queries, but that spiraled out of control with more complex analysis; the SQL needed to be changed sporadically for each new database dialect (BigQuery, Redshift, Aethena, Postgres, etc etc) and the SQL fragments were very challenging to reuse (and so fragments were copy-pasted all over). ~~~ Advantages we think it has over writing SQL by hand: - Queries are…
2024 · hashquery.dev · its alternatives →
- 12
DataBackfill▲131Backfill your historical GA4 data to BigQuery
2024 · databackfill.com · its alternatives →
- 13IM
2017 · xyz.insightdataengineering.com · its alternatives →
- 14
Move marketing data to BigQuery warehouse, no code required
2023 · whatagraph.com · its alternatives →
- 15
LBADD: An experimental, distributed SQL database. Contribute to tomarrell/lbadd development by creating an account on GitHub.
2019 · github.com · its alternatives →
- 16
[Deprecated] Load data from Kafka to any data warehouse. BQ sink is being supported in Firehose now. https://github.com/odpf/firehose - gojekfarm/beast
2019 · github.com · its alternatives →
- 17
OpenSheet▲86Hi folks. I've been doing some experiments on how LLMs could get more handy in the day to day of working with files (CSV, Parquet, etc). Earlier last year, I built https://datakit.page and evolved it over and over into an all in-browser experience with help of duckdb-wasm. Got loads of feedbacks and I think it turned into a good shape with being an adhoc local data studio, but I kept hearing two main things/issues: Why can't the AI also change cells in the file we give to it? Why can't we modify this grid ourselves? So besides the whole READ and text-to-SQL flows, what seemed…
Feb 2026 · opensheet.app · its alternatives →
- 18
A look at modern database approaches and how Citus scales PG
2016 · softwareengineeringdaily.com · its alternatives →
- 19DS
I played around with GPT-3 to build this demo. Select a public BigQuery dataset and describe your query in natural English, then edit the generated SQL as needed and execute it. https://app.tabbydata.com/sql-assistant-demo
2021 · its alternatives →
- 20GA
I wanted to build a persistent message queue based on SQLite, because that's what I'm using for my main state anyway. This gives me ACID across state and messaging, which is nice! I've been inspired by the terminology of AWS SQS for this, but it's obviously much simpler. Maybe you can use it too. :)
2024 · goqite.com · its alternatives →
- 21SD
Hi HN, I'm Dean, the non-technical co-founder of SchemafreeSQL. We released our beta version about a year ago. You can see the HN Post here https://news.ycombinator.com/item?id=30291592 Today I am pleased to announce our initial release of our hosted SFSQL offering. A major concern from the HN Beta feedback we received was our longevity. Being a hosted database solution I can see why. We took that to heart and re-engineered our offering. We de-risked it by minimizing the amount of infrastructure under our management, fly.io manages customer's dedicated SFSQL endpoints,…
2023 · schemafreesql.com · its alternatives →
- 22
Hey HN! I've been working on Skytable since 2020 and after several iterations from a simple K/V store, we've walked the path to this release. The goal of Skytable is to deliver a solid foundation for building data intensive applications. Skytable's primary goal is performance and scale. Even with a query language it can outperform K/V stores which use simple commands (benchmarks will be shared in another post). Several implementations in Skytable (especially around query evaluation and execution) are fundamentally different from SQL and even NoSQL counterparts and there are some…
2023 · skytable.io · its alternatives →
- 23
- 24
I built DDL to Data after repeatedly pushing back on "just use production data and mask it" requests. Teams needed populated databases for testing, but pulling prod meant security reviews, PII scrubbing, and DevOps tickets. Hand-written seed scripts were the alternative slow, fragile, and out of sync the moment schemas changed. Paste your CREATE TABLE statements, get realistic test data back. It parses your schema, preserves foreign key relationships, and generates data that looks real, emails look like emails, timestamps are reasonable, uniqueness constraints are honored. No setup, no…
Jan 2026 · ddltodata.com · its alternatives →
Also compare
- Google Cloud Bigtable alternatives
- Open-Source Business Intelligence for BigQuery – Looker Alternative alternatives
- Connect Pub/Sub to BigQuery with an open source Dataflow pipeline alternatives
- Data Diff – compare tables of any size across databases alternatives
- BemiDB – Postgres read replica optimized for analytics alternatives
- Godb is a simple Go ORM for PostgreSQL, MySQL, SQLite and SQL Server alternatives
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →