Alternatives
Products that do what The Canada census data in a SQLite file; advice appreciated does
This is niche, I'll admit. I needed to look through the latest census data, but it was exported as multiple multi-gigabyte bespoke latin1-encoded CSV files. Pandas, Polars, and SQLite's CSV import tool weren't much help, so I shelved the project until recently, when I started taking a SQLite course online. I picked it up again, normalized the data, and now there's a database that can be queried through a SQL view that matches the headings in the original CSVs. I'm proud of the script I created to export the data, as well as automatically compress the artifact, make the diagrams and…
- 1CE
Hello Hacker News! We're a team of YC founders (Meldium W13, Draft S11, TapEngage S11) launching something new (https://www.getcensus.com). How many times has your business team asked you to generate yet another CSV file, write a ”quick report” in SQL, or send some custom data to a terrible API (looking at you Marketo)? We’ve built a product that connects directly to your data warehouse and syncs into apps like Salesforce, Customer.io and even Google Sheets. In fact, your business teams won’t even need to rely on engineering to manage all these pipelines. The tech stack for…
2020
- 2WW
2021 · superintendent.app
- 3
We have been using graph DBs more and more at work. I found them painful to work with locally and decided to try and build something better.
12d ago · github.com
- 4UC
Paste in my prompt to Claude Code with an embedded API key for accessing my public readonly SQL+vector database, and you have a state-of-the-art research tool over Hacker News, arXiv, LessWrong, and dozens of other high-quality public commons sites. Claude whips up the monster SQL queries that safely run on my machine, to answer your most nuanced questions. There's also an Alerts functionality, where you can just ask Claude to submit a SQL query as an alert, and you'll be emailed when the ultra nuanced criteria is met (and the output changes). Like I want to know when somebody posts about…
Dec 2025 · exopriors.com
- 5SQ
Part of the workflow for building my website is the generation of a table in tab-separated column format (.tsv). The source data is found in four other .tsv files. I use an SQLite query to perform a 4-way join and write out the new table. For convenience, I wrote a script that encapsulates the query inside a Bash function. The example below illustrates this technique. repertoire() { pushd $CMM_SOURCES/_data sqlite3 <<EOS .headers on .mode tabs .import category.tsv category .import composition.tsv composition .import concert.tsv concert .import program.tsv program .once repertoire.tsv…
2021
- 6
- 7
- 8
- 9
- 10AW
2016 · alphasheets.com
- 11
- 12
- 13SD
a fast zero-copy sqlite implementation only for dumping the contents of a sqlite3 file
Oct 2025 · github.com
- 14ST
2016 · github.com
- 15DY
Hey HN! I'm open-sourcing DataKit today. GitHub: https://github.com/datakitpage/datakit Live demo: https://datakit.page DataKit is a browser-based data analysis platform that processes multi-gigabyte files (CSV, Parquet, JSON, Excel) entirely client-side using DuckDB-WASM. Your data never leaves your browser. What it does: • Process large files (tested up to 20GB) without any server • Full SQL interface powered by DuckDB compiled to WebAssembly • Python notebooks via Pyodide for data science workflows • Connect to remote sources (PostgreSQL, MotherDuck, S3) with…
Dec 2025 · github.com
- 16DQ
What started as a Claude Code experiment turned into a browser-native SQL workbench I now use daily. Runs DuckDB WASM entirely in your browser. No backend, no installation, no signup. - Query local files (CSV, Parquet, Excel) – data never leaves your machine - Handles 100M+ rows, 50GB+ files in a browser tab - Full UI: Monaco editor, schema explorer, spreadsheet-style results grid - Share SQL via URL – anyone can run your query instantly - BigQuery connector built-in (Snowflake coming) v0.2 – actively developing. Feedback welcome. GitHub (MIT):…
Dec 2025 · sql.dbxlite.com
- 17XC
xsql is an open-source Rust CLI + TUI for converting SQL schema DDL between database dialects. Instead of text-based rewrites, it parses CREATE TABLE statements into a small intermediate representation (IR), then emits equivalent SQL for the target dialect. This makes conversions safer, testable, and easier to extend. It supports single-file and recursive folder conversion, includes a no-typing interactive TUI, and recently added an experimental IR v2 with constraint support and JSON output for CI and tooling use. Feedback is very welcome, especially on schema portability and IR design.
Dec 2025 · github.com
- 18MS
Hey HN, I’m the author. I built Misata because existing tools (Faker, Mimesis) are great for random rows but terrible for relational or temporal integrity. I needed to generate data for a dashboard where "Timesheets" must happen after "Project Start Date," and I wanted to define these rules via natural language. How it works: LLM Layer: Uses Groq/Llama-3.3 to parse a "story" into a JSON schema constraint config. Simulation Layer: Uses Vectorized NumPy (no loops) to generate data. It builds a DAG of tables to ensure parent rows exist before child rows (referential integrity).…
Dec 2025 · github.com
- 19
Import CSV data into kintone subtables with field mapping
May 2026 · takumi-dev.lemonsqueezy.com
- 20ST
Hey HN! I've been building CSV editors for 15 years. This is my third rewrite, and I think I finally got it right. Key features: - Excel-like operation for intuitive use - Equipped with basic to advanced tools necessary for handling CSV - Supports various formats and character encodings. Can handle CSVs with different column counts - Cross-platform (Windows/Mac, Linux coming soon) - Opens 100MB files in 1.6 seconds (12x faster than Excel) Tech stack: Tauri (Rust + React/TypeScript/TailwindCSS) Would love feedback from anyone dealing with large datasets daily! Website:…
2025 · smoothcsv.com
- 21SE
Introducing sqlxport: export SQL query results to Parquet/CSV in seconds — and optionally upload to S3 or MinIO. Works with PostgreSQL & Redshift CLI-first, cloud-friendly Great for data pipelines and engineers
2025 · github.com
- 22DQ
There are a lot of APIs that provide access to these types of data, but there were not any (as far as we're aware of) tools & services that provide access to query the raw data directly for analytical purposes. We get the data across different sources and clean, schematize them in a PostgreSQL databases so folks can query/analyze the data directly. We have ~100 tables of data across stocks, ETFs, economic indicators, US/international census data and plan to keep adding more. More information on the tables are available at https://docs.wizdata.io Access to all of the data…
2022 · wizdata.io
- 23HP
I built this because I was tired of scrolling through hundreds of lines of AWS CLI JSON output just to find instance status. hawk brings pandas-like operations (select, group_by, aggregations) to CLI with unified syntax across JSON/YAML/CSV. Key features: - Instant data structure overview with `| info` - Same query syntax for all formats - Built in Rust for speed and single-binary distribution Would love feedback from the community!
2025 · github.com
- 24IB
I got tired of the overhead required to run even a simple data analysis - cloud setup, ETL pipelines, orchestration, cost monitoring - so I built a fully local data-stack/IDE where I can write SQL/Py, run it, see results, and iterate quickly and interactively. You get data lake like catalog, zero-ETL, lineage, versioning, and analytics running entirely on your machine. You can import from a database, webpage, CSV, etc. and query in natural language or do your own work in SQL/Pyspark. Connect to local models like Gemma or cloud LLMs like Claude for querying and analysis. You…
Apr 2026 · stream-sock-3f5.notion.site
Ranked by how close each launch is in meaning, then by votes. Refine with a description →