Storing and Analyzing 160 billion Quotes in ClickHouse

What it does

Exploring efficient data storage and analysis for quant trading using ClickHouse. This article compares various storage solutions and demonstrates the impressive performance of ClickHouse for handling large-scale financial data. Every quant trader needs to store and analyze tick or aggregated data efficiently. This article explores various options for data storage and focuses on using ClickHouse for high-performance financial data analysis. Note: KDB and Shakti require learning a specific query language Q/K. This might be challenging, example query looks like this: ClickHouse started in Yandex (Russian Google) in 2012 and was mainly used to store analytics from the web data, this type of…from rafalkwasny.com

• 
  ClickHouse-local – a small tool for serverless data analytics2023 · clickhouse.com · ▲289

  Me with my friend Vitaly Ludvichenko made an experiment to combine ClickHouse server and client to make a self-contained program running a database engine and processing data without a server: https://github.com/ClickHouse/ClickHouse/pull/150 Development continued in the past 6 years, and now clickhouse-local becomes a swiss-army knife for data processing. Say "ffmpeg" for datasets and more. It can resemble textql, octosql, dsq, duckdb, trdsql, q, datafusion-cli, spyql, but has better capabilities and performance. Here is a tutorial:…

• 
  ClickHouse2016 · clickhouse.com · ▲12

  ClickHouse is a free analytic DBMS for big data.

• 
  A benchmark + latency sim for LLM db queries: ClickHouse / Postgres2025 · github.com · ▲12

  Performance comparison of ClickHouse vs PostgreSQL using LLM-style query patterns on realistic aircraft tracking data - GitHub - 514-labs/LLM-query-test: Performance comparison of ClickHouse vs PostgreSQL using LLM-style query patterns on realistic aircraft tracking data

• 
  Distributed Tracing Using OpenTelemetry and ClickHouse2021 · github.com · ▲105

  Open source APM: OpenTelemetry traces, metrics, and logs - uptrace/uptrace

• 
  GraphJSON – Easily log and analyze events using ClickHouse2022 · graphjson.com · ▲128

  Hi HN, My name is JR and I had a need for a simple analytics solution that allowed me to store (timestamp, json) logs and run SQL over them. It was hard to find the right solution. Solutions like Mixpanel and Amplitude optimized for particular report types. Whereas solutions like Snowflake, BigQuery, etc. required a lot of setup. I built GraphJSON to fit in the middle. I strived for the ease of use of tools like Mixpanel and Amplitude, but wanted to ensure affordances were built to support use cases that big data warehouses enable. Under the hood, GraphJSON is powered by ClickHouse. This…

• 
  ObsessionDB – We rebuilt ClickHouse infrastructure to cut our costs 50%Jan 2026 · obsessiondb.com · ▲12

  Hey HN, I'm Marc. I run Numia, a blockchain data company serving real-time APIs at near-petabyte scale. ObsessionDB is managed ClickHouse we built for ourselves that costs roughly 50% less than other managed options. Now we're launching it as a standalone service. We had the classic split: ClickHouse for real-time analytics APIs, BigQuery for data warehouse workloads. Data replicated between both, costs adding up. Managed ClickHouse worked but was too expensive to put our warehouse workload into. Self-hosted meant replica nodes doubling storage and waiting days to copy 25TB to new replicas.…

• 
  SimCity, but with Permits▲936

  A free city-building game in your browser. You are the mayor. You know what the city needs. Now get it past the zoning board, the neighbors, the appeals court and the next election.

  Life & fun · 3d ago · permit.petercai.com

• IV
  I've been paying for a rural Tanzanian's education for 10 years▲778

  Life & fun · 16d ago · tanzaniaeducationproject.org

• 
  Bigwords.page – Turn any screen into a sign. The URL is the app▲728

  Turn a phone, tablet or TV into a sign. Type a message and it fills the screen: welcome signs, timers, Wi-Fi passwords and more. No app, no account, free.

  Life & fun · 17d ago · bigwords.page

• 
  Guitoro, a virtual guitar you strum with your keyboard▲573

  Play a free virtual guitar online with your keyboard or by touch. Slow songs down and see every chord, string and strum. Acoustic, classic, electric and bass.

  Life & fun · 10d ago · guitoro.com

• 
  See *almost* any carriers phone settings▲432

  Carrier settings from iPhone, Pixel and Galaxy firmware, decoded and compared: APNs, VoLTE, 5G and Wi-Fi Calling per carrier, and what each build changed.

  Life & fun · 14d ago · carrierexplode.com

• 
  The whole Solar System and every tracked satellite, live in the browser▲407

  Life & fun · 24d ago · space.bl2.net

• 
  Wordware▲9,848

  Your tool for building AI agents with natural language

  AI · 2024 · wordware.ai

• 
  If YouTube had actual channels▲2,741

  If Youtube had actual channels.

  Life & fun · 2024 · ytch.xyz

• 
  Me.bot▲1,627

  The inspiring companion for your life

  AI · 2024 · me.bot

• 
  Upmetrics AI▲1,197

  Business plan & financial forecast using AI

  Work · 2024 · upmetrics.co

• 
  Jupitrr AI▲1,195

  Jupitrr AI turns raw talking videos into scroll-stopping content for coaches and consultants. Research, script, record, edit, and publish in one app.

  AI · 2024 · jupitrr.com

• 
  InstantDB – A Modern Firebase▲1,145

  Hey there HN! We’re Joe and Stopa, and today we’re open sourcing InstantDB, a client-side database that makes it easy to build real-time and collaborative apps like Notion and Figma. Building modern apps these days involves a lot of schleps. For a basic CRUD app you need to spin up servers, wire up endpoints, integrate auth, add permissions, and then marshal data from the backend to the frontend and back again. If you want to deliver a buttery smooth user experience, you’ll need to add optimistic updates and rollbacks. We do these steps over and over for every feature we build, which can…

  Dev tools · 2024 · github.com