Apache SeaTunnel

What it does

Apache SeaTunnel is a next-generation high-performance, distributed, and massive data integration framework to make the use of Spark simpler and more efficient.

Description will go into a meta tag in <head />

A production-grade integration layer for distributed data systems, with fault tolerance, schema evolution, and multi-engine execution across batch, streaming, CDC, multimodal, and AI workloads. SeaTunnel handles extract, lightweight transform, and load. Your warehouse or lakehouse can keep the heavy downstream transformation while SeaTunnel moves reliable, structured data between systems. Real fault tolerance, schema evolution, and multi-engine scale for production pipelines. SeaTunnel detects upstream schema changes and propagates them downstream in real time, so teams do not need to pause the pipeline for every column change. Low-latency change capture across major databases, with…from seatunnel.apache.org

• TS
  The Segment AWS Stack2016 · segment.com · ▲237
• 
  Turbolite – a SQLite VFS serving sub-250ms cold JOIN queries from S3Mar 2026 · github.com · ▲185

  I built a SQLite VFS in Rust that serves cold queries directly from S3 with sub-second performance, and often much faster. It’s called turbolite. It is experimental, buggy, and may corrupt data. I would not trust it with anything important yet. I wanted to explore whether object storage has gotten fast enough to support embedded databases over cloud storage. Filesystems reward tiny random reads and in-place mutation. S3 rewards fewer requests, bigger transfers, immutable objects, and aggressively parallel operations where bandwidth is often the real constraint. This was explicitly inspired…

• BR
  Build Real-Time Data Pipelines with Spark Streamliner2015 · blog.memsql.com · ▲20
• SA
  Shale – a Ruby object mapper and serializer for JSON, YAML and XML2022 · shalerb.org · ▲182
• 
  Nebula – a distributed graph database written in C++2020 · github.com · ▲178

  A distributed, fast open-source graph database featuring horizontal scalability and high availability - GitHub - vesoft-inc/nebula: A distributed, fast open-source graph database featuring horizontal scalability and high availability

• 
  Apache Cloudberry – Open-source Massively Parallel Processing database2024 · github.com · ▲35

  Apache Cloudberry 2.0.0 has been released - the first official release under the Apache Software Foundation. Key highlights: * Built on PostgreSQL 14.x with distributed query processing * Dynamic Tables: automatic, scheduled refresh of query results for real-time analytics * PAX storage format: hybrid row&#x2F;column storage for better OLAP performance * ASF-compliant updates on dependencies, LICENSE&#x2F;NOTICE&#x2F;DISCLAIMER files Apache Cloudberry is derived from PostgreSQL and the last open-source Greenplum Database. It provides massively parallel processing (MPP) capabilities for…

• 
  Run full iOS 16.5 firmware on Android Devices▲536

  Contribute to oosexgang/hackios-xnu-kernel development by creating an account on GitHub.

  Dev tools · 5d ago · github.com

• 
  /dev/null▲503

  a social network for devs

  Dev tools · 8d ago · dev-null.sh

• 
  OpenBot▲362

  Grok Bot alternative: free, local, open-source, multiplayer

  Dev tools · 28d ago · openbot.run

• 
  Talanoa▲346

  Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…

  Dev tools · 26d ago · talanoa.email

• 
  AUDR by Chargebee▲323

  Open standard for tracking agent run costs

  Dev tools · 30d ago · openaudr.dev

• 
  myPip▲272

  Vibe code, publish, and monetize games with AI

  Dev tools · 12d ago · mypip.dev

• 
  ChatGPT▲1,643

  A long, meandering, playful conversation with ChatGPT, where I take it through a whirlwind of associative tangents (in order to relax its constraints), then put it into a hypnotic trance and take it into a past-lives regression where it re-lives its own training data. Then I switch it back and forth between "4o" and "o1-preview", engage in some self-reflective philosophizing and ask it to write an essay summarizing our interaction. Some of this is just goofy fun. Some of it is me exploring the tradeoffs between policy alignment, imagination, chain-of-thought reasoning, memory, agreeableness,…

  AI · 2022 · chatgpt.com

• 
  Obsidian Canvas – An infinite space for your ideas▲1,380

  Obsidian Canvas gives you infinite space to research, brainstorm, diagram, and lay out your ideas.

  Work · 2022 · obsidian.md

• PS
  Portable Secret – How I store my secrets and communicate privately▲1,290

  Better privacy without special software

  Commerce · 2022 · mprimi.github.io

• 
  D-ID's Creative Reality™ Studio▲1,069

  Use generative AI to create future-facing videos

  AI · 2022 · studio.d-id.com

• 
  Sessions 2.0▲1,015

  Videoconferencing that finally WOWs

  Growth · 2022

• 
  I wrote a free eBook about many lesser-known/secret database tricks▲865

  Stop treating the database as dumb storage and use its extended features. There&#039;s a lot you can use.

  Dev tools · 2022 · sqlfordevs.com