nowfound

Dev tools · October 25, 2024

TO

Trench – Open-source analytics infrastructure

Hey HN! I want to share a new open source project I've been working on called Trench (https://trench.dev). It's open source analytics infrastructure for tracking events, page views, and identifying users, and it's built on top of ClickHouse and Kafka. https://github.com/frigadehq/trench I built Trench because the Postgres table we used for tracking events at our startup (http://frigade.com/) was getting expensive and becoming a performance bottleneck as we scaled to millions of end users. Many companies run into the same problem as us (e.g.…

Visit github.comAlternativestop 16% of October 2024

In plain words

Trench is an open-source analytics infrastructure built on ClickHouse and Kafka for tracking events, page views, and identifying users. It's designed for developers building applications that need to handle event tracking at scale. The tool addresses the performance and cost problems that arise when event data outgrows traditional relational databases like Postgres, offering a more efficient alternative for companies processing millions of events.

written from the facts on this page · September 2026

From the sources

In the maker’s words, at launch

Hey HN! I want to share a new open source project I've been working on called Trench (https://trench.dev). It's open source analytics infrastructure for tracking events, page views, and identifying users, and it's built on top of ClickHouse and Kafka. https://github.com/frigadehq/trench I built Trench because the Postgres table we used for tracking events at our startup (http://frigade.com/) was getting expensive and becoming a performance bottleneck as we scaled to millions of end users. Many companies run into the same problem as us (e.g. Stripe, Heroku: https://brandur.org/fragments/events). They often start by adding a basic events table to their relational database, which works at first, but can become an issue as the application scales. It’s usually the biggest table in the database, the slowest one to query, and the longest one to back up. With Trench, we’ve put together a single Docker image that gives you a production-ready tracking event table built for scale and speed. When we migrated our tracking table from Postgres to Trench, we saw a 42% reduction in cost to serve on our primary Postgres cluster and all lag spikes from autoscaling under high traffic were eliminated. Here are some of the core features: * Fully compliant with the Segment tracking spec e.g. track(), identify(), group(), etc. * Can handle thousands of events per second on a single node * Query tracking data in real-time with read-after-write guarantees * Send data anywhere with throttled and batched webhooks * Single production-ready docker image. No need to manage and roll your own Kafka/ClickHouse/Nodejs/etc. * Easily plugs into any cloud hosted ClickHouse and Kafka solutions e.g. ClickHouse Cloud, Confluent Trench can be used for a range of use cases. Here are some possibilities: 1. Real-Time Monitoring and Alerting: Set up real-time alerts and monitoring for your services by tracking custom events like errors, usage spikes, or specific user actions and sending that data anywhere with Trench’s webhooks 2. Event Replay and Debugging: Capture all user interactions in real-time for event replay 3. A/B Testing Platform: Capture events from different users and groups in real time. Segment users by querying in real time and serve the right experiences to the right users 4. Product Analytics for SaaS Applications: Embed Trench into your existing SaaS product to power user audit logs or tracking scripts on your end-users’ websites 5. Build a custom RAG model: Easily query event data and give users answers in real-time. LLMs are really good at writing SQL The project is open-source and MIT-licensed. If there’s interest, we’re thinking about adding support for Elastic Search, direct data integrations (e.g. Redshift, S3, etc.), and an admin interface for creating queries, webhooks, etc. Have you experienced the same issues with your events tables? I'd love to hear what HN thinks about the project.

More dev tools this month

the category →
  • Dograh592

    The open source VAPI alternative

    Dev tools · 25d ago · dograh.com

  • Meridian530

    Don't let your work go unnoticed. Get promoted!

    Dev tools · 20d ago · meridiona.com

  • x1516

    Lovable for iPhone apps go from idea to App Store

    Dev tools · 11d ago · x1.new

  • Open-source GTM skills for technical founders

    Dev tools · 29d ago · gtmcofounder.com

  • OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.

    Dev tools · 1d ago · opentrailpaper.com

  • Nuphos380

    The AI-Native DevOps Workspace.

    Dev tools · 24d ago · nuphos.ai

Launched alongside, October 2024

the whole month →
  • buzzabout1,267

    Audience insights from 1B+ online discussions in 2 mins

    AI · 2024 · buzzabout.ai

  • bolt.new1,233

    Prompt, run, edit & deploy full-stack web apps

    AI · 2024 · bolt.new

  • Feta1,217

    Run smarter stand-ups, build better products

    AI · 2024 · feta.io

  • Trag955

    AI code review companion

    AI · 2024 · usetrag.com

  • Turn Notion databases into portals & apps with no code

    Dev tools · 2024 · softr.io

  • One inbox for all your work discussions

    Work · 2024 · generalcollaboration.com