nowfound

AI · May 2, 2024

Hamilton's UI – observability, lineage, and catalog for data pipelines

Hey HN – Stefan and Elijah here from DAGWorks (http://dagworks.io/, YC W23). If you don’t remember us from our previous HN launch (https://news.ycombinator.com/item?id=35056903), we’re the authors of Hamilton (https://github.com/dagworks-inc/hamilton), an open-source library for building self-documenting, modular dataflows in python that works for data, ML, LLM pipelines, & even web-workflows. We’ve been developing this UI for a while and we’re excited to say we open-sourced it! It comes out of the box with the following capabilities, and…

Hamilton's UI – observability, lineage, and catalog for data pipelines launched on May 2, 2024 with 40 votes, #692 of 4,539 launches that month and more than 90% of that year's launches. The site was still online in September 2026, 2 years on.

Visit github.com ↗Alternativestop 15% of May 2024

In plain words

Hamilton's UI is an open-source interface for Python data pipelines that provides observability, data lineage, and artifact cataloging. Built to work with Hamilton's modular dataflow library, it requires minimal code changes to enable automatic execution tracking, code profiling, data summary statistics, and lineage visualization. The tool is designed for data engineers and ML practitioners building data, machine learning, LLM, and web-based workflows in Python.

written from the facts on this page · September 2026

From the sources

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does. - hamilton/ui at main · apache/hamilton

In the maker’s words, at launch

Hey HN – Stefan and Elijah here from DAGWorks (http://dagworks.io/, YC W23). If you don’t remember us from our previous HN launch (https://news.ycombinator.com/item?id=35056903), we’re the authors of Hamilton (https://github.com/dagworks-inc/hamilton), an open-source…

Does a similar job

all alternatives →
  • Hamilton, a Microframework for Creating Dataframes2021 · github.com · ▲64

    A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton - stitchfix/hamilton

  • Burr – A framework for building and debugging GenAI apps faster2024 · github.com · ▲94

    Hey HN, we're developing Burr (github.com/dagworks-inc/burr), an open-source python framework that makes it easier to build and debug GenAI applications. Burr is a lightweight library that can integrate with your favorite tools and comes with a debugging UI. If you prefer a video introduction, you can watch me build a chatbot here: https://www.youtube.com/watch?v=rEZ4oDN0GdU. Common friction points we’ve seen with GenAI applications include logically modeling application flow, debugging and recreating error cases, and curating data for testing/evaluation (see…

  • DA
    dstack – an open-source tool to build data applications easily2020 · ▲134

    Dear HN, I am Riwaj, the cofounder of dstack.ai (https://github.com/dstackai). A few months ago, we built an online service that allows users to publish data visualizations from Python or R. The idea was to build a tool that did not require additional programming or front-end development for publishing data visualizations. Such a code can be invoked from either Jupyter notebook, RMarkdown, Python, or R scripts. Once the data is pushed, it can be accessed via a browser. Open-sourcing dstack: During our customer discovery phase, we realized that dstack.ai should integrate a lot…

  • Mandala – Automatically save, query and version Python computations2024 · github.com · ▲100

    `mandala` is a framework I wrote to automate tracking ML experiments for my research. It differs from other experiment tracking tools by making persistence, query and versioning logic a generic part of the programming language itself, as opposed to an external logging tool you must learn and adapt to. The goal is to be able to write expressive computational code without thinking about persistence (like in an interactive session), and still have the full benefits of a versioned, queriable storage afterwards. Surprisingly, it turns out that this vision can pretty much be achieved with two…

  • You don't need to adopt new tools for LLM observability2024 · github.com · ▲102

    If you've built any web-based app in the last 15 years, you probably used something like Datadog, New Relic, Sentry, etc. to monitor and trace your app, right? Why should it be different when the app you're building happens to be using LLMs? So today we're open-sourcing OpenLLMetry-JS. It's an open protocol and SDK, based on OpenTelemetry, that provides traces and metrics for LLM JS/TS applications and can be connected to any of the 15+ tools that already support OpenTelemetry. Here's the repo: https://github.com/traceloop/openllmetry-js A few months ago we launched…

  • MD
    Mongo DB management and GUI, built using Electron2015 · mongotron.io · ▲88

    FIONA77 hadir sebagai forum gaming digital dengan pilihan permainan beragam, informasi menarik, dan peluang big profit yang mudah di dapatkan.

More ai this month

the category →
  • Video model that turns script into viral social media videos

    AI · 18d ago · spira.ai

  • The browser where Claude Code and Codex work beside you

    AI · 18d ago · rill.love

  • Kolibri is Aleph Alpha

    AI · 20d ago · tej.as

  • Paintings by AI models: programs run through a simulation of oil paint.

    AI · 21d ago · stillwet.art

  • Beam.win▲378

    Run AI agents on one Mac and use its windows on another

    AI · 5d ago · beam.win

  • Route requests to the right LLM for cost, latency & quality

    AI · 22d ago · fastrouter.ai

Source: Show HN post ↗ · launch text quoted in part

Launched alongside, May 2024

the whole month →
  • Voicenotes▲1,485

    AI note-taker that's truly intelligent

    AI · 2024 · voicenotes.com

  • Wegic▲1,179

    The first AI web designer & developer by your side

    Dev tools · 2024 · wegic.ai

  • Insighto▲1,108

    Ship features users want

    Growth · 2024 · insigh.to

  • Ivee▲1,087

    The B2B influencer marketing platform

    Growth · 2024

  • Waxwing▲1,035

    AI copilot for every marketing task

    AI · 2024

  • AI powered zero-waste meal planner

    AI · 2024 · ohapotato.app