Dev tools · alternatives · 2026
24 alternatives to Open-source infra for building embedded data pipelines
Hey HN! We are building *open source infrastructure for deploying customer-facing data pipelines.* Here’s our repo https://github.com/pipebird/pipebird and website https://pipebird.com/. Pipebird (YC W22) is designed to enable companies that generate important data to offer secure data pushes to their customers’ warehouses, directly from their products. Our team was previously building in fintech, where we heard from many of our peers that their customers wanted data pushed directly to their warehouses. Customers wanted to bring data into their source of…
Pipebird is an open-source infrastructure tool that enables companies to securely push data directly to their customers' data warehouses from their products. It targets data-generating businesses that want to offer… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Open-source infra for building embedded data pipelines launched in 2022; newer entries below may have overtaken it.
- 1
Every data pipeline job I had to tackle required quite a few components to set up: - One tool to ingest data - Another one to transform it - If you wanted to run Python, set up an orchestrator - If you need to check the data, a data quality tool Let alone this being hard to set up and taking time, it is also pretty high-maintenance. I had to do a lot of infra work, and while this being billable hours for me I didn’t enjoy the work at all. For some parts of it, there were nice solutions like dbt, but in the end for an end-to-end workflow, it didn’t work. That’s why I decided to build an…
2024 · github.com · its alternatives →
- 2
Get and manipulate data with a visual programming interface.
2017 · pipes.digital · its alternatives →
- 3
I've been obsessed for the past ~year with the possibilities of talking to LLMs. I built a bunch of one-off prototypes, shared code on X, started a Meetup group in SF, and co-hosted a big hackathon. It turns out that there are a few low-level problems that everybody building conversational/real-time AI needs to solve on the way to building/shipping something that works well: low-latency media transport, echo cancellation, voice activity detection, phrase endpointing, pipelining data between models/services, handling voice interruptions, swapping out different…
2024 · github.com · its alternatives →
- 4
- 5
- 6
We’re Robin, Louis, and Thomas. Pipelex is a DSL and a Python runtime for repeatable AI workflows. Think Dockerfile/SQL for multi-step LLM pipelines: you declare steps and interfaces; any model/provider can fill them. Why this instead of yet another workflow builder? - Declarative, not glue code: you state what to do; the runtime figures out how. - Agent-first: each step carries natural-language context (purpose, inputs/outputs with meaning) so LLMs can follow, audit, and optimize. Our MCP server enables agents to run pipelines but also to build new pipelines on demand. - Open…
Oct 2025 · github.com · its alternatives →
- 7
- 8
Managed auth and 10,000+ tools across 3,000+ APIs for the agents you’re building — and a secure gateway for the AI tools your company uses.
2019 · pipedream.com · its alternatives →
- 9
- 10
buildpipe▲116Compose, run and automate multi step AI developer workflows
May 2026 · buildpipe.com · its alternatives →
- 11
🧙 Build, run, and manage data pipelines for integrating and transforming data. - mage-ai/mage-ai
2022 · github.com · its alternatives →
- 12
Iterate your real-time data pipelines with Git
2023 · tinybird.co · its alternatives →
- 13
Supercharged GitHub pipelines with observability & insights
2023 · its alternatives →
- 14
Instill VDP▲130Open source unstructured data ETL for AI first applications
2024 · instill-ai.com · its alternatives →
- 15
Mage AI helps data teams build, orchestrate, monitor, and repair production data pipelines with editable SQL and Python for analytics, applications, and AI.
2022 · mage.ai · its alternatives →
- 16
- 17
Hey HN! Pipedream is an integration and compute platform purpose-built for developers building workflows and connecting cloud services. You can author workflows without writing any code: Pipedream supports over 700 integrated applications (GitHub, Slack, etc) [1] and all connectors are open source [2]. In addition, you can write any Node.js, Python, Go, or Bash code within workflows, extending the pre-built integrations with your own custom logic. Since we launched Pipedream on HN [3], over 300k developers have used the product. Pipedream developers tell us consistently that they love the…
2022 · pipedream.com · its alternatives →
- 18
Data integration made easy. | Build one central data source.
2019 · cdata.com · its alternatives →
- 19IM
2017 · xyz.insightdataengineering.com · its alternatives →
- 20
Hey HN, I'm really proud to share with you my new open source project: Kestra https://github.com/kestra-io/kestra I created a few years ago a successful open source AKHQ project: https://github.com/tchiotludo/akhq (renamed from KafkaHQ) which has been adopted by big companies like Best Buy, Pipedrive, BMW, Decathlon and many more. 2300 stars, 120 contributors, 10M docker downloads, much more than I expected. Now let's talk about Kestra, an infinitely scalable orchestration and scheduling platform for creating, running, scheduling and monitoring…
2022 · github.com · its alternatives →
- 21
A highly configurable Google Cloud Dataflow pipeline that writes data into Google Big Query table from Pub/Sub - bomboradata/pubsub-to-bigquery
2017 · github.com · its alternatives →
- 22
- 23
Automate your CI/CD pipeline with 30+ supported integrations
2019 · atlassian.com · its alternatives →
- 24
Steampipe▲69Open source SQL interface to your favorite cloud APIs🧑💻
2022 · steampipe.io · its alternatives →
Also compare
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →