Alternatives
Products that do what Tool for Creating SQL Pipelines – Structure.rest does
Hi All! We've spent a few months on getting an MVP together, and would love to get some feedback on whether this tool meets you needs. Here is a link to a demo video: https://www.youtube.com/watch?v=FBLi3vdKB-4&feature=emb_rel_pause Here's a link to our website: https://www.structure.rest And here's a blog article, I published today in the space: https://www.structure.rest/blog/using-a-data-analytics-stack-to-gain-business-insights
- 1
- 2
- 3
- 4AI
Hi HN, I’m Sean, the founder of Ascend.io (https://www.ascend.io). I’m really excited to post here and announce the launch of Ascend.io, a radical new way of designing, scaling, and automating data pipelines. Ascend is the result of nearly 4 years of development effort for a team that is now 30-strong, and I would love for you to give it a test drive and let me what you think. I’ve felt this pain since I wrote my first MapReduce in 2004 (using Sawzall @ Google), and in the 15 years since, things have not improved at the pace of other parts of the technology ecosystem. When I went…
2019
- 5OS
Hey HN, This is Adrian and David, and we're excited (and nervous) to show you basetool (https://basetool.io). Basetool helps companies view and manage all their data in one place. Companies have data in tons of places like BI tools, data warehouses, 3rd party services, and their databases. However, because the tools are not connected, it's a hassle to have visibility across the whole organization and even more difficult to safely share that data with the team or external collaborators. The vision is to give basetool access to your data source and get a tool that way above a…
2021
- 6AL
Hi HN! I am Maria, solo founder of DataQA (https://dataqa.ai/), a tool to search and label documents for various NLP tasks (e.g. entity extraction, entity linking, etc). I have worked as a data scientist and ML engineer for the better part of a decade, and over that time have specialised mainly in applications involving natural language processing (NLP). One of the key questions I have always had at the back of my mind is whether my time was well spent. Whenever I spent more time on feature engineering or trying different models, I always wondered whether I would get better…
2021
- 7IS
Everything that would be here is in the README. I hope this gets big, it has tons of potential.
2013 · github.com
- 8BL
Hello everyone! I am Jan, CTO and one of the creators of Pathway, the real-time data processing framework. I’m excited to share Pathway’s ready-to-use AI Pipelines, configurable with just YAML! These frameworks offer out-of-the-box solutions for AI search, RAG, and more—optimized for real-time indexing and in-memory processing. What makes it simple? YAML templates! The pipeline templates are fully customizable using YAMLs to fit your needs, from changing the data sources to the choice of the LLM model, all without touching Pathway’s Python code. Thanks to the Pathway data processing engine,…
2024 · pathway.com
- 9CM
Shameless plug for the functionality my team shipped to beta just before Christmas. For context, Forge is Atlassian's product extensibility framework that lets you write your own plugins (for lack of a better word) for our cloud SaaS products: https://developer.atlassian.com/platform/forge/ Coming up in a few weeks from another of my teams will be a feature we call "Dynamic Pipelines" which will let you use a similar Forge lambda function to mutate/generate Bitbucket Pipelines workflows at runtime.
2024 · bitbucket.org
- 10RR
2016 · github.com
- 11HM
One year ago, I downloaded the news.arc code and decided that I would teach myself programming by building a better aggregator. At that time, I had some rudimentary HTML knowledge, and little FORTRAN under my belt. I knew that I wanted an aggregator that could support a wide range of submissions, and one that could scale without losing quality for the user. Hubski is what I have to show for my time and effort. The easiest way to describe Hubski is to say that it uses a commenting system akin to HN or Reddit, but uses a sharing scheme like Twitter. You have a personal feed comprised of the…
2011
- 12DC
Hey HN, A few friends and I have spent the past 6 years or so developing a way to write data transformation code in a way that can easily adapt to changes in logic or data elements both upstream and downstream without the need major refactoring, regression testing, or re-orchestration. We decided to open source the project about two months ago and published a CLI tool after we realized how big of a task it was to take on incumbents like stored procedures, dbt, and psyspark. It is early days for our community and we are looking to grow and engage with others to poke holes and contribute…
2024 · github.com
- 13AO
A couple of years ago, we had an interesting idea. When a development team within an organization consists of around 10 members or fewer, controlling the risks associated with database changes might be achieved through trust and real-time communication. However, as the team grows, the responsibilities within the team become more specialized. Imagine a scenario where different branches of the business exist, each with its own set of developers, team leads, testers, testing leads, DBAs, and more. Relying solely on traditional communication methods becomes increasingly challenging when it comes…
2023 · github.com
- 14IM
Hi there! I've been working with data in one form or another, professionally, for about 5 years. I've been thinking about my own personal data and how it's used for at least twice that long. I've been sort of building something in my head for a while that solves my own problem and, in the beginning of this year, I found the opportunity to spend some time building it out. I'll leave the detailed explanation to the blog post but, in short, I built what amounts to an API crawler combined with a data processor to help you download your personal data from 3rd party services and work with it using…
2024 · joshcanhelp.com
- 15SG
Scaling data teams today means dealing with the complexity of the modern data stack. While DBT has become a core tool for transforming raw data into structured, analytics-ready tables, most teams are using it in ways that lead to chaos: duplicated models, inconsistent metrics, and inefficient SQL that directly impacts cloud spend. The real issue isn’t with DBT itself—it’s in how it’s applied across teams. Here’s the typical setup: Finance defines a revenue model, Marketing calculates customer lifetime value, and Product defines churn. All in DBT, but all with slightly different logic,…
2024 · github.com
- 16MI
Hi! Recently I've launched - mybfio.io - platform for software reviews with social network aspect. Prehistory Many great system are already in place that allow people to search and rate software products, including the site I am publishing this post on. However I have always felt that those systems are not specifically centered around product/software development lifecycle (releases, real users feedback over a product entire lifetime, so on) and often too broad or not designed specifically for that type of work, which is ok. Why? As an opensource author I would like to have constant…
2021
- 17PA
Hey HN! Pipevals is early and rough (this is a learning project), but usable. It currently lets you: - build evaluation pipelines as graphs - run them against datasets - track how output quality changes over time
Mar 2026 · github.com
- 18MD
I've spent about the past 6 months or so working on what I think of as 'database as a service'. Essentially hosted Sqlite with CORS support so users can post from anywhere, and execute queries saved on the backend. One of the things I'm going for is a completely in browser development experience, so there's nothing to install, the user simply uses the UI to create and edit queries and admin their database. One of the most basic uses would be posting form data from a static HTML page: https://www.lite-engine.com/blog/post_form.html I've posted it here before and didn't get…
2016
- 19SL
At Arcesium, we needed a way to run SQL-driven CRUD operations, manage slowly-changing dimensions, and handle schema evolution on our cloud data lakes—without the overhead of spinning up distributed clusters or relying on vendor-managed query services. That’s why we built SwiftLake, a lightweight open-source library that brings Apache Iceberg and DuckDB together: - Lightweight & cluster-free: Runs as a single Java service with embedded DuckDB—no distributed infra required. - Full CRUD and SCD1/SCD2 support: Reads, inserts/appends, updates, deletes, and merges with ACID guarantees.…
Sep 2025 · github.com
- 20DP
Hi HN – this is Peter from DBOS here with Qian (qianli_cs) and Jeremy (jedberg). We’re building an open-source, lightweight durable workflows library on top of Postgres. Ever since we first launched on HN last year, we’ve been blown away by the support, feedback, and response we’ve received from the community. We've realized durable workflows are critical for everything from business processes to AI automation to data pipelines, but most existing durable orchestration tools are either too heavy or too complicated for most applications. Instead, we're building something lightweight, simple,…
2025 · github.com
- 21SP
I built Sculptor after repeatedly seeing founders try to hire data scientists for a task that ultimately boiled down to extracting structured data from unstructured text (customer records, social posts, websites, etc) using an LLM API. We ended up reinventing this pattern internally at least three times in the past year, so I published Sculptor as a streamlined, open-source solution: - Simple schema-based extraction, with parallelization and type validation. - Multi-step pipelines with filtering or transforms between steps. - Configure everything in YAML/JSON for easy reuse. It’s MIT…
2025 · github.com
- 22SA
Hi, this has been a labor of love over the last few days =) Can't wait to hear you feedback and of course AMA!
2023 · blog.airsequel.com
- 23PF
Hi there Hacker News, I've started a side project http://datasourcehub.com which aims to be a platform for data scientists. The project is still in the idea phase so the UI/UX and functionality are all subject to change. Feel free to play around, below is a guest login, and make sure files are content type of 'text/csv'. All data is subject to deletion, it's just a sandbox right now! By reaching out to the Hacker News community I hope to reach expert data scientists and get their feedback. Below are some questions I'd like to answer and some proposed directions that this…
2013
- 24IB
Hey HN! I am a developer working on a startup doing lots of payment integration stuff with payment providers like Stripe. I built a tool to talk to Stripe data, just so that I can answer questions from our team. I turned that into analytics tool (sort of) to answer questions about MRR, churn, revenue etc. (https://www.dataraccoon.io/). There is a two minute demo video on the page if you want to see how it works, or you can use free trial without needing a credit card. I was wondering if you would use such a tool directly in Slack or prefer receiving messages about your metrics…
2024 · dataraccoon.io
Ranked by how close each launch is in meaning, then by votes. Refine with a description →