Ascend.io – Smarter Data Pipelines
Hi HN, I’m Sean, the founder of Ascend.io (https://www.ascend.io). I’m really excited to post here and announce the launch of Ascend.io, a radical new way of designing, scaling, and automating data pipelines. Ascend is the result of nearly 4 years of development effort for a team that is now 30-strong, and I would love for you to give it a test drive and let me what you think. I’ve felt this pain since I wrote my first MapReduce in 2004 (using Sawzall @ Google), and in the 15 years since, things have not improved at the pace of other parts of the technology ecosystem. When I went…
What it does
In the maker’s words, at launch
Hi HN, I’m Sean, the founder of Ascend.io (https://www.ascend.io). I’m really excited to post here and announce the launch of Ascend.io, a radical new way of designing, scaling, and automating data pipelines. Ascend is the result of nearly 4 years of development effort for a team that is now 30-strong, and I would love for you to give it a test drive and let me what you think. I’ve felt this pain since I wrote my first MapReduce in 2004 (using Sawzall @ Google), and in the 15 years since, things have not improved at the pace of other parts of the technology ecosystem. When I went about trying to fix this, I took a page from other technologies, particularly the migration to declarative models such as those found in React and Kubernetes. With Ascend, you just declare what you want the end-state of your data to be and the Dataflow Control Plane automates the orchestration, infrastructure, and persistence to make it happen. Data can arrive late, schemas can shift, logic can be updated, and the control plane generates new pipelines to propagate, backfill, and repair existing datasets. With this approach, pipelines take a lot less code to build (current record is reducing LOC from 100k to 2k), they break less, and you get to actually sleep through the night without being paged. I certainly think this is a huge step forward for the world of pipeline development and making pipelines suck less. But, I really want to know what you all think! Anyone who is interested, I can get you setup with a free trial (https://www.ascend.io/get-started). Can’t wait to hear the feedback! ~Sean
Does the same job
all alternatives →- IWI wrote a book about using Lambda with Go2021 · ▲103
Hi HN! During the last few years, I worked on a few applications built with Go, running on AWS Lambda. As I got to know the platform better, I started to find Go & Lambda to be a really productive combination. The applications were fast, and they ended up being much cheaper to run than what my team & I had built before. It’s probably not the best platform for _every_ application, but I was surprised at how much of our workload worked well on it. As we brought new engineers on to our team and helped them get up to speed with the stack, I found that we were covering a lot of the same topics…
- IMI made an Open Source Personal Data Pipeline2024 · joshcanhelp.com · ▲5
Hi there! I've been working with data in one form or another, professionally, for about 5 years. I've been thinking about my own personal data and how it's used for at least twice that long. I've been sort of building something in my head for a while that solves my own problem and, in the beginning of this year, I found the opportunity to spend some time building it out. I'll leave the detailed explanation to the blog post but, in short, I built what amounts to an API crawler combined with a data processor to help you download your personal data from 3rd party services and work with it using…
- IMI made an AI powered alternative to Webflow, Wix, Framer2024 · instawebai.com · ▲5
Hey everyone! I'm really excited to share a side project I've been pouring my heart into lately. As a developer with over five years of experience, I've taken on my fair share of freelance web development projects. In the beginning, I always coded everything from scratch, but as I juggled more projects simultaneously, I started using Webflow to save time. While Webflow was definitely a lifesaver, I couldn't help but wish for an even faster way to set up a website – something that would allow me to start with a template and then easily customize it to my heart's content. The problem with most…
- TFTool for Creating SQL Pipelines – Structure.rest2020 · ▲13
Hi All! We've spent a few months on getting an MVP together, and would love to get some feedback on whether this tool meets you needs. Here is a link to a demo video: https://www.youtube.com/watch?v=FBLi3vdKB-4&feature=emb_rel_pause Here's a link to our website: https://www.structure.rest And here's a blog article, I published today in the space: https://www.structure.rest/blog/using-a-data-analytics-stack-to-gain-business-insights
- IMI made a Node.js boilerplate, to ship your startup with less pain2024 · ▲5
Hey everyone, Rahim here, an indie maker with a passion for building useful tools. This time, I'm excited to share FasterNode.io: a turbo booster for your Node.js SaaS project! Think of it as a pre-built foundation packed with goodies like user auth, payments, and clean code. This means you can launch weeks, not months, faster and focus on what truly matters - building an awesome SaaS that solves problems! Whether you're a seasoned developer or just starting out, FasterNode.io is here to streamline your journey. Curious to learn more? Let's ditch the boilerplate code and build something…
- AIAirflow is cool but have you tried this for data pipelines?2022 · github.com · ▲9
More work this month
the category →
The app store for voice native apps that lives in your notch
Work · 28d ago · voiceos.com
The New Calendly▲211Handle all of the work before, during, and after meetings
Work · 17d ago · calendly.com
Launched alongside, July 2019
the whole month →
Really good curated email design and code inspiration
Dev tools · 2019 · reallygoodemails.com
Poolside FM 2.0▲671Super-summer music website inspired by a '90s OS
Life & fun · 2019 · v2.poolside.fm