Alternatives
Products that do what I made an Open Source Personal Data Pipeline does
Hi there! I've been working with data in one form or another, professionally, for about 5 years. I've been thinking about my own personal data and how it's used for at least twice that long. I've been sort of building something in my head for a while that solves my own problem and, in the beginning of this year, I found the opportunity to spend some time building it out. I'll leave the detailed explanation to the blog post but, in short, I built what amounts to an API crawler combined with a data processor to help you download your personal data from 3rd party services and work with it using…
- 1AI
Hi HN, I’m Sean, the founder of Ascend.io (https://www.ascend.io). I’m really excited to post here and announce the launch of Ascend.io, a radical new way of designing, scaling, and automating data pipelines. Ascend is the result of nearly 4 years of development effort for a team that is now 30-strong, and I would love for you to give it a test drive and let me what you think. I’ve felt this pain since I wrote my first MapReduce in 2004 (using Sawzall @ Google), and in the 15 years since, things have not improved at the pace of other parts of the technology ecosystem. When I went…
2019
- 2IS
Everything that would be here is in the README. I hope this gets big, it has tons of potential.
2013 · github.com
- 3DT
In April last year I started thinking about using Twitter in a smarter way. I wanted to do analytics on my tweets and find out more about people following me on Twitter. What kinds of things do people who follow me like and retweet? I decided to dig into the data and find out. When I went to try and download Twitter data in raw form I found I quickly got bogged down writing API wrangling code and fiddling with API keys. I just wanted to crunch some data but here I was wrangling Twitter's API. This was such a frustrating experience it suddenly looked like an opportunity to me. Was there room…
2022 · tweetfeast.com
- 4SL
So a while ago I was thinking it would be neat to build a site that had the most absolute utility. The idea I came up with was a site to store those little protips that are super useful, if you know them ahead of time. I hired a guy to work on it with me, and ClueDB was born: http://cluedb.com/ Please give it a whirl (it uses Twitter auth as login but doesn't tweet anything) and tell me what you think! (Various trivia: My first try at a project coded by someone else and "product managed" by me. Runs on Flask + MongoDB. Also, this is totally unrelated to my startup.)
2011
- 5DO
Hi HN! I am an undergrad student trying to build interesting things with AI. Recently, I was looking for a dataset I could use for a new project. I realized that it is really frustrating to go through all the government websites (with terrible UX) just to find some usable dataset. I set out to build a GitHub for datasets, named DataHub. Right now, we have more than 1000 datasets from Montréal and New York City, with more cities coming soon (and possible government agencies). All of this is wrapped into a powerful search. It's a breeze to find a dataset to work on. I'd be interested to know…
2017
- 6MW
This was more of a sandbox to play with Raphael and Flot than anything else but I think there are some interesting statistics in there. It'd be awesome to do this over time but I really don't have the spare time required.
2011 · burntbrunch.github.com
- 7DN
Hi everyone, Anuj here, Dataherald CEO. There are a bunch of EXTERNAL data sources in the world that people use a lot -- think census data, Bureau of Labor Statistics (unemployment, inflation), but even proprietary data sources. I was tired of getting these into useable data pipelines every time I need need to use them. Dataherald simply creates data pipelines to hundreds of data sources and then lets you create auto-updating data viz -- all in under 60 seconds. The goal is to enable non-tech users to more easily use data, which has been a huge problem for me throughout my career. We…
2022 · medium.com
- 8MO
I made this site over the past year in my own time, http://bizspeaking.com/ , the Twitter for deals. I'm going full-time on this project and sincerely seek all suggestions on building a viable business -- partner, funding, mentor, referrer, designer, developer, legal, anything. Technically, this site is mainly made with the Pyramid (Python) web framework, PostgreSQL as relational db, MongoDB as document store, Redis as cache/queue, and Solr for search. Do follow our AngelList page http://angel.co/bizspeaking , and official blog http://bizspeaking.posterous.com/ Thank you!
2011
- 9MM
I love the idea of quantified self and recently decided to pull all of my data in one place. I pull all of my data from ActivityWatch, Wakatime, and Health Connect APIs :)
2023 · kshivendu.dev
- 10PF
Hi there Hacker News, I've started a side project http://datasourcehub.com which aims to be a platform for data scientists. The project is still in the idea phase so the UI/UX and functionality are all subject to change. Feel free to play around, below is a guest login, and make sure files are content type of 'text/csv'. All data is subject to deletion, it's just a sandbox right now! By reaching out to the Hacker News community I hope to reach expert data scientists and get their feedback. Below are some questions I'd like to answer and some proposed directions that this…
2013
- 11TB
Hello everyone, I have always loved coding and in the couple I was thinking of making an open source project and it turned out to be awesome I hope you guys like it. I present Explore Singapore which I created as an open-source intelligence engine to execute retrieval-augmented generation (RAG) on Singapore's public policy documents and legal statutes and historical archives. The objective required building a domain-specific search engine which enables LLM systems to decrease errors by using government documents as their exclusive information source. What my Project does :- basically it…
Feb 2026 · github.com
- 12IM
I spent the past few weeks making an open source cloud code editing environment with an AI copilot and multiplayer collaboration! It's fully self-hostable in 5-10 minutes. There's a lot of minor improvements to be made, and some are already listed in the Github issues. Let me know what you think and feel free to try it out.
2024 · github.com
- 13SH
Needed this in my own work, anonymizing PII/PHI and decided to build this because presidio didn't really cut it for our use-case. Try it and maybe let me know if you have any feedback :)
2025 · github.com
- 14IB
Hey HN! Over the past few weeks, I’ve been working on DataBridge, an open-source solution for data ingestion and querying across text, PDFs, images, and videos. In our latest update, we’ve added a fully local deployment option: - No internet required – Runs entirely offline. - Customizable Models – Supports any LLM and embedding model via Ollama (with options for any other private providers) - Extensibility – You can plug in your own models or tools easily. This local-first approach ensures better privacy, security, and flexibility, especially for teams dealing with sensitive data. You can…
2025 · github.com
- 15IM
I'm documenting everything about my process. From learning to code, to building the app, and all the way to my outreach efforts. I'm learning as I go and sharing it with everyone who's not a programer, and is daunted to build a software on their own. Trust me. If I can do it, anyone can! You can find my updates on: https://Claritask.com ...as well as video updates on https://www.youtube.com/channel/UCdmqmifW4kIcPclXigay1dQ Would love to hear your feedback on my progress and if you have any suggestions on what I can do better. There's so many task managers out…
2017
- 16IM
Hey HN, When I was learning to code I was always intrigued to see the guys on twitter making money with a SaaS. I always wondered how to make them and after a few months I developed my own. I wanted to share a Boilerplate for any new devs who are wondering how to start their own SaaS or wonder how things work. Boilerplate comes with Auth, Payments, UI and all the good stuff. Ali
2024 · github.com
- 17AL
I wanted to share something I've been working on recently: Statum, a handy web analytics tool. https://github.com/extractumio/statum The journey began when I found myself frequently needing simple web analytics for my projects. I tried Google Analytics, especially GA4, and realized it was quite complex and, at times, not very accurate, especially when I wanted to view stats for the current day or recent hours. Then I tested a few fancy startup solution but ended up with way too expensive plans the expect me to subscribe (I'm not that rich to pay $99/month for every…
2023 · github.com
- 18IO
2024 · docs.cubyc.com
- 19IM
After I posted about https://cosme.dev/ask-docs on Reddit I received some messages asking me how If I was going to make the code open source or if I could show them how I did it. So I decided to create this repo so you can take a look at the code and maybe apply the same techniques on your own apps. It's made using only PHP as language so I think is pretty different since most stuff out there is made using python or javascript. It uses the OpenAI API and Redis as a vector database.
2023 · github.com
- 20IM
Hey everyone! I'm really excited to share a side project I've been pouring my heart into lately. As a developer with over five years of experience, I've taken on my fair share of freelance web development projects. In the beginning, I always coded everything from scratch, but as I juggled more projects simultaneously, I started using Webflow to save time. While Webflow was definitely a lifesaver, I couldn't help but wish for an even faster way to set up a website – something that would allow me to start with a template and then easily customize it to my heart's content. The problem with most…
2024 · instawebai.com
- 21WB
Hey HN: Kaveh here, founder of https://www.usage.ai/ We help companies drive down AWS, GCP, and Azure spend. Why? Because the way it's done now is a pain. DevOps and Software Engineers end up spending time managing costs rather than focusing on business problems. I have been building Usage AI for almost 4 years now (4 year anniversary in 1 month from now!) with an incredible group of founding people. We started as a product just to help lower AWS EC2 costs, and now we do all major AWS services (such as RDS, OpenSearch, ElastiCache, and Redshift with more on the way) and other…
2024
- 22AO
Hello HN! My name is Rémy and I recently published an astronomy dashboard where everything is open source: the code of the website, the framework it is based on and the library that computes astronomical data. For the last few years, I have been developing the Ruby library Astronoby (https://github.com/rhannequin/astronoby) with as much dedication and perseverance I could while I don't have any scientific academic background. My end goal was to use this library and build a website that not only provides as much data as possible, but let anyone access and understand how it…
Nov 2025
- 23AR
Hey HN! Quick TL; DR: I set up scrapers for the websites of ~20k tech companies, fed the results through GPT, spent some sleepless nights building a web app, and voilá. I started this after getting fed up with how slow LinkedIn felt. I finally got it working and easy to use, so I wanted to share it with you guys. The job list is free. But I’m currently paying a lot of money to OpenAI for all the data I’m passing through GPT, so I may end up eventually charging for some advanced features, or putting ads on it or something. Please let me know what you think! I’m actively developing this so I’m…
2024 · techjobs.xyz
- 24IM
Hello everyone. I'm a relatively new developer and I started my first project to go full production recently. It is a directory of payment processors and payment service providers. It's free to use and gives detailed info on their pricing, business model, supported business types, available countries, prohibited businesses and high risk business support. So far only 40 have been added with more to come. And I allow processors to contact me so that they're details can be added to the database. I'll eventually automate this and add verification the months to come. I hope you'll find it useful.…
2025 · sourcefees.com
Ranked by how close each launch is in meaning, then by votes. Refine with a description →