Surfer Protocol – Export and build applications with your personal data
Hey everyone, we built a local-first, open-source framework to allows you to export and build applications with your personal data. This August, we built a digital footprint exporter (https://news.ycombinator.com/item?id=41325719) that allowed people to get back their personal data, but there was no way to interact with it. So we added a python package, improved the reliability of the exporting, and implemented a unified JSON structure across platforms. How it works: - Electron’s built-in webview element is used to navigate to the platform’s website and the user can connect…
What it does
In the maker’s words, at launch
Hey everyone, we built a local-first, open-source framework to allows you to export and build applications with your personal data. This August, we built a digital footprint exporter (https://news.ycombinator.com/item?id=41325719) that allowed people to get back their personal data, but there was no way to interact with it. So we added a python package, improved the reliability of the exporting, and implemented a unified JSON structure across platforms. How it works: - Electron’s built-in webview element is used to navigate to the platform’s website and the user can connect their account. A CSS selector is used to determine if the user has successfully connected their account. Then, the data is exported through intercepting the network requests and using the cookies and auth token to make requests, or by automatically clicking buttons / links on the website and handling the downloading and parsing of the file. All this data is transformed into a unified JSON structure - For iMessage, the application requires full-disk access and then runs a python script to turn the iMessage sqlite database into JSON. How to get started: - Download the Desktop app or run it locally from source: https://docs.surferprotocol.org/desktop/installation - Connect your accounts and export your data - Use the python package to interact with the data: https://docs.surferprotocol.org/sdk/python. Example applications are in the cookbook: https://docs.surferprotocol.org/cookbook/python Here's a demo video: https://www.youtube.com/watch?v=HuLnEFlQsHE&ab_channel=Sahil... Would love some feedback and thoughts on what you guys think of this!
Does the same job
all alternatives →
- NONous – Open-Source Agent Framework with Autonomous, SWE Agents, WebUI2024 · github.com · ▲155
Hello HN! The day has finally come to stop adding features and start sharing what I've been building the last 5-6 months. It's a bit of CrewAI, OpenDevon, LangFuse/Cloud all in one, providing devs who prefer TypeScript an integrated framework thats provides a lot out of the box to start experimenting and building agents with. It started after peeking at the LangChain docs a few times and never liking the example code. I began experimenting with automating a simple Jira request from the engineering team to add an index to one of our Google Spanner databases (for context I'm the…
- IMI made an Open Source Personal Data Pipeline2024 · joshcanhelp.com · ▲5
Hi there! I've been working with data in one form or another, professionally, for about 5 years. I've been thinking about my own personal data and how it's used for at least twice that long. I've been sort of building something in my head for a while that solves my own problem and, in the beginning of this year, I found the opportunity to spend some time building it out. I'll leave the detailed explanation to the blog post but, in short, I built what amounts to an API crawler combined with a data processor to help you download your personal data from 3rd party services and work with it using…
- IBI built an offline open-source RAG system DataBridge2025 · github.com · ▲7
Hey HN! Over the past few weeks, I’ve been working on DataBridge, an open-source solution for data ingestion and querying across text, PDFs, images, and videos. In our latest update, we’ve added a fully local deployment option: - No internet required – Runs entirely offline. - Customizable Models – Supports any LLM and embedding model via Ollama (with options for any other private providers) - Extensibility – You can plug in your own models or tools easily. This local-first approach ensures better privacy, security, and flexibility, especially for teams dealing with sensitive data. You can…
More dev tools this month
the category →
Open-source GTM skills for technical founders
Dev tools · 29d ago · gtmcofounder.com
OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.
Dev tools · 2d ago · opentrailpaper.com
