Qri, a free and open source distributed dataset versioning tool
I wanted to make you all aware of the latest release of Qri -pronounced ‘query’- (0.6.1), a free & open-source dataset version control system / network for finding, collaborating on & publishing open datasets on IPFS. We’re finally ready to recruit users (crash test smarties) to test drive qri & let us know what they love / don’t love / what’s broken. You likely have questions about qri. Hope this helps: Qri tackles four common data problems: - Discovery: Can I find data I’m looking for? - Trust: Can I trust what I’ve found? - Friction: Can I make this work with my other…
What it does
In the maker’s words, at launch
I wanted to make you all aware of the latest release of Qri -pronounced ‘query’- (0.6.1), a free & open-source dataset version control system / network for finding, collaborating on & publishing open datasets on IPFS. We’re finally ready to recruit users (crash test smarties) to test drive qri & let us know what they love / don’t love / what’s broken. You likely have questions about qri. Hope this helps: Qri tackles four common data problems: - Discovery: Can I find data I’m looking for? - Trust: Can I trust what I’ve found? - Friction: Can I make this work with my other stuff? - Sync: How do I h&le changes in data? Because qri is global & content-addressed, adding data to qri also checks the entire network to see if someone has added it before. Every change on qri is associated with a peer, creating an audit-able trail you can use to quickly see what has changed & who changed it. All datasets on qri are automatically described at the time of ingest using a flexible schema that makes data naturally inter-operate. Qri comes with tools to turn all datasets on the network into a JSON API with a single command. Finally, all changes in qri are tracked & synced. All data on qri is public, & discoverable by anyone on the network once you hit publish. Qri is still in its SUPER early stages, so it will be buggy, offer little guidance/help within the app. That’s what our team is here for. How to Download: https://qri.io/download/ For now, you’ll need a Mac to use the front-end app (windows support coming). Scroll down the download page to see links to command line tools. Getting started: - Documents: https://qri.io/docs/ - Tutorials: https://qri.io/docs/tutorials/ - Qri Demos: https://www.youtube.com/channel/UC7E3_hURgFO2mVCLDwPSyOQ How you can support Qri: - Share feedback by filing a github issue: https://github.com/qri-io - Introduce us to a data scientist in your life - Follow on Twitter @qri_io or star on Github Thank you so much!
Does the same job
all alternatives →
- DODataHub, open source datasets for Artificial Intelligence2017 · ▲14
Hi HN! I am an undergrad student trying to build interesting things with AI. Recently, I was looking for a dataset I could use for a new project. I realized that it is really frustrating to go through all the government websites (with terrible UX) just to find some usable dataset. I set out to build a GitHub for datasets, named DataHub. Right now, we have more than 1000 datasets from Montréal and New York City, with more cities coming soon (and possible government agencies). All of this is wrapped into a powerful search. It's a breeze to find a dataset to work on. I'd be interested to know…
- ALA labelling tool to easily extract and label Wikipedia data2021 · ▲116
Hi HN! I am Maria, solo founder of DataQA (https://dataqa.ai/), a tool to search and label documents for various NLP tasks (e.g. entity extraction, entity linking, etc). I have worked as a data scientist and ML engineer for the better part of a decade, and over that time have specialised mainly in applications involving natural language processing (NLP). One of the key questions I have always had at the back of my mind is whether my time was well spent. Whenever I spent more time on feature engineering or trying different models, I always wondered whether I would get better…
- SVSirixDB – versioning through efficient snapshotting2018 · ▲55
I've already posted yesterday, but I'd really love to get comments, any kind of questions, suggestions and help would be greatly appreciated as it's an Open Source project of mine (and was for others during my studies at the University of Konstanz 6 years ago). Since then I spent countless ours to bring forth the idea of a versioned storage system, especially well suited for analytical tasks for timd-varying data. Especially I'd love to discuss what documentation you need, which next steps are necessary (JSON, Cloud...), API additions or changes... I've updated the README quiet a bit, such…
More dev tools this month
the category →
Open-source GTM skills for technical founders
Dev tools · 29d ago · gtmcofounder.com
OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.
Dev tools · 2d ago · opentrailpaper.com
Launched alongside, December 2018
the whole month →
Humaaans▲1,592Mix-&-match illustrations of humans with a design library.
Growth · 2018 · humaaans.com
Make your ideas look awesome, without relying on a designer
Life & fun · 2018 · refactoringui.com
