Free, zero configuration hosting for data and models using Git and DVC
Hey HN! I'm Guy, one of the creators of DAGsHub. We help data scientists track experiments and version their code, data & models using Git. We're committed to building on open source protocols and improving the user experience on top of them - in this case, DVC. We've built capabilities on top of it like visually interacting with your pipeline, creating data pull requests, browsing data files etc. One thing we kept running into is users being challenged by setting up the cloud environment necessary, to push their data to AWS S3, GCS (which we support), and other DVC remotes. Since our focus…
What it does
In the maker’s words, at launch
Hey HN! I'm Guy, one of the creators of DAGsHub. We help data scientists track experiments and version their code, data & models using Git. We're committed to building on open source protocols and improving the user experience on top of them - in this case, DVC. We've built capabilities on top of it like visually interacting with your pipeline, creating data pull requests, browsing data files etc. One thing we kept running into is users being challenged by setting up the cloud environment necessary, to push their data to AWS S3, GCS (which we support), and other DVC remotes. Since our focus is on community projects, it was clear that this is a lot of friction that we don't want, as it gets in the way of users actually working on data science. To fix this, we built DAGsHub Storage. It's the easiest DVC remote you can set up, and we made the process of setting it up as close as possible to the process of setting up a Git remote. That means that you don't need a credit card, define storage access permissions, IAM, etc. Just type in `dvc remote add origin [https://dagshub.com/<user>/<project>.dvc](https://dagshub.com/<user>/<project>.dvc)`. Since our goal is to spur community projects and collaboration, DAGsHub storage is free for open source projects, and we also gave some free storage to private projects, because, heck, why not. After you push your data to DAGsHub Storage, you'll be able to view it, compare versions and share it with collaborators easily, as well as control team access. This means that you can contribute data to projects, not just code. I hope this makes ML work better and promote Open Source Data Science. Unlike GitLFS, we're offering significantly more storage, basing it on the much more data science oriented DVC, and actually letting you browse, compare and share the data files and artifacts via the UI. As usual, I'd love to hear your feedback! https://dagshub.com/blog/dagshub-storage-zero-configuration-dataset-model-hosting
Does the same job
all alternatives →- D1DVC 1.0 release. 5 lessons from 3 years of building open-source ML tool2020 · ▲19
Hey HN, creator of DVC here! DVC (https://dvc.org/) is known as Git for data projects. Technically, DVC codifies your data and machine learning pipelines as text metafiles (with pointers to actual data in S3/GCP/Azure/SSH) while you use Git for the actual versioning. DevOps folks call this approach GitOps or more specifically in this case - DataOps or MLOps. We’ve been working towards 1.0 since we started 3 years ago. What began as my pet project now has 100+ code contributors, 100+ documentation contributors, and thousands of users. Our community has taught us…

- SSSorcia – Self-hosted web front end for Git repositories, written in Go2020 · git.mysticmode.org · ▲100
- GTGitorials – Tutorials as Git Repos2017 · gitorials.com · ▲147

- GGGo-git – low-level and extensible Git client library in Go2016 · github.com · ▲114
More dev tools this month
the category →



Open-source GTM skills for technical founders
Dev tools · 29d ago · gtmcofounder.com

OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.
Dev tools · 1d ago · opentrailpaper.com

Launched alongside, January 2021
the whole month →
- BA
Life & fun · 2021 · beeperhq.com
- IM
Life & fun · 2021 · read.cv

- IS
Life & fun · 2021 · petapixel.com
- IB
Life & fun · 2021 · vim.so