nowfound

Dev tools · alternatives · 2026

24 alternatives to H5records – simple large dataset for pytorch training

Large dataset storage format for Pytorch. Contribute to theblackcat102/H5Record development by creating an account on GitHub.

Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. H5records – simple large dataset for pytorch training launched in 2021; newer entries below may have overtaken it.

  1. 1WS

    I’ve been in the MLOps space for ~10 years, and data is still the hardest unsolved open problem. Code is versioned using Git, data is stored somewhere else, and context often lives in a 3rd location like Slack or GDocs. This is why we built XetHub, a platform that enables teams to treat data like code, using Git. Unlike Git LFS, we don’t just store the files. We use content-defined chunking and Merkle Trees to dedupe against everything in history. This allows small changes in large files to be stored compactly. Read more here:…

    2022 · xethub.com · its alternatives →

  2. 2

    Developer tools for deep learning & machine learning

    2019 · wandb.ai · its alternatives →

  3. 3

    Build and share datasets to experiment with ML

    2021 · datatorch.io · its alternatives →

  4. 4

    An on-disk B+tree for Python 3. Contribute to NicolasLM/bplustree development by creating an account on GitHub.

    2018 · github.com · its alternatives →

  5. 5

    The Virtual Feature Store. Turn your existing data infrastructure into a feature store. - featureform/featureform

    2021 · github.com · its alternatives →

  6. 6DC
  7. 7

    Perform data science on data that remains in someone else's server - OpenMined/PySyft

    2018 · github.com · its alternatives →

  8. 8PK

    I built a small, self-contained K-Means implementation in pure PyTorch: https://gitlab.com/hassonofer/pt_kmeans I was working on dataset sampling and approximate nearest neighbor search, and tried several existing libraries for large-scale K-Means. I couldn't find something that was fast, simple, and would run comfortably on my own workstation without hitting memory limits. Maybe I missed an existing solution, but I ended up writing one that fit my needs. The core insight: Keep your data on CPU (where you have more RAM) and intelligently move only the necessary chunks to…

    2025 · its alternatives →

  9. 9GF

    2018 · dataturks.com · its alternatives →

  10. 10

    Machine Learning in Seconds. Dead Simple. PyTorch Flexible.

    2021 · its alternatives →

  11. 11

    Hello HN, We are pleased to introduce you graphlearn-for-pytorch (https://github.com/alibaba/graphlearn-for-pytorch), an open-source distributed graph neural network library based on PyTorch and compatible with PyG. Our library is designed to make it easy for developers to build and train large-scale graph models in a distributed environment. With graphlearn-for-pytorch, you can leverage GPUs to accelerate graph sampling and utilize UVA to reduce the overheads of feature collection. Following a scalable design, graphlearn-for-pytorch supports training GNN models on…

    2023 · github.com · its alternatives →

  12. 12

    We're excited to announce that we've open-sourced LeanRL, a lightweight PyTorch reinforcement learning library that provides recipes for fast RL training using torch.compile and CUDA graphs. By leveraging these tools, we've achieved significant speed-ups compared to the original CleanRL implementations - up to 6x faster! Reinforcement learning is notoriously CPU-bound due to the high frequency of small CPU operations. PyTorch's powerful compiler can help alleviate these issues, but comes with its own costs. LeanRL addresses this challenge by providing simple recipes to accelerate your…

    2024 · github.com · its alternatives →

  13. 13
    FlashML▲15

    Drag & Drop Machine Learning Models w/ PyTorch Flexibility.

    2020 · its alternatives →

  14. 14GA
  15. 15ID

    Hello, Hacker News! I'm Erik, cofounder of Release (YCW20). At Release we help “virtualize” your environment, so you can quickly reproduce it for various purposes: remote development, testing, staging, or even running production. But, today I would like to introduce our most popular feature that we are now offering for free: Instant Datasets! Instant Datasets allows you to easily create multiple pools of datasets and distribute them to your teams and it cleans up after itself. Imagine you have multiple production databases in RDS and you need that data when doing testing and development. I…

    2023 · its alternatives →

  16. 16VC

    Hi HN! We just launched a GitHub integration that scales your Git repos to handle 100 terabytes of files in a single repo. XetData enables data scientists and machine learning engineers to version code, models, and datasets together. Most teams have glued together clunky workflows using S3, DVC, Git, Git LFS, and other tools and make true reproducibility difficult: https://news.ycombinator.com/item?id=37694701 We instead embrace and extend Git so end-users don’t need to learn a new tool and a new set of commands. Our implementation is similar to Git LFS, where we take over the…

    2023 · its alternatives →

  17. 17

    N-D labeled arrays and datasets in Python. Contribute to pydata/xarray development by creating an account on GitHub.

    2014 · github.com · its alternatives →

  18. 18

    :zap:A Lightweight NLP Data Loader for All Deep Learning Frameworks in Python - tofunlp/lineflow

    2019 · github.com · its alternatives →

  19. 19

    Access annotated datasets

    2023 · github.com · its alternatives →

  20. 20

    Learn PyTorch from scratch with simple examples.

    Aug 2026 · khayyamshah2007.blogspot.com · its alternatives →

  21. 21
    Note▲7

    Machine learning library, Distributed training, Deep learning, Reinforcement learning, Models, TensorFlow, PyTorch - NoteDance/Note

    2025 · github.com · its alternatives →

  22. 22

    Go to https://github.com/pytorch/tutorials - this repo is deprecated and no longer maintained - spro/practical-pytorch

    2017 · github.com · its alternatives →

  23. 23

    3D transformations for Python. Contribute to dfki-ric/pytransform3d development by creating an account on GitHub.

    2021 · github.com · its alternatives →

  24. 24

    Towards Reproducible Machine Learning

    2019 · pytorch.org · its alternatives →

Also compare

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →