Alternatives
Products that do what Pandera – An open source data testing framework for data science and ML does
Hi HN, I'm excited to share Pandera, an open source framework for data testing, built for data scientists and ML engineers: https://www.union.ai/pandera I’ve been working with data and building models for a decade, and one of the biggest pain points for me is working with low-quality data. I got burned by incorrect data types and unexpected values so many times that I built a Pandera to help you safeguard your pipelines from silent data bugs. You can create schemas for your dataframe-like objects, which can be validated at run-time, in your unit tests via property-based…
- 1
- 2DA
Dear HN, I am Riwaj, the cofounder of dstack.ai (https://github.com/dstackai). A few months ago, we built an online service that allows users to publish data visualizations from Python or R. The idea was to build a tool that did not require additional programming or front-end development for publishing data visualizations. Such a code can be invoked from either Jupyter notebook, RMarkdown, Python, or R scripts. Once the data is pushed, it can be accessed via a browser. Open-sourcing dstack: During our customer discovery phase, we realized that dstack.ai should integrate a lot…
2020
- 3DO
Hi HN! I am an undergrad student trying to build interesting things with AI. Recently, I was looking for a dataset I could use for a new project. I realized that it is really frustrating to go through all the government websites (with terrible UX) just to find some usable dataset. I set out to build a GitHub for datasets, named DataHub. Right now, we have more than 1000 datasets from Montréal and New York City, with more cities coming soon (and possible government agencies). All of this is wrapped into a powerful search. It's a breeze to find a dataset to work on. I'd be interested to know…
2017
- 4SM
Hello HN, I built Syna to understand how modern ML frameworks like PyTorch actually work — from the ground up. It’s a minimal, define-by-run (dynamic graph) framework inspired by DeZero, written entirely with NumPy. Unlike most libraries, Syna includes a basic reinforcement learning module right inside the same framework — no separate packages. It’s not about speed or GPUs — it’s about clarity, simplicity, and learning the internals of machine learning. Great for students, educators, and anyone curious about what’s really happening under the hood. GitHub:…
Oct 2025 · github.com
- 5
- 6SP
https://github.com/tracyhenry/Kyrix Open source MIT project from Turing award winner Michael Stonebraker. Seeking contributors.
2020
- 7EO
Like many of you, we've spent the last two years dealing with requests to sprinkle LLM-powered features everywhere. One recurring problem we faced in almost every project was related to data governance. In most cases, it was extremely hard to implement the needed granular control over the retrieved data. We developed custom solutions each time, but when we realized most of the solutions could be reused in subsequent projects, we started thinking about creating a modular framework. Today we're releasing that framework! We've already built some modules using open-source solutions such as…
2024 · github.com
- 8TN
Hi guys, I’m excited to share an update on ReproModel, an open-source toolbox designed to streamline the testing and reproduction of machine learning models. I, like many of you, have really struggled with benchmarking and comparing models, from missing code, to opaque experiment parameters slowing the process. I decided to take matters into my own hands, and created a mini-toolbox in my free time to streamline the process. The goal is to reduce the time and effort spent on replicating experiments, enabling researchers to focus on innovation rather than setup. Knowing this task is not an…
2024 · github.com
- 9ZO
Hello HN, I am Sonal, a data consultant from India. For the past few months(and years!), I have been working on an entity resolution tool to build a single source of truth for customers, suppliers, products and parts. Here is a short demo of Zingg in action https://www.youtube.com/watch?v=zOabyZxN9b0 As a data consultant, I often struggled to build unified views of core entities on the datalake and the warehouse. Data spread across different systems has variations and consistencies making Customer 360, KYC, AML, segmentation, personalization and other analytics difficult. As I…
2022
- 10MD
We’re excited to share ML-Dev-Bench, a new open-source benchmark that tests AI agents on real-world ML development tasks. Unlike typical coding challenges or Kaggle-style competitions, our benchmark simulates end-to-end ML workflows including: - Dataset handling and preprocessing - Debugging model and code failures - Implementing new model architectures - Fine-tuning and improving existing models With 30 diverse tasks, ML-Dev-Bench evaluates agents across critical stages of ML development. To complement this, we built Calipers, a framework that provides systematic performance evaluation and…
2025 · github.com
- 11WB
Hi everyone, We have been developing a platform to enable professionals to build AI assistants to help them through their work. After a few months, we realized people are trying to sell basic functionalities that can be built from scratch in a couple of hours. Due to this, individuals who are not familiar with the current SOTA are misinformed about the potential of generative models. So, we decided to open up some of our most popular templates as standalone tools for free to empower individuals and set a solid standard for what people should expect. We believe the barrier to accessing…
2024 · join.modularmind.app
- 12IE
Hey HN, when building ML systems for industrial AI, we have learned that data inspection is critical during the ML development process. We are also big fans of the Hugging Face ecosystem. That is why we built an integration to our data exploration tool Spotlight that allows you to interactively explore Hugging Face datasets with one line of code. Spotlight lets you leverage model results such as predictions and embeddings to gain a deeper understanding in data segments and model failure modes. Currently, many many NLP, CV, Audio and multimodal datasets are supported both locally and on the…
2023 · huggingface.co
- 13PF
Hi there Hacker News, I've started a side project http://datasourcehub.com which aims to be a platform for data scientists. The project is still in the idea phase so the UI/UX and functionality are all subject to change. Feel free to play around, below is a guest login, and make sure files are content type of 'text/csv'. All data is subject to deletion, it's just a sandbox right now! By reaching out to the Hacker News community I hope to reach expert data scientists and get their feedback. Below are some questions I'd like to answer and some proposed directions that this…
2013
- 14TS
Hello Hacker News community! I'm currently working in financial risk management within the banking sector, and I began my career as a Data Science specialist. For quite some time, my friend and I have been developing a small pet project just for fun. This tool has repeatedly helped us save time when testing various hypotheses and machine learning models. The core idea is to combine different scripts—created in various programming languages and virtual environments—within a minimalist graphical interface. Whether you're building models, running a local neural network, or sending requests to…
2024
- 15IB
Disclaimer it is a heavily AI assisted project. The goal was not to be the most performative but the kind that's easier to learn from. I wanted to share this in case there are people who had the same idea or wanted to see something like this.
Jun 2026 · github.com
- 16WB
Here is a production-first Keras-inspired LM framework, built with the advice of François Chollet (ex-Google, creator of Keras and ARC-AGI), our technical advisor. This system have already been deployed in production with our clients (which is why we have already every LLMOps practice implemented). It is also compatible with Jupyter and Marimo to integrate seamlessly in you Data Scientists workflows. You can try the code examples online on HF space and you can find more information in the documentation and FAQ. If you have any feedback for us don't hesitate to join our discord! More releases…
2025 · github.com
- 17DR
The first ever AI peer reviewed research article just got approved. It’s kinda crazy how advanced AI have come to replace researchers. I've just been using Deep Research on ChatGPT and Perplexity a lot to write and research complex technical reports for my boss. He loves the reports and it has decreased my workload a ton but I still have some frustrations with it. None of them provide an API that gets me the same quality of output you would with the applications. I wanted something with more control on the LLMs, swappable with the reasoning new models that came out. Not just prompt →…
2025 · github.com
- 18ST
Hey HN, Data quality matters more than ever. Our world increasingly relies on AI and proprietary datasets to fine-tune models. But as many of us know, garbage in often results in garbage out. Bad data can cost millions, especially when it informs important decisions like public health policy or interest rate hedging. Today’s data engineers need a flexible, secure, and performant data quality toolkit designed for the modern workflow. But current solutions were built a decade ago and don't support big data technologies, such as Spark. This is why we're building Spotlight - the data quality…
2023 · spotlight.dev
- 19IB
Hey HN! Over the past few weeks, I’ve been working on DataBridge, an open-source solution for data ingestion and querying across text, PDFs, images, and videos. In our latest update, we’ve added a fully local deployment option: - No internet required – Runs entirely offline. - Customizable Models – Supports any LLM and embedding model via Ollama (with options for any other private providers) - Extensibility – You can plug in your own models or tools easily. This local-first approach ensures better privacy, security, and flexibility, especially for teams dealing with sensitive data. You can…
2025 · github.com
- 20AO
Hey HN, My workflow for any complex queries is to ask it in multiple AI chats (Gemini, Claude, o3,..) in parallel and then continue the conversation with the chat response that I found the most useful. I built a simple open source app that queries 10+ AI models at once and summarizes their answers with a selected combiner AI model. There's a GIF in the github repo that shows it in action. You can try it on your local machine: https://github.com/Nexarithm/multi_model_chat If you are interested, I also made a detailed blog post on technical details, feature of the personal…
2025 · github.com
- 21DA
I'm a journalist and product developer by day, and a curious generalist who loves making things whenever I find time. I've always loved building little web apps, even with my limited coding skills. As a student and early in my career, I had a lot of time, so it didn't matter. In recent years however, with life being busy as it is, most of my ideas stayed at the back of my mind. There simply wasn't enough time to compensate for my limited skills. Until I started working with Cursor, that is. All of a sudden, the time needed to turn an idea into a working prototype is once again within what…
Sep 2025 · dataguessr.com
- 22RA
Hi there, looking for feedback on my new project "Featherless.AI" The idea is to allow users to run all the models on hugging face instantly. Via the OpenAI API compatible endpoint. Why? Because its a real chore to download models and spin up GPUs, especially if you want to test multiple models. Not to mention GPUs cost multiple dollars an hour to rent. And if we want more people to use open source AI, we got to make it easier for them to try and play with all of them. So what if instead of spinning up dedicated GPUs per model (which is what every provider is doing) We can startup a LLM…
2024 · featherless.ai
- 23GA
Hi, Hacker News! We're excited to announce the release of GraphAr, an open-source file format for archiving and exchanging graph data. The landscape of graph processing systems is fragmented, with various types of systems, including graph databases, graph computation systems, and GNN systems. However, currently, there is no common file format for efficiently storing and exchanging graph data while maintaining its schema and graph semantics. GraphAr is designed to address this issue by providing a simple, lightweight format for storing and exchanging graph data. GraphAr is a flexible and…
2023 · github.com
- 24FF
I built Hermes, an open-source Python framework for multi-agent financial research. Most AI “equity research” demos stop at generating text. In practice, real workflows require pulling structured XBRL financials from SEC filings, extracting labeled sections like MD&A and Risk Factors, merging macro and market data, building actual Excel models with formulas, and generating investment memos in Word or PDF. Hermes is designed to handle that full pipeline end to end. It includes 35 financial data tools covering SEC EDGAR (via edgartools), FRED, Yahoo Finance market data, and RSS-based financial…
Feb 2026 · github.com
Ranked by how close each launch is in meaning, then by votes. Refine with a description →