Python library to scan ML models for vulnerabilities
Hi! I’ve been working on this automatic scanner for ML models to detect issues like underperforming data slices, overconfidence in predictions, robustness problems, and others. It supports all main Python ML frameworks (sklearn, torch, xgboost, …) and integrates with the quality assurance solution we are building at Giskard AI (https://giskard.ai) to systematically test models before putting them in production. It is still a beta and I would love to hear your feedback if you have the time to try it out. We have quite a few tutorials in the docs with ready-made colab notebooks to…
Python library to scan ML models for vulnerabilities launched on June 13, 2023 with 20 votes, #1,560 of 4,655 launches that month and more than 75% of that year's launches. The site was not reachable when checked in September 2026.
In plain words
This Python library automatically scans machine learning models to identify vulnerabilities including underperforming data subsets, prediction overconfidence, and robustness issues. It works with major ML frameworks like scikit-learn, PyTorch, and XGBoost, and integrates with Giskard AI's quality assurance platform for pre-production testing. Designed for data scientists and ML engineers, it offers tutorials and ready-made Jupyter notebooks to help users get started testing their models.
written from the facts on this page · September 2026
From the sources
In the maker’s words, at launch
Hi! I’ve been working on this automatic scanner for ML models to detect issues like underperforming data slices, overconfidence in predictions, robustness problems, and others. It supports all main Python ML frameworks (sklearn, torch, xgboost, …) and integrates with the quality assurance solution we are building at…
Does a similar job
all alternatives →
Giskard – Testing framework dedicated to LLMs and Tabular ML models2023 · github.com · ▲15🐢 Open-Source Evaluation & Testing library for LLM Agents - Giskard-AI/giskard-oss
Machine learning (entirely) in Rust2016 · github.com · ▲20Machine Learning library for Rust. Contribute to AtheMathmo/rusty-machine development by creating an account on GitHub.
AutoAI – A framework to find the best performing AI/ML model2021 · github.com · ▲41Python based framework for Automatic AI for Regression and Classification over numerical data. Performs model search, hyper-parameter tuning, and high-quality Jupyter Notebook code generation. - blobcity/autoai
PyBroker – Algotrading in Python with Machine Learning2023 · github.com · ▲70Hello, I am excited to share PyBroker with you, a free and open-source Python framework that I developed for creating algorithmic trading strategies, including those that utilize machine learning. With PyBroker, you can easily develop and fine-tune trading rules, build powerful ML models, and gain valuable insights into your strategy's performance. Some of the key features of PyBroker include: - A super-fast backtesting engine built using NumPy and accelerated with Numba. - The ability to create and execute trading rules and models across multiple instruments with ease. - Access to…
ADTK – new Python library for time series anomaly detection2019 · github.com · ▲67A Python toolkit for rule-based/unsupervised anomaly detection in time series - arundo/adtk
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 20d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 29d ago · world.pixverse.video
Source: Show HN post ↗ · launch text quoted in part
Launched alongside, June 2023
the whole month →
Heya HN, I've been working on a reddit-like platform as my primary side project for the last few years. Doing a (very) soft launch today, mainly because I want to use it to encourage discussion of alternatives. How non.io works: 1. Free to browse, paid to interact. 2. Minimum subscription is $2 (though you can choose more). I take $1 to run the servers, everything left gets split evenly between everything you upvote that month. It's a simple model, but I hope it's a better one than the freemium model we've been relying on for the last few years. Fundamentally I feel like any ad-supported…
Commerce · 2023 · non.io
Typefully 2.0▲931Effortlessly publish on Twitter and LinkedIn, now with AI
Growth · 2023 · typefully.com
SlashPage▲755Create websites in seconds to build your first 1K community
Growth · 2023 · slashpage.com
Easy to use AI-powered, drag-and-drop website, SAAS landing, directory, and blog builder for startups, mobile apps, and SaaS. 100% no code, no design skills needed.
AI · 2023 · unicornplatform.com