Giskard
Open-source testing framework for LLMs & ML models
Giskard launched on November 9, 2023 with 521 votes, #30 of 4,333 launches that month and more than 99% of that year's launches. The site was still online in September 2026, 2 years on.
In plain words
Giskard is an open-source testing framework designed for large language models and machine learning models. It automatically detects hallucinations and biases in AI systems and supports testing at scale across various model types, from tabular models to LLMs. The platform offers both self-hosted and cloud deployment options and integrates with popular tools like Hugging Face, MLflow, and Weights & Biases, making it suitable for developers and teams building ML applications.
written from the facts on this page · September 2026
From the sources
Fast LLM & ML testing at scale 🛡️ Detect hallucinations & biases automatically 🔍 Enterprise Testing Hub ☁️ Self-hosted / cloud 🤝 Integrated with 🤗, MLFlow, W&B From tabular models to LLMs, Giskard handles everything! https://github.com/Giskard-AI/giskard
🐢 Open-Source Evaluation & Testing library for LLM Agents - Giskard-AI/giskard-oss
Does a similar job
all alternatives →
Giskard – Testing framework dedicated to LLMs and Tabular ML models2023 · github.com · ▲15🐢 Open-Source Evaluation & Testing library for LLM Agents - Giskard-AI/giskard-oss
TensorZero2025 · github.com · ▲307Hi HN! We're Gabriel & Viraj, and we're excited to open source TensorZero. To be a little cheeky, TensorZero is an open-source platform that helps LLM applications graduate from API wrappers into defensible AI products. 1. Integrate our model gateway 2. Send metrics or feedback 3. Unlock compounding improvements in quality, cost, and latency It enables a data & learning flywheel for LLMs by unifying: • Inference: one API for all LLMs, with <1ms P99 overhead • Observability: inference & feedback → your database • Optimization: better prompts, models, inference strategies • Experimentation:…
- PLPython library to scan ML models for vulnerabilities2023 · docs.giskard.ai · ▲20
Hi! I’ve been working on this automatic scanner for ML models to detect issues like underperforming data slices, overconfidence in predictions, robustness problems, and others. It supports all main Python ML frameworks (sklearn, torch, xgboost, …) and integrates with the quality assurance solution we are building at Giskard AI (https://giskard.ai) to systematically test models before putting them in production. It is still a beta and I would love to hear your feedback if you have the time to try it out. We have quite a few tutorials in the docs with ready-made colab notebooks to…
AI Playground by Vercel Labs2023 · play.vercel.ai · ▲249Hey, Jared Palmer (creator of this playground) here. Really excited to ship this. I’ve been building this over the past few weeks to compare LLMs from different providers like OpenAI, Anthropic, Cohere, etc. At Vercel, I manage our Frameworks division (including Next.js, Svelte, and Turbo) and wanted to also dogfood some of the latest features in a slightly larger application. This playground takes a lot of inspiration from https://nat.dev and is built on Tailwind, ui.shadcn.com, and some upcoming Vercel products we’re announcing soon. We’re going to continue adding models to…
A Karpathy-style LLM wiki your agents maintain (Markdown and Git)Apr 2026 · github.com · ▲260I shipped a wiki layer for AI agents that uses markdown + git as the source of truth, with a bleve (BM25) + SQLite index on top. No vector or graph db yet. It runs locally in ~/.wuphf/wiki/ and you can git clone it out if you want to take your knowledge with you. The shape is the one Karpathy has been circling for a while: an LLM-native knowledge substrate that agents both read from and write into, so context compounds across sessions rather than getting re-pasted every morning. Most implementations of that idea land on Postgres, pgvector, Neo4j, Kafka, and a dashboard. I…
Evaluate LLM-based RAG Applications with automated test set generation2024 · github.com · ▲13🐢 Open-Source Evaluation & Testing library for LLM Agents - Giskard-AI/giskard-oss
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 20d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 28d ago · world.pixverse.video
Source: Product Hunt launch ↗
Launched alongside, November 2023
the whole month →
Discover & book top creators to promote your product
Growth · 2023 · passionfroot.me
SpeedVitals▲829Hi HN, I’m Kashish, one of the co-founders of SpeedVitals, a platform for testing & monitoring website performance with a major emphasis on Core Web Vitals. Until now, our platform has only focused on Synthetic/Lab testing, such as Lighthouse tests and TTFB tests. But now, we have developed a Real-User Monitoring platform that doubles up as a Web Analytics tool. One major feature we have that most RUM tools lack is Performance Audits. Just like Lighthouse audits work on Lab test data, our audits work across all the real-user visits and gives suggestions on what task to prioritize first.…
Dev tools · 2023 · speedvitals.com