The Legal Embedding Benchmark (MLEB)
Hey HN, I'm excited to share the Massive Legal Embedding Benchmark (MLEB) — the first comprehensive benchmark for legal embedding models. Unlike previous legal retrieval datasets, MLEB was created by someone with actual domain expertise (I have a law degree and previously led the AI team at the Attorney-General's Department of Australia). I came up with MLEB while trying to train my own state-of-the-art legal embedding model. I found that there were no good benchmarks for legal information retrieval to evaluate my model on. That led me down a months-long process working alongside my brother…
The Legal Embedding Benchmark (MLEB) launched on October 26, 2025 with 11 votes, #1,209 of 8,178 launches that month and more than 75% of that year's launches.
In plain words
The Massive Legal Embedding Benchmark (MLEB) is a benchmark dataset for evaluating legal embedding models and information retrieval systems. It comprises 10 datasets covering multiple jurisdictions including the US, UK, Australia, Singapore, and Ireland, with document types spanning cases, laws, regulations, contracts, and textbooks. The benchmark was created by someone with legal expertise and prior experience leading an AI team at Australia's Attorney-General's Department. It addresses a gap in testing resources for legal embedding models by providing standardized evaluation sets for retrieval and other problem types.
written from the facts on this page · September 2026
From the sources
A Blog post by Isaacus on Hugging Face
We're announcing the release of the Massive Legal Embedding Benchmark (MLEB) , the largest, most diverse, and most comprehensive benchmark for legal text embedding models. MLEB contains 10 datasets spanning multiple document types, jurisdictions, areas of law, and tasks. To do well on MLEB, embedding models must demonstrate both extensive legal domain knowledge and strong legal reasoning skills. On MLEB, our newly released Kanon 2 Embedder legal embedding model scores highest while simultaneously maintaining the lowest inference time of all commercial competitors, highlighting the extreme accuracy and efficiency gains to be had from domain adaptation. 23 October 2025 : MLEB has since been…from huggingface.co
In the maker’s words, at launch
Hey HN, I'm excited to share the Massive Legal Embedding Benchmark (MLEB) — the first comprehensive benchmark for legal embedding models. Unlike previous legal retrieval datasets, MLEB was created by someone with actual domain expertise (I have a law degree and previously led the AI team at the Attorney-General's…
Does a similar job
all alternatives →
Building a web search engine from scratch with 3B neural embeddings2025 · blog.wilsonl.in · ▲699End-to-end deep dive of the project, spanning a large GPU cluster, distributed RocksDB, and terabytes of sharded HNSW.
- IMI made a website to semantically search ArXiv papers2024 · papermatch.mitanshu.tech · ▲324
As a grad student (and an ADHDer), I had trouble doing literature review systematically. To combat this, I made a website that finds similar papers using the meaning of the thing I am looking for. I used MixedBread's [^1] embedding model to generate vectors from the abstracts. I store and search similar vectors using Milvus [^2] and finally use Gradio [^3] to serve the frontend. I update the vector database weekly by pulling the metadata dataset from Kaggle [^4]. To speed up the search process on my free oracle instance, I binarise the embeddings and use Hamming distance as a metric. I would…
- BVBenchmarking VLMs vs. Traditional OCR2025 · getomni.ai · ▲146
Vision models have been gaining popularity as a replacement for traditional OCR. Especially with Gemini 2.0 becoming cost competitive with the cloud platforms. We've been continuously evaluating different models since we released the Zerox package last year (https://github.com/getomni-ai/zerox). And we wanted to put some numbers behind it. So we’re open sourcing our internal OCR benchmark + evaluation datasets. Full writeup + data explorer here: https://getomni.ai/ocr-benchmark Github: https://github.com/getomni-ai/benchmark Huggingface:…
Embeddinghub: A vector database built for Machine Learning embeddings2021 · github.com · ▲118The Virtual Feature Store. Turn your existing data infrastructure into a feature store. - featureform/featureform
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 22d ago · stillwet.art
FastRouter.ai▲364Route requests to the right LLM for cost, latency & quality
AI · 23d ago · fastrouter.ai
Source: Show HN post ↗ · launch text quoted in part
Launched alongside, October 2025
the whole month →
I went down the rabbit hole on a side project and ended up building this: Strange Attractors(https://blog.shashanktomar.com/posts/strange-attractors). It’s built with three.js. Working on it reminded me of the little "maths for fun" exercises I used to do while learning programming in early days. Just trying things out, getting fascinated and geeky, and being surprised by the results. I spent way too much time on this, but it was extreme fun. My favorite part: someone pointed me to the Simone Attractor on Threads. It is a 2D attractor and I asked GPT to extrapolate it to…
AI · Oct 2025 · blog.shashanktomar.com
Autism Simulator▲779Hey all, I built this. It’s not trying to capture every autistic experience (that’d be impossible). It’s based on my own lived experience as well as that of friends on the spectrum. I'm trying to give people a feel for what masking, decision fatigue, and burnout can look like day-to-day. That’s hard to explain in words, but easier to show through choices and stats. I'm not trying to "define autism". I’ve gotten good feedback here about resilience, meds, and difficulty tuning. I’ll keep tweaking it. If even a few people walk away thinking, "ah, maybe that’s why my coworker struggles in those…
Life & fun · 2025 · autism-simulator.vercel.app
