Dev tools · alternatives · 2026
24 alternatives to Fuzzy deduplicate any CSV using vector embeddings
I made an app to fuzzy-deduplicate my Google Sheets and CRM records - No manual configuration required - Works out-of-the-box on most data types (ex. people, companies, product catalog) Implementation details: - Embeds records using an E5-family model - Performs similarity search using DuckDB w/ vector similarity extension - Does last-mile comparison and merges duplicates using Claude Demo video: https://youtu.be/7mZ0kdwXBwM Github repo (Apache 2.0 licensed): https://github.com/SnowPilotOrg/dedupe_it Background story: My company has a table for…
Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Fuzzy deduplicate any CSV using vector embeddings launched in 2024; newer entries below may have overtaken it.
- 1
Go library that provides fuzzy string matching optimized for filenames and code symbols in the style of Sublime Text, VSCode, IntelliJ IDEA et al. - sahilm/fuzzy
2018 · github.com · its alternatives →
- 2
Flookup▲88Fuzzy match, highlight and remove duplicates from your data
2019 · getflookup.com · its alternatives →
- 3
Flookup 2.0▲96Fuzzy match, highlight and remove duplicates from your data
2021 · getflookup.com · its alternatives →
- 4
Advanced Bloom Filter Based Algorithms for Efficient Approximate Data De-Duplication in Streams - jparkie/PDD
2016 · github.com · its alternatives →
- 5GS
I created an add-on for Google Sheets called Flookup, and it comes both as a free version and a VERY AFFORDABLE paid version. At its core, Flookup is a fuzzy matching add-on that helps you manage text that is less than a 100% match. Beyond that it can be used to: 1. Search for and match data regardless of whether it contains typos. 2. Highlight and delete duplicates duplicates even if the data has mismatched text. 3. Calculate the percentage similarity between strings. 4. Extract unique values from any column based on percentage similarity. 5. Sum and find the average of numbers based on…
2020 · its alternatives →
- 6
Paste in my prompt to Claude Code with an embedded API key for accessing my public readonly SQL+vector database, and you have a state-of-the-art research tool over Hacker News, arXiv, LessWrong, and dozens of other high-quality public commons sites. Claude whips up the monster SQL queries that safely run on my machine, to answer your most nuanced questions. There's also an Alerts functionality, where you can just ask Claude to submit a SQL query as an alert, and you'll be emailed when the ultra nuanced criteria is met (and the output changes). Like I want to know when somebody posts about…
Dec 2025 · exopriors.com · its alternatives →
- 7
Deduplix▲9Deduplication Software and Secure Data Deduplication
2025 · ixsight.com · its alternatives →
- 8
After working with LLMs for long enough, I found myself wanting a lightweight utility for doing various small tasks to prepare inputs, locate information and create evaluators. This library is two things: a very simple model and utilities that inference it (eg. fuzzy deduplication). The target platform is CPU, and it’s intended to be light, fast and pip installable — a library that lowers the barrier to working with strings semantically. You don’t need to install pytorch to use it, or any deep learning runtimes. How can this be accomplished? The model is simply token embeddings that are…
2024 · github.com · its alternatives →
- 9
We’ve just open-sourced SemHash, a lightweight package for semantic text deduplication. It lets you effortlessly clean up your datasets and avoid pitfalls caused by duplicate samples in semantic search, RAG, and machine learning. Main Features: - Fast and hardware friendly: Deduplicate datasets with millions of records in minutes, on a CPU. - Flexible: Works on single or multiple datasets (e.g., train/test deduplication), and multi-column data (e.g., Question-Answering datasets). - Lightweight: Minimal dependencies (largest is NumPy). - Explainable: Easily inspect duplicates and what…
2025 · github.com · its alternatives →
- 10
Features Spreadsheet-like interface All you want is here • Cell Editing: Directly click and edit content within cells. • Formula Support: Input mathematical and logical formulas to auto-calculate values. • Data Sorting and Filtering: Sort data based on a column or multiple columns; use filters to view specific rows of data. • Aggregation Function: Automatically summarize statistics for each column, providing instant calculations like sum, average, count, max, and min for streamlined data analysis. • Data Formatting: formatting numbers, dates, etc. • Grouping: Organize rows into collapsible…
2024 · github.com · its alternatives →
- 11
Hello HN! I became frustrated with the unpredictible/poor match quality and opaqueness of "relevance scores" in existing fuzzy and fulltext search libs, so I tried something different and this is the result. The main selling point is the result quality / ordering, with best-in-class memory overhead and excellent performance being bonuses. The API is pretty stable at this point, but looking for feedback before committing to 1.0. TL;DR The test corpus is a 4MB json file with 162k words/phrases, so give it a second for initial download. You can also drag/drop your own…
2022 · github.com · its alternatives →
- 12IM
As a grad student (and an ADHDer), I had trouble doing literature review systematically. To combat this, I made a website that finds similar papers using the meaning of the thing I am looking for. I used MixedBread's [^1] embedding model to generate vectors from the abstracts. I store and search similar vectors using Milvus [^2] and finally use Gradio [^3] to serve the frontend. I update the vector database weekly by pulling the metadata dataset from Kaggle [^4]. To speed up the search process on my free oracle instance, I binarise the embeddings and use Hamming distance as a metric. I would…
2024 · papermatch.mitanshu.tech · its alternatives →
- 13
I recently found myself computing the similarity between lots of very high dimensional vectors (i.e., sentence embedding vectors from LLMs), and I wanted to try some more powerful measures of similarity/dependency than just Cosine similarity, which seems to be the default for everything nowadays because of its computational efficiency. There are many other more involved measures that can detect more subtle relationships, but the problem is that some of them are quite slow to compute, especially if you're trying to do it in Python. For my favorite measure of statistical dependency,…
2023 · github.com · its alternatives →
- 14
Embedding-based code duplication detector. Contribute to rafal-qa/slopo development by creating an account on GitHub.
Jul 2026 · github.com · its alternatives →
- 15
DeDuplicate▲78Remove duplicate files in G Drive, Dropbox, OneDrive, MEGA
2022 · apps.apple.com · its alternatives →
- 16DD
Gleb, Alex, Erez and Simon here – we are building an open-source tool for comparing data within and across databases at any scale. The repo is at https://github.com/datafold/data-diff, and our home page is https://datafold.com/. As a company, Datafold builds tools for data engineers to automate the most tedious and error-prone tasks falling through the cracks of the modern data stack, such as data testing and lineage. We launched two years ago with a tool for regression-testing changes to ETL code…
2022 · its alternatives →
- 17
- 18
I have spent several years working on search engines in the backend and have now utilized that experience to develop a fuzzy search library for the frontend. It's fast, accurate and can be used for all languages. It should be easy to integrate into your Javascript / Typescript projects. If you test it and find any edge cases that did not work for you please let me know. The implementation is based on 3-grams by the book, augmented with a novel trick of sorting the characters within the 3-grams for enhanced accuracy. For a detailed explanation you may refer to my related blog post at…
2024 · github.com · its alternatives →
- 19
The Virtual Feature Store. Turn your existing data infrastructure into a feature store. - featureform/featureform
2021 · github.com · its alternatives →
- 20
Stop cleaning data. Start using it.
2025 · mergeitai.com · its alternatives →
- 21
AI fuzzy matching & deduplication — no code
May 2026 · dedupfuzzy.com · its alternatives →
- 22
OpenSheet▲86Hi folks. I've been doing some experiments on how LLMs could get more handy in the day to day of working with files (CSV, Parquet, etc). Earlier last year, I built https://datakit.page and evolved it over and over into an all in-browser experience with help of duckdb-wasm. Got loads of feedbacks and I think it turned into a good shape with being an adhoc local data studio, but I kept hearing two main things/issues: Why can't the AI also change cells in the file we give to it? Why can't we modify this grid ourselves? So besides the whole READ and text-to-SQL flows, what seemed…
Feb 2026 · opensheet.app · its alternatives →
- 23
DataFrog▲4Offline tool to fuzzy match, merge messy Excel files No-Code
Jan 2026 · ehabahmed2.github.io · its alternatives →
- 24
Hi! We are excited to announce the second release of Desbordante — an open-source, high-performance data profiler that is capable of discovering and validating many different patterns in data using various algorithms. Unlike existing data profilers, Desbordante focuses on discovering complex patterns in data, which are notoriously hard to extract. Since its inception in 2019, it has become the fastest open-source tool for these tasks. It also offers an array of patterns which have no alternative implementations. With this release, Desbordante now supports 17 types of patterns, such as:…
2024 · github.com · its alternatives →
Also compare
- A fast, hopefully accurate, fuzzy matching library written in Go alternatives
- Flookup alternatives
- Flookup 2.0 alternatives
- PDD – Probabilistic De-Duplication of Streams with Bloom Filters alternatives
- Google Sheets add-on to compare text, fuzzy-match, highlight duplicates alternatives
- Use Claude Code to Query 600 GB Indexes over Hacker News, ArXiv, etc. alternatives
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →