Alternatives
Products that do what Fuzzy deduplicate any CSV using vector embeddings does
I made an app to fuzzy-deduplicate my Google Sheets and CRM records - No manual configuration required - Works out-of-the-box on most data types (ex. people, companies, product catalog) Implementation details: - Embeds records using an E5-family model - Performs similarity search using DuckDB w/ vector similarity extension - Does last-mile comparison and merges duplicates using Claude Demo video: https://youtu.be/7mZ0kdwXBwM Github repo (Apache 2.0 licensed): https://github.com/SnowPilotOrg/dedupe_it Background story: My company has a table for…
- 1GS
I created an add-on for Google Sheets called Flookup, and it comes both as a free version and a VERY AFFORDABLE paid version. At its core, Flookup is a fuzzy matching add-on that helps you manage text that is less than a 100% match. Beyond that it can be used to: 1. Search for and match data regardless of whether it contains typos. 2. Highlight and delete duplicates duplicates even if the data has mismatched text. 3. Calculate the percentage similarity between strings. 4. Extract unique values from any column based on percentage similarity. 5. Sum and find the average of numbers based on…
2020
- 2CT
Jul 2026 · github.com
- 3XS
2019 · github.com
- 4SF
We’ve just open-sourced SemHash, a lightweight package for semantic text deduplication. It lets you effortlessly clean up your datasets and avoid pitfalls caused by duplicate samples in semantic search, RAG, and machine learning. Main Features: - Fast and hardware friendly: Deduplicate datasets with millions of records in minutes, on a CPU. - Flexible: Works on single or multiple datasets (e.g., train/test deduplication), and multi-column data (e.g., Question-Answering datasets). - Lightweight: Minimal dependencies (largest is NumPy). - Explainable: Easily inspect duplicates and what…
2025 · github.com
- 5
- 6AF
2018 · github.com
- 7
- 8
- 9SS
We’ve just released SemHash v0.3.0, a major rework of our open-source text pre-processing library. We’ve added two new functionalities: outlier filtering & representative sampling. The core API has been reworked to make sure all of these features can be used together in an intuitive way. Our new features use the existing approximate nearest neighbors index that we already used for semantic deduplication, so they can be ran very quickly after building the index on your dataset. The core package can now be used for: - Semantic Deduplication: Remove semantic duplicates from your dataset. This…
2025 · github.com
- 10FA
2019 · flatfile.io
- 11FD
Hello HN! It has been about three years since I launched this current iteration of my Google Sheets add-on called Flookup. I'm a solo developer and, currently, I handle absolutely everything to do with Flookup from writing code, replying support emails and even marketing. It is a lot of work but very satisfying because I get to see, first hand, how helpful it has been to my userbase. Before Flookup was launched, there was only one prominent Google Sheets add-on that could be used for data cleaning (to a certain degree) but, luckily for me, that add-on had left a gap in functionality that I…
2022
- 12CE
Hello Hacker News! We're a team of YC founders (Meldium W13, Draft S11, TapEngage S11) launching something new (https://www.getcensus.com). How many times has your business team asked you to generate yet another CSV file, write a ”quick report” in SQL, or send some custom data to a terrible API (looking at you Marketo)? We’ve built a product that connects directly to your data warehouse and syncs into apps like Salesforce, Customer.io and even Google Sheets. In fact, your business teams won’t even need to rely on engineering to manage all these pipelines. The tech stack for…
2020
- 13NN
Hi HN. Peter here. As a machine learning engineer, I mostly think in terms of feature vectors, embeddings, and matrices. One of the most useful byproducts of deep neural networks is embeddings because they allow us to represent high-dimensional data in terms of lower-dimensional latent vectors. These feature vectors can be used for downstream applications like similarly search, recommendation systems and near duplicate detection. As an ML engineer, I was frustrated by the lack of a datastore in which vectors are first-class citizens. As a result, most ML engineers, including myself, end up…
2021
- 14SV
Hi HN, I'm Daniel from Superlinked! We have built an open-source framework that improves vector search relevance and usefulness by combining structured metadata with unstructured data in your embeddings. We included self-hostable API server that sits between your data sources and vector database. Docs: https://docs.superlinked.com/ We're launching our cloud offering soon where you can use Superlinked to orchestrate high-performance retrieval for RAG, Search & Recommendation apps in your own cloud. Looking for feedback and happy to answer questions!
2024 · github.com
- 15FA
Fuzzyhome is a lightweight new-tab page that lets you very quickly fuzzy find links and navigate to a result. If there are no matching links, you can use your query to perform a search with your search engine of choice. You can also append your query to arbitrary links with a bang-like feature. Cohesive usage instructions can be found on the GitHub page: https://github.com/familyfriendlymikey/fuzzyhome Fuzzyhome is free, entirely client-side, and statically hosted with Cloudflare pages. No sign in or account required. Export your links to a JSON file in the settings menu…
2022 · fuzzyho.me
- 16CA
2019 · github.com
- 17UD
I've been working a fair bit with DSPy lately, and I did some work in combining the benefits of vector search and LLMs (via a DSPy pipeline) to disambiguate records with a high degree of accuracy to help enrich a dataset. The blog post shows how this approach scales well, is very cost-effective and super concise - all it takes is < 100 lines of DSPy code and it all runs async. The code to reproduce is in this repo if anyone's interested (all tools are 100% free and open source, and the methodology will work with open weight LLMs too).…
2025 · blog.kuzudb.com
- 18PV
Search a 100,000-article ParqDB index directly in the browser with MiniLM, HTTP Range, Parquet, and WebAssembly.
16d ago · search.parqdb.io
- 19
- 20
A lightweight Windows app to clean CSVs offline.
Jun 2026 · jadinicescoarts.gumroad.com
- 21
Clean broken and duplicate CSV rows offline—$19 once
Jul 2026 · store.marabusiness.net
- 22
- 23AV
Hi HN! It’s always bothered me that there’s no real equivalent of SQL WHERE for vector content. Filtering is one of the cornerstones of a modern database — but vector DBs only support either top-k sort, which is only useful for fuzzy search, or metadata filtering, which isn’t semantic. I’ve found myself wanting all the results matching my semantic query, not just k! Aside from data analysis, it's relevant if you’re trying to do any LLM reasoning: you don’t make good decisions or reach good conclusions by considering a small subset of information. So, we’ve designed a filtering primitive on…
2023 · reviews.emberml.com
- 24DE
Hey! We’ve built a data extraction tool to flexibly automate data and document processing. You’ve probably seen a few of these, so have we! A few of us have been varyingly stuck trying to automate the extraction of borrower financials for the past 5 years. We think that there are a few missing features of most data extraction tools. * They are usually too complex to quickly get up and running * They are overly constrained in terms of what workflows and documents they support We’ve always felt like speed and flexibility were sticking points, so we went slightly orthogonal to the alternatives.…
2024 · go.sea.dev
Ranked by how close each launch is in meaning, then by votes. Refine with a description →