nowfound

Dev tools · November 4, 2024

FD

Fuzzy deduplicate any CSV using vector embeddings

I made an app to fuzzy-deduplicate my Google Sheets and CRM records - No manual configuration required - Works out-of-the-box on most data types (ex. people, companies, product catalog) Implementation details: - Embeds records using an E5-family model - Performs similarity search using DuckDB w/ vector similarity extension - Does last-mile comparison and merges duplicates using Claude Demo video: https://youtu.be/7mZ0kdwXBwM Github repo (Apache 2.0 licensed): https://github.com/SnowPilotOrg/dedupe_it Background story: My company has a table for…

Fuzzy deduplicate any CSV using vector embeddings launched on November 4, 2024 with 5 votes and more than 50% of that year's launches.

What it does

In the maker’s words, at launch

I made an app to fuzzy-deduplicate my Google Sheets and CRM records - No manual configuration required - Works out-of-the-box on most data types (ex. people, companies, product catalog) Implementation details: - Embeds records using an E5-family model - Performs similarity search using DuckDB w/ vector…

Does a similar job

all alternatives →
  • A fast, hopefully accurate, fuzzy matching library written in Go2018 · github.com · ▲186

    Go library that provides fuzzy string matching optimized for filenames and code symbols in the style of Sublime Text, VSCode, IntelliJ IDEA et al. - sahilm/fuzzy

  • Flookup2019 · getflookup.com · ▲88

    Fuzzy match, highlight and remove duplicates from your data

  • Flookup 2.02021 · getflookup.com · ▲96

    Fuzzy match, highlight and remove duplicates from your data

  • PDD – Probabilistic De-Duplication of Streams with Bloom Filters2016 · github.com · ▲86

    Advanced Bloom Filter Based Algorithms for Efficient Approximate Data De-Duplication in Streams - jparkie/PDD

  • GS
    Google Sheets add-on to compare text, fuzzy-match, highlight duplicates2020 · ▲80

    I created an add-on for Google Sheets called Flookup, and it comes both as a free version and a VERY AFFORDABLE paid version. At its core, Flookup is a fuzzy matching add-on that helps you manage text that is less than a 100% match. Beyond that it can be used to: 1. Search for and match data regardless of whether it contains typos. 2. Highlight and delete duplicates duplicates even if the data has mismatched text. 3. Calculate the percentage similarity between strings. 4. Extract unique values from any column based on percentage similarity. 5. Sum and find the average of numbers based on…

  • Deduplix2025 · ixsight.com · ▲9

    Deduplication Software and Secure Data Deduplication

More dev tools this month

the category →
  • /dev/null▲484

    a social network for devs

    Dev tools · 3d ago · dev-null.sh

  • open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.

    Dev tools · 28d ago · github.com

  • Contribute to reladraw/reladraw development by creating an account on GitHub.

    Dev tools · 26d ago · github.com

  • OpenBot▲362

    Grok Bot alternative: free, local, open-source, multiplayer

    Dev tools · 23d ago · openbot.run

  • Talanoa▲346

    Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…

    Dev tools · 21d ago · talanoa.email

  • CoreSpeed▲332

    One MCP for everything your agents need: apps, memory, tools

    Dev tools · 28d ago · corespeed.io

Source: Show HN post ↗ · launch text quoted in part

Launched alongside, November 2024

the whole month →
  • Lovable▲1,477

    Hey HN! Previous CERN physicist turned hacker here. We've developed a way to make AI coding actually work by systematically identifying and fixing places where LLMs typically fail in full-stack development. Today we're launching as Lovable (previously gptengineer.app) since it's such a big change. The problem? AI writing code typically make small mistakes and then get stuck. Those who tried know the frustration. We fixed most of this by mapping out where LLMs fail in full-stack dev and engineering around those pitfalls with prompt chains. Thanks to this, in all comparisons I found with: v0,…

    AI · 2024 · lovable.dev

  • Superchat▲1,427

    AI Agents for WhatsApp Business, Instagram & Co

    Growth · 2024 · superchat.com

  • Postiz▲1,188

    Streamline your social media with Postiz. Schedule posts, analyze performance, and manage all accounts in one place.

    Dev tools · 2024 · postiz.com

  • I wasn't quite sure if this qualified as "Show HN" given you can't really download it and try it out. However, dang said[0]: > If it's hardware or something that's not so easy to try out over the internet, find a different way to show how it actually works—a video, for example, or a detailed post with photos. Hopefully I did that? Additionally, I've put code and a detailed guide for the netboot computer management setup on GitHub: https://github.com/kentonv/lanparty Anyway, if this shouldn't have been Show HN, I apologize! [0]…

    Dev tools · 2024 · lanparty.house

  • Unlock a new level productivity with AI, Cloud Sync and more

    Work · 2024 · raycast.com

  • Cap▲1,047

    Beautiful screen recordings, owned by you. 100% open source.

    Dev tools · 2024 · cap.so