Dev tools · alternatives · 2026
24 alternatives to Help improve language coverage in Common Crawl
Hey HN, the Common Crawl Foundation is trying to expand the coverage of our crawl to more languages, regions and cultures, and if you speak a language other than English (LOTE) you can help! By validating Language Identification data (LangID or LID): https://dynabench.org/tasks/text-language-identification By contributing urls for our seed crawl: https://github.com/commoncrawl/web-languages We're also organizing a Workshop on Multilingual Data Quality Signals (WMDQS) with MLCommons and EleutherAI where we have a call for papers open…
Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes.
- 1
I built this tool because I wanted a way to just take a bunch of URLs or domains, and query their content in RAG applications. It takes away the pain of crawling, extracting content, chunking, vectorizing, and updating periodically. I'm curious to see if it can be useful to others. I meant to launch this six months ago but life got in the way...
2024 · embedding.io · its alternatives →
- 2
- 3
- 4
An open-source language translation system for 200 languages
2022 · github.com · its alternatives →
- 5
- 6
TL;DR: Vector-based RAG performs poorly for many real-world applications like codebase chats, and you should consider 'language maps'. Part of our mission at Mutable.ai is to make it much easier for developers to build and understand software. One of the natural ways to do this is to create a codebase chat, that answer questions about your repo and help you build features. It might seem simple to plug in your codebase into a state-of-the-art LLM, but LLMs have two limitations that make human-level assistance with code difficult: 1. They currently have context windows that are too small to…
2024 · twitter.com · its alternatives →
- 7
2018 · hub.docker.com · its alternatives →
- 8
A repository that contains models, datasets, and fine-tuning techniques for DB-GPT, with the purpose of enhancing model performance in Text-to-SQL - eosphoros-ai/DB-GPT-Hub
2023 · github.com · its alternatives →
- 9
- 10
Free & interactive language world map. Discover with how many people you can communicate, and share your coloured map and results!
2023 · languageworldmap.com · its alternatives →
- 11
Language Lego. Contribute to ayoungprogrammer/Lango development by creating an account on GitHub.
2016 · github.com · its alternatives →
- 12
Hi HackerNews, Lately, I have seen an explosion in posts offering paid APIs/services to get unstructured data into LLMs (i.e. langchain extract, ragflow, unstructured, unstract, just to name a few) and I have been largely disappointed by them, either because they fail to implement multimodal support, fail to give good context for "really tricky" PDFs / Word docs / Powerpoints, or are just plain difficult to use. In light of all these posts I figured I'd share my solution that has been working smoothly for me and my clients. I put it up on GitHub for free so you can check it…
2024 · github.com · its alternatives →
- 13LangSearch▲37
Free web search API, free rerank API, world engine for AGI
2024 · langsearch.com · its alternatives →
- 14LI
2018 · languagemodels.io · its alternatives →
- 15
You can test translation quality here https://lingvanex.com/translate/
2025 · github.com · its alternatives →
- 16VD
Discover, evaluate, and access relevant embeddings in your go-to framework. Skip all the infra for scraping, cleaning, indexing, and updating high-quality embeddings.
2023 · embedding.store · its alternatives →
- 17
An educational Rust project for exporting and running inference on Qwen3 LLM family - reinterpretcat/qwen3-rs
2025 · github.com · its alternatives →
- 18AS
We explored a novel method to gauge the significance of tokens in prompts given to large language models, without needing direct model access. Essentially, we just did an ablation study on the prompt using cosine similarity of the embeddings as the measure. We got surprisingly promising results when comparing this really simple approach to integrated gradients. Curious to hear thoughts from the community!
2023 · heatmap.demos.watchful.io · its alternatives →
- 19
PolyglotGPT▲15Hi HN! I'm trying to learn a language, but I don't have anyone to speak it with, so I made this website to get some practice. To start, all you have to do is set your native language and target language. Then, just start talking to it in either your native or target language. It'll catch any mistakes you make when you speak in your target language and answer any grammar/vocab questions you have. It has a translate button, a romanize button (converts any text into the Latin alphabet), and you can highlight words/phrases you don't know in AI responses to have them explained. I'd…
2025 · polyglotgpt.com · its alternatives →
- 20
Synthetic data generation is an essential step in training and evaluating LLMs/Agents/RAG pipelines, but tooling around this is still lacking. We're introducing Curator, an open-source library designed to streamline the data curation process. While there are many libraries to prompt LLMs, the semantics of generating synthetic data is different from prompting. For example, we need to process a large number of prompts (sometimes in millions or more) while accepting some failures, utilize several stages of prompting, incorporate human feedback, and filter out bad data using verifiers…
2025 · github.com · its alternatives →
- 21
Test and compare results from Large Language Models (LLMs) simultaneously, including Anthropic's Claude 1.2, OpenAI's GPT-4, GPT-3.5 turbo, and Cohere's CommandXL Nightly. Analyze the results side-by-side in a single UI on top of LLM APIs.
2023 · retool.com · its alternatives →
- 22
I recently submitted another project for using LLMs to correct errors and improve formatting of OCRed documents which was well received. The low cost and high quality/speed of the latest "value tier" models from OpenAI and Anthropic have made it possible to get compelling results at a very reasonable price in that application. It occured to me that the same approach taken there (namely, splitting documents into chunks and sending each chunk through a chain of LLM prompts that each take the output of the previous prompt and apply an additional layer of processing) could be easily applied…
2024 · github.com · its alternatives →
- 23
Hello everyone. I built an AI-based toolset to help me with language learning. I wanted to be able to easily generate very specific study content and get rapid feedback on my writing. Unlike most language apps, it doesn’t actually try to teach you a language. Instead, it’s a collection of tools for people at an intermediate level who already have a learning process It’s particularly great for Anki users. There a demo video on the login page, and I set up anonymous auth for people who want to test it without creating an account. Feedback and bug reports welcome.
2025 · drillapp.xyz · its alternatives →
- 24
Supports 25+ Languages, Plugins for Chrome, Firefox & GDocs
2019 · languagetool.org · its alternatives →
Also compare
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →