AI · alternatives · 2026
24 alternatives to Chonky – a neural text semantic chunking goes multilingual
TLDR: I’m expanding the family of text-splitting Chonky models with new multilingual model. You can learn more about this neural approach in a previous post: https://news.ycombinator.com/item?id=43652968 Since the release of the first distilbert-based model I’ve released two more models based on a ModernBERT. All these models were pre-trained and fine-tuned primary on English texts. But recently mmBERT(https://huggingface.co/blog/mmbert) has been released. This model pre-trained on massive dataset that contains 1833 languages. So I had an idea of…
Chonky is a neural text semantic chunking tool that splits documents into meaningful chunks for processing. It now includes multilingual models trained on 1,833 languages using mmBERT, expanding beyond its original… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes.
- 1
TLDR: I’ve made a transformer model and a wrapper library that segments text into meaningful semantic chunks. The current text splitting approaches rely on heuristics (although one can use neural embedder to group semantically related sentences). I propose a fully neural approach to semantic chunking. I took the base distilbert model and trained it on a bookcorpus to split concatenated text paragraphs into original paragraphs. Basically it’s a token classification task. Model fine-tuning took day and a half on a 2x1080ti. The library could be used as a text splitter module in a RAG system or…
2025 · github.com · its alternatives →
- 2
I built Chonkie because I was tired of rewriting chunking code for RAG applications. Existing libraries were either too bloated (80MB+) or too basic, with no middle ground. Core features: - 21MB default install vs 80-171MB alternatives - 33x faster token chunking than popular alternatives - Supports multiple chunking strategies: token, word, sentence, and semantic - Works with all major tokenizers (transformers, tokenizers, tiktoken) - Zero external dependencies for basic functionality Technical optimizations: - Uses tiktoken with multi-threading for faster tokenization - Implements…
2024 · github.com · its alternatives →
- 3
I built this project as a way to learn more about NLP by applying it to something weird and unsolved. The Voynich Manuscript is a 15th-century book written in an unknown script. No one’s been able to translate it, and many think it’s a hoax, a cipher, or a constructed language. I wasn’t trying to decode it — I just wanted to see: does it behave like a structured language? I stripped a handful of common suffix-like endings (aiin, dy, etc.) to isolate what looked like root forms. I know that’s a strong assumption — I call it out directly in the repo — but it helped clarify the clustering. From…
2025 · github.com · its alternatives →
- 4
We release Steerling-8B, an 8B-parameter causal diffusion language model that is interpretable by construction — its predictions are routed through concepts you can measure, audit, and control.
Feb 2026 · guidelabs.ai · its alternatives →
- 5
- 6WS
We’ve trained a generative AI model to browse the web and answer questions/retrieve code snippets directly. Unlike ChatGPT, it has access to primary sources and is able to cite them when you hover over an answer (click on the text to go to the source being cited). We also show regular Bing results side-by-side with our AI answer. The model is an 11-billion parameter T5-derivative that has been fine-tuned on feedback given on hundreds of thousands of searches done (anonymously) on our platform. Giving the model web access lessens its burden to need to store a snapshot of human knowledge…
2022 · beta.sayhello.so · its alternatives →
- 7
Lingoedit 2.0▲445Simplify translation and editing: your AI language companion
2024 · its alternatives →
- 8AC
Hi HN, We’re Shreyash and Bhavnick. We built Chonkie, an open-source library for advanced chunking and embedding of text and code. It was previously Python-only, but we just released a TypeScript version: https://github.com/chonkie-inc/chonkie-ts Many AI projects in JS/TS (like those using Vercel's AI SDK or Mastra) rely on basic text splitters. But better chunking = better retrieval = better performance. That’s what Chonkie is built for. Current native chunkers (in TS): - Code Chunker – handles Python, TypeScript, etc. - Recursive Chunker – rule-based, hierarchical…
2025 · its alternatives →
- 9CT
We are excited to announce Cedille, the largest language model for French (6b parameters). Demo: https://cedille.ai Language models are general purpose AI systems that are able to solve a range of tasks by simply being prompted for it. It can be used for example to summarize text, do translations, or for idea generation & overcoming writer's block. You may know GPT-3, the humongous model from OpenAI. Cedille is a similar model targeting the French demographic - but smaller, as we don’t yet have $1b in the bank like they do. Although GPT-3 supports multiple languages including…
2021 · its alternatives →
- 10
See how a modern neural network completes your text.
2019 · inferkit.com · its alternatives →
- 11
Summarization AI▲226Instantly summarize web pages and save time
2025 · chromewebstore.google.com · its alternatives →
- 12
We developed a new framework that enables flexible control of generated text in language models. By combining several models and/or system prompts in one mathematical formula, it lets you tweak your style and combine model outputs with ease. A handy tool for those working with LLMs, looking for more fine-grained control of stylistic output. More details in our paper: https://arxiv.org/abs/2311.14479. Feedback and potential applications are welcome.
2023 · github.com · its alternatives →
- 13
- 14
- 15
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production - huggingface/tokenizers
2020 · github.com · its alternatives →
- 16
I previously posted this a month and a half ago: https://news.ycombinator.com/item?id=45876742 I have rewritten it to be much more simple, from 951 lines of code to just 364, with no loss in core functionality or generation quality. I also added a tiny GPT implementation as a comparison (inspired by Andrej Karpathy's code). The two model implementations are ~80% identical, with the core differences being the generate and get_batch functions. The model architecture, training loop, etc, differ in only 19 lines of code. Trained weights are included, so you can just clone and run…
Nov 2025 · github.com · its alternatives →
- 17
Hi HN, I’ve been working on an OCR pipeline specifically optimized for machine learning dataset preparation. It’s designed to process complex academic materials — including math formulas, tables, figures, and multilingual text — and output clean, structured formats like JSON and Markdown. Some features: • Multi-stage OCR combining DocLayout-YOLO, Google Vision, MathPix, and Gemini Pro Vision • Extracts and understands diagrams, tables, LaTeX-style math, and multilingual text (Japanese/Korean/English) • Highly tuned for ML training pipelines, including dataset generation and…
2025 · github.com · its alternatives →
- 18
We have a dataset of 3,095 standardized AI responses across 43 prompts. From each response, we extract a 32-dimension stylometric fingerprint (lexical richness, sentence structure, punctuation habits, formatting patterns, discourse markers). Some findings: - 9 clone clusters (>90% cosine similarity on z-normalized feature vectors) - Mistral Large 2 and Large 3 2512 score 84.8% on a composite metric combining 5 independent signals - Gemini 2.5 Flash Lite writes 78% like Claude 3 Opus. Costs 185x less - Meta has the strongest provider "house style" (37.5x distinctiveness ratio) - "Satirical…
Apr 2026 · rival.tips · its alternatives →
- 19
An open-source language translation system for 200 languages
2022 · github.com · its alternatives →
- 20
AI-driven Multilingual SEO to boost your global reach
2024 · multilipi.com · its alternatives →
- 21PL
Hey there HN - Today I'm sharing a demo of my our language learning tool, Phrasing. It's a tool born from the language acquisition hypothesis, too many hours in an anki slog, and a strange desire to always be learning obscure languages. The method is simple: 1. type in a show 2. learn the most important words 3. watch the show/acquire the words 4. review the words when needed in the future. On top of that, we're trying to: - do some novel things with spaced repetition (no more anki slog) - expand the sort of content you can learn from (I want to to refresh my French by reading The…
2024 · phrasing.app · its alternatives →
- 22
Neural Search. Contribute to raphaelsty/neural-cherche development by creating an account on GitHub.
2023 · github.com · its alternatives →
- 23
🔎 Search the information available on a webpage using natural language instead of an exact string match. - model-zoo/shift-ctrl-f
2020 · github.com · its alternatives →
- 24
2021 · chrome.google.com · its alternatives →
Also compare
- Chonky – a neural approach for text semantic chunking alternatives
- Chonkie – A Fast, Lightweight Text Chunking Library for RAG alternatives
- I modeled the Voynich Manuscript with SBERT to test for structure alternatives
- Steerling-8B, a language model that can explain any token it generates alternatives
- Linnk.AI alternatives
- Web search using a ChatGPT-like model that can cite its sources alternatives
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →