AI · alternatives · 2026
24 alternatives to Chonky – a neural approach for text semantic chunking
TLDR: I’ve made a transformer model and a wrapper library that segments text into meaningful semantic chunks. The current text splitting approaches rely on heuristics (although one can use neural embedder to group semantically related sentences). I propose a fully neural approach to semantic chunking. I took the base distilbert model and trained it on a bookcorpus to split concatenated text paragraphs into original paragraphs. Basically it’s a token classification task. Model fine-tuning took day and a half on a 2x1080ti. The library could be used as a text splitter module in a RAG system or…
Chonky is a neural text chunking tool that segments documents into meaningful semantic chunks using a transformer model trained on the BookCorpus dataset. Unlike traditional heuristic-based approaches, it uses a fully… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes.
- 1
TLDR: I’m expanding the family of text-splitting Chonky models with new multilingual model. You can learn more about this neural approach in a previous post: https://news.ycombinator.com/item?id=43652968 Since the release of the first distilbert-based model I’ve released two more models based on a ModernBERT. All these models were pre-trained and fine-tuned primary on English texts. But recently mmBERT(https://huggingface.co/blog/mmbert) has been released. This model pre-trained on massive dataset that contains 1833 languages. So I had an idea of…
Oct 2025 · huggingface.co · its alternatives →
- 2
I built Chonkie because I was tired of rewriting chunking code for RAG applications. Existing libraries were either too bloated (80MB+) or too basic, with no middle ground. Core features: - 21MB default install vs 80-171MB alternatives - 33x faster token chunking than popular alternatives - Supports multiple chunking strategies: token, word, sentence, and semantic - Works with all major tokenizers (transformers, tokenizers, tiktoken) - Zero external dependencies for basic functionality Technical optimizations: - Uses tiktoken with multi-threading for faster tokenization - Implements…
2024 · github.com · its alternatives →
- 3
Gist AI▲646Free website, YouTube, PDF summarizer, powered by ChatGPT
2023 · gistai.tech · its alternatives →
- 4
- 5
I built this project as a way to learn more about NLP by applying it to something weird and unsolved. The Voynich Manuscript is a 15th-century book written in an unknown script. No one’s been able to translate it, and many think it’s a hoax, a cipher, or a constructed language. I wasn’t trying to decode it — I just wanted to see: does it behave like a structured language? I stripped a handful of common suffix-like endings (aiin, dy, etc.) to isolate what looked like root forms. I know that’s a strong assumption — I call it out directly in the repo — but it helped clarify the clustering. From…
2025 · github.com · its alternatives →
- 6AC
Hi HN, We’re Shreyash and Bhavnick. We built Chonkie, an open-source library for advanced chunking and embedding of text and code. It was previously Python-only, but we just released a TypeScript version: https://github.com/chonkie-inc/chonkie-ts Many AI projects in JS/TS (like those using Vercel's AI SDK or Mastra) rely on basic text splitters. But better chunking = better retrieval = better performance. That’s what Chonkie is built for. Current native chunkers (in TS): - Code Chunker – handles Python, TypeScript, etc. - Recursive Chunker – rule-based, hierarchical…
2025 · its alternatives →
- 7WS
We’ve trained a generative AI model to browse the web and answer questions/retrieve code snippets directly. Unlike ChatGPT, it has access to primary sources and is able to cite them when you hover over an answer (click on the text to go to the source being cited). We also show regular Bing results side-by-side with our AI answer. The model is an 11-billion parameter T5-derivative that has been fine-tuned on feedback given on hundreds of thousands of searches done (anonymously) on our platform. Giving the model web access lessens its burden to need to store a snapshot of human knowledge…
2022 · beta.sayhello.so · its alternatives →
- 8
- 9
- 10
See how a modern neural network completes your text.
2019 · inferkit.com · its alternatives →
- 11
We release Steerling-8B, an 8B-parameter causal diffusion language model that is interpretable by construction — its predictions are routed through concepts you can measure, audit, and control.
Feb 2026 · guidelabs.ai · its alternatives →
- 12
I built this tool because I wanted a way to just take a bunch of URLs or domains, and query their content in RAG applications. It takes away the pain of crawling, extracting content, chunking, vectorizing, and updating periodically. I'm curious to see if it can be useful to others. I meant to launch this six months ago but life got in the way...
2024 · embedding.io · its alternatives →
- 13
Hey HN! I love finding new books to read on here. I wanted to gather the most mentioned books and recreate the serendipity of physical browsing. I scraped 20k comments from HN threads related to reading, extracted the references and opinions using GPT-4o mini, and visualised their embeddings as a map. - OpenAI's embeddings were processed using UMAP and HDBSCAN. A direct 2D projection from the text embeddings didn't yield visually interesting results. Instead, HDBSCAN is first applied on a high-dimensional projection. Those clusters tend to correspond to different genres. The genre…
2024 · hnbooks.pieterma.es · its alternatives →
- 14NL
Link: https://www.nlpdemystified.org/ Hi HN: After a year of work, I've published my free NLP course. The course helps anyone who knows Python and a bit of math go from the basics to today's mainstream models and frameworks. I strive to balance theory and practice, so every module consists of detailed explanations and slides along with a Colab notebook putting the ideas into practice (in most modules). The notebooks cover how to accomplish everyday NLP tasks including extracting key information, document search, text similarity, text classification, finding topics in…
2022 · its alternatives →
- 15
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production - huggingface/tokenizers
2020 · github.com · its alternatives →
- 16
We have a dataset of 3,095 standardized AI responses across 43 prompts. From each response, we extract a 32-dimension stylometric fingerprint (lexical richness, sentence structure, punctuation habits, formatting patterns, discourse markers). Some findings: - 9 clone clusters (>90% cosine similarity on z-normalized feature vectors) - Mistral Large 2 and Large 3 2512 score 84.8% on a composite metric combining 5 independent signals - Gemini 2.5 Flash Lite writes 78% like Claude 3 Opus. Costs 185x less - Meta has the strongest provider "house style" (37.5x distinctiveness ratio) - "Satirical…
Apr 2026 · rival.tips · its alternatives →
- 17GB
Hey everyone, I wanted to share a new tool we've created called Jotte (https://jotte.ai) which we believe can be a game-changer for AI-generated longform writing like novels and research papers. As you may know, current AI like ChatGPT and GPT-3 have a token limit of around 4000 tokens or 3000 words, which limits their effectiveness for longer writing tasks. With Jotte, we've developed a graph-based approach to summarize information and effectively give AI "unlimited" memory. Jotte remembers recent details like the meal a character ate a page ago, while avoiding getting bogged down…
2023 · jotte.ai · its alternatives →
- 18
Bibby AI ▲165Hi, Fellow researcher from Yale, I was frustrated with Overleaf and google docs not able to write and collaborate on documents the way I wanted to. I write my research in Latex but since Cursor came out, I thought this has to change, I'm wasting too much time and having mental fog all the time, kinda going through writer's block and hence I decided to create this latex writing assistant for myself but now used by a ton of researchers, I wanted your feedback, what you like, what you don't like, alternatives you've seen, what you would like to have, nice to have, you'd definitely pay to have,…
Apr 2026 · trybibby.com · its alternatives →
- 19RL
Documentation for Diffbot — transform the raw web into structured knowledge.
2011 · diffbot.com · its alternatives →
- 20
Hi HN: I published part one of my free NLP course. The course is intended to help anyone who knows Python and a bit of math go from the very basics all the way to today's mainstream models and frameworks. I strive to balance theory and practice and so every module consists of detailed explanations and slides along with a Colab notebook (in most modules) putting the theory into practice. In part one, we cover text preprocessing, how to turn text into numbers, and multiple ways to classify and search text using "classical" approaches. And along the way, we'll pick up useful bits on how to use…
2022 · nlpdemystified.org · its alternatives →
- 21
Neural Search. Contribute to raphaelsty/neural-cherche development by creating an account on GitHub.
2023 · github.com · its alternatives →
- 22
Simple and customizable text classification with AI
2019 · monkeylearn.com · its alternatives →
- 23
2021 · chrome.google.com · its alternatives →
- 24
We developed a new framework that enables flexible control of generated text in language models. By combining several models and/or system prompts in one mathematical formula, it lets you tweak your style and combine model outputs with ease. A handy tool for those working with LLMs, looking for more fine-grained control of stylistic output. More details in our paper: https://arxiv.org/abs/2311.14479. Feedback and potential applications are welcome.
2023 · github.com · its alternatives →
Also compare
- Chonky – a neural text semantic chunking goes multilingual alternatives
- Chonkie – A Fast, Lightweight Text Chunking Library for RAG alternatives
- Gist AI alternatives
- Tidyread alternatives
- I modeled the Voynich Manuscript with SBERT to test for structure alternatives
- Advanced Chunking in JavaScript/TypeScript with Chonkie alternatives
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →