Advanced Chunking in JavaScript/TypeScript with Chonkie

In plain words

Chonkie is an open-source TypeScript library for splitting and preparing text and code for AI applications. It provides multiple chunking strategies including code-aware, recursive, token-based, and sentence-level splitting, with support for custom tokenizers and delimiters across languages. Designed for JavaScript and TypeScript projects using AI frameworks, Chonkie aims to improve retrieval quality and AI performance compared to basic text splitters.

written from the facts on this page · September 2026

From the sources

In the maker’s words, at launch

Hi HN, We’re Shreyash and Bhavnick. We built Chonkie, an open-source library for advanced chunking and embedding of text and code. It was previously Python-only, but we just released a TypeScript version: https://github.com/chonkie-inc/chonkie-ts Many AI projects in JS/TS (like those using…

• 
  Chonkie – A Fast, Lightweight Text Chunking Library for RAG2024 · github.com · ▲199

  I built Chonkie because I was tired of rewriting chunking code for RAG applications. Existing libraries were either too bloated (80MB+) or too basic, with no middle ground. Core features: - 21MB default install vs 80-171MB alternatives - 33x faster token chunking than popular alternatives - Supports multiple chunking strategies: token, word, sentence, and semantic - Works with all major tokenizers (transformers, tokenizers, tiktoken) - Zero external dependencies for basic functionality Technical optimizations: - Uses tiktoken with multi-threading for faster tokenization - Implements…

• 
  Chonky – a neural approach for text semantic chunking2025 · github.com · ▲169

  TLDR: I’ve made a transformer model and a wrapper library that segments text into meaningful semantic chunks. The current text splitting approaches rely on heuristics (although one can use neural embedder to group semantically related sentences). I propose a fully neural approach to semantic chunking. I took the base distilbert model and trained it on a bookcorpus to split concatenated text paragraphs into original paragraphs. Basically it’s a token classification task. Model fine-tuning took day and a half on a 2x1080ti. The library could be used as a text splitter module in a RAG system or…

• 
  Ultra-lightweight chunker library with emoji support2025 · github.com · ▲19

  I kept rewriting the same array.slice(i, i + n) logic in every project. Eventually, I decided to stop and just make a utility. Chonkify is a small (~870B), zero-dependency JS/TS library for chunking any kind of data: - Works with Array, String, Buffer, Set, Map, Array-like, TypedArray - Handles AsyncIterable (great for batching streams) - Unicode-safe (correctly handles grapheme clusters, emoji, etc.) - ESM-first, TypeScript-ready I mostly made it for myself, but figured others might find it useful too. Would love feedback!

• 
  Chonky – a neural text semantic chunking goes multilingualOct 2025 · huggingface.co · ▲43

  TLDR: I’m expanding the family of text-splitting Chonky models with new multilingual model. You can learn more about this neural approach in a previous post: https://news.ycombinator.com/item?id=43652968 Since the release of the first distilbert-based model I’ve released two more models based on a ModernBERT. All these models were pre-trained and fine-tuned primary on English texts. But recently mmBERT(https://huggingface.co/blog/mmbert) has been released. This model pre-trained on massive dataset that contains 1833 languages. So I had an idea of…

• CC
  Chonkie Cloud – No-nonsense chunking now on the the cloud2025 · cloud.chonkie.ai · ▲6

  Hey HN, We’re the developers of Chonkie, a powerful and easy-to-use chunking library. Last November, we introduced Chonkie OSS here on HN (https://news.ycombinator.com/item?id=42100819) and got some fantastic feedback. Today, we’re excited to share Chonkie Cloud, a fully hosted service for chunking, along with new tools to make building and debugging RAG systems easier than ever. --- A quick recap for context: We launched Chonkie as an open-source project late last year. A few weeks ago, we decided to go full-time on it. Unfortunately, this shift wasn’t as smooth as we had…

• 
  ChunkHound, a local-first tool for understanding large codebasesJan 2026 · github.com · ▲114

  ChunkHound’s goal is simple: local-first codebase intelligence that helps you pull deep, core-dev-level insights on demand, generate always-up-to-date docs, and scale from small repos to enterprise monorepos — while staying free + open source and provider-agnostic (VoyageAI / OpenAI / Qwen3, Anthropic / OpenAI / Gemini / Grok, and more). I’d love your feedback — and if you have, thank you for being part of the journey!

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 17d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 17d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 18d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 20d ago · stillwet.art

• 
  Onepin▲384

  AI voiceover with every name, price and date said right

  AI · 30d ago · onepin.ai

• 
  PixVerse R2▲381

  A real-time world model you can explore and change

  AI · 29d ago · world.pixverse.video

• 
  Tapflow 2.0▲1,125

  We built Tapflow for devs, designers, PMs, and tech folks who’ve been sitting on internal docs, templates, and systems — but never productized them. Upload a PDF, notes, or workshop deck, and Tapflow drafts a structured product (with chapters, teaser and pricing plans). It’s good for AI kits, onboarding guides, design systems, and frameworks. You can sell through Stripe, LemonSqueezy, or PayPal. Real-time collaboration is in early beta. No site builder, no LMS — clean design and just focused tools to ship. Fully bootstrapped and just launched on PH today →…

  Work · 2025 · tapflow.ai

• C9
  Clippy – 90s UI for local LLMs▲1,122

  Life & fun · 2025 · felixrieseberg.github.io

• 
  Appwrite Sites▲990

  Appwrite 2.0 brings a new engine, a rebuilt Console, five database types, an S3 API, an OAuth 2.1 server, and organization-level Domains and Firewall.

  Dev tools · 2025 · appwrite.io

• 
  AI Meeting Notes by Notion▲965

  Perfect meeting memory in Notion

  AI · 2025 · notion.com

• 
  Den▲948

  Multiplayer AI agent builder

  AI · 2025 · getden.io

• 
  Raycast for iOS▲870

  Powerful productivity on the go

  AI · 2025 · raycast.com