Beyond text splitting – improved file parsing for LLMs

In plain words

This tool addresses a common challenge in preparing documents for large language models by offering enhanced file parsing beyond simple text splitting. It's designed for developers and AI practitioners who need more sophisticated document processing before feeding content to LLMs. The approach improves upon basic text chunking methods, potentially preserving document structure and context better for downstream AI applications.

written from the facts on this page · September 2026

• 
  Open-source, high performance layout parsing for LLM's2024 · github.com · ▲13

  Improved file parsing for LLM’s. Contribute to Filimoa/open-parse development by creating an account on GitHub.

• 
  Megaparse [LW24]2024 · megaparse.com · ▲289

  Open-source Document Parser to Markdown with OCR/LLMs

• 
  Document Parser by Contextual AI2025 · docs.contextual.ai · ▲118

  Rank a list of documents according to their relevance to a query primarily and your custom instructions secondarily. We evaluated the model on instructions for recency, document type, source, and metadata, and it can generalize to other instructions as well. The reranker supports multilinguality. Th

• 
  Preprocess2025 · preprocess.co · ▲106

  Preprocess maximises RAG performances

• 
  l1m.io2025 · l1m.io · ▲135

  The simplest API to get structured data from any LLM

• 
  Chonky – a neural approach for text semantic chunking2025 · github.com · ▲169

  TLDR: I’ve made a transformer model and a wrapper library that segments text into meaningful semantic chunks. The current text splitting approaches rely on heuristics (although one can use neural embedder to group semantically related sentences). I propose a fully neural approach to semantic chunking. I took the base distilbert model and trained it on a bookcorpus to split concatenated text paragraphs into original paragraphs. Basically it’s a token classification task. Model fine-tuning took day and a half on a 2x1080ti. The library could be used as a text splitter module in a RAG system or…

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 17d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 17d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 19d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 20d ago · stillwet.art

• 
  PixVerse R2▲381

  A real-time world model you can explore and change

  AI · 29d ago · world.pixverse.video

• 
  Hemory▲381

  Keep listening. Searchable memory for your AI agents.

  AI · 29d ago · hemory.com

• 
  Supabase▲2,325

  The Postgres developer platform is now generally available

  Dev tools · 2024 · supabase.com

• 
  Cal.com Platform▲1,601

  Build your pixel-perfect booking experience with Atoms

  Dev tools · 2024 · cal.com

• 
  PaddleBoat▲1,162

  Perfect your sales pitch with realistic AI roleplays

  AI · 2024 · padboat.com

• 
  deco.cx 2.0▲1,078

  Build web apps 10x faster with Deno, JSX, TS & Tailwind

  Dev tools · 2024 · decocms.com

• 
  IXORD AI▲955

  Navigate tasks, ignite creativity

  AI · 2024

• 
  Assista AI▲949

  A central nervous system for all your productivity apps

  AI · 2024 · getassista.com