AI · alternatives · 2026

24 alternatives to LLM Aided Transcription Improvement

I recently submitted another project for using LLMs to correct errors and improve formatting of OCRed documents which was well received. The low cost and high quality/speed of the latest "value tier" models from OpenAI and Anthropic have made it possible to get compelling results at a very reasonable price in that application. It occured to me that the same approach taken there (namely, splitting documents into chunks and sending each chunk through a chain of LLM prompts that each take the output of the previous prompt and apply an additional layer of processing) could be easily applied…

LLM Aided Transcription Improvement uses large language models to refine raw speech transcripts by correcting errors, improving coherence, adding punctuation, and applying formatting. It processes transcripts in chunks… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. LLM Aided Transcription Improvement launched in 2024; newer entries below may have overtaken it.

1
LLM-aided OCR – Correcting Tesseract OCR errors with LLMs▲479
Almost exactly 1 year ago, I submitted something to HN about using Llama2 (which had just come out) to improve the output of Tesseract OCR by correcting obvious OCR errors [0]. That was exciting at the time because OpenAI's API calls were still quite expensive for GPT4, and the cost of running it on a book-length PDF would just be prohibitive. In contrast, you could run Llama2 locally on a machine with just a CPU, and it would be extremely slow, but "free" if you had a spare machine lying around. Well, it's amazing how things have changed since then. Not only have models gotten a lot better,…
2024 · github.com · its alternatives →
2
Llama 3.2 Interpretability with Sparse Autoencoders▲579
I spent a lot of time and money on this rather big side project of mine that attempts to replicate the mechanistic interpretability research on proprietary LLMs that was quite popular this year and produced great research papers by Anthropic [1], OpenAI [2] and Deepmind [3]. I am quite proud of this project and since I consider myself the target audience for HackerNews did I think that maybe some of you would appreciate this open research replication as well. Happy to answer any questions or face any feedback. Cheers [1]…
2024 · github.com · its alternatives →
3
Beyond text splitting – improved file parsing for LLMs▲206
Improved file parsing for LLM’s. Contribute to Filimoa/open-parse development by creating an account on GitHub.
2024 · github.com · its alternatives →
4IT
I trained a 9M speech model to fix my Mandarin tones▲469
Built this because tones are killing my spoken Mandarin and I can't reliably hear my own mistakes. It's a 9M Conformer-CTC model trained on ~300h (AISHELL + Primewords), quantized to INT8 (11 MB), runs 100% in-browser via ONNX Runtime Web. Grades per-syllable pronunciation + tones with Viterbi forced alignment. Try it here: https://simedw.com/projects/ear/
Jan 2026 · simedw.com · its alternatives →
5
Using LLama2 to Correct OCR Errors▲54
I've been disappointed by the very poor quality of results that I generally get when trying to run OCR on older scanned documents, especially ones that are typewritten or otherwise have unusual or irregular typography. I recently had the idea of using Llama2 to use common sense reasoning and subject level expertise to correct transcription errors in a "smart" way-- basically doing what a human proofreader who is familiar with the topic might do. I came up with the linked script that takes a PDF as input, runs Tesseract on it to get an initial text extraction, and then feeds this…
2023 · github.com · its alternatives →
6
TensorZero▲307
Hi HN! We're Gabriel & Viraj, and we're excited to open source TensorZero. To be a little cheeky, TensorZero is an open-source platform that helps LLM applications graduate from API wrappers into defensible AI products. 1. Integrate our model gateway 2. Send metrics or feedback 3. Unlock compounding improvements in quality, cost, and latency It enables a data & learning flywheel for LLMs by unifying: • Inference: one API for all LLMs, with <1ms P99 overhead • Observability: inference & feedback → your database • Optimization: better prompts, models, inference strategies • Experimentation:…
2025 · github.com · its alternatives →
7
Fine-grained stylistic control of LLMs using model arithmetic▲85
We developed a new framework that enables flexible control of generated text in language models. By combining several models and/or system prompts in one mathematical formula, it lets you tweak your style and combine model outputs with ease. A handy tool for those working with LLMs, looking for more fine-grained control of stylistic output. More details in our paper: https://arxiv.org/abs/2311.14479. Feedback and potential applications are welcome.
2023 · github.com · its alternatives →
8
Improve LLM Performance by Maximizing Iterative Development▲104
I have been working in AI space for a while now, first at FAANG with ML since 2021, then with LLM in start-ups since early 2023. I think LLM Application development is extremely iterative, more so than any other types of development. This is because to improve an LLM application performance (accuracy, hallucinations, latency, cost), you need to try various combinations of LLM models, prompt templates (e.g., few-shot, chain-of-thought), prompt context with different RAG architecture, different agent architecture, and more. There are thousands of possible combinations and you need a process…
2024 · github.com · its alternatives →
9
Improve Text-to-SQL Accuracy with LLM▲17
A repository that contains models, datasets, and fine-tuning techniques for DB-GPT, with the purpose of enhancing model performance in Text-to-SQL - eosphoros-ai/DB-GPT-Hub
2023 · github.com · its alternatives →
10
TuneTrain.ai▲79
Do you know that Small Language Models (SLM) can outperform LLMs if trained (fine-tuned) on domain specific datasets, like your companies knowledge base? The issue: fine-tuning a SLM usually requires a dataset of 10k - 100k records, which is huge. I created a platform for applying "human in the loop" augmentation techniques on your small dataset, so that you can start with maybe 100 records and build-up quickly huge datasets and launch a training without prior knowledge. I implemented 2 techniques, based on LLM distillation, however: more to come. HN, what Do you think? Do you see value in…
2025 · tunetrain.ai · its alternatives →
11
I just open sourced my document/website extractor for Vision-LLMs▲37
Hi HackerNews, Lately, I have seen an explosion in posts offering paid APIs/services to get unstructured data into LLMs (i.e. langchain extract, ragflow, unstructured, unstract, just to name a few) and I have been largely disappointed by them, either because they fail to implement multimodal support, fail to give good context for "really tricky" PDFs / Word docs / Powerpoints, or are just plain difficult to use. In light of all these posts I figured I'd share my solution that has been working smoothly for me and my clients. I put it up on GitHub for free so you can check it…
2024 · github.com · its alternatives →
12
Turn native language audio into flashcards and shadowing practice▲92
Here is a tool I built initially for myself to help with my German and Greek language studies. It started as a hack for creating Anki cards from native language audio. It extracts the words, finds their base forms (lemmas) and groups the examples by the lemma. At some point I realised that I have a transcription with word level timestamps that opens a lot of other opportunities. So I added a mode to click the first and last word in the transcript and it starts looping with the right gap and repeat count. Another feature I use a lot is selecting an audio fragment, sending a predefined prompt…
Jun 2026 · lingochunk.com · its alternatives →
13
LLM, a Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)▲45
G'day, HN! I'm one of the maintainers of `llm`. I've been working alongside a trusty group of contributors to bring this project to life, and we're now at a point where we're ready to share it with the world. Large language models (LLMs) are taking the computing world by storm due to their emergent abilities that allow them to perform a wide variety of tasks, including translation, summarization, code generation, and even some degree of reasoning. However, the ecosystem around LLMs is still in its infancy, and it can be difficult to get started with these models. `llm` is a one-stop shop for…
2023 · github.com · its alternatives →
14
A private, flat monthly subscription for open-source LLMs▲31
Hey HN! We've run our privacy-focused open-source inference company for a while now, and we're launching a flat monthly subscription similar to Anthropic's. It should work with Cline, Roo, KiloCode, Aider, etc — any OpenAI-compatible API client should do. The rate limits at every tier are higher than the Claude rate limits, so even if you prefer using Claude it can be a helpful backup for when you're rate limited, for a pretty low price. Let me know if you have any feedback!
2025 · synthetic.new · its alternatives →
15
Reducing LLM input tokens by 70%▲56
Run GPT-OSS, Qwen, Llama, and DeepSeek through one OpenAI-compatible API with streaming and clear usage-based pricing.
May 2026 · adola.app · its alternatives →
16AT
A tool to benchmark LLM APIs (OpenAI, Claude, local/self-hosted)▲55
I recently built a small open-source tool to benchmark different LLM API endpoints — including OpenAI, Claude, and self-hosted models (like llama.cpp). It runs a configurable number of test requests and reports two key metrics: • First-token latency (ms): How long it takes for the first token to appear • Output speed (tokens/sec): Overall output fluency Demo: https://llmapitest.com/ Code: https://github.com/qjr87/llm-api-test The goal is to provide a simple, visual, and reproducible way to evaluate performance across different LLM providers, including…
2025 · llmapitest.com · its alternatives →
17UY
UpTrain (YC W23) – open-source tool to evaluate LLM response quality▲12
Hello, we are Shikha and Sourabh, founders of UpTrain(YC W23) - an open-source tool to evaluate the performance of your LLM applications on aspects such as correctness, tonality, hallucination, fluency, etc. The Problem: Unlike traditional Machine learning or Deep learning models where we always have a unique Ground Truth and can define metrics like Precision, Recall, accuracy, etc. to quantify the model’s performance, LLMs are trickier and it is very difficult to estimate if their response is correct or not. If you are using GPT-4 to write a recruitment email, there is no unique correct…
2023 · demo.uptrain.ai · its alternatives →
18
LLM-docs, software documentation intended for consumption by LLMs▲28
I was inspired by a recent tweet by Andrej Karpathy, as well as my own experience copying and pasting a bunch of html docs into Claude yesterday and bemoaning how long-winded and poorly formatted it was. I’m trying to decide if I should make it into a full-fledged service and completely automate the process of generating the distilled documentation. Problem is that it would cost a lot in API tokens and wouldn’t generate any revenue (plus it would have to be updated as documentation changes significantly). Maybe Anthropic wants to fund it as a public good? Let me know!
2025 · github.com · its alternatives →
19
10x better performance from the Coding Harnesses with LLM-wiki▲16
Build source-backed knowledge bases with Claude Code, Codex, OpenCode, or any AI agent. Export Project Knowledge Checkpoints, apply personal specialist review methods, shape Ideas, and promote approved work into Projects.
Jun 2026 · llm-wiki.net · its alternatives →
20
LLM Alignment Template – Aligning Language Models with Human Feedback▲9
Hey Hacker News! I've been working on an open-source project called LLM Alignment Template, a comprehensive toolkit designed to help researchers, developers, and data scientists align large language models (LLMs) with human values using Reinforcement Learning from Human Feedback (RLHF). What the project does: Interactive Web Interface: Easily train models, visualize alignment metrics, and manage alignment with an accessible UI. Training with RLHF: Align models effectively to human preferences using feedback loops. Explainability: Built-in dashboards to help understand model behavior using…
2024 · github.com · its alternatives →
21
Fine-tuned Llama 3.2 3B to match 70B models for local transcripts▲31
I wrote a small local tool to transcribe audio notes (Whisper/Parakeet). Code: https://github.com/bilawalriaz/lazy-notes I wanted to process raw transcripts locally without OpenRouter. Llama 3.2 3B with a prompt was decent but incomplete, so I tried SFT. I fine-tuned Llama 3.2 3B to clean/analyze dictation and emit structured JSON (title, tags, entities, dates, actions). Data: 13 real memos → Kimi K2 gold JSON → ~40k synthetic + gold; keys canonicalized. Chutes.ai (5k req/day). Training: RTX 4090 24GB, ~4h, LoRA (r=128, α=128, dropout=0.05), max seq 2048,…
2025 · bilawal.net · its alternatives →
22
Minimal LLM Post-Training Experiments on an 8GB GPU (SFT, DPO, GRPO)▲21
Minimal, readable LLM post-training experiments on one 8GB GPU. Measures forgetting, seed variance, and RL emergence. - pochenai/nano-llm-posttraining
Aug 2026 · github.com · its alternatives →
23
Toolkit for LLM Fine-Tuning, Ablating and Testing▲14
Hello all! Very happy to share this toolkit that allows you to fine-tune your choice of open-source LLMs on your data! The toolkit also allows you to run ablation studies across LLMs, prompt designs, training configurations, and can ingest different data files -- all through just ONE YAML file! After fine-tuning, you can also run a bunch of tests to ensure that the fine-tuned LLM behaves as expected, enabling faster time-to-production! Why this toolkit? Why now? While closed-source LLMs have become popular for chat-based applications, enterprises are considering a shift to self-hosted SLMs…
2024 · github.com · its alternatives →
24
UpTrain – A Practical Approach to Finetuning LLMs for Custom Use-Cases▲10
2023 · github.com · its alternatives →

Also compare

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →