AI · alternatives · 2026

24 alternatives to Next-Gen AI Training: LLM-RLHF-Tuning with PPO and DPO

Comprehensive toolkit for Reinforcement Learning from Human Feedback (RLHF) training, featuring instruction fine-tuning, reward model training, and support for PPO and DPO algorithms with various configurations for the Transformer 5 models including Qwen 3.0 - raghavc/LLM-RLHF-Tuning-with-PPO-and-DP

Next-Gen AI Training is an open-source toolkit for fine-tuning large language models using reinforcement learning from human feedback methods. It implements PPO (Proximal Policy Optimization) and DPO (Direct Preference… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Next-Gen AI Training: LLM-RLHF-Tuning with PPO and DPO launched in 2024; newer entries below may have overtaken it.

1
LlamaGym – fine-tune LLM agents with online reinforcement learning▲239
Fine-tune LLM agents with online reinforcement learning - KhoomeiK/LlamaGym
2024 · github.com · its alternatives →
2
Predibase Reinforcement Fine-Tuning▲175
LLM reinforcement fine-tuning platform to improve LLM output
2025 · rubrik.com · its alternatives →
3
I RL-trained an agent that trains models with RL (for ~$1.3k)▲107
RL-training an AI agent to RL-train AI agents. Contribute to Danau5tin/ai-trains-ai development by creating an account on GitHub.
Jul 2026 · github.com · its alternatives →
4
TensorZero▲307
Hi HN! We're Gabriel & Viraj, and we're excited to open source TensorZero. To be a little cheeky, TensorZero is an open-source platform that helps LLM applications graduate from API wrappers into defensible AI products. 1. Integrate our model gateway 2. Send metrics or feedback 3. Unlock compounding improvements in quality, cost, and latency It enables a data & learning flywheel for LLMs by unifying: • Inference: one API for all LLMs, with <1ms P99 overhead • Observability: inference & feedback → your database • Optimization: better prompts, models, inference strategies • Experimentation:…
2025 · github.com · its alternatives →
5
Minimal LLM Post-Training Experiments on an 8GB GPU (SFT, DPO, GRPO)▲21
Minimal, readable LLM post-training experiments on one 8GB GPU. Measures forgetting, seed variance, and RL emergence. - pochenai/nano-llm-posttraining
Aug 2026 · github.com · its alternatives →
6
Llama 3.2 Interpretability with Sparse Autoencoders▲579
I spent a lot of time and money on this rather big side project of mine that attempts to replicate the mechanistic interpretability research on proprietary LLMs that was quite popular this year and produced great research papers by Anthropic [1], OpenAI [2] and Deepmind [3]. I am quite proud of this project and since I consider myself the target audience for HackerNews did I think that maybe some of you would appreciate this open research replication as well. Happy to answer any questions or face any feedback. Cheers [1]…
2024 · github.com · its alternatives →
7
TuneTrain.ai▲79
Do you know that Small Language Models (SLM) can outperform LLMs if trained (fine-tuned) on domain specific datasets, like your companies knowledge base? The issue: fine-tuning a SLM usually requires a dataset of 10k - 100k records, which is huge. I created a platform for applying "human in the loop" augmentation techniques on your small dataset, so that you can start with maybe 100 records and build-up quickly huge datasets and launch a training without prior knowledge. I implemented 2 techniques, based on LLM distillation, however: more to come. HN, what Do you think? Do you see value in…
2025 · tunetrain.ai · its alternatives →
8BP
Beating Pokemon Red with RL and <10M Parameters▲183
Hi everyone! After spending hundreds of hours, we're excited to finally share our progress in developing a reinforcement learning system to beat Pokémon Red. Our system successfully completes the game using a policy under 10M parameters, PPO, and a few novel techniques. With the release of Claude Plays Pokémon, now feels like the perfect time to showcase our work. We'd love to get feedback!
2025 · drubinstein.github.io · its alternatives →
9
Multi-GPU Reinforcement Learning in Tensorflow for OpenAI Gym▲58
Multi-GPU reinforcement learning using Deep Q-Network in TensorFlow for OpenAI Gym - vishar0/dist-dqn
2016 · github.com · its alternatives →
10
Netmind Power▲272
Hi HN, We just opened public access to Qwen3‑Coder‑480B‑A35B‑Instruct via a REST/SDK API. Why it might be interesting: - Fully open-source (Apache‑2.0): https://github.com/QwenLM/Qwen3-Coder - 480B params (35B active MoE), long context up to 1M tokens with YaRN - Matches Claude Sonnet/GPT‑4o on SWE-Bench Verified (81.6%) - Free tier: 100K tokens/month
2023 · netmind.ai · its alternatives →
11
Monostate AItraining▲59
Fine-tuning, RL, and inference in one CLI
Dec 2025 · github.com · its alternatives →
12
LLM Alignment Template – Aligning Language Models with Human Feedback▲9
Hey Hacker News! I've been working on an open-source project called LLM Alignment Template, a comprehensive toolkit designed to help researchers, developers, and data scientists align large language models (LLMs) with human values using Reinforcement Learning from Human Feedback (RLHF). What the project does: Interactive Web Interface: Easily train models, visualize alignment metrics, and manage alignment with an accessible UI. Training with RLHF: Align models effectively to human preferences using feedback loops. Explainability: Built-in dashboards to help understand model behavior using…
2024 · github.com · its alternatives →
13
Watch a neural net learn to play Snake▲205
In browser PPO training demo, made possible by tinygrad: TinyJit -> WebGPU kernels. Requires WebGPU.
May 2026 · ppo.gradexp.xyz · its alternatives →
14
ART – a new open-source RL framework for training agents▲116
Hey HN, I wanted to share a new project we've been working on for the last couple of months called ART (https://github.com/OpenPipe/ART). ART is a new open-source framework for training agents using reinforcement learning (RL). RL allows you to train an agent to perform better at any task whose outcome can be measured and quantified. There are many excellent projects focused on training LLMs with RL, such as GRPOTrainer (https://huggingface.co/docs/trl/main/en/grpo_trainer) and verl…
2025 · github.com · its alternatives →
15RA
RL Agent that can auto-optimize your LLM prompts▲14
Hey everyone! Along with my team, I've developed a reinforcement learning system that automatically optimizes LLM prompts, complete with a visualization feature to track both prompt structure and learning progress over time. Take a look here: https://nomadic-ml.github.io/nomadic/cookbooks/Nomadic_Promp... Check out our website too:https://www.nomadicml.com/ In terms of how this visualization works: The RL Prompt Optimizer employs a reinforcement learning framework to iteratively improve prompts used for language model evaluations. At each episode, the…
2024 · nomadic-ml.github.io · its alternatives →
16
Create your own finetuned AI model using Google Sheets▲137
Hello HN, We built Promptrepo to make finetuning accessible to product teams — not just ML engineers. Last week, OpenAI’s CPO shared how they use fine-tuning for everything from customer support to deep research, and called it the future for serious AI teams. Yet most teams I know still rely on prompting, because fine-tuning is too technical, while the people who have the training data (product managers and domain experts) are often non-technical. With Promptrepo, they can now: - Add training examples in Google Sheets - Click a button to train - Deploy and test instantly - Use OpenAI,…
2025 · promptrepo.com · its alternatives →
17
Taylor AI▲118
Fine-tune open source LLMs in minutes
2023 · trytaylor.ai · its alternatives →
18
FinetuneDB – AI fine-tuning platform to create custom LLMs▲152
Hey HN! We’re building FinetuneDB (https://finetunedb.com/), an LLM fine-tuning platform. It enables teams to easily create and manage high-quality datasets, and streamlines the entire workflow from fine-tuning to serving and evaluating models with domain experts. You can check out our docs here: (https://docs.finetunedb.com/) FinetuneDB exists because creating and managing high-quality datasets is a real bottleneck when fine-tuning LLMs. The quality of your data directly impacts the performance of your fine-tuned models, and existing tools didn’t offer an easy…
2024 · finetunedb.com · its alternatives →
19
Arkor▲142
Fine-tune and Deploy Open-weight Models in TypeScript
Jul 2026 · arkor.ai · its alternatives →
20
Improve LLM Performance by Maximizing Iterative Development▲104
I have been working in AI space for a while now, first at FAANG with ML since 2021, then with LLM in start-ups since early 2023. I think LLM Application development is extremely iterative, more so than any other types of development. This is because to improve an LLM application performance (accuracy, hallucinations, latency, cost), you need to try various combinations of LLM models, prompt templates (e.g., few-shot, chain-of-thought), prompt context with different RAG architecture, different agent architecture, and more. There are thousands of possible combinations and you need a process…
2024 · github.com · its alternatives →
21
Fast Deep Reinforcement Learning Course▲148
I worked on this applied Deep Reinforcement Learning course for the better part of 2021. I made a Datacamp course [0] before, and this served as my inspiration to make an applied Deep RL series. Normally, Deep RL courses teach a lot of mathematically involved theory. You get the practical applications near the end (if at all). I have tried to turn that on its head. In the top-down approach, you learn practical skills first, then go deeper later. This is much more fun. This course (the first in a planned multi-part series) shows how to use the Deep Reinforcement Learning framework RLlib to…
2022 · courses.dibya.online · its alternatives →
22
Fine-tune an 8B model on a 4 GB laptop GPU▲139
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU. - MakazhanAlpamys/Soup
Aug 2026 · github.com · its alternatives →
23
Terminal-Bench-RL: Training long-horizon terminal agents with RL▲125
After training calculator agent via RL, I really wanted to go bigger! So I built RL infrastructure for training long-horizon terminal/coding agents that scales from 2x A100s to 32x H100s (~$1M worth of compute!) Without any training, my 32B agent hit #19 on Terminal-Bench leaderboard, beating Stanford's Terminus-Qwen3-235B-A22! With training... well, too expensive, but I bet the results would be good! *What I did*: - Created a Claude Code-inspired agent (system msg + tools) - Built Docker-isolated GRPO training where each rollout gets its own container - Developed a multi-agent…
2025 · github.com · its alternatives →
24
Monostate▲73
Vibe Training AI models
Mar 2026 · its alternatives →

Also compare

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →