Next-Gen AI Training: LLM-RLHF-Tuning with PPO and DPO
Comprehensive toolkit for Reinforcement Learning from Human Feedback (RLHF) training, featuring instruction fine-tuning, reward model training, and support for PPO and DPO algorithms with various configurations for the Transformer 5 models including Qwen 3.0 - raghavc/LLM-RLHF-Tuning-with-PPO-and-DP
Next-Gen AI Training: LLM-RLHF-Tuning with PPO and DPO launched on March 18, 2024 with 30 votes, #1,077 of 4,270 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 2 years on.
In plain words
Next-Gen AI Training is an open-source toolkit for fine-tuning large language models using reinforcement learning from human feedback methods. It implements PPO (Proximal Policy Optimization) and DPO (Direct Preference Optimization) algorithms. The tool is designed for machine learning engineers and researchers who want to optimize LLM behavior based on human preferences. It provides practical implementations of advanced training techniques typically used in production model development.
written from the facts on this page · September 2026
From the sources
Comprehensive toolkit for Reinforcement Learning from Human Feedback (RLHF) training, featuring instruction fine-tuning, reward model training, and support for PPO and DPO algorithms with various configurations for the Transformer 5 models including Qwen 3.0 - raghavc/LLM-RLHF-Tuning-with-PPO-and-DPO
Does a similar job
all alternatives →
LlamaGym – fine-tune LLM agents with online reinforcement learning2024 · github.com · ▲239Fine-tune LLM agents with online reinforcement learning - KhoomeiK/LlamaGym
Predibase Reinforcement Fine-Tuning2025 · rubrik.com · ▲175LLM reinforcement fine-tuning platform to improve LLM output
I RL-trained an agent that trains models with RL (for ~$1.3k)Jul 2026 · github.com · ▲107RL-training an AI agent to RL-train AI agents. Contribute to Danau5tin/ai-trains-ai development by creating an account on GitHub.
TensorZero2025 · github.com · ▲307Hi HN! We're Gabriel & Viraj, and we're excited to open source TensorZero. To be a little cheeky, TensorZero is an open-source platform that helps LLM applications graduate from API wrappers into defensible AI products. 1. Integrate our model gateway 2. Send metrics or feedback 3. Unlock compounding improvements in quality, cost, and latency It enables a data & learning flywheel for LLMs by unifying: • Inference: one API for all LLMs, with <1ms P99 overhead • Observability: inference & feedback → your database • Optimization: better prompts, models, inference strategies • Experimentation:…
Minimal LLM Post-Training Experiments on an 8GB GPU (SFT, DPO, GRPO)Aug 2026 · github.com · ▲21Minimal, readable LLM post-training experiments on one 8GB GPU. Measures forgetting, seed variance, and RL emergence. - pochenai/nano-llm-posttraining
TuneTrain.ai2025 · tunetrain.ai · ▲79Do you know that Small Language Models (SLM) can outperform LLMs if trained (fine-tuned) on domain specific datasets, like your companies knowledge base? The issue: fine-tuning a SLM usually requires a dataset of 10k - 100k records, which is huge. I created a platform for applying "human in the loop" augmentation techniques on your small dataset, so that you can start with maybe 100 records and build-up quickly huge datasets and launch a training without prior knowledge. I implemented 2 techniques, based on LLM distillation, however: more to come. HN, what Do you think? Do you see value in…
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 22d ago · stillwet.art
FastRouter.ai▲364Route requests to the right LLM for cost, latency & quality
AI · 23d ago · fastrouter.ai
Source: Show HN post ↗
Launched alongside, March 2024
the whole month →
🌐 The Internet Computer! Free, Open-Source, and Self-Hostable. - HeyPuter/puter
Dev tools · 2024 · github.com
Microlaunch▲1,115Launch and get feedback on both the idea and product
Dev tools · 2024 · microlaunch.net
