AI · alternatives · 2026

24 alternatives to RLLama

Empowering LLMs with Memory-Augmented Reinforcement Learning

Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes.

1
Wordllama – Things you can do with the token embeddings of an LLM▲370
After working with LLMs for long enough, I found myself wanting a lightweight utility for doing various small tasks to prepare inputs, locate information and create evaluators. This library is two things: a very simple model and utilities that inference it (eg. fuzzy deduplication). The target platform is CPU, and it’s intended to be light, fast and pip installable — a library that lowers the barrier to working with strings semantically. You don’t need to install pytorch to use it, or any deep learning runtimes. How can this be accomplished? The model is simply token embeddings that are…
2024 · github.com · its alternatives →
2
LlamaGym – fine-tune LLM agents with online reinforcement learning▲239
Fine-tune LLM agents with online reinforcement learning - KhoomeiK/LlamaGym
2024 · github.com · its alternatives →
3
I built a tiny LLM to demystify how language models work▲915
Built a ~9M param LLM from scratch to understand how they actually work. Vanilla transformer, 60K synthetic conversations, ~130 lines of PyTorch. Trains in 5 min on a free Colab T4. The fish thinks the meaning of life is food. Fork it and swap the personality for your own character.
Apr 2026 · github.com · its alternatives →
4
Predibase Reinforcement Fine-Tuning▲175
LLM reinforcement fine-tuning platform to improve LLM output
2025 · rubrik.com · its alternatives →
5RA
RL Agent that can auto-optimize your LLM prompts▲14
Hey everyone! Along with my team, I've developed a reinforcement learning system that automatically optimizes LLM prompts, complete with a visualization feature to track both prompt structure and learning progress over time. Take a look here: https://nomadic-ml.github.io/nomadic/cookbooks/Nomadic_Promp... Check out our website too:https://www.nomadicml.com/ In terms of how this visualization works: The RL Prompt Optimizer employs a reinforcement learning framework to iteratively improve prompts used for language model evaluations. At each episode, the…
2024 · nomadic-ml.github.io · its alternatives →
6
LLM Explorer▲152
Find your best LLM for a local inference
2023 · its alternatives →
7
ART – a new open-source RL framework for training agents▲116
Hey HN, I wanted to share a new project we've been working on for the last couple of months called ART (https://github.com/OpenPipe/ART). ART is a new open-source framework for training agents using reinforcement learning (RL). RL allows you to train an agent to perform better at any task whose outcome can be measured and quantified. There are many excellent projects focused on training LLMs with RL, such as GRPOTrainer (https://huggingface.co/docs/trl/main/en/grpo_trainer) and verl…
2025 · github.com · its alternatives →
8
I RL-trained an agent that trains models with RL (for ~$1.3k)▲107
RL-training an AI agent to RL-train AI agents. Contribute to Danau5tin/ai-trains-ai development by creating an account on GitHub.
Jul 2026 · github.com · its alternatives →
9
TuneTrain.ai▲79
Do you know that Small Language Models (SLM) can outperform LLMs if trained (fine-tuned) on domain specific datasets, like your companies knowledge base? The issue: fine-tuning a SLM usually requires a dataset of 10k - 100k records, which is huge. I created a platform for applying "human in the loop" augmentation techniques on your small dataset, so that you can start with maybe 100 records and build-up quickly huge datasets and launch a training without prior knowledge. I implemented 2 techniques, based on LLM distillation, however: more to come. HN, what Do you think? Do you see value in…
2025 · tunetrain.ai · its alternatives →
10SP
System Prompt Learning – LLMs Learn Problem-Solving from Experience▲48
I built a system that lets LLMs automatically learn and improve problem-solving strategies over time, inspired by Andrej Karpathy's idea of a "third paradigm" for LLM learning. The basic idea: instead of using static system prompts, the LLM builds up a database of strategies that actually work for different problem types. When you give it a new problem, it selects the most relevant strategies, applies them, then evaluates how well they worked and refines them. For example, after seeing enough word problems, it learned this strategy: 1) Read carefully and identify unknowns, 2) Define…
2025 · its alternatives →
11
Monostate AItraining▲59
Fine-tuning, RL, and inference in one CLI
Dec 2025 · github.com · its alternatives →
12
Continual Learning with .md▲34
I have a proposal that addresses long-term memory problems for LLMs when new data arrives continuously (cheaply!). The program involves no code, but two Markdown files. For retrieval, there is a semantic filesystem that makes it easy for LLMs to search using shell commands. It is currently a scrappy v1, but it works better than anything I have tried. Curious for any feedback!
Apr 2026 · github.com · its alternatives →
13
Next-Gen AI Training: LLM-RLHF-Tuning with PPO and DPO▲30
Comprehensive toolkit for Reinforcement Learning from Human Feedback (RLHF) training, featuring instruction fine-tuning, reward model training, and support for PPO and DPO algorithms with various configurations for the Transformer 5 models including Qwen 3.0 - raghavc/LLM-RLHF-Tuning-with-PPO-and-DP
2024 · github.com · its alternatives →
14
Taylor AI▲118
Fine-tune open source LLMs in minutes
2023 · trytaylor.ai · its alternatives →
15
CogniMemo▲120
AI that remembers, learns, and evolves
Dec 2025 · app.cognimemo.com · its alternatives →
16
LearnTime▲105
LMS platform
2024 · ltime.com.ua · its alternatives →
17
LLM Alignment Template – Aligning Language Models with Human Feedback▲9
Hey Hacker News! I've been working on an open-source project called LLM Alignment Template, a comprehensive toolkit designed to help researchers, developers, and data scientists align large language models (LLMs) with human values using Reinforcement Learning from Human Feedback (RLHF). What the project does: Interactive Web Interface: Easily train models, visualize alignment metrics, and manage alignment with an accessible UI. Training with RLHF: Align models effectively to human preferences using feedback loops. Explainability: Built-in dashboards to help understand model behavior using…
2024 · github.com · its alternatives →
18
Llongterm▲12
The missing memory layer for generative AI
2024 · llongterm.com · its alternatives →
19
Llama-8B Teaches Itself Baby Steps to Deep Research Using RL▲39
I've been tinkering with getting Llama-8B to bootstrap its own research skills through self-play. The model generates questions about documents, searches for answers, and then learns from its own successes/failures through RL (hacked up Unsloth's GRPO code). Started with just 23% accuracy on Apollo 13 mission report questions and hit 53% after less than an hour of training. Everything runs locally using open-source models. It's cool to see the model go from completely botching search queries to iteratively researching to get the right answer.
2025 · github.com · its alternatives →
20
Learning a Language Using Only Words You Know▲84
A proof-of-concept language learning app that uses LLMs to generate definitions of unknown words using only previously mastered vocabulary.
Dec 2025 · simedw.com · its alternatives →
21
Promptr for AI▲32
The context manager and skills library for marketing teams
Apr 2026 · promptr.ai · its alternatives →
22CD
Cancer diagnosis makes for an interesting RL environment for LLMs▲46
Hey HN, this is David from Aluna (YC S24). We work with diagnostic labs to build datasets and evals for oncology tasks. I wanted to share a simple RL environment I built that gave frontier LLMs a set of tools that lets it zoom and pan across a digitized pathology slide to find the relevant regions to make a diagnosis. Here are some videos of the LLM performing diagnosis on a few slides: (https://www.youtube.com/watch?v=k7ixTWswT5c): traces of an LLM choosing different regions to view before making a diagnosis on a case of small-cell carcinoma of the lung…
Nov 2025 · its alternatives →
23BA
Butter, a muscle memory cache for LLMs▲23
Hi HN, Erik here. Today we launch Butter, an OpenAI-compatible API proxy that caches LLM generations and serves them deterministically on revisit. Since April, we’ve been working on this concept of “muscle memory,” or deterministic replay, for agent systems performing automations. You may recall our first post in May, launching a python package called Muscle Mem: https://news.ycombinator.com/item?id=43988381 Since then, the product has evolved entirely, now taking the form of an LLM Proxy. For a deep dive into this process, check out:…
2025 · docs.butter.dev · its alternatives →
24
NanoRL – RL training for LLMs in ~1,800 lines▲11
The smallest async RL trainer I could write: one loop that runs REINFORCE on CartPole on a laptop and async GRPO on a cluster (e.g. 8xH100 trainer, 8 vLLM workers, ran as a [SkyPilot job group](https://docs.skypilot.ai/en/latest/examples/job-groups.html) on k8s ). All without Ray or TRL or DeepSpeed etc., workers talk to the trainer over stdlib HTTP.
Aug 2026 · github.com · its alternatives →

Also compare

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →