Dev tools · alternatives · 2026
24 alternatives to Grammar Generator App for Llama.cpp
llama.cpp added context-free grammar guided generation functionality. It requires passing a file in a derivative of BNF notation, which gets messy very quickly for things like JSON. To improve the experience, we built a small compiler from TypeScript interfaces to the grammar file format and have it hosted in a little browser app. See more in discussion at https://github.com/ggerganov/llama.cpp/discussions/2494
The Grammar Generator App for Llama.cpp is a browser-based tool that converts TypeScript interfaces into context-free grammar files for use with llama.cpp's guided generation feature. It simplifies the process of… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Grammar Generator App for Llama.cpp launched in 2023; newer entries below may have overtaken it.
- 1
Llama 3.3 70B▲347Llama 405B-level performance, at a fraction of the cost
2024 · developer.meta.com · its alternatives →
- 2
Llama 2▲263The next generation of Meta's open source LLM
2023 · developer.meta.com · its alternatives →
- 3
Locally run an Instruction-Tuned Chat-Style LLM . Contribute to antimatter15/alpaca.cpp development by creating an account on GitHub.
2023 · github.com · its alternatives →
- 4
Outlines is a Python library that focuses on text generation with large language models. Brandon and I are not LLM experts and started the project a few months ago because we wanted to understand better how the generation process works. Our original background is probabilistic, relational and symbolic programming. Recently we came up with a fast way to generate text that matches a regex (https://blog.normalcomputing.ai/posts/2023-07-27-regex-guide...). The basic idea is simple: regular expressions have an equivalent Deterministic-Finite Automaton (DFA) representation. We…
2023 · github.com · its alternatives →
- 5
- 6
LLaMA▲118A foundational, 65-billion-parameter large language model
2023 · research.facebook.com · its alternatives →
- 7
High-speed download of LLaMA, Facebook's 65B parameter GPT model - shawwn/llama-dl
2023 · github.com · its alternatives →
- 8
I've been playing around with https://github.com/zphang/minimal-llama/ and https://github.com/tloen/alpaca-lora/blob/main/finetune.py, and wanted to create a simple UI where you can just paste text, tweak the parameters, and finetune the model quickly using a modern GPU. To prepare the data, simply separate your text with two blank lines. There's an inference tab, so you can test how the tuned model behaves. This is my first foray into the world of LLM finetuning, Python, Torch, Transformers, LoRA, PEFT, and Gradio. Enjoy!
2023 · github.com · its alternatives →
- 9
Code Llama▲73A state-of-the-art large language model for coding
2023 · ai.meta.com · its alternatives →
- 10
Code Llama 70B▲144New, performant version of Meta's LLM for code generation
2024 · developer.meta.com · its alternatives →
- 11
Author here. I just wanted a quick and easy way to easily submit strings to a REST API and get back the embedding vectors in JSON using Llama2 and other similar LLMs, so I put this together over the past couple days. It's very quick and easy to set up and totally self-contained and self-hosted. You can easily add new models to it by simply adding the HuggingFace URL to the GGML format model weights. Two models are included by default, and these are automatically downloaded the first time it's run. It lets you not only submit text strings and get back the embeddings, but also to compare two…
2023 · github.com · its alternatives →
- 12
Stateful load balancer customized for llama.cpp (with a reverse proxy).
2024 · github.com · its alternatives →
- 13
JS tokenizer for LLaMA 1 and 2. Contribute to belladoreai/llama-tokenizer-js development by creating an account on GitHub.
2023 · github.com · its alternatives →
- 14
Llama▲3123.1-405B: an open source model to rival GPT-4o / Claude-3.5
2024 · developer.meta.com · its alternatives →
- 15
JSON AST > Clojure. Contribute to quadracollision/llmisp development by creating an account on GitHub.
May 2026 · github.com · its alternatives →
- 16
Code Mode▲144I’ve been testing a simple idea inspired by Apple/Cloudflare/Anthropic: LLMs are far better at writing a small program than coordinating multiple tool calls. So instead of giving the model 10+ tools, I exposed one: a TypeScript sandbox with access to the same interfaces. The model writes a script → it runs once → done. What changed - +68% reduction in token use - No multi-step drift or retries - Local models (Llama 3.1 8B / Phi-3) became much more reliable Repo: https://github.com/universal-tool-calling-protocol/code-mode Curious whether others have seen…
Nov 2025 · github.com · its alternatives →
- 17
I wrote a small local tool to transcribe audio notes (Whisper/Parakeet). Code: https://github.com/bilawalriaz/lazy-notes I wanted to process raw transcripts locally without OpenRouter. Llama 3.2 3B with a prompt was decent but incomplete, so I tried SFT. I fine-tuned Llama 3.2 3B to clean/analyze dictation and emit structured JSON (title, tags, entities, dates, actions). Data: 13 real memos → Kimi K2 gold JSON → ~40k synthetic + gold; keys canonicalized. Chutes.ai (5k req/day). Training: RTX 4090 24GB, ~4h, LoRA (r=128, α=128, dropout=0.05), max seq 2048,…
2025 · bilawal.net · its alternatives →
- 18
We believe that AI should be fully open source and part of the collective knowledge. The original LLaMA code is GPL licensed which means any project using it must also be released under GPL. This "taints" any other code and prevents meaningful academic and commercial use. Lit-LLaMA solves that for good.
2023 · github.com · its alternatives →
- 19
This proof-of-concept project combines: - Flutter, from Google; - ClojureDart, port of Clojure to Dart from Tensegritics; and - Matrix, a reactive framework from moi. So, yes, we can now program Flutter with a Lisp. Yay. Project includes dozens of working examples and a full implementation of the TodoMVC classic to help tire-kickers play around. Support installing freely available on the #matrix channel on the Clojurians Slack.
2022 · github.com · its alternatives →
- 20LC
Complete llama.cpp tutorial for 2026. Install, compile with CUDA/Metal, run GGUF models, tune all inference flags, use the API server, speculative decoding, and benchmark your hardware. https://vucense.com/dev-corner/llama-cpp-tutorial-run-gguf-m...
Apr 2026 · its alternatives →
- 21
G'day, HN! I'm one of the maintainers of `llm`. I've been working alongside a trusty group of contributors to bring this project to life, and we're now at a point where we're ready to share it with the world. Large language models (LLMs) are taking the computing world by storm due to their emergent abilities that allow them to perform a wide variety of tasks, including translation, summarization, code generation, and even some degree of reasoning. However, the ecosystem around LLMs is still in its infancy, and it can be difficult to get started with these models. `llm` is a one-stop shop for…
2023 · github.com · its alternatives →
- 22
Very low footprint DOM-style JSON parser written in portable ANSI C - json-parser/json-parser
2012 · github.com · its alternatives →
- 23
The from-scratch guide to building large language models in NodeJS.
8d ago · book.humanexperiences.io · its alternatives →
- 24
The easiest way to do output iteration with Llama 3.1 405B
2024 · respan.ai · its alternatives →
Also compare
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →