Grammar Generator App for Llama.cpp

llama.cpp added context-free grammar guided generation functionality. It requires passing a file in a derivative of BNF notation, which gets messy very quickly for things like JSON. To improve the experience, we built a small compiler from TypeScript interfaces to the grammar file format and have it hosted in a little browser app. See more in discussion at https://github.com/ggerganov/llama.cpp/discussions/2494

Visit grammar.intrinsiclabs.ai ↗Alternatives

In plain words

The Grammar Generator App for Llama.cpp is a browser-based tool that converts TypeScript interfaces into context-free grammar files for use with llama.cpp's guided generation feature. It simplifies the process of creating grammar rules, particularly for structured outputs like JSON, by compiling from TypeScript notation rather than requiring developers to write grammar files manually in BNF derivative syntax. The tool is designed for developers working with local language model inference through llama.cpp.

written from the facts on this page · September 2026

More dev tools this month

the category →

Dograh▲592
The open source VAPI alternative
Dev tools · 25d ago · dograh.com
Meridian▲530
Don't let your work go unnoticed. Get promoted!
Dev tools · 20d ago · meridiona.com
x1▲516
Lovable for iPhone apps go from idea to App Store
Dev tools · 11d ago · x1.new
The GTM Co-Founder▲402
Open-source GTM skills for technical founders
Dev tools · 29d ago · gtmcofounder.com
Open-Source eInk Bike Computer▲389
OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.
Dev tools · 1d ago · opentrailpaper.com
Nuphos▲380
The AI-Native DevOps Workspace.
Dev tools · 24d ago · nuphos.ai

Launched alongside, August 2023

the whole month →

Resend▲1,326
Email for developers
Dev tools · 2023 · resend.com
STORI AI▲1,320
Your ideas become visually compelling branded social posts
AI · 2023 · storiai.com
Kombai▲1,080
A new AI model that you can prompt with UI designs
AI · 2023 · kombai.com
User Persona Generator▲1,014
Understand your audience without 50 interviews
AI · 2023 · founderpal.ai
Lottielab▲871
Create and ship lottie animations to sites and apps faster
Dev tools · 2023 · lottielab.com
LC
LLMs can generate valid JSON 100% of the time▲854
Outlines is a Python library that focuses on text generation with large language models. Brandon and I are not LLM experts and started the project a few months ago because we wanted to understand better how the generation process works. Our original background is probabilistic, relational and symbolic programming. Recently we came up with a fast way to generate text that matches a regex (https://blog.normalcomputing.ai/posts/2023-07-27-regex-guide...). The basic idea is simple: regular expressions have an equivalent Deterministic-Finite Automaton (DFA) representation. We…
AI · 2023 · github.com