nowfound

Dev tools · August 2, 2023

Grammar Generator App for Llama.cpp

llama.cpp added context-free grammar guided generation functionality. It requires passing a file in a derivative of BNF notation, which gets messy very quickly for things like JSON. To improve the experience, we built a small compiler from TypeScript interfaces to the grammar file format and have it hosted in a little browser app. See more in discussion at https://github.com/ggerganov/llama.cpp/discussions/2494

Grammar Generator App for Llama.cpp launched on August 2, 2023 with 19 votes, #1,552 of 4,347 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 3 years on.

In plain words

The Grammar Generator App for Llama.cpp is a browser-based tool that converts TypeScript interfaces into context-free grammar files for use with llama.cpp's guided generation feature. It simplifies the process of creating grammar rules, particularly for structured outputs like JSON, by compiling from TypeScript notation rather than requiring developers to write grammar files manually in BNF derivative syntax. The tool is designed for developers working with local language model inference through llama.cpp.

written from the facts on this page · September 2026

Does a similar job

all alternatives →
  • Llama 3.3 70B2024 · developer.meta.com · ▲347

    Llama 405B-level performance, at a fraction of the cost

  • Llama 22023 · developer.meta.com · ▲263

    The next generation of Meta's open source LLM

  • Alpaca.cpp – Run an Instruction-Tuned Chat-Style LLM on a MacBook2023 · github.com · ▲673

    Locally run an Instruction-Tuned Chat-Style LLM . Contribute to antimatter15/alpaca.cpp development by creating an account on GitHub.

  • LLMs can generate valid JSON 100% of the time2023 · github.com · ▲854

    Outlines is a Python library that focuses on text generation with large language models. Brandon and I are not LLM experts and started the project a few months ago because we wanted to understand better how the generation process works. Our original background is probabilistic, relational and symbolic programming. Recently we came up with a fast way to generate text that matches a regex (https://blog.normalcomputing.ai/posts/2023-07-27-regex-guide...). The basic idea is simple: regular expressions have an equivalent Deterministic-Finite Automaton (DFA) representation. We…

  • LlamaCoder 2024 · ai.meta.com · ▲373

    AI-powered coding assistant by Meta

  • LLaMA2023 · research.facebook.com · ▲118

    A foundational, 65-billion-parameter large language model

More dev tools this month

the category →
  • /dev/null▲483

    a social network for devs

    Dev tools · 3d ago · dev-null.sh

  • open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.

    Dev tools · 27d ago · github.com

  • Contribute to reladraw/reladraw development by creating an account on GitHub.

    Dev tools · 25d ago · github.com

  • OpenBot▲362

    Grok Bot alternative: free, local, open-source, multiplayer

    Dev tools · 23d ago · openbot.run

  • Talanoa▲345

    Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…

    Dev tools · 20d ago · talanoa.email

  • CoreSpeed▲332

    One MCP for everything your agents need: apps, memory, tools

    Dev tools · 28d ago · corespeed.io

Source: Show HN post ↗

Launched alongside, August 2023

the whole month →
  • Resend▲1,325

    An entire collection of pre-built components with a much faster development experience.

    Dev tools · 2023 · resend.com

  • STORI AI▲1,316

    Your ideas become visually compelling branded social posts

    AI · 2023 · storiai.com

  • Kombai▲1,079

    A new AI model that you can prompt with UI designs

    AI · 2023 · kombai.com

  • Understand your audience without 50 interviews

    AI · 2023 · founderpal.ai

  • Lottielab▲869

    Create and ship lottie animations to sites and apps faster

    Dev tools · 2023 · lottielab.com

  • Outlines is a Python library that focuses on text generation with large language models. Brandon and I are not LLM experts and started the project a few months ago because we wanted to understand better how the generation process works. Our original background is probabilistic, relational and symbolic programming. Recently we came up with a fast way to generate text that matches a regex (https://blog.normalcomputing.ai/posts/2023-07-27-regex-guide...). The basic idea is simple: regular expressions have an equivalent Deterministic-Finite Automaton (DFA) representation. We…

    AI · 2023 · github.com