Gradient – a web API for fine-tuning and deploying Llama2
We’ve just launched Gradient — an API that helps you build private LLMs that you own. We simplify inference and fine-tuning on open-source LLMs such as llama2, and you only pay by the token. Our API platform makes it possible for you to create private models with a single API call. Run inference on your fine tuned model instantly with no cold boot (and no need to pay for compute costs). The product is truly on demand - when you run fine tuning and inference on our platform, there's nearly 0 startup latency for these API calls. And you're not paying for the compute, you just pay for the…
In plain words
Gradient is an API platform that enables developers to fine-tune and deploy private language models based on open-source models like Llama2. Users can create custom models with a single API call and run inference with minimal latency, paying only for tokens consumed rather than compute resources. The service supports multiple Llama variants and eliminates traditional infrastructure costs, making it practical for developers to build and serve multiple fine-tuned models without excessive expenses.
written from the facts on this page · September 2026
From the sources
In the maker’s words, at launch
We’ve just launched Gradient — an API that helps you build private LLMs that you own. We simplify inference and fine-tuning on open-source LLMs such as llama2, and you only pay by the token. Our API platform makes it possible for you to create private models with a single API call. Run inference on your fine tuned model instantly with no cold boot (and no need to pay for compute costs). The product is truly on demand - when you run fine tuning and inference on our platform, there's nearly 0 startup latency for these API calls. And you're not paying for the compute, you just pay for the tokens you're consuming. This makes it possible for developers to build and serve nearly unlimited fine tuned models without incurring ridiculous infrastructure fees. We currently support Llama2 7B and Nous Hermes2 (Llama2 13B unlocked variant), and are releasing LlamaCoder and Llama2 70b in a few weeks. Gradient is also SOC 2 and HIPAA compliant. When you sign up, we give you $10 in free credits to start experimenting. We'd love to get your feedback, and let us know what you're building on our Discord! Sign up (https://gradient.ai/) Twitter (https://twitter.com/Gradient_AI_) Discord (https://discord.gg/yvgVKEgkmd)
More dev tools this month
the category →
Open-source GTM skills for technical founders
Dev tools · 29d ago · gtmcofounder.com
OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.
Dev tools · 1d ago · opentrailpaper.com
Launched alongside, August 2023
the whole month →
Lottielab▲871Create and ship lottie animations to sites and apps faster
Dev tools · 2023 · lottielab.com
- LC
Outlines is a Python library that focuses on text generation with large language models. Brandon and I are not LLM experts and started the project a few months ago because we wanted to understand better how the generation process works. Our original background is probabilistic, relational and symbolic programming. Recently we came up with a fast way to generate text that matches a regex (https://blog.normalcomputing.ai/posts/2023-07-27-regex-guide...). The basic idea is simple: regular expressions have an equivalent Deterministic-Finite Automaton (DFA) representation. We…
AI · 2023 · github.com