nowfound

Life & fun · August 14, 2023

OT

OSS tool to finetune and serve LLMs on different clouds

OSS tool to finetune and serve LLMs on different clouds launched on August 14, 2023 with 12 votes, #1,612 of 4,347 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 3 years on.

Visit llm-atc.readthedocs.io ↗Alternatives

In plain words

OSS tool to finetune and serve LLMs on different clouds is an open-source tool that enables users to fine-tune and deploy large language models across multiple cloud platforms. It supports model customization for specific use cases and provides flexibility in choosing cloud infrastructure providers. The tool targets developers and organizations that need to adapt LLMs to their particular requirements while maintaining portability across different cloud environments.

written from the facts on this page · September 2026

From the sources

LLM-ATC is a tool for finetuning and serving open source large language models (LLMs). Finetune on any cloud (AWS, Azure, GCP, Lambda Cloud, IBM, Samsung, OCI, Cloudflare). Serving supported on (AWS, GCP). [More clouds in development!] Models saved to object store (e.g. S3, GCS) for accessfrom llm-atc.readthedocs.io

Does a similar job

all alternatives →
  • finetune LLMs via the Finetuning Hub2023 · github.com · ▲80

    Hi HN community, I have been working on benchmarking publicly available LLMs these past couple of weeks. More precisely, I am interested on the finetuning piece since a lot of businesses are starting to entertain the idea of self-hosting LLMs trained on their proprietary data rather than relying on third party APIs. To this point, I am tracking the following 4 pillars of evaluation that businesses are typically look into: - Performance - Time to train an LLM - Cost to train an LLM - Inference (throughput / latency / cost per token) For each LLM, my aim is to benchmark them for…

  • Unsloth2025 · unsloth.ai · ▲241

    Finetune LLMs 2x faster, 80% less memory

  • Finetune LLaMA-7B on commodity GPUs using your own text2023 · github.com · ▲449

    I've been playing around with https://github.com/zphang/minimal-llama/ and https://github.com/tloen/alpaca-lora/blob/main/finetune.py, and wanted to create a simple UI where you can just paste text, tweak the parameters, and finetune the model quickly using a modern GPU. To prepare the data, simply separate your text with two blank lines. There's an inference tab, so you can test how the tuned model behaves. This is my first foray into the world of LLM finetuning, Python, Torch, Transformers, LoRA, PEFT, and Gradio. Enjoy!

  • My LLM CLI tool can run tools now, from Python code or plugins2025 · simonwillison.net · ▲529

    LLM 0.26 is out with the biggest new feature since I started the project: support for tools. You can now use the LLM CLI tool—and Python library—to grant LLMs from …

  • Ollama – Run LLMs on your Mac2023 · github.com · ▲284

    Hi HN A few folks and I have been working on this project for a couple weeks now. After previously working on the Docker project for a number of years (both on the container runtime and image registry side), the recent rise in open source language models made us think something similar needed to exist for large language models too. While not exactly the same as running linux containers, running LLMs shares quite a few of the same challenges. There are "base layers" (e.g. models like Llama 2), specific configuration to run correctly (parameters, temperature, context window sizes etc). There's…

  • FinetuneDB – AI fine-tuning platform to create custom LLMs2024 · finetunedb.com · ▲152

    Hey HN! We’re building FinetuneDB (https://finetunedb.com/), an LLM fine-tuning platform. It enables teams to easily create and manage high-quality datasets, and streamlines the entire workflow from fine-tuning to serving and evaluating models with domain experts. You can check out our docs here: (https://docs.finetunedb.com/) FinetuneDB exists because creating and managing high-quality datasets is a real bottleneck when fine-tuning LLMs. The quality of your data directly impacts the performance of your fine-tuned models, and existing tools didn’t offer an easy…

More life & fun this month

the category →

Source: Show HN post ↗

Launched alongside, August 2023

the whole month →
  • Resend▲1,325

    An entire collection of pre-built components with a much faster development experience.

    Dev tools · 2023 · resend.com

  • STORI AI▲1,316

    Your ideas become visually compelling branded social posts

    AI · 2023 · storiai.com

  • Kombai▲1,079

    A new AI model that you can prompt with UI designs

    AI · 2023 · kombai.com

  • User Persona Generator▲1,014

    Understand your audience without 50 interviews

    AI · 2023 · founderpal.ai

  • Lottielab▲869

    Create and ship lottie animations to sites and apps faster

    Dev tools · 2023 · lottielab.com

  • LLMs can generate valid JSON 100% of the time▲854

    Outlines is a Python library that focuses on text generation with large language models. Brandon and I are not LLM experts and started the project a few months ago because we wanted to understand better how the generation process works. Our original background is probabilistic, relational and symbolic programming. Recently we came up with a fast way to generate text that matches a regex (https://blog.normalcomputing.ai/posts/2023-07-27-regex-guide...). The basic idea is simple: regular expressions have an equivalent Deterministic-Finite Automaton (DFA) representation. We…

    AI · 2023 · github.com