Alternatives
Products that do what I built a website where you can easily fine-tune Llama 3.1 models does
Hey HN, I built a website where you can train Llama 3.1 8b & 70b (4bit) on your data. I use unsloth in the backend and the training is done on H100s which I rent programmatically from Runpod. I'd love some feedback. If you would be interested in using it feel free to book a chat with me: cal.com/hamada/tunellama-intro Happy to give you free credits :) P.S. I'm also looking for a co-founder as I have big plans for this.
- 1
- 2IB
I spent the last few days building out a nicer ChatGPT-like interface to use Mistral 7B and Llama 3 fully within a browser (no deps and installs). I’ve used the WebLLM project by MLC AI for a while to interact with LLMs in the browser when handling sensitive data but I found their UI quite lacking for serious use so I built a much better interface around WebLLM. I’ve been using it as a therapist and coach. And it’s wonderful knowing that my personal information never leaves my local computer. Should work on Desktop with Chrome or Edge. Other browsers are adding WebGPU support as well - see…
2024 · github.com
- 3
- 4P2
I wrote this over the last couple of weeks using Rails 3, Twilio and a variety of Gems, putting in about 2 hours per day. I'd love any feedback from the HN community on any aspects of the site (design, API construction, documentation, marketing, pricing which is TBD). On a related note: I have to say that I'm really flying with Rails 3. Typically I roll with Django, but have been super impressed with the Rails 3. Feels really clean, and there are some Gems that make the more mundane parts of the webapp construction fun and agile: Haml/Sass, blueprint, Fancy-buttons, Devise. I'll probably…
2011 · phoneify.com
- 5OS
Looking for the cheapest place to deploy llama 3.1 model? Don't worry we have found it so you don't have to.
2024 · github.com
- 6IJ
Hey HN! I've been working on Muxamp for over a year now, and I decided that there's no point in keeping the source closed. (I never planned on making money from it.) I've learned a lot since I started, and I hope others can benefit from its release--and perhaps teach me a thing or two as well :)
2013 · github.com
- 7UA
Hey HN! After using a combination of Unsloth and Axolotl a lot, and finding it generally painful to figure out the right performance tuning for things like batch sizing and multi-GPU sharding, I wrote a small Python lib that sets up known-good LoRA training configurations for Llama 3.1 8B and 70B Instruct, and includes helpers for distilling from larger models or training on serverless finetuning platforms, and includes a walkthrough for distilling DeepSeek-R1 into a Llama 3.1 8B LoRA... But you can use it for pretty much any finetuning task, not just distilling large models!
2025 · github.com
- 8RA
Hi there, looking for feedback on my new project "Featherless.AI" The idea is to allow users to run all the models on hugging face instantly. Via the OpenAI API compatible endpoint. Why? Because its a real chore to download models and spin up GPUs, especially if you want to test multiple models. Not to mention GPUs cost multiple dollars an hour to rent. And if we want more people to use open source AI, we got to make it easier for them to try and play with all of them. So what if instead of spinning up dedicated GPUs per model (which is what every provider is doing) We can startup a LLM…
2024 · featherless.ai
- 9RL
2024 · app.wiz.chat
- 10FT
I wrote a small local tool to transcribe audio notes (Whisper/Parakeet). Code: https://github.com/bilawalriaz/lazy-notes I wanted to process raw transcripts locally without OpenRouter. Llama 3.2 3B with a prompt was decent but incomplete, so I tried SFT. I fine-tuned Llama 3.2 3B to clean/analyze dictation and emit structured JSON (title, tags, entities, dates, actions). Data: 13 real memos → Kimi K2 gold JSON → ~40k synthetic + gold; keys canonicalized. Chutes.ai (5k req/day). Training: RTX 4090 24GB, ~4h, LoRA (r=128, α=128, dropout=0.05), max seq 2048,…
2025 · bilawal.net
- 11IB
hey hn, I built an open-source Perplexity clone that can run local LLMs and cloud LLMs. It's fully self-hostable through Docker and uses ollama to support local LLMs. The demo video in the repository shows me running it locally with llama3 on my M1 Macbook Pro. I'm open to any suggestions or feedback, thanks!
2024 · github.com
- 12IM
As a handsome local AI enjoyer™ you’ve probably noticed one of the big flaws with LLMs: It lies. Confidently. ALL THE TIME. I’m autistic and extremely allergic to vibes-based tooling, so … I built a thing. Maybe it’s useful to you too. The thing: llama-conductor llama-conductor is a router that sits between your frontend (eg: OWUI) & backend (llama.cpp + llama-swap). Local-first but it should talk to anything OpenAI-compatible if you point it there (note: experimental so YMMV). LC is a glass-box that makes the stack behave like a deterministic system, instead of a drunk telling a story about…
Jan 2026
- 13IT
I trained the 65b model on my texts so I can talk to myself. It's pretty useless as an assistant, and will only do stuff you convince it to, but I guess it's technically uncensored? I'll leave it up for a bit if you want to chat with it. I posted this to Reddit and had several hundred people talking to it. Salient points from that discussion: LLAMA 1 65b Rank 128 5 epochs Batch size 1, 256 cutoff Trained in the Oobabooga suite using bitsandbytes 4-bit quantization for the lora Loss around 1.5 seems to give the most coherent results Trained on raw text dumps that is then parsed by a crappy…
2023 · airic.serveo.net
- 14AO
I've built an airgapped Retrieval-Augmented Generation (RAG) system for question-answering on documents, running entirely offline with local inference. Using Llama 3, Mistral, and Gemini, this setup allows secure, private NLP on your own machine. Perfect for researchers, data scientists, and developers who need to process sensitive data without cloud dependencies. Built with Llama C++, LangChain, and Streamlit, it supports quantized models and provides a sleek UI for document processing. Check it out, contribute, or suggest new features!
2024 · github.com
- 15LF
We’ve built a LLM fine-tuning SDK that supports Llama 3.1 right now. We’d love your feedback, and are happy to give extra free credits if you try the product and jump on a 15 minute call and provide feedback :)
2024 · docs.luminolabs.ai
- 16IM
I'm a musician by night, software developer by day, and one of the minor frustrations I've always had was trying to find a simple tuner app for my phone. Looking at both the iOS and Android app stores, you'll find a lot of the top tuner apps are rather bloated with ads or subscription callouts. I thought I'd create a dead-simple minimalistic mobile chromatic tuner the way I would like it - open the app and tune my guitar. My work is in web with NodeJS and React, so I chose React Native since it was the easiest to understand coming from React. Flutter was also an option since the company I…
2022 · github.com
- 17IB
I’ve been playing around with local LLMs for the past couple of months and decided to build something that can run on an iPhone. It’s a universal app built with SwiftUI and the excellent ggml library. The model is an SFT fine tuned and 4 bit quantised version of the RedPajama-INCITE-Chat-3B-v1 OSS LLM. It works reasonably well on recent-ish (~3 year old) iPhones, iPads and Macs. It was launched on the App Store yesterday[1] and Product Hunt today[2]. It seems to be reasonably ok at natural language interactions, but given its size, does pretty badly at coding and reasoning. Also, it…
2023
- 18IB
Hey HN! Over the past few weeks, I’ve been working on DataBridge, an open-source solution for data ingestion and querying across text, PDFs, images, and videos. In our latest update, we’ve added a fully local deployment option: - No internet required – Runs entirely offline. - Customizable Models – Supports any LLM and embedding model via Ollama (with options for any other private providers) - Extensibility – You can plug in your own models or tools easily. This local-first approach ensures better privacy, security, and flexibility, especially for teams dealing with sensitive data. You can…
2025 · github.com
- 19LA
2023 · github.com
- 20IB
Hey HN! Last week I was working on a website and needed a way to synchronise visuals with live music. I've used MIDI controllers for this before, but I am travelling right now and don't have mine with me. So I had the crazy idea to build a browser extension that uses the keyboard as input and includes a sequencer. I gave myself 24 to work on it. It ended up taking longer (of course), specially since I ended up creating a demo, a small landing, docs, and an intro video. Took me one week from idea to launch (pushed quite a bit tbh). Features: - Works as a browser extension. Atm distributed…
2024 · minitap.io
- 21M4
Well HN, I've finally produced something I think is worthy of sharing, but I didn't do it "in a weekend". Yeah, it's an iOS puzzle game. And yeah, it's a game I built because I wanted to play it rather than based on market research, so all this sort of makes it the antithesis of a popular HN post. But whatever. Still hoping for some of that patented (har har) expert HN feedback. Critique any part of it except the music. Also, PM me for upgrade codes, or I can post some here if there's any interest. Download (it's free):…
2012
- 22WW
Over three months ago, I posted my book on HN and got tremendous +ve reponse. I am happy to inform that I have published the book to leanpub as per the comments I got on HN itself! It is pay as you go model, and the minimum is $0 because I wanted to contribute back to the FOSS Community
2016
- 23PU
After seeing a cool demo of a hack on Twitter, I built a cross platform version of it that works well and uses streaming. From anywhere on Mac and Linux, trigger Ollama and optionally feed it your clipboard. I built it yesterday and it's already very useful to me. I'm pretty excited about it and wanted to share!
2024 · github.com
- 24AA
Hi HN! Last night, I live streamed myself coding this Llama 2 Agent on a Single GPU (Colab). After 6 hours it actually has some good results. How it works is it takes in your intuition (e.g. "I think x would be cool") and develops a business idea (with a name and branding colors) and a business plan. After the business plan is developed, it criticizes this plan recursively until the "Investor" prompt is satisfied with the plan. After all this it will generate the final MVP idea and pass it to a the React Engineer Agent I live coded 2 days ago…
2023 · github.com
Ranked by how close each launch is in meaning, then by votes. Refine with a description →