Alternatives
Products that do what We made a 2.5GB Offline disaster AI assistant [video] does
It is a prototype for Gemma 3n Impact Challenge hosted by DeepMind. We don't have experience on local LLM before, so it is a pretty fun learning experience. Hope to see more lightweight llm model in the future!
- 1PS
I didn't want to buy a standalone computer or repurpose a laptop to run constantly so I could maintain a system to sync my LLMs, so I built this. It's a simple overview of my system, laid out in a way easy to unpack and replicate for yourself. The project is meant to be configured individually, and uniquely, since one solution might not be what's best for another. If anything, maybe it gives you some ideas on how to implement things for your own project. Best wishes, Ryan.
28d ago · pacslate.com
- 2IT
I trained the 65b model on my texts so I can talk to myself. It's pretty useless as an assistant, and will only do stuff you convince it to, but I guess it's technically uncensored? I'll leave it up for a bit if you want to chat with it. I posted this to Reddit and had several hundred people talking to it. Salient points from that discussion: LLAMA 1 65b Rank 128 5 epochs Batch size 1, 256 cutoff Trained in the Oobabooga suite using bitsandbytes 4-bit quantization for the lora Loss around 1.5 seems to give the most coherent results Trained on raw text dumps that is then parsed by a crappy…
2023 · airic.serveo.net
- 3RA
Hi there, looking for feedback on my new project "Featherless.AI" The idea is to allow users to run all the models on hugging face instantly. Via the OpenAI API compatible endpoint. Why? Because its a real chore to download models and spin up GPUs, especially if you want to test multiple models. Not to mention GPUs cost multiple dollars an hour to rent. And if we want more people to use open source AI, we got to make it easier for them to try and play with all of them. So what if instead of spinning up dedicated GPUs per model (which is what every provider is doing) We can startup a LLM…
2024 · featherless.ai
- 4IM
Every time I wanted to use LLMs in my existing pipelines the integration was very bloated, complex, and too slow. This is why I created a lightweight library that works just like scikit-learn, the flow generally follows a pipeline-like structure where you “fit” (learn) a skill from sample data or an instruction set, then “predict” (apply the skill) to new data, returning structured results. High-Level Concept Flow Your Data --> Load Skill / Learn Skill --> Create Tasks --> Run Tasks --> Structured Results --> Downstream Steps And the bast part: Every step can be saved and reused as…
2025 · github.com
- 5AT
We kept shipping “simple” LLM features that were fluent-but-wrong. After too many postmortems we wrote down the failure patterns and added a small reasoning layer in front of the model. It’s model-agnostic, sits beside your existing stack, and you can implement it from a single PDF (MIT). What’s inside the PDF A problem map of 16 failure modes we kept hitting in real systems (OCR/layout drift, table-to-question mismatches, embedding≠meaning, pre-deploy collapse, etc.). Four lightweight gates you can add today: Knowledge-boundary canaries (empty/adversarial/known-fact probes).…
2025 · github.com
- 6LC
May 2026 · github.com
- 7HP
Hi HN. I heard you like dev tools and AI, so we wanted to share our project that we’ve been working on. We’re working on Horizon [1] - a higher level abstraction for LLMs so that developers can spend less time trying to grapple with LLMs to make them work and more time with users. This is the starting feature set which takes an auto-ML approach to identify the optimal LLM model, hyperparameters, and prompt - instead of just giving you the tooling to figure it out yourself. You can read more about it in our documentations. Our view is that as LLMs become increasingly commoditized and prompts…
2023 · gethorizon.ai
- 8MA
I've been working on training this small vision language model for the last month - excited to release the first prototype today! It is based on SigLIP (image encoder), Phi-1.5 (text model) and trained using the LLaVa-1.5 training dataset. It runs reasonably fast on CPU with ~8GB of RAM in full 32-bit precision. There's plenty of room to speed it up and reduce memory consumption by quantizing the model. I posted a video of it running on my M2 Macbook Air (on CPU not MPS, so performance should be comparable on other hardware) on Twitter to demonstrate inference speed:…
2023 · github.com
- 9WB
Hey HN, After GPT-3 created waves in the tech industry, a lot of AI tools were emerging and with that, some AI website builders But the results seemed way too generic to us. It felt like the developers were rushing to catch the wave instead of building a proper tool We took our time, did months of RnD and finally came up with something better than what others in the market are doing. It’s got better design output. While it’s still in beta, I wanted to show HN what we did. Will appreciate the feedback when you guys try it out. Here is the link to signup for the beta:…
2024 · dorik.com
- 10IM
I’m Hayden, a 13-year-old developer based in Australia, and I’ve built a CoT logical thinking and reasoning AI model similar to OpenAI o1. It's powered by open source small models like Llama 3.1 and 3.2 and I would love for you to try it and share your feedback with me. You can try it here: https://ai.pixelverse.tech/app/cortexchat I built it just for fun and launched it a day after the o1 release. It's not perfect yet but its still amazing to see how a detailed prompt can have such a difference on the quality of the LLM response! Please let me know any feedback or…
2024 · ai.pixelverse.tech
- 11
- 12GV
Hey HN, I just updated my project that compares some LLMs. It uses your prompt for all the models and runs at the same time. You can see the results being generated in real-time and decide what's the best for your use case. I'm open to any suggestions and feedback. Thanks!
2024 · geminivsgpt.com
- 13MA
Fed up of 'restrictive' AI training plan creators, history analysers and lifestyle loggers. Try this - bit nerdy, lots of rough edges!
Nov 2025 · intervals.pro
- 14OS
Hi HN, We're a small team building AI tutors out of India, and as you might guess, this means we spend a ton of time writing, testing, and refining prompts for LLMs. When we started out, we were using the OpenAI playground but things became tedious when we wanted to compare responses from different models. We tried a bunch of other playgrounds but found them lacking in some features so we built our own. Quick Links: Github: https://github.com/supernova-app/ai-playground Hosted demo: http://playground.getsupernova.ai Demo video:…
2025 · playground.getsupernova.ai
- 15MA
Hi HN, A couple weeks ago I shared an early version of a side project I’ve been tinkering with called Persistent Mind Model. I built it at home on an i7-10700K / 32GB RAM / RTX 3080 because I was curious whether an AI could keep a stable “mind” over time, that could "think" about it's own identity as an LLM, instead of resetting every session. After a lot more tinkering, I think the architecture is finally in a solid place. Basically, it saves everything the AI does, thoughts, decisions, updates as a chain of events in a local SQLite database. Because the “identity” is stored in…
Nov 2025 · github.com
- 16IB
Hey HN, I've been working on something cool that I wanted to share with you all. It's called Viewpoint, an analytics tool for LLMs like OpenAI, Anthropic models, and Gemini. The idea came from the constant flood of new LLM models and the need to figure out which ones work best for my projects without breaking the bank. With viewpoint, I can track token usage, costs, latency(WIP), and traffic over time, making it easier to compare different models and see which ones perform best and save money. The tool works asynchronously, so it doesn't add any latency to your LLM requests, and you have…
2024 · viewpointhq.com
- 17IS
Hey HN! For that last 8 months I've been trying to make agents that can hack web applications to find vulnerabilities in them - An AI Security Tester. The system has 29 agents in total, a custom LLM Orchestration framework which works on the task-subtask architecture (old-school but works amazingly for my use case, and is pretty reliable) with custom agent calling mechanism. No Auo-Gen, Langchain and Crew AI - Everything custom built for pentesting. Each test runs in an isolated Kali linux environment (on AWS Fargate), where the agents have full access to the environment to undertake any…
2025
- 18AG
I’ve been building LLM tooling for a small VC fund and found myself explaining the same mental model over and over to non-technical people around me: how a stateless LLM becomes a chatbot, how tool use works, what an agent is mechanically, and why context windows shape all of it. I never found a guide that covered that full chain at the level I wanted, so I wrote one. It’s nine short chapters, each building on the last. Deliberately simplified: the goal is a useful mental model, not a textbook. Feedback, corrections, and contributions welcome: github.com/ymyke/aiaiai
Apr 2026 · aiaiai.guide
- 19AA
Hey folks, I'm Yuval. I run a tiny startup called Glitter AI. It's just me full-time here, with a couple of freelances to help here and there. A couple of months ago, I went from managing zero requests to hundreds -- overnight (won Product of the day on Product Hunt). As someone who gets VERY easily distracted (maybe you relate), I had to find some sort of way of handling all the chaos if I didn't want to burn out. I came up with a pretty cool automation flow that I thought folks on HN here may be interested in reading about :) So here goes: Most of my interactions come through Intercom.…
2024
- 20HH
I found myself building a bunch of LLM-backed features that needed to use tool calling, and some of those tools involved doing things that were somewhat high stakes - communicating on my behalf or modifying shared / production data. one example - I wanted to replace a marketing website with a chatbot + vector DB loaded with the previous content, docs, and blog posts. Between hallucinations, missing knowledge base info, and the LLM generally writing like an psuedo-intellectual high schooler, I realized I couldn't trust it to communicate unsupervised with my website visitors. I needed a…
2024 · github.com
- 21IM
I had really bad health anxiety the last 2 years that severely impacted my quality of life. I started using Claude for support and was surprised by how much it helped. I realised how much potential there is for LLMs to provide an objective perspective on stressful thoughts - so I built an app that helps you form a habit around this to reduce long term anxiety. You vent what's on your mind and an LLM will evaluate your thoughts objectively (heavily leaning on CBT techniques), to help you maintain a more balanced perspective. Technical stack: - Flutter (to release cross-platform) - OpenAI API…
2025 · resetapp.co.uk
- 22IA
I am working on an AI that uses multiple LLM based agents to do medical research on any topic you choose! The program terminates after a set number of iterations and all of the findings are saved. Still a work in progress but it is showing some promising results imho! Would love to receive any critical and constructive feedback, collaborate, Review your PRs, or discuss your ideas!!
2023 · github.com
- 23AD
Hi all, I threw together a small prototype I am calling “Notepad.ai”. A new take on UIs for interacting with LLMs. While I enjoy using LLM’s in the chat format I wanted to see what it would be like to do it in a more long form style. It let’s you write in a pretty free form, much like Window’s Notepad, but you can choose to hit ctrl+[ to analyze the text with a preset prompt of your choosing. It has a few other small features. It’s WIP and very experimental. I would appreciate any feedback or thoughts. Video: https://youtu.be/ntdlgFmSxQY Live Demo:…
2024 · github.com
- 24IB
Think of HackerNews, but only for AI content. Did build this out of the wish for easier discoverability of new technologies in the AI/ML space. Obviously, so far only a tiny small community, but maybe a few of you find it nice to be around and want to post a link there every now and then :)
2023 · news.aiapipro.com
Ranked by how close each launch is in meaning, then by votes. Refine with a description →