Alternatives
Products that do what I implemented evals metrics for LLMs that runs locally on your machine does
- 1
- 2FT
May 2026 · github.com
- 3IB
Built a simple web app that tells you which open-source LLMs will work on your hardware. It auto-detects your specs, shows compatible models from Hugging Face, gives realistic performance estimates (tokens/sec), and recommends quantization settings. You can also manually input specs to see "what if I upgraded my RAM?" Made this after wasting time downloading giant models only to find they crawled on my hardware. Hope it saves you some frustration!
2025 · caniusellm.com
- 4LA
Feb 2026 · github.com
- 5LR
I built localLLLM: a small community project for running local models. Live: https://locallllm.fly.dev The goal is simple: if someone has model + OS + GPU + RAM, they should get steps that actually work (ideally one liner) I need help populating and validating guides. If you run local models, please submit one working recipe (or report what failed). Would love to hear general feedback as well!
Apr 2026 · locallllm.fly.dev
- 6AE
I've been working on a site [1] to give people control of their LLM workflows through AI evals - automated checks that, once defined, let you move fast without regressions and cut through hype with proof. That one-liner is aimed at software engineers, but I've spent my career helping cross-functional teams collaborate, and that's really what this is about. AI agents make powerful workflows very plausible, but only if teams can grow them incrementally without losing control - no vendor lock-in, no discipline silos, no blind trust in outputs. The site tries to meet different audiences where…
Feb 2026 · ai-evals.io
- 7SE
Hey HN! I built self-driving sim and eval at Waymo. Now I’m building Scorecard to bring that approach to agent eval: reproducible, automated scoring for AI. Scorecard lets you: - Run LLM-as-judge evals on agent workflows: test tool usage, multi-step reasoning, and task completion in CI/CD or in a playground. - Debug failures with OpenTelemetry traces: see which tool failed, why your agent looped, and where reasoning went wrong. - Collaborate on datasets, simulated agents, and evaluation metrics. Try it out → https://app.scorecard.io (free tier, no payment required!) Docs →…
Oct 2025 · docs.scorecard.io
- 8IB
2025 · interlify.com
- 9IM
Live demo here: http://fonctionlabs.com:8000 Similarly to aka_sh (guess we were working parallelly on similar topics), I created with my brother a chainlit-based webapp, which summarizes Youtube videos in order to gain time. It works as an RAG-based LLM, and is very light in the sense that it does not use RAG libraries like langchain or llamaindex. You can use it with your own OpenAI API key. It also supports local models like Mistral, or Llamma. It is ofc open-source, and you can deploy with Docker if you choose. Some of the next steps are: - using whisper to be able to compute a…
2024 · github.com
- 10IB
I was overspending on GPT-4o. It was really hard to compare different models I could switch to, so I built this LLM comparison tool. It shows leaderboards, pricing, and performance data across 100+ LLMs (including all major providers and open-source models). Key features: - Live pricing comparisons - Benchmark Scores (MMLU, HumanEval, GPQA, etc.) - Context length vs cost analysis - Speed/throughput tests across providers - Quality vs price visualizations - Open source (all data verifiable) Try it out: https://llmstats.com I'd like to know your opinion :) Tech stack: Next.js,…
2025 · llm-stats.com
- 11IE
Hi HN! I spent the last year traveling and feeling purposeless after shutting down my last startup (Zage YC S’21) in Dec 2022. There were some obstacles I couldn’t overcome and decided to return investors 50% of their capital. To afford (and justify to myself) traveling, I started consulting as an engineer and product designer. I started (https://backspace.nyc) and it was a good time. I (and some friends) built a handful of AI experiences and learned a lot along the way. The hardest thing about running a services business shipping and selling AI experiences powered by LLMs was…
2024 · loom.com
- 12AO
I've built an airgapped Retrieval-Augmented Generation (RAG) system for question-answering on documents, running entirely offline with local inference. Using Llama 3, Mistral, and Gemini, this setup allows secure, private NLP on your own machine. Perfect for researchers, data scientists, and developers who need to process sensitive data without cloud dependencies. Built with Llama C++, LangChain, and Streamlit, it supports quantized models and provides a sleek UI for document processing. Check it out, contribute, or suggest new features!
2024 · github.com
- 13AU
Hi HN, I was once given the advice: Don't waste expensive frontier model credits (GPT/Claude/etc.) on bulk work. Send the boring, repetitive, high-volume jobs to a smaller model, and save the expensive prompts for when you actually need frontier-level reasoning. I complained and told my manager that I shouldnt have to think about using certain models for certain coding tasks, and that one model should handle everything. Well, here we are anyway. If anyone needs a place to absolutely abuse an LLM with high-volume tasks, come beat ours up at https://yolo-auto.com. Here are…
Jul 2026 · yolo-auto.com
- 14
Structured evaluation of Apple Foundation Models on macOS
May 2026 · llmevalsuite.com
- 15LL
2023 · github.com
- 16RM
Apr 2026 · github.com
- 17IM
So hard to keep up with tooling and MLOps - I put it all in one place and got some tips from an experienced friend on what to use.
2025 · readyforagents.com
- 18IB
Hey HN, I've been working on something cool that I wanted to share with you all. It's called Viewpoint, an analytics tool for LLMs like OpenAI, Anthropic models, and Gemini. The idea came from the constant flood of new LLM models and the need to figure out which ones work best for my projects without breaking the bank. With viewpoint, I can track token usage, costs, latency(WIP), and traffic over time, making it easier to compare different models and see which ones perform best and save money. The tool works asynchronously, so it doesn't add any latency to your LLM requests, and you have…
2024 · viewpointhq.com
- 19AS
Hi HN! When I was the Product Management lead for HR Tech at Google, I thought there were several opportunities to integrate LLMs into our tools to make employees more efficient. Managers could get summaries of peer reviews, recruiters could quickly generate personalized outreach letters to candidates, etc. But I had 3 big problems: 1. Third Party Systems: A lot of work happens in Salesforce, Workday, SAP, etc. And we had no way of modifying that code to integrate what we wanted. 2. Legacy Systems: A lot of the tools in our portfolio were oooold, and nobody really wanted to go in and mess…
2024 · asksteve.to
- 20IL
2025 · github.com
- 21LA
Jun 2026 · rorlikowski.github.io
- 22EC
Hi! I've found myself repeatedly writing little scripts to do bulk calls to LLMs for various tasks. For example, run some analysis on a large list of records. There are a few "gotchas" to doing this. For example, some service providers have rate limits, and some models will not reliably return JSON (if you're asking for it). So, I've written a command for this. What I've tried to do here is let the user break up prompts and configuration as they see fit. For example, you can have a prompt file which includes the API key, rate limit, settings, etc. all together, or break these up into…
2025 · github.com
- 23IB
hey hn, I built an open-source Perplexity clone that can run local LLMs and cloud LLMs. It's fully self-hostable through Docker and uses ollama to support local LLMs. The demo video in the repository shows me running it locally with llama3 on my M1 Macbook Pro. I'm open to any suggestions or feedback, thanks!
2024 · github.com
- 24NB
I've spent weeks curating technical implementation details of how companies are actually deploying LLMs and Generative AI in production. The database now contains over 300 case studies with detailed technical summaries (230,000+ words) focusing exclusively on architectural decisions, deployment patterns, and real engineering challenges. Key features: * Each case study is technically focused - no marketing fluff * 150+ entries from technical conference talks and panels (saving you 100+ hours of video watching) * Sophisticated filtering by technical stack, RAG implementations, monitoring…
2024 · zenml.io
Ranked by how close each launch is in meaning, then by votes. Refine with a description →