LLM Ops Toolkit by Lamatic.ai

What it does

Interactive tools for managing 20+ LLM APIs in production. Cost calculator, diversity audit, and routing simulator.

Real-time AI provider uptime monitoring + cost calculator and routing tools for 18+ LLM APIs in production.

Discover the true cost of managing multiple LLM providers — beyond API bills. Assess your organization's LLM operations maturity with 10 targeted questions. Visualize how intelligent routing distributes requests across models. Aggregate uptime monitoring across 18 AI API providers — 90-day history with response timefrom tools.lamatic.ai

• 
  TensorZero2025 · github.com · ▲307

  Hi HN! We're Gabriel & Viraj, and we're excited to open source TensorZero. To be a little cheeky, TensorZero is an open-source platform that helps LLM applications graduate from API wrappers into defensible AI products. 1. Integrate our model gateway 2. Send metrics or feedback 3. Unlock compounding improvements in quality, cost, and latency It enables a data & learning flywheel for LLMs by unifying: • Inference: one API for all LLMs, with <1ms P99 overhead • Observability: inference & feedback → your database • Optimization: better prompts, models, inference strategies • Experimentation:…

• 
  LLM StatsOct 2025 · llm-stats.com · ▲293

  I was overspending on GPT-4o. It was really hard to compare different models I could switch to, so I built this LLM comparison tool. It shows leaderboards, pricing, and performance data across 100+ LLMs (including all major providers and open-source models). Key features: - Live pricing comparisons - Benchmark Scores (MMLU, HumanEval, GPQA, etc.) - Context length vs cost analysis - Speed&#x2F;throughput tests across providers - Quality vs price visualizations - Open source (all data verifiable) Try it out: https:&#x2F;&#x2F;llmstats.com I'd like to know your opinion :) Tech stack: Next.js,…

• AT
  A tool to benchmark LLM APIs (OpenAI, Claude, local/self-hosted)2025 · llmapitest.com · ▲55

  I recently built a small open-source tool to benchmark different LLM API endpoints — including OpenAI, Claude, and self-hosted models (like llama.cpp). It runs a configurable number of test requests and reports two key metrics: • First-token latency (ms): How long it takes for the first token to appear • Output speed (tokens&#x2F;sec): Overall output fluency Demo: https:&#x2F;&#x2F;llmapitest.com&#x2F; Code: https:&#x2F;&#x2F;github.com&#x2F;qjr87&#x2F;llm-api-test The goal is to provide a simple, visual, and reproducible way to evaluate performance across different LLM providers, including…

• 
  LLMonitor2023 · ▲128

  Open source monitoring and production toolkit for AI apps

• 
  Free LLM API Pricing Calculator2024 · docsbot.ai · ▲175

  Calculate and compare the cost of the latest LLM APIs

• 
  LLM Pricing2024 · ailesson.io · ▲178

  LLMs price comparison tool developed and updated by LLM

• 
  /dev/null▲468

  a social network for devs

  Dev tools · 2d ago · dev-null.sh

• 
  Whiteboard (YC W26) – an open-source IDE for thoughtful software design▲423

  open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.

  Dev tools · 27d ago · github.com

• 
  Reladraw – A diagram language where you decide where to place things▲411

  Contribute to reladraw/reladraw development by creating an account on GitHub.

  Dev tools · 25d ago · github.com

• 
  OpenBot▲362

  Grok Bot alternative: free, local, open-source, multiplayer

  Dev tools · 22d ago · openbot.run

• 
  Talanoa▲340

  Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…

  Dev tools · 20d ago · talanoa.email

• 
  CoreSpeed▲332

  One MCP for everything your agents need: apps, memory, tools

  Dev tools · 27d ago · corespeed.io

• 
  Brila▲1,364

  One-page websites from real Google Maps reviews

  AI · Apr 2026 · brila.ai

• AG
  A game where you build a GPU▲964

  Thought the resources for GPU arch were lacking, so here we are

  Life & fun · Apr 2026 · jaso1024.com

• 
  I built a tiny LLM to demystify how language models work▲915

  Built a ~9M param LLM from scratch to understand how they actually work. Vanilla transformer, 60K synthetic conversations, ~130 lines of PyTorch. Trains in 5 min on a free Colab T4. The fish thinks the meaning of life is food. Fork it and swap the personality for your own character.

  AI · Apr 2026 · github.com

• 
  Fathom 3.0▲800

  AI meeting notes: now bot-free, in ChatGPT & Claude + more

  AI · Apr 2026 · fathom.ai

• 
  Brutalist Concrete Laptop Stand (2024)▲786

  I made a laptop stand out of solid concrete, in the style of brutalist architecture, with themes of urbex and urban decay

  Life & fun · Apr 2026 · sam-burns.com

• 
  I built a frontpage for personal blogs▲783

  With social media and now AI, its important to keep the indie web alive. There are many people who write frequently. Blogosphere tries to highlight them by fetching the recent posts from personal blogs across many categories. There are two versions: Minimal (HN-inspired, fast, static): https:&#x2F;&#x2F;text.blogosphere.app&#x2F; Non-minimal: https:&#x2F;&#x2F;blogosphere.app&#x2F; If you don't find your blog (or your favorite ones), please add them. I will review and approve it.

  AI · Apr 2026 · text.blogosphere.app