nowfound

AI · March 14, 2024

Open-source AI studio – Core infrastructure stack for LLM Apps

[deprecated] AI Gateway - core infrastructure stack for building production-ready AI Applications - pyadav/gateway

Open-source AI studio – Core infrastructure stack for LLM Apps launched on March 14, 2024 with 29 votes, #1,081 of 4,270 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 2 years on.

Visit github.com ↗Alternativestop 25% of March 2024

In plain words

Open-source AI studio is core infrastructure software designed for building applications with large language models. It provides developers with foundational tools and frameworks needed to construct LLM-based systems. The software is available as open-source code, making it accessible to developers who want to build AI applications without proprietary constraints. It targets software engineers and teams developing AI-powered applications.

written from the facts on this page · September 2026

Does a similar job

all alternatives →
  • LLM Gateway2025 · llmgateway.io · ▲296

    I built an OpenAI-compatible LLM gateway that routes requests to OpenAI, Anthropic, Ollama, vLLM, llama-server, SGLang... anything that speaks /v1/chat/completions. Single Go binary, one YAML config file, no infrastructure. It does the things you'd expect from this kind of gateway... semantic routing via a three-layer cascade (keyword heuristics, embedding similarity, LLM classifier) that picks the best model when clients omit the model field, weighted round-robin load balancing across local inference servers with health checks and failover. The part I think is most…

  • Laminar2024 · laminar.sh · ▲350

    Open-source all-in-one platform for engineering AI products

  • LLMWare2024 · llmware.ai · ▲358

    Dev tool to make AI apps to deploy privately or locally

  • TrueFoundry AI GatewayDec 2025 · truefoundry.com · ▲315

    Many teams connecting LLMs to external tools eventually encounter the same architectural issue: as more tools and agents are added, the integration pattern becomes an N×M mesh of direct connections. Each agent implements its own auth, retries, rate limiting, and logging; each tool needs credentials distributed to multiple places and observability becomes fragmented. We built LLM gateway with this goal to provide a single place to manage authentication, authorization, routing, and observability for MCP servers, with a path toward a more general agent-gateway architecture in the future. The…

  • Dify.AI2023 · dify.ai · ▲261

    Open-source platform for LLMOps, define your AI-native apps

  • TensorZero2025 · github.com · ▲307

    Hi HN! We're Gabriel & Viraj, and we're excited to open source TensorZero. To be a little cheeky, TensorZero is an open-source platform that helps LLM applications graduate from API wrappers into defensible AI products. 1. Integrate our model gateway 2. Send metrics or feedback 3. Unlock compounding improvements in quality, cost, and latency It enables a data & learning flywheel for LLMs by unifying: • Inference: one API for all LLMs, with <1ms P99 overhead • Observability: inference & feedback → your database • Optimization: better prompts, models, inference strategies • Experimentation:…

More ai this month

the category →
  • Video model that turns script into viral social media videos

    AI · 18d ago · spira.ai

  • The browser where Claude Code and Codex work beside you

    AI · 17d ago · rill.love

  • Kolibri is Aleph Alpha

    AI · 19d ago · tej.as

  • Paintings by AI models: programs run through a simulation of oil paint.

    AI · 21d ago · stillwet.art

  • A real-time world model you can explore and change

    AI · 29d ago · world.pixverse.video

  • Beam.win▲377

    Run AI agents on one Mac and use its windows on another

    AI · 4d ago · beam.win

Source: Show HN post ↗

Launched alongside, March 2024

the whole month →
  • Dub.co▲1,475

    Short links with superpowers

    Dev tools · 2024 · dub.co

  • 🌐 The Internet Computer! Free, Open-Source, and Self-Hostable. - HeyPuter/puter

    Dev tools · 2024 · github.com

  • Microlaunch▲1,115

    Launch and get feedback on both the idea and product

    Dev tools · 2024 · microlaunch.net

  • Milestone▲1,113

    Interactive, gamified product tours for SaaS

    Growth · 2024 · milestoneflow.io

  • Hunted Space▲1,004

    Insights on Product Hunt launches

    Growth · 2024 · hunted.space

  • Creatie▲850

    The one-stop product design tool amplified by AI

    AI · 2024 · creatie.ai