nowfound

AI · January 8, 2024

Friendli Serverless Endpoints

Call open-source generative AI models with low costs

Visit site ↗Alternativestop 20% of January 2024

What it does

Users can seamlessly integrate open-source generative AI models into their applications with granular control at the per-token or per-step level at the lowest price on the market, enabling need-specific resource usage optimizations.

Does a similar job

all alternatives →
  • Evoke2023 · ▲317

    Run open source AI models on the cloud with our APIs

  • Generative.photos2019 · ▲439

    25k diverse & customizable free stock photos generated by AI

  • GA
    GoModel – an open-source AI gateway in GoApr 2026 · github.com · ▲217

    Hi, I’m Jakub, a solo founder based in Warsaw. I’ve been building GoModel since December with a couple of contributors. It's an open-source AI gateway that sits between your app and model providers like OpenAI, Anthropic or others. I built it for my startup to solve a few problems: - track AI usage and cost per client or team - switch models without changing app code - debug request flows more easily - reduce AI spendings with exact and semantic caching How is it different? - ~17MB docker image - LiteLLM's image is more than 44x bigger ("docker.litellm.ai/berriai/litellm:latest" ~…

  • EnergeticAI2023 · ▲142

    Use open-source AI in your Node.js apps, up to 67x faster

  • OS
    Open-source AI data generator (now hosted)Sep 2025 · metabase.com · ▲39

    Hey HN! A few months ago we shared our AI dataset generator as an open source repo, and the response was incredible (https://news.ycombinator.com/item?id=44388093). We got requests from folks who wanted to use it without the hosting overhead, so we created both options: a hosted version (https://www.metabase.com/ai-data-generator for instant use and the source code fully open (https://github.com/metabase/dataset-generator) for anyone who wants to self-host or contribute. Looking forward to seeing how you use it and what you build on top of…

  • JoyAI - Generative AI for Salesforce2023 · ▲87

    Connecting businesses with generative AI in meaningful ways

More ai this month

the category →
  • I trained a 125M model to autocomplete piano on-device▲598

    I trained a 125M-parameter transformer to autocomplete piano performances in real time (~108 notes/sec on an iPhone 15). The idea is basically GitHub Copilot or Tabnine, except instead of prompting it with code, you prompt it by playing a few notes on a MIDI piano. The model then continues what you played, entirely on-device. The app is free if anyone wants to try it. Happy to answer questions about the model, training, Core ML, or the many things that didn't work.

    AI · 19d ago · simedw.com

  • Astute▲585

    Automate your B2B brand going viral, with new media creators

    AI · 20d ago · company-app.joinastute.com

  • Grok Bot▲547

    AI teammates that you can give real work to

    AI · 27d ago · x.ai

  • Needle2: 14MB agentic LLM for phones, wearables, smart home and robots▲537

    Hey HN, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots and microcontrollers. We got really great feedback here, and have now incorporated the suggestions to release Needle 2. The whole model is a single 14MB binary that runs a full session in 28MB of RAM; 45m parameters at 2bit compression. Needle hits 500 tokens/sec decode speed on a Raspberry Pi 5, sits between 400-1,500 tokens/sec on VR devices like Meta Quest 3S and Apple Vision Pro, and ranges…

    AI · 29d ago · cactuscompute.com

  • Monid▲480

    One wallet, every paid tool your agent needs

    AI · 8d ago · monid.ai

  • Clara AI SDR▲460

    Turn website visitors into qualified pipeline

    AI · 21d ago · clarasdr.ai

Source: Product Hunt launch ↗

Launched alongside, January 2024

the whole month →