nowfound

Dev tools · August 23, 2023

Pip install inference, open source computer vision deployment

Deploying vision models is time consuming and tedious. Setting up dependencies. Fixing conflicts. Configuring TRT acceleration. Flashing (and re-flashing) NVIDIA Jetsons. A streamlined, developer-friendly solution for inference is needed. We, the Roboflow team, have been hard at work open sourcing Inference, an open source vision deployment solution. Our solution is designed with developers in mind, offering a HTTP-based interface. Run models on your hardware without having to write architecture-specific inference code. Here's a demo showing how to go from a model to GPU inference on a video…

Pip install inference, open source computer vision deployment launched on August 23, 2023 with 71 votes, #1,421 of 4,347 launches that month and more than 90% of that year's launches. The site was still online in September 2026, 3 years on.

In plain words

Inference is an open source computer vision deployment tool that simplifies running vision models on various hardware through a standardized HTTP-based interface. Developers can deploy models without writing hardware-specific code, eliminating tedious configuration of dependencies, conflicts, and accelerators like TensorRT. The solution targets developers who need to move from trained models to production inference quickly, reducing deployment time significantly. It supports deployment across different devices and hardware platforms.

written from the facts on this page · September 2026

From the sources

Turn any computer or edge device into a command center for your computer vision projects. - roboflow/inference

In the maker’s words, at launch

Deploying vision models is time consuming and tedious. Setting up dependencies. Fixing conflicts. Configuring TRT acceleration. Flashing (and re-flashing) NVIDIA Jetsons. A streamlined, developer-friendly solution for inference is needed. We, the Roboflow team, have been hard at work open sourcing Inference, an open…

Does a similar job

all alternatives →
  • Inferless2025 · inferless.com · ▲749

    Deploy any machine learning models in minutes

  • General ComputeMay 2026 · generalcompute.com · ▲315

    AI models that run on an inference cloud optimized for speed

  • Banana2022 · banana.dev · ▲235

    Serverless GPUs for Machine Learning inference

  • ZeroGPUJun 2026 · zerogpu.ai · ▲298

    The compute efficient layer for AI inference

  • Inference Engine by GMI CloudDec 2025 · gmicloud.ai · ▲180

    Fast multimodal-native inference at scale

  • GA
    GPU-Accelerated Inference Hosting2021 · inferrd.com · ▲56

More dev tools this month

the category →
  • /dev/null▲481

    a social network for devs

    Dev tools · 2d ago · dev-null.sh

  • open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.

    Dev tools · 27d ago · github.com

  • Contribute to reladraw/reladraw development by creating an account on GitHub.

    Dev tools · 25d ago · github.com

  • OpenBot▲362

    Grok Bot alternative: free, local, open-source, multiplayer

    Dev tools · 22d ago · openbot.run

  • Talanoa▲341

    Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…

    Dev tools · 20d ago · talanoa.email

  • CoreSpeed▲332

    One MCP for everything your agents need: apps, memory, tools

    Dev tools · 28d ago · corespeed.io

Source: Show HN post ↗ · launch text quoted in part

Launched alongside, August 2023

the whole month →
  • Resend▲1,325

    An entire collection of pre-built components with a much faster development experience.

    Dev tools · 2023 · resend.com

  • STORI AI▲1,316

    Your ideas become visually compelling branded social posts

    AI · 2023 · storiai.com

  • Kombai▲1,079

    A new AI model that you can prompt with UI designs

    AI · 2023 · kombai.com

  • Understand your audience without 50 interviews

    AI · 2023 · founderpal.ai

  • Lottielab▲869

    Create and ship lottie animations to sites and apps faster

    Dev tools · 2023 · lottielab.com

  • Outlines is a Python library that focuses on text generation with large language models. Brandon and I are not LLM experts and started the project a few months ago because we wanted to understand better how the generation process works. Our original background is probabilistic, relational and symbolic programming. Recently we came up with a fast way to generate text that matches a regex (https://blog.normalcomputing.ai/posts/2023-07-27-regex-guide...). The basic idea is simple: regular expressions have an equivalent Deterministic-Finite Automaton (DFA) representation. We…

    AI · 2023 · github.com