Alternatives
Products that do what Fast,Compiled deep-learning based modules for inferencing on CPUs does
Hi HN,I am Anubhav from RamanLabs.We have been developing dedicated modules based on deep-learning for purposes like face-detection,object-detection,pose-estimation etc. We hope to make it easy for developers,hobbyists to integrate such functionalities into their existing app/pipeline at the cost of a few milliseconds.All our modules run end to end in super-realtime even on consumer-grade CPUs[0]. For now we provide only Python based API. We provide Demo for each of the modules to allow testing for your desired data distribution.We also have a blog[1] where we hope to add more technical…
- 1
- 2
- 3TA
2020 · thinc.ai
- 4IC
Hi HN, I am Anubhav from RamanLabs. We have been developing end to end Computer-vision modules to make it easy for developers, hobbyists to integrate such functionality into their applications with minimal amount of code. All modules are developed to run real-time on consumer-grade CPUs[0]. For now we are releasing only Python-language SDK. Demos are provided to allow users to test performance on desired data-distribution. Framework powering these modules in completely written in Nim language, which under the hood wraps some Operation's implementation provided by libraries like…
2022 · ramanlabs.in
- 5DA
DeepFace is a leading open-source library for facial recognition and facial attribute analysis, and the de facto standard in Python. It wraps multiple state-of-the-art models that have reached — and even surpassed — human-level accuracy in recognizing faces. By the numbers (as of early 2025): 15,000+ stars on GitHub; ~4 million installations via pip; 800+ citations in academic papers Whether you're building a cutting-edge AI project or simply exploring facial recognition, DeepFace makes advanced capabilities accessible with just a few lines of code.
2025 · github.com
- 6IB
Hi HN, Over the past few months, I've been building `dsc`, a tensor library from scratch in C++/CUDA. My main focus has been on getting the basics right, prioritizing a clean API, simplicity, and clear observability for running small LLMs locally. The key features are: - C++ core with CUDA support written from scratch. - A familiar, PyTorch-like Python API. - Runs real models: it's complete enough to load a model like Qwen from HuggingFace and run inference on both CUDA and CPU with a single line change[1]. - Simple, built-in observability for both Python and C++. Next on the roadmap is…
2025 · github.com
- 7
- 8WM
We wrote our inference engine on Rust, it is faster than llama cpp in all of the use cases. Your feedback is very welcomed. Written from scratch with idea that you can add support of any kernel and platform.
2025 · github.com
- 9RA
This started out as a personal effort to learn more about machine learning. It's currently a CLI app where you give it a JSON file specifying your network architecture and hyperparameters and point it to your training data, then invoke it again in 'eval' mode with some data it's not seen before and it will try to classify each sample. I don't see many other people using Vulkan for GPGPU, and there may be many good reasons for that, but I wanted to try something a bit different. I've made every attempt to make the code very clean and readable and I've written up the math in…
2024 · github.com
- 10
- 11DA
2017 · deepforge.org
- 12PI
Deploying vision models is time consuming and tedious. Setting up dependencies. Fixing conflicts. Configuring TRT acceleration. Flashing (and re-flashing) NVIDIA Jetsons. A streamlined, developer-friendly solution for inference is needed. We, the Roboflow team, have been hard at work open sourcing Inference, an open source vision deployment solution. Our solution is designed with developers in mind, offering a HTTP-based interface. Run models on your hardware without having to write architecture-specific inference code. Here's a demo showing how to go from a model to GPU inference on a video…
2023 · github.com
- 13PO
Our company Vertex.AI has been working on this for a while but this is the first public release. We're starting with using PlaidML to bring OpenCL support to Keras and more frameworks, platforms, etc are coming. Yes, this means you can use use your AMD GPU for deep learning dev. Sorry, no Mac or Windows support yet although the brave can try building from source (it should work). http://vertex.ai/blog/announcing-plaidml https://github.com/plaidml/plaidml
2017
- 14IB
I’ve spent the last few months building a deep learning engine completely from scratch in Python (using only math and random). What started as a basic linear algebra calculator project grew into a symbolic tensor system with autodiff, custom matrix ops, attention mechanisms, LayerNorm, GELU, and even a text generation demo trained on the Brown corpus. I'm still an undergrad, so my main goal is to deeply understand how deep learning actually works under the hood - gradients, attention, backpropagation, optimizers - by building it step-by-step with full visibility into everything, and without…
2025 · github.com
- 15
- 16ET
2017 · github.com
- 17
- 18
- 19TR
2018 · actcast.io
- 20
- 21DG
2016 · github.com
- 22IW
2021 · github.com
- 23IB
Dec 2025 · github.com
- 24CM
I'm a machine learning engineer who always found it annoying to integrate ML models into phone apps, smartwatch apps, microcontroller firmware etc... Why do we need all these libraries and runtimes with all the overhead, compatibility issues and other headaches, when it's just some math to be executed? So I made a compiler that simply converts the model into plain source code with no dependencies, and it actually solved all my deployment problems. Now I'm curious if it can help anyone else too. Through the link you can submit your model file (Keras h5, onnx soon to be supported), and I'll…
2023 · waveworks.dk
Ranked by how close each launch is in meaning, then by votes. Refine with a description →