Alternatives
Products that do what Export YOLO/RF-DETR Models to ONNX, TensorRT, CoreML – 100% Local does
- 1IR
2016 · github.com
- 2CO
2020 · github.com
- 3FS
2016 · github.com
- 4TR
2018 · github.com
- 5DM
2021 · github.com
- 6TJ
2018 · github.com
- 7HH
2018 · github.com
- 8LB
2021 · lowdefy.com
- 9BB
2018 · github.com
- 10TA
2015 · github.com
- 11RJ
2018 · remoteml.com
- 12CM
I'm a machine learning engineer who always found it annoying to integrate ML models into phone apps, smartwatch apps, microcontroller firmware etc... Why do we need all these libraries and runtimes with all the overhead, compatibility issues and other headaches, when it's just some math to be executed? So I made a compiler that simply converts the model into plain source code with no dependencies, and it actually solved all my deployment problems. Now I'm curious if it can help anyone else too. Through the link you can submit your model file (Keras h5, onnx soon to be supported), and I'll…
2023 · waveworks.dk
- 13OS
2016 · vpj.github.io
- 14MZ
2020 · modelzoo.dev
- 15AV
2018 · github.com
- 16ZE
2020 · github.com
- 17TE
2021 · inferrd.com
- 18TF
2021 · losttech.software
- 19PE
2017 · pollly.orson.io
- 20XC
2017 · github.com
- 21K2
Hey Hacker News! We are excited to share our open-source project, KTransformers, a flexible framework designed for cutting-edge LLM inference optimizations! Leveraging state-of-the-art kernels from llamafile and marlin, KTransformers seamlessly enhances the performance of HuggingFace Transformers, making it possible to operate large 236B MoE models or extremely long 1M context locally with promising speed. KTransformers is a Python-centric framework designed with extensibility at its core. By implementing and injecting an optimized module with a single line of code, users gain access to a…
2024 · github.com
- 22PA
2019 · panini.ai
- 23SP
I was recently playing with Apple's CoreML and had several painful observations on tooling. It's not enough for a long read but should be for an HN post. In short, you can take a simple BERT-like encoder model in PyTorch, convert it into an f32 CoreML checkpoint, and run it on CPU or GPU, but not NPU. Let's unpack this. Having a simple and extensible format to exchange common ANN architectures is a big issue for anyone who uses more than one framework or programming language to run the same model. ONNX is the closest we have to that standard, but it's hard to call anything Protobuf-related…
2024 · github.com
- 24TO
2016 · ecc-comp.blogspot.com
Ranked by how close each launch is in meaning, then by votes. Refine with a description →