nowfound

Alternatives

Products that do what Export YOLO/RF-DETR Models to ONNX, TensorRT, CoreML – 100% Local does

  1. 1IR
  2. 2CO
  3. 3FS

    2016 · github.com

  4. 4TR
  5. 5DM

    2021 · github.com

  6. 6TJ
  7. 7HH
  8. 8LB
  9. 9BB
  10. 10TA
  11. 11RJ
  12. 12CM

    I'm a machine learning engineer who always found it annoying to integrate ML models into phone apps, smartwatch apps, microcontroller firmware etc... Why do we need all these libraries and runtimes with all the overhead, compatibility issues and other headaches, when it's just some math to be executed? So I made a compiler that simply converts the model into plain source code with no dependencies, and it actually solved all my deployment problems. Now I'm curious if it can help anyone else too. Through the link you can submit your model file (Keras h5, onnx soon to be supported), and I'll…

    2023 · waveworks.dk

  13. 13OS
  14. 14MZ
  15. 15AV
  16. 16ZE
  17. 17TE
  18. 18TF

    2021 · losttech.software

  19. 19PE
  20. 20XC
  21. 21K2

    Hey Hacker News! We are excited to share our open-source project, KTransformers, a flexible framework designed for cutting-edge LLM inference optimizations! Leveraging state-of-the-art kernels from llamafile and marlin, KTransformers seamlessly enhances the performance of HuggingFace Transformers, making it possible to operate large 236B MoE models or extremely long 1M context locally with promising speed. KTransformers is a Python-centric framework designed with extensibility at its core. By implementing and injecting an optimized module with a single line of code, users gain access to a…

    2024 · github.com

  22. 22PA
  23. 23SP

    I was recently playing with Apple's CoreML and had several painful observations on tooling. It's not enough for a long read but should be for an HN post. In short, you can take a simple BERT-like encoder model in PyTorch, convert it into an f32 CoreML checkpoint, and run it on CPU or GPU, but not NPU. Let's unpack this. Having a simple and extensible format to exchange common ANN architectures is a big issue for anyone who uses more than one framework or programming language to run the same model. ONNX is the closest we have to that standard, but it's hard to call anything Protobuf-related…

    2024 · github.com

  24. 24TO

    2016 · ecc-comp.blogspot.com

Ranked by how close each launch is in meaning, then by votes. Refine with a description →