WhiteLightning – ultra-lightweight ONNX text classifiers trained w LLMs
Hey HN, We’re Volodymyr and Volodymyr—two developers from Ukraine building WhiteLightning. It’s a tool that turns large LLMs (Claude 4, Grok 4, GPT-4o via OpenRouter) into tiny ONNX text classifiers that run anywhere—even on drones at the edge. Why we built this: Many developers want custom models (spam filters, sentiment analysis, PII detection, moderation tools), but don’t want to deal with constant API calls or deploy heavy models in production. How it works: WhiteLightning uses LLMs to generate training data and distills it into KB-sized ONNX models you can run on any device and in any…
WhiteLightning – ultra-lightweight ONNX text classifiers trained w LLMs launched on August 1, 2025 with 8 votes, #2,487 of 8,530 launches that month and more than 75% of that year's launches.
What it does
In the maker’s words, at launch
Hey HN, We’re Volodymyr and Volodymyr—two developers from Ukraine building WhiteLightning. It’s a tool that turns large LLMs (Claude 4, Grok 4, GPT-4o via OpenRouter) into tiny ONNX text classifiers that run anywhere—even on drones at the edge. Why we built this: Many developers want custom models (spam filters…
Does a similar job
all alternatives →
Llama 3.2 Interpretability with Sparse Autoencoders2024 · github.com · ▲579I spent a lot of time and money on this rather big side project of mine that attempts to replicate the mechanistic interpretability research on proprietary LLMs that was quite popular this year and produced great research papers by Anthropic [1], OpenAI [2] and Deepmind [3]. I am quite proud of this project and since I consider myself the target audience for HackerNews did I think that maybe some of you would appreciate this open research replication as well. Happy to answer any questions or face any feedback. Cheers [1]…
TensorZero2025 · github.com · ▲307Hi HN! We're Gabriel & Viraj, and we're excited to open source TensorZero. To be a little cheeky, TensorZero is an open-source platform that helps LLM applications graduate from API wrappers into defensible AI products. 1. Integrate our model gateway 2. Send metrics or feedback 3. Unlock compounding improvements in quality, cost, and latency It enables a data & learning flywheel for LLMs by unifying: • Inference: one API for all LLMs, with <1ms P99 overhead • Observability: inference & feedback → your database • Optimization: better prompts, models, inference strategies • Experimentation:…
- PTPredictive text using only 13kb of JavaScript. no LLM2024 · adamgrant.info · ▲207

Tiny-vLLM – high performance LLM inference engine in C++ and CUDAMay 2026 · github.com · ▲205Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM - jmaczan/tiny-vllm
More ai this month
the category →



Paintings by AI models: programs run through a simulation of oil paint.
AI · 21d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 30d ago · world.pixverse.video

Source: Show HN post ↗ · launch text quoted in part
Launched alongside, August 2025
the whole month →

I built the world's most impractical 1000-pixel display and anyone in the world can draw on it. It draws a single pixel at a time and takes 30-60 minutes to complete a single image. Anyone can participate in the project by voting for the next image to be drawn, and submitting images. https://kilopx.com/
Work · 2025 · benholmen.com


Kitten TTS is an open-source series of tiny and expressive text-to-speech models for on-device applications. We are excited to launch a preview of our smallest model, which is less than 25 MB. This model has 15M parameters. This release supports English text-to-speech applications in eight voices: four male and four female. The model is quantized to int8 + fp16, and it uses onnx for runtime. The model is designed to run literally anywhere eg. raspberry pi, low-end smartphones, wearables, browsers etc. No GPU required! We're releasing this to give early users a sense of the latency and voices…
AI · 2025 · github.com

I was wondering how I can arrange objects along a spherical helix path, and read some articles on it. I ended up learning about parametric equations again, and make this visualization to document what I learned: https://visualrambling.space/moving-objects-in-3d/ feel free to visit and let me know what you think!
Life & fun · 2025 · visualrambling.space

For HTML Day 2025 [1], I made a web service that displays the current sky at your approximate location as a CSS gradient. Colours are simulated on-demand using atmospheric absorption and scattering coefficients. Updates every minute, without the use of client-side JavaScript. Source code and additional information is available on GitHub: https://github.com/dnlzro/horizon [1] https://html.energy/html-day/2025/index.html
Dev tools · 2025 · sky.dlazaro.ca