Alternatives
Products that do what Finetune a Gemma 2B model for codegen does
Sharing instructions on finetuning Gemma2b for a codegen usecase!
- 1
- 2
- 3
Hey HN, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots and microcontrollers. We got really great feedback here, and have now incorporated the suggestions to release Needle 2. The whole model is a single 14MB binary that runs a full session in 28MB of RAM; 45m parameters at 2bit compression. Needle hits 500 tokens/sec decode speed on a Raspberry Pi 5, sits between 400-1,500 tokens/sec on VR devices like Meta Quest 3S and Apple Vision Pro, and ranges…
27d ago · cactuscompute.com
- 4
- 5
- 6
- 7
- 8
- 9EC
2020 · github.com
- 10CC
2020 · codemap.app
- 11NT
I built a CLI tool that turns codebases and PRs into diagrams so you can quickly understand how things fit together. Originally made it because I couldn't follow my own AI-generated repos. Just shipped a big update: - Switched from D2 to Mermaid for rendering - Tree-sitter AST parsing + agentic flow instead of raw LLM calls. ~50x faster. - Works on any GitHub repo or PR, not just local - Dropped the web frontend, it's just a CLI now - Published as a pip package Still a ton to improve and I'm building fast. Feedback, issues, PRs all welcome.
Feb 2026 · github.com
- 12AD
2018 · blog.jupyter.org
- 13
- 14BG
2017 · python-boilerplate.com
- 15IG
2021 · imagine.ai
- 16IM
I made my first macOS utility app that ships with a bundled Gemma 4 model, specifically the Gemma E4B one. It made my app DMG have 5.3 GB in size, but I think it is a small size for the power that this free local model can provide. It runs fine on CPU, but can also run on Apple Silicon GPU, although I did not notice any performance improvements with GPU (tested on a M5 chip). I think these local lightweight and multimodal models will open multiple possibilities for new software tools where privacy is essential.
May 2026 · snapname.app
- 17E0
2017 · github.com
- 18OS
2016 · coderoad.github.io
- 19IM
Hey guys, I made a VS Code extension, within which you can use the Mixtral 8x7B AI model for free. Mixtral 8x7B is a new AI model from the Mistral family, which outperforms GPT-3 in many benchmarks, a fact that I have personally confirmed in daily coding tasks, where Mistral 8x7B was the clear winner. You can use all the AI features, such as AI Lens with custom instructions and similar. I'm pretty sure some of features will be useful to you. I'd appreciate both, positive and negative feedback!
2023 · marketplace.visualstudio.com
- 20MM
Hi HN! We (Thomas and Stéphan, hello!) recently released Model2Vec, a Python library for distilling any sentence transformer into a small set of static embeddings. This makes inference with such a model up to 500x faster, and reduces model size by a factor of 15 (7.5M params or 15/30MB on disk, depending on whether you use float16 or float32). This allows you to embed 50-100k documents per second on a cpu on a macbook. This reduction of course comes at a cost: distilled models are worse than their parent models. Even so, they are actually a lot better than large sets of conventional…
2024 · github.com
- 21CV
I worked as a software engineer at Amazon, SAP, and on open source. In all 3 places I have struggled with the friction of understanding codebases before I can make a contribution. I think this brain-fatiguing process can be improved. I am trying to solve it with a tool I built over the last 4 years called CodeCanvas: https://docs.code-canvas.com CodeCanvas visualizes codebases through interactive diagrams linked directly to source code. Users can record 'simulations' to demonstrate data flow and business logic. I’ve also recently added an LLM chat where it takes only the relevant…
2025 · pie-crepe-38f.notion.site
- 22M2
2019 · reddit.com
- 23CP
2022 · code-struct.vercel.app
- 24PT
I vibe-coded a terminal tool called Pluqqy (I had a dormant domain on hand) to help me keep LLM context organized while coding with AI. It’s my first time writing Go and my first terminal app, built almost entirely with Claude Code. • What it does: Pluqqy lets you manage prompts, rules, and context as small building blocks, then stitch them together into a single file (like AGENT.md or CLAUDE.md) that your coding agent can consume. It’s meant to reduce context drift and make iteration easier. • Why I built it: I was losing track of my agent context between sessions and wanted something…
Oct 2025 · github.com
Ranked by how close each launch is in meaning, then by votes. Refine with a description →