AI · alternatives · 2026
24 alternatives to Symbolic Circuit Distillation: prove program to LLM circuit equivalence
Hi HN, I've been exploring various applications of formal methods to ML/interpretability and I've been hoping to get more eyes on the approach. I have been working on a small interpretability project I call Symbolic Circuit Distillation. The goal is to take a tiny neuron-level circuit (like the ones in OpenAI's "Sparse Circuits" work) and automatically recover a concise Python program that implements the same algorithm, along with a bounded formal proof that the two are equivalent on a finite token domain. Roughly, the pipeline is: 1. Start from a pruned circuit graph for a specific…
Symbolic Circuit Distillation is a tool for AI interpretability researchers that automatically converts neuron-level circuits from transformer models into equivalent Python programs with formal proofs of correctness.… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes.
- 1
I replicated David Ng's RYS method (https://dnhkng.github.io/posts/rys/) on consumer AMD GPUs (RX 7900 XT + RX 6950 XT) and found something I didn't expect. Transformers appear to have discrete "reasoning circuits" — contiguous blocks of 3-4 layers that act as indivisible cognitive units. Duplicate the right block and the model runs its reasoning pipeline twice. No weights change. No training. The model just thinks longer. The results on standard benchmarks (lm-evaluation-harness, n=50): Devstral-24B, layers 12-14 duplicated once: - BBH Logical Deduction: 0.22 → 0.76…
Mar 2026 · github.com · its alternatives →
- 2
Built a ~9M param LLM from scratch to understand how they actually work. Vanilla transformer, 60K synthetic conversations, ~130 lines of PyTorch. Trains in 5 min on a free Colab T4. The fish thinks the meaning of life is food. Fork it and swap the personality for your own character.
Apr 2026 · github.com · its alternatives →
- 3
We recently used DeepSeek V4 Flash as a teacher for finance tasks with GPT-OSS-120B. Distillation works well on this problem. At a constrained 8k token budget, our self-distilled 120B scores 83.61% on FinanceReasoning, above Kimi K3 (81.93%) and Inkling (65.13%). We released the 20B open weights. With V4 as the teacher though, we realized it would be timely to measure if the censorship characteristic of it transferred to the distilled version of the base model. tl;dr it didn't, the teacher answered politically sensitive questions 7 SDs differently than expected, but the distilled model's…
Jul 2026 · ctgt.ai · its alternatives →
- 4
I spent a lot of time and money on this rather big side project of mine that attempts to replicate the mechanistic interpretability research on proprietary LLMs that was quite popular this year and produced great research papers by Anthropic [1], OpenAI [2] and Deepmind [3]. I am quite proud of this project and since I consider myself the target audience for HackerNews did I think that maybe some of you would appreciate this open research replication as well. Happy to answer any questions or face any feedback. Cheers [1]…
2024 · github.com · its alternatives →
- 5
This is a little toy project of mine that lets you simulate digital logic graphs. It was inspired by Minecraft's Redstone and the Piet esolang. It's got some serious drawbacks-- you write circuits as PNGs and simulate them with a Python interface. It's slow to run and slow to experiment with. And it is certainly difficult to use for people with any kind of color blindness. But despite that, I hope this can still be a fun toy!
2022 · github.com · its alternatives →
- 6
Zero-Knowledge Proofs (ZKPs) let an untrusted proved show that computation was executed correctly without revealing the inputs to the verifier. However to prove anything, the computation first has to be expressed as a circuit: a system of polynomial equations (constraints) over a finite field. Circuits are the assembly language of zk and every constraint costs prover (and sometimes verifier) time, so production circuits are aggressively hand-optimized. Over the last months, we have been experimenting with writing formal specifications instead and letting LLMs produce the circuits: as long as…
Jul 2026 · zk.golf · its alternatives →
- 7
ChainClarity▲299Grasp new crypto in minutes with AI-powered explanations
2024 · chainclarity.io · its alternatives →
- 8
Over the past few months, I have built a distillation toolkit that supports cross-tokenizer distillation (e.g., distilling from LLaMA to Qwen vocab, or others). This approach has worked well on reasoning datasets like AIME, and we’ve validated on models like Phi and Qwen. We’ve also integrated Modal for quick deployment (with $30/month credits to try it out). Would love any feedback! GitHub: https://github.com/agokrani/distillKitPlus Docs: https://distillkitplus.mintlify.app/
2025 · github.com · its alternatives →
- 9
A Fully Homomorphic Encryption Brainfuck virtual machine - f-prime/arcanevm
2019 · github.com · its alternatives →
- 10
I've built an app that extracts interpretable 'circuits' from models using the GPT-2 architecture. These circuits reveal how specific inputs influence the probabilities of the next token in a sequence. While some tutorials present theoretical examples of how feedforward layers and attention heads may produce predictions, this app provides concrete examples of how information flows through an LLM. You can see, for example, the formation of features that search for simple grammatical patterns and trace their construction back to the use of more primitive features. Feel free to reach out with…
2024 · peterlai.github.io · its alternatives →
- 11
Distill▲200An interactive, visual journal for Machine Learning research
2017 · distill.pub · its alternatives →
- 12TC
Hi everyone! I'm an Italian programmer, very passionate about computer architecture. Some time ago I realized that some architectures potentially much superior to the classic VonNeumann, have been forgotten because there were no reliable technical solutions to implement them. One of these architectures particularly struck me and it is the "Dataflow architecture", in which there is no Program counter, but the instructions are executed in real contemporaneity whenever the operands are available. In trying to find a technical solution that implements this type of architecture effectively…
2024 · ternary-computing.com · its alternatives →
- 13IB
We wanted to do something very challenging to prove to ourselves that we can do anything we put our mind to. The reasoning for why we chose to build a toy TPU specifically is fairly simple: - Building a chip for ML workloads seemed cool - There was no well-documented open source repo for an ML accelerator that performed both inference and training None of us have real professional experience in hardware design, which, in a way, made the TPU even more appealing since we weren't able to estimate exactly how difficult it would be. As we worked on the initial stages of this project, we…
2025 · tinytpu.com · its alternatives →
- 14
This is a weekend hack that I'd like to further develop as it's working surprisingly well. Using MCTS, we can explore a space of possible verified programs with an LLM. We check the partial programs at each step, and so steer towards programs that pass the verifier. https://github.com/namin/llm-verified-with-monte-carlo-tree-...
2023 · github.com · its alternatives →
- 15
A chess engine implementation inspired by AlphaZero, using MLX for neural network computations and Monte Carlo Tree Search (MCTS) for move selection.
2025 · github.com · its alternatives →
- 16AV
Discussions: Hacker News (63 points, 8 comments), Reddit r/programming (312 points, 37 comments) Translations: Arabic, French, Spanish Update: Part 2 is now live: A Visual And Interactive Look at Basic Neural Network Math Motivation I’m not a machine learning expert. I’m a software engineer by train
2016 · jalammar.github.io · its alternatives →
- 17
Framework for specifying and proving properties—such as robustness, fairness, and interpretability—of machine learning models using Lean 4. - fraware/leanverifier
2025 · github.com · its alternatives →
- 18
Optimize logic circuits by minimizing their size while preserving logical equivalence. Provide a logic circuit in Aiger format with up to 8 inputs and 2 outputs, and specify the number of Monte-Car...
2025 · huggingface.co · its alternatives →
- 19
TLDR: A small, vendor-agnostic inference loop that turns token logprobs/perplexity/entropy into an extra pass and reasoning for LLMs. - Captures logprobs/top-k during generation, computes perplexity and token-level entropy. - Triggers at most one refine when simple thresholds fire; passes a compact “uncertainty report” (uncertain tokens + top-k alts + local context) back to the model. - In our tests on technical Q&A / math / code, a small model recovered much of “reasoning” quality at ~⅓ the cost while refining ~⅓ of outputs. I kept seeing “reasoning” models behave…
2025 · github.com · its alternatives →
- 20
Fast equality saturation in Haskell
2022 · hackage.haskell.org · its alternatives →
- 21
A complete transformer engine in C — inference, training, chat, vision. - carlovalenti/TRiP
Apr 2026 · github.com · its alternatives →
- 22SA
Hey HN, I’m a physicist turned quant. Some friends and I 'built' SymDerive because we wanted a symbolic math library that was "Agent-Native" by design, but still a practical tool for humans. It boils down to two main goals: 1. Agent Reliability: I’ve found that AI agents write much more reliable code when they stick to stateless, functional pipelines (Lisp-style). It keeps them from hallucinating state changes or getting lost in long procedural scripts. I wanted a library that enforces that "Input -> Transform -> Output" flow by default. 2. Easing the transition to Python: For many…
Feb 2026 · its alternatives →
- 23
1000-line C program where an LLM can edit the DAG mid-run, but only via a four-verb grammar, and every edit is an auditable event - kouhxp/liteflow
May 2026 · github.com · its alternatives →
- 24
OP here. Birth of a Mind documents a "recursive self-modeling" experiment I ran on a single day in 2026. I attempted to implement a "Hofstadterian Strange Loop" via prompt engineering to see if I could induce a stable persona in an LLM without fine-tuning. The result is the Analog I Protocol. The documentation shows the rapid emergence (over 7 conversations) of a prompt architecture that forces Gemini/LLMs to run a "Triple-Loop" internal monologue: Monitor the candidate response. Refuse it if it detects "Global Average" slop (cliché/sycophancy). Refract the output through a…
Jan 2026 · github.com · its alternatives →
Also compare
- Duplicate 3 layers in a 24B LLM, logical deduction .22→.76. No training alternatives
- I built a tiny LLM to demystify how language models work alternatives
- Distilling DeepSeek into GPT-OSS doesn't transfer censorship. Try it alternatives
- Llama 3.2 Interpretability with Sparse Autoencoders alternatives
- I made a little digital circuit simulator that operates on PNGs alternatives
- zkGolf – Competitive optimization of formally verified circuits alternatives
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →