nowfound

Dev tools · June 23, 2025

Blockdiff – How we built our own file format for VM disk snapshots

Usually, I’m a researcher working on areas like RL for coding agents – but one day I became annoyed by our slow VM startup times. So I took the plunge into systems engineering and built the first version of our VM hypervisor called otterlink. It now powers both our research & all of Devin production workloads. Compared to EC2, otterlink was able to bring down VM startup times by about 10x. The real pain point, however, were EC2’s long snapshot times. We want a lot of flexibility (e.g. forking, rollback and suspending VMs) that all require taking disk snapshots. On EC2 taking disk snapshots…

Blockdiff – How we built our own file format for VM disk snapshots launched on June 23, 2025 with 11 votes, #2,422 of 7,999 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 1 year on.

In plain words

Blockdiff is a custom file format built for the otterlink VM hypervisor that enables fast disk snapshots for virtual machines. It performs block-level differential snapshots, reducing snapshot times from over 30 minutes to seconds. The format supports VM operations like forking, rollback, and suspension, and is used to power both research workloads and production systems. Blockdiff was developed by a researcher who transitioned into systems engineering to optimize VM performance and user experience.

written from the facts on this page · September 2026

From the sources

How we built blockdiff, an open-source tool for rapid block-level diffs and snapshots of VM disks.

We made it open-source here: https://github.com/CognitionAI/blockdiff Usually, I’m a researcher working on areas like RL for coding agents – but one day I became annoyed by our slow VM startup times. So I took the plunge into systems engineering and built the first version of our VM hypervisor called otterlink . It now powers both our research & all of Devin production workloads. Devin writes and runs code in a VM environment. Why VMs instead of Docker? For untrusted user workloads we require full isolation for security purposes . Moreover, many realistic dev environments require using Docker (e.g. to spin up a backend service or database). Good luck running Docker inside Docker, so we…from cognition.ai

In the maker’s words, at launch

Usually, I’m a researcher working on areas like RL for coding agents – but one day I became annoyed by our slow VM startup times. So I took the plunge into systems engineering and built the first version of our VM hypervisor called otterlink. It now powers both our research & all of Devin production workloads.…

Does a similar job

all alternatives →
  • Sub-millisecond VM sandboxes using CoW memory forkingMar 2026 · github.com · ▲311

    I wanted to see how fast an isolated code sandbox could start if I never had to boot a fresh VM. So instead of launching a new microVM per execution, I boot Firecracker once with Python and numpy already loaded, then snapshot the full VM state. Every execution after that creates a new KVM VM backed by a `MAP_PRIVATE` mapping of the snapshot memory, so Linux gives me copy-on-write pages automatically. That means each sandbox starts from an already-running Python process inside a real VM, runs the code, and exits. These are real KVM VMs, not containers: separate guest kernel, separate guest…

  • Slim – Build and run tiny VMs from Dockerfiles2019 · github.com · ▲389

    Build and run tiny vms from Dockerfiles. Small and sleek. - ottomatica/slim

  • Slim 2: Create VM from Dockerfile, boots in seconds (+macOS M1/Hyper-V)2022 · github.com · ▲59

    Build and run tiny vms from Dockerfiles. Small and sleek. - GitHub - ottomatica/slim at 2.x

  • Storage Block by Liveblocks2022 · liveblocks.io · ▲288

    Convert your product to multiplayer in minutes

  • Modshim – A new alternative to monkey-patching in Python2025 · github.com · ▲109

    I've invented a new alternative to forking / vendoring / monkey-patching packages in Python. It's a bit like OverlayFS for Python modules - it allows you write modifications for a target module (lower) in a new module (upper), and have these combined in a new virtual module (mount). It works by rewriting imports using AST transformations, then running both the lower and upper module's code in the new Python module. This prevents polluting the global namespace when monkey-patching, and means if you want to make changes to a third-party package, you don't have to take on the…

  • UVexplorer2023 · uvexplorer.com · ▲82

    Lightning fast layer 2 network mapping

More dev tools this month

the category →
  • /dev/null▲494

    a social network for devs

    Dev tools · 4d ago · dev-null.sh

  • Contribute to oosexgang/hackios-xnu-kernel development by creating an account on GitHub.

    Dev tools · 22h ago · github.com

  • open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.

    Dev tools · 29d ago · github.com

  • Contribute to reladraw/reladraw development by creating an account on GitHub.

    Dev tools · 27d ago · github.com

  • OpenBot▲362

    Grok Bot alternative: free, local, open-source, multiplayer

    Dev tools · 24d ago · openbot.run

  • Talanoa▲346

    Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…

    Dev tools · 22d ago · talanoa.email

Source: Show HN post ↗ · launch text quoted in part

Launched alongside, June 2025

the whole month →
  • IM

    Hey HN! Pilots everywhere are required to keep a logbook of all their flying hours, aircraft, airports, and so on. Since I track everything digitally (some people still just use paper logbooks!), I put together some data visualizations and a few 3D globes to show my flying history. This globe is probably my favourite so far: https://jameshard.ing/pilot/globes/all If you’ve got ideas for other graphs or ways to show this kind of data, I’d love to hear them!

    Life & fun · 2025 · jameshard.ing

  • Stunning presentations with AI. No design skills required.

    AI · 2025 · chroniclehq.com

  • Build native mobile apps for iOS and Android without code.

    Dev tools · 2025 · bble.io

  • Twenty▲989

    Build your Enterprise CRM with an AI-friendly SDK

    Dev tools · 2025 · twenty.com

  • All your connections, across all your socials.

    AI · 2025 · pally.com

  • I was the main contributor to workout.lol, an open-source fitness app to easily build a workout routine. The project had traction (1.4k GitHub stars, 95 forks, ~20K visits/month), but was eventually sold due to video licensing hurdles. The new owner stopped maintaining it, and the repo went abandoned. Over the next 9 months, I sent 15 emails to try to save it : no replies. Feature requests & issues were ignored. The community was left with a "broken" tool let's say. I couldn't just let it die So I built the new version from scratch with the same open-source spirit, but a better…

    Dev tools · 2025 · github.com