nowfound

Life & fun · September 22, 2022

I Built 0xFast Stream – 100x Faster Ethereum Block Downloads

Getting web3 data out of Ethereum nodes or node services is excruciatingly slow (at least days if not weeks). I had wanted a way to just download the blocks quickly since I started exploring the web3 space. Took me a bunch of trial and errors to get to a way where I can parse all the blocks since genesis within 12 hours. But, instead of moving on to the next thing, I put this service together over the last few days, so everyone can benefit.

I Built 0xFast Stream – 100x Faster Ethereum Block Downloads launched on September 22, 2022 with 13 votes, #999 of 3,464 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 4 years on.

In plain words

0xFast Stream is a service for downloading and parsing Ethereum blockchain data from genesis to the present. It addresses the slow speed of traditional node services and data extraction methods, completing what typically takes days or weeks in approximately 12 hours. The tool is designed for web3 developers and researchers who need quick access to historical Ethereum block data for analysis and exploration.

written from the facts on this page · September 2026

From the sources

Writing on databases, systems, and startups.

As I’ve ventured into the web3 space, I’ve been astounded by how unintuitive getting your hands on web3 data is. The first thing I wanted to do was to download the blockchain data and play with it. Seems simple enough, right? Not quite. While there are several web3 API services available, they can be excruciatingly slow. To test this out, I wrote a simple Go script to fetch an Ethereum block, all its transactions, its receipts, and logs. And I ran it over these services to see what kind of throughput and latency I could get. The numbers were surprisingly bad. Here’s the code , and these are the results: Ethereum mainnet has 15M+ blocks. At these speeds, it would take forever to download…from manishrjain.com

Does a similar job

all alternatives →
  • 0F
    0xFast – Faster Web3 APIs2022 · 0xfast.com · ▲63

    Excited to showcase 0xFast to HN! Built using a new indexing system designed for Web3 data, 0xFast outperforms the most popular web3 API platforms, while also being 3x cheaper.

  • Project Zero2024 · projectzero.io · ▲139

    Extract, transform & stream Blockchain data

  • Streams2024 · quicknode.com · ▲106

    Real-time blockchain data streaming made simple

  • Faster FastAPI with simdjson and io_uring on Linux 5.192023 · github.com · ▲290

    A few months ago, I benchmarked FastAPI on an i9 MacBook Pro. I couldn't believe my eyes. A primary REST endpoint to `sum` two integers took 6 milliseconds to evaluate. It is okay if you are targeting a server in another city, but it should be less when your client and server apps are running on the same machine. FastAPI would have bottleneck-ed the inference of our lightweight UForm neural networks recently trending on HN under the title "Beating OpenAI CLIP with 100x less data and compute". (Thank you all for the kind words!) So I wrote another library. It has been a while since I have…

  • Astra Block2023 · ibm.com · ▲62

    Stream real-time, human-readable blockchain data

  • Etherglade2018 · ▲136

    Accept Ethereum on your site in minutes!

More life & fun this month

the category →

Source: Show HN post ↗

Launched alongside, September 2022

the whole month →
  • IM

    Life & fun · 2022 · dogbunnypuzzle.com

  • A couple of years ago, I had an interesting idea. What if there was a marketplace where all the underlying tech was open-source? The order management system, the storefront, customer support, etc. The marketplace would simply connect to the seller’s infra instead of locking them in. If, for some reason, the seller is removed from the marketplace, their software stays with them and they can continue accepting orders directly. This model can be used to disrupt any marketplace from AirBNB to UberEats: building tech for home renters and restaurants and later, leveraging that to build a competing…

    Dev tools · 2022 · openship.org

  • Polywork▲1,214

    Discover opportunities to collaborate

    Life & fun · 2022

  • xTiles▲1,036

    Organize your ideas & projects visually

    Work · 2022 · xtiles.app

  • Arcade 2.0▲1,026

    The easiest way to showcase your product

    Life & fun · 2022 · arcade.software

  • Maven▲978

    100+ live courses taught by experts, education reimagined

    Life & fun · 2022 · maven.com