nowfound

Life & fun · January 11, 2025

Jist now searches JSON 17x faster than jq

Hi HN! Happy to share that jist can now search JSON 17x faster than jq for a provided input (string or a file). The major change is using the bleeding edge simdjson parser as the preferred way of parsing and querying the input. Since simdjson can only work on files up to 4.2GB, jist falls back to its earlier implementation of scanning through input in chunks of 1MB which means it can still query files of virtually infinite size 3x faster than jq ever could while using ~10MB of memory. The next major feature will be summarizing input JSON into a schema - and it will do this by scanning the…

Jist now searches JSON 17x faster than jq launched on January 11, 2025 with 7 votes and more than 75% of that year's launches. The site was still online in September 2026, 1 year on.

What it does

Search a JSON path and get the value fast. Contribute to adelamodwala/jist development by creating an account on GitHub.

jist attempts to find the complete JSON value (string, number, bool, or JSON object) for a given search key as fast as possible. You can also summarize a full json/ndjson file into a schema to you know... get the "jist" of it ;) jist uses the state-of-the art simdjson library for parsing JSON input / files smaller than 4.2GB in size. For files larger than 4.2GB or that don't fit into memory or forced streaming mode (option -s or --streaming ), jist falls back to an earlier implementation using a simple character based lexer json-tools . While the fallback implementation is relatively slower than simdjson, it's still really fast at a throughput of ~300MB/s and uses almost no memory (around…from github.com

In the maker’s words, at launch

Hi HN! Happy to share that jist can now search JSON 17x faster than jq for a provided input (string or a file). The major change is using the bleeding edge simdjson parser as the preferred way of parsing and querying the input. Since simdjson can only work on files up to 4.2GB, jist falls back to its earlier…

Does a similar job

all alternatives →
  • Jist searches JSON 3x faster than jq2024 · github.com · ▲11

    Hi HN, jist is a JSON path search tool that feels like accessing a JavaScript object. It’s 3x faster than jq for the same use case, and over 2000x more memory efficient when searching a 3.3GB file for the last element (jist reads data in chunks so has constant space use). It doesn’t implement pattern matching yet. A feature I’m looking to add is generating a full JSON schema using the same streaming approach so stay tuned! Any feedback and feature requests are more than welcome

  • Faster FastAPI with simdjson and io_uring on Linux 5.192023 · github.com · ▲290

    A few months ago, I benchmarked FastAPI on an i9 MacBook Pro. I couldn't believe my eyes. A primary REST endpoint to `sum` two integers took 6 milliseconds to evaluate. It is okay if you are targeting a server in another city, but it should be less when your client and server apps are running on the same machine. FastAPI would have bottleneck-ed the inference of our lightweight UForm neural networks recently trending on HN under the title "Beating OpenAI CLIP with 100x less data and compute". (Thank you all for the kind words!) So I wrote another library. It has been a while since I have…

  • jql – Easier jq Alternative with a Lispy Syntax Written in Go2020 · github.com · ▲217

    Easy JSON Query Processor with a Lispy syntax in Go - cube2222/jql

  • JSON QueryOct 2025 · jsonquerylang.org · ▲154

    I'm working on a tool that will probably involve querying JSON documents and I'm asking myself how to expose that functionality to my users. I like the power of `jq` and the fact that LLMs are proficient at it, but I find it right out impossible to come up with the right `jq` incantations myself. Has anyone here been in a similar situation? Which tool / language did you end up exposing to your users?

  • JSON For You – Visualize JSON in graph or table views2024 · github.com · ▲211

    After two years of improvement, I think it's time to share it with you all. Here’s a quick overview: - Common features include validation, formatting, minification, and more. - Visualize JSON in a graph or table view. - Structured comparison with fallback to text comparison. - Navigate though JSON using JSON pointer. - Supports jq. Would love to hear the community's questions, thoughts and comments!

  • Searchable compression for JSON – ~99% page skip and sub-ms lookups2025 · github.com · ▲15

    Problem JSON/NDJSON is everywhere in data platforms, but compression usually breaks searchability. You either keep queryable raw stores (high I/O/egress) or compress into gz/zstd blobs (cheap to store, painful to probe). The “cloud tax” shows up as wasted reads. What I built (SEE — Semantic Entropy Encoding) A schema-aware, searchable compression codec for JSON that keeps exists/pos lookups fast while still compressing. Internals: structure-aware delta + dictionaries, a PageDir + mini-index to jump to relevant pages, and a tuned Bloom filter that skips ~99% of pages.…

More life & fun this month

the category →

Source: Show HN post ↗ · launch text quoted in part

Launched alongside, January 2025

the whole month →
  • Hello! I'm Byran. I spent the past ~6 months engineering a laptop from scratch. It's fully open-source on GH at: https://github.com/Hello9999901/laptop

    Dev tools · 2025 · byran.ee

  • TI

    I realized that the PDF engines of modern desktop browsers (PDFium and PDF.js) support JavaScript with enough I/O primitives to make a basic game like Tetris. It was a bit tricky to find a union of features that work in both engines, but in the end it turns out that showing/hiding annotation "fields" works well to make monochrome pixels, and keyboard input can be achieved by typing in a text input box. All in all it's quite janky but a nice reminder of how general purpose PDF scripting can be. The linked PDF is all ASCII so you can just open it in a text editor, or have a look at…

    Life & fun · 2025 · th0mas.nl

  • 21st.dev▲1,211

    I originally built this app to organize and reuse interesting React + Tailwind components I came across on Twitter, inspired by the shadcn/ui approach. Later, a friend started contributing their own components, and it got me thinking—this could grow into something bigger, like an NPM for design engineers to share and use components. Would love to hear your thoughts!

    Dev tools · 2025 · 21st.dev

  • Create lifelike, personalized AI avatars from text prompts

    AI · 2025 · jogg.ai

  • Turn Figma designs into full stack apps with AI

    Dev tools · 2025 · figma.com

  • CSS library based on Counter Strike 1.6 UI.

    Life & fun · 2025 · cs16.samke.me