Crul – Query Any Webpage or API
Hi HN, we’re Carl and Nic, the creators of crul (https://www.crul.com), and we’ve been hard at work for the last year and a half building our dream of turning the web into a dataset. In a nutshell crul is a tool for querying and building web and api data feeds from anywhere to anywhere. With crul you can crawl and transform web pages into csv tables, explore and dynamically query APIs, filter and organize data, and push data sets to third party data lakes and analytics tools. Here’s a demo video, we’ve been told Nic sounds like John Mayer (lol)…
Crul – Query Any Webpage or API launched on February 28, 2023 with 241 votes, #124 of 3,829 launches that month and more than 95% of that year's launches. The site was still online in September 2026, 3 years on.
In plain words
Crul is a tool for extracting and transforming data from websites and APIs into usable datasets. Users can crawl web pages into CSV tables, query APIs dynamically, filter and organize data, and export results to data lakes and analytics platforms. It's designed for developers and data professionals who need to gather web data without building custom scripts or dealing with traditional web scraping tools.
written from the facts on this page · September 2026
From the sources
Structure any Web/API data
Dispatch prompts as a part of a crul query pipeline. Use expansion to asynchronously run the same or a tokenized prompt across a data set. Include live API/Webpage data in your prompts and chain prompts together. Generate vector emebeddings from data and push to a vector database. Use the vectorquery command to semantically query the database. Generate synthetic data sets using natural language prompts, as well as sampled from real data. Configure queries to run on a set interval and export to the destination of your choice. Use the diff command to maintain rolling diffs of only new content, or push entire results set on each run. Download results to a local CSV or JSON file and further…from crul.com
In the maker’s words, at launch
Hi HN, we’re Carl and Nic, the creators of crul (https://www.crul.com), and we’ve been hard at work for the last year and a half building our dream of turning the web into a dataset. In a nutshell crul is a tool for querying and building web and api data feeds from anywhere to anywhere. With crul you can…
Does a similar job
all alternatives →
Turn any website into an API (for those who miss Kimono)2019 · simplescraper.io · ▲332Web scraping made simple — extract data with our free Chrome extension and powerful cloud platform. Turn websites into structured data at scale, via dashboard or API.
Turn any website into a knowledge base for LLMs2024 · embedding.io · ▲305I built this tool because I wanted a way to just take a bunch of URLs or domains, and query their content in RAG applications. It takes away the pain of crawling, extracting content, chunking, vectorizing, and updating periodically. I'm curious to see if it can be useful to others. I meant to launch this six months ago but life got in the way...
More dev tools this month
the category →
open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.
Dev tools · 27d ago · github.com
Contribute to reladraw/reladraw development by creating an account on GitHub.
Dev tools · 25d ago · github.com
OpenBot▲362Grok Bot alternative: free, local, open-source, multiplayer
Dev tools · 22d ago · openbot.run
Talanoa▲343Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…
Dev tools · 20d ago · talanoa.email
CoreSpeed▲332One MCP for everything your agents need: apps, memory, tools
Dev tools · 28d ago · corespeed.io
Source: Show HN post ↗ · launch text quoted in part
