POC to scrape and structure HTML into JSON for RAG
Hey all, I built a quick PoC that scrapes a webpage, sends the content to Gemini Flash, and outputs a clean, structured JSON — ready for RAG workflows. In my case, I’ll use this structured data to enhance models by integrating external knowledge sources during the generation process. Curious if you think this has potential or if there are any use cases I might have missed. Happy to share more details if there's interest!
POC to scrape and structure HTML into JSON for RAG launched on April 29, 2025 with 9 votes, #3,599 of 7,818 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 1 year on.
What it does
Enter a URL to extract structured JSON content using Gemini AI. This is ideal for RAG workflows, AI assistants, or any app needing clean, machine-readable data from webfrom structured.pages.dev
Does a similar job
all alternatives →
Tabstack Structured ExtractionJun 2026 · tabstack.ai · ▲199Extract web data into structured JSON, no scraper required.
Turn any website into an API (for those who miss Kimono)2019 · simplescraper.io · ▲332Web scraping made simple — extract data with our free Chrome extension and powerful cloud platform. Turn websites into structured data at scale, via dashboard or API.
Turn any website into a knowledge base for LLMs2024 · embedding.io · ▲305I built this tool because I wanted a way to just take a bunch of URLs or domains, and query their content in RAG applications. It takes away the pain of crawling, extracting content, chunking, vectorizing, and updating periodically. I'm curious to see if it can be useful to others. I meant to launch this six months ago but life got in the way...
LLM Scraper – turn any webpage into structured data2024 · github.com · ▲88Turn any webpage into structured data using LLMs. Contribute to mishushakov/llm-scraper development by creating an account on GitHub.
RAGstack – private ChatGPT for enterprise VPCs, built with Llama 22023 · github.com · ▲84Hey hacker news, We’re the cofounders at Psychic.dev (http://psychic.dev) where we help companies connect LLMs to private data. With the launch of Llama 2, we think it’s finally viable to self-host an internal application that’s on-par with ChatGPT, so we did exactly that and made it an open source project. We also included a vector DB and API server so you can upload files and connect Llama 2 to your own data. The RAG in RAGstack stands for Retrieval Augmented Generation, a technique where the capabilities of a large language model (LLM) are augmented by retrieving information…
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 21d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 30d ago · world.pixverse.video
Source: Show HN post ↗
Launched alongside, April 2025
the whole month →
Hi everyone, I built PyXL — a hardware processor that executes a custom assembly generated from Python programs, without using a traditional interpreter or virtual machine. It compiles Python -> CPython Bytecode -> Instruction set designed for direct hardware execution. I’m sharing an early benchmark: a GPIO test where PyXL achieves a 480ns round-trip toggle — compared to 14-25 micro seconds on a MicroPython Pyboard - even though PyXL runs at a lower clock (100MHz vs. 168MHz). The design is stack-based, fully pipelined, and preserves Python's dynamic typing without static type restrictions.…
Dev tools · 2025 · runpyxl.com
The Unsure Calculator is an online tool that lets you calculate with numbers you’re not sure about.
Life & fun · 2025 · filiph.github.io
https://the-pocket.github.io/Tutorial-Codebase-Knowledge/
AI · 2025 · github.com
