Linkgrabs.com the Simple and Fast API to Fetch JavaScript Web Pages
For some of my work with LLMs and RAG I needed to be able to fetch content from my customer's support site. Basic cURL calls weren't working because the site is an SPA and is rendered completely through javascript. The trouble it took me to figure out how to capture the rendered HTML from a headless browser and how to do it reliably in production inspired me to create LinkGrabs.com so others would not have to go through the same pain.
Linkgrabs.com the Simple and Fast API to Fetch JavaScript Web Pages launched on June 28, 2024 with 7 votes, #1,341 of 4,672 launches that month and more than 75% of that year's launches.
Does a similar job
all alternatives →


- IMI'm making an AI scraper called FetchFox2024 · fetchfoxai.com · ▲105
Hi! I'm Marcell, and I'm working on FetchFox (https://fetchfoxai.com). It's a Chrome extension that lets you use AI to scrape any website for any data. I'd love to get your feedback. Here's a quick demo showing how you can use it to scrape leads from an auto dealer directory. What's cool is that it scrapes non-uniform pages, which is quite hard to do with "traditional" scrapers: https://youtu.be/wPbyPSFsqzA A little background: I've written lots and lots of scrapers over the last 10+ years. They're fun to write when they work, but the internet has changed in ways…
Swap.js – a JavaScript micro-framework (HTML fragments over the wire)2023 · github.com · ▲127Hi HN! I created this lib in the need of a simple and tiny framework to easily do AJAX-style navigation / replacement of fragments in the page, in a web application. For people who don't want to use client-side-rendering and complex frameworks à la React, there are nowadays a few "HTML-over-the-wire" libraries, like HTMX, Unpoly or this super-tiny one Swap.js :) One other key thing is that no external tool is needed: no bundler, no webpack, no TypeScript compiler, no minification needed. Just write HTML, JS (+ your preferred server-side language: PHP, Python, etc.) and it works. The…

More ai this month
the category →



Paintings by AI models: programs run through a simulation of oil paint.
AI · 22d ago · stillwet.art

FastRouter.ai▲364Route requests to the right LLM for cost, latency & quality
AI · 23d ago · fastrouter.ai
Source: Show HN post ↗
Launched alongside, June 2024
the whole month →

La Growth Machine▲1,216Create personalized, multi-channel conversations at scale
AI · 2024 · lagrowthmachine.com


PyjamaHR▲1,132Hiring on autopilot. The AI applicant tracking system (ATS).
Work · 2024 · pyjamahr.com