nowfound

AI · June 28, 2024

LC

Linkgrabs.com the Simple and Fast API to Fetch JavaScript Web Pages

For some of my work with LLMs and RAG I needed to be able to fetch content from my customer's support site. Basic cURL calls weren't working because the site is an SPA and is rendered completely through javascript. The trouble it took me to figure out how to capture the rendered HTML from a headless browser and how to do it reliably in production inspired me to create LinkGrabs.com so others would not have to go through the same pain.

Linkgrabs.com the Simple and Fast API to Fetch JavaScript Web Pages launched on June 28, 2024 with 7 votes, #1,341 of 4,672 launches that month and more than 75% of that year's launches.

Does a similar job

all alternatives →
  • LinkGrabs.com2024 · ▲8

    The Simple & Fast API for Fetching Complete Web Pages

  • Simple Scraper2019 · simplescraper.io · ▲556

    Turn any website into an API in just a few seconds.

  • Web Scraper API2021 · datashake.com · ▲287

    Scrape the web at scale without getting blocked

  • IM
    I'm making an AI scraper called FetchFox2024 · fetchfoxai.com · ▲105

    Hi! I'm Marcell, and I'm working on FetchFox (https://fetchfoxai.com). It's a Chrome extension that lets you use AI to scrape any website for any data. I'd love to get your feedback. Here's a quick demo showing how you can use it to scrape leads from an auto dealer directory. What's cool is that it scrapes non-uniform pages, which is quite hard to do with "traditional" scrapers: https://youtu.be/wPbyPSFsqzA A little background: I've written lots and lots of scrapers over the last 10+ years. They're fun to write when they work, but the internet has changed in ways…

  • Swap.js – a JavaScript micro-framework (HTML fragments over the wire)2023 · github.com · ▲127

    Hi HN! I created this lib in the need of a simple and tiny framework to easily do AJAX-style navigation / replacement of fragments in the page, in a web application. For people who don't want to use client-side-rendering and complex frameworks à la React, there are nowadays a few "HTML-over-the-wire" libraries, like HTMX, Unpoly or this super-tiny one Swap.js :) One other key thing is that no external tool is needed: no bundler, no webpack, no TypeScript compiler, no minification needed. Just write HTML, JS (+ your preferred server-side language: PHP, Python, etc.) and it works. The…

  • fetching.io2014 · fetching.io · ▲83

    Never lose track of a website again.

More ai this month

the category →
  • Video model that turns script into viral social media videos

    AI · 19d ago · spira.ai

  • The browser where Claude Code and Codex work beside you

    AI · 19d ago · rill.love

  • Kolibri is Aleph Alpha

    AI · 21d ago · tej.as

  • Paintings by AI models: programs run through a simulation of oil paint.

    AI · 22d ago · stillwet.art

  • Beam.win▲379

    Run AI agents on one Mac and use its windows on another

    AI · 5d ago · beam.win

  • Route requests to the right LLM for cost, latency & quality

    AI · 23d ago · fastrouter.ai

Source: Show HN post ↗

Launched alongside, June 2024

the whole month →
  • Pygma▲1,412

    AI copilot for Instagram

    AI · 2024 · pygma.me

  • Cello▲1,347

    Easiest way to add a referral program to your SaaS

    Growth · 2024 · cello.so

  • Create personalized, multi-channel conversations at scale

    AI · 2024 · lagrowthmachine.com

  • Revolutionary AI email, reimagined for teams

    AI · 2024 · superhuman.com

  • FlowMapp 3.0▲1,142

    Visual website planning in the most powerful way

    Work · 2024 · flowmapp.com

  • PyjamaHR▲1,132

    Hiring on autopilot. The AI applicant tracking system (ATS).

    Work · 2024 · pyjamahr.com