nowfound

Alternatives

Products that do what Snitchmd – Cloudflare-protected URLs into clean Markdown via Docker does

Shmauthor here. Built this for myself, putting it out in case it's useful. Needed any URL as clean Markdown for LLM context — including Cloudflare/anti-bot sites. curl gets HTTP 403 on those, raw HTML is 80%+ nav noise eating context, paid SaaS (Firecrawl, Jina) wasn't an option for me. It's a Docker wrapper around two existing OSS tools — CloakBrowser (stealth Chromium that passes Cloudflare) and rs-trafilatura (HTML → Markdown). No new scraper, just glue. Runs locally, my URLs stay on my box Token reduction (raw curl HTML vs snitchmd, tiktoken cl100k_base): -…

  1. 1

    Turn any website into LLM-ready Markdown

    Aug 2026 · exabase.io

  2. 2

    RAG-ready web scraping that cuts your LLM token costs

    Apr 2026

  3. 3
    Roast.io157

    Host your website in 4 seconds with unfurl + SEO goodies

    2018

  4. 4SI
  5. 5

    Scrape, Screenshot, and extract LLM-ready data

    Jan 2026

  6. 6SS
  7. 7CP

    2018 · gist.github.com

  8. 8WS

    Second article in a series. Interesting info regarding Cloudflare.

    2024 · 8chananon.github.io

  9. 9UI
  10. 10GS

    I built GetPost because I miss the simplicity of just SCPing files to a personal server, but I do not miss the maintenance burden. It's a pastebin/imagebin that runs on Cloudflare Workers with zero ongoing costs and zero maintenance. Key features: - Deploy in 5 minutes, runs free forever (100k reads, 1k uploads daily on CF free tier) - No complex toolchain - no NPM, no wrangler - just curl, python3, and a simple build script - Handles text, markdown (server-rendered), images, any file type up to 10MB - ULID-based access control with separate delete keys An interesting technical bit:…

    2025 · staging.getpost.workers.dev

  11. 11IM
  12. 12WA
  13. 13

    Open-source agent skill + stdlib HTTP service that strips invisible Unicode, C2PA/EXIF/XMP, and (best-effort) statistical text marks from files you own. Claude / Gemini-SynthID / OpenAI / Kirchenbauer / keyed-Gumbel class.

    8d ago · github.com

  14. 14CO
  15. 15CH

    There is a growing number of companies offering anti-bot protection SaaS to protect websites from scraping by automated bots based on Puppeteer/Selenium. Most of them rely on browser properties such as headers, javascript properties (window., navigator.), behavior analysis, to build device/user fingerprints and match it against a database of "whitelisted" fingerprints (typical user behavior/settings/device props etc). For the past few months, together with two other devs I have worked on a customized Puppeteer/Playwright scraping backend. It's essentially a drop-in…

    2021

  16. 16HS

    Hi HN! I built hidetext.sh — a way to share text, code, and files through links the server can't read. How it works: your browser generates a random key and encrypts everything locally (NaCl secretbox, XSalsa20-Poly1305). Only ciphertext is uploaded. The key goes into the URL fragment — the part after # — which browsers never send to servers. The link carries the key, my server stores the locked box, and the two only meet in a browser. A design detail I'm fairly happy with: burn-after-read doesn't destroy the paste on the first HTTP request. The naive version means a Slack or iMessage link…

    Jul 2026 · hidetext.sh

  17. 17XT

    I just built XYMake (https://xymake.com), a tool that lets you convert any X (Twitter) thread into clean markdown, making your conversations accessible for LLMs, MCPs, or any API. ## What it does: - Transforms any X thread URL into markdown by simply changing "x.com" to "xymake.com" in the URL - OAuth2 login to "free your data" and make your threads available - Auto-generates OG images with token counts and participant info for easy sharing - Serves different content types based on whether the request is from a crawler, browser, or agent ## Why I built it: I believe people should…

    2025 · xymake.com

  18. 18LC

    Attached is my attempt at making a small toy S3 client without any other dependency besides libcurl and OpenSSL. Was tested mainly on MinIO (RIP) locally, so I would expect some bugs when using it against AWS, although I was able to play with it on some open access buckets Be aware that I am not a C++ programmer and this project was indeed done to learn a bit of C++ myself :') Feedback on any of the code, either on gtest, or the benchmarking section or the core itself is welcome!

    Jun 2026 · github.com

  19. 19AM

    I recently saw a post from the Vercel CEO pointing out that LLMs understand websites much better when they can request: `Accept: text/markdown` Most websites today are built for humans. When AI agents try to consume them, they get complex HTML instead of clean, structured content. So I built *accept-md* – a simple open-source package for Next.js that helps solve this. Getting started is intentionally minimal: ``` npx accept-md init ``` After that, your existing Next.js routes can automatically respond with Markdown whenever an AI agent (or any client) requests it. No redesigns, no CMS…

    Feb 2026 · accept.md

  20. 20WW
  21. 21

    Open-source web scraper — turn any URL into LLM data

    4d ago · gcrawlai.com

  22. 22

    Cloud browsers for scraping, automation with captcha solving

    10d ago · 2captcha.com

  23. 23

    Check if LLMs can cite your site.

    22d ago · github.com

  24. 24

    AI-Native On-Page SEO & JS Render Diff Inspector

    20d ago · chromewebstore.google.com

Ranked by how close each launch is in meaning, then by votes. Refine with a description →