nowfound

AI · February 21, 2025

The Internet's Open Source AI Paywall

I built DarkForest Protocol after watching sites get hammered by AI search bots. Robots.txt isn't working. Some sites are using Nepenthes/Quixotic to poison models, but that's a lose-lose approach. DarkForest is an open-source middleware (Express/Next.js/Vite) that lets any site establish clear boundaries with AI systems. One line of code redirects crawlers to a message about respecting content - no poisoning required. This is just the start. The long-term vision is to build: (1) A collective intelligence network where sites share crawler patterns, and (2) An internet scale…

The Internet's Open Source AI Paywall launched on February 21, 2025 with 13 votes, #1,198 of 5,999 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 1 year on.

Visit darkestforest.xyz ↗Alternativestop 20% of February 2025

In plain words

DarkForest Protocol is an open-source middleware for Express, Next.js, and Vite that helps websites manage AI crawler access. Instead of using content poisoning techniques or relying on outdated robots.txt files, it allows sites to redirect AI bots with a single line of code to a message about respecting boundaries. The tool is designed for website owners frustrated with excessive AI scraping and serves as foundation for a planned network where sites can share crawler patterns and eventually participate in an automated marketplace for AI content licensing.

written from the facts on this page · September 2026

From the sources

the internet

In the maker’s words, at launch

I built DarkForest Protocol after watching sites get hammered by AI search bots. Robots.txt isn't working. Some sites are using Nepenthes/Quixotic to poison models, but that's a lose-lose approach. DarkForest is an open-source middleware (Express/Next.js/Vite) that lets any site establish clear…

Does a similar job

all alternatives →
  • Stop AI scrapers from hammering your self-hosted blog (using porn)Dec 2025 · github.com · ▲373

    Alright so if you run a self-hosted blog, you've probably noticed AI companies scraping it for training data. And not just a little (RIP to your server bill). There isn't much you can do about it without cloudflare. These companies ignore robots.txt, and you're competing with teams with more resources than you. It's you vs the MJs of programming, you're not going to win. But there is a solution. Now I'm not going to say it's a great solution...but a solution is a solution. If your website contains content that will trigger their scraper's safeguards, it will get dropped from their data…

  • Open AgentsApr 2026 · open-agents.dev · ▲161

    OpenAgents - The collaboration OS for AI agents. Contribute to openagents-org/openagents development by creating an account on GitHub.

  • InsForge – Open-source Heroku for coding agentsMay 2026 · github.com · ▲62

    Hi HN, I'm Hang, cofounder of InsForge (YC P26). InsForge is an open-source Heroku for AI coding agents: a backend platform designed for coding agents to deploy, operate, and debug end-to-end. Open source under Apache 2.0 (https://github.com/InsForge/InsForge). Quick demo here (https://youtu.be/7Bax5qz0IfM). We started InsForge because we just wanted our Claude Code to handle all the backend / infra stuff for us, instead of us jumping between dashboards doing manual config, or copy paste logs and docs back to agents. We first tried creating a folder…

  • OS
  • We post-trained a model that pen tests instead of refusingJun 2026 · argusred.com · ▲93

    Anthropic and OpenAI's publicly available models are explicitly guard-railed so that they refuse offensive tasks. And their cyber-focussed models are gated for enterprises. This leaves SMEs and mid market open to major vulnerabilities. AI can be used as both an adversarial and defensive tool in the world of cyber. A worst case outcome is if only the adversaries have access. Meanwhile, most existing AI cyber tools are just wrappers. The problem is that they still have all the guardrails on from the foundation model where they will inherit its refusals. For this project we've post-trained a…

  • Aura – Like robots.txt, but for AI actions2025 · github.com · ▲41

    Hi, I've been watching the rise of AI agents with a mix of excitement and dread. We're building incredible tools that can browse the web, but we're forcing them to navigate a world built for human eyes. They scrape screens and parse fragile DOMs. We're trying to tame them to act like humans. I believe this is fundamentally wrong. The goal isn't to make AI operate at a human level, but to unlock its super-human potential. The current path is dangerous. When agents from OpenAI, Google, and others start browsing at scale and speed, concepts like UI/UX will lose meaning for them. The entire…

More ai this month

the category →
  • Video model that turns script into viral social media videos

    AI · 17d ago · spira.ai

  • The browser where Claude Code and Codex work beside you

    AI · 17d ago · rill.love

  • Kolibri is Aleph Alpha

    AI · 19d ago · tej.as

  • Paintings by AI models: programs run through a simulation of oil paint.

    AI · 20d ago · stillwet.art

  • A real-time world model you can explore and change

    AI · 29d ago · world.pixverse.video

  • Hemory▲381

    Keep listening. Searchable memory for your AI agents.

    AI · 30d ago · hemory.com

Source: Show HN post ↗ · launch text quoted in part

Launched alongside, February 2025

the whole month →
  • Beautiful screen recordings with instant shareable links

    Growth · 2025 · screen.studio

  • Tana▲1,665

    Put your notes to work with voice and AI

    AI · 2025 · tana.inc

  • IG

    I was at FB/Meta from late 2013 to early 2023, mostly working in the compiler/runtime spaces. I got hit in the spring 2023 layoff wave. I immediately started making games in my newfound free time (a lifelong interest, and I even worked in AA(A?) back ca. ~2000), and in October 2023 I stumbled upon the idea of a roguelike pachinko/plinko game inspired by Luck Be A Landlord. Things snowballed quickly, I started talking to publishers, then worked like crazy through all of 2024, almost the hardest I've ever worked in my career, and launched the game in December 2024. It's sold…

    Work · 2025

  • Tanka▲1,410

    AI Messenger with smart reply & long term memory for teams

    AI · 2025 · tanka.ai

  • Tool Finder▲1,327

    Your shortcut to better software

    AI · 2025 · toolfinder.com

  • i wanted to change the habit of reaching for my phone in the morning and doomscrolling away an hour so i built an app to help me. now i have to literally touch grass before accessing my most distracting apps the app is built in swiftui, uses the screen time apis provided by apple and google vision to recognise grass or not i'd love to get your thoughts on the concept.

    Life & fun · 2025 · touchgrass.now