AI Agents for Osint/Sigint
The goal was to bring down the cost at the context eng. level. We do it with Layout Memoization. Instead of dumping HTML into the context window, we have built a continual learning browser harness (read only for now). We have built an early prototype for you to try out, where you can: 1. Spins up a browser instance 2. Extract any structured or tabular data from anywhere on the open-web 3. And you can do all this at the cost of a vector search Would love to hear your thoughts on this. Thanks for taking the time to read it.
AI Agents for Osint/Sigint launched on August 29, 2026 with 13 votes, #880 of 23,274 launches that month and more than 90% of that year's launches.
In plain words
AI Agents for Osint/Sigint is a web scraping tool that extracts structured and tabular data from dynamic websites while reducing processing costs. It uses layout memoization and a continual learning browser harness to minimize context window usage, allowing data extraction at vector search pricing levels rather than full large language model costs. The tool is designed for users who need efficient open-web data retrieval without traditional high expenses associated with browser automation and scraping approaches.
written from the facts on this page · September 2026
From the sources
Memoize page layouts so extraction cost falls as usage grows. Public beta is open.
75% of the web is dynamic. Basically database records presented in HTML. Built for humans. Fast-forward to 2026, and we're basically dumping anything and everything into the context windows; taking Nvidia to the moon. This consists of claws, browser/computer-use, and agentic crawlers, and scrapers. These have made it easier to retrieve data, but the cost has stayed the same. Underneath, these still rely on long-context LLMs. It's an work-in-progress implementation for a continual learning harness focusing on Browser-use. Scatter plot of correctness against average USD cost for Makra, Exa, and Firecrawl. Lower cost is toward thefrom makralabs.org
Does a similar job
all alternatives →
- WSWeb search using a ChatGPT-like model that can cite its sources2022 · beta.sayhello.so · ▲318
We’ve trained a generative AI model to browse the web and answer questions/retrieve code snippets directly. Unlike ChatGPT, it has access to primary sources and is able to cite them when you hover over an answer (click on the text to go to the source being cited). We also show regular Bing results side-by-side with our AI answer. The model is an 11-billion parameter T5-derivative that has been fine-tuned on feedback given on hundreds of thousands of searches done (anonymously) on our platform. Giving the model web access lessens its burden to need to store a snapshot of human knowledge…
- IMI'm making an AI scraper called FetchFox2024 · fetchfoxai.com · ▲105
Hi! I'm Marcell, and I'm working on FetchFox (https://fetchfoxai.com). It's a Chrome extension that lets you use AI to scrape any website for any data. I'd love to get your feedback. Here's a quick demo showing how you can use it to scrape leads from an auto dealer directory. What's cool is that it scrapes non-uniform pages, which is quite hard to do with "traditional" scrapers: https://youtu.be/wPbyPSFsqzA A little background: I've written lots and lots of scrapers over the last 10+ years. They're fun to write when they work, but the internet has changed in ways…
Questions this answers
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 20d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 29d ago · world.pixverse.video
Source: Show HN post ↗
Launched alongside, August 2026
the whole month →- TL
Life & fun · Aug 2026 · louisabraham.github.io
Clipto MCP▲655Hey HN, We recently built Clipto. It’s a tool that lets you search over terabytes of video, audio, and images on your computer, without relying on the cloud. Motivation: we probably all had this similar experience, we know a moment exists in a video or audio, but finding it takes hours scrubbing the timeline. You can send all the media to process in the cloud, but it’s slow, expensive and raises privacy concerns. So we decided to build our own on-device media search engine. How it works (high level): 1. We ingest video, audio, image; normalize formats via ffmpeg; run content analysis to…
Work · Aug 2026 · clipto.com
Hello HN! I found that picking out plausible but diverse skin tones for my digital art and game development projects was kind of difficult, and I got curious about if there was a way to define a color space that made it easy. I've built a color picker and procedural generation algorithm based on the space as well as a bunch of other fun js features and demos throughout the page that use the equations. If you find it interesting, I have lots of explanations of how I built it and what properties the space has. The methodology might be a bit shaky, but hopefully the result is as helpful for…
Life & fun · Aug 2026 · toneyalexander.github.io
Astute▲606Automate your B2B brand going viral, with new media creators
AI · Aug 2026 · company-app.joinastute.com