I indexed 8,643 BSides talks across 227 chapters and 6 continents
Hi HN, I'm Roland, and for the past few weeks, I've been building AllBSides — a directory of every BSides conference talk uploaded to YouTube. As of today, 8,643 talks from 5,927 speakers across 227 chapters in 68 countries. Combined runtime is 280 days. The transcripts come to about 60 million words. The archive came together in stages: 1. Manually map every BSides chapter's YouTube channel 2. Pull every video and transcript from Supabase 3. Run each transcript through Haiku for tag extraction (tools, topics, difficulty, team, talk style, research method, and much more) 4. Run results…
In plain words
AllBSides is a searchable directory of 8,643 security conference talks from BSides events worldwide, indexed across 227 chapters in 68 countries. The archive aggregates YouTube videos and transcripts from 5,927 speakers, totaling 280 days of combined runtime and 60 million words. It is designed for security professionals, researchers, and practitioners seeking specific talks by extracting and tagging content across dimensions like tools, topics, difficulty level, and research methods. The resource makes the distributed BSides lecture catalog accessible through a single searchable platform.
written from the facts on this page · September 2026
From the sources
In the maker’s words, at launch
Hi HN, I'm Roland, and for the past few weeks, I've been building AllBSides — a directory of every BSides conference talk uploaded to YouTube. As of today, 8,643 talks from 5,927 speakers across 227 chapters in 68 countries. Combined runtime is 280 days. The transcripts come to about 60 million words. The archive came together in stages: 1. Manually map every BSides chapter's YouTube channel 2. Pull every video and transcript from Supabase 3. Run each transcript through Haiku for tag extraction (tools, topics, difficulty, team, talk style, research method, and much more) 4. Run results through Sonnet for categorization and dedup 5. Final pass goes through Opus for verification 6. Do a manual verification - at one time, the pipeline showed over 16k AI suggestions for manual verification. Today, most are resolved. Total LLM cost so far: about €200. The whole pipeline is rebuildable from scratch. Each talk gets its own page with embedded video, full transcript, speakers, tags, and "related talks." Each tool/framework/protocol/standard mentioned across the corpus gets its own page (3,968 distinct technologies tracked). Some interesting facts I gathered while building it: -(A) The site is currently 94% bot traffic. Of that, about 80,000 hits/month are AI training crawlers (ClaudeBot, GPTBot, meta-externalagent). Within 7 days of the talks archive going live, all major AI labs had ingested the entire corpus. The discovery cascade was startling to watch in real time. -(B) The taxonomy work was the hardest part. Distinguishing "tools" from "frameworks" from "protocols" from "concepts" sounds easy until you have 5,000 ambiguous extracted entities. The 3-tier LLM pipeline helped a lot — Haiku alone was too noisy, Opus alone was too expensive. -(C) Top tools mentioned: Wireshark (343), PowerShell (342), Metasploit (332), Burp Suite (322), GitHub (296), VirusTotal (273), Docker (253), Splunk (251), Nmap (247), MITRE ATT&CK (237). The list reflects what BSides talks actually discuss, not what vendors curate. -(D) May is the peak BSides month — 29 events, 17% of all events with dates. -(E) The top 1% of talks (86 videos by view count) account for 51% of all viewership. The other 99% are deeply niche, often the only video record of a specific technique. The stack is intentionally lean: Go, SQLite, vanilla JavaScript, BunnyCDN. Static rendering at build time. No frameworks, no client-side state. The site costs about €50/month to run. The data behind this post and much more can be found in the site footer, under the link "stats". Happy to answer questions about the data pipeline, the taxonomy decisions, or what the AI crawler patterns looked like as the archive went live. Feedback on what to build next is genuinely welcome — I'm a solo dev figuring this out as I go. — Roland (parkado)
Does the same job
all alternatives →- 2G22 GB of Hacker News in SQLiteDec 2025 · hackerbook.dosaygo.com · ▲730
Community, All the HN belong to you. This is an archive of hacker news that fits in your browser. When I made HN Made of Primes I realized I could probably do this offline sqlite/wasm thing with the whole GBs of archive. The whole dataset. So I tried it, and this is it. Have Hacker News on your device. Go to this repo (https://github.com/DOSAYGO-STUDIO/HackerBook): you can download it. Big Query -> ETL -> npx serve docs - that's it. 20 years of HN arguments and beauty, can be yours forever. So they'll never die. Ever. It's the unkillable static archive of HN and it's…
- SCSemantic clusters and embeddings for 500k Hacker News comments2024 · app.airtrain.ai · ▲114
- HNHacker News archive (47M+ items, 11.6GB) as Parquet, updated every 5mMar 2026 · huggingface.co · ▲408
- PAPodText.ai – Search anything said on a podcast, highlight text to play2023 · podtext.ai · ▲219
Hi HN, wanted to share a project that I’ve been working on recently. PodText allows users to find anything said on a podcast. You can also listen and share clips to a specific part of the podcast audio, simply by highlighting the text of that part. Currently there are just over 25k podcast episodes and I’m adding a lot more in the coming weeks (yes my GPU bill is painful). In order to monetize it, I’m building a sponsorship database to help sponsors find podcasts and vice versa. This will be sold in the form of a $99/month “PodText Business” subscription. I bet I could charge a lot more…
- TATheBigDB - A simpler open database of facts2013 · thebigdb.com · ▲133
A searchable, timestamped index of 1,124 AI Engineer talks3d ago · aietalks.com · ▲10Summaries and timestamps for every talk on the AI Engineer YouTube channel.
More work this month
the category →
The app store for voice native apps that lives in your notch
Work · 28d ago · voiceos.com
The New Calendly▲211Handle all of the work before, during, and after meetings
Work · 17d ago · calendly.com
Launched alongside, May 2026
the whole month →
Parallel agents, diff reviewer, and multi-model comparisons
Dev tools · May 2026 · kilo.ai
- NW
Hey HN, Henry here from Cactus. We open-sourced Needle, a 26M parameter function-calling (tool use) model. It runs at 6000 tok/s prefill and 1200 tok/s decode on consumer devices. We were always frustrated by the little effort made towards building agentic models that run on budget phones, so we conducted investigations that led to an observation: agentic experiences are built upon tool calling, and massive models are overkill for it. Tool calling is fundamentally retrieval-and-assembly (match query to tool name, extract argument values, emit JSON), not reasoning. Cross-attention…
Life & fun · May 2026 · github.com
- FM
Dev tools · May 2026 · github.com