Research Stack

Turn the open web into LLM-ready text — powers our feed scraper and Oracle research.

• Firecrawl ↗

  Site → clean markdown/JSON; pairs well with Brave search for article research.

  www.firecrawl.dev/

• firecrawl (GitHub) ↗

  Open-source core; self-host or inspect the scrape pipeline.

  github.com/firecrawl/firecrawl

• Crawl4AI ↗

  Async crawl tuned for RAG — fast article body extraction.

  github.com/unclecode/crawl4ai

• browser-use ↗

  LLM-driven browser agent for flows plain HTTP cannot reach.

  github.com/browser-use/browser-use

• video-use ↗

  Browser agent variant aimed at video-heavy pages.

  github.com/browser-use/video-use

• Crawlee ↗

  Production scraper framework (Playwright/Puppeteer) with queues and retries.

  github.com/apify/crawlee

• Scrapy ↗

  Classic Python spider framework — still unbeatable for large crawls.

  github.com/scrapy/scrapy

• MarkItDown ↗

  Microsoft utility: PDF, Office, HTML → markdown for LLM ingestion.

  github.com/microsoft/markitdown

• Scrapling ↗

  Adaptive scraping — handles DOM changes better than brittle selectors.

  github.com/D4Vinci/Scrapling

• AutoScraper ↗

  Learns patterns from examples; good for repetitive news layouts.

  github.com/alirezamika/autoscraper

• curl-impersonate ↗

  TLS/browser fingerprint mimicry when sites block datacenter IPs.

  github.com/lwthiker/curl-impersonate

• open-lovable ↗

  Firecrawl + app builder experiment — scrape-to-UI prototyping.

  github.com/firecrawl/open-lovable

Username pivots, breach data, maps, and document trails — Oracle board fuel.

• Sherlock ↗

  Hunt a username across 400+ sites — first stop for identity pivots.

  github.com/sherlock-project/sherlock

• SomaliScan — Epstein Index ↗

  Structured investigation index — reference for deep-dive articles.

  www.somaliscan.com/investigation/epstein-index

• theHarvester ↗

  Emails, subdomains, and hosts from public sources.

  github.com/laramies/theHarvester

• SpiderFoot ↗

  Automated OSINT correlation engine with 200+ modules.

  github.com/smicallef/spiderfoot

• Shodan ↗

  Internet-wide device/service search — exposed cameras, ICS, misconfigs.

  www.shodan.io/

• Have I Been Pwned ↗

  Breach lookup for emails and passwords.

  haveibeenpwned.com/

• DeHashed ↗

  Paid breach/credential search with rich filters.

  dehashed.com/

• LeakCheck ↗

  Another breach index — cross-check findings.

  leakcheck.io/

• FaceCheck.ID ↗

  Reverse face search across the public web.

  facecheck.id/

• PimEyes ↗

  Face search engine — use responsibly and verify legally.

  pimeyes.com/en

• ExifTool ↗

  Extract GPS, camera, and edit history from images and PDFs.

  exiftool.org/

• Jimpl EXIF viewer ↗

  Browser-side EXIF strip/view — quick photo metadata checks.

  jimpl.com/

• WiGLE ↗

  Wireless network geolocation — map SSIDs and MAC addresses.

  wigle.net/

• Google Hacking Database ↗

  Classic Google dork patterns for exposed files and panels.

  www.exploit-db.com/google-hacking-database

• deviceinfo.me ↗

  What your browser leaks (IP, UA, WebRTC) — tradecraft baseline.

  www.deviceinfo.me/

• IntelTechniques Tools ↗

  Mike Bazzell's curated OSINT tool menu — industry standard reference.

  inteltechniques.com/tools/index.html

• Ultimate OSINT Collection ↗

  Start.me dashboard — hundreds of OSINT bookmarks in one place.

  start.me/p/DPYPMz/the-ultimate-osint-collection

• OSINT on Chain ↗

  Blockchain-adjacent OSINT resources.

  osint.intelligenceonchain.com/

• PentestList ↗

  Searchable pentest/OSINT tool directory.

  pentestlist.com/

• UseOdin ↗

  OSINT platform for analysts.

  www.useodin.net/

• Osiris AI Live Map ↗

  Global incidents, CCTV, earthquakes, live news — situational awareness layer.

  www.osirisai.live/

• ExtractFace ↗

  Facebook photo/face extraction helpers for authorized research.

  github.com/mrpnkt/ExtractFace

• fb-sleep-stats ↗

  Activity-pattern analysis from public Facebook signals.

  github.com/sorenlouv/fb-sleep-stats

• st3gg ↗

  OSINT / threat-hunting utilities collection.

  github.com/elder-plinius/st3gg

• PentAGI ↗

  Autonomous pentest agent — research only on systems you own.

  github.com/vxcontrol/pentagi

• The art of pivoting ↗

  Essay on OSINT pivot methodology.

  hatless1der.com/advanced-osint-the-art-of-pivoting/

• GPX Editor map ↗

  Verify geolocation claims against GPX/track data.

  www.gpxeditor.co.uk/map

Multi-step research, coding agents, and workflow runners.

• agency-agents ↗

  Multi-agent agency pattern — specialist roles in one pipeline.

  github.com/msitarzewski/agency-agents

• DeerFlow ↗

  ByteDance deep-research agent framework.

  github.com/bytedance/deer-flow

• Hermes Agent ↗

  Long-horizon agent runtime.

  hermes-agent.org/

• Codex Orchestration ↗

  Orchestrate Codex/CLI agents across tasks.

  github.com/Cjbuilds/Codex-Orchestration

• oh-my-claudecode ↗

  Claude Code power-user tooling and workflows.

  github.com/Yeachan-Heo/oh-my-claudecode

• everything-claude-code ↗

  Curated Claude Code configs, hooks, and patterns.

  github.com/affaan-m/everything-claude-code

• GitHub spec-kit ↗

  Spec-driven development — plan before you ship.

  github.com/github/spec-kit

• Dify ↗

  Visual LLM app builder — prototype Oracle-style flows without code.

  github.com/langgenius/dify

• MiroFish ↗

  Multi-agent simulation / swarm experiments.

  github.com/666ghj/MiroFish

• PLFM RADAR ↗

  Radar-style monitoring agent project.

  github.com/NawfalMotii79/PLFM_RADAR

• Cursor Automations ↗

  Scheduled cloud agents — cron backup for scrapers and briefings.

  cursor.com/docs/cloud-agent/automations

• DeepTutor ↗

  AI tutoring / research agent from HKUDS.

  github.com/HKUDS/DeepTutor

• mempalace ↗

  Agent memory layer experiments.

  github.com/milla-jovovich/mempalace

• RuView ↗

  Agent/view tooling for Ruvnet stack.

  github.com/ruvnet/RuView

• meta-llm-charter ↗

  Governance patterns for multi-model agent systems.

  github.com/entropyvortex/meta-llm-charter

• Odysseus ↗

  Local-first agent runtime concept.

  pewdiepie-archdaemon.github.io/odysseus/

• TaxHacker ↗

  Document → structured data agent (receipts, forms).

  github.com/vas3k/TaxHacker

• block/buzz ↗

  Block's agent experimentation repo.

  github.com/block/buzz

Short-form video, launch reels, and audio — complements Brag Studio.

• /brag ↗

  Hyperframes launch videos — integrated in our admin Brag Studio.

  github.com/latent-spaces/brag

• OpenMontage ↗

  Open video montage tooling.

  github.com/calesthio/OpenMontage

• MoneyPrinterTurbo ↗

  Automated short video from script — TikTok/Reels pipeline.

  github.com/harry0703/MoneyPrinterTurbo

• Lightreel ↗

  AI video reel generation.

  lightreel.ai/landing

• Supertonic (TTS) ↗

  Expressive TTS for video voiceovers.

  github.com/supertone-inc/supertonic

• voicebox ↗

  Local voice cloning / TTS workstation.

  github.com/jamiepine/voicebox

• LongCat Video ↗

  Meituan long-form video generation research.

  github.com/meituan-longcat/LongCat-Video

• LongCat Avatar 1.5 ↗

  Talking-head avatar model weights.

  huggingface.co/meituan-longcat/LongCat-Video-Avatar-1.5

• OpenGame ↗

  Game/video interactive generation experiments.

  github.com/leigest519/OpenGame

• SongGeneration Studio ↗

  AI music generation UI.

  github.com/BazedFrog/SongGeneration-Studio

• img2threejs ↗

  Image → 3D scene for visual explainers.

  github.com/hoainho/img2threejs

• Three.js Object Sculptor ↗

  Codex plugin for 3D object authoring.

  github.com/vinhhien112/Three.js-Object-Sculptor-Codex-Plugin

• animate-ui ↗

  Animated UI components for launch pages.

  github.com/imskyleen/animate-ui

• Higgsfield Supercomputer ↗

  High-end generative video platform.

  higgsfield.ai/supercomputer

Weights, OCR, speech, and local runtimes — for self-hosted research stacks.

• GLM-OCR ↗

  Document OCR model — declassified PDF pipelines.

  github.com/zai-org/GLM-OCR

• Open LM GLM-5.2 ↗

  GLM model family hub.

  openlm.ai/glm-5.2/

• Qwen3.6 35B GGUF ↗

  Quantized Qwen for local inference.

  huggingface.co/unsloth/Qwen3.6-35B-A3B-GGUF

• Qwen distilled reasoning ↗

  Distilled reasoning model experiment.

  huggingface.co/Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled

• speech-to-speech ↗

  HF real-time speech pipeline.

  github.com/huggingface/speech-to-speech

• Hungarian GPT-2 news ↗

  Small Hungarian news LM — niche locale experiments.

  huggingface.co/NYTK/text-generation-news-gpt2-small-hungarian

• Kronos ↗

  Time-series / forecasting model tooling.

  github.com/shiyu-coder/Kronos

• Wan2GP ↗

  GPU-optimized Wan video model runner.

  github.com/deepbeepmeep/Wan2GP

• PixelRAG ↗

  Visual RAG — images in retrieval pipelines.

  github.com/StarTrail-org/PixelRAG

• Open Higgsfield AI ↗

  Open replication/experiments around Higgsfield.

  github.com/Anil-matcha/Open-Higgsfield-AI

• CorridorKey ↗

  Model routing / key management utility.

  github.com/nikopueringer/CorridorKey

• picoclaw ↗

  Tiny local agent runtime.

  picoclaw.io/

• entropic (Qu.ai) ↗

  Managed inference pricing — compare against self-host.

  entropic.qu.ai/pricing

Ship and run The Theorist-style stacks without enterprise lock-in.

• Coolify ↗

  Self-host PaaS on your VPS — escape serverless limits.

  github.com/coollabsio/coolify

• Chatwoot ↗

  Open-source support inbox when user base grows.

  github.com/chatwoot/chatwoot

• Maybe Finance ↗

  Open personal finance — if you monetize later.

  github.com/maybe-finance/maybe

• AdKit ↗

  Ad creative generation — growth layer for The Theorist.

  adkit.so/

• Shipper ↗

  Fast product shipping toolkit.

  app.shipper.now/

• usefastlane.ai ↗

  AI-accelerated product lanes.

  www.usefastlane.ai/

• indiepa.ge ↗

  Indie maker landing pages.

  indiepa.ge/

• tiiny.ai ↗

  Micro-SaaS / landing experiments.

  tiiny.ai/

• ui-ux-pro-max-skill ↗

  UI/UX skill pack for agent-assisted design.

  github.com/nextlevelbuilder/ui-ux-pro-max-skill

• ai-website-cloner ↗

  Clone-and-remix site templates with agents.

  github.com/JCodesMore/ai-website-cloner-template

• Skills (MengTo) ↗

  Design/dev skill definitions for Claude.

  github.com/MengTo/Skills

• Skills (lixiaolin94) ↗

  Additional agent skill library.

  github.com/lixiaolin94/skills

• Anthropic Skilljar ↗

  Official Anthropic training courses.

  anthropic.skilljar.com/

• walls.rip mail ↗

  Disposable/alias mail for signup tradecraft.

  walls.rip/mail

Playgrounds worth watching — not all production-ready.

• HY-3D ↗

  3D generation playground.

  hy-3d.com/

• Emergent ↗

  Agent app builder sandbox.

  app.emergent.sh/home

• CodinGame ↗

  Algorithm puzzles — keeps scraping/parsing skills sharp.

  www.codingame.com/ide/puzzle/onboarding

• Rork ↗

  Mobile app AI builder.

  rork.com/

• oiioii.ai ↗

  Creative AI workspace.

  www.oiioii.ai/login

• Kimi ↗

  Moonshot long-context chat — compare research quality.

  www.kimi.com/membership/pricing

• UserRebirth ↗

  Growth/analytics experiment.

  userebirth.com/dashboard

• lemonade.gg ↗

  Gaming/agent crossover project.

  lemonade.gg/

• linux-android ↗

  Run Linux on Android — field research device.

  github.com/mayukh4/linux-android

• scrcpy ↗

  Mirror and control Android from desktop.

  github.com/Genymobile/scrcpy

• Alice ↗

  Personal AI assistant framework.

  github.com/pmbstyle/Alice

Skill-building — geolocation, quizzes, courses, and military open-source reading.

• GeoGuessr ↗

  Train geolocation intuition from street-level imagery.

  www.geoguessr.com/

• Quiztime (@quiztime) ↗

  Twitter geolocation challenge series — gold standard training.

  x.com/quiztime

• Introduction to OSINT ↗

  Structured beginner OSINT course.

  www.myosint.training/courses/introduction-to-osint

• TCM OSINT Course (Notion) ↗

  Community OSINT curriculum notes.

  www.notion.so/TCM-OSINT-Course-183a035142118024b3c0ea2827350a19

• SOC.mil IdM publications ↗

  US Army intel doctrine — open PDF library.

  www.soc.mil/IdM/publications/IdMpubs.html

• OSINT pivoting (YouTube) ↗

  Video walkthrough on pivot techniques.

  www.youtube.com/watch?v=nd5W82KN9B8

• OSINT phone/email (Reddit) ↗

  Community thread on number/email pivots.

  www.reddit.com/r/OSINT/comments/15y4wuh/phone_number_and_email/

Research tooling — authorized testing only. Laws vary by country.

For systems you own or have written permission to test. Unauthorized access is illegal. The Theorist links these for defensive awareness and journalist tradecraft education only.

• USB Army Knife ↗

  Multi-function USB research implant — know what defenders detect.

  github.com/i-am-shodan/USBArmyKnife/wiki/Installation

• USB Army Knife (overview) ↗

  Independent write-up of capabilities and risks.

  www.mobile-hacker.com/2025/01/24/usb-army-knife-the-ultimate-close-access-penetest-tool/

• Pwnagotchi ↗

  WiFi handshake capture pet — passive RF research.

  pwnagotchi.ai/

• Hak5 USB Rubber Ducky ↗

  Classic keystroke injection research platform.

  shop.hak5.org/products/usb-rubber-ducky

• Alfa AWUS036AXM ↗

  Monitor-mode WiFi adapter for RF surveys.

  alfa-network.eu/wi-fi/wi-fi-adapters/alfa-usb-adapter-awus036axm

• LilyGo T-Dongle S3 ↗

  Compact ESP32-S3 USB form factor for custom tools.

  lilygo.cc/products/t-dongle-s3