Bounded, source-linked documentation crawler for authorized websites. Robots-first Scrapy workflow with JSON and CSV evidence.
python documentation web-crawler web-scraping robots-txt scrapy reproducible-builds data-export source-provenance security-boundaries
-
Updated
Sep 5, 2026 - Python