Popular repositories Loading

1. scrapy-splash scrapy-splash Public

   Scrapy+Splash for JavaScript integration

   Python 3.1k 450

2. scrapy-playwright scrapy-playwright Public

   🎭 Playwright integration for Scrapy

   Python 1k 110

3. scrapy-djangoitem scrapy-djangoitem Public

   Scrapy extension to write scraped items using Django models

   Python 498 87

4. scrapy-zyte-smartproxy scrapy-zyte-smartproxy Public

   Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy

   Python 356 88

5. scrapy-jsonrpc scrapy-jsonrpc Public

   Scrapy extension to control spiders using JSON-RPC

   Python 297 72

6. scrapy-deltafetch scrapy-deltafetch Public

   Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls

   Python 267 48