1. Scrapyd Cluster Management (1) Group, filter and select any numbers of nodes (2) Execute command on multinodes with one click 2. Scrapy Log Analysis (1) Stats collection (2) Progress visualization (3) Logs categorization 3. All Scrapyd API Supported (1) Deploy project, Run Spider, Stop job (2) List projects/versions/spiders/running_jobs (3) Delete version/project 4. Others (1) Basic auth for web UI (2) Accessing Scrapyd servers protected by basic auth
ScrapydWeb
Full-featured web UI for Scrapyd cluster management, Scrapy log analysis and visualization
Explore By Topic