Crawlab

Crawlab

Distributed crawler management platform that supports any language and framework

12,207GitHub
Description

This is a distributed web crawler management platform based on Go-language, supporting multiple programming languages such as Python, NodeJS, Go, Java, and PHP, as well as multiple web crawler frameworks such as Scrapy, Puppeteer, and Selenium. Instructions for use: 1. The default account and password are admin / admin Main features: 1. distributed architecture 2. user-friendly interface 3. Integration and extensibility 4. Open source and community support

Screenshots
Screenshot 1
Screenshot 2
Screenshot 3
Screenshot 4
App Information
Version
0.6.3
Package Size
44.31 KB
Image Size
1.32 GB
Updated
October 10, 2025
Source Code
crawlab-team
Platform Support
PC
Keywords
crawler