scrapy==2.17.0
# A high-level Web Crawling and Web Scraping framework
$ pip install scrapy
🔗 This package's source is indexed on CodeBrowser too
View GitHub repo →
downloads/wk
664,786
license
—
version
2.17.0
python
>=3.10
What is scrapy?
Scrapy is a Python framework for building web crawlers and scrapers that can extract data from websites at scale. Developers use it to automate the collection of structured data from web pages efficiently, handling tasks like following links, managing requests, and parsing HTML without writing boilerplate code. It's particularly useful for large-scale web scraping projects that require performance, reliability, and the ability to handle multiple concurrent requests.