Scrapy at a glance — Scrapy 0.18.4 documentation
"Scrapy is an application framework for crawling web sites and extracting structured data which can be used for a wide range of useful applications, like data mining, information processing or historical archival."