Scrapy at a glance — Scrapy 0.17.0 documentation
▻http://doc.scrapy.org/en/latest/intro/overview.html
Scrapy is an application framework for crawling web sites and extracting structured data which can be used for a wide range of useful applications, like data mining, information processing or historical archival.