provides a lot of powerful features for making scraping easy and efficient, such as: • Built-in support for selecting and extracting data from HTML/XML sources using extended CSS selectors and XPath expressions spiders. • Built-in support for generating feed exports in multiple formats (JSON, CSV, XML) and storing them in multiple backends (FTP, S3, local filesystem) • Robust encoding support and auto-detection for dealing with foreign, non-standard and broken encoding dec- larations. • Strong extensibility support, allowing you to plug in your own functionality using signals and a well-defined API (middlewares

making scraping easy and efficient, such as: • Built-in support for selecting and extracting data from HTML and XML sources • Built-in support for cleaning and sanitizing the scraped data using a collection collection of reusable filters (called Item Loaders) shared between all the spiders. • Built-in support for generating feed exports in multiple formats (JSON, CSV, XML) and storing them in multiple backends associated with the scraped items 2.1. Scrapy at a glance 7 Scrapy Documentation, Release 0.24.6 • Support for extending Scrapy by plugging your own functionality using signals and a well-defined API (mid-

for making scraping easy and efficient, such as: Built-in support for selecting and extracting data from HTML and XML sources Built-in support for cleaning and sanitizing the scraped data using a collection collection of reusable filters (called Item Loaders) shared between all the spiders. Built-in support for generating feed exports in multiple formats (JSON, CSV, XML) and storing them in multiple backends pipeline for automatically downloading images (or any other media) associated with the scraped items Support for extending Scrapy by plugging your own functionality using signals and a well-defined API (middlewares

Scrapy provides a lot of powerful features for making scraping easy and efficient, such as: Built-in support for selecting and extracting data from HTML/XML sources using extended CSS selectors and XPath expressions your spiders. Built-in support for generating feed exports in multiple formats (JSON, CSV, XML) and storing them in multiple backends (FTP, S3, local filesystem) Robust encoding support and auto-detection for dealing with foreign, non- standard and broken encoding declarations. Strong extensibility support, allowing you to plug in your own functionality using signals and a well-defined API (middlewares

provides a lot of powerful features for making scraping easy and efficient, such as: • Built-in support for selecting and extracting data from HTML/XML sources using extended CSS selectors and XPath expressions spiders. • Built-in support for generating feed exports in multiple formats (JSON, CSV, XML) and storing them in multiple backends (FTP, S3, local filesystem) • Robust encoding support and auto-detection for dealing with foreign, non-standard and broken encoding dec- larations. • Strong extensibility support, allowing you to plug in your own functionality using signals and a well-defined API (middlewares

Scrapy provides a lot of powerful features for making scraping easy and efficient, such as: Built-in support for selecting and extracting data from HTML/XML sources using extended CSS selectors and XPath expressions your spiders. Built-in support for generating feed exports in multiple formats (JSON, CSV, XML) and storing them in multiple backends (FTP, S3, local filesystem) Robust encoding support and auto-detection for dealing with foreign, non- standard and broken encoding declarations. Strong extensibility support, allowing you to plug in your own functionality using signals and a well-defined API (middlewares

Scrapy provides a lot of powerful features for making scraping easy and efficient, such as: Built-in support for selecting and extracting data from HTML/XML sources using extended CSS selectors and XPath expressions your spiders. Built-in support for generating feed exports in multiple formats (JSON, CSV, XML) and storing them in multiple backends (FTP, S3, local filesystem) Robust encoding support and auto-detection for dealing with foreign, non- standard and broken encoding declarations. Strong extensibility support, allowing you to plug in your own functionality using signals and a well-defined API (middlewares

Scrapy provides a lot of powerful features for making scraping easy and efficient, such as: Built-in support for selecting and extracting data from HTML/XML sources using extended CSS selectors and XPath expressions your spiders. Built-in support for generating feed exports in multiple formats (JSON, CSV, XML) and storing them in multiple backends (FTP, S3, local filesystem) Robust encoding support and auto-detection for dealing with foreign, non- standard and broken encoding declarations. Strong extensibility support, allowing you to plug in your own functionality using signals and a well-defined API (middlewares

Scrapy provides a lot of powerful features for making scraping easy and efficient, such as: Built-in support for selecting and extracting data from HTML/XML sources using extended CSS selectors and XPath expressions your spiders. Built-in support for generating feed exports in multiple formats (JSON, CSV, XML) and storing them in multiple backends (FTP, S3, local filesystem) Robust encoding support and auto-detection for dealing with foreign, non- standard and broken encoding declarations. Strong extensibility support, allowing you to plug in your own functionality using signals and a well-defined API (middlewares

Scrapy provides a lot of powerful features for making scraping easy and efficient, such as: Built-in support for selecting and extracting data from HTML/XML sources using extended CSS selectors and XPath expressions your spiders. Built-in support for generating feed exports in multiple formats (JSON, CSV, XML) and storing them in multiple backends (FTP, S3, local filesystem) Robust encoding support and auto-detection for dealing with foreign, non- standard and broken encoding declarations. Strong extensibility support, allowing you to plug in your own functionality using signals and a well-defined API (middlewares