sources using extended CSS selectors and XPath expressions, with helper methods to extract using regular expressions. An interactive shell console (IPython aware) for trying out the CSS and XPath expressions efficient XML and HTML parser parsel [https://pypi.python.org/pypi/parsel], an HTML/XML data extraction library written on top of lxml, w3lib [https://pypi.python.org/pypi/w3lib], a multi-purpose helper for dealing Besides the extract() and extract_first() methods, you can also use the re() method to extract using regular expressions: >>> response.css('title::text').re(r'Quotes.*') ['Quotes to Scrape'] >>> response.css('title::text')

http://www.mininova.org/tor/NUMBER where NUMBER is an integer. We’ll use that to construct the regular expression for the links to follow: /tor/\d+. We’ll use XPath [http://www.w3.org/TR/xpath] for selecting name is contained inside a

tag:

Darwin - The Evolution Of An Exhibition

An XPath expression to extract the name could be: //h1/text() And the description is contained inside a

http://www.mininova.org/tor/NUMBER where NUMBER is an integer. We’ll use that to construct the regular expression for the links to follow: /tor/\d+. We’ll use XPath [http://www.w3.org/TR/xpath] for selecting that the file name is contained inside a

tag:

Home[2009][Eng]XviD-ovd

An XPath expression to extract the name could be: //h1/text() And the description is contained inside a

http://www.mininova.org/tor/NUMBER where NUMBER is an integer. We’ll use that to construct the regular expression for the links to follow: /tor/\d+. We’ll use XPath [http://www.w3.org/TR/xpath] for selecting name is contained inside a

tag:

Darwin - The Evolution Of An Exhibition

An XPath expression to extract the name could be: //h1/text() And the description is contained inside a

http://www.mininova.org/tor/NUMBER where NUMBER is an integer. We’ll use that to construct the regular expression for the links to follow: /tor/\d+. We’ll use XPath for selecting the data to extract from that the file name is contained inside a

tag:

Home[2009][Eng]XviD-ovd

An XPath expression to extract the name could be: //h1/text() And the description is contained inside a

http://www.mininova.org/tor/NUMBER where NUMBER is an integer. We’ll use that to construct the regular expression for the links to follow: /tor/\d+. We’ll use XPath for selecting the data to extract from name is contained inside a

tag:

Darwin - The Evolution Of An Exhibition

An XPath expression to extract the name could be: //h1/text() And the description is contained inside a

http://www.mininova.org/tor/NUMBER where NUMBER is an integer. We’ll use that to construct the regular expression for the links to follow: /tor/\d+. For extracting data we’ll use XPath [http://www.w3.org/TR/xpath] that the file name is contained inside a

tag:

Home[2009][Eng]XviD-ovd

An XPath expression to extract the name could be: //h1/text() And the description is contained inside a

http://www.mininova.org/tor/NUMBER where NUMBER is an integer. We’ll use that to construct the regular expression for the links to follow: /tor/\d+. We’ll use XPath for selecting the data to extract from name is contained inside a

tag:

Darwin - The Evolution Of An Exhibition

An XPath expression to extract the name could be: //h1/text() And the description is contained inside a

http://www.mininova.org/tor/NUMBER where NUMBER is an integer. We’ll use that to construct the regular expression for the links to follow: /tor/\d+. We’ll use XPath [http://www.w3.org/TR/xpath] for selecting that the file name is contained inside a

tag:

Home[2009][Eng]XviD-ovd

An XPath expression to extract the name could be: //h1/text() And the description is contained inside a

http://www.mininova.org/tor/NUMBER where NUMBER is an integer. We’ll use that to construct the regular expression for the links to follow: /tor/\d+. We’ll use XPath [http://www.w3.org/TR/xpath] for selecting that the file name is contained inside a

tag:

Home[2009][Eng]XviD-ovd

An XPath expression to extract the name could be: //h1/text() And the description is contained inside a