The 2nd part of my web scraping tutorial covers Scrapy Shell, which can be used to interactively test and refine scraping logic. We will scrape Apple's website for the latest iPhone models and their prices.
Why is it a really bad idea to use Thread.sleep() in your tests? And what should you use instead?
A tutorial about creating web spiders with Scrapy and running them with Jenkins.
