Nobody needs to write REST API clients manually anymore - generating a decent client from well-written definitions is a common practice. In this two-part series, I will introduce you to Microsoft Kiota, a new project that aims to provide a novel approach to the boring task of generating SDK clients. In the first part, I'll walk you through my sandbox REST API project, and demonstrate how to generate an OpenAPI definition file using the code-first approach.
In the last part of my Web Scraping series, we will refactor the Spider and fix the issues we have encountered in the previous parts. Also, we will deploy and run our Scrapy Spider on Jenkins.
This article is the third part of my web scraping series. I focuse on creating a Scrapy Spider to scrape Apple's website for the latest iPhone models and their prices. I will explain how to create a new Scrapy project, and generate a Spider. The article also covers fetching the pages for different iPhone models from the US, Swedish, and Hungarian Apple sites.