Web Scraping with Python
About this Course
In this 2-hour long project-based course, you will learn how to analyze complex HTML structures and identify the relevant data to be extracted using Scrapy and XPath. You will apply the concepts of web scraping, including setting up a Scrapy project, generating spiders, and using XPath queries to extract data from websites that do not provide an API. Additionally, you will evaluate the effectiveness and efficiency of your scraping code, considering factors such as changing webpage structures, scalability, and coding defensively to ensure robustness. The course includes hands-on labs where you will create a spider and parse complex HTML, allowing you to practice and reinforce the concepts learned.Created by: Duke University
Related Online Courses
This is a Google Cloud Self-Paced Lab. In this hands-on lab, you will use Apps Script to call the Natural Language API from Google Docs to analyze the sentiment of selected text in the... more
Unlock the secrets of SEO! Dive into the fascinating world of Search Engine Optimization (SEO) and discover how major search engines like Google rank websites and content. This introductory course... more
This specialization is intended for students, working professionals, entrepreneurs, and intrapreneurs looking to learn more about strategies and tools to run an effective social business.... more
In this Specialization, you will learn industry-standard theory and methods for developing successful user interfaces (UIs). Upon completing this Specialization, you will have fluency with the user... more
Indigenous Canada is a 12-lesson Massive Open Online Course (MOOC) from the Faculty of Native Studies that explores the different histories and contemporary perspectives of Indigenous peoples... more
Powered by
