For someone who needs to gather a huge amount of information from the Internet and wants to save huge time doing it, web scraping definitely the key. Generally, web scraping is the process of gathering information from the Internet. Instead of manually collecting the data, this procedure is done automatically using software like Python. Web Scraping, however, has been a subject for debate whether this procedure is legal or not.
In this provocatively titled video presented by Kimberly Fessel from PyCon, we will learn more about web scraping. Automated web scraping can be a solution to speed up the data collection process. You write your code once and it will get the information you want many times and from many pages. In this video, Kimberly will walk us through her take on the process and will teach us everything we need to understand about web scraping from HTML basics through pipeline methods to compile entire datasets. Of course, even if you do share Kimberly’s legal position on the legality of web scraping, as she points out, you do still need to take into account copyright and other fair usage or ownership rights when considering the process.
If you want to learn more about web scraping using Python, feel free to watch the tutorial below.
