FEEL FREE TO CONTACT ME @ ------------------------------------------ Email : sarvesh.singh18@hotmail.com Github : https://github.com/Sarvesh18 Twitter : https://twitter.com/sarvesh_smcs2 LinkedIn : https://www.linkedin.com/in/sarvesh18

2. Collect
Data???
API
Based
Web
Scrapping

3. In many cases where a website wants you to have access to their data, they will have a web-based
API that makes downloading the data easier than reading it from an HTML page.
One big advantage of using an API is that it is an officially sanctioned method of getting access to
the data. Aside from the legal protections, using an API means that the website owners and
programmers know that people are using it, and won’t change the API without a lot of advance
warning. If you are scraping a webpage and depending on it’s format to remain unchanged so that
you can find the data you want, any time the website gets an update your web-scraper will break!

4. Web scraping is the practice of using a computer program to sift through a web page and gather the data
that you need in a format most useful to you while at the same time preserving the structure of the data.
However, before learning how to do this, you should understand that some websites put legal (and ethical)
restrictions on the data they provide. In some cases a website intends the data to be seen by humans, but
do not want a program to download the data automatically. Website owners have several legitimate reasons
for not wanting you to download their data automatically. In some cases the website owners worry about
programs overloading their server.
Scrapy BeautifulSoup RegEx Jsoup

6. • response.xpath('//title/text()').extract_first()XPath
• response.css('title::text').extract()CSS Path
• response.css('title::text').re(r'LG.*')Regex

7. CSV
JSON
XML
Text