Web Scraping and Data Extraction Service

1,801 views

Published on

Learn more about Web Scraping and data extraction services. We have covered various points about scraping, extraction and converting un-structured data to structured format. For more info visit http://promptcloud.com/

0 Comments
4 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,801
On SlideShare
0
From Embeds
0
Number of Embeds
82
Actions
Shares
0
Downloads
45
Comments
0
Likes
4
Embeds 0
No embeds

No notes for slide

Web Scraping and Data Extraction Service

  1. 1. Image Credits: codeatomic
  2. 2. What is Web Scraping • Web Scraping refers to an application that processes the HTML of a Web page to extract data for manipulation such as converting the Web page to another format (i.e. HTML to XML). • It is also known as Web Harvesting and Web Data Extraction
  3. 3. Web Scraping Architecture Image Credits: dotnet4features
  4. 4. • Web Scraping scripts and applications will simulate a person viewing a Web site with a browser. Using these scripts you can connect to a Web page and request a page, exactly as a browser would do. • The Web server will send back the page which you can then manipulate or extract specific information from.
  5. 5. Converting Unstructured data to Structured data Image Credits: netscavator
  6. 6. • Unstructured content is largely obtained after the scraping process. Structuring the data is the tedious process. But nowadays most of the tools easily does this functionality to segregate the data based on the fields. After the segregation the data is converted into either an API or any other format like • CSV • XML • XLS • JSON
  7. 7. Web Indexing Image Credits: iloveldsclothing
  8. 8. • Web scraping is closely related to web indexing, which indexes information on the web using a bot or web crawler and is a universal technique adopted by most search engines.
  9. 9. Uses of Scraping Services Image Credits: agconexus
  10. 10. Following are some of the uses of Scraping service: • Online price comparison • Contact scraping • weather data monitoring • Website change detection • To collect data's for research work • web mash up • web data integration • Scraping articles blog and content • Social media crawling • Crawling review data
  11. 11. Outsourcing SLA for web crawl Image Credits: cpltechnology
  12. 12. If you have a plan to outsource the web crawl or Scraping services, consider the following SLA's • Crawlability • Scalability • Data structure capabilities • Data accuracy • Data coverage • Availability • Adaptability • Maintainability
  13. 13. For more information Visit http://blog.promptcloud.com/ Reach out to info@promptcloud.com
  14. 14. Visit http://promptcloud.com/

×