Crawling the web for fun and profit
•28 likes•8,534 views
Report
Share
Crawling technology are the basis for search engines but they also have many applications for business and for fun.
More Related Content
What's hot
What's hot(8)
Viewers also liked
Viewers also liked(20)
Similar to Crawling the web for fun and profit
Similar to Crawling the web for fun and profit(20)
More from Federico Feroldi
More from Federico Feroldi(7)
Recently uploaded
Recently uploaded(20)
Crawling the web for fun and profit
- 1. Crawling the Web (for fun and profit) Federico Feroldi
- 2. “A Web crawler is a computer program that browses the World Wide Web in a methodical, automated manner.” Wikipedia Picture greetings to photoholic1 --LennyB
- 6. Search engines only show you what their crawlers can catch Picture greetings to jimbrickett
- 7. The deep web contains a lot of valuable information e-commerce finance transportation yellow pages medicine government opinions real estate personal intranets social Picture greetings to tricky ™
- 8. Dig deeper with your own crawler Picture greetings to Super*Junk
- 9. Information = Competitive Advantage Picture greetings to mastrobiggo
- 10. B a cku p h i s t o r i c a l data: web sites, blogs
- 11. Social network analysis: find influencers and interests based on “social circles”
- 12. Find what people like
- 13. Sentiment analysis: find what people say about your brand or product
- 16. Real estate
- 17. Personal data and online reputation
- 18. Do It Yourself Picture greetings to vic_206
- 19. Anybody can build a search engine
- 20. Scrapy Scheduler Internet architecture Re qu es Data ts Item Scrapy Downloader pipeline Requests Engine es Ite ns ms po R es Spider
- 21. Twitter social graph crawler with Scrapy in 150 LOC
- 22. The Web is much bigger than what you can search with Google