SlideShare is now on Android. 15 million presentations at your fingertips.  Get the app

×
  • Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
 

Roll your own web crawler. RubyDay 2013

by VP of Engineers at Gild inc on Jun 14, 2013

  • 2,962 views

It is all about data. ...

It is all about data.
Having the right data at the right time might make the difference between you and your competitor. Google can show you just what it can catch. If you know where to find the data of your interest, let's go deeper and roll your own web crawler framework.
Taking the advantage of the latest cool technologies I will show you how to build your distributed web crawler based on Redis and Mongo

Statistics

Views

Total Views
2,962
Views on SlideShare
2,943
Embed Views
19

Actions

Likes
8
Downloads
0
Comments
0

2 Embeds 19

http://lanyrd.com 15
https://twitter.com 4

Accessibility

Categories

Upload Details

Uploaded via SlideShare as Adobe PDF

Usage Rights

CC Attribution License

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
Post Comment
Edit your comment

Roll your own web crawler. RubyDay 2013 Roll your own web crawler. RubyDay 2013 Presentation Transcript