On October 23rd, 2014, we updated our
By continuing to use LinkedIn’s SlideShare service, you agree to the revised terms, so please take a few minutes to review them.
Apache Hadoop India Summit 2011 Keynote talk "Hadoop & the Future of Cloud Computing" by Todd PapaioannouPresentation Transcript
Hadoop & thefuture of Cloud Computing Todd Papaioannou VP, Cloud Architecture By SearchNetMedia
what’s happening More publicly available human-generated content More interactions being tracked (e.g. clickstream data) More business processes are being digitized More history being kept = The Data Exhaust! Flickr : sub_lime79 BigData is here!
CUTTING THROUGH THE NOISE access audience blogs communication computerinternetmass media people networking technology Location Social Relationships Science UnderstandingUser Interests Flickr : Lomo-Cam
turning data into insights machine learning time series logic regression content clustering algorithms Ad inventory modeling user interest prediction Flickr : NASA Goddard Photo and Video factorization models
making it relevant Flickr : ogimogi
hadoop: lightning-fast Technology science + big data + insight = personal relevance = VALUE Flickr : DDFic
BEHIND every click
hadoop Flickr : Got Sarah
THE PLATFORM EFFECT THE HADOOP ECOSYSTEM and other Early Adopters Scale and productize Hadoop Orgs with Internet Scale Problems Add tools / frameworks, enhance Hadoop Enhance Hadoop Ecosystem Service Providers Grow ecosystem - Training, support, enhancements Apache Hadoop Virtuous Circle!
Investment -> Adoption
Adoption -> Investment
Mainstream / Enterprise adoption Fund further development, enhancements 9
HADOOP IS GOING MAINSTREAM 2010 2008 2009 2007 The Datagraph Blog 10
hadoop at yahoo! “Where Science meets Data” PRODUCTS Data Analytics Content Optimization Content Enrichment Yahoo! Mail Anti-Spam Advertising Products Ad Optimization Ad Selection Big Data Processing & ETL DIMENSIONAL DATA CONTENT DATA PIPELINES HADOOP CLUSTERS Tens of thousands of servers APPLIED SCIENCE User Interest Prediction Ad inventory prediction Machine learning - search ranking Machine learning - ad targeting Machine learning - spam filtering 11