Hadoop&The New Analytics Casey KiernanSr. Director / Data Architecture - Shopzilla.com November 1, 2011
AgendaThe New “Data”The New Business ModelThe New Analytic ScenariosThe New Analytic ArchitecturesThe New Analytic TechnologiesAnd, Yes… The New Data-Center 2
SERVICES • SOA • JSON • AVRO • APPLICATIONS • HTML • JAVA • C# • THE CLOUD • HADOOP • OLAP PYTHON • SITES • TENANT • ORG • SSNFINANCE • ID • CUSTOMER • EXPERIAN SQL SERVER • ORACLE • UNIX • SUBVERSION • COMPLIANCE • SECURITY • SALESFORCE • MYSQL The World as I See it
My Mountain Bike as a Data Platform Data Collection Heart Rate Data Collection Altitude Data Collection Temperature Speed / Trip Miles Time Guidance Performance Rate of Climb Calories Burned Miles Obtained Total Climbed Elapsed Time Current, Average, Max Values Data Collection Cadence / RPM Data Architecture - on a Local Wireless Network (ANT+ Protocol)
“Business” Analytics BUSINESS INTELLIGENCE. DATA WAREHOUSE/OLAP. OLTP DATA. What are our most profitable Movie titles?
“Business” Analytics What did Happen? What will Happen? Operational Reporting Tactical Analytics Strategic Months WeeksWeeks Months Years 6
“Personal” Analytics SELF-SERVICE. GUIDANCE. BEHAVIOURS. What Movie should I watch tonight?
“Personal” Analytics What is Happening NOW? What did Happen? What will Happen? Historical Behaviors Tactical Analytics Strategic Months WeeksWeeks Months Years 8