© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.1
Intro to Big Data
and Real-Time
Analytics
Turning data into
answers
April 11, 2013
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.2
$3Hey
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.3
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.4
$3Hey
!
++
+
+
=
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.5
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
The Big Data Opportunity
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.7
Putting Big Data in Perspective: January 1983
Compaq’s first portable computer
shipped!
TWO real floppy drives and 128KB
memory …….
Michael Jackson had the
chart topper “Billie Jean” on
LP
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.8
Cost of a Gigabyte in 1983: $1,000,000
Source: http://www.mkomo.com/cost-per-gigabyte
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.9
YouTube
Viber
Qzone
Amazon Web Services
GoGrid
Rackspac
e
LimeLight
Jive Software
salesforce.com
Xactly
Paint.NET
Business
Education
Entertainment
Games
Lifestyle
Music
Navigation
News
Photo & Video
Productivity
Reference
Social Networking
Sport
Travel
Utilities
Workbrain
SuccessFactors
Taleo
Workday
Finance
box.net
Facebook
LinkedIn
TripIt
Pinterest
Zynga
Zynga
Baidu
Twitter
Twitter
Yammer
Atlassian
Atlassian
MobilieIronSmugMug
SmugMug
Atlassian
Amazon
Amazon
iHandy
PingMe
PingMe
Associatedcontent
Flickr
Snapfish
Answers.com
Tumblr.
Urban
Scribd.Pandora
MobileFrame.com
Mixi
CYworld
Renren
Xing
Yandex
Yandex
Heroku
RightScale
New Relic
AppFog
Bromium
Splunk
CloudSigma
cloudability
kaggle
nebula
Parse
ScaleXtreme
SolidFire
Zillabyte
dotCloud
BeyondCore
Mozy
Fring Toggl
MailChimp
Hootsuite
Foursquare
buzzd
Dragon Diction
SuperCam
UPS Mobile
Fed Ex Mobile
Scanner Pro
DocuSign
HP ePrint
iSchedule
Khan Academy
BrainPOP
myHomework
Cookie Doodle
Ah! Fasion Girl
PaperHost
SLI Systems
NetSuite
OpSource
Joyent
Hosting.com
Tata Communications
Datapipe
PPM
Alterian
Hyland
NetDocuments
NetReach
OpenText
Xerox
Google
Microsoft
IntraLinks
Qvidian
Sage
SugarCRM
Volusion
Zoho
Adobe
Avid
Corel
Microsoft
Serif
Yahoo
CyberShift
Saba
Softscape
Sonar6
Ariba
Yahoo!
Quadrem
Elemica
Kinaxis
CCC
DCC
SCM
ADP VirtualEdge
Cornerstone onDemand
CyberShift
Kenexa
Saba
Softscape
Sonar6
Workscape
Exact Online
FinancialForce.com
Intacct
NetSuite
Plex Systems
Quickbooks
eBay
MRM
Claim Processing
Payroll
Sales tracking
& Marketing
Commissions
Database
ERP
CRM
SCM
HCM
HCM
PLM
HP
EMC
Cost Management
Order Entry
Product
Configurator
Bills of Material
Engineering
Inventory
Manufacturing Projects
Quality Control
SAP
Cash Management
Accounts
Receivable
Fixed AssetsCosting
Billing
Time and Expense
Activity
Managemen
t
Training
Time &
Attendance
Rostering
Service
Data Warehousing
The
internet
Client/server
Every 60 seconds
23,148
+apps downloaded
98,000
tweets
400,710
ads requests
2000
lyrics played
on Tunewiki
208,333
minutes Angry
Birds played
IBM
Unisys
Burroug
hs
Hitachi
NEC
Bull
Fijitsu
Mainframe
The explosion of data is not news to anyone …
Mobile, social,
Big data & the
cloud
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.10
Today, data analysis is slow, painful and costly
?
?
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Business Objectives
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.12
Lower cost and demonstrate value to the business
Key Market Drivers
Massive growth in volume and variety of data
High Expectations for up-to-date and current data
Data access for Business Analysts
How do I know the
data is current?
How can I make
sense of all this data?
How do I align this
data for business
insights?
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.13
Use of Analytics in your Customer’s Business
Degrees of Intelligence
Forecast
CompetitiveAdvantage
Predict
Real Time
Decisions
Identify Exact Problem
Automatic Alerts & Actions
Statistical Analysis and Forecasting
Predictive Modeling
Proactive Optimized Decisions
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.14
Consequences for not Changing
Continued growth of data forces
architectures away from their original
design strengths
Higher costs for lower performance
Competitive advantage erodes at top
speed in a fast moving market
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
What is Vertica
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.16
Legacy architectures were built for a different
world
• Proprietary
• Expensive
• Centralized,
monolithic
• Process laden
• Batch
• Summary
• Slow
Yesterday’s data warehouse
and analytic infrastructure
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.17
50x-1000x faster performance at 30% the cost, proven by more than 2500 customers & OEMs
Vertica, purpose built for answers in near real
time
1000x
Volume Variety Velocity
Value
Vertica is a real time analytics database
platform purpose built for Big Data.
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.18
Advanced analytics
Time-series, geospatial, click-streamand an SDK for more
Designed for answers from the very first line of
code, Vertica technology makes the difference
Achieve best data query performance with unique Vertica column
store
Columnar
storage and
execution
Add resources on the fly with linear scaling on the grid, commodity hardwareClustering
Store more data, provide more views, 90% less storage requiredCompression
Query and load 24x7 with zero administration
Continuous
performance
Database design
Automated performance tuning
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.19
Vertica architecture – every element purpose
built for volume, variety, velocity and value
Next-generation administration and design tools
True column store - RDBMS
Native and performance optimized high availability
Real time massively parallel processing
Columnar
Compression Concurrent
Load &
Query
Elastic
Cluster SQL
Analytics
User-
Defined
Analytics
Optimized
Connectors
Standard
Interface
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Success Stories
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.21
2500+ Customers and Growing
Communications Consumer Marketing Online Web & Gaming Healthcare RetailFinancial Services
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.22
Big Data Analytics
Hundreds of customers have invested in Vertica
FINANCIAL SERVICES
COMMUNICATIONS
CONSUMER MARKETINGHEALTHCARE
RETAILONLINE WEB AND GAMING
“Vertica opened doors to analyses
that otherwise were either too time-
intensive or impossible. That
knowledge is invaluable in an
aggressively competitive market like
ours.”
- Brian Harvell, Executive Director for
Network Operations, Comcast
“Started small with one research
effort, result set came back so fast
that we thought the queries had
failed. Today we’ve moved the entire
analytics stack to Vertica! Thrilled to
be a Vertica customer!”
- Doug Porter, SVP & CIO, BlueCross
BlueShield Association
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.23
• Promotional Testing
• Claims Analyses
• Patient Records Analyses
• Clinical data Analyses
• Fraud Monitoring
• Financial Tracking
• Tick data back-testing
• Behavior Analytics
• Click Stream Analyses
• Network Analyses
• Customer Analytics
• Compliance Testing
• Loyalty Analysis
• Campaign Management
More than 2500 customers & OEMs in multiple
industries are finding answers
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
What ANSWERS do you need?

3rd day big data

  • 1.
    © Copyright 2012Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.1 Intro to Big Data and Real-Time Analytics Turning data into answers April 11, 2013
  • 2.
    © Copyright 2012Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.2 $3Hey
  • 3.
    © Copyright 2012Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.3
  • 4.
    © Copyright 2012Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.4 $3Hey ! ++ + + =
  • 5.
    © Copyright 2012Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.5
  • 6.
    © Copyright 2012Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The Big Data Opportunity
  • 7.
    © Copyright 2012Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.7 Putting Big Data in Perspective: January 1983 Compaq’s first portable computer shipped! TWO real floppy drives and 128KB memory ……. Michael Jackson had the chart topper “Billie Jean” on LP
  • 8.
    © Copyright 2012Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.8 Cost of a Gigabyte in 1983: $1,000,000 Source: http://www.mkomo.com/cost-per-gigabyte
  • 9.
    © Copyright 2012Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.9 YouTube Viber Qzone Amazon Web Services GoGrid Rackspac e LimeLight Jive Software salesforce.com Xactly Paint.NET Business Education Entertainment Games Lifestyle Music Navigation News Photo & Video Productivity Reference Social Networking Sport Travel Utilities Workbrain SuccessFactors Taleo Workday Finance box.net Facebook LinkedIn TripIt Pinterest Zynga Zynga Baidu Twitter Twitter Yammer Atlassian Atlassian MobilieIronSmugMug SmugMug Atlassian Amazon Amazon iHandy PingMe PingMe Associatedcontent Flickr Snapfish Answers.com Tumblr. Urban Scribd.Pandora MobileFrame.com Mixi CYworld Renren Xing Yandex Yandex Heroku RightScale New Relic AppFog Bromium Splunk CloudSigma cloudability kaggle nebula Parse ScaleXtreme SolidFire Zillabyte dotCloud BeyondCore Mozy Fring Toggl MailChimp Hootsuite Foursquare buzzd Dragon Diction SuperCam UPS Mobile Fed Ex Mobile Scanner Pro DocuSign HP ePrint iSchedule Khan Academy BrainPOP myHomework Cookie Doodle Ah! Fasion Girl PaperHost SLI Systems NetSuite OpSource Joyent Hosting.com Tata Communications Datapipe PPM Alterian Hyland NetDocuments NetReach OpenText Xerox Google Microsoft IntraLinks Qvidian Sage SugarCRM Volusion Zoho Adobe Avid Corel Microsoft Serif Yahoo CyberShift Saba Softscape Sonar6 Ariba Yahoo! Quadrem Elemica Kinaxis CCC DCC SCM ADP VirtualEdge Cornerstone onDemand CyberShift Kenexa Saba Softscape Sonar6 Workscape Exact Online FinancialForce.com Intacct NetSuite Plex Systems Quickbooks eBay MRM Claim Processing Payroll Sales tracking & Marketing Commissions Database ERP CRM SCM HCM HCM PLM HP EMC Cost Management Order Entry Product Configurator Bills of Material Engineering Inventory Manufacturing Projects Quality Control SAP Cash Management Accounts Receivable Fixed AssetsCosting Billing Time and Expense Activity Managemen t Training Time & Attendance Rostering Service Data Warehousing The internet Client/server Every 60 seconds 23,148 +apps downloaded 98,000 tweets 400,710 ads requests 2000 lyrics played on Tunewiki 208,333 minutes Angry Birds played IBM Unisys Burroug hs Hitachi NEC Bull Fijitsu Mainframe The explosion of data is not news to anyone … Mobile, social, Big data & the cloud
  • 10.
    © Copyright 2012Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.10 Today, data analysis is slow, painful and costly ? ?
  • 11.
    © Copyright 2012Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Business Objectives
  • 12.
    © Copyright 2012Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.12 Lower cost and demonstrate value to the business Key Market Drivers Massive growth in volume and variety of data High Expectations for up-to-date and current data Data access for Business Analysts How do I know the data is current? How can I make sense of all this data? How do I align this data for business insights?
  • 13.
    © Copyright 2012Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.13 Use of Analytics in your Customer’s Business Degrees of Intelligence Forecast CompetitiveAdvantage Predict Real Time Decisions Identify Exact Problem Automatic Alerts & Actions Statistical Analysis and Forecasting Predictive Modeling Proactive Optimized Decisions
  • 14.
    © Copyright 2012Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.14 Consequences for not Changing Continued growth of data forces architectures away from their original design strengths Higher costs for lower performance Competitive advantage erodes at top speed in a fast moving market
  • 15.
    © Copyright 2012Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. What is Vertica
  • 16.
    © Copyright 2012Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.16 Legacy architectures were built for a different world • Proprietary • Expensive • Centralized, monolithic • Process laden • Batch • Summary • Slow Yesterday’s data warehouse and analytic infrastructure
  • 17.
    © Copyright 2012Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.17 50x-1000x faster performance at 30% the cost, proven by more than 2500 customers & OEMs Vertica, purpose built for answers in near real time 1000x Volume Variety Velocity Value Vertica is a real time analytics database platform purpose built for Big Data.
  • 18.
    © Copyright 2012Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.18 Advanced analytics Time-series, geospatial, click-streamand an SDK for more Designed for answers from the very first line of code, Vertica technology makes the difference Achieve best data query performance with unique Vertica column store Columnar storage and execution Add resources on the fly with linear scaling on the grid, commodity hardwareClustering Store more data, provide more views, 90% less storage requiredCompression Query and load 24x7 with zero administration Continuous performance Database design Automated performance tuning
  • 19.
    © Copyright 2012Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.19 Vertica architecture – every element purpose built for volume, variety, velocity and value Next-generation administration and design tools True column store - RDBMS Native and performance optimized high availability Real time massively parallel processing Columnar Compression Concurrent Load & Query Elastic Cluster SQL Analytics User- Defined Analytics Optimized Connectors Standard Interface
  • 20.
    © Copyright 2012Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Success Stories
  • 21.
    © Copyright 2012Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.21 2500+ Customers and Growing Communications Consumer Marketing Online Web & Gaming Healthcare RetailFinancial Services
  • 22.
    © Copyright 2012Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.22 Big Data Analytics Hundreds of customers have invested in Vertica FINANCIAL SERVICES COMMUNICATIONS CONSUMER MARKETINGHEALTHCARE RETAILONLINE WEB AND GAMING “Vertica opened doors to analyses that otherwise were either too time- intensive or impossible. That knowledge is invaluable in an aggressively competitive market like ours.” - Brian Harvell, Executive Director for Network Operations, Comcast “Started small with one research effort, result set came back so fast that we thought the queries had failed. Today we’ve moved the entire analytics stack to Vertica! Thrilled to be a Vertica customer!” - Doug Porter, SVP & CIO, BlueCross BlueShield Association
  • 23.
    © Copyright 2012Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.23 • Promotional Testing • Claims Analyses • Patient Records Analyses • Clinical data Analyses • Fraud Monitoring • Financial Tracking • Tick data back-testing • Behavior Analytics • Click Stream Analyses • Network Analyses • Customer Analytics • Compliance Testing • Loyalty Analysis • Campaign Management More than 2500 customers & OEMs in multiple industries are finding answers
  • 24.
    © Copyright 2012Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. What ANSWERS do you need?