SlideShare a Scribd company logo
Big Data in the Data Center
Jean-Pierre Dijcks
Big Data Product Mangement




1   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Agenda


         Architecting Big Data
         Building Big Data Solutions
         Oracle Big Data Appliance




2   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Architecting Big Data




3   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
What Does a Big Data World Look Like?
        Truck / Motor Manufacturer
    What they collect
    Monitors the complete car
    Miles Per Gallon, Driving techniques
    Location information

    How they use it
    Better tailored servicing plans
    Better targeted marketing
    Offer better finance deals or related options
    More data for R&D
    Sell on to partners

    Big Data means…
    The ability to predict when components might fail
    Create better service plans based on actual usage
    Drivers can post their data to manufacturers website
    Black box data can help with accidents


4   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
What Does a Big Data World Look Like?
         Retailer / White Goods
What they collect
Food monitoring by RFID tags –
Fridge monitors food usage and sell-
by dates

How they use it
Automated food ordering
Better targeted marketing due to better data about
how/when customer uses products


Big Data means…
    More detailed information about customers
    Better store based demand planning



5    Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Sample of Big Data Use Cases Today

    AUTOMOTIVE
    Auto sensors
                                                  What is the main difference in this data?
                                                  COMMUNICATIONS
                                                  Location-based
                                                                 Retail / CPG
                                                                 Sentiment analysis
                                                                                    FINANCIAL
                                                                                    SERVICES
                                                                                                                                EDUCATION &
                                                                                                                                RESEARCH
    reporting                                       advertising             Hot products            Risk & portfolio analysis   Experiment
    location,                                                                                       New products                sensor analysis
                                                                            Optimized Marketing
    problems


HIGH TECHNOLOGY /
                                                    Volume, Velocity, Variety
                                                          LIFE              MEDIA/
                                                                                                     ON-LINE
                                                                                                     SERVICES /                 HEALTH CARE
INDUSTRIAL MFG.                                           SCIENCES          ENTERTAINMENT            SOCIAL                     Patient sensors,
Mfg quality                                               Clinical trials   Viewers / advertising    MEDIA                      monitoring, EHRs
Warranty analysis                                         Genomics          effectiveness            People & career            Quality of care
                                                                            Cross Sell               matching
                                                                                                     Web-site
                                                                                                     optimization
    OIL & GAS                                          These Characteristics Challenge your
                                                        Games           TRAVEL &
                                                                        TRANSPORTATION        UTILITIES
                                                                                                                                 LAW
                                                                                                                                 ENFORCEMENT
    Drilling                                            Adjust to
    exploration
    sensor analysis
                                                        player
                                                        behavior
                                                                  Existing Architecture Meter
                                                                        Sensor analysis for
                                                                        optimal traffic flows
                                                                                              Smart
                                                                                              analysis for
                                                                                                                                 & DEFENSE
                                                                                                                                 Threat analysis -
                                                                                                      network                    social media
                                                         In-Game Ads        Customer sentiment        capacity,                  monitoring, photo
                                                                                                                                 analysis




6    Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Building your big data architecture

          Gradually Extending your Existing Architecture for Big Data:
           Step 1: Further Analyze Current Data
           Step 2: Architect for Data Variety and Volume
           Step 3: Architect for Data Velocity
           Step 4: Discover New Patterns



             Increase                                                      Business Value

7   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Step 0: Data Warehouse Foundation


                                                                                                                 • Dashboard
                      High                                                  Oracle                               • Ad-Hoc Query
                      Density
                      Data                                                 Database
                                                                                                Oracle BI
                                                                                                Enterprise
                                                                                                 Edition




             Acquire                                    Organize                      Analyze           Decide

8   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Step 1: Deep Analysis of Current Data


                                                                                                                   • Dashboard
                      High                                                  Oracle                                 • Ad-Hoc Query
                      Density
                      Data                                                 Database
                                                                                                  Oracle BI        • Churn
                                                                                                  Enterprise       • Locality
                                                                                                   Edition
                                                                                   Spatial
                                                                                  and Graph
                                                                                  Advanced
                                                                                  Analytics



             Acquire                                    Organize                        Analyze           Decide

9   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Step 2: Architect for Volume and Variety


                                                                                                                    • Dashboard
                       High                                                  Oracle                                 • Ad-Hoc Query
                       Density                                              Database
                       Data
                                                                                                   Oracle BI        • Churn
                                                                                                   Enterprise       • Locality
 Low
 Density                                                                                            Edition
                                                                                    Spatial                         • Relationship
 variable
 Data                                                                              and Graph                        • Comments
                                            Hadoop
                                                                                   Advanced
                                                    Aggregate                      Analytics
                                                   Pre-Analyze



              Acquire                                    Organize                        Analyze           Decide

10   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Step 3: Architect for Velocity

                            High                                              Oracle
                           Density
                            Data                                             Database
                                                                                                                             • Dashboard
                                                                                                             Oracle BI       • Ad-Hoc Query
                                                Hadoop                                                       Enterprise
        Low                                                                                                   Edition
      Density                                                                     Spatial and                                • Churn
     Batch Data                                                                     Graph                                    • Locality
                                                   Aggregate
                                                                                   Advanced
                                                  Pre-Analyze
                                                                                   Analytics         Model                   • Relationship
                                                                                                                             • Comments
Streaming                                      Event                                                          Real Time
   Data                                      Processing                                                       Decisions
                                                                                                                             • Recommend
                                                                                                                             • Act
                                                                                            Act

               Acquire                                    Organize                         Analyze                  Decide

11    Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Step 4: Discover New Information
                                                                                                               Endeca Information Discovery

                              High                                              Oracle
                             Density
                              Data                                             Database
                                                                                                                                     • Dashboard
                                                                                                               Oracle BI             • Ad-Hoc Query
                                                  Hadoop                                                       Enterprise
          Low                                                                                                   Edition
        Density                                                                     Spatial and                                      • Churn
       Batch Data                                                                     Graph                                          • Locality
                                                     Aggregate
                                                                                     Advanced
                                                    Pre-Analyze
                                                                                     Analytics         Model                          • Relationship
                                                                                                                                      • Comments
Streaming                                        Event                                                          Real Time
   Data                                        Processing                                                       Decisions
                                                                                                                                      • Recommend
                                                                                                                                      • Act
                                                                                              Act

                                                            Organize                         Analyze                  Decide          • Discover
                 Acquire

  12    Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Oracle Engineered Systems

         Simplify IT – Simplify Big Data                                                                              • Dashboard
                                                                                                                                       
                                                                                                                      • Ad-Hoc Query
                           Oracle
                          Big Data
                          Appliance
                                                                            Oracle
                                                                            Exadata                   Oracle
                                                                                                                      • Churn
                                                                                                                      • Locality       
                                                                                                                                       
                                                                                                     Exalytics
                                                                                                                      • Relationship
                                                                                                                      • Comments
                                                               InfiniBand               InfiniBand

                                                                                                                      • Recommend
                                                                                                                      • Act            
                                                                                                                      • Discover
                                                                                                                                       
              Acquire                                    Organize                     Analyze                Decide

13   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Building Big Data Solutions




14   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Building a Big Data Solution
         Customer Retention and Social Media

           Apply classic churn models to the Data Warehouse data
           Add Social Data (Twitter) and Relationships (Facebook)
           Analyze Social Data and Relationships
           Deploy New Retention Policy into the Data Stream




              Increase                                                      Business Value

15   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Predict Customer Churn


                                                                            Churn
Find at-risk customers

Predictive models

Widely used




16   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Oracle Advanced Analytics
           Oracle Data Mining



12 Algorithms                                                                             Build
                                                                            Usage
Extreme performance                                                          Data        Deploy
                                                                                                     Customer A: 0.49
                                                                                                     Customer B: 0.25
                                                                                          Score
GUI for Data Scientists



                                                                             Acquire   Organize   Analyze         Decide



17   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Understand Your Customers


                                                                            Churn   Social
Find interesting data sets                                                          Data

Process the data to
represent meaningful
actions

Uncover new relationships
                                                                                    New
                                                                                    Facts


18   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Oracle Big Data Appliance
         Big Data Acquisition and Organization


                                                                             Twitter
                                                                              Data
Pre-integrated cluster                                                                        Collect
                                                                                                          Customer A:
                                                                            Facebook                      Customer B:
Sun Oracle hardware                                                                          Sessionize
                                                                              Data
Cloudera CDH                                                                                 Aggregate

Massive scale                                                                Internal
                                                                            Log Data

                                                                                   Acquire     Organize



19   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Oracle Big Data Connectors



                                                                                                     Customer A:
High performance                                                            Customer A:              Customer B:
                                                                            Customer B:
Secure
                                                                                                       Cust A: 0.49
Efficient                                                                                              Cust B: 0.25




                                                                            Acquire       Organize



20   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Oracle Advanced Analytics
         Oracle R Enterprise




Open source compatible                                                                                          Model
                                                                              Customer A:                                        D    0.10
                                                                              Customer B:                         0.25
Scales to huge data sets
                                                                                                 R                         B
                                                                                                                                     0.79
Extreme performance                                                                                      0.49
                                                                                Cust A: 0.49                      A              C
                                                                                Cust B: 0.25
Widely used


                                                                            Organize           Analyze                  Decide



21   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Real-Time Retention Decisions


                                                                            Churn    Social
                                                                                     Data
React to real-time events

Influence key customers

Adjust in real-time
                                                                            New      New
                                                                            Policy   Facts


22   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Oracle RTD and Oracle NoSQL Database


                                                                                                         Enrich
                                                                                                                        Decisions


Self learning                                                                       Tweet           Events                     Model       D
                                                                                                                                       B
Fast profile lookups
                                                                                                                               A           C
Integrated                                                                                Instant
                                                                                       Communication
                                                                            Tweet           Offer               Ideas


                                                                                                             Analyze            Decide



23   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Oracle Big Data Appliance




24   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Oracle Big Data Appliance


Get up and Running
Quickly

Improve Performance of
Hadoop

Integrated with Exadata

Lower TCO for Big Data




25   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Price comparison

Oracle Big Data Appliance                                       “Build-Your-Own” – HP hardware and Cloudera
                Year 1     Year 2    Year 3      Total                            Year 1       Year 2     Year 3    Total


                                                                 Servers and
 BDA Cost       $450,000                                                           $428,220
                                                                 switches


 Support
                 $54,000   $54,000     $54,000                   Support Cost      $136,233     $72,000   $72,000
 Cost

 On-site                                                         Installation &
 Installation    $14,150                                         configuration
                                                                 not included

 Total          $518,150   $54,000     $54,000    $626,150       Total             $564,453     $72,000   $72,000    $708,453


Full details at https://blogs.oracle.com/datawarehousing/entry/price_comparison_for_big_data
Big Data Appliance performance comparisons
     6x faster than custom 20-node Hadoop                                   2.5x faster than 30-node Hadoop cluster
     cluster for large batch transformation jobs                            for tagging and parsing text documents



                      10                                                                      10




                                                                               Time (hours)
       Time (hours)




                      5                                                                        5




                      0                                                                        0
                              Big Data                        DIY Hadoop                           Big Data    Cloud-based
                              Appliance                         Cluster                            Appliance     Hadoop


27   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
28   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
29   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

More Related Content

Similar to 2012 09 Oracle bigdata_architecture

BI Forum 2012 - Integrované systémy
BI Forum 2012 - Integrované systémyBI Forum 2012 - Integrované systémy
BI Forum 2012 - Integrované systémyOKsystem
 
Admonsters OPS Mobile Keynote Presentation
Admonsters OPS Mobile Keynote PresentationAdmonsters OPS Mobile Keynote Presentation
Admonsters OPS Mobile Keynote Presentation
Paul Gelb
 
DataSift Update - May 3rd 2011 - Devnest
DataSift Update - May 3rd 2011 - DevnestDataSift Update - May 3rd 2011 - Devnest
DataSift Update - May 3rd 2011 - Devnest
Ollie Parsley
 
GRS Market Research
GRS Market ResearchGRS Market Research
GRS Market Research
Munish Kumar
 
SOA and Cloud in Life Sciences
SOA and Cloud in Life SciencesSOA and Cloud in Life Sciences
SOA and Cloud in Life Sciences
Sandeep Bhat
 
Twitter and Mediasift Partnership
Twitter and Mediasift PartnershipTwitter and Mediasift Partnership
Twitter and Mediasift Partnership
Nick Halstead
 
Cloudera Sessions - Cloudera Keynote: A Blueprint for Data Management
Cloudera Sessions - Cloudera Keynote: A Blueprint for Data ManagementCloudera Sessions - Cloudera Keynote: A Blueprint for Data Management
Cloudera Sessions - Cloudera Keynote: A Blueprint for Data Management
Cloudera, Inc.
 
SAS Customer Analytics for Insurance
SAS Customer Analytics for InsuranceSAS Customer Analytics for Insurance
SAS Customer Analytics for Insurance
stuartdrose
 
Big dataforcf os1_23_12_final
Big dataforcf os1_23_12_finalBig dataforcf os1_23_12_final
Big dataforcf os1_23_12_finalBurrPilgerMayer
 
IASA 2010 - Enhancing the Agent Experience
IASA 2010 - Enhancing the Agent ExperienceIASA 2010 - Enhancing the Agent Experience
IASA 2010 - Enhancing the Agent Experience
Security MicroImaging
 
EDF2013: Selected Talk: Bryan Drexler: The 80/20 Rule and Big Data
EDF2013: Selected Talk: Bryan Drexler: The 80/20 Rule and Big Data EDF2013: Selected Talk: Bryan Drexler: The 80/20 Rule and Big Data
EDF2013: Selected Talk: Bryan Drexler: The 80/20 Rule and Big Data
European Data Forum
 
Financial Services Data - Use It or Lose It
Financial Services Data - Use It or Lose ItFinancial Services Data - Use It or Lose It
Financial Services Data - Use It or Lose It
John Avery
 
Asian Bankers Association, Manila Conference
Asian Bankers Association, Manila ConferenceAsian Bankers Association, Manila Conference
Asian Bankers Association, Manila ConferenceDeepak Ramanathan
 
Eureka Facts Capabilities Overview
Eureka Facts Capabilities OverviewEureka Facts Capabilities Overview
Eureka Facts Capabilities Overview
EurekaFacts
 
Kantar health china credential deck 20110621
Kantar health china credential deck 20110621Kantar health china credential deck 20110621
Kantar health china credential deck 20110621
simonlxg
 
Commerical Advantage Services Brochure
Commerical Advantage Services BrochureCommerical Advantage Services Brochure
Commerical Advantage Services BrochureAlexHewitt
 
Annik research analytics deck pvd
Annik research analytics deck   pvdAnnik research analytics deck   pvd
Annik research analytics deck pvdAtul Sharma
 
Future of Analytics is here
Future of Analytics is hereFuture of Analytics is here
Future of Analytics is here
SAS Institute India Pvt. Ltd
 
Big data meets big analytics
Big data meets big analyticsBig data meets big analytics
Big data meets big analytics
Deepak Ramanathan
 

Similar to 2012 09 Oracle bigdata_architecture (20)

BI Forum 2012 - Integrované systémy
BI Forum 2012 - Integrované systémyBI Forum 2012 - Integrované systémy
BI Forum 2012 - Integrované systémy
 
Admonsters OPS Mobile Keynote Presentation
Admonsters OPS Mobile Keynote PresentationAdmonsters OPS Mobile Keynote Presentation
Admonsters OPS Mobile Keynote Presentation
 
DataSift Update - May 3rd 2011 - Devnest
DataSift Update - May 3rd 2011 - DevnestDataSift Update - May 3rd 2011 - Devnest
DataSift Update - May 3rd 2011 - Devnest
 
GRS Market Research
GRS Market ResearchGRS Market Research
GRS Market Research
 
SOA and Cloud in Life Sciences
SOA and Cloud in Life SciencesSOA and Cloud in Life Sciences
SOA and Cloud in Life Sciences
 
Twitter and Mediasift Partnership
Twitter and Mediasift PartnershipTwitter and Mediasift Partnership
Twitter and Mediasift Partnership
 
Cloudera Sessions - Cloudera Keynote: A Blueprint for Data Management
Cloudera Sessions - Cloudera Keynote: A Blueprint for Data ManagementCloudera Sessions - Cloudera Keynote: A Blueprint for Data Management
Cloudera Sessions - Cloudera Keynote: A Blueprint for Data Management
 
SAS Customer Analytics for Insurance
SAS Customer Analytics for InsuranceSAS Customer Analytics for Insurance
SAS Customer Analytics for Insurance
 
Big dataforcf os1_23_12_final
Big dataforcf os1_23_12_finalBig dataforcf os1_23_12_final
Big dataforcf os1_23_12_final
 
IASA 2010 - Enhancing the Agent Experience
IASA 2010 - Enhancing the Agent ExperienceIASA 2010 - Enhancing the Agent Experience
IASA 2010 - Enhancing the Agent Experience
 
EDF2013: Selected Talk: Bryan Drexler: The 80/20 Rule and Big Data
EDF2013: Selected Talk: Bryan Drexler: The 80/20 Rule and Big Data EDF2013: Selected Talk: Bryan Drexler: The 80/20 Rule and Big Data
EDF2013: Selected Talk: Bryan Drexler: The 80/20 Rule and Big Data
 
Financial Services Data - Use It or Lose It
Financial Services Data - Use It or Lose ItFinancial Services Data - Use It or Lose It
Financial Services Data - Use It or Lose It
 
Asian Bankers Association, Manila Conference
Asian Bankers Association, Manila ConferenceAsian Bankers Association, Manila Conference
Asian Bankers Association, Manila Conference
 
Eureka Facts Capabilities Overview
Eureka Facts Capabilities OverviewEureka Facts Capabilities Overview
Eureka Facts Capabilities Overview
 
Kantar health china credential deck 20110621
Kantar health china credential deck 20110621Kantar health china credential deck 20110621
Kantar health china credential deck 20110621
 
Hacking Trust
Hacking TrustHacking Trust
Hacking Trust
 
Commerical Advantage Services Brochure
Commerical Advantage Services BrochureCommerical Advantage Services Brochure
Commerical Advantage Services Brochure
 
Annik research analytics deck pvd
Annik research analytics deck   pvdAnnik research analytics deck   pvd
Annik research analytics deck pvd
 
Future of Analytics is here
Future of Analytics is hereFuture of Analytics is here
Future of Analytics is here
 
Big data meets big analytics
Big data meets big analyticsBig data meets big analytics
Big data meets big analytics
 

More from jdijcks

Oracle Big Data Appliance and Big Data SQL for advanced analytics
Oracle Big Data Appliance and Big Data SQL for advanced analyticsOracle Big Data Appliance and Big Data SQL for advanced analytics
Oracle Big Data Appliance and Big Data SQL for advanced analytics
jdijcks
 
Oracle Openworld Presentation with Paul Kent (SAS) on Big Data Appliance and ...
Oracle Openworld Presentation with Paul Kent (SAS) on Big Data Appliance and ...Oracle Openworld Presentation with Paul Kent (SAS) on Big Data Appliance and ...
Oracle Openworld Presentation with Paul Kent (SAS) on Big Data Appliance and ...
jdijcks
 
Expand a Data warehouse with Hadoop and Big Data
Expand a Data warehouse with Hadoop and Big DataExpand a Data warehouse with Hadoop and Big Data
Expand a Data warehouse with Hadoop and Big Data
jdijcks
 
2013 05 Oracle big_dataapplianceoverview
2013 05 Oracle big_dataapplianceoverview2013 05 Oracle big_dataapplianceoverview
2013 05 Oracle big_dataapplianceoverview
jdijcks
 
2012 10 bigdata_overview
2012 10 bigdata_overview2012 10 bigdata_overview
2012 10 bigdata_overviewjdijcks
 
Big dataappliance hadoopworld_final
Big dataappliance hadoopworld_finalBig dataappliance hadoopworld_final
Big dataappliance hadoopworld_final
jdijcks
 

More from jdijcks (6)

Oracle Big Data Appliance and Big Data SQL for advanced analytics
Oracle Big Data Appliance and Big Data SQL for advanced analyticsOracle Big Data Appliance and Big Data SQL for advanced analytics
Oracle Big Data Appliance and Big Data SQL for advanced analytics
 
Oracle Openworld Presentation with Paul Kent (SAS) on Big Data Appliance and ...
Oracle Openworld Presentation with Paul Kent (SAS) on Big Data Appliance and ...Oracle Openworld Presentation with Paul Kent (SAS) on Big Data Appliance and ...
Oracle Openworld Presentation with Paul Kent (SAS) on Big Data Appliance and ...
 
Expand a Data warehouse with Hadoop and Big Data
Expand a Data warehouse with Hadoop and Big DataExpand a Data warehouse with Hadoop and Big Data
Expand a Data warehouse with Hadoop and Big Data
 
2013 05 Oracle big_dataapplianceoverview
2013 05 Oracle big_dataapplianceoverview2013 05 Oracle big_dataapplianceoverview
2013 05 Oracle big_dataapplianceoverview
 
2012 10 bigdata_overview
2012 10 bigdata_overview2012 10 bigdata_overview
2012 10 bigdata_overview
 
Big dataappliance hadoopworld_final
Big dataappliance hadoopworld_finalBig dataappliance hadoopworld_final
Big dataappliance hadoopworld_final
 

Recently uploaded

De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
Product School
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
Product School
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Jeffrey Haguewood
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Product School
 
Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
Dorra BARTAGUIZ
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
DianaGray10
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
Product School
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
Product School
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Tobias Schneck
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Product School
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
OnBoard
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
Elena Simperl
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
Jemma Hussein Allen
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
Alison B. Lowndes
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 

Recently uploaded (20)

De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 

2012 09 Oracle bigdata_architecture

  • 1. Big Data in the Data Center Jean-Pierre Dijcks Big Data Product Mangement 1 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 2. Agenda  Architecting Big Data  Building Big Data Solutions  Oracle Big Data Appliance 2 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 3. Architecting Big Data 3 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 4. What Does a Big Data World Look Like? Truck / Motor Manufacturer What they collect Monitors the complete car Miles Per Gallon, Driving techniques Location information How they use it Better tailored servicing plans Better targeted marketing Offer better finance deals or related options More data for R&D Sell on to partners Big Data means… The ability to predict when components might fail Create better service plans based on actual usage Drivers can post their data to manufacturers website Black box data can help with accidents 4 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 5. What Does a Big Data World Look Like? Retailer / White Goods What they collect Food monitoring by RFID tags – Fridge monitors food usage and sell- by dates How they use it Automated food ordering Better targeted marketing due to better data about how/when customer uses products Big Data means… More detailed information about customers Better store based demand planning 5 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 6. Sample of Big Data Use Cases Today AUTOMOTIVE Auto sensors What is the main difference in this data? COMMUNICATIONS Location-based Retail / CPG Sentiment analysis FINANCIAL SERVICES EDUCATION & RESEARCH reporting advertising Hot products Risk & portfolio analysis Experiment location, New products sensor analysis Optimized Marketing problems HIGH TECHNOLOGY / Volume, Velocity, Variety LIFE MEDIA/ ON-LINE SERVICES / HEALTH CARE INDUSTRIAL MFG. SCIENCES ENTERTAINMENT SOCIAL Patient sensors, Mfg quality Clinical trials Viewers / advertising MEDIA monitoring, EHRs Warranty analysis Genomics effectiveness People & career Quality of care Cross Sell matching Web-site optimization OIL & GAS These Characteristics Challenge your Games TRAVEL & TRANSPORTATION UTILITIES LAW ENFORCEMENT Drilling Adjust to exploration sensor analysis player behavior Existing Architecture Meter Sensor analysis for optimal traffic flows Smart analysis for & DEFENSE Threat analysis - network social media In-Game Ads Customer sentiment capacity, monitoring, photo analysis 6 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 7. Building your big data architecture Gradually Extending your Existing Architecture for Big Data:  Step 1: Further Analyze Current Data  Step 2: Architect for Data Variety and Volume  Step 3: Architect for Data Velocity  Step 4: Discover New Patterns Increase Business Value 7 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 8. Step 0: Data Warehouse Foundation • Dashboard High Oracle • Ad-Hoc Query Density Data Database Oracle BI Enterprise Edition Acquire Organize Analyze Decide 8 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 9. Step 1: Deep Analysis of Current Data • Dashboard High Oracle • Ad-Hoc Query Density Data Database Oracle BI • Churn Enterprise • Locality Edition Spatial and Graph Advanced Analytics Acquire Organize Analyze Decide 9 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 10. Step 2: Architect for Volume and Variety • Dashboard High Oracle • Ad-Hoc Query Density Database Data Oracle BI • Churn Enterprise • Locality Low Density Edition Spatial • Relationship variable Data and Graph • Comments Hadoop Advanced Aggregate Analytics Pre-Analyze Acquire Organize Analyze Decide 10 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 11. Step 3: Architect for Velocity High Oracle Density Data Database • Dashboard Oracle BI • Ad-Hoc Query Hadoop Enterprise Low Edition Density Spatial and • Churn Batch Data Graph • Locality Aggregate Advanced Pre-Analyze Analytics Model • Relationship • Comments Streaming Event Real Time Data Processing Decisions • Recommend • Act Act Acquire Organize Analyze Decide 11 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 12. Step 4: Discover New Information Endeca Information Discovery High Oracle Density Data Database • Dashboard Oracle BI • Ad-Hoc Query Hadoop Enterprise Low Edition Density Spatial and • Churn Batch Data Graph • Locality Aggregate Advanced Pre-Analyze Analytics Model • Relationship • Comments Streaming Event Real Time Data Processing Decisions • Recommend • Act Act Organize Analyze Decide • Discover Acquire 12 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 13. Oracle Engineered Systems Simplify IT – Simplify Big Data • Dashboard  • Ad-Hoc Query Oracle Big Data Appliance Oracle Exadata Oracle • Churn • Locality   Exalytics • Relationship • Comments InfiniBand InfiniBand • Recommend • Act  • Discover  Acquire Organize Analyze Decide 13 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 14. Building Big Data Solutions 14 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 15. Building a Big Data Solution Customer Retention and Social Media  Apply classic churn models to the Data Warehouse data  Add Social Data (Twitter) and Relationships (Facebook)  Analyze Social Data and Relationships  Deploy New Retention Policy into the Data Stream Increase Business Value 15 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 16. Predict Customer Churn Churn Find at-risk customers Predictive models Widely used 16 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 17. Oracle Advanced Analytics Oracle Data Mining 12 Algorithms Build Usage Extreme performance Data Deploy Customer A: 0.49 Customer B: 0.25 Score GUI for Data Scientists Acquire Organize Analyze Decide 17 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 18. Understand Your Customers Churn Social Find interesting data sets Data Process the data to represent meaningful actions Uncover new relationships New Facts 18 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 19. Oracle Big Data Appliance Big Data Acquisition and Organization Twitter Data Pre-integrated cluster Collect Customer A: Facebook Customer B: Sun Oracle hardware Sessionize Data Cloudera CDH Aggregate Massive scale Internal Log Data Acquire Organize 19 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 20. Oracle Big Data Connectors Customer A: High performance Customer A: Customer B: Customer B: Secure Cust A: 0.49 Efficient Cust B: 0.25 Acquire Organize 20 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 21. Oracle Advanced Analytics Oracle R Enterprise Open source compatible Model Customer A: D 0.10 Customer B: 0.25 Scales to huge data sets R B 0.79 Extreme performance 0.49 Cust A: 0.49 A C Cust B: 0.25 Widely used Organize Analyze Decide 21 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 22. Real-Time Retention Decisions Churn Social Data React to real-time events Influence key customers Adjust in real-time New New Policy Facts 22 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 23. Oracle RTD and Oracle NoSQL Database Enrich Decisions Self learning Tweet Events Model D B Fast profile lookups A C Integrated Instant Communication Tweet Offer Ideas Analyze Decide 23 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 24. Oracle Big Data Appliance 24 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 25. Oracle Big Data Appliance Get up and Running Quickly Improve Performance of Hadoop Integrated with Exadata Lower TCO for Big Data 25 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 26. Price comparison Oracle Big Data Appliance “Build-Your-Own” – HP hardware and Cloudera Year 1 Year 2 Year 3 Total Year 1 Year 2 Year 3 Total Servers and BDA Cost $450,000 $428,220 switches Support $54,000 $54,000 $54,000 Support Cost $136,233 $72,000 $72,000 Cost On-site Installation & Installation $14,150 configuration not included Total $518,150 $54,000 $54,000 $626,150 Total $564,453 $72,000 $72,000 $708,453 Full details at https://blogs.oracle.com/datawarehousing/entry/price_comparison_for_big_data
  • 27. Big Data Appliance performance comparisons 6x faster than custom 20-node Hadoop 2.5x faster than 30-node Hadoop cluster cluster for large batch transformation jobs for tagging and parsing text documents 10 10 Time (hours) Time (hours) 5 5 0 0 Big Data DIY Hadoop Big Data Cloud-based Appliance Cluster Appliance Hadoop 27 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 28. 28 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 29. 29 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

Editor's Notes

  1. Who are my most valuable customers?What is last Months Revenue?
  2. Where are my most valuable customers located?Who is most likely to churn in the next month?
  3. What opinions do people have?Why do people buy these products?
  4. How do I influence buying decisions?How do I prevent serious issues from happening?
  5. How do I influence buying decisions?How do I prevent serious issues from happening?
  6. How do I influence buying decisions?How do I prevent serious issues from happening?