Copyright © 2013, Oracle and/or its affiliates. All rights reserved.1
Fast Data:
From zero to insight
with Real Time Big Data
Bryan Ko, Senior Sales Consultant
Data Integration Solution
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.2
Is your Business Running Fast Enough?
Opportunity Lies in the Timeliness of Accurate Analysis and Action
 Large and growing data volumes
 Data loses value at a faster rate
 Customer touch-points are increasing
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.3
93%
believe their organization is losing
revenue as a result of not being
able to fully leverage information
67%89%
executives who say
drawing intelligence
from data is top priority
executives who would
grade themselves C or
lower in preparedness
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.3
Source: Oracle Research Study - From Overload to Impact: An Industry Scorecard on Big Data Business Challenges, July 2012
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.4
of executives say
too much critical
information is
delivered too late
Source: Aberdeen Group – January 2012, survey of 247 executives - Data Management for BI – Big Data, Bigger Insight, Superior Performance
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.5
Velocity Demand Fueled by M2M Growth
The New Reality of the Internet of Things
 Data from things is growing 22X
over 5 years from 2011-2016
 Devices are becoming more intelligent
 Devices are becoming more connected
Source: CISCO VNI Mobile 2012
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.6
Driving More Value from All of Your Data
What about Big Data?
 High velocity data brings high value
 Especially to volatile business processes
 Are big data solutions centered on
Hadoop or NoSQL fast enough?
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.7
What is Fast Data?
Turning High Velocity Data into Value
 It’s about getting more from in-flight data
 It’s about faster action, faster insights
 It’s about visibility and predictability
 It’s about running your business in real-time
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.8
Higher Quality
In Operations
Improved
Efficiency
Key Value Drivers of Timely, Accurate Action
Delivering Tangible Results with Fast Data
New
Services
Better Customer
Experience
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.9
Transportation &
Logistics
TelecommunicationsFinancial Services
Manufacturing &
Retail
Utilities & Oil and Gas
Public Sector &
Healthcare
Fast Data is Universal Across Industries
Healthcare
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.10
Obstacles to Faster Data
While Ensuring Accuracy, Efficiency, and Scale
Business event
Action Time
BusinessValue
Data captured
Analysis completed
Action taken
Source: Richard Hackethorn’s Component’s of Action Time
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.11
What Slows You Down?
3 Components of Event-to-Action Latency
Data
latency
Analysis
latency
Decision latency
Based on Richard Hackethorn’s Component’s of Action Time
Business event
Action Time
BusinessValue
Data captured
Analysis completed
• Data Latency
• Analysis Latency
• Decision Latency
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.12
Oracle Event Processing
Oracle Coherence
Oracle Fast Data
Filter, Move, Transform, Analyze, and Act at High Velocity
Oracle Business Analytics
ANALYZE
Oracle Real-Time Decisions
Oracle BPM
ACT
Oracle GoldenGate
Oracle Data Integrator
MOVE &
TRANSFORM
FILTER &
CORRELATE
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.13
Filter and Correlate
Complete In-Flight Event and Data Processing
 A complete solution for building applications to filter, correlate,
and process events in real time
 Ensure downstream applications are driven by true, real-time
intelligence
 Help eliminate, consolidate, correlate, and filter data before it
clutters your data warehouse
 Analyze massive data streams in real-time
Oracle Event Processing
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.14
Filter and Correlate, In-memory
Enrich Data for More Accurate Decisions
 Integrated with Oracle Event Processing
 Rely on the most powerful in-memory storage technology
 Speed performance with in-memory data lookups and queries
 Enrich data input with scaled caching
 Trust your results are accurate in real-time
Oracle Coherence
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.15
Managing Fast Data on Devices
 Embed Fast Data into smart devices and gateways
 Process data in real-time on the device
 Only deliver relevant information to data center
thereby minimizing data congestion
 Streamline Fast data across entire M2M value chain -
from device to data center
Streamline Fast Data Processing
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.16
Move and Transform
Real-Time Data Capture and Big Data Transformations
 Capture changed data and events in real time
 Apply basic filtering and transformation at capture point
 Transform and load structured or unstructured data for
analysis
 Improve the trusted quality of information
Oracle Data Integration
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.17
EMP
Oracle Real Time Data Integration
Oracle’s Unique Offering for Real Time Business Intelligence
Oracle
GoldenGate
Oracle Data
Integrator
EMP DEPT
DIM
FACT
DIM
DIMDIM
ODS Schema DW Schema
On-Disk Logs
Source 1
On-Disk Logs
Source 2
Oracle
GoldenGate
Oracle GoldenGate
• Real time extracts from
transactional systems
• Continuous streaming load
into ODS Schema of target
Oracle Data Integrator EE
• High Performance ‘E-LT’ on
target data warehouse
EMP DEPT
DEPT
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.18
Oracle Data Integration for Big Data
Improving Productivity and Efficiency for Big Data
Benefits
• Improves productivity for
transforming Big Data
• Optimizes the loading of Big Data
with Oracle Loader for Hadoop
• Reduce complexities of processing
Hadoop through graphical tooling
• Consistent tooling across BI/DW,
SOA, Integration and Big Data
Transforms
Via MapReduce
Oracle Data
Integrator
Oracle Exadata
Oracle Loader for
Hadoop
Loads
Activates
HiveQL
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.19
Analyze
Drive Better Business Outcomes with Real-Time Information
 In-memory analytics to provide actionable insight from large
amounts of data - fast.
 Trust your data model is current and accurate
 Quickly organize and explore diverse and unstructured Big
data from inside and outside your organization
 Predict outcomes based on real-time information
Oracle Business Analytics
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.20
Act
Real-Time Automated Decision Making, Predictive Analytics
 Predict outcomes based on real-time information
 Deliver real-time decisions and recommendations to
customers and front-line employees
 Automatically render decisions within a business process to
create tailored messaging
 Integrate with human workflow, process management, activity
monitoring
Oracle Real-time Decisions and Oracle BPM
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.21
 Optimized loads, Infiniband, Smart Storage
 No data transfer to/from separate servers
 Transformations use Exadata optimized SQL
 Native batch and Real-time integration capability
 Bridge your enterprise data to Big Data Appliance
 Faster refreshes of data analysis with Exalytics
 Tightly integrated with Exadata, Exalytics, Exalogic
Fast Data Even Faster on Engineered Systems
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.22
CONCLUSION
REMOVE EVENT-TO-ACTION LATENCY
PARTNER WITH ORACLE FOR FAST DATA
MAXIMIZE VALUE FROM HIGH-VELOCITY DATA
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.23
Where to Get More Information?
Oracle’s Fast Data Solutions
EXTERNAL: www.oracle.com/fastdata
#OracleFastData

8 from zero to insight with real time big data

  • 1.
    Copyright © 2013,Oracle and/or its affiliates. All rights reserved.1 Fast Data: From zero to insight with Real Time Big Data Bryan Ko, Senior Sales Consultant Data Integration Solution
  • 2.
    Copyright © 2013,Oracle and/or its affiliates. All rights reserved.2 Is your Business Running Fast Enough? Opportunity Lies in the Timeliness of Accurate Analysis and Action  Large and growing data volumes  Data loses value at a faster rate  Customer touch-points are increasing
  • 3.
    Copyright © 2013,Oracle and/or its affiliates. All rights reserved.3 93% believe their organization is losing revenue as a result of not being able to fully leverage information 67%89% executives who say drawing intelligence from data is top priority executives who would grade themselves C or lower in preparedness Copyright © 2012, Oracle and/or its affiliates. All rights reserved.3 Source: Oracle Research Study - From Overload to Impact: An Industry Scorecard on Big Data Business Challenges, July 2012
  • 4.
    Copyright © 2013,Oracle and/or its affiliates. All rights reserved.4 of executives say too much critical information is delivered too late Source: Aberdeen Group – January 2012, survey of 247 executives - Data Management for BI – Big Data, Bigger Insight, Superior Performance
  • 5.
    Copyright © 2013,Oracle and/or its affiliates. All rights reserved.5 Velocity Demand Fueled by M2M Growth The New Reality of the Internet of Things  Data from things is growing 22X over 5 years from 2011-2016  Devices are becoming more intelligent  Devices are becoming more connected Source: CISCO VNI Mobile 2012
  • 6.
    Copyright © 2013,Oracle and/or its affiliates. All rights reserved.6 Driving More Value from All of Your Data What about Big Data?  High velocity data brings high value  Especially to volatile business processes  Are big data solutions centered on Hadoop or NoSQL fast enough?
  • 7.
    Copyright © 2013,Oracle and/or its affiliates. All rights reserved.7 What is Fast Data? Turning High Velocity Data into Value  It’s about getting more from in-flight data  It’s about faster action, faster insights  It’s about visibility and predictability  It’s about running your business in real-time
  • 8.
    Copyright © 2013,Oracle and/or its affiliates. All rights reserved.8 Higher Quality In Operations Improved Efficiency Key Value Drivers of Timely, Accurate Action Delivering Tangible Results with Fast Data New Services Better Customer Experience
  • 9.
    Copyright © 2013,Oracle and/or its affiliates. All rights reserved.9 Transportation & Logistics TelecommunicationsFinancial Services Manufacturing & Retail Utilities & Oil and Gas Public Sector & Healthcare Fast Data is Universal Across Industries Healthcare
  • 10.
    Copyright © 2013,Oracle and/or its affiliates. All rights reserved.10 Obstacles to Faster Data While Ensuring Accuracy, Efficiency, and Scale Business event Action Time BusinessValue Data captured Analysis completed Action taken Source: Richard Hackethorn’s Component’s of Action Time
  • 11.
    Copyright © 2013,Oracle and/or its affiliates. All rights reserved.11 What Slows You Down? 3 Components of Event-to-Action Latency Data latency Analysis latency Decision latency Based on Richard Hackethorn’s Component’s of Action Time Business event Action Time BusinessValue Data captured Analysis completed • Data Latency • Analysis Latency • Decision Latency
  • 12.
    Copyright © 2013,Oracle and/or its affiliates. All rights reserved.12 Oracle Event Processing Oracle Coherence Oracle Fast Data Filter, Move, Transform, Analyze, and Act at High Velocity Oracle Business Analytics ANALYZE Oracle Real-Time Decisions Oracle BPM ACT Oracle GoldenGate Oracle Data Integrator MOVE & TRANSFORM FILTER & CORRELATE
  • 13.
    Copyright © 2013,Oracle and/or its affiliates. All rights reserved.13 Filter and Correlate Complete In-Flight Event and Data Processing  A complete solution for building applications to filter, correlate, and process events in real time  Ensure downstream applications are driven by true, real-time intelligence  Help eliminate, consolidate, correlate, and filter data before it clutters your data warehouse  Analyze massive data streams in real-time Oracle Event Processing
  • 14.
    Copyright © 2013,Oracle and/or its affiliates. All rights reserved.14 Filter and Correlate, In-memory Enrich Data for More Accurate Decisions  Integrated with Oracle Event Processing  Rely on the most powerful in-memory storage technology  Speed performance with in-memory data lookups and queries  Enrich data input with scaled caching  Trust your results are accurate in real-time Oracle Coherence
  • 15.
    Copyright © 2013,Oracle and/or its affiliates. All rights reserved.15 Managing Fast Data on Devices  Embed Fast Data into smart devices and gateways  Process data in real-time on the device  Only deliver relevant information to data center thereby minimizing data congestion  Streamline Fast data across entire M2M value chain - from device to data center Streamline Fast Data Processing
  • 16.
    Copyright © 2013,Oracle and/or its affiliates. All rights reserved.16 Move and Transform Real-Time Data Capture and Big Data Transformations  Capture changed data and events in real time  Apply basic filtering and transformation at capture point  Transform and load structured or unstructured data for analysis  Improve the trusted quality of information Oracle Data Integration
  • 17.
    Copyright © 2013,Oracle and/or its affiliates. All rights reserved.17 EMP Oracle Real Time Data Integration Oracle’s Unique Offering for Real Time Business Intelligence Oracle GoldenGate Oracle Data Integrator EMP DEPT DIM FACT DIM DIMDIM ODS Schema DW Schema On-Disk Logs Source 1 On-Disk Logs Source 2 Oracle GoldenGate Oracle GoldenGate • Real time extracts from transactional systems • Continuous streaming load into ODS Schema of target Oracle Data Integrator EE • High Performance ‘E-LT’ on target data warehouse EMP DEPT DEPT
  • 18.
    Copyright © 2013,Oracle and/or its affiliates. All rights reserved.18 Oracle Data Integration for Big Data Improving Productivity and Efficiency for Big Data Benefits • Improves productivity for transforming Big Data • Optimizes the loading of Big Data with Oracle Loader for Hadoop • Reduce complexities of processing Hadoop through graphical tooling • Consistent tooling across BI/DW, SOA, Integration and Big Data Transforms Via MapReduce Oracle Data Integrator Oracle Exadata Oracle Loader for Hadoop Loads Activates HiveQL
  • 19.
    Copyright © 2013,Oracle and/or its affiliates. All rights reserved.19 Analyze Drive Better Business Outcomes with Real-Time Information  In-memory analytics to provide actionable insight from large amounts of data - fast.  Trust your data model is current and accurate  Quickly organize and explore diverse and unstructured Big data from inside and outside your organization  Predict outcomes based on real-time information Oracle Business Analytics
  • 20.
    Copyright © 2013,Oracle and/or its affiliates. All rights reserved.20 Act Real-Time Automated Decision Making, Predictive Analytics  Predict outcomes based on real-time information  Deliver real-time decisions and recommendations to customers and front-line employees  Automatically render decisions within a business process to create tailored messaging  Integrate with human workflow, process management, activity monitoring Oracle Real-time Decisions and Oracle BPM
  • 21.
    Copyright © 2013,Oracle and/or its affiliates. All rights reserved.21  Optimized loads, Infiniband, Smart Storage  No data transfer to/from separate servers  Transformations use Exadata optimized SQL  Native batch and Real-time integration capability  Bridge your enterprise data to Big Data Appliance  Faster refreshes of data analysis with Exalytics  Tightly integrated with Exadata, Exalytics, Exalogic Fast Data Even Faster on Engineered Systems
  • 22.
    Copyright © 2013,Oracle and/or its affiliates. All rights reserved.22 CONCLUSION REMOVE EVENT-TO-ACTION LATENCY PARTNER WITH ORACLE FOR FAST DATA MAXIMIZE VALUE FROM HIGH-VELOCITY DATA
  • 23.
    Copyright © 2013,Oracle and/or its affiliates. All rights reserved.23 Where to Get More Information? Oracle’s Fast Data Solutions EXTERNAL: www.oracle.com/fastdata #OracleFastData