The GoodThe Bad, andThe Big Data FOR A FEW TERABYTES MORE – THE GOOD, THE BAD and THE BIG DATA       Cenk Kiral       Seni...
Big Data Buzz                                “Are you ready for              “Big data: science’s“The promise of          ...
Big Data – a growing torrent                                                                    5 billion              Mob...
Why Is Big Data Important?US HEALTH CARE      MANUFACTURING       GLOBAL PERSONAL                        EUROPE PUBLIC    ...
It’s About the Devices….30 million sensors30% annual growth rate
What Does This Mean for Business  Insurance – Pay as you Drive   Remote Medical Monitoring                                ...
What Makes it Big Data?                                  SOCIAL                           BLOG                            ...
Defining Big Data With Three V’sThe GoodThe Bad, andThe Big Data
Defining Big Data With Three V’sThe GoodThe Bad, andThe Big Data
Growth in Enterprise Unstructured Data  Increase significantly                 33%         How will the  Increase moderate...
Value of Unstructured Data                                   Extremely       Somewhat                    important,       ...
Unstructured Data                                           85% of data acquired is unstructured                          ...
Defining Big Data Terminology
Big Data Use Cases  Today’s Challenge                  New Data                 What’s Possible      Healthcare           ...
Potential Uses of Big DataThe GoodThe Bad, andThe Big Data
Potential Uses of Big DataThe GoodThe Bad, andThe Big Data
Unstructured Data Usage Example⓵                                                  ⓵                                       ...
Right-time Data Warehousing                                      Stage 2                    Stage 3                       ...
Right-time Data Warehousing                                                          Pervasive Access                     ...
What is Your Big Data Strategy? DECIDE              ACQUIRE                                How will you                   ...
What is Your Big Data Strategy? DECIDE              ACQUIRE                                How will you                   ...
What is Your Big Data Strategy? DECIDE              ACQUIRE                                What skill sets                ...
What is Your Big Data Strategy? DECIDE              ACQUIRE                                How will you                   ...
Big Data in Action DECIDE               ACQUIRE                                 Make                                 Bette...
Oracle Big Data Appliance“If anyone doubted Oracles seriousness aboutcompeting in the big data arena, those doubtsshould b...
Oracle Engineered Systems       Big Data Appliance   Hardware:   • 216 CPU cores, 864 GB RAM, 648 TB disk   • 40 Gb/s Infi...
Making Decisions Based on Big Data ChallengeBig data has been     Want to add new     How do we quickly transformed into  ...
Dashboard Analytics•Oracle Business Intelligence Enterprise Edition ‒Advanced dashboard visualization ‒Runs BI and EPM app...
Oracle Exalytics HardwareEngineered for extreme analytics•40 Intel processor cores•1 Terabyte main memory•40 Gb InfiniBand...
Oracle Exalytics Software•Oracle TimesTen In-Memory Database ‒Adaptive in-memory caching of analytics ‒In-memory columnar ...
Oracle Endeca Information Discovery  A platform for provisioning data discovery applications across the enterprise        ...
Oracle Integrated Solution Stack for Big Data   HDFS            Hadoop                  (MapReduce)                       ...
Oracle Integrated Solution Stack       Engineered SystemsACQUIRE     ORGANIZE     ANALYZE   DECIDE
Oracle Big Data Connectors •Oracle Data Integrator Application Adapter for Hadoop •Oracle Loader for Hadoop •Oracle Direct...
Maximizing the Value of Enterprise Big Data•Hardware and software for Big Data•Integrates all enterprise data  –Structured...
The GoodThe Bad, andThe Big Data
Upcoming SlideShare
Loading in …5
×

For a few terabytes more - The Good, The Bad and The Big Data, Cenk Kiral, Oracle

1,271 views

Published on

Oracle Extreme Analytic Summit, 22.03.2012 r.

Published in: Technology
0 Comments
3 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,271
On SlideShare
0
From Embeds
0
Number of Embeds
5
Actions
Shares
0
Downloads
0
Comments
0
Likes
3
Embeds 0
No embeds

No notes for slide
  • Insurance – sensors in vehiclesMedical – new devices for remote monitoringRetail – foot path analysis with location awareness of in-store customersList goes on…..
  • For a few terabytes more - The Good, The Bad and The Big Data, Cenk Kiral, Oracle

    1. 1. The GoodThe Bad, andThe Big Data FOR A FEW TERABYTES MORE – THE GOOD, THE BAD and THE BIG DATA Cenk Kiral Senior Director of BI&EPM solutions – ECEMEA region
    2. 2. Big Data Buzz “Are you ready for “Big data: science’s“The promise of the era of big microscope of the big data” data?” 21st century”Intelligent Utility - 8/28/11 McKinsey Quarterly - 11/11 Business Week – 11/8/11“Big data, “Decisions, analytics get “Health care is next decisions…will even bigger, frontier for big big data have hotter in 2012” data” big impact?”InfoWorld – 12/30/11 Wall Street Journal – 1/19/12 Financial Times – 1/24/12
    3. 3. Big Data – a growing torrent 5 billion Mobile phones in use in 2010 Growth in global 40% 5% Projected growth in global data Generated per year vs. IT spending 30 billion Pieces of content shared On Facebook every month235 Terabytes data collected by the US 15 Library of Congress in April 2011 Sectors in the US have more data stored per company than the US Library of congress$600 To buy a disk drive that can store all of the world’s music out of 17The GoodThe Bad, and Source: McKinsey Global Institute 2011 MayThe Big Data
    4. 4. Why Is Big Data Important?US HEALTH CARE MANUFACTURING GLOBAL PERSONAL EUROPE PUBLIC US RETAIL LOCATION DATA SECTOR ADMINIncrease industry Decrease dev., Increase service Increase industry Increase netvalue per year by assembly costs by provider revenue by value per year by margin by$300 B –50% $100 B €250 B 60+% “In a big data world, a competitor that fails to sufficiently develop its capabilities will be left behind.” McKinsey Global Institute Source: * McKinsey Global Institute: Big Data – The next frontier for innovation, competition and productivity (May 2011)
    5. 5. It’s About the Devices….30 million sensors30% annual growth rate
    6. 6. What Does This Mean for Business Insurance – Pay as you Drive Remote Medical Monitoring Utilities – Smart gridLogistics – Smart Low Carbon Routing Nuclear Wind Solar farms Generation Traditional New Sensors / Distributed Computing on Transmission and Distribution Lines Generation alert operators, fix problems, integrate large-scale renewables generation Transmission Smart Transmission Substation Smart Transmission Substation & Distribution From other Grids Sens ors, Smar Smart Distribution Substation t switc hes Smart Distribution Substation Off-Shore Renewable energy H Energy Retail o m e A r e a N e t w Smart Meters and Home Networks help o customers use energy wisely, mitigate peak r demand, integrate local renewables k Smart Customers Electric Vehicles
    7. 7. What Makes it Big Data? SOCIAL BLOG 101100101001 001001101010 SMART 101011100101 METER 010100100101VOLUME VELOCITY VARIETY VALUE
    8. 8. Defining Big Data With Three V’sThe GoodThe Bad, andThe Big Data
    9. 9. Defining Big Data With Three V’sThe GoodThe Bad, andThe Big Data
    10. 10. Growth in Enterprise Unstructured Data Increase significantly 33% How will the Increase moderately 47% amount of No change 9% unstructured Decrease moderately 6% data change over next 3Decrease significantly 2% years? Dont know/unsure 4%Source: Unisphere Research, 2011
    11. 11. Value of Unstructured Data Extremely Somewhat important, important, 18% 30% Dont How important know unsure, 6 is unstructured % data to your Not Very important business? today, 8% important, 39%Source: Unisphere Research, 2011
    12. 12. Unstructured Data 85% of data acquired is unstructured • Field Service • Memos, letters, • Financial • News feeds notes notes, reports reports • Web sites • Tech Support • E-mail • Product • Transcripts memos • HTML sheets • Research data Structured Data • Call center documents • Exported narrative • PDF documents data • Customer comments Unstructured Data Actually, some of this data is structured (XML, ...) But it is not in table/column (relational) formatThe GoodThe Bad, andThe Big Data
    13. 13. Defining Big Data Terminology
    14. 14. Big Data Use Cases Today’s Challenge New Data What’s Possible Healthcare Preventive care, reduced Remote patient monitoring Expensive office visits hospitalization Manufacturing Product sensors Automated diagnosis, support In-person support Location-Based Services Geo-advertising, traffic, local Real time location data Based on home zip code search Public Sector Tailored services, Citizen surveys Standardized services cost reductions Retail Sentiment analysis Social mediaOne size fits all marketing segmentation
    15. 15. Potential Uses of Big DataThe GoodThe Bad, andThe Big Data
    16. 16. Potential Uses of Big DataThe GoodThe Bad, andThe Big Data
    17. 17. Unstructured Data Usage Example⓵ ⓵ ⓵ Customer calls in to Facts from Call Center notes and Extracted data is combined with existing complain memos are exhaustively customer data within the Warehouse My average extracted (customer history, profitability data, etc) fees are too EDW high! Fact Extraction I’m getting too many dropped calls! Customer feedback funnels into companies via email, web forms, feedback surveys and in call center ⓵ ⓵ notes ⓵ Precise event triggers are set to Combined data is analyzed to more Special offer sent to customer to initiate action to prevent churn accurately determined the eliminate possibility of defection of valuable customer propensity to churn, based on the nature of the complaint or EDW problem, which is viewed against the profitability of the customer Example demonstrates the usage of structured and unstructured data together (in near-real-time). Applies to all industries.
    18. 18. Right-time Data Warehousing Stage 2 Stage 3 Stage 4 Stage 1 Stage 5 Why did it What will happen What should I doWhat happened? Automation happen? next? right now? Provide assistance for The Right-time Data Standard reports lead to Warehouse is used to Standard reports Use of Analytics to tactical decisions made new questions automate and improve understand Cause/Effect in the field the daily business and Correlation activities via event notification services Begin testing Business Questions known in Many complex Ad Hoc models based on real advance queries data Begin formulation of Business automation is Business Models based continuously Limited use of Ad Hoc Explore on analytics and Early stages of Business monitored, tuned and queries interdependencies observations Automation enhanced Traditional Data Warehouse Right-time Data Warehouse Batch Ad Hoc Data Mining Operational BI Disintermediated Decisions
    19. 19. Right-time Data Warehousing Pervasive Access Alerts Just-in-Time Reports Right-time Data Historical Data Near real-time data loading Near real-time data loading Analytics More than 90% of Data Warehouses will have intra-day or better updates, and more than 50% will have continuous updates. (Gartner)The GoodThe Bad, andThe Big Data
    20. 20. What is Your Big Data Strategy? DECIDE ACQUIRE How will you acquire live streams of unstructured data?ANALYZE ORGANIZE
    21. 21. What is Your Big Data Strategy? DECIDE ACQUIRE How will you organize big data so it can be integrated into your data center?ANALYZE ORGANIZE
    22. 22. What is Your Big Data Strategy? DECIDE ACQUIRE What skill sets and tools will you use to analyze big data?ANALYZE ORGANIZE
    23. 23. What is Your Big Data Strategy? DECIDE ACQUIRE How will you share the analysis in real-time?ANALYZE ORGANIZE
    24. 24. Big Data in Action DECIDE ACQUIRE Make Better Decisions Using Big DataANALYZE ORGANIZE
    25. 25. Oracle Big Data Appliance“If anyone doubted Oracles seriousness aboutcompeting in the big data arena, those doubtsshould be removed by todays release of theOracle Big Data Appliance. The appliance ishitting the market sooner than many peopleexpected it would, and it includes key softwarefrom Cloudera…” – InformationWeek
    26. 26. Oracle Engineered Systems Big Data Appliance Hardware: • 216 CPU cores, 864 GB RAM, 648 TB disk • 40 Gb/s InfiniBand, inter-rack, node connectivity • 10 Gb/s Ethernet, data center connectivity System Software: • Oracle Linux, Oracle Java Hotspot VM • Oracle NoSQL Database Community Edition • Open-source R distribution • Cloudera’s Distribution including Apache Hadoop • Cloudera Manager
    27. 27. Making Decisions Based on Big Data ChallengeBig data has been Want to add new How do we quickly transformed into insights into BI integrate R analytics actionable insight dashboard into dashboard?
    28. 28. Dashboard Analytics•Oracle Business Intelligence Enterprise Edition ‒Advanced dashboard visualization ‒Runs BI and EPM applications•Integrating R Analytics ‒Embed R script’s web interface in BI dashboard ‒Graphics will stream to BI dashboard
    29. 29. Oracle Exalytics HardwareEngineered for extreme analytics•40 Intel processor cores•1 Terabyte main memory•40 Gb InfiniBand connection to Oracle Exadata
    30. 30. Oracle Exalytics Software•Oracle TimesTen In-Memory Database ‒Adaptive in-memory caching of analytics ‒In-memory columnar compression ‒Tightly integrated with Oracle Exadata ‒Enables speed-of-thought visualization•Oracle Business Intelligence Foundation Suite
    31. 31. Oracle Endeca Information Discovery A platform for provisioning data discovery applications across the enterprise Endeca Information Discovery helps organizations quickly explore all relevant data Unified Interactive App • Combine structured & unstructured Querying Exploration Composition data from disparate systems • Automatically organize information Faceted Data Model for search, discovery & analysisIntegration Enrichment Indexing • Rapidly assemble easy to use analysis applications
    32. 32. Oracle Integrated Solution Stack for Big Data HDFS Hadoop (MapReduce) In-Database AnalyticsOracle NoSQL Oracle Loader Data Analytic Database for Hadoop Warehouse Applications Enterprise Oracle Data Applications Integrator ACQUIRE ORGANIZE ANALYZE DECIDE
    33. 33. Oracle Integrated Solution Stack Engineered SystemsACQUIRE ORGANIZE ANALYZE DECIDE
    34. 34. Oracle Big Data Connectors •Oracle Data Integrator Application Adapter for Hadoop •Oracle Loader for Hadoop •Oracle Direct Connector for Hadoop Distributed File System •Oracle R Connector for Hadoop
    35. 35. Maximizing the Value of Enterprise Big Data•Hardware and software for Big Data•Integrates all enterprise data –Structured and unstructured –SQL and NoSQL•Fastest time-to-market•Single vendor support
    36. 36. The GoodThe Bad, andThe Big Data

    ×