NoSQL Databases for Enterprises - NoSQL Now Conference 2013

1,448 views

Published on

Talk delivered at Dataversity NoSQL Now! Conference in San Jose, August 2013. Describes primary NoSQL functionality and the key features and concerns that Enterprises should consider when choosing a NoSQL technology provider.

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,448
On SlideShare
0
From Embeds
0
Number of Embeds
4
Actions
Shares
0
Downloads
42
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

NoSQL Databases for Enterprises - NoSQL Now Conference 2013

  1. 1. 1 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  2. 2. NoSQL Technology and Enterprise applications – Where the Rubber Meets the Road Dave Segleau Director Product Management, Oracle
  3. 3. Agenda  How we got here  Where we are today  What’s important  Sample Use Cases 3 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  4. 4. NoSQL and Big Data Where did it come from? SQL JDBC, ODBC General Purpose Managed Schemas Security, Backups Analytics … 4 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Distributed Processing More Flexible Schema Management Distributed, Replicated File System Globally Distributed, “Always On” data Competitive Advantages of “Fast Data” Application Driver Lower TCO, commodity HW scale-out NoSQL databases Flexible Schemas Sharded, Replicated Database High Speed, Simple Ops
  5. 5. Oracle NoSQL Database Where is it used? Distributed, Web-scale Applications ERP EAM Simple Data CRM Management Inventory Control Accting & Payroll Process Mgmt Business Analytics … 5 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Application Driver Globally Distributed, “Always On” data Real Time Event Processing Mobile Data Management Competitive Advantages of “Fast Data” Sensor Data Capture Lower TCO, Online Gaming commodity HW scale-out …
  6. 6. The NoSQL Landscape Pioneers – Built their own Oracle has invested in NoSQL as a key data management technology Global Enterprise Technology Adopters Source: NoSQL Market Forecast 2013-2018 by Market Research Media 6 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  7. 7. What is Oracle NoSQL Database? SOCIAL BLOG SMART METER VOLUME VELOCITY VARIETY 1011001010010 0100110101010 1011100101010 100100101 VALUE Non-relational database designed for cost effective simple queries of high volume, velocity & variety data. Provides high performance & availability data storage of Big Data’s simple data using a scale-out of servers design. 7 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  8. 8. Oracle NoSQL Database Distributed, Scalable, Highly Available, Key-Value Database Application Application Application Driver Driver Storage Nodes Datacenter A  Simple Administration Application Storage Nodes Datacenter B  Flexible Data Model  Predictable Performance  ACID Transactions at scale  Transparent Integration  Commercial grade software and support 8 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  9. 9. What’s Really Important? Technical Feature Why Storage Model Not really Will merge over time Specific Features Somewhat Application requirements? Performance Somewhat Rapid changes, YMWV Integration Critical Long term, Repetitive cost Reliability/Support Critical Early products, Product direction Predictability 9 Importance Critical Production reqs & SLAs Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  10. 10. Integration Oracle NoSQL Database: Integrated out of the box  Query NoSQL data from Oracle Database  Access NoSQL data from Hadoop for DW and analytics  Share data with Coherence for extensible in-memory cache grid  Persist history & event streams for processing with OEP  Store & query RDF data using Oracle RDF for NoSQL 10 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  11. 11. Reliability & Support Oracle NoSQL Database: Enterprise-Grade Software & Support  Decades of widespread, reliable deployment experience  15+ years of mission-critical non-relational database technology  Oracle Support available for both Enterprise and Community Edition 11 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  12. 12. Predictability Oracle NoSQL Database: Designed for Predictability - Insert Test Insert Performance 450000 Oracle NoSQL… Other NoSQL… 400000 Throughput (ops/sec) 350000 300000 250000 200000 150000 100000 50000 0 0.2 1.8 3.5 5.2 6.8 8.5 10.2 Time (minutes) 12 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 11.8 13.5 15.2 16.8 18.5
  13. 13. Predictability Oracle NoSQL Database: Designed for Predictability 95/5 Read/Update Throughput 70,000 7 60,000 6 50,000 5 40,000 4 30,000 3 20,000 2 10,000 1 0 144 (48x3) 20% 40% 60% 80% 216 (72x3) 216* (72x3) Nodes (Shards x RF) Throughput (ops/sec) 13 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Read Latency (ms) Update Latency (ms) Average Latency (ms) 8 0 Throughput (ops/sec) 80,000
  14. 14. Oracle NoSQL Database When it really matters Integration Reliability & Support Predictability 14 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  15. 15. Agenda  How we got here  Where we are today  What’s important  Sample Use Cases 15 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  16. 16. Oracle NoSQL Database Use Case Summary Web-Scale Transaction Processing Flexibility Real-Time Event Processing High velocity, volume, variety, data capture and update Guaranteed low latency simple lookups for endcustomers and users Real time events trigger rules that perform low latency lookups Web browsing, E-Retail, Online Gaming, CDR processing, Sensor data capture 16 Web-Scale Personalization Advertising, Product Recommendations, Online Catalogs, Social Media, Profile Management, Personalization Medical Monitoring, Factory Automation, Quality of Service, Oil & Gas, Geolocation Tracking Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Point Point
  17. 17. NoSQL for Web Commerce Customer Service Call center routing and context retrieval Objectives Benefits  Web commerce customer service  Easy to use flexible data formats  Enable call center routing and dispatch  Horizontally scalable, low latency database  Improved product up-sell and cross-sell  Predictable performance Solution  Geographically distributed enterprise access  Oracle NoSQL database for customer profile data capture and access  Build repository for unstructured and variable data record formats  Deploy distributed database for world-wide access 17 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Customer Service End Customers Click-2-Call Application NoSQL DB Driver Customer Profiles
  18. 18. NoSQL for Customer Experience Management Brand enhancement and loyalty enrichment Objectives Benefits  Centralized view of customer data within  Simple, flexible data format federated database environment  Dynamic, customer influence tactics  Highly scalable with predictable performance Solution  Oracle NoSQL database for central  Enterprise support, technology commitment and roadmap Customer Care & End Customers repository of meta data for customer activity, scheduling and “next generation experience” events  Oracle database for financial data, reservation and property management Event Scheduling Application NoSQL DB Driver Reservation Systems 18 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Staff & End Customers Customer Profiles
  19. 19. 360 Degree Customer Profile Managing what you know Customer Service End Customers Click-2-Call Web Service Application Driver Legacy Transactional Systems 19 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 360 View Customer Profiles Recommendation Engine
  20. 20. 360 Degree Customer Profile Date JSON Date JSON Date JSON Purchases Web Traffic Minor Key Date Customer ID JSON Profile JSON Interests JSON Future? 20 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Major Key Value
  21. 21. Real-Time Event Processing Incoming Event Stream Processing 21 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Event Buffer Long-Term Storage
  22. 22. NoSQL for Fraud Scoring Financial Services coordinated theft prevention Benefits  Combine data sources for complex scoring  Simple data model, flexible transactions  Detect, alert analyst with low latency  Scalable, Low Latency data management  Handle burst seasonal transaction volumes  Easy configuration and administration Solution  Enterprise Support  Oracle Coherence cluster for real time transaction object management  Oracle NoSQL Database for fraud model and customer profile management  Oracle Database for statistics and fraud modeling-related data 22 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Transaction Authorization Processor Objectives Application Data Ingestion NoSQL DB Driver
  23. 23. Deployment Options Engineered System Commodity Cluster 23 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  24. 24. Oracle NoSQL Database When you need: For Applications that do: Integration Reliability & Support Web-Scale Personalization Predictability 24 Web-Scale Transaction Processing Real-Time Event Processing Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  25. 25. 25 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  26. 26. 26 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  27. 27. Appendix 27 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  28. 28. Choose the RIGHT tool for the job Hadoop Distributed File System (HDFS) Oracle NoSQL Database Oracle Database File System Key-Value Database Relational Database No inherent structure Simple data structure Complex data structures, rich SQL High volume writes High volume random reads and writes High volume OLTP with 2-PC Limited functionality, roll-your-own applications Simple get/put high speed storage, flex configuration Security, Backup/Restore, Data life cycle mgmt, XML, etc. Batch Oriented Real-Time, web-scale specialized applications General purpose SQL platform, multiple applications, ODBC, JDBC 28 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  29. 29. Web-Scale Transaction Processing Salient Aspects • NoSQL DB for High velocity, high volume, high variety, transactional data capture Enterprise Data Warehouse Application Driver • Hadoop and Data Warehouse for analytics • Applications: Web browsing, Web Retail, CDR processing, Sensor data capture 29 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Acquire Organize Analyze
  30. 30. Web-Scale Personalization Business Users End Customers Salient Aspects • Platform for real-time content delivery • Content & market segmentation is acquired and analyzed in Hadoop & RDBMS Multi-Reporting Dimensional Application • NoSQL provides low latency content lookup and delivery to end-customers or users • Applications: Advertising, Product Recommendations, Online Catalogs, Social Media, Profile Management, Personalization 30 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Driver Acquire, Analyze, Prepare Content Delivery
  31. 31. Real-Time Event Processing Salient Aspects • Real time events trigger rule execution in Oracle Event Processor • OEP rules perform low latency lookups to Oracle NoSQL DB for additional data • Applications: Utilities, Medical Monitoring, Factory Automation, Quality of Service, Oil & Gas Exploration, Geolocation Tracking 31 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Rule Action Low Latency Lookups Driver
  32. 32. NoSQL for Social, Online Betting Real-time, In-Play Gaming Platform Objectives  Scalable in-play sports betting platform  Increase new business revenue  Improve operational efficiency  “Oracle NoSQL Database enabled the rapid, scalable processing of incoming XML, ensuring high available and guaranteed event ordering.” James Anthony Chief Technology Officer Passoker Solution Real-Time, In-Play Sports Betting  Match in-play bets with incoming events  Promote interaction between customers  Scale system with customers and events XML App Providers  Feeds MySQL database for revenue 32 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Event Capture & Store Accounting & Operations NoSQL DB tracking and operational reporting Customers MySQL
  33. 33. NoSQL for Web Scale Retail Dynamic catalog and customer insight profiling Objectives Benefits  Handle exponential growth in products and  Easily manage volatile, evolving data formats customers with highly dynamic profiles  Defend competitive margins – new players  Scalable, Low Latency data management Solution  Online, easy configuration and administration  Flexible transaction options  Oracle NoSQL database for rich customer profile management, product catalog browsing and shopping cart management  Oracle Database for financial transactions, inventory and order fulfillment, business analytics and insight Application NoSQL DB Driver Order Processing 33 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. E-Retail & Order Fulfillment Delivery
  34. 34. NoSQL for Data Scalable PaaS Subscription Web-Scale services infrastructure for financial industry Objectives  Provide special purpose application server services to financial institutions  Provide cost competitive subscriptions Solution  “Oracle NoSQL DB delivers high availability, scalability and performance for our customers who are dealing with unprecedented data volume, velocity and variability challenges.” Alex Korotkoff Chief Executive Officer EngineON  Oracle NoSQL Database for unstructured data capture and application object persistence  Oracle Database for business analytics and insight into the data collected 34 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Application NoSQL DB Driver
  35. 35. NoSQL for Customer Loyalty Coupon redemption, Vendor recommendations Objectives  Scalable customer loyalty portal  New multi-channel consumer model  Improve operational efficiency  “Oracle NoSQL DB handles high volumes of customer loyalty operations every day, minimizing the load to our OLTP Oracle RAC Database.” Frank Puechl Senior Data Architect PAYBACK Solution  Personalized multi-channel coupon generation and redemption  Cross-promote affiliated vendors  Scale system with customers and participating retailers Retail Partners End Customers Application NoSQL DB Driver Customer Profiles 35 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Market Segmentation Available Coupons
  36. 36. NoSQL in Oracle Communications Mgmt Elastic Charging Engine Objectives Benefits  Improve billing and revenue management  Manages rapid growth in data volumes  Calculate charges for any service combo  Cost effective High Performance and Scalability  Provide scalable CDR processing  Integrated with Oracle Coherence Solution Application Data Ingestion  NoSQL database for rated event persistence and consumption by downstream systems  Coherence memory optimization using NoSQL database for out of band data 36 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. OCM Rated Event s Processor  Coherence cluster for real time event rating NoSQL DB Driver

×