Copyright © 2013, Oracle and/or its affiliates. All rights reserved.1
NoSQL Databases
Robert Greene, Anuj Sahni,
Product Management
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.3
The following is intended to outline our general pro...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.4
NoSQL – in the eyes of the Oracle
Key-Value
Graph
Fu...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.5
Design drivers
Systems
Friendly
Usability
Scalabilit...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.6
Systems Friendly
 Data Collaborations
– Orchestrati...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.7
 OEP for event-driven &
streaming applications
 Or...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.8
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.9
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.10
Integration with RDF
RDF Use Cases
• Unified conten...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.11
Commodity Servers
NoSQL DB Driver
Processing Applic...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.12
Engineered Systems
NoSQL DB Driver
Processing Appli...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.13
Usability– Major/Minor KV Paradigm
User mailbox dat...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.14
Dev Usability– Modeled as Nested Tables
User mailbo...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.15
 SNMP (Enterprise Edition Only)
– MIBs in SNMPv2 f...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.16
 We did do it!
 Admin commands available to
descr...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.17
Scalability Architecture – Applications View
 Elas...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.18
 Increase Data Capacity
– Add more storage nodes
–...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.19
 Supports heterogeneous
storage topology
 Replica...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.20
 1.6 billion records
 94K insert/sec
 25K read/u...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.21
• Twitter sees ~500M tweets/day
• This is 350K a mi...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.22
YCSB – Benchmarking Predictability
Oracle NoSQL Dat...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.23
 Simple Key-Value Data Model
 Horizontally Scalab...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.24
Oracle NoSQL Database Subscription Model
 Oracle N...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.25
Oracle NoSQL DB Licensing
 Enterprise Edition
– Cl...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.26
Oracle NoSQL DB Resources
 NoSQL DB Use Cases, Whi...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.27
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.28
Upcoming SlideShare
Loading in …5
×

Oracle NoSQL Database release 3.0 overview

358 views
272 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
358
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
13
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Oracle NoSQL Database release 3.0 overview

  1. 1. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.1
  2. 2. NoSQL Databases Robert Greene, Anuj Sahni, Product Management
  3. 3. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.3 The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
  4. 4. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.4 NoSQL – in the eyes of the Oracle Key-Value Graph Fundamentals
  5. 5. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.5 Design drivers Systems Friendly Usability Scalability Predictably Responsive NoSQL – in the eyes of the Oracle
  6. 6. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.6 Systems Friendly  Data Collaborations – Orchestrating – Monitoring – Process and/or Data movement Eventing NoSQL HDFS RDBMS Useful Services Cache
  7. 7. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.7  OEP for event-driven & streaming applications  Oracle NoSQL DB accessed from KV Cartridge  NoSQL DB data directly accessible via CQL queries Features NoSQL DB and Event Processing
  8. 8. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.8
  9. 9. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.9
  10. 10. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.10 Integration with RDF RDF Use Cases • Unified content metadata for federated resources • Validate semantic and structural consistency Social Media Analysis  Analyze social relations using curated metadata - Blogs, wikis, video - Calendars, IM, voice Semantic Metadata Layer  Find related content & relations by navigating connected entities  “Reason” across entities Text Mining & Entity Analytics
  11. 11. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.11 Commodity Servers NoSQL DB Driver Processing Application Data Connector Servers Big Data Acquisition Real Time Access
  12. 12. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.12 Engineered Systems NoSQL DB Driver Processing Application HDFS, Hadoop, CDH Map Reduce ORCH ‐ Stats Map Reduce Hive ‐ Activities Map Reduce Pig ‐ Sessionize Big Data Acquisition Batch Processing Big Data Appliance Big Data Acquisition Real Time Access Data Connector
  13. 13. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.13 Usability– Major/Minor KV Paradigm User mailbox data Key Space : /user/id/-/folder/inbox/arrival date /user/id/-/folder/deleted/arrival date Value : { “name" : "Email", "namespace" : "com.companyX.email.avro", "type" : "record", "fields": [ {"name": "from", "type": "string", "default": ""}, {"name": "to", "type": "string", "default": ""}, {"name": "sender", "type": "string", "default": ""}, {"name": "cc", "type": "string", "default": ""}, {"name": "subject", "type": "string", "default": ""}, {“name”: “msgBody”, “type”: “string”, “default”: “”} ] }
  14. 14. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.14 Dev Usability– Modeled as Nested Tables User mailbox data UserID Folder Name Arrival Date From To Sender CC Subject Msg Body Parent Table Name: User Major Key Inherited from parent table Primary Key “Value” UserID Primary Key Major Key Child Table Name: Folder
  15. 15. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.15  SNMP (Enterprise Edition Only) – MIBs in SNMPv2 format – Storage node SNMP agent – admin and rep nodes – Performance metrics – Via polling – Service change events – Via traps or polling – Notifications (Traps) – Latency and throughput limits  OEM Integrated for holistic RDBMS / NoSQL Monitoring Standard Protocol Support Admin Usability - Enterprise Manager Integration
  16. 16. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.16  We did do it!  Admin commands available to describe safe upgrade order  Scripted available hands-free upgrade experience  Read/Write availability throughout the upgrade process What’s the Big Deal Admin Usability – Online Rolling Upgrades 0 2.5 5 7.5 10 12.5 15 17.5 72 (24x3) 144 (48x3) 216 (72x3) TimetoUpgrade(min) Total Nodes (Shards x Rep. Factor) Online Rolling Upgrade Ever tried to upgrade a 200 node system while it’s active?
  17. 17. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.17 Scalability Architecture – Applications View  Elastic Shards (split, add, contract) Store Partition M Partition M R Partition M R R Application NoSQL Driver R R R  Writes to elected node  Reads from any node in system
  18. 18. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.18  Increase Data Capacity – Add more storage nodes – New shards automatically created  Increase Data Throughput – More shards = better write throughput – More replicas/shard = better read throughput Smart Topology NoSQL DB Driver Application Master Replica Replica StorageNode StorageNode StorageNode Shard-1 Master Replica Replica Shard-2 Scalability– Elastic Cluster Expansion
  19. 19. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.19  Supports heterogeneous storage topology  Replicas move from over- utilized to under-utilized storage nodes  Number of shards and replication factor remain unchanged Improve Performance Scalability - Rebalance an Unbalanced Store Storage Node 1 Storage Node 2 Storage Node 3 Represents a vnode
  20. 20. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.20  1.6 billion records  94K insert/sec  25K read/update/sec  Low latency  Linear scalability What’s the Big Deal YCSB – Benchmark Commodity Servers
  21. 21. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.21 • Twitter sees ~500M tweets/day • This is 350K a minute • Capture twitter activity with 3 commodity servers • 1.25M ops/sec • 2 billion records • 2 TB of data • 95% read, 5% update • Low latency, High Scalability What’s the Big Deal YCSB - Benchmarking with SSD’s 0 1 2 3 4 0 200,000 400,000 600,000 800,000 1,000,000 1,200,000 1,400,000 6 (2x3) 12 (4x3) 24 (8x3) 30 (10x3) AverageLatency(ms) Throughput(ops/sec) Cluster Size ( 3->15 servers ) Mixed Throughput Throughput (ops/sec) Write Latency (ms) Read Latency (ms)
  22. 22. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.22 YCSB – Benchmarking Predictability Oracle NoSQL Database: Designed for Predictability 0 1 2 3 4 5 6 7 8 0 10,000 20,000 30,000 40,000 50,000 60,000 70,000 80,000 144 (48x3) 20% 40% 60% 80% 216 (72x3) 216* (72x3) AverageLatency(ms) Throughput(ops/sec) Nodes (Shards x RF) 95/5 Read/Update Throughput Throughput (ops/sec) Read Latency (ms) Update Latency (ms)
  23. 23. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.23  Simple Key-Value Data Model  Horizontally Scalable  Highly Available  Elastic Configuration  ACID Transactions  Simple administration  Transparent load balancing  Commercial grade software and support  Secondary Indexing  Authentication / SSL Security  Data Center support Features Oracle NoSQL Database Scalable, Highly Available, Key-Value Database Application Storage Nodes Datacenter B Storage Nodes Datacenter A Application NoSQL DB Driver Application NoSQL DB Driver Application
  24. 24. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.24 Oracle NoSQL Database Subscription Model  Oracle NoSQL Database Community Edition – Open Source AGPL Edition  Support is now available for Community Edition – Price is $2,000/year per server – No upfront license fee – Provides for full Oracle support policy response – Purchase online via the Oracle Store  Offers affordable support option for startups  Provides Oracle expertise for production deployment New business-friendly support service The Store https://shop.oracle.com/
  25. 25. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.25 Oracle NoSQL DB Licensing  Enterprise Edition – Closed Source. Standard Oracle License.  Community Edition has all of the basic functionality and APIs. Gets you started.  Enterprise Edition for large, production, multi-data center, Oracle integration- centric customers and/or non-GPL compliant customers. Community -or- Enterprise Edition
  26. 26. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.26 Oracle NoSQL DB Resources  NoSQL DB Use Cases, White Papers, Data Sheets, Benchmarks http://www.oracle.com/technetwork/products/nosqldb/overview/index.html  NoSQL DB Documentation http://www.oracle.com/technetwork/products/nosqldb/documentation/index.html  NoSQL DB Downloads http://www.oracle.com/technetwork/products/nosqldb/downloads/index.html  NoSQL DB OTN Forum http://forums.oracle.com/forums/forum.jspa?forumID=1388  OU Training Classes http://bit.ly/V5qbmY  Great Application Development article on OTN: http://www.oracle.com/technetwork/articles/bigdata/oracle-nosqldb-appdev-1891870.html
  27. 27. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.27
  28. 28. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.28

×