Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Partner Webcast – Oracle NoSQL key-value database

1,882 views

Published on

The Oracle NoSQL Database is a horizontally scaled, Key-Value database for Web Services and Cloud, designed specifically to provide highly reliable, scalable and available data storage across a configurable set of systems that function as storage nodes. Oracle NoSQL Database provides a powerful and flexible transaction model that greatly simplifies the process of developing a NoSQL-based application. It scales horizontally with high availability and transparent load balancing even when dynamically adding new capacity.
With Big Data becoming the biggest thing in IT since the internet itself, developers everywhere are focused on applications to accelerate businesses.

[Read More @https://blogs.oracle.com/imc/entry/oracle_nosql]

  • Writing a good research paper isn't easy and it's the fruit of hard work. You can get help from writing. Check out, please ⇒ www.HelpWriting.net ⇐
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here

Partner Webcast – Oracle NoSQL key-value database

  1. 1. Stay Connected BLOGS.ORACLE.COM/IMC TWITTER.COM/ORACLEIMC YOUTUBE.COM/ORACLEIMCTEAM FACEBOOK.COM/ORACLEIMC
  2. 2. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Presented by Oracle NoSQL Database Andrey Rivkin Technical Consultant FORS Distribution October 16, 2014
  3. 3. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Agenda A bit of history and what is NoSQL Data Model Architecture Consistency When to use Community Edition vs Enterprise Edition What’s new in release 3.0
  4. 4. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Reasons for creating NoSQL technology The appearance in the early 2000s: •Google - web search engine •Facebook – social network •Amazon - online retailer Common features of these systems: •Constantly changing structure •Unpredictable data growth •A huge number of users
  5. 5. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | What is NoSQL? NoSQL = Not only SQL. Do not have a structured scheme -Frequently the data is stored in the scheme of key-value -The structure of the database schema is created by the application Allow almost infinite horizontal scale -The data is stored in the copies on different servers -Node failure does not result in data loss -Reading is done from the master or a copies Working with data through a simple operations (no SQL) -CREATE -RETRIEVE -UPDATE -DELETE
  6. 6. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
  7. 7. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle NoSQL Database Horizontally Scaled, Key-Value Database for Web Services and Cloud •Simple Data model Based on Key-value scheme with two parts key – major + minor Simple operations read/insert/update/delete •Scalability Optimized data access Smart division and distribution of data •High Availability & No-Single Point of Failure single-master, multi-replica database replication automated fail-over election •Transparent Load Balancing Read from master or/and replicas Network topology and latency-aware Storage Nodes Data Center A Storage Nodes Data Center B Application NoSQL DB Driver Application NoSQL DB Driver
  8. 8. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Key – Value pair Oracle NoSQL Database hashes keys to provide good distribution over a collection of computers that provide storage for the database. A key is the concatenation of a Major Key Path and a Minor Key Path, both of which are specified by the application. A minor component does not affect the distribution and can be empty. Key
  9. 9. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Key – Value pair Oracle NoSQL Database stores value as byte array. Mapping of the byte arrays to data structures is done by application. There are no restrictions on the size or structure of the value field. Value
  10. 10. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Logical representation of Oracle NoSQL Database Key Value Key 1 Value 1 Key 2 Value 2 Key 3 Value 3 Key 4 Value 4 Key 5 Value 5 Key 6 Value 6 Index Key 1 – Value 1 Key 5 – Value 5 Key 4 – Value 4 Key 2 – Value 2 Key 3 – Value 3 Key 6 – Value 6
  11. 11. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Physical representation of Oracle NoSQL Database Key 1 – Value 1 Key 5 – Value 5 Key 4 – Value 4 Key 2 – Value 2 Key 3 – Value 3 Key 6 – Value 6 server rack 1 server rack 2 Key 1 – Value 1 Key 1 – Value 1 Key 4 – Value 4 Key 4 – Value 4 Key 2 – Value 2 Key 2 – Value 2 Key 5 – Value 5 Key 5 – Value 5 Key 3 – Value 3 Key 3 – Value 3 Key 6 – Value 6 Key 6 – Value 6
  12. 12. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Physical representation of Oracle NoSQL Database server rack 1 server rack 2 Key 1 – Value 1 Key 1 – Value 1 Key 4 – Value 4 Key 4 – Value 4 Key 2 – Value 2 Key 2 – Value 2 Key 5 – Value 5 Key 5 – Value 5 Key 3 – Value 3 Key 3 – Value 3 Key 6 – Value 6 Key 6 – Value 6
  13. 13. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | server rack 1 server rack 2 Key 1 – Value 1 Key 1 – Value 1 Key 4 – Value 4 Key 4 – Value 4 Key 2 – Value 2 Key 2 – Value 2 Key 5 – Value 5 Key 5 – Value 5 Key 3 – Value 3 Key 3 – Value 3 Key 6 – Value 6 Key 6 – Value 6 Storage architecture Shard 1 (Replication Group 1) Shard 2 (Replication Group 2) Shard 3 (Replication Group 3) Master Master Master Slave Slave Slave
  14. 14. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Storage architecture Key 1 – Value 1 Key 4 – Value 4 Oracle NoSQL Database Storage Node Key 1 – Value 1 Key 1 – Value 1 Key 4 – Value 4 Key 4 – Value 4 Key 2 – Value 2 Key 2 – Value 2 Key 5 – Value 5 Key 5 – Value 5 Key 3 – Value 3 Key 3 – Value 3 Key 6 – Value 6 Key 6 – Value 6 Master Master Master Slave Slave Slave
  15. 15. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | How Does it work? Client Replication Group Master Replica Replica Key – Value pairs
  16. 16. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Client How Do We Read? get( ) hash( ) LUT( )
  17. 17. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Consistency of data BASE Basically Available Soft state Eventual consistency ACID Atomicity Atomicity requires that each transaction is "all or nothing": if one part of the transaction fails, the entire transaction fails, and the database state is left unchanged. Consistency The consistency property ensures that any transaction will bring the database from one valid state to another. Isolation The isolation property ensures that the concurrent execution of transactions results in a system state that would be obtained if transactions were executed serially, i.e. one after the other. Durability Durability means that once a transaction has been committed, it will remain so, even in the event of power loss, crashes, or errors.
  18. 18. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Consistency of data Oracle NoSQL Database – ACID or BASE system? Can be configured for the whole system and for a particular operation!
  19. 19. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | In which case you should use Oracle NoSQL Database?  Terabytes or petabytes of data  The application should not have a single point of failure  The use of multiple low-cost servers  Short response time of simple queries  Unstructured or semi-structured data model
  20. 20. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Potential systems for Oracle NoSQL Database  LDAP like systems Why? It’s fast! User personalization Why? No clear data model and constant addition of new features! Collection of different types of data from the sensors Why? A lot of concurrent sessions! Logging of Internet traffic (CDR GPRS, web logs) Why? Huge amount of data! File storage (like Dropbox, Google disk) Why? Cheap store of large amounts of unstructured data!
  21. 21. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle NoSQL Database Community VS Enterprise Edition Oracle NoSQL Database Community Edition. Open Source. GPLv2 or AGPL license. Oracle NoSQL Database Enterprise Edition. Closed Source. Standard Oracle License. List price: $10K/CPU.
  22. 22. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle NoSQL Database benefits Community Edition 1.Java and C APIs 2.Store billions of records and multi-terabytes of data 3.No-Single Point of failure 4.Designed to scale out to thousands of nodes 5.Streaming Large Object Support 6.Easy online administration 7.Online rolling upgrade 8.Efficient Multi-Zone support 9.Integrated with Apache Hadoop
  23. 23. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle NoSQL Database Enterprise Edition includes all features available in Community Edition, plus these additional features: Simple Network Management Protocol (SNMP) adapter for monitoring Oracle Database Integration via External Tables: Access data through SQL queries Integration with Oracle Event Processing (OEP) engine using NoSQL database cartridge: Access data through CQL queries Integration with Oracle Coherence to permit Oracle NoSQL Database to be used as a cache for Oracle Coherence applications and to allow applications to directly access cached data from Oracle NoSQL Database. A Java-based interface to store and query semantic data through support for the Resource Description Framework (RDF), SPARQL query language, and a subset of the Web Ontology Language (OWL) are now supported. Enterprise Grade Support (24x7) for Enterprise Edition (EE). Oracle NoSQL Database benefits Enterprise Edition
  24. 24. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Table data model support –Simplifies data modeling & leverages existing “table” expertise Secondary indexing –Allow indexing on any component of the record –Huge performance benefit due to parallel, indexed data access Data centers –Metro-area zones for disaster recovery and business continuity –Secondary zones for read-only workloads Security –Authentication and network-level encryption Oracle NoSQL DB Release 3.0
  25. 25. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Lower barrier to adoption, shorter time to market Simplified application modeling –Uses familiar table concepts –Introduces strongly typed fields –Easy to/from JSON with full type support and AVRO serialization –Allows secondary indexing of non-key data Sets foundation for SQL query access from Oracle DB Previous Key/Value and JSON schema APIs still supported Oracle NoSQL DB Release 3.0 Table model benefits
  26. 26. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle NoSQL DB Release 3.0 Secondary Index support Broader low latency use case support –Primary and Secondary Indexes –Indexes automatically maintained –Provides sorted results Low resource cost with high performance –Low cardinality matching, guaranteed consistent –Shard-local indexing, low latency record access –B-trees locally ordered, scanned in parallel, merged result set –Improved index cache eviction
  27. 27. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle NoSQL DB Release 3.0 Secondary Index Get() API specifies index Equality or range searches Low order multi-value indexes –Composite index on values –Parallel Index ScanA –Ordered results –Indexable single element arrays  Equality search on lname + fname  Equality search on lname and range on fname  Range or Equality search on lname by itself  Can’t search on just fname Index on (lname, fname) UserId fname lname email Table Users
  28. 28. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle NoSQL DB Release 3.0 Zones Metro-Local Quorum –Low latency writes, HA 2nd’ary Read-Only Zones –Analytic workloads –Report generation –Asynchronous replication New Read Consistency: No Master Topology Aware Client Driver Provides business continuity and distributed workload management DC1 DC2 DC3 Metropolitan Zones Reports Batch Analytics
  29. 29. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle NoSQL DB Release 3.0 Security Overview Protected Access to Data –Enforcement is configurable Authentication –OS independent, password based user access –Internal cluster components self authenticate (HA password distribution) –Oracle Wallet integrated –Admin utility to generate self-signed certificates Wire level data encryption –All client-server, server-server channels SSL encrypted
  30. 30. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | •Free test of Oracle NoSQL database is available here: http://www.oracle.com/technetwork/database/database- technologies/nosqldb/overview/index.html •Try Oracle Big Data Lite Virtual Machine: http://www.oracle.com/technetwork/database/bigdata-appliance/oracle- bigdatalite-2104726.html 32 Try it yourself!
  31. 31. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Q&A 33 Andrey Rivkin FORS Distribution Big Data Specialist Andre.Rivkin@fors.ru ISV Migration Center blog: http://blogs.oracle.com/imc ISV Migration Center email: partner.imc@beehiveonline.oracle.com
  32. 32. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | •Oracle.com Partner Hub oracle.com/partners/goto/hub-ecemea •Migration Center Team Blog blogs.oracle.com/imc feeds.feedburner.com/oracleIMC •Partner Webcast Recordings youtube.com/OracleIMCteam •Partner Webcast Presentations slideshare.net:/Oracle_IMC_team •Partner.IMC@beehiveonline.oracle.com Oracle Partner Hub ISV Migration Center •twitter.com/OracleIMC •plus.google.com/+OracleIMC •facebook.com/OracleIMC •linkedin.com/groups/Oracle-Partner-Hub-Migration- Center-4535240

×