NoSQL Databases, Not just a Buzzword

1. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References NoSQL Databases Not just a Buzzword Haitham A. El-Ghareeb Faculty of Computers and Information Sciences Mansoura University Egypt helghareeb@mans.edu.eg December 8, 2014 Haitham A. El-Ghareeb NoSQL Databases

2. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Contacts Twitter: @helghareeb Linkedin: http://eg.linkedin.com/in/helghareeb Youtube: http://video.helghareeb.me Web site: http://www.helghareeb.me Blog: http://blog.helghareeb.me email: helghareeb@mans.edu.eg email: helghareeb@gmail.com Haitham A. El-Ghareeb NoSQL Databases

3. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References 1 Let's Agree on.. Some de

4. nitions Open Source Scalability Theory vs. Product 2 Data Models Flat File Hierarchical Network Relational Object 3 NoSQL Matters Key Value Stores Haitham A. El-Ghareeb NoSQL Databases

5. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Column Oriented Document-based Graph 4 Closer Look on Famous Products Redis Cassandra MongoDB Neo4j 5 Research in NoSQL Disadvantages of NoSQL Which DB When 6 Finally 7 References Haitham A. El-Ghareeb NoSQL Databases

6. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Objectives NoSQL is a hot topic Meet some famous Data Models Compare NoSQL and SQL Review common features of NoSQL databases Identify some SQL Challenges Address CAP Theorem Meet some well known NoSQL Products Haitham A. El-Ghareeb NoSQL Databases

7. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Some de

8. nitions Open Source Scalability Theory vs. Product 1 Let's Agree on.. Some de

11. nitions Open Source Scalability Theory vs. Product Column Oriented Document-based Graph 4 Closer Look on Famous Products Redis Cassandra MongoDB Neo4j 5 Research in NoSQL Disadvantages of NoSQL Which DB When 6 Finally 7 References Haitham A. El-Ghareeb NoSQL Databases

13. nitions Open Source Scalability Theory vs. Product Database Collection of persistent data that is used by the application systems of some given enterprise [3]. Haitham A. El-Ghareeb NoSQL Databases

15. nitions Open Source Scalability Theory vs. Product Database System Basically just a computerized record-keeping system. The database itself can be regarded as a kind of electronic

16. ling cabinet; that is, it is a repository or container for a collection of computerized data

17. les [3]. Haitham A. El-Ghareeb NoSQL Databases

19. nitions Open Source Scalability Theory vs. Product Data Model Can be de

20. ned as [3]: A model of the persistent data of some particular enterprise. Takes facilities provided and applies them to some speci

21. c problem. Haitham A. El-Ghareeb NoSQL Databases

23. nitions Open Source Scalability Theory vs. Product Open Source FOSS: Free and Open Source Software Flat Model of Management Everyone can contribute Variety Haitham A. El-Ghareeb NoSQL Databases

25. nitions Open Source Scalability Theory vs. Product Scalability It is the ability of a system, network, or process to handle a growing amount of work in a capable manner or its ability to be enlarged to accommodate that growth [2]. For example, it can refer to the capability of a system to increase its total output under an increased load when resources (typically hardware) are added. Haitham A. El-Ghareeb NoSQL Databases

27. nitions Open Source Scalability Theory vs. Product Scalability Options Traditional Scaling (Vertical Scaling) - Cloud databases scaling up by adding new expensive big servers. is not always possible is not reliable in many cases Haitham A. El-Ghareeb NoSQL Databases

29. nitions Open Source Scalability Theory vs. Product Scalability Options Traditional Scaling (Vertical Scaling) - Cloud databases scaling up by adding new expensive big servers. is not always possible is not reliable in many cases Architectural principle - scaling out (Horizontal Scaling) based on data partitioning, i.e. dividing the database across many (inexpensive) machines. Haitham A. El-Ghareeb NoSQL Databases

31. nitions Open Source Scalability Theory vs. Product Sharding Technique: data sharding, i.e. horizontal partitioning of data Haitham A. El-Ghareeb NoSQL Databases

33. nitions Open Source Scalability Theory vs. Product Sharding Technique: data sharding, i.e. horizontal partitioning of data Consequences: manage parallel access in the application scales well for both reads and writes not transparent, application needs to be partition-aware Haitham A. El-Ghareeb NoSQL Databases

35. nitions Open Source Scalability Theory vs. Product Theory vs. Product Who leads: Academia vs. Market? Who makes the standards? Who sticks with standards? Haitham A. El-Ghareeb NoSQL Databases

37. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object 1 Let's Agree on.. Some de

39. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object Column Oriented Document-based Graph 4 Closer Look on Famous Products Redis Cassandra MongoDB Neo4j 5 Research in NoSQL Disadvantages of NoSQL Which DB When 6 Finally 7 References Haitham A. El-Ghareeb NoSQL Databases

40. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object Flat File Widely Used Example - Con

41. guration Files Example - Comma Separated Value (CSV)

42. les Disadvantages - Many Haitham A. El-Ghareeb NoSQL Databases

43. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object Con

44. guration File Haitham A. El-Ghareeb NoSQL Databases

45. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object Hierarchical Data Model Represents data as hierarchical tree structures. Each hierarchy represents a number of related records. There is no standard language for the hierarchical model. A popular hierarchical DML is DL/1 of the IMS system. It dominated the DBMS market for over 20 years between 1965 and 1985 and is still a widely used DBMS worldwide. Haitham A. El-Ghareeb NoSQL Databases

46. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object Hierarchical Data Model Example Haitham A. El-Ghareeb NoSQL Databases

47. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object Hierarchical Data Model Products Examples of Products [4]: Microsoft Windows Registry IBM - IMS SAS - System 2K TDMS Haitham A. El-Ghareeb NoSQL Databases

48. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object Network Data Model [4] Represents data as record types and also represents a limited type of 1:N relationship, called a set type. A 1:N, or one-to-many, relationship relates one instance of a record to many record instances using some pointer linking mechanism in these models. Also known as the CODASYL DBTG model 1. DML was proposed in the 1971 by Database Task Group (DBTG). 1CODASYL DBTG stands for Conference on Data Systems Languages Database Task Group. Haitham A. El-Ghareeb NoSQL Databases

49. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object Network Model Example [4] Haitham A. El-Ghareeb NoSQL Databases

50. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object Network Data Model Products Example of Products [4] Computer Associates - IDMS Unisys - DMS 1100 HP - IMAGE HP - VAX DBMS Cincom - SUPRA Haitham A. El-Ghareeb NoSQL Databases

51. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object Haitham A. El-Ghareeb NoSQL Databases

52. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object Relational Model In Relational Model [3]: Data is represented by means of rows in tables, and such rows can be directly interpreted as true propositions. Operators are provided for operating on rows in tables, and those operators directly support the process of inferring additional true propositions from the given ones. As a simple example, the relational project operator. First relational products began to appear in the late 1970s and early 1980s. Haitham A. El-Ghareeb NoSQL Databases

53. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object ACID Properties Haitham A. El-Ghareeb NoSQL Databases

54. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object ACID Properties Atomic { All of the work in a transaction completes (commit) or none of it completes. Haitham A. El-Ghareeb NoSQL Databases

55. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object ACID Properties Atomic { All of the work in a transaction completes (commit) or none of it completes. Consistent { A transaction transforms the database from one consistent state to another consistent state. Consistency is de

56. ned in terms of constraints. Haitham A. El-Ghareeb NoSQL Databases

58. ned in terms of constraints. Isolated { The results of any changes made during a transaction are not visible until the transaction has committed. Haitham A. El-Ghareeb NoSQL Databases

60. ned in terms of constraints. Isolated { The results of any changes made during a transaction are not visible until the transaction has committed. Durable { The results of a committed transaction survive failures. Haitham A. El-Ghareeb NoSQL Databases

61. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object Relational Model is Great I World Economy is Relational SQL = Rich, declarative query language Database enforces referential integrity ACID semantics Well understood by developers Well supported by frameworks and tools, e.g. Spring JDBC, Hibernate, JPA Haitham A. El-Ghareeb NoSQL Databases

62. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object Relational Model is Great II Well understood by operations Con

63. guration Care and feeding Backups Tuning Failure and recovery Performance characteristics But. . . . Haitham A. El-Ghareeb NoSQL Databases

64. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object Relational Model Challenges Haitham A. El-Ghareeb NoSQL Databases

65. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object Relational Model Challenges Object/relational impedance mismatch Complicated to map rich domain model to relational schema Haitham A. El-Ghareeb NoSQL Databases

66. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object Relational Model Challenges Object/relational impedance mismatch Complicated to map rich domain model to relational schema Relational schema is rigid Dicult to handle semi-structured data, e.g. varying attributes Schema changes = downtime or money loss Haitham A. El-Ghareeb NoSQL Databases

67. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object Relational Model Challenges Object/relational impedance mismatch Complicated to map rich domain model to relational schema Relational schema is rigid Dicult to handle semi-structured data, e.g. varying attributes Schema changes = downtime or money loss Extremely dicult/impossible to scale writes: Vertical scaling is limited/requires money Horizontal scaling is limited or requires money Haitham A. El-Ghareeb NoSQL Databases

68. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object Relational Model Challenges Object/relational impedance mismatch Complicated to map rich domain model to relational schema Relational schema is rigid Dicult to handle semi-structured data, e.g. varying attributes Schema changes = downtime or money loss Extremely dicult/impossible to scale writes: Vertical scaling is limited/requires money Horizontal scaling is limited or requires money Performance can be suboptimal for some use cases Haitham A. El-Ghareeb NoSQL Databases

69. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object Brewer's CAP Theorem A distributed system can support only two of the following characteristics: Consistency Availability Partition tolerance Haitham A. El-Ghareeb NoSQL Databases

70. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object Consistency all nodes see the same data at the same time client perceives that a set of operations has occurred all at once More like Atomic in ACID transaction properties Haitham A. El-Ghareeb NoSQL Databases

71. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object Availability Node(s) failures do not prevent survivors from continuing to operate Every operation must terminate in an intended response Haitham A. El-Ghareeb NoSQL Databases

72. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object Partition Tolerance Operations will complete, even if individual components are unavailable System continues to operate despite arbitrary message loss Haitham A. El-Ghareeb NoSQL Databases

73. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object CAP Theorem Challenge Brewer's CAP Theorem: for any system sharing data, it is impossible to guarantee simultaneously all of these three properties. Very large systems will partition at some point: It is necessary to decide between C and A Traditional DBMS prefer C over A and P Most Web applications choose A (except in speci

74. c applications such as order processing) Haitham A. El-Ghareeb NoSQL Databases

75. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object CAP Theorem and ACID Drop A or C of ACID Relaxing C makes replication easy, facilitates fault tolerance, Relaxing A reduces (or eliminates) need for distributed concurrency control. Haitham A. El-Ghareeb NoSQL Databases

76. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object Object Data Model [4] I The object data model de

77. nes a database in terms of objects, their properties, and their operations. Objects with the same structure and behavior belong to a class, and classes are organized into hierarchies (or acyclic graphs). The operations of each class are speci

78. ed in terms of prede

79. ned procedures called methods. Haitham A. El-Ghareeb NoSQL Databases

80. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Flat File Hierarchical Network Relational Object Object Data Model [4] II Relational DBMSs have been extending their models to incorporate object database concepts and other capabilities; these systems are referred to as object-relational or extended relational systems. Haitham A. El-Ghareeb NoSQL Databases

81. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Key Value Stores Column Oriented Document-based Graph Haitham A. El-Ghareeb NoSQL Databases

82. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Key Value Stores Column Oriented Document-based Graph 1 Let's Agree on.. Some de

84. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Key Value Stores Column Oriented Document-based Graph Column Oriented Document-based Graph 4 Closer Look on Famous Products Redis Cassandra MongoDB Neo4j 5 Research in NoSQL Disadvantages of NoSQL Which DB When 6 Finally 7 References Haitham A. El-Ghareeb NoSQL Databases

85. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Key Value Stores Column Oriented Document-based Graph Google Trends - 2009 Haitham A. El-Ghareeb NoSQL Databases

86. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Key Value Stores Column Oriented Document-based Graph Job Trends - 2006 - 2011 Haitham A. El-Ghareeb NoSQL Databases

87. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Key Value Stores Column Oriented Document-based Graph Job Trends - 2006 - 2011 Haitham A. El-Ghareeb NoSQL Databases

88. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Key Value Stores Column Oriented Document-based Graph De

89. nition From www.nosql-database.org Next Generation Databases mostly addressing some of the points: being non-relational, distributed, open-source and horizontal scalable. The original intention has been modern web-scale databases. The movement began early 2009 and is growing rapidly. Often more characteristics apply as: schema-free, easy replication support, simple API, eventually consistent / BASE (not ACID), a huge data amount, and more. Haitham A. El-Ghareeb NoSQL Databases

90. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Key Value Stores Column Oriented Document-based Graph NoSQL Distinguishing Characteristics Large data volumes Google's big data Scalable replication and distribution Potentially thousands of machines Potentially distributed around the world Queries need to return answers quickly Mostly query, few updates Asynchronous Inserts and Updates Schema-less ACID transaction properties are not needed { BASE Open source development Haitham A. El-Ghareeb NoSQL Databases

91. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Key Value Stores Column Oriented Document-based Graph List of NoSQL Databases I From www.nosql-database.org: Currently [ 150 ] Grouped into: Wide Column Store / Column Families Document Store Key Value / Tuple Store Graph Databases Multimodel Databases Object Databases Grid and Cloud Database Solutions Haitham A. El-Ghareeb NoSQL Databases

92. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Key Value Stores Column Oriented Document-based Graph List of NoSQL Databases II XML Databases Multidimensional Databases Multivalue Databases Event Sourcing Network Model Other NoSQL related databases Unresolved and uncategorized Haitham A. El-Ghareeb NoSQL Databases

93. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Key Value Stores Column Oriented Document-based Graph BASE Transactions Acronym contrived to be the opposite of ACID Basically Available - possibilities of faults but not a fault of the whole system Soft state - copies of a data item may be inconsistent Eventually Consistent - copies become consistent at some later time if there are no more updates to that data item Haitham A. El-Ghareeb NoSQL Databases

94. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Key Value Stores Column Oriented Document-based Graph BASE Transactions Acronym contrived to be the opposite of ACID Basically Available - possibilities of faults but not a fault of the whole system Soft state - copies of a data item may be inconsistent Eventually Consistent - copies become consistent at some later time if there are no more updates to that data item Characteristics Weak consistency Availability

95. rst Best eort Approximate answers OK Simpler and faster Haitham A. El-Ghareeb NoSQL Databases

97. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Key Value Stores Column Oriented Document-based Graph Today's focus Inchallah Key-Value Store - Hash table of keys Column Oriented - Each storage block contains data from only one column Document Store - stores documents made up of tagged elements Graph Databases - focus on relations not only entities Haitham A. El-Ghareeb NoSQL Databases

99. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Key Value Stores Column Oriented Document-based Graph Key-Value Store I A two-column table consisting of a key and a value associated with the key. The key acts as the index, and the value can be referenced as a look up. Example - Project-Voldemort http://www.project-voldemort.com/ Linkedin eventual consistent key value stores, auto scaling. Haitham A. El-Ghareeb NoSQL Databases

100. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Key Value Stores Column Oriented Document-based Graph Key-Value Store II Example - MemCached http://memcachedb.org/ Backend storage is Berkeley-DB Membase { Memcached with persistence and improved consistent hashing. AppFabric Cache { Multi region Cache. Redis { Data structure server. Riak { Based on Amazon's Dynamo. Haitham A. El-Ghareeb NoSQL Databases

101. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Key Value Stores Column Oriented Document-based Graph Key-Value Store Haitham A. El-Ghareeb NoSQL Databases

102. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Key Value Stores Column Oriented Document-based Graph Consistent Hashing Solves Partitioning Problem. Consistent Hashing. servers = [s1, s2, s3, s4] serverToSendData = servers[hash(data) % servers.length] Haitham A. El-Ghareeb NoSQL Databases

103. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Key Value Stores Column Oriented Document-based Graph Optimistic Concurrency Haitham A. El-Ghareeb NoSQL Databases

105. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Key Value Stores Column Oriented Document-based Graph Column Oriented Haitham A. El-Ghareeb NoSQL Databases

106. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Key Value Stores Column Oriented Document-based Graph Column Oriented Store data in column order Allow key-value pairs to be stored (and retrieved on key) in a massively parallel system Data model: families of attributes de

107. ned in a schema, new attributes can be added Storing principle: big hashed distributed tables Properties: partitioning (horizontally and/or vertically), high availability etc. Completely transparent to application Enables compression over column Haitham A. El-Ghareeb NoSQL Databases

109. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Key Value Stores Column Oriented Document-based Graph Document-based Collections of Documents Schema-less Based on JSON format: a data model which supports lists, maps, dates, Boolean with nesting Indexed semi-structured documents Haitham A. El-Ghareeb NoSQL Databases

111. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Key Value Stores Column Oriented Document-based Graph Graph Data Model Haitham A. El-Ghareeb NoSQL Databases

115. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Key Value Stores Column Oriented Document-based Graph Haitham A. El-Ghareeb NoSQL Databases

116. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Key Value Stores Column Oriented Document-based Graph NoSQL Concept Tree [1] Haitham A. El-Ghareeb NoSQL Databases

117. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Key Value Stores Column Oriented Document-based Graph Complexity Haitham A. El-Ghareeb NoSQL Databases

118. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Redis Cassandra MongoDB Neo4j 1 Let's Agree on.. Some de

120. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Redis Cassandra MongoDB Neo4j Column Oriented Document-based Graph 4 Closer Look on Famous Products Redis Cassandra MongoDB Neo4j 5 Research in NoSQL Disadvantages of NoSQL Which DB When 6 Finally 7 References Haitham A. El-Ghareeb NoSQL Databases

121. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Redis Cassandra MongoDB Neo4j Haitham A. El-Ghareeb NoSQL Databases

122. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Redis Cassandra MongoDB Neo4j Redis I Advanced key-value store Values can be binary strings, Lists, Sets, Ordered Sets, Hash maps, .. Operations for each data type, e.g. appending to a list, adding to a set, retrieving a slice of a list, . . . Provides pub/sub-based messaging Very fast: In-memory operations 100K operations/second on entry-level hardware Haitham A. El-Ghareeb NoSQL Databases

123. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Redis Cassandra MongoDB Neo4j Redis II Persistent Periodic snapshots of memory OR append commands to log

124. le Limits are size of keys retained in memory. Has transactions Commands can be batched and executed atomically Haitham A. El-Ghareeb NoSQL Databases

125. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Redis Cassandra MongoDB Neo4j Scaling Redis Master/slave replication Tree of Redis servers Non-persistent master can replicate to a persistent slave Use slaves for read-only queries Run multiple servers per physical host Server is single threaded = Leverage multiple CPUs Optional virtual memory Ideally data should

126. t in RAM Values (not keys) written to disc Haitham A. El-Ghareeb NoSQL Databases

127. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Redis Cassandra MongoDB Neo4j Redis use cases Use in conjunction with another database Drop-in replacement for Memcached Session state Cache of data retrieved from System Of Records (SOR) Denormalized datastore for high-performance queries Randomly selecting an item { SRANDMEMBER Queuing { Lists with LPOP, RPUSH, . . . . High score tables { Sorted sets Notable users: github, guardian.co.uk, . . . . Haitham A. El-Ghareeb NoSQL Databases

129. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Redis Cassandra MongoDB Neo4j Cassandra Data Model I Columns - The column is the smallest increment of data in Cassandra. It is a tuple containing a name, a value and a timestamp. A column must have a name, and the name can be a static label (such as name or email) or it can be dynamically set when the column is created by application. It is not required for a column to have a value. Haitham A. El-Ghareeb NoSQL Databases

130. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Redis Cassandra MongoDB Neo4j Cassandra Data Model II Haitham A. El-Ghareeb NoSQL Databases

131. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Redis Cassandra MongoDB Neo4j Column Family Column Family is similar to a table in that it is a container for columns and rows. In Cassandra, we de

132. ne column families. Column families can (and should) de

133. ne metadata about the columns, but the actual columns that make up a row are determined by the client application. Each row can have a dierent set of columns. Column Family is not entirely schema-less. Each column family should be designed to contain a single type of data. Haitham A. El-Ghareeb NoSQL Databases

134. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Redis Cassandra MongoDB Neo4j Static vs. Dynamic Column Family Haitham A. El-Ghareeb NoSQL Databases

135. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Redis Cassandra MongoDB Neo4j Super Column Column Family can contain either regular columns or super columns. Super Column which adds another level of nesting to the regular column family structure. Super columns are comprised of a (super) column name and an ordered map of sub-columns. A super column can specify a comparator on both the super column name as well as on the sub-column names. Haitham A. El-Ghareeb NoSQL Databases

136. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Redis Cassandra MongoDB Neo4j Super Column Haitham A. El-Ghareeb NoSQL Databases

137. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Redis Cassandra MongoDB Neo4j Cassandra Advantages Tunable consistency. Decentralized. Writes are faster than reads. No Single point of failure. Incremental scalability. Uses consistent hashing (logical partitioning) when clustered. Peer to peer routing(ring). Haitham A. El-Ghareeb NoSQL Databases

139. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Redis Cassandra MongoDB Neo4j BigTable Representation Haitham A. El-Ghareeb NoSQL Databases

141. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Redis Cassandra MongoDB Neo4j MongoDB Document-oriented database JSON-style documents: Lists, Maps, primitives Documents organized into collections (table) Full or partial document updates Transactional update in place on one document Atomic Modi

142. ers Rich query language for dynamic queries Index support { secondary and compound GridFS for eciently storing large

143. les Map/Reduce Haitham A. El-Ghareeb NoSQL Databases

144. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Redis Cassandra MongoDB Neo4j BSON Haitham A. El-Ghareeb NoSQL Databases

145. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Redis Cassandra MongoDB Neo4j MongoDB Query By Example Haitham A. El-Ghareeb NoSQL Databases

146. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Redis Cassandra MongoDB Neo4j One Document Sequence of bytes on disk = fast I/O No joins/seeks In-place updates when possible = no index updates Transaction = update of single document Haitham A. El-Ghareeb NoSQL Databases

147. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Redis Cassandra MongoDB Neo4j MongoDB use cases Use cases Real-time analytics Content management systems Single document partial update Caching High volume writes Who is using it? Shutter y, Foursquare Bit.ly Intuit SourceForge, NY Times GILT Groupe, Evite, SugarCRM Haitham A. El-Ghareeb NoSQL Databases

149. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Redis Cassandra MongoDB Neo4j Neo4j I Graph data model Collection of graph nodes Typed relationships between nodes Nodes and relationships have properties High performance traversal API from roots Breadth

150. rst/depth

151. rst Query to

152. nd root nodes Indexes on node/relationship properties Pluggable - Lucene is the default Graph algorithms: shortest path, . . . Haitham A. El-Ghareeb NoSQL Databases

153. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Redis Cassandra MongoDB Neo4j Neo4j II Transactional (ACID) including 2PC Deployment modes Embedded { written in Java Server with REST API Haitham A. El-Ghareeb NoSQL Databases

154. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Redis Cassandra MongoDB Neo4j Neo4j Use Cases I Use Cases Anything social Cloud/Network management, i.e. tracking/managing physical/virtual resources Any kind of geospatial data Master data management Bioinformatics Fraud detection Metadata management Haitham A. El-Ghareeb NoSQL Databases

155. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Redis Cassandra MongoDB Neo4j Neo4j Use Cases II Who is using it? StudiVZ (the largest social network in Europe) Fanbox The Swedish military And big organizations in datacom, intelligence, and

156. nance that wish to remain anonymous Haitham A. El-Ghareeb NoSQL Databases

157. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Redis Cassandra MongoDB Neo4j Cypher Haitham A. El-Ghareeb NoSQL Databases

158. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Disadvantages of NoSQL Which DB When 1 Let's Agree on.. Some de

160. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Disadvantages of NoSQL Which DB When Column Oriented Document-based Graph 4 Closer Look on Famous Products Redis Cassandra MongoDB Neo4j 5 Research in NoSQL Disadvantages of NoSQL Which DB When 6 Finally 7 References Haitham A. El-Ghareeb NoSQL Databases

161. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Disadvantages of NoSQL Which DB When Disadvantages of NoSQL New and sometimes buggy Data is generally duplicated, potential for inconsistency No standardized schema No standard format for queries No standard language Dicult to impose complicated structures Depend on the application layer to enforce data integrity No guarantee of support Too many options, which one, or ones to pick Haitham A. El-Ghareeb NoSQL Databases

162. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Disadvantages of NoSQL Which DB When Which DB Engine When Haitham A. El-Ghareeb NoSQL Databases

163. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Disadvantages of NoSQL Which DB When Another Attempt Haitham A. El-Ghareeb NoSQL Databases

164. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References 1 Let's Agree on.. Some de

166. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Column Oriented Document-based Graph 4 Closer Look on Famous Products Redis Cassandra MongoDB Neo4j 5 Research in NoSQL Disadvantages of NoSQL Which DB When 6 Finally 7 References Haitham A. El-Ghareeb NoSQL Databases

167. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References NoSQL Summary NoSQL databases reject: Overhead of ACID transactions Complexity of SQL Burden of up-front schema design Declarative query expression Yesterday's technology Programmer responsible for Step-by-step procedural language Navigating access path Haitham A. El-Ghareeb NoSQL Databases

168. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References SQL vs. NoSQL SQL Databases Prede

169. ned Schema Standard de

170. nition and interface language Tight consistency Well de

171. ned semantics NoSQL Database No prede

172. ned Schema Per-product de

173. nition and interface language Getting an answer quickly is more important than getting a correct answer Haitham A. El-Ghareeb NoSQL Databases

174. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References How to Succeed? Know your application Don't forget the past lessons Consider a hybrid approach Fight the desire to Roll-Your-Own-DB Start small but signi

175. cant Haitham A. El-Ghareeb NoSQL Databases

176. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Haitham A. El-Ghareeb NoSQL Databases

177. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References Contacts Twitter: @helghareeb Linkedin: http://eg.linkedin.com/in/helghareeb Youtube: http://video.helghareeb.me Web site: http://www.helghareeb.me Blog: http://blog.helghareeb.me email: helghareeb@mans.edu.eg email: helghareeb@gmail.com Haitham A. El-Ghareeb NoSQL Databases

179. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References References I Dataversity and the NoSQLNow! conference present the CIO's guide to NoSQL: A free whitepaper by dan McCreary and william McKnight. Andre B. Bondi. Characteristics of scalability and their impact on performance. In Proceedings of the 2Nd International Workshop on Software and Performance, WOSP '00, pages 195{203, New York, NY, USA, 2000. ACM. Haitham A. El-Ghareeb NoSQL Databases

180. Let's Agree on.. Data Models NoSQL Matters Closer Look on Famous Products Research in NoSQL Finally References References II C. J. Date. An Introduction to Database Systems. Addison-Wesley, 8th edition, 2003. Ramez Elmasri and Shamkant B. Navathe. Fundamentals of Database Systems. Addison-Wesley, 6th edition, 2010. Haitham A. El-Ghareeb NoSQL Databases

NoSQL Databases, Not just a Buzzword

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (20)

Similar to NoSQL Databases, Not just a Buzzword

Similar to NoSQL Databases, Not just a Buzzword (20)

More from Haitham El-Ghareeb

More from Haitham El-Ghareeb (20)

Recently uploaded

Recently uploaded (20)

NoSQL Databases, Not just a Buzzword