SlideShare a Scribd company logo
1 of 35
Download to read offline
Cassandra – An Introduction

                                  Mikio L. Braun
                                    Leo Jugel

                               TU Berlin, twimpact

                                 LinuxTag Berlin
                                  13. Mai 2011




LinuxTag Berlin, 13. 5. 2011   (c) 2011 by Mikio L. Braun   @mikiobraun, blog.mikiobraun.de
What is NoSQL
 ●   For many web applications, “classical data
     bases” are not the right choice:
      ●   Database is just used for storing objects.
      ●   Consistency not essential.
      ●   A lot of concurrent access.




LinuxTag Berlin, 13. 5. 2011     (c) 2011 by Mikio L. Braun   @mikiobraun, blog.mikiobraun.de
NoSQL in comparison
Classical Databases                               NoSQL
Powerful query language                           very simple query language
Scales by using larger servers                    skales through clustering
(“scaling up”)                                    (“scaling out”)
Changes of database schema very costly            No fixed database schema
ACID: Atomicity, Consistency, Isolation,          Typically only “eventually consistent”
Duratbility
Transactions, locking, etc.                       Typically no support for transactions etc.




LinuxTag Berlin, 13. 5. 2011     (c) 2011 by Mikio L. Braun      @mikiobraun, blog.mikiobraun.de
Brewer's CAP Theorem
 ●   CAP: Consistency, Availability, Partition
     Tolerance
      ●   Consistency: You never get old data.
      ●   Availability: read/write operations always possible.
      ●   Partition Tolerance: other guarantees hold even if
          network of servers break.
 ●   You can only have two of these!



Gilbert, Lynch, Brewer's conjecture and the feasibility of consistent, available, partition-
tolerant web services, ACM SIGACT News, Volume 33, Issue 2, June 2002
LinuxTag Berlin, 13. 5. 2011     (c) 2011 by Mikio L. Braun     @mikiobraun, blog.mikiobraun.de
Homepage                       http://cassandra.apache.org
Language                       Java
History                        ● Developed at Facebook for inbox search,
                               released as Open Source in July 2008
                               ● Apache Incubator since March 2009

                               ● Apache Top-Level since February 2010


Main Properties                ● structured key value store

                               ● “eventually consistent”

                               ● fully equivalent nodes

                               ● cluster can be modified without restarting


Support                        DataStax (http://datastax.com)
Licence                        Apache 2.0

LinuxTag Berlin, 13. 5. 2011       (c) 2011 by Mikio L. Braun   @mikiobraun, blog.mikiobraun.de
Version 0.6.x and 0.7.x
 ●   Most important changes in 0.7.x
      ●   config file format changed from XML to YAML
      ●   schema modification (ColumnFamilies) without
          restart
      ●   Beginning support for secondary indices
 ●   However, also problems with stability initially.




LinuxTag Berlin, 13. 5. 2011   (c) 2011 by Mikio L. Braun   @mikiobraun, blog.mikiobraun.de
Inspirations for Cassandra
 ●   Amazon Dynamo
      ●   Clustering without dedicated master node
      ●   Peer-to-peer discovery of nodes, HintedHintoff, etc.
 ●   Google BigTable
      ●   data model
      ●   requires central master node
      ●   Provides much more fine grained control:
            –   which data should be stored together
            –   on-the-fly compression, etc.


LinuxTag Berlin, 13. 5. 2011   (c) 2011 by Mikio L. Braun   @mikiobraun, blog.mikiobraun.de
Installation
 ●   Download tar.gz from
     http://cassandra.apache.org/download/
 ●   Unpack
 ●   ./conf contains config files
 ●   ./bin/cassandra -f to start Cassandra, Ctrl-C to
     stop




LinuxTag Berlin, 13. 5. 2011   (c) 2011 by Mikio L. Braun   @mikiobraun, blog.mikiobraun.de
Configuration
 ●   Database
      ●   Version 0.6.x: conf/storage-conf.xml
      ●   Version 0.7.x: conf/cassandra.yaml
 ●   JVM Parameters
      ●   Version 0.6.x: bin/cassandra.in.sh
      ●   Version 0.7.x: conf/cassandra-env.sh




LinuxTag Berlin, 13. 5. 2011    (c) 2011 by Mikio L. Braun   @mikiobraun, blog.mikiobraun.de
Cassandra's Data Model
Keyspace (= database)                                          byte arrays
  Column Family (= table)                     Row
              key                             {name1: value1, name2: value2, name3: value3, ...}


                                                                      column
                               strings
                                                                                 sorted by name!
                               sorted according to partitioner

    Super Column Family
                key
                                                key                      {name1: value1, ...}




LinuxTag Berlin, 13. 5. 2011             (c) 2011 by Mikio L. Braun      @mikiobraun, blog.mikiobraun.de
Example: Simple Object Store
   class Person {
       long id;
       String name;
       String affiliation;
   }

                                       Convert fields to byte arrays




                    Keyspace “MyDatabase”:
                        ColumnFamily “Person”:
                            “1”: {“id”: “1”, “name”: “Mikio Braun, “affiliation”: “TU Berlin”}




LinuxTag Berlin, 13. 5. 2011         (c) 2011 by Mikio L. Braun     @mikiobraun, blog.mikiobraun.de
Example: Index
   class Page {
       long id;
       …                                                                  Object data fields
       List<Links> links;
   }                            Keyspace “MyDatabase”
                                    ColumnFamily “Pages”
   class Link {                         “3”: {“id”: 3, …}
       long id;                         “4”: {“id”: 4, …}
       ...                                                               Used for both, linking
       int numberOfHits;            ColumnFamily “Links”                 and indexing!
   }                                    “1”: {“id”: 1, “url”: …}
                                        “17”. {“id”: 17, “url”: …}

                                    ColumnFamily “LinksPerPageByNumberOfHits”
                                        “3”: { “00000132:00000001”: “t”, “000025: 00000017”: …
                                        “4”: { “00000044:00000024”: “t”, … }

      Here we exploit that
      columns are sorted
      by their names.                  Of course, everything encoded in byte arrays,
                                       not ASCII

LinuxTag Berlin, 13. 5. 2011      (c) 2011 by Mikio L. Braun     @mikiobraun, blog.mikiobraun.de
Are SuperColumnFamilies
                     necessary?

 ●   Usually, you can replace a SuperColumnFamily
     by several CollumnFamilies.
 ●   Since SuperColumnFamilies make the
     implementation and the protocol more compelx,
     there are also people advocating the remove
     SuperCFs... .



LinuxTag Berlin, 13. 5. 2011   (c) 2011 by Mikio L. Braun   @mikiobraun, blog.mikiobraun.de
Cassandra's Architecture

                            MemTable                                Read Operation




                                            Flush
 Memory


 Disk




Write Operation            Commit Log                     SSTable          SSTable            SSTable




                                                                         Compaction!
 LinuxTag Berlin, 13. 5. 2011          (c) 2011 by Mikio L. Braun        @mikiobraun, blog.mikiobraun.de
Cassandras API
  ●   THRIFT-based API
Read operations                                          Write operations
get                       single column                  insert                 single column
get_slice                 range of columns               batch_mutate           several columns in
multiget_slice            range of columns in                                   several rows
                          several rows                   remove                 single column
get_count                 column count                   truncate               while ColumnFamily
get_range_slice           several columns from
                          range of rows
get_indexed_slices range of columns from
                   index

Sonstige
login, describe_*, add/drop column family/keyspace                                      since 0.7.x


 LinuxTag Berlin, 13. 5. 2011        (c) 2011 by Mikio L. Braun      @mikiobraun, blog.mikiobraun.de
Cassandra Clustering
 ●   Fully equivalent nodes, no master node.
 ●   Bootstrapping requires seed node.
            “Storage Proxy”



                  Node                  Node                  Node




                               Reads/writes according to consistency level

                  Query

LinuxTag Berlin, 13. 5. 2011   (c) 2011 by Mikio L. Braun   @mikiobraun, blog.mikiobraun.de
Consistency Level and
                       Replication Factor
●Replication factor: On how many nodes is a
piece of data stored?

●   Consistency level:
Consistency Level
ANY                            A node has received the operation, even a
                               HintedHandoff node.
ONE                            One node has completed the request.
QUORUM                         Operation has completed on majority of nodes / newest
                               result is returned.
LOCAL_QUORUM                   QUORUM in local data center
GLOBAL_QUORUM                  QUORUM in global data center
ALL                            Wait till all nodes have completed the request


LinuxTag Berlin, 13. 5. 2011   (c) 2011 by Mikio L. Braun   @mikiobraun, blog.mikiobraun.de
How to deal with failure
●   As long as requirements of the consistency level can be
    met, everything is fine.
●   Hinted Handoff:
     ●   A write operation for a faulty node is stored on another node and
         pushed to the other node once it is available again.
     ●   Data won't be readable after write!
●   Read Repair:
     ●   After read operation has completed, data will be compared and
         updated on all nodes in the background.




LinuxTag Berlin, 13. 5. 2011   (c) 2011 by Mikio L. Braun   @mikiobraun, blog.mikiobraun.de
Libraries
Python        Pycassa: http://github.com/pycassa/pycass
              Telephus: http://github.com/driftx/Telephus
Java          Datanucleus JDO:http://github.com/tnine/Datanucleus-Cassandra-Plugin
              Hector: http://github.com/rantav/hector
              Kundera http://code.google.com/p/kundera/
              Pelops: http://github.com/s7/scale7-pelops
Grails        grails-cassandra: https://github.com/wolpert/grails-cassandra
.NET          Aquiles: http://aquiles.codeplex.com/
              FluentCassandra: http://github.com/managedfusion/fluentcassandra
Ruby          Cassandra: http://github.com/fauna/cassandra
PHP           phpcassa: http://github.com/thobbs/phpcassa
              SimpleCassie: http://code.google.com/p/simpletools-php/wiki/SimpleCassie


Or roll your own based on THRIFT http://thrift.apache.org/ :)




LinuxTag Berlin, 13. 5. 2011      (c) 2011 by Mikio L. Braun    @mikiobraun, blog.mikiobraun.de
TWIMPACT: An Application
 ●   Real-time analysis of Twitter
 ●   Trend analysis based on retweets
 ●   Very high data rate (several million tweets per
     day, about 50 per second)




LinuxTag Berlin, 13. 5. 2011   (c) 2011 by Mikio L. Braun   @mikiobraun, blog.mikiobraun.de
TWIMPACT: twimpact.jp




LinuxTag Berlin, 13. 5. 2011   (c) 2011 by Mikio L. Braun   @mikiobraun, blog.mikiobraun.de
TWIMPACT: twimpact.com




LinuxTag Berlin, 13. 5. 2011   (c) 2011 by Mikio L. Braun   @mikiobraun, blog.mikiobraun.de
Application Profile
 ●   Information about tweets, users, and retweets
 ●   Text matching for non-API-retweets
 ●   Retweet frequency and user impact
 ●   Operation profile:
              get_slice        get     get_slice     batch_mutate    insert   batch_mutate       remove
              (all)                    (range)       (one row)
  Fraction    50.1%            6.0%    0.1%          14.9%           21.5%    6.8%               0.8%
  Duration 1.1ms               1.7ms   0.8ms         0.9ms           1.1ms    0.8ms              1.2ms




LinuxTag Berlin, 13. 5. 2011            (c) 2011 by Mikio L. Braun     @mikiobraun, blog.mikiobraun.de
Practical Experiences with
                       Cassandra
 ●   Very stable
 ●   Read operations relatively expensive
 ●   Multithreading leads to a huge performance
     increase
 ●   Requires quite extensive tuning
 ●   Clustering doesn't automatically lead to better
     performance
 ●   Compaction leads to performance decrease of
     up to 50%

LinuxTag Berlin, 13. 5. 2011   (c) 2011 by Mikio L. Braun   @mikiobraun, blog.mikiobraun.de
Performance through Multithreading
 ●   Multithreading leads to much higher throughput
 ●   How to achieve multithreading without locking
     support?
                                                                             64
                                                                             32
                                                                             16
                                                                             8
                                                                         4
                                                                         2



                                                                         1
                                                                                  Core i7,
                                                                                  4 cores
                                                                                  (2 + 2 HT)
LinuxTag Berlin, 13. 5. 2011   (c) 2011 by Mikio L. Braun   @mikiobraun, blog.mikiobraun.de
Performance through Multithreading
 ●   Multithreading leads to much higher throughput
 ●   How to achieve multithreading without locking
     support?




LinuxTag Berlin, 13. 5. 2011   (c) 2011 by Mikio L. Braun   @mikiobraun, blog.mikiobraun.de
Cassandra Tuning
 ●   Tuning opportunities:
      ●   Size of memtables, thresholds for flushes
      ●   Size of JVM Heap
      ●   Frequency and depth of compaction
 ●   Where?
      ●   MemTableThresholds etc. in conf/cassandra.yaml
      ●   JVM Parameters in conf/cassandra-env.sh




LinuxTag Berlin, 13. 5. 2011      (c) 2011 by Mikio L. Braun   @mikiobraun, blog.mikiobraun.de
Overview of JVM GC
                                                                     Old Generation
                  Young Generation
                                                                                 CMSInitiatingOccupancyFraction




              “Eden”           “Survivors”
                                                                                         Additional memory
                                                                                         usage while GC
            up to a few hundred MB                                    dozens of GBs      is running

LinuxTag Berlin, 13. 5. 2011            (c) 2011 by Mikio L. Braun       @mikiobraun, blog.mikiobraun.de
Cassandra's Memory Usage




            Flush
                                              Memtables,
                                              indexes, etc.




Size of Memtable: 128M, JVM Heap: 3G, #CF: 12            Compaction
 LinuxTag Berlin, 13. 5. 2011   (c) 2011 by Mikio L. Braun      @mikiobraun, blog.mikiobraun.de
Cassandra's Memory Usage
 ●   Memtables may survive for a very long time (up
     to several hours)
      ●   are placed in old generation
      ●   GC has to process several dozen GBs
      ●   heap to small, GC triggered too late
               “GC storm”
 ●   Trade-off:
      ●   I/O load vs. memory usage
 ●   Do not neglect compaction!

LinuxTag Berlin, 13. 5. 2011   (c) 2011 by Mikio L. Braun   @mikiobraun, blog.mikiobraun.de
The Effects of GC and Compactions




                                                       Große
                                                        GC
                               Compaction




LinuxTag Berlin, 13. 5. 2011        (c) 2011 by Mikio L. Braun   @mikiobraun, blog.mikiobraun.de
Cluster vs Single Node
●   Our set-up:
     ●   1 Cluster with six-core CPU and RAID 5 with 6 hard disks
     ●   4 Cluster with six-core CPU and RAID 0 with 2 hard disks
●   Single node consistently performs 1,5-3 times better.
●   Possible causes:
     ●   Overhead through network communication/consistency levels, etc.
     ●   Hard disk performance significant
     ●   Cluster still too small
●   Effectively available disk space:
     ●   1 Cluster: 6 * 500 GB = 3TB with RAID 5 = 2.5 TB (83%)
     ●   4 Cluster: 4 * 1TB = 4TB with replication factor 2 = 2TB (50%)

LinuxTag Berlin, 13. 5. 2011   (c) 2011 by Mikio L. Braun   @mikiobraun, blog.mikiobraun.de
Alternatives
 ●   MongoDB, CouchDB, redis, even
     memcached... .
 ●   Persistency: Disk or RAM?
 ●   Replication: Master/Slave or Peer-to-Peer?
 ●   Sharding?
 ●   Upcoming trend towards more complex query
     languages (Javascript), map-reduce operations,
     etc.


LinuxTag Berlin, 13. 5. 2011   (c) 2011 by Mikio L. Braun   @mikiobraun, blog.mikiobraun.de
Summary: Cassandra
 ●   Platform which scales well
 ●   Active user and developer community
 ●   Read operations quite expensive
 ●   For optimal performance, extensive tuning
     necessary
 ●   Depending on your application, eventually
     consistent and lack of transactions/locking might
     be problematic.


LinuxTag Berlin, 13. 5. 2011   (c) 2011 by Mikio L. Braun   @mikiobraun, blog.mikiobraun.de
Links
●   Apache Cassandra http://cassandra.apache.org
●   Apache Cassandra Wiki
    http://wiki.apache.org/cassandra/FrontPage
●   DataStax Dokumentation für Cassandra
    http://www.datastax.com/docs/0.7/index
●   My Blog: http://blog.mikiobraun.de
●   Twimpact: http://beta.twimpact.com




LinuxTag Berlin, 13. 5. 2011   (c) 2011 by Mikio L. Braun   @mikiobraun, blog.mikiobraun.de

More Related Content

Viewers also liked

Cassandra Explained
Cassandra ExplainedCassandra Explained
Cassandra Explained
Eric Evans
 

Viewers also liked (6)

Cassandra Explained
Cassandra ExplainedCassandra Explained
Cassandra Explained
 
Append only data stores
Append only data storesAppend only data stores
Append only data stores
 
An Overview of Apache Cassandra
An Overview of Apache CassandraAn Overview of Apache Cassandra
An Overview of Apache Cassandra
 
Cassandra Introduction & Features
Cassandra Introduction & FeaturesCassandra Introduction & Features
Cassandra Introduction & Features
 
Introduction to memcached
Introduction to memcachedIntroduction to memcached
Introduction to memcached
 
Cassandra NoSQL Tutorial
Cassandra NoSQL TutorialCassandra NoSQL Tutorial
Cassandra NoSQL Tutorial
 

Similar to Cassandra - An Introduction

Using-The-Common-Space-DUG-Datatel-Miko
Using-The-Common-Space-DUG-Datatel-MikoUsing-The-Common-Space-DUG-Datatel-Miko
Using-The-Common-Space-DUG-Datatel-Miko
MIKO ..
 
Dotnet interview qa
Dotnet interview qaDotnet interview qa
Dotnet interview qa
abcxyzqaz
 
Building services using windows azure
Building services using windows azureBuilding services using windows azure
Building services using windows azure
Suliman AlBattat
 

Similar to Cassandra - An Introduction (20)

C++0x
C++0xC++0x
C++0x
 
NoSql databases
NoSql databasesNoSql databases
NoSql databases
 
Using-The-Common-Space-DUG-Datatel-Miko
Using-The-Common-Space-DUG-Datatel-MikoUsing-The-Common-Space-DUG-Datatel-Miko
Using-The-Common-Space-DUG-Datatel-Miko
 
Lotusphere 2007 BP301 Advanced Object Oriented Programming for LotusScript
Lotusphere 2007 BP301 Advanced Object Oriented Programming for LotusScriptLotusphere 2007 BP301 Advanced Object Oriented Programming for LotusScript
Lotusphere 2007 BP301 Advanced Object Oriented Programming for LotusScript
 
Dotnet interview qa
Dotnet interview qaDotnet interview qa
Dotnet interview qa
 
Socket Programming In Python
Socket Programming In PythonSocket Programming In Python
Socket Programming In Python
 
Summary of "Cassandra" for 3rd nosql summer reading in Tokyo
Summary of "Cassandra" for 3rd nosql summer reading in TokyoSummary of "Cassandra" for 3rd nosql summer reading in Tokyo
Summary of "Cassandra" for 3rd nosql summer reading in Tokyo
 
olibc: Another C Library optimized for Embedded Linux
olibc: Another C Library optimized for Embedded Linuxolibc: Another C Library optimized for Embedded Linux
olibc: Another C Library optimized for Embedded Linux
 
Serialization in .NET
Serialization in .NETSerialization in .NET
Serialization in .NET
 
"Source Code Abstracts Classification Using CNN", Vadim Markovtsev, Lead Soft...
"Source Code Abstracts Classification Using CNN", Vadim Markovtsev, Lead Soft..."Source Code Abstracts Classification Using CNN", Vadim Markovtsev, Lead Soft...
"Source Code Abstracts Classification Using CNN", Vadim Markovtsev, Lead Soft...
 
Framework Design Guidelines For Brussels Users Group
Framework Design Guidelines For Brussels Users GroupFramework Design Guidelines For Brussels Users Group
Framework Design Guidelines For Brussels Users Group
 
Presentation of Python, Django, DockerStack
Presentation of Python, Django, DockerStackPresentation of Python, Django, DockerStack
Presentation of Python, Django, DockerStack
 
Peyton jones-2011-parallel haskell-the_future
Peyton jones-2011-parallel haskell-the_futurePeyton jones-2011-parallel haskell-the_future
Peyton jones-2011-parallel haskell-the_future
 
Simon Peyton Jones: Managing parallelism
Simon Peyton Jones: Managing parallelismSimon Peyton Jones: Managing parallelism
Simon Peyton Jones: Managing parallelism
 
Building services using windows azure
Building services using windows azureBuilding services using windows azure
Building services using windows azure
 
The Why and How of Scala at Twitter
The Why and How of Scala at TwitterThe Why and How of Scala at Twitter
The Why and How of Scala at Twitter
 
Python Pants Build System for Large Codebases
Python Pants Build System for Large CodebasesPython Pants Build System for Large Codebases
Python Pants Build System for Large Codebases
 
OrientDB introduction - NoSQL
OrientDB introduction - NoSQLOrientDB introduction - NoSQL
OrientDB introduction - NoSQL
 
C#ppt
C#pptC#ppt
C#ppt
 
Lotusphere 2007 AD507 Leveraging the Power of Object Oriented Programming in ...
Lotusphere 2007 AD507 Leveraging the Power of Object Oriented Programming in ...Lotusphere 2007 AD507 Leveraging the Power of Object Oriented Programming in ...
Lotusphere 2007 AD507 Leveraging the Power of Object Oriented Programming in ...
 

More from Mikio L. Braun (8)

Bringing ML To Production, What Is Missing? AMLD 2020
Bringing ML To Production, What Is Missing? AMLD 2020Bringing ML To Production, What Is Missing? AMLD 2020
Bringing ML To Production, What Is Missing? AMLD 2020
 
Academia to industry looking back on a decade of ml
Academia to industry looking back on a decade of mlAcademia to industry looking back on a decade of ml
Academia to industry looking back on a decade of ml
 
Architecting AI Applications
Architecting AI ApplicationsArchitecting AI Applications
Architecting AI Applications
 
Machine Learning for Time Series, Strata London 2018
Machine Learning for Time Series, Strata London 2018Machine Learning for Time Series, Strata London 2018
Machine Learning for Time Series, Strata London 2018
 
Hardcore Data Science - in Practice
Hardcore Data Science - in PracticeHardcore Data Science - in Practice
Hardcore Data Science - in Practice
 
Data flow vs. procedural programming: How to put your algorithms into Flink
Data flow vs. procedural programming: How to put your algorithms into FlinkData flow vs. procedural programming: How to put your algorithms into Flink
Data flow vs. procedural programming: How to put your algorithms into Flink
 
Scalable Machine Learning
Scalable Machine LearningScalable Machine Learning
Scalable Machine Learning
 
Realtime Data Analysis Patterns
Realtime Data Analysis PatternsRealtime Data Analysis Patterns
Realtime Data Analysis Patterns
 

Recently uploaded

Recently uploaded (20)

Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
 
Connecting the Dots in Product Design at KAYAK
Connecting the Dots in Product Design at KAYAKConnecting the Dots in Product Design at KAYAK
Connecting the Dots in Product Design at KAYAK
 
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdfLinux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
 
Powerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara LaskowskaPowerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara Laskowska
 
Demystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyDemystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John Staveley
 
Designing for Hardware Accessibility at Comcast
Designing for Hardware Accessibility at ComcastDesigning for Hardware Accessibility at Comcast
Designing for Hardware Accessibility at Comcast
 
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
 
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdfSimplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
 
Buy Epson EcoTank L3210 Colour Printer Online.pptx
Buy Epson EcoTank L3210 Colour Printer Online.pptxBuy Epson EcoTank L3210 Colour Printer Online.pptx
Buy Epson EcoTank L3210 Colour Printer Online.pptx
 
Strategic AI Integration in Engineering Teams
Strategic AI Integration in Engineering TeamsStrategic AI Integration in Engineering Teams
Strategic AI Integration in Engineering Teams
 
The Metaverse: Are We There Yet?
The  Metaverse:    Are   We  There  Yet?The  Metaverse:    Are   We  There  Yet?
The Metaverse: Are We There Yet?
 
What's New in Teams Calling, Meetings and Devices April 2024
What's New in Teams Calling, Meetings and Devices April 2024What's New in Teams Calling, Meetings and Devices April 2024
What's New in Teams Calling, Meetings and Devices April 2024
 
WSO2CONMay2024OpenSourceConferenceDebrief.pptx
WSO2CONMay2024OpenSourceConferenceDebrief.pptxWSO2CONMay2024OpenSourceConferenceDebrief.pptx
WSO2CONMay2024OpenSourceConferenceDebrief.pptx
 
UiPath Test Automation using UiPath Test Suite series, part 2
UiPath Test Automation using UiPath Test Suite series, part 2UiPath Test Automation using UiPath Test Suite series, part 2
UiPath Test Automation using UiPath Test Suite series, part 2
 
IESVE for Early Stage Design and Planning
IESVE for Early Stage Design and PlanningIESVE for Early Stage Design and Planning
IESVE for Early Stage Design and Planning
 
Where to Learn More About FDO _ Richard at FIDO Alliance.pdf
Where to Learn More About FDO _ Richard at FIDO Alliance.pdfWhere to Learn More About FDO _ Richard at FIDO Alliance.pdf
Where to Learn More About FDO _ Richard at FIDO Alliance.pdf
 
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
 
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
 
Optimizing NoSQL Performance Through Observability
Optimizing NoSQL Performance Through ObservabilityOptimizing NoSQL Performance Through Observability
Optimizing NoSQL Performance Through Observability
 
UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1
 

Cassandra - An Introduction

  • 1. Cassandra – An Introduction Mikio L. Braun Leo Jugel TU Berlin, twimpact LinuxTag Berlin 13. Mai 2011 LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 2. What is NoSQL ● For many web applications, “classical data bases” are not the right choice: ● Database is just used for storing objects. ● Consistency not essential. ● A lot of concurrent access. LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 3. NoSQL in comparison Classical Databases NoSQL Powerful query language very simple query language Scales by using larger servers skales through clustering (“scaling up”) (“scaling out”) Changes of database schema very costly No fixed database schema ACID: Atomicity, Consistency, Isolation, Typically only “eventually consistent” Duratbility Transactions, locking, etc. Typically no support for transactions etc. LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 4. Brewer's CAP Theorem ● CAP: Consistency, Availability, Partition Tolerance ● Consistency: You never get old data. ● Availability: read/write operations always possible. ● Partition Tolerance: other guarantees hold even if network of servers break. ● You can only have two of these! Gilbert, Lynch, Brewer's conjecture and the feasibility of consistent, available, partition- tolerant web services, ACM SIGACT News, Volume 33, Issue 2, June 2002 LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 5. Homepage http://cassandra.apache.org Language Java History ● Developed at Facebook for inbox search, released as Open Source in July 2008 ● Apache Incubator since March 2009 ● Apache Top-Level since February 2010 Main Properties ● structured key value store ● “eventually consistent” ● fully equivalent nodes ● cluster can be modified without restarting Support DataStax (http://datastax.com) Licence Apache 2.0 LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 6. Version 0.6.x and 0.7.x ● Most important changes in 0.7.x ● config file format changed from XML to YAML ● schema modification (ColumnFamilies) without restart ● Beginning support for secondary indices ● However, also problems with stability initially. LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 7. Inspirations for Cassandra ● Amazon Dynamo ● Clustering without dedicated master node ● Peer-to-peer discovery of nodes, HintedHintoff, etc. ● Google BigTable ● data model ● requires central master node ● Provides much more fine grained control: – which data should be stored together – on-the-fly compression, etc. LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 8. Installation ● Download tar.gz from http://cassandra.apache.org/download/ ● Unpack ● ./conf contains config files ● ./bin/cassandra -f to start Cassandra, Ctrl-C to stop LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 9. Configuration ● Database ● Version 0.6.x: conf/storage-conf.xml ● Version 0.7.x: conf/cassandra.yaml ● JVM Parameters ● Version 0.6.x: bin/cassandra.in.sh ● Version 0.7.x: conf/cassandra-env.sh LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 10. Cassandra's Data Model Keyspace (= database) byte arrays Column Family (= table) Row key {name1: value1, name2: value2, name3: value3, ...} column strings sorted by name! sorted according to partitioner Super Column Family key key {name1: value1, ...} LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 11. Example: Simple Object Store class Person { long id; String name; String affiliation; } Convert fields to byte arrays Keyspace “MyDatabase”: ColumnFamily “Person”: “1”: {“id”: “1”, “name”: “Mikio Braun, “affiliation”: “TU Berlin”} LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 12. Example: Index class Page { long id; … Object data fields List<Links> links; } Keyspace “MyDatabase” ColumnFamily “Pages” class Link { “3”: {“id”: 3, …} long id; “4”: {“id”: 4, …} ... Used for both, linking int numberOfHits; ColumnFamily “Links” and indexing! } “1”: {“id”: 1, “url”: …} “17”. {“id”: 17, “url”: …} ColumnFamily “LinksPerPageByNumberOfHits” “3”: { “00000132:00000001”: “t”, “000025: 00000017”: … “4”: { “00000044:00000024”: “t”, … } Here we exploit that columns are sorted by their names. Of course, everything encoded in byte arrays, not ASCII LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 13. Are SuperColumnFamilies necessary? ● Usually, you can replace a SuperColumnFamily by several CollumnFamilies. ● Since SuperColumnFamilies make the implementation and the protocol more compelx, there are also people advocating the remove SuperCFs... . LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 14. Cassandra's Architecture MemTable Read Operation Flush Memory Disk Write Operation Commit Log SSTable SSTable SSTable Compaction! LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 15. Cassandras API ● THRIFT-based API Read operations Write operations get single column insert single column get_slice range of columns batch_mutate several columns in multiget_slice range of columns in several rows several rows remove single column get_count column count truncate while ColumnFamily get_range_slice several columns from range of rows get_indexed_slices range of columns from index Sonstige login, describe_*, add/drop column family/keyspace since 0.7.x LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 16. Cassandra Clustering ● Fully equivalent nodes, no master node. ● Bootstrapping requires seed node. “Storage Proxy” Node Node Node Reads/writes according to consistency level Query LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 17. Consistency Level and Replication Factor ●Replication factor: On how many nodes is a piece of data stored? ● Consistency level: Consistency Level ANY A node has received the operation, even a HintedHandoff node. ONE One node has completed the request. QUORUM Operation has completed on majority of nodes / newest result is returned. LOCAL_QUORUM QUORUM in local data center GLOBAL_QUORUM QUORUM in global data center ALL Wait till all nodes have completed the request LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 18. How to deal with failure ● As long as requirements of the consistency level can be met, everything is fine. ● Hinted Handoff: ● A write operation for a faulty node is stored on another node and pushed to the other node once it is available again. ● Data won't be readable after write! ● Read Repair: ● After read operation has completed, data will be compared and updated on all nodes in the background. LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 19. Libraries Python Pycassa: http://github.com/pycassa/pycass Telephus: http://github.com/driftx/Telephus Java Datanucleus JDO:http://github.com/tnine/Datanucleus-Cassandra-Plugin Hector: http://github.com/rantav/hector Kundera http://code.google.com/p/kundera/ Pelops: http://github.com/s7/scale7-pelops Grails grails-cassandra: https://github.com/wolpert/grails-cassandra .NET Aquiles: http://aquiles.codeplex.com/ FluentCassandra: http://github.com/managedfusion/fluentcassandra Ruby Cassandra: http://github.com/fauna/cassandra PHP phpcassa: http://github.com/thobbs/phpcassa SimpleCassie: http://code.google.com/p/simpletools-php/wiki/SimpleCassie Or roll your own based on THRIFT http://thrift.apache.org/ :) LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 20. TWIMPACT: An Application ● Real-time analysis of Twitter ● Trend analysis based on retweets ● Very high data rate (several million tweets per day, about 50 per second) LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 21. TWIMPACT: twimpact.jp LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 22. TWIMPACT: twimpact.com LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 23. Application Profile ● Information about tweets, users, and retweets ● Text matching for non-API-retweets ● Retweet frequency and user impact ● Operation profile: get_slice get get_slice batch_mutate insert batch_mutate remove (all) (range) (one row) Fraction 50.1% 6.0% 0.1% 14.9% 21.5% 6.8% 0.8% Duration 1.1ms 1.7ms 0.8ms 0.9ms 1.1ms 0.8ms 1.2ms LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 24. Practical Experiences with Cassandra ● Very stable ● Read operations relatively expensive ● Multithreading leads to a huge performance increase ● Requires quite extensive tuning ● Clustering doesn't automatically lead to better performance ● Compaction leads to performance decrease of up to 50% LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 25. Performance through Multithreading ● Multithreading leads to much higher throughput ● How to achieve multithreading without locking support? 64 32 16 8 4 2 1 Core i7, 4 cores (2 + 2 HT) LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 26. Performance through Multithreading ● Multithreading leads to much higher throughput ● How to achieve multithreading without locking support? LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 27. Cassandra Tuning ● Tuning opportunities: ● Size of memtables, thresholds for flushes ● Size of JVM Heap ● Frequency and depth of compaction ● Where? ● MemTableThresholds etc. in conf/cassandra.yaml ● JVM Parameters in conf/cassandra-env.sh LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 28. Overview of JVM GC Old Generation Young Generation CMSInitiatingOccupancyFraction “Eden” “Survivors” Additional memory usage while GC up to a few hundred MB dozens of GBs is running LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 29. Cassandra's Memory Usage Flush Memtables, indexes, etc. Size of Memtable: 128M, JVM Heap: 3G, #CF: 12 Compaction LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 30. Cassandra's Memory Usage ● Memtables may survive for a very long time (up to several hours) ● are placed in old generation ● GC has to process several dozen GBs ● heap to small, GC triggered too late  “GC storm” ● Trade-off: ● I/O load vs. memory usage ● Do not neglect compaction! LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 31. The Effects of GC and Compactions Große GC Compaction LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 32. Cluster vs Single Node ● Our set-up: ● 1 Cluster with six-core CPU and RAID 5 with 6 hard disks ● 4 Cluster with six-core CPU and RAID 0 with 2 hard disks ● Single node consistently performs 1,5-3 times better. ● Possible causes: ● Overhead through network communication/consistency levels, etc. ● Hard disk performance significant ● Cluster still too small ● Effectively available disk space: ● 1 Cluster: 6 * 500 GB = 3TB with RAID 5 = 2.5 TB (83%) ● 4 Cluster: 4 * 1TB = 4TB with replication factor 2 = 2TB (50%) LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 33. Alternatives ● MongoDB, CouchDB, redis, even memcached... . ● Persistency: Disk or RAM? ● Replication: Master/Slave or Peer-to-Peer? ● Sharding? ● Upcoming trend towards more complex query languages (Javascript), map-reduce operations, etc. LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 34. Summary: Cassandra ● Platform which scales well ● Active user and developer community ● Read operations quite expensive ● For optimal performance, extensive tuning necessary ● Depending on your application, eventually consistent and lack of transactions/locking might be problematic. LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de
  • 35. Links ● Apache Cassandra http://cassandra.apache.org ● Apache Cassandra Wiki http://wiki.apache.org/cassandra/FrontPage ● DataStax Dokumentation für Cassandra http://www.datastax.com/docs/0.7/index ● My Blog: http://blog.mikiobraun.de ● Twimpact: http://beta.twimpact.com LinuxTag Berlin, 13. 5. 2011 (c) 2011 by Mikio L. Braun @mikiobraun, blog.mikiobraun.de