State of Cassandra, 2011

State of Cassandra 2011Jonathan EllisApache ChairCTODataStax

Job Trends from Indeed.com 2

Customer and Verticals•  Financial•  Social Media•  Advertising•  Entertainment•  Energy•  E-tail•  Health care•  Government 3

Why?Why? 4 4

Why Cassandra?Why Cassandra? 6 6

Better technology•  Multi-master, multi-DC•  Linearly scalable•  Larger-than-memory datasets•  Best-in-class performance (not just writes!)•  Fully durable•  Integrated caching•  Tuneable consistency 7

Tunable Consistency WRITE READ Level Level ANY ONE ONE LOCAL_QUORUM LOCAL_QUORUM QUORUM QUORUM ALL ALL

Generalizes Easily to Multi-DC 9

0.7•  CREATE COLUMN FAMILY•  Expiring columns (TTL)•  Secondary (column) indexes•  Efficient streaming 1 0

0.8•  CQL•  Counters•  Automatic memtable tuning•  New bulk load interface 1 1

A performance retrospective 1 2

October 8, 2011Road to 1.0 13

Theme: polish•  Repair•  Compaction•  Optimize reads for update-heavy workloads•  CQL 1.1 1 4

Repair•  Consistency is checked per-ColumnFamily but data is transferred per-Keyspace•  Merkle trees requests are sent en masse, but may not execute start at the same time 1 5

Compression•  Rows-per-block or blocks-per-row 1 6

Read Performance: Compaction 1 7

Level-based Compaction•  SSTables are non-overlapping within a level•  Bounds the number that can contain a given row L2: 1000 MB L1: 100 MB L0: newly flushed 1 8

Read performance: maxtimestamp•  Sort sstables by maximum (client-provided) timestamp•  Only merge sstables until we have the columns request•  Allows pre-merging highly fragmented rows without waiting for compaction 1 9

CQL 1.1•  ALTER•  Counter support•  TTL support•  Compound columns•  Prepared statements 2 1

Post-1.0•  Ease of use• Ease of use• Ease of use 2 2

Post-1.0 features•  “Native” CQL transport•  Triggers•  Entity groups•  Smarter range queries 2 3

Brisk•  Analytics for your realtime data without ETL•  Widens scope of Cassandra’s applicability•  Also: Solandra 2 4

QuestionsQues/ons? 25 25

http://cassandra.apache.org	451064
http://translate.googleusercontent.com	665
http://infinitysoft.co.in	116
http://webcache-exp-test.googleusercontent.com	88
http://webcache.googleusercontent.com	54
http://n.clarobr.mobi	42
http://207.46.192.232	19
http://ps.googleusercontent.com	11
http://cassandra.apache.org.	11
http://talktech.blog.com	8
http://shutto.com	8
http://mail-archives.apache.org	8
http://cache.baidu.com	7
http://helpmetocode.blogspot.in	5
http://localhost	5
http://helpmetocode.blogspot.com	3
http://proxyadc2	3
http://cassandra.apache.org.nyud.net	2
http://74.6.238.254	2
http://cc.bingj.com	2
http://honyaku.yahoofs.jp	2
http://cassandra.apache.org&_=1334228131261 HTTP	1
http://cassandra.apache.org&_=1334228023459 HTTP	1
http://10.11.51.1	1
http://cassandra.apache.org&_=1331806034491 HTTP	1
http://bluecoat-01	1
http://cassandra.apache.org&_=1334918477455 HTTP	1
http://cassandra.apache.org&_=1337931394781 HTTP	1
http://cassandra.apache.org&_=1337698307216 HTTP	1
http://10.237.125.89	1
http://stackoverflow.com	1
http://cassandra.apache.org&_=1336310345765 HTTP	1
http://cassandra.apache.org&_=1336310735312 HTTP	1
http://172.23.3.5	1
http://www.google.com&_=1336666414467 HTTP	1
http://incubator.apache.org	1
http://cassandra.apache.org&_=1331198139718 HTTP	1
http://camel.apache.org	1
http://activemq.apache.org	1
http://205.188.242.5	1
http://172.21.112.106&_=1323736540147 HTTP	1
http://172.21.112.106&_=1323736473295 HTTP	1
http://www.google.com	1
http://cassandra.apache.org&_=1322327675763 HTTP	1
http://cassandra.apache.org&_=1322327624157 HTTP	1
http://www.sogou.com	1
http://cassandra.apache.org&_=1325177435964 HTTP	1
http://61n6d2d98f6ghdf4g.ru	1
http://cassandra.apache.org&_=1331198124953 HTTP	1
http://cassandra.apache.org.sixxs.org	1
http://170.2.59.17	1

State of Cassandra, 2011

by jbellis on Aug 01, 2011

Accessibility

Categories

Tags

Upload Details

Usage Rights

57 Embeds 452K

Statistics

State of Cassandra, 2011 — Presentation Transcript