Datastax Academy: What ? Why ? How ?
DuyHai DOAN
Cassandra as Infrastructure Technology
•  ING (Cassandra as a service)
•  Netflix
•  Sony Playstation Network
•  Microsoft Office 365
•  Ebay (40Tb in a single table …)
•  Etc ..
© 2015 DataStax, All Rights Reserved.
 2
Cassandra as Infrastructure Technology
•  The SMACK stack as an alternative to the Hadoop stack for streaming
•  Spark
•  Mesos
•  Akka
•  Cassandra
•  Kafka
•  Read @helenaedelson slides here http://goo.gl/cCIE7F
© 2015 DataStax, All Rights Reserved.
 3
Rich eco-system around Cassandra
•  Apache Spark (C* connector)
•  Apache Zeppelin (C* interpreter)
•  Apache Mesos (https://github.com/mesosphere/cassandra-mesos)
•  Apache Kafka (KIP-30)
•  Apache Shiro (C* as cluster session store)
•  Hunk, JasperSoft, Pentaho, Tableau ..
© 2015 DataStax, All Rights Reserved.
 4
Increasing SQL-like features
•  CQL DML (SELECT, INSERT, UPDATE, DELETE …)
•  CQL DDL CREATE/ALTER/DROP (SCHEMA, TABLE, TYPE, FUNCTION …)
•  CQL Credentials
•  CREATE/ALTER/DROP (USER, ROLE)
•  GRANT <xxx> PERMISSION ON <resource> TO <user_name>
•  REVOKE <xxx> PERMISSION ON <resource> FROM <user_name>
© 2015 DataStax, All Rights Reserved.
 5
Increasing SQL-like features
•  User Defined Functions
CREATE [OR REPLACE] FUNCTION [IF NOT EXISTS] keyspace';'function-name ( <arg-name> <arg-type> )
(CALLED | RETURNS NULL) ON NULL INPUT
RETURNS <type>
LANGUAGE <language>
AS <body>
© 2015 DataStax, All Rights Reserved.
 6
Increasing SQL-like features
•  Materialized Views
CREATE MATERIALIZED VIEW [IF NOT EXISTS] keyspace_name.view_name AS
SELECT column1, column2, ...
FROM keyspace_name.table_name
WHERE column1 IS NOT NULL AND column2 IS NOT NULL ...
PRIMARY KEY(column1, column2, ...)
•  Real time notifications (CDC) CASSANDRA-8844
© 2015 DataStax, All Rights Reserved.
 7
More powerful search in future
•  Apple open-sourced Secondary Index Impl
•  https://github.com/xedin/sasi
CREATE CUSTOM INDEX ON sasi (bio) USING
'org.apache.cassandra.db.index.SSTableAttachedSecondaryIndex'
WITH OPTIONS = {
'analyzer_class': 'org.apache.cassandra.db.index.sasi.analyzer.StandardAnalyzer',
'tokenization_enable_stemming': 'true',
'analyzed': 'true',
'tokenization_normalize_lowercase': 'true',
'tokenization_locale': 'en'
};
© 2015 DataStax, All Rights Reserved.
 8
More powerful search in future
•  Apple open-sourced Secondary Index Impl
•  https://github.com/xedin/sasi
SELECT *
FROM sasi
WHERE (created_at > 1442959315018 OR first_name = 'P')
AND age > 26
ALLOW FILTERING;
© 2015 DataStax, All Rights Reserved.
 9
More powerful search in future
•  Limited to 2.0.x branch
•  Needs special patch to OSS code
•  Support only COMPACT STORAGE table
•  Only compatible with Murmur3Partitioner
•  CASSANDRA-10661 to merge to Cassandra 3.0 !!!
•  Github issues to support full CQL3 (https://github.com/xedin/sasi/issues/3)
© 2015 DataStax, All Rights Reserved.
 10
Datastax Gartner reports (Operational DB)
© 2015 DataStax, All Rights Reserved.
 11
Oct 2013
Datastax Gartner reports (Operational DB)
© 2015 DataStax, All Rights Reserved.
 12
Oct 2014
Datastax Gartner reports (Operational DB)
© 2015 DataStax, All Rights Reserved.
 13
Oct 2015
Cassandra Job Trend
© 2015 DataStax, All Rights Reserved.
 14
Cassandra Job Offers (I’ve received)
© 2015 DataStax, All Rights Reserved.
 15
Cassandra Job Offers (I’ve received)
© 2015 DataStax, All Rights Reserved.
 16
Problem ?
© 2015 DataStax, All Rights Reserved.
 17
•  Lack of Cassandra skills
•  Difficulty to hire Cassandra experts
Solution: https://academy.datastax.com
© 2015 DataStax, All Rights Reserved.
 18
Self-Paced Courses
19
© 2015 DataStax, All Rights Reserved.
FREE
Instructor-Led Training
20
© 2015 DataStax, All Rights Reserved.
FREE
O’Reilly Certification
21
© 2015 DataStax, All Rights Reserved.
Technical Evangelists
22
© 2015 DataStax, All Rights Reserved.
•  On-site help, data-modeling, cluster health check
•  duy_hai.doan@datastax.com, @doanduyhai
FREE
From Devs & Ops perspective
23
© 2015 DataStax, All Rights Reserved.
Cassandra is mainstream
+
You are trained & certified
=
Career Boost
24
© 2015 DataStax, All Rights Reserved.
academy.datastax.com

Data stax academy

  • 1.
    Datastax Academy: What? Why ? How ? DuyHai DOAN
  • 2.
    Cassandra as InfrastructureTechnology •  ING (Cassandra as a service) •  Netflix •  Sony Playstation Network •  Microsoft Office 365 •  Ebay (40Tb in a single table …) •  Etc .. © 2015 DataStax, All Rights Reserved. 2
  • 3.
    Cassandra as InfrastructureTechnology •  The SMACK stack as an alternative to the Hadoop stack for streaming •  Spark •  Mesos •  Akka •  Cassandra •  Kafka •  Read @helenaedelson slides here http://goo.gl/cCIE7F © 2015 DataStax, All Rights Reserved. 3
  • 4.
    Rich eco-system aroundCassandra •  Apache Spark (C* connector) •  Apache Zeppelin (C* interpreter) •  Apache Mesos (https://github.com/mesosphere/cassandra-mesos) •  Apache Kafka (KIP-30) •  Apache Shiro (C* as cluster session store) •  Hunk, JasperSoft, Pentaho, Tableau .. © 2015 DataStax, All Rights Reserved. 4
  • 5.
    Increasing SQL-like features • CQL DML (SELECT, INSERT, UPDATE, DELETE …) •  CQL DDL CREATE/ALTER/DROP (SCHEMA, TABLE, TYPE, FUNCTION …) •  CQL Credentials •  CREATE/ALTER/DROP (USER, ROLE) •  GRANT <xxx> PERMISSION ON <resource> TO <user_name> •  REVOKE <xxx> PERMISSION ON <resource> FROM <user_name> © 2015 DataStax, All Rights Reserved. 5
  • 6.
    Increasing SQL-like features • User Defined Functions CREATE [OR REPLACE] FUNCTION [IF NOT EXISTS] keyspace';'function-name ( <arg-name> <arg-type> ) (CALLED | RETURNS NULL) ON NULL INPUT RETURNS <type> LANGUAGE <language> AS <body> © 2015 DataStax, All Rights Reserved. 6
  • 7.
    Increasing SQL-like features • Materialized Views CREATE MATERIALIZED VIEW [IF NOT EXISTS] keyspace_name.view_name AS SELECT column1, column2, ... FROM keyspace_name.table_name WHERE column1 IS NOT NULL AND column2 IS NOT NULL ... PRIMARY KEY(column1, column2, ...) •  Real time notifications (CDC) CASSANDRA-8844 © 2015 DataStax, All Rights Reserved. 7
  • 8.
    More powerful searchin future •  Apple open-sourced Secondary Index Impl •  https://github.com/xedin/sasi CREATE CUSTOM INDEX ON sasi (bio) USING 'org.apache.cassandra.db.index.SSTableAttachedSecondaryIndex' WITH OPTIONS = { 'analyzer_class': 'org.apache.cassandra.db.index.sasi.analyzer.StandardAnalyzer', 'tokenization_enable_stemming': 'true', 'analyzed': 'true', 'tokenization_normalize_lowercase': 'true', 'tokenization_locale': 'en' }; © 2015 DataStax, All Rights Reserved. 8
  • 9.
    More powerful searchin future •  Apple open-sourced Secondary Index Impl •  https://github.com/xedin/sasi SELECT * FROM sasi WHERE (created_at > 1442959315018 OR first_name = 'P') AND age > 26 ALLOW FILTERING; © 2015 DataStax, All Rights Reserved. 9
  • 10.
    More powerful searchin future •  Limited to 2.0.x branch •  Needs special patch to OSS code •  Support only COMPACT STORAGE table •  Only compatible with Murmur3Partitioner •  CASSANDRA-10661 to merge to Cassandra 3.0 !!! •  Github issues to support full CQL3 (https://github.com/xedin/sasi/issues/3) © 2015 DataStax, All Rights Reserved. 10
  • 11.
    Datastax Gartner reports(Operational DB) © 2015 DataStax, All Rights Reserved. 11 Oct 2013
  • 12.
    Datastax Gartner reports(Operational DB) © 2015 DataStax, All Rights Reserved. 12 Oct 2014
  • 13.
    Datastax Gartner reports(Operational DB) © 2015 DataStax, All Rights Reserved. 13 Oct 2015
  • 14.
    Cassandra Job Trend ©2015 DataStax, All Rights Reserved. 14
  • 15.
    Cassandra Job Offers(I’ve received) © 2015 DataStax, All Rights Reserved. 15
  • 16.
    Cassandra Job Offers(I’ve received) © 2015 DataStax, All Rights Reserved. 16
  • 17.
    Problem ? © 2015DataStax, All Rights Reserved. 17 •  Lack of Cassandra skills •  Difficulty to hire Cassandra experts
  • 18.
    Solution: https://academy.datastax.com © 2015DataStax, All Rights Reserved. 18
  • 19.
    Self-Paced Courses 19 © 2015DataStax, All Rights Reserved. FREE
  • 20.
    Instructor-Led Training 20 © 2015DataStax, All Rights Reserved. FREE
  • 21.
    O’Reilly Certification 21 © 2015DataStax, All Rights Reserved.
  • 22.
    Technical Evangelists 22 © 2015DataStax, All Rights Reserved. •  On-site help, data-modeling, cluster health check •  duy_hai.doan@datastax.com, @doanduyhai FREE
  • 23.
    From Devs &Ops perspective 23 © 2015 DataStax, All Rights Reserved. Cassandra is mainstream + You are trained & certified = Career Boost
  • 24.
    24 © 2015 DataStax,All Rights Reserved. academy.datastax.com