Exploiting Hotel Cassandra
cqlsh> SELECT * FROM presentations WHERE eventname='CassandraSummit' AND company='ING' AND year=2015;
eventname | company | year | area | name | presentation | title | twitter
-----------------+---------+------+------+---------------------+-----------------------------+-----------------------+-----------
CassandraSummit | ING | 2015 | NL | Christopher Reedijk | ExploitING Hotel Cassandra | Engineer/Chapter Lead | @creedijk
CassandraSummit | ING | 2015 | NL | Gary Stewart | ExploitING Hotel Cassandra | Engineer/Architect | @Gaz_GandA
(2 rows)
cqlsh> SELECT * FROM presentations WHERE eventname='CassandraSummit' AND company='ING';
eventname | company | year | area | name | presentation | title | twitter
-----------------+---------+------+------+---------------------+-----------------------------+-----------------------+-----------
CassandraSummit | ING | 2015 | NL | Christopher Reedijk | ExploitING Hotel Cassandra | Engineer/Chapter Lead | @creedijk
CassandraSummit | ING | 2015 | NL | Gary Stewart | ExploitING Hotel Cassandra | Engineer/Architect | @Gaz_GandA
CassandraSummit | ING | 2014 | NL | Christopher Reedijk | C*@ING: Testing the waters | Dev Engineer | @creedijk
CassandraSummit | ING | 2014 | NL | Gary Stewart | C*@ING: Testing the waters | Dev Engineer | @Gaz_GandA
(4 rows)
Exploiting Hotel Cassandra
Market leaders Benelux
Growth markets
Commercial Banking
Challengers
3
World map
Over 40 countries
52,000+ employees
Market leaders Benelux
Growth markets
Commercial Banking
Challengers
4
European map
Full-service bank
Very strong European base
Ranked 7th
Largest bank of NL
150+ DevOps teams
• Engineer / Architect
• Love/hate relationship with C*
• 15 years of experience in IT
• @ING since: 01-01-2012
• Engineer / Chapter Lead
• Back-end guy
• 11 years of experience in IT
• @ING since: 01-01-2011
5
a little bit about us
Gary Stewart Christopher Reedijk
#CassandraSummit
6
on a dark desert highway #CassandraSummit
There was a need for
availability
There was a need for
consistency
There was a need for
scalability
7
on a dark desert highway #CassandraSummit
• Lots of small use cases
• Lots of DevOps teams
• No ephemeral (dedicated) storage
• Zero to none NoSQL experience
my head grew heavy and my sight grew dim
8
#CassandraSummit
this could be Heaven or this could be Hell
9
#CassandraSummit
• Cassandra seemed to be the solution
• How to work with this paradigm shift
• Are we ready for it?
this could be Heaven or this could be Hell
10
#CassandraSummit
then she lit up a candle and she showed me the way
11
#CassandraSummit
APIs and Cassandra are a great fit
e.g. http://host/customer/{id}
then she lit up a candle and she showed me the way
12
#CassandraSummit
welcome to the Hotel Cassandra
13
#CassandraSummit
• Combine the small use cases
• Keeping costs in mind
• Do we dare to share?
welcome to the Hotel Cassandra
14
#CassandraSummit
such a lovely place..., such a lovely face
15
#CassandraSummit
Luxury
Hotel
1100+ colleagues trained
4 certified trainers
35+ DevOps teams
12 clusters (4/5 environments)
Containment
Reduce paperwork
Unexpected load
Infrastructure
Functionality
MonitoringAdvice
Life cycle
management
Security
Velocity
Training
16
plenty of room at the hotel cassandra #CassandraSummit
17
sandbox feedback containment
plenty of room at the hotel cassandra #CassandraSummit
some dance to remember, some dance to forget
18
#CassandraSummit
• Can our hardware give us containment?
YES, but very expensive
• Can Cassandra offer containment?
NO, not on keyspace level
• Can other technologies give us containment?
PARTIALLY, but involves new technologies
• Can our software give us containment?
YES, but needs ownership
some dance to remember, some dance to forget
19
#CassandraSummit
so I called up the Captain
20
#CassandraSummit
so I called up the Captain
21
#CassandraSummit
so I called up the Captain
22
#CassandraSummit
please bring me my wine
23
#CassandraSummit
please bring me my wine
24
#CassandraSummit
please bring me my wine
25
#CassandraSummit
please bring me my wine
26
#CassandraSummit
please bring me my wine
27
#CassandraSummit
they livin' it up at the hotel cassandra
28
#CassandraSummit
they livin' it up at the hotel cassandra
29
#CassandraSummit
what a nice surprise..., bring your alibis
30
#CassandraSummit
what a nice surprise..., bring your alibis
31
#CassandraSummit
• SSD's for SOLR/Spark
• 3.6TB Nodes
• 3 Data Centers
• Spinning disks
• 3.6TB Nodes
• Spinning disks
• 10-15TB per node
• Date Tiered Compaction
32
mirrors on the ceiling..., the pink champagne on ice #CassandraSummit
we are all just prisoners here, of our own device
33
#CassandraSummit
we are all just prisoners here, of our own device
34
#CassandraSummit
they stab it with their steely knives
35
#CassandraSummit
they stab it with their steely knives
36
#CassandraSummit
they stab it with their steely knives
37
#CassandraSummit
but they just can't kill the beast
38
#CassandraSummit
• Tracking of queries in order to give more insight in
common best practices and actual use case pattern
• Cross-environment datamodel check
• Capacity management with prediction
• ...
but they just can't kill the beast
39
#CassandraSummit
40
you can check-out any time you like..., but you can never leave! #CassandraSummit
There is the need for
availability
There is the need for
consistency
There is the need for
scalability
41
you can check-out any time you like..., but you can never leave! #CassandraSummit
Thank you
christopher.reedijk@ing.nl
@creedijk
gary.stewart@ing.nl
@Gaz_GandA
visuals by Isabelle Hörl:
www.isabellehorl.com | @IsabelleHorl
we are hiring!
Follow us to stay a step ahead
ING.com
YouTube.com/ING
SlideShare.net/ING@ING_News LinkedIn.com/company/ING
Flickr.com/INGGroupFacebook.com/ING
ING Group’s Annual Accounts are prepared in accordance with
International Financial Reporting Standards as adopted by the
European Union (‘IFRS-EU’).
In preparing the financial information in this document, the same
accounting principles are applied as in the 2014 ING Group Annual
Accounts. All figures in this document are unaudited. Small
differences are possible in the tables due to rounding.
Certain of the statements contained herein are not historical facts,
including, without limitation, certain statements made of future
expectations and other forward-looking statements that are based
on management’s current views and assumptions and involve
known and unknown risks and uncertainties that could cause actual
results, performance or events to differ materially from those
expressed or implied in such statements. Actual results,
performance or events may differ materially from those in such
statements due to, without limitation: (1) changes in general
economic conditions, in particular economic conditions in ING’s core
markets, (2) changes in performance of financial markets, including
developing markets, (3) consequences of a potential (partial) break-
up of the euro, (4) the implementation of ING’s restructuring plan to
separate banking and insurance operations, (5) changes in the
availability of, and costs associated with, sources of liquidity such as
interbank funding, as well as conditions in the credit markets
generally, including changes in borrower and counterparty
creditworthiness, (6) the frequency and severity of insured loss
events, (7) changes affecting mortality and
morbidity levels and trends,(8) changes affecting persistency levels,
(9) changes affecting interest rate levels, (10) changes affecting
currency exchange rates, (11) changes in investor, customer and
policyholder behaviour, (12) changes in general competitive factors,
(13) changes in laws and regulations, (14) changes in the policies of
governments and/or regulatory authorities, (15) conclusions with
regard to purchase accounting assumptions and methodologies,
(16) changes in ownership that could affect the future availability to
us of net operating loss, net capital and built-in loss carry forwards,
(17) changes in credit ratings, (18) ING’s ability to achieve projected
operational synergies and (19) the other risks and uncertainties
detailed in the Risk Factors section contained in the most recent
annual report of ING Groep N.V. Any forward-looking statements
made by or on behalf of ING speak only as of the date they are
made, and, ING assumes no obligation to publicly update or revise
any forward-looking statements, whether as a result of new
information or for any other reason.
This document does not constitute an offer to sell, or a solicitation
of an offer to purchase, any securities in the United States or any
other jurisdiction. The securities of NN Group have not been and will
not be registered under the U.S. Securities Act of 1933, as amended
(the “Securities Act”), and may not be offered or sold within the
United States absent registration or an applicable exemption from
the registration requirements of the Securities Act.
www.ing.com
Disclaimer
44

Exploiting hotel Cassandra

  • 1.
    Exploiting Hotel Cassandra cqlsh>SELECT * FROM presentations WHERE eventname='CassandraSummit' AND company='ING' AND year=2015; eventname | company | year | area | name | presentation | title | twitter -----------------+---------+------+------+---------------------+-----------------------------+-----------------------+----------- CassandraSummit | ING | 2015 | NL | Christopher Reedijk | ExploitING Hotel Cassandra | Engineer/Chapter Lead | @creedijk CassandraSummit | ING | 2015 | NL | Gary Stewart | ExploitING Hotel Cassandra | Engineer/Architect | @Gaz_GandA (2 rows)
  • 2.
    cqlsh> SELECT *FROM presentations WHERE eventname='CassandraSummit' AND company='ING'; eventname | company | year | area | name | presentation | title | twitter -----------------+---------+------+------+---------------------+-----------------------------+-----------------------+----------- CassandraSummit | ING | 2015 | NL | Christopher Reedijk | ExploitING Hotel Cassandra | Engineer/Chapter Lead | @creedijk CassandraSummit | ING | 2015 | NL | Gary Stewart | ExploitING Hotel Cassandra | Engineer/Architect | @Gaz_GandA CassandraSummit | ING | 2014 | NL | Christopher Reedijk | C*@ING: Testing the waters | Dev Engineer | @creedijk CassandraSummit | ING | 2014 | NL | Gary Stewart | C*@ING: Testing the waters | Dev Engineer | @Gaz_GandA (4 rows) Exploiting Hotel Cassandra
  • 3.
    Market leaders Benelux Growthmarkets Commercial Banking Challengers 3 World map Over 40 countries 52,000+ employees
  • 4.
    Market leaders Benelux Growthmarkets Commercial Banking Challengers 4 European map Full-service bank Very strong European base Ranked 7th Largest bank of NL 150+ DevOps teams
  • 5.
    • Engineer /Architect • Love/hate relationship with C* • 15 years of experience in IT • @ING since: 01-01-2012 • Engineer / Chapter Lead • Back-end guy • 11 years of experience in IT • @ING since: 01-01-2011 5 a little bit about us Gary Stewart Christopher Reedijk #CassandraSummit
  • 6.
    6 on a darkdesert highway #CassandraSummit
  • 7.
    There was aneed for availability There was a need for consistency There was a need for scalability 7 on a dark desert highway #CassandraSummit
  • 8.
    • Lots ofsmall use cases • Lots of DevOps teams • No ephemeral (dedicated) storage • Zero to none NoSQL experience my head grew heavy and my sight grew dim 8 #CassandraSummit
  • 9.
    this could beHeaven or this could be Hell 9 #CassandraSummit
  • 10.
    • Cassandra seemedto be the solution • How to work with this paradigm shift • Are we ready for it? this could be Heaven or this could be Hell 10 #CassandraSummit
  • 11.
    then she litup a candle and she showed me the way 11 #CassandraSummit
  • 12.
    APIs and Cassandraare a great fit e.g. http://host/customer/{id} then she lit up a candle and she showed me the way 12 #CassandraSummit
  • 13.
    welcome to theHotel Cassandra 13 #CassandraSummit
  • 14.
    • Combine thesmall use cases • Keeping costs in mind • Do we dare to share? welcome to the Hotel Cassandra 14 #CassandraSummit
  • 15.
    such a lovelyplace..., such a lovely face 15 #CassandraSummit Luxury Hotel 1100+ colleagues trained 4 certified trainers 35+ DevOps teams 12 clusters (4/5 environments) Containment Reduce paperwork Unexpected load Infrastructure Functionality MonitoringAdvice Life cycle management Security Velocity Training
  • 16.
    16 plenty of roomat the hotel cassandra #CassandraSummit
  • 17.
    17 sandbox feedback containment plentyof room at the hotel cassandra #CassandraSummit
  • 18.
    some dance toremember, some dance to forget 18 #CassandraSummit
  • 19.
    • Can ourhardware give us containment? YES, but very expensive • Can Cassandra offer containment? NO, not on keyspace level • Can other technologies give us containment? PARTIALLY, but involves new technologies • Can our software give us containment? YES, but needs ownership some dance to remember, some dance to forget 19 #CassandraSummit
  • 20.
    so I calledup the Captain 20 #CassandraSummit
  • 21.
    so I calledup the Captain 21 #CassandraSummit
  • 22.
    so I calledup the Captain 22 #CassandraSummit
  • 23.
    please bring memy wine 23 #CassandraSummit
  • 24.
    please bring memy wine 24 #CassandraSummit
  • 25.
    please bring memy wine 25 #CassandraSummit
  • 26.
    please bring memy wine 26 #CassandraSummit
  • 27.
    please bring memy wine 27 #CassandraSummit
  • 28.
    they livin' itup at the hotel cassandra 28 #CassandraSummit
  • 29.
    they livin' itup at the hotel cassandra 29 #CassandraSummit
  • 30.
    what a nicesurprise..., bring your alibis 30 #CassandraSummit
  • 31.
    what a nicesurprise..., bring your alibis 31 #CassandraSummit
  • 32.
    • SSD's forSOLR/Spark • 3.6TB Nodes • 3 Data Centers • Spinning disks • 3.6TB Nodes • Spinning disks • 10-15TB per node • Date Tiered Compaction 32 mirrors on the ceiling..., the pink champagne on ice #CassandraSummit
  • 33.
    we are alljust prisoners here, of our own device 33 #CassandraSummit
  • 34.
    we are alljust prisoners here, of our own device 34 #CassandraSummit
  • 35.
    they stab itwith their steely knives 35 #CassandraSummit
  • 36.
    they stab itwith their steely knives 36 #CassandraSummit
  • 37.
    they stab itwith their steely knives 37 #CassandraSummit
  • 38.
    but they justcan't kill the beast 38 #CassandraSummit
  • 39.
    • Tracking ofqueries in order to give more insight in common best practices and actual use case pattern • Cross-environment datamodel check • Capacity management with prediction • ... but they just can't kill the beast 39 #CassandraSummit
  • 40.
    40 you can check-outany time you like..., but you can never leave! #CassandraSummit
  • 41.
    There is theneed for availability There is the need for consistency There is the need for scalability 41 you can check-out any time you like..., but you can never leave! #CassandraSummit
  • 42.
    Thank you christopher.reedijk@ing.nl @creedijk gary.stewart@ing.nl @Gaz_GandA visuals byIsabelle Hörl: www.isabellehorl.com | @IsabelleHorl we are hiring!
  • 43.
    Follow us tostay a step ahead ING.com YouTube.com/ING SlideShare.net/ING@ING_News LinkedIn.com/company/ING Flickr.com/INGGroupFacebook.com/ING
  • 44.
    ING Group’s AnnualAccounts are prepared in accordance with International Financial Reporting Standards as adopted by the European Union (‘IFRS-EU’). In preparing the financial information in this document, the same accounting principles are applied as in the 2014 ING Group Annual Accounts. All figures in this document are unaudited. Small differences are possible in the tables due to rounding. Certain of the statements contained herein are not historical facts, including, without limitation, certain statements made of future expectations and other forward-looking statements that are based on management’s current views and assumptions and involve known and unknown risks and uncertainties that could cause actual results, performance or events to differ materially from those expressed or implied in such statements. Actual results, performance or events may differ materially from those in such statements due to, without limitation: (1) changes in general economic conditions, in particular economic conditions in ING’s core markets, (2) changes in performance of financial markets, including developing markets, (3) consequences of a potential (partial) break- up of the euro, (4) the implementation of ING’s restructuring plan to separate banking and insurance operations, (5) changes in the availability of, and costs associated with, sources of liquidity such as interbank funding, as well as conditions in the credit markets generally, including changes in borrower and counterparty creditworthiness, (6) the frequency and severity of insured loss events, (7) changes affecting mortality and morbidity levels and trends,(8) changes affecting persistency levels, (9) changes affecting interest rate levels, (10) changes affecting currency exchange rates, (11) changes in investor, customer and policyholder behaviour, (12) changes in general competitive factors, (13) changes in laws and regulations, (14) changes in the policies of governments and/or regulatory authorities, (15) conclusions with regard to purchase accounting assumptions and methodologies, (16) changes in ownership that could affect the future availability to us of net operating loss, net capital and built-in loss carry forwards, (17) changes in credit ratings, (18) ING’s ability to achieve projected operational synergies and (19) the other risks and uncertainties detailed in the Risk Factors section contained in the most recent annual report of ING Groep N.V. Any forward-looking statements made by or on behalf of ING speak only as of the date they are made, and, ING assumes no obligation to publicly update or revise any forward-looking statements, whether as a result of new information or for any other reason. This document does not constitute an offer to sell, or a solicitation of an offer to purchase, any securities in the United States or any other jurisdiction. The securities of NN Group have not been and will not be registered under the U.S. Securities Act of 1933, as amended (the “Securities Act”), and may not be offered or sold within the United States absent registration or an applicable exemption from the registration requirements of the Securities Act. www.ing.com Disclaimer 44