SlideShare a Scribd company logo
There and back again,
ING’s Cassandra Tale
Datastax Summit 2016
Gary Stewart, @Gaz_GandA
Christopher Reedijk, @creedijk
London, April 19, 2016
Market leaders Benelux
Growth markets
Commercial Banking
Challengers
2
European map
Full-service bank
Very strong European base
IT is something ING does
Largest bank of NL
150+ Squads
20+ use cases in production
Engineer / Architect Engineer / Chapter Lead
3
a little bit about us
Gary Stewart Christopher Reedijk
#DataStaxSummit
4
the contract … #DataStaxSummit
5
an unexpected party #DataStaxSummit
DevOpsEngineers
Managers
InfraEngineers
6
an unexpected journey #DataStaxSummit
Financial Fit
7
#DataStaxSummit
the trolls of data modeling
8
#DataStaxSummit
Think about the queries first!
Sometimes storing JSON in text
is best
saved by …
9
#DataStaxSummit
Lonely Planet
10
#DataStaxSummit
11
the goblins of data querying #DataStaxSummit
Don’t do table scans
Think about Read path
i.e. avoid increasing sequential
reads as data grows
Do performance tests even for
small use-cases!
12
saved by … #DataStaxSummit
iDeal
13
#DataStaxSummit
14
the riddles of Gollum #DataStaxSummit
What could go wrong this time ….
NTP killed the happy flow
Customers couldn’t go to next page 
the riddles of time
15
#DataStaxSummit
NTP killed the happy flow
Customers couldn’t go to next page 
Versioning to the rescue
saved by …
16
#DataStaxSummit
Experiments API
17
#DataStaxSummit
Aggressive distributed
Read-after-Write, causing
read-repair-blocking
18
the spiders of 99 percentile #DataStaxSummit
Be careful with read-after-write
Always check the functionality
of the framework you’re using
19
saved by … #DataStaxSummit
Cached Data
20
#DataStaxSummit
SizeTieredCompactionStrategy
Default, compact after 4 sstables
20GB data needs 100GB+ storage
the loss of storage
21
SST1 SST1 SST2 SST1 SST2 SST3 SST1 SST2 SST3 SST4 SST5
FLUSH
FLUSH
FLUSH FLUSH
COMPACT
#DataStaxSummit
Data space required is now
around 50% less!
Attention to details can save i/o
and disk space
saved by …
22
SST1 SST1 SST2 SST3
FLUSH
FLUSH
COMPACT
#DataStaxSummit
Fraud Investigation
23
#DataStaxSummit
Bad performance and nodes
dying constantly
Network and GC issues
Hinted handoffs going crazy
Very long GC-pauses causing nodes to freeze
Never ending compactions
24
the wood elves of network #DataStaxSummit
Take a step back
Upgraded to 4.8.5
with G1GC (default when using Java 8)
4.7.3 is way too chatty
Increased heap and new to
16GB and 8GB
for coordinator nodes,
which in our case are all 
25
saved by … #DataStaxSummit
Incoming
Traffic
26
the desolation of smaug #DataStaxSummit
Think top-down – queries first
Talk about failures
Experimentation – Sandbox
Environment that is safe to fail
Take a step back
understand the architecture
flow of data
ensure you are understanding the problem
27
desolated by … #DataStaxSummit
28
the battle of 5 armies #DataStaxSummit
29
the battle of 5 armies #DataStaxSummit
InfraEngineers
DevOpsEngineers
Architects
???
Managers
Each time we ventured out there
with new insights ready to take on new epic
challenges
And each time we came back
Bit bruised but never broken 
More willing to share
And rolled out into PRD
30
there and back … #DataStaxSummit
again and again and again …
31
#DataStaxSummit
Thank you
christopher.reedijk@ing.nl
@creedijk
gary.stewart@ing.nl
@Gaz_GandA
visuals by Isabelle Hörl:
www.isabellehorl.com | @IsabelleHorl
we are hiring!
Follow us to stay a step ahead
ING.com
YouTube.com/ING
SlideShare.net/ING@ING_News LinkedIn.com/company/ING
Flickr.com/INGGroupFacebook.com/ING
ING Group’s Annual Accounts are prepared in accordance with
International Financial Reporting Standards as adopted by the
European Union (‘IFRS-EU’).
In preparing the financial information in this document, the same
accounting principles are applied as in the 2014 ING Group Annual
Accounts. All figures in this document are unaudited. Small
differences are possible in the tables due to rounding.
Certain of the statements contained herein are not historical facts,
including, without limitation, certain statements made of future
expectations and other forward-looking statements that are based
on management’s current views and assumptions and involve
known and unknown risks and uncertainties that could cause actual
results, performance or events to differ materially from those
expressed or implied in such statements. Actual results,
performance or events may differ materially from those in such
statements due to, without limitation: (1) changes in general
economic conditions, in particular economic conditions in ING’s core
markets, (2) changes in performance of financial markets, including
developing markets, (3) consequences of a potential (partial) break-
up of the euro, (4) the implementation of ING’s restructuring plan to
separate banking and insurance operations, (5) changes in the
availability of, and costs associated with, sources of liquidity such as
interbank funding, as well as conditions in the credit markets
generally, including changes in borrower and counterparty
creditworthiness, (6) the frequency and severity of insured loss
events, (7) changes affecting mortality and
morbidity levels and trends,(8) changes affecting persistency levels,
(9) changes affecting interest rate levels, (10) changes affecting
currency exchange rates, (11) changes in investor, customer and
policyholder behaviour, (12) changes in general competitive factors,
(13) changes in laws and regulations, (14) changes in the policies of
governments and/or regulatory authorities, (15) conclusions with
regard to purchase accounting assumptions and methodologies,
(16) changes in ownership that could affect the future availability to
us of net operating loss, net capital and built-in loss carry forwards,
(17) changes in credit ratings, (18) ING’s ability to achieve projected
operational synergies and (19) the other risks and uncertainties
detailed in the Risk Factors section contained in the most recent
annual report of ING Groep N.V. Any forward-looking statements
made by or on behalf of ING speak only as of the date they are
made, and, ING assumes no obligation to publicly update or revise
any forward-looking statements, whether as a result of new
information or for any other reason.
This document does not constitute an offer to sell, or a solicitation
of an offer to purchase, any securities in the United States or any
other jurisdiction. The securities of NN Group have not been and will
not be registered under the U.S. Securities Act of 1933, as amended
(the “Securities Act”), and may not be offered or sold within the
United States absent registration or an applicable exemption from
the registration requirements of the Securities Act.
www.ing.com
Disclaimer
34

More Related Content

Similar to Cassandra at ING - There and back again

There and Back again, ING's Cassandra Tale (Christopher Reedijk, Gary Stewart...
There and Back again, ING's Cassandra Tale (Christopher Reedijk, Gary Stewart...There and Back again, ING's Cassandra Tale (Christopher Reedijk, Gary Stewart...
There and Back again, ING's Cassandra Tale (Christopher Reedijk, Gary Stewart...
DataStax
 
ING Groep N.V.: ExploitING Hotel Cassandra
ING Groep N.V.: ExploitING Hotel CassandraING Groep N.V.: ExploitING Hotel Cassandra
ING Groep N.V.: ExploitING Hotel Cassandra
DataStax Academy
 
Video: The State of the Solid State Drive SSD
Video: The State of the Solid State Drive SSDVideo: The State of the Solid State Drive SSD
Video: The State of the Solid State Drive SSD
inside-BigData.com
 
Big Data in Global Telecom Market: Key Trends, Market Opportunities and Indus...
Big Data in Global Telecom Market: Key Trends, Market Opportunities and Indus...Big Data in Global Telecom Market: Key Trends, Market Opportunities and Indus...
Big Data in Global Telecom Market: Key Trends, Market Opportunities and Indus...
Market Research Reports, Inc.
 
GraphTour - ING - Fighting insanity
GraphTour - ING - Fighting insanityGraphTour - ING - Fighting insanity
GraphTour - ING - Fighting insanity
Neo4j
 
Big data in Private Banking
Big data in Private BankingBig data in Private Banking
Big data in Private Banking
Jérôme Kehrli
 
Global Data Center Rack PDU Market 2017 - 2021
Global Data Center Rack PDU Market 2017 - 2021Global Data Center Rack PDU Market 2017 - 2021
Global Data Center Rack PDU Market 2017 - 2021
Market Research Reports, Inc.
 
The Internet of Things: The next growth engine for the semiconductor industry
The Internet of Things: The next growth engine for the semiconductor industryThe Internet of Things: The next growth engine for the semiconductor industry
The Internet of Things: The next growth engine for the semiconductor industry
PwC
 
Deutsche Bank Survey Sees Blockchain Adoption in Six Years
Deutsche Bank Survey Sees Blockchain Adoption in Six YearsDeutsche Bank Survey Sees Blockchain Adoption in Six Years
Deutsche Bank Survey Sees Blockchain Adoption in Six Years
Nicola Barozzi 🚘✔
 
Deutsche bank investor_report - blockchain is coming sooner than you think
Deutsche bank investor_report -  blockchain is coming sooner than you thinkDeutsche bank investor_report -  blockchain is coming sooner than you think
Deutsche bank investor_report - blockchain is coming sooner than you think
Ian Beckett
 
Signals Flash Nov 2017: 5G in Americas | Signals Research Group
Signals Flash Nov 2017: 5G in Americas | Signals Research GroupSignals Flash Nov 2017: 5G in Americas | Signals Research Group
Signals Flash Nov 2017: 5G in Americas | Signals Research Group
3G4G
 
ORBCOMM Investor Overview
ORBCOMM Investor OverviewORBCOMM Investor Overview
ORBCOMM Investor Overview
ORBCOMM Inc.
 
Plc splitter market
Plc splitter marketPlc splitter market
Plc splitter market
Sagarmaratha1
 
ITIL and DEVOPS can be friends
ITIL and DEVOPS can be friendsITIL and DEVOPS can be friends
ITIL and DEVOPS can be friends
ING-IT
 
Elasticsearch: From development to production in 15 minutes
Elasticsearch: From development to production in 15 minutesElasticsearch: From development to production in 15 minutes
Elasticsearch: From development to production in 15 minutes
Elasticsearch
 
Samsung Q4 2008 earnings release
Samsung Q4 2008 earnings releaseSamsung Q4 2008 earnings release
Samsung Q4 2008 earnings release
earningsreport
 
The Determinants of Foreign Direct Investment: A study based on country-level...
The Determinants of Foreign Direct Investment: A study based on country-level...The Determinants of Foreign Direct Investment: A study based on country-level...
The Determinants of Foreign Direct Investment: A study based on country-level...Yi Zhang
 
ORBCOMM Investor Overview
ORBCOMM Investor OverviewORBCOMM Investor Overview
ORBCOMM Investor Overview
ORBCOMM Inc.
 
DockerCon 2017 - General Session Day 2 - Ben Golub
DockerCon 2017 - General Session Day 2 - Ben GolubDockerCon 2017 - General Session Day 2 - Ben Golub
DockerCon 2017 - General Session Day 2 - Ben Golub
Docker, Inc.
 
ENTG-Investor-Analyst-Update-2021-FINAL.pdf
ENTG-Investor-Analyst-Update-2021-FINAL.pdfENTG-Investor-Analyst-Update-2021-FINAL.pdf
ENTG-Investor-Analyst-Update-2021-FINAL.pdf
KyleLee118804
 

Similar to Cassandra at ING - There and back again (20)

There and Back again, ING's Cassandra Tale (Christopher Reedijk, Gary Stewart...
There and Back again, ING's Cassandra Tale (Christopher Reedijk, Gary Stewart...There and Back again, ING's Cassandra Tale (Christopher Reedijk, Gary Stewart...
There and Back again, ING's Cassandra Tale (Christopher Reedijk, Gary Stewart...
 
ING Groep N.V.: ExploitING Hotel Cassandra
ING Groep N.V.: ExploitING Hotel CassandraING Groep N.V.: ExploitING Hotel Cassandra
ING Groep N.V.: ExploitING Hotel Cassandra
 
Video: The State of the Solid State Drive SSD
Video: The State of the Solid State Drive SSDVideo: The State of the Solid State Drive SSD
Video: The State of the Solid State Drive SSD
 
Big Data in Global Telecom Market: Key Trends, Market Opportunities and Indus...
Big Data in Global Telecom Market: Key Trends, Market Opportunities and Indus...Big Data in Global Telecom Market: Key Trends, Market Opportunities and Indus...
Big Data in Global Telecom Market: Key Trends, Market Opportunities and Indus...
 
GraphTour - ING - Fighting insanity
GraphTour - ING - Fighting insanityGraphTour - ING - Fighting insanity
GraphTour - ING - Fighting insanity
 
Big data in Private Banking
Big data in Private BankingBig data in Private Banking
Big data in Private Banking
 
Global Data Center Rack PDU Market 2017 - 2021
Global Data Center Rack PDU Market 2017 - 2021Global Data Center Rack PDU Market 2017 - 2021
Global Data Center Rack PDU Market 2017 - 2021
 
The Internet of Things: The next growth engine for the semiconductor industry
The Internet of Things: The next growth engine for the semiconductor industryThe Internet of Things: The next growth engine for the semiconductor industry
The Internet of Things: The next growth engine for the semiconductor industry
 
Deutsche Bank Survey Sees Blockchain Adoption in Six Years
Deutsche Bank Survey Sees Blockchain Adoption in Six YearsDeutsche Bank Survey Sees Blockchain Adoption in Six Years
Deutsche Bank Survey Sees Blockchain Adoption in Six Years
 
Deutsche bank investor_report - blockchain is coming sooner than you think
Deutsche bank investor_report -  blockchain is coming sooner than you thinkDeutsche bank investor_report -  blockchain is coming sooner than you think
Deutsche bank investor_report - blockchain is coming sooner than you think
 
Signals Flash Nov 2017: 5G in Americas | Signals Research Group
Signals Flash Nov 2017: 5G in Americas | Signals Research GroupSignals Flash Nov 2017: 5G in Americas | Signals Research Group
Signals Flash Nov 2017: 5G in Americas | Signals Research Group
 
ORBCOMM Investor Overview
ORBCOMM Investor OverviewORBCOMM Investor Overview
ORBCOMM Investor Overview
 
Plc splitter market
Plc splitter marketPlc splitter market
Plc splitter market
 
ITIL and DEVOPS can be friends
ITIL and DEVOPS can be friendsITIL and DEVOPS can be friends
ITIL and DEVOPS can be friends
 
Elasticsearch: From development to production in 15 minutes
Elasticsearch: From development to production in 15 minutesElasticsearch: From development to production in 15 minutes
Elasticsearch: From development to production in 15 minutes
 
Samsung Q4 2008 earnings release
Samsung Q4 2008 earnings releaseSamsung Q4 2008 earnings release
Samsung Q4 2008 earnings release
 
The Determinants of Foreign Direct Investment: A study based on country-level...
The Determinants of Foreign Direct Investment: A study based on country-level...The Determinants of Foreign Direct Investment: A study based on country-level...
The Determinants of Foreign Direct Investment: A study based on country-level...
 
ORBCOMM Investor Overview
ORBCOMM Investor OverviewORBCOMM Investor Overview
ORBCOMM Investor Overview
 
DockerCon 2017 - General Session Day 2 - Ben Golub
DockerCon 2017 - General Session Day 2 - Ben GolubDockerCon 2017 - General Session Day 2 - Ben Golub
DockerCon 2017 - General Session Day 2 - Ben Golub
 
ENTG-Investor-Analyst-Update-2021-FINAL.pdf
ENTG-Investor-Analyst-Update-2021-FINAL.pdfENTG-Investor-Analyst-Update-2021-FINAL.pdf
ENTG-Investor-Analyst-Update-2021-FINAL.pdf
 

Recently uploaded

Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024
Globus
 
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Globus
 
Navigating the Metaverse: A Journey into Virtual Evolution"
Navigating the Metaverse: A Journey into Virtual Evolution"Navigating the Metaverse: A Journey into Virtual Evolution"
Navigating the Metaverse: A Journey into Virtual Evolution"
Donna Lenk
 
How to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good PracticesHow to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good Practices
Globus
 
Enhancing Research Orchestration Capabilities at ORNL.pdf
Enhancing Research Orchestration Capabilities at ORNL.pdfEnhancing Research Orchestration Capabilities at ORNL.pdf
Enhancing Research Orchestration Capabilities at ORNL.pdf
Globus
 
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptxTop Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
rickgrimesss22
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
Top 7 Unique WhatsApp API Benefits | Saudi Arabia
Top 7 Unique WhatsApp API Benefits | Saudi ArabiaTop 7 Unique WhatsApp API Benefits | Saudi Arabia
Top 7 Unique WhatsApp API Benefits | Saudi Arabia
Yara Milbes
 
GlobusWorld 2024 Opening Keynote session
GlobusWorld 2024 Opening Keynote sessionGlobusWorld 2024 Opening Keynote session
GlobusWorld 2024 Opening Keynote session
Globus
 
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing SuiteAI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
Google
 
Prosigns: Transforming Business with Tailored Technology Solutions
Prosigns: Transforming Business with Tailored Technology SolutionsProsigns: Transforming Business with Tailored Technology Solutions
Prosigns: Transforming Business with Tailored Technology Solutions
Prosigns
 
Developing Distributed High-performance Computing Capabilities of an Open Sci...
Developing Distributed High-performance Computing Capabilities of an Open Sci...Developing Distributed High-performance Computing Capabilities of an Open Sci...
Developing Distributed High-performance Computing Capabilities of an Open Sci...
Globus
 
How Recreation Management Software Can Streamline Your Operations.pptx
How Recreation Management Software Can Streamline Your Operations.pptxHow Recreation Management Software Can Streamline Your Operations.pptx
How Recreation Management Software Can Streamline Your Operations.pptx
wottaspaceseo
 
Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024
Globus
 
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamOpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
takuyayamamoto1800
 
Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume MontevideoVitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke
 
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
Juraj Vysvader
 
Vitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke Java Microservices Resume.pdfVitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke
 
Large Language Models and the End of Programming
Large Language Models and the End of ProgrammingLarge Language Models and the End of Programming
Large Language Models and the End of Programming
Matt Welsh
 
First Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User EndpointsFirst Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User Endpoints
Globus
 

Recently uploaded (20)

Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024
 
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
 
Navigating the Metaverse: A Journey into Virtual Evolution"
Navigating the Metaverse: A Journey into Virtual Evolution"Navigating the Metaverse: A Journey into Virtual Evolution"
Navigating the Metaverse: A Journey into Virtual Evolution"
 
How to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good PracticesHow to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good Practices
 
Enhancing Research Orchestration Capabilities at ORNL.pdf
Enhancing Research Orchestration Capabilities at ORNL.pdfEnhancing Research Orchestration Capabilities at ORNL.pdf
Enhancing Research Orchestration Capabilities at ORNL.pdf
 
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptxTop Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
Top 7 Unique WhatsApp API Benefits | Saudi Arabia
Top 7 Unique WhatsApp API Benefits | Saudi ArabiaTop 7 Unique WhatsApp API Benefits | Saudi Arabia
Top 7 Unique WhatsApp API Benefits | Saudi Arabia
 
GlobusWorld 2024 Opening Keynote session
GlobusWorld 2024 Opening Keynote sessionGlobusWorld 2024 Opening Keynote session
GlobusWorld 2024 Opening Keynote session
 
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing SuiteAI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
 
Prosigns: Transforming Business with Tailored Technology Solutions
Prosigns: Transforming Business with Tailored Technology SolutionsProsigns: Transforming Business with Tailored Technology Solutions
Prosigns: Transforming Business with Tailored Technology Solutions
 
Developing Distributed High-performance Computing Capabilities of an Open Sci...
Developing Distributed High-performance Computing Capabilities of an Open Sci...Developing Distributed High-performance Computing Capabilities of an Open Sci...
Developing Distributed High-performance Computing Capabilities of an Open Sci...
 
How Recreation Management Software Can Streamline Your Operations.pptx
How Recreation Management Software Can Streamline Your Operations.pptxHow Recreation Management Software Can Streamline Your Operations.pptx
How Recreation Management Software Can Streamline Your Operations.pptx
 
Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024
 
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamOpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
 
Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume MontevideoVitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume Montevideo
 
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
 
Vitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke Java Microservices Resume.pdfVitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke Java Microservices Resume.pdf
 
Large Language Models and the End of Programming
Large Language Models and the End of ProgrammingLarge Language Models and the End of Programming
Large Language Models and the End of Programming
 
First Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User EndpointsFirst Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User Endpoints
 

Cassandra at ING - There and back again

  • 1. There and back again, ING’s Cassandra Tale Datastax Summit 2016 Gary Stewart, @Gaz_GandA Christopher Reedijk, @creedijk London, April 19, 2016
  • 2. Market leaders Benelux Growth markets Commercial Banking Challengers 2 European map Full-service bank Very strong European base IT is something ING does Largest bank of NL 150+ Squads 20+ use cases in production
  • 3. Engineer / Architect Engineer / Chapter Lead 3 a little bit about us Gary Stewart Christopher Reedijk #DataStaxSummit
  • 4. 4 the contract … #DataStaxSummit
  • 5. 5 an unexpected party #DataStaxSummit DevOpsEngineers Managers InfraEngineers
  • 6. 6 an unexpected journey #DataStaxSummit
  • 8. the trolls of data modeling 8 #DataStaxSummit
  • 9. Think about the queries first! Sometimes storing JSON in text is best saved by … 9 #DataStaxSummit
  • 11. 11 the goblins of data querying #DataStaxSummit
  • 12. Don’t do table scans Think about Read path i.e. avoid increasing sequential reads as data grows Do performance tests even for small use-cases! 12 saved by … #DataStaxSummit
  • 14. 14 the riddles of Gollum #DataStaxSummit What could go wrong this time ….
  • 15. NTP killed the happy flow Customers couldn’t go to next page  the riddles of time 15 #DataStaxSummit
  • 16. NTP killed the happy flow Customers couldn’t go to next page  Versioning to the rescue saved by … 16 #DataStaxSummit
  • 19. Be careful with read-after-write Always check the functionality of the framework you’re using 19 saved by … #DataStaxSummit
  • 21. SizeTieredCompactionStrategy Default, compact after 4 sstables 20GB data needs 100GB+ storage the loss of storage 21 SST1 SST1 SST2 SST1 SST2 SST3 SST1 SST2 SST3 SST4 SST5 FLUSH FLUSH FLUSH FLUSH COMPACT #DataStaxSummit
  • 22. Data space required is now around 50% less! Attention to details can save i/o and disk space saved by … 22 SST1 SST1 SST2 SST3 FLUSH FLUSH COMPACT #DataStaxSummit
  • 24. Bad performance and nodes dying constantly Network and GC issues Hinted handoffs going crazy Very long GC-pauses causing nodes to freeze Never ending compactions 24 the wood elves of network #DataStaxSummit
  • 25. Take a step back Upgraded to 4.8.5 with G1GC (default when using Java 8) 4.7.3 is way too chatty Increased heap and new to 16GB and 8GB for coordinator nodes, which in our case are all  25 saved by … #DataStaxSummit Incoming Traffic
  • 26. 26 the desolation of smaug #DataStaxSummit
  • 27. Think top-down – queries first Talk about failures Experimentation – Sandbox Environment that is safe to fail Take a step back understand the architecture flow of data ensure you are understanding the problem 27 desolated by … #DataStaxSummit
  • 28. 28 the battle of 5 armies #DataStaxSummit
  • 29. 29 the battle of 5 armies #DataStaxSummit InfraEngineers DevOpsEngineers Architects ??? Managers
  • 30. Each time we ventured out there with new insights ready to take on new epic challenges And each time we came back Bit bruised but never broken  More willing to share And rolled out into PRD 30 there and back … #DataStaxSummit
  • 31. again and again and again … 31 #DataStaxSummit
  • 32. Thank you christopher.reedijk@ing.nl @creedijk gary.stewart@ing.nl @Gaz_GandA visuals by Isabelle Hörl: www.isabellehorl.com | @IsabelleHorl we are hiring!
  • 33. Follow us to stay a step ahead ING.com YouTube.com/ING SlideShare.net/ING@ING_News LinkedIn.com/company/ING Flickr.com/INGGroupFacebook.com/ING
  • 34. ING Group’s Annual Accounts are prepared in accordance with International Financial Reporting Standards as adopted by the European Union (‘IFRS-EU’). In preparing the financial information in this document, the same accounting principles are applied as in the 2014 ING Group Annual Accounts. All figures in this document are unaudited. Small differences are possible in the tables due to rounding. Certain of the statements contained herein are not historical facts, including, without limitation, certain statements made of future expectations and other forward-looking statements that are based on management’s current views and assumptions and involve known and unknown risks and uncertainties that could cause actual results, performance or events to differ materially from those expressed or implied in such statements. Actual results, performance or events may differ materially from those in such statements due to, without limitation: (1) changes in general economic conditions, in particular economic conditions in ING’s core markets, (2) changes in performance of financial markets, including developing markets, (3) consequences of a potential (partial) break- up of the euro, (4) the implementation of ING’s restructuring plan to separate banking and insurance operations, (5) changes in the availability of, and costs associated with, sources of liquidity such as interbank funding, as well as conditions in the credit markets generally, including changes in borrower and counterparty creditworthiness, (6) the frequency and severity of insured loss events, (7) changes affecting mortality and morbidity levels and trends,(8) changes affecting persistency levels, (9) changes affecting interest rate levels, (10) changes affecting currency exchange rates, (11) changes in investor, customer and policyholder behaviour, (12) changes in general competitive factors, (13) changes in laws and regulations, (14) changes in the policies of governments and/or regulatory authorities, (15) conclusions with regard to purchase accounting assumptions and methodologies, (16) changes in ownership that could affect the future availability to us of net operating loss, net capital and built-in loss carry forwards, (17) changes in credit ratings, (18) ING’s ability to achieve projected operational synergies and (19) the other risks and uncertainties detailed in the Risk Factors section contained in the most recent annual report of ING Groep N.V. Any forward-looking statements made by or on behalf of ING speak only as of the date they are made, and, ING assumes no obligation to publicly update or revise any forward-looking statements, whether as a result of new information or for any other reason. This document does not constitute an offer to sell, or a solicitation of an offer to purchase, any securities in the United States or any other jurisdiction. The securities of NN Group have not been and will not be registered under the U.S. Securities Act of 1933, as amended (the “Securities Act”), and may not be offered or sold within the United States absent registration or an applicable exemption from the registration requirements of the Securities Act. www.ing.com Disclaimer 34