Société Générale: Offre Monitoring as a service avec la Suite Elastic

1. 1
Thibaut BARRAULT, Stéphane LOPES
Société Générale
SG|Monitoring
A SG|MARKETS capabilities

2. 2
* Excluding insurance policyholders.
** Rounded figure. Headcount at end-2018 excluding temporary staff
Societe Generale is one of the leading European financial services groups.
Based on a diversified and integrated banking model, the Group combines financial
strength
and proven expertise in innovation with a strategy of sustainable growth, aiming to be
the
trusted partner for its clients, committed to the positive transformations of the world.
3 complementary core businesses:
• French Retail Banking
• International Retail Banking & Financial Services
• Global Banking & Investor Solutions
31 million*
individual clients, businesses and
institutional investors
+ 149,000**
members of staff
67 countries
worldwide
€3,864 million
Group Net Income
€25,205 million
in Net Banking Income
10.9%
Common Equity Tier 1 ratio
OUR VALUES
Team Spirit Innovation Responsibility Commitment
SOCIETE GENERALE
The company

3. 3
WHO ARE WE ?
SG|Monitoring technical
architect
10+ years experience deploying
monitoring solutions
THIBAUT B. STEPHANE L.
8 team members
GBIS/GBSU/ARC
SG|Monitoring
The team
450 Web sites
SG|Monitoring application
manager
10+ years experience deploying
monitoring solutions
350 API
150 Business
applications

4. 4
THE (SHORT) STORY
Metric AlertThreshold
… and then the event came.
Observability
At the beginning was the metric …

5. 5
THE EVENT
WHO
WHERE
WHEN
WHAT
FOR
Event Based Monitoring
The missing link between technical and functional
worlds

6. 6
THE 4 LAYERS
APP A
APP D APP E
APPLICATION
CHAIN
INFRASTRUCTURE
CPU DISK NETWORK DATABASE MIDDLWARE
. . .
APPLICATION
APP B
BUSINESS
PROCESS
NEGOCIATION EXECUTION
PRE
BOOKING BOOKING
DEAL
PROCESSING . . .
IT
CLIENT
BUSINESS
TECHNICAL
BUSINESS
SG|MONITORING
The long way to the business value

7. 7
THE SOLUTION(S)
Gateway Event store
Event
Dashboard
Gateway
Portal
Matomo Analytics
store
Span
Server
Config store
Alert store
Alert
manager
Business
Application
Business
API
Business
Web Sites
Alert
Processor
Streamer API store
Api
Dashbaord
+
Per application
THE SOLUTION(S)
Application data using SG|Monitring public endpoints
Client UI
Internal flow
Streamer
Elastic is at the heart of our solution

8. 8
STAY OPEN (BUT ... )
Hosting User
Support
Software
Support
UpgradeLicence Change
Management
$ $$
Alerta Grafana Matomo Zipkin
Hazelcas
t
Kubernete
s
Drools Jenkins
$
Hosting User
Support
Software
Support
UpgradeLicence Change
Management
$$$ $ $$ $
Elastic Cloud
Entrerprise
The ugly truth : No license fee ≠ free
$

9. 9
• Multiple Elasticsearch clusters
created
• Business Chain monitoring
TIMELINE
20162013
• Traders interested
2014 201
5 2017 2018
• Multiple Elasticsearch clusters
created
• Web analytics
• Multiple Elasticsearch clusters
created • API Monitoring
• Multiple Elasticsearch clusters
created
• Infrastructure monitoring
improvement
• Multiple Elasticsearch clusters
created
• ECE in PRODUCTION
• POC on security topics with ML
• POC on business chain with
Canvas & Vega
• Performance monitoring
• Multiple Elasticsearch clusters
managed
2019
0
100
200
300
400
# Elasticsearch clusters
An incremental and pragmatic approach

10. 10
IN DETAILS - PORTAL
Integration in a feature oriented portal

11. 11

12. 12
BUSINESS CHAIN
MONITORING
Application A, Application B
Application C, Application D
Application E
Application F
Application G
Live Notifications of Latency
/ Missing trades / Trades inerror
SLA=1s-20secmax
HTTP
HTTP
HTTP
Alert processor
1. Correlation engine to
follow trade cycle
between applicative
layers
2. Rolling mode to discard
useless data (1M facts/
day)
3. Latency analysis
Front office UI
Front Officers
Support Officers
HTTP
Data Complexity
1 Trade
1 Trade
1 Trade
N Facts
N Facts
N Facts
HTTP
Creating business value from monitoring

13. 13

14. 14
IMPORTANT POINTS
• Business case
• Maintenance cost
• Change management
• Scalability axis
• Why subscription ?
• Central management with ECE
• Elastic support
• Oauth authentication
• Machine learning
• Public cloud
• ROI 30% cost savings
• Tips
• Installation with help of Elastic experts
• Architecture review
• Understand very well the ES tuning for performance
Integration in a feature oriented portal