SlideShare a Scribd company logo
App Modernization with Aerospike
as an Intraday System of Record
Venkat Thamminana
Managing Director, Portfolio
Management Technology
Charles Schwab
Proprietary & Confidential | All rights reserved. © 2023 Aerospike, Inc.
Modernization goals
a. Vision- Build better, faster and cheaper solutions
b. Architectural principles
i. One operational data store
ii. No local caching at VM level
iii.Maximum code reuse
iv.Avoid or minimize calls outside CLR/JVM
v. App tier is just business logic and on light weight VMs
2
Proprietary & Confidential | All rights reserved. © 2023 Aerospike, Inc.
Trading architecture view- 2014 vs now
2014 view
a. All the core trading applications are on
mainframe
b. Limited skillset
c. Scaling is costly
d. Development takes time
e. Constraints on latency & throughput
f. Availability- DR is a challenge
Current view
a. All the client interfacing applications
are decoupled from mainframe
b. DB2 is retained as system of record for
legacy applications
c. Developed on dotNet platform with
aerospike as distributed database
d. Horizontally scalable
e. Latency is in 30 milliseconds and
throughput is 2 M transactions/min
f. Deployed in multiple data centers with
zone isolation strategy for high
availability
3
Proprietary & Confidential | All rights reserved. © 2023 Aerospike, Inc.
Modernization Strategy followed
a. Aerospike as intraday system of record
i. Migrate all the read apps
i. Have all the data in aerospike with near real time refresh
ii. Daily refresh, intraday refresh & weekly refresh as needed
iii. Deploy the business logic on app tier with data in aerospike
ii. Migrate write apps, retain DB2 as system of record
i. Post the transactions real time onto aerospike
ii. Async process to update data in DB2
b. Aerospike as system of record
i. Build all new capabilities
ii. Build for the resiliency for data
i. Not to leverage XDR- XDR can propagate data loss/corruption that happens in
one DC to other DCs making it harder to restore
ii. Zone isolation where each zone will have 100% of data.
4
Proprietary & Confidential | All rights reserved. © 2023 Aerospike, Inc.
A view of current stats
a. Aerospike DB level
a. Data stored per zone
a. ~150 TB
b. Transaction volumes
a. 75 Billions in a typical day
b. 20 Billion writes
c. 55 Billion reads
c. Latency
a. 99.9% of all read as well as writes are < 1 millisecond
d. Throughput
a. 1.1M/sec- Reads, 0.45 M/sec- writes
b. Application level
a. Latency- ~30 millisecond/transaction
b. Throughput- 2 M/min
5
Proprietary & Confidential | All rights reserved. © 2023 Aerospike, Inc.
6
1st
phase- all read applications are
migrated
2nd
phase- all write applications are
migrated
3rd
phase- All new capabilities are
developed with aerospike as system
of record.
Modernization journey- 3 phases
Proprietary & Confidential | All rights reserved. © 2023 Aerospike, Inc.
Zone Isolation deployment- multi zone view
Key call outs
• A new zone can be setup without disturbing
any other zone. Only interaction with other
zone is through async messaging apps.
• Failover from active zone to another zone
will be very quick and involve routing all the
channels traffic at load balancer level. Data is
consistent in all aerospike clusters, so no
impact to client experience with fail over.
• The failover process will remain same with
zonal fail over or regional failover.
• We have opportunity to handle all the
channel traffic across multiple zones. (50%
from zone 1 and 50% from zone2). True
active-active setup.
• Any changes, to write or apps, can be
promoted to one zone. After validating the
change in the zone, the changes can be
promoted to all zones.
• Ready for cloud deployment, can route the
channel traffic in a canary mode to minimize
risk.
Txns
Intraday
events
SOD files
KAFKA multi node cluster
NAS folder
SOR database
File Data loader
Intraday data
loader
Txn posting
Aero
spike
Read
services
Write
services
Zone 1 (Active)
Service layer
File loaders
Async message
processors
Async
Messaging
Systems of
record
Txn
generators
Service
Consumers
Web & Mobile channels
Async Messaging/Kafka
Zone2
Read
services
Write
services
File Data loader
Intraday data
loader
Txn posting
Aero
spike
Read
services
Write
services
Read
services
Write
services
Proprietary & Confidential | All rights reserved. © 2023 Aerospike, Inc.
In closing
a. Modernization journey is very rewarding
b. Met all the objectives we started with
c. Aerospike exceeded our expectations and became a critical
component in the eco system
d. Developed an industry leading performance reporting capability with
aerospike as system of record
Coming next
a. Make the applications cloud ready
b. Deploy in public cloud
8

More Related Content

Similar to App Modernization with Aerospike as an Intraday System of Record_Venkat Thamminana.pdf

HTTP_SS_ENTERPRISE_EN
HTTP_SS_ENTERPRISE_ENHTTP_SS_ENTERPRISE_EN
HTTP_SS_ENTERPRISE_EN
Bernd Thomsen
 
Introducing Events and Stream Processing into Nationwide Building Society (Ro...
Introducing Events and Stream Processing into Nationwide Building Society (Ro...Introducing Events and Stream Processing into Nationwide Building Society (Ro...
Introducing Events and Stream Processing into Nationwide Building Society (Ro...
confluent
 
Twelve Factor App
Twelve Factor AppTwelve Factor App
Twelve Factor App
Christ Ngantung
 
Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with K...
Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with K...Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with K...
Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with K...
confluent
 
Structured Streaming Data Pipeline Using Kafka, Spark, and MapR-DB
Structured Streaming Data Pipeline Using Kafka, Spark, and MapR-DBStructured Streaming Data Pipeline Using Kafka, Spark, and MapR-DB
Structured Streaming Data Pipeline Using Kafka, Spark, and MapR-DB
Carol McDonald
 
Nfv open stack-shuo-yang
Nfv open stack-shuo-yangNfv open stack-shuo-yang
Nfv open stack-shuo-yang
OW2
 
Ignite 2017 - Windows Server Feature Release
Ignite 2017 - Windows Server Feature ReleaseIgnite 2017 - Windows Server Feature Release
Ignite 2017 - Windows Server Feature Release
Taylor Brown
 
Atmosphere 2014: Switching from monolithic approach to modular cloud computin...
Atmosphere 2014: Switching from monolithic approach to modular cloud computin...Atmosphere 2014: Switching from monolithic approach to modular cloud computin...
Atmosphere 2014: Switching from monolithic approach to modular cloud computin...
PROIDEA
 
Optimize DR and Cloning with Logical Hostnames in Oracle E-Business Suite (OA...
Optimize DR and Cloning with Logical Hostnames in Oracle E-Business Suite (OA...Optimize DR and Cloning with Logical Hostnames in Oracle E-Business Suite (OA...
Optimize DR and Cloning with Logical Hostnames in Oracle E-Business Suite (OA...
Andrejs Prokopjevs
 
Patterns and Pains of Migrating Legacy Applications to Kubernetes
Patterns and Pains of Migrating Legacy Applications to KubernetesPatterns and Pains of Migrating Legacy Applications to Kubernetes
Patterns and Pains of Migrating Legacy Applications to Kubernetes
Josef Adersberger
 
Patterns and Pains of Migrating Legacy Applications to Kubernetes
Patterns and Pains of Migrating Legacy Applications to KubernetesPatterns and Pains of Migrating Legacy Applications to Kubernetes
Patterns and Pains of Migrating Legacy Applications to Kubernetes
QAware GmbH
 
Deep Automation and ML-Driven Analytics for Application Services
Deep Automation and ML-Driven Analytics for Application ServicesDeep Automation and ML-Driven Analytics for Application Services
Deep Automation and ML-Driven Analytics for Application Services
Avi Networks
 
Are you ready to be edgy? Bringing applications to the edge of the network
Are you ready to be edgy? Bringing applications to the edge of the networkAre you ready to be edgy? Bringing applications to the edge of the network
Are you ready to be edgy? Bringing applications to the edge of the network
Megan O'Keefe
 
Developing for Hybrid Cloud with Bluemix
Developing for Hybrid Cloud with BluemixDeveloping for Hybrid Cloud with Bluemix
Developing for Hybrid Cloud with Bluemix
Roberto Pozzi
 
Project COLA: Use Case to create a scalable application in the cloud based on...
Project COLA: Use Case to create a scalable application in the cloud based on...Project COLA: Use Case to create a scalable application in the cloud based on...
Project COLA: Use Case to create a scalable application in the cloud based on...
Project COLA
 
GigaSpaces CCF 4 Xap
GigaSpaces CCF 4 XapGigaSpaces CCF 4 Xap
GigaSpaces CCF 4 Xap
Shay Hassidim
 
SaaS Enablement of your existing application (Cloud Slam 2010)
SaaS Enablement of your existing application (Cloud Slam 2010)SaaS Enablement of your existing application (Cloud Slam 2010)
SaaS Enablement of your existing application (Cloud Slam 2010)
Nati Shalom
 
Infrastructure Strategies 2007
Infrastructure Strategies 2007Infrastructure Strategies 2007
Infrastructure Strategies 2007
Dr. Jimmy Schwarzkopf
 
CtrlS: Cloud Solutions for Retail & eCommerce
CtrlS: Cloud Solutions for Retail & eCommerceCtrlS: Cloud Solutions for Retail & eCommerce
CtrlS: Cloud Solutions for Retail & eCommerce
eTailing India
 
Edge Computing Platforms and Protocols - Ph.D. thesis
Edge Computing Platforms and Protocols - Ph.D. thesisEdge Computing Platforms and Protocols - Ph.D. thesis
Edge Computing Platforms and Protocols - Ph.D. thesis
Nitinder Mohan
 

Similar to App Modernization with Aerospike as an Intraday System of Record_Venkat Thamminana.pdf (20)

HTTP_SS_ENTERPRISE_EN
HTTP_SS_ENTERPRISE_ENHTTP_SS_ENTERPRISE_EN
HTTP_SS_ENTERPRISE_EN
 
Introducing Events and Stream Processing into Nationwide Building Society (Ro...
Introducing Events and Stream Processing into Nationwide Building Society (Ro...Introducing Events and Stream Processing into Nationwide Building Society (Ro...
Introducing Events and Stream Processing into Nationwide Building Society (Ro...
 
Twelve Factor App
Twelve Factor AppTwelve Factor App
Twelve Factor App
 
Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with K...
Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with K...Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with K...
Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with K...
 
Structured Streaming Data Pipeline Using Kafka, Spark, and MapR-DB
Structured Streaming Data Pipeline Using Kafka, Spark, and MapR-DBStructured Streaming Data Pipeline Using Kafka, Spark, and MapR-DB
Structured Streaming Data Pipeline Using Kafka, Spark, and MapR-DB
 
Nfv open stack-shuo-yang
Nfv open stack-shuo-yangNfv open stack-shuo-yang
Nfv open stack-shuo-yang
 
Ignite 2017 - Windows Server Feature Release
Ignite 2017 - Windows Server Feature ReleaseIgnite 2017 - Windows Server Feature Release
Ignite 2017 - Windows Server Feature Release
 
Atmosphere 2014: Switching from monolithic approach to modular cloud computin...
Atmosphere 2014: Switching from monolithic approach to modular cloud computin...Atmosphere 2014: Switching from monolithic approach to modular cloud computin...
Atmosphere 2014: Switching from monolithic approach to modular cloud computin...
 
Optimize DR and Cloning with Logical Hostnames in Oracle E-Business Suite (OA...
Optimize DR and Cloning with Logical Hostnames in Oracle E-Business Suite (OA...Optimize DR and Cloning with Logical Hostnames in Oracle E-Business Suite (OA...
Optimize DR and Cloning with Logical Hostnames in Oracle E-Business Suite (OA...
 
Patterns and Pains of Migrating Legacy Applications to Kubernetes
Patterns and Pains of Migrating Legacy Applications to KubernetesPatterns and Pains of Migrating Legacy Applications to Kubernetes
Patterns and Pains of Migrating Legacy Applications to Kubernetes
 
Patterns and Pains of Migrating Legacy Applications to Kubernetes
Patterns and Pains of Migrating Legacy Applications to KubernetesPatterns and Pains of Migrating Legacy Applications to Kubernetes
Patterns and Pains of Migrating Legacy Applications to Kubernetes
 
Deep Automation and ML-Driven Analytics for Application Services
Deep Automation and ML-Driven Analytics for Application ServicesDeep Automation and ML-Driven Analytics for Application Services
Deep Automation and ML-Driven Analytics for Application Services
 
Are you ready to be edgy? Bringing applications to the edge of the network
Are you ready to be edgy? Bringing applications to the edge of the networkAre you ready to be edgy? Bringing applications to the edge of the network
Are you ready to be edgy? Bringing applications to the edge of the network
 
Developing for Hybrid Cloud with Bluemix
Developing for Hybrid Cloud with BluemixDeveloping for Hybrid Cloud with Bluemix
Developing for Hybrid Cloud with Bluemix
 
Project COLA: Use Case to create a scalable application in the cloud based on...
Project COLA: Use Case to create a scalable application in the cloud based on...Project COLA: Use Case to create a scalable application in the cloud based on...
Project COLA: Use Case to create a scalable application in the cloud based on...
 
GigaSpaces CCF 4 Xap
GigaSpaces CCF 4 XapGigaSpaces CCF 4 Xap
GigaSpaces CCF 4 Xap
 
SaaS Enablement of your existing application (Cloud Slam 2010)
SaaS Enablement of your existing application (Cloud Slam 2010)SaaS Enablement of your existing application (Cloud Slam 2010)
SaaS Enablement of your existing application (Cloud Slam 2010)
 
Infrastructure Strategies 2007
Infrastructure Strategies 2007Infrastructure Strategies 2007
Infrastructure Strategies 2007
 
CtrlS: Cloud Solutions for Retail & eCommerce
CtrlS: Cloud Solutions for Retail & eCommerceCtrlS: Cloud Solutions for Retail & eCommerce
CtrlS: Cloud Solutions for Retail & eCommerce
 
Edge Computing Platforms and Protocols - Ph.D. thesis
Edge Computing Platforms and Protocols - Ph.D. thesisEdge Computing Platforms and Protocols - Ph.D. thesis
Edge Computing Platforms and Protocols - Ph.D. thesis
 

More from Aerospike, Inc.

Building for a Real-time Data Future_Subbu Iyer.pdf
Building for a Real-time Data Future_Subbu Iyer.pdfBuilding for a Real-time Data Future_Subbu Iyer.pdf
Building for a Real-time Data Future_Subbu Iyer.pdf
Aerospike, Inc.
 
What a Modern Database Enables_Srini Srinivasan.pdf
What a Modern Database Enables_Srini Srinivasan.pdfWhat a Modern Database Enables_Srini Srinivasan.pdf
What a Modern Database Enables_Srini Srinivasan.pdf
Aerospike, Inc.
 
Aerospike & Unity_Connecting Developer Communities_Matt Dondelinger and Stace...
Aerospike & Unity_Connecting Developer Communities_Matt Dondelinger and Stace...Aerospike & Unity_Connecting Developer Communities_Matt Dondelinger and Stace...
Aerospike & Unity_Connecting Developer Communities_Matt Dondelinger and Stace...
Aerospike, Inc.
 
Aerospike & AWS Working backward from the customer.pdf
Aerospike &  AWS Working backward from the customer.pdfAerospike &  AWS Working backward from the customer.pdf
Aerospike & AWS Working backward from the customer.pdf
Aerospike, Inc.
 
Update on Aerospike Database, Clients and Frameworks_Ronen Botzer.pdf
Update on Aerospike Database, Clients and Frameworks_Ronen Botzer.pdfUpdate on Aerospike Database, Clients and Frameworks_Ronen Botzer.pdf
Update on Aerospike Database, Clients and Frameworks_Ronen Botzer.pdf
Aerospike, Inc.
 
Developing for Real-time_Art Anderson.pdf
Developing for Real-time_Art Anderson.pdfDeveloping for Real-time_Art Anderson.pdf
Developing for Real-time_Art Anderson.pdf
Aerospike, Inc.
 
Aerospike Today and Tomorrow Product Roadmap 2023_Lenley Hensarling.pdf
Aerospike Today and Tomorrow Product Roadmap 2023_Lenley Hensarling.pdfAerospike Today and Tomorrow Product Roadmap 2023_Lenley Hensarling.pdf
Aerospike Today and Tomorrow Product Roadmap 2023_Lenley Hensarling.pdf
Aerospike, Inc.
 
Now in AI- How we got here_Ashwin Rao.pdf
Now in AI- How we got here_Ashwin Rao.pdfNow in AI- How we got here_Ashwin Rao.pdf
Now in AI- How we got here_Ashwin Rao.pdf
Aerospike, Inc.
 
Art of the Possible_Tim Faulkes.pdf
Art of the Possible_Tim Faulkes.pdfArt of the Possible_Tim Faulkes.pdf
Art of the Possible_Tim Faulkes.pdf
Aerospike, Inc.
 

More from Aerospike, Inc. (9)

Building for a Real-time Data Future_Subbu Iyer.pdf
Building for a Real-time Data Future_Subbu Iyer.pdfBuilding for a Real-time Data Future_Subbu Iyer.pdf
Building for a Real-time Data Future_Subbu Iyer.pdf
 
What a Modern Database Enables_Srini Srinivasan.pdf
What a Modern Database Enables_Srini Srinivasan.pdfWhat a Modern Database Enables_Srini Srinivasan.pdf
What a Modern Database Enables_Srini Srinivasan.pdf
 
Aerospike & Unity_Connecting Developer Communities_Matt Dondelinger and Stace...
Aerospike & Unity_Connecting Developer Communities_Matt Dondelinger and Stace...Aerospike & Unity_Connecting Developer Communities_Matt Dondelinger and Stace...
Aerospike & Unity_Connecting Developer Communities_Matt Dondelinger and Stace...
 
Aerospike & AWS Working backward from the customer.pdf
Aerospike &  AWS Working backward from the customer.pdfAerospike &  AWS Working backward from the customer.pdf
Aerospike & AWS Working backward from the customer.pdf
 
Update on Aerospike Database, Clients and Frameworks_Ronen Botzer.pdf
Update on Aerospike Database, Clients and Frameworks_Ronen Botzer.pdfUpdate on Aerospike Database, Clients and Frameworks_Ronen Botzer.pdf
Update on Aerospike Database, Clients and Frameworks_Ronen Botzer.pdf
 
Developing for Real-time_Art Anderson.pdf
Developing for Real-time_Art Anderson.pdfDeveloping for Real-time_Art Anderson.pdf
Developing for Real-time_Art Anderson.pdf
 
Aerospike Today and Tomorrow Product Roadmap 2023_Lenley Hensarling.pdf
Aerospike Today and Tomorrow Product Roadmap 2023_Lenley Hensarling.pdfAerospike Today and Tomorrow Product Roadmap 2023_Lenley Hensarling.pdf
Aerospike Today and Tomorrow Product Roadmap 2023_Lenley Hensarling.pdf
 
Now in AI- How we got here_Ashwin Rao.pdf
Now in AI- How we got here_Ashwin Rao.pdfNow in AI- How we got here_Ashwin Rao.pdf
Now in AI- How we got here_Ashwin Rao.pdf
 
Art of the Possible_Tim Faulkes.pdf
Art of the Possible_Tim Faulkes.pdfArt of the Possible_Tim Faulkes.pdf
Art of the Possible_Tim Faulkes.pdf
 

Recently uploaded

Premium Girls Call Mumbai 9920725232 Unlimited Short Providing Girls Service ...
Premium Girls Call Mumbai 9920725232 Unlimited Short Providing Girls Service ...Premium Girls Call Mumbai 9920725232 Unlimited Short Providing Girls Service ...
Premium Girls Call Mumbai 9920725232 Unlimited Short Providing Girls Service ...
shanihomely
 
Vulnerability Management: A Comprehensive Overview
Vulnerability Management: A Comprehensive OverviewVulnerability Management: A Comprehensive Overview
Vulnerability Management: A Comprehensive Overview
Steven Carlson
 
Using LLM Agents with Llama 3, LangGraph and Milvus
Using LLM Agents with Llama 3, LangGraph and MilvusUsing LLM Agents with Llama 3, LangGraph and Milvus
Using LLM Agents with Llama 3, LangGraph and Milvus
Zilliz
 
Girls Call Churchgate 9910780858 Provide Best And Top Girl Service And No1 in...
Girls Call Churchgate 9910780858 Provide Best And Top Girl Service And No1 in...Girls Call Churchgate 9910780858 Provide Best And Top Girl Service And No1 in...
Girls Call Churchgate 9910780858 Provide Best And Top Girl Service And No1 in...
maigasapphire
 
BT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdf
BT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdfBT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdf
BT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdf
Neo4j
 
Uncharted Together- Navigating AI's New Frontiers in Libraries
Uncharted Together- Navigating AI's New Frontiers in LibrariesUncharted Together- Navigating AI's New Frontiers in Libraries
Uncharted Together- Navigating AI's New Frontiers in Libraries
Brian Pichman
 
"Mastering Graphic Design: Essential Tips and Tricks for Beginners and Profes...
"Mastering Graphic Design: Essential Tips and Tricks for Beginners and Profes..."Mastering Graphic Design: Essential Tips and Tricks for Beginners and Profes...
"Mastering Graphic Design: Essential Tips and Tricks for Beginners and Profes...
Anant Gupta
 
Feature sql server terbaru performance.pptx
Feature sql server terbaru performance.pptxFeature sql server terbaru performance.pptx
Feature sql server terbaru performance.pptx
ssuser1915fe1
 
July Patch Tuesday
July Patch TuesdayJuly Patch Tuesday
July Patch Tuesday
Ivanti
 
Best Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdfBest Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdf
Tatiana Al-Chueyr
 
The Role of IoT in Australian Mobile App Development - PDF Guide
The Role of IoT in Australian Mobile App Development - PDF GuideThe Role of IoT in Australian Mobile App Development - PDF Guide
The Role of IoT in Australian Mobile App Development - PDF Guide
Shiv Technolabs
 
BLOCKCHAIN TECHNOLOGY - Advantages and Disadvantages
BLOCKCHAIN TECHNOLOGY - Advantages and DisadvantagesBLOCKCHAIN TECHNOLOGY - Advantages and Disadvantages
BLOCKCHAIN TECHNOLOGY - Advantages and Disadvantages
SAI KAILASH R
 
Girls call Kolkata 👀 XXXXXXXXXXX 👀 Rs.9.5 K Cash Payment With Room Delivery
Girls call Kolkata 👀 XXXXXXXXXXX 👀 Rs.9.5 K Cash Payment With Room Delivery Girls call Kolkata 👀 XXXXXXXXXXX 👀 Rs.9.5 K Cash Payment With Room Delivery
Girls call Kolkata 👀 XXXXXXXXXXX 👀 Rs.9.5 K Cash Payment With Room Delivery
sunilverma7884
 
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptxDublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Kunal Gupta
 
Mastering OnlyFans Clone App Development: Key Strategies for Success
Mastering OnlyFans Clone App Development: Key Strategies for SuccessMastering OnlyFans Clone App Development: Key Strategies for Success
Mastering OnlyFans Clone App Development: Key Strategies for Success
David Wilson
 
IPLOOK Remote-Sensing Satellite Solution
IPLOOK Remote-Sensing Satellite SolutionIPLOOK Remote-Sensing Satellite Solution
IPLOOK Remote-Sensing Satellite Solution
IPLOOK Networks
 
(CISOPlatform Summit & SACON 2024) Cyber Insurance & Risk Quantification.pdf
(CISOPlatform Summit & SACON 2024) Cyber Insurance & Risk Quantification.pdf(CISOPlatform Summit & SACON 2024) Cyber Insurance & Risk Quantification.pdf
(CISOPlatform Summit & SACON 2024) Cyber Insurance & Risk Quantification.pdf
Priyanka Aash
 
(CISOPlatform Summit & SACON 2024) Gen AI & Deepfake In Overall Security.pdf
(CISOPlatform Summit & SACON 2024) Gen AI & Deepfake In Overall Security.pdf(CISOPlatform Summit & SACON 2024) Gen AI & Deepfake In Overall Security.pdf
(CISOPlatform Summit & SACON 2024) Gen AI & Deepfake In Overall Security.pdf
Priyanka Aash
 
(CISOPlatform Summit & SACON 2024) Digital Personal Data Protection Act.pdf
(CISOPlatform Summit & SACON 2024) Digital Personal Data Protection Act.pdf(CISOPlatform Summit & SACON 2024) Digital Personal Data Protection Act.pdf
(CISOPlatform Summit & SACON 2024) Digital Personal Data Protection Act.pdf
Priyanka Aash
 
Patch Tuesday de julio
Patch Tuesday de julioPatch Tuesday de julio
Patch Tuesday de julio
Ivanti
 

Recently uploaded (20)

Premium Girls Call Mumbai 9920725232 Unlimited Short Providing Girls Service ...
Premium Girls Call Mumbai 9920725232 Unlimited Short Providing Girls Service ...Premium Girls Call Mumbai 9920725232 Unlimited Short Providing Girls Service ...
Premium Girls Call Mumbai 9920725232 Unlimited Short Providing Girls Service ...
 
Vulnerability Management: A Comprehensive Overview
Vulnerability Management: A Comprehensive OverviewVulnerability Management: A Comprehensive Overview
Vulnerability Management: A Comprehensive Overview
 
Using LLM Agents with Llama 3, LangGraph and Milvus
Using LLM Agents with Llama 3, LangGraph and MilvusUsing LLM Agents with Llama 3, LangGraph and Milvus
Using LLM Agents with Llama 3, LangGraph and Milvus
 
Girls Call Churchgate 9910780858 Provide Best And Top Girl Service And No1 in...
Girls Call Churchgate 9910780858 Provide Best And Top Girl Service And No1 in...Girls Call Churchgate 9910780858 Provide Best And Top Girl Service And No1 in...
Girls Call Churchgate 9910780858 Provide Best And Top Girl Service And No1 in...
 
BT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdf
BT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdfBT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdf
BT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdf
 
Uncharted Together- Navigating AI's New Frontiers in Libraries
Uncharted Together- Navigating AI's New Frontiers in LibrariesUncharted Together- Navigating AI's New Frontiers in Libraries
Uncharted Together- Navigating AI's New Frontiers in Libraries
 
"Mastering Graphic Design: Essential Tips and Tricks for Beginners and Profes...
"Mastering Graphic Design: Essential Tips and Tricks for Beginners and Profes..."Mastering Graphic Design: Essential Tips and Tricks for Beginners and Profes...
"Mastering Graphic Design: Essential Tips and Tricks for Beginners and Profes...
 
Feature sql server terbaru performance.pptx
Feature sql server terbaru performance.pptxFeature sql server terbaru performance.pptx
Feature sql server terbaru performance.pptx
 
July Patch Tuesday
July Patch TuesdayJuly Patch Tuesday
July Patch Tuesday
 
Best Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdfBest Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdf
 
The Role of IoT in Australian Mobile App Development - PDF Guide
The Role of IoT in Australian Mobile App Development - PDF GuideThe Role of IoT in Australian Mobile App Development - PDF Guide
The Role of IoT in Australian Mobile App Development - PDF Guide
 
BLOCKCHAIN TECHNOLOGY - Advantages and Disadvantages
BLOCKCHAIN TECHNOLOGY - Advantages and DisadvantagesBLOCKCHAIN TECHNOLOGY - Advantages and Disadvantages
BLOCKCHAIN TECHNOLOGY - Advantages and Disadvantages
 
Girls call Kolkata 👀 XXXXXXXXXXX 👀 Rs.9.5 K Cash Payment With Room Delivery
Girls call Kolkata 👀 XXXXXXXXXXX 👀 Rs.9.5 K Cash Payment With Room Delivery Girls call Kolkata 👀 XXXXXXXXXXX 👀 Rs.9.5 K Cash Payment With Room Delivery
Girls call Kolkata 👀 XXXXXXXXXXX 👀 Rs.9.5 K Cash Payment With Room Delivery
 
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptxDublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
 
Mastering OnlyFans Clone App Development: Key Strategies for Success
Mastering OnlyFans Clone App Development: Key Strategies for SuccessMastering OnlyFans Clone App Development: Key Strategies for Success
Mastering OnlyFans Clone App Development: Key Strategies for Success
 
IPLOOK Remote-Sensing Satellite Solution
IPLOOK Remote-Sensing Satellite SolutionIPLOOK Remote-Sensing Satellite Solution
IPLOOK Remote-Sensing Satellite Solution
 
(CISOPlatform Summit & SACON 2024) Cyber Insurance & Risk Quantification.pdf
(CISOPlatform Summit & SACON 2024) Cyber Insurance & Risk Quantification.pdf(CISOPlatform Summit & SACON 2024) Cyber Insurance & Risk Quantification.pdf
(CISOPlatform Summit & SACON 2024) Cyber Insurance & Risk Quantification.pdf
 
(CISOPlatform Summit & SACON 2024) Gen AI & Deepfake In Overall Security.pdf
(CISOPlatform Summit & SACON 2024) Gen AI & Deepfake In Overall Security.pdf(CISOPlatform Summit & SACON 2024) Gen AI & Deepfake In Overall Security.pdf
(CISOPlatform Summit & SACON 2024) Gen AI & Deepfake In Overall Security.pdf
 
(CISOPlatform Summit & SACON 2024) Digital Personal Data Protection Act.pdf
(CISOPlatform Summit & SACON 2024) Digital Personal Data Protection Act.pdf(CISOPlatform Summit & SACON 2024) Digital Personal Data Protection Act.pdf
(CISOPlatform Summit & SACON 2024) Digital Personal Data Protection Act.pdf
 
Patch Tuesday de julio
Patch Tuesday de julioPatch Tuesday de julio
Patch Tuesday de julio
 

App Modernization with Aerospike as an Intraday System of Record_Venkat Thamminana.pdf

  • 1. App Modernization with Aerospike as an Intraday System of Record Venkat Thamminana Managing Director, Portfolio Management Technology Charles Schwab
  • 2. Proprietary & Confidential | All rights reserved. © 2023 Aerospike, Inc. Modernization goals a. Vision- Build better, faster and cheaper solutions b. Architectural principles i. One operational data store ii. No local caching at VM level iii.Maximum code reuse iv.Avoid or minimize calls outside CLR/JVM v. App tier is just business logic and on light weight VMs 2
  • 3. Proprietary & Confidential | All rights reserved. © 2023 Aerospike, Inc. Trading architecture view- 2014 vs now 2014 view a. All the core trading applications are on mainframe b. Limited skillset c. Scaling is costly d. Development takes time e. Constraints on latency & throughput f. Availability- DR is a challenge Current view a. All the client interfacing applications are decoupled from mainframe b. DB2 is retained as system of record for legacy applications c. Developed on dotNet platform with aerospike as distributed database d. Horizontally scalable e. Latency is in 30 milliseconds and throughput is 2 M transactions/min f. Deployed in multiple data centers with zone isolation strategy for high availability 3
  • 4. Proprietary & Confidential | All rights reserved. © 2023 Aerospike, Inc. Modernization Strategy followed a. Aerospike as intraday system of record i. Migrate all the read apps i. Have all the data in aerospike with near real time refresh ii. Daily refresh, intraday refresh & weekly refresh as needed iii. Deploy the business logic on app tier with data in aerospike ii. Migrate write apps, retain DB2 as system of record i. Post the transactions real time onto aerospike ii. Async process to update data in DB2 b. Aerospike as system of record i. Build all new capabilities ii. Build for the resiliency for data i. Not to leverage XDR- XDR can propagate data loss/corruption that happens in one DC to other DCs making it harder to restore ii. Zone isolation where each zone will have 100% of data. 4
  • 5. Proprietary & Confidential | All rights reserved. © 2023 Aerospike, Inc. A view of current stats a. Aerospike DB level a. Data stored per zone a. ~150 TB b. Transaction volumes a. 75 Billions in a typical day b. 20 Billion writes c. 55 Billion reads c. Latency a. 99.9% of all read as well as writes are < 1 millisecond d. Throughput a. 1.1M/sec- Reads, 0.45 M/sec- writes b. Application level a. Latency- ~30 millisecond/transaction b. Throughput- 2 M/min 5
  • 6. Proprietary & Confidential | All rights reserved. © 2023 Aerospike, Inc. 6 1st phase- all read applications are migrated 2nd phase- all write applications are migrated 3rd phase- All new capabilities are developed with aerospike as system of record. Modernization journey- 3 phases
  • 7. Proprietary & Confidential | All rights reserved. © 2023 Aerospike, Inc. Zone Isolation deployment- multi zone view Key call outs • A new zone can be setup without disturbing any other zone. Only interaction with other zone is through async messaging apps. • Failover from active zone to another zone will be very quick and involve routing all the channels traffic at load balancer level. Data is consistent in all aerospike clusters, so no impact to client experience with fail over. • The failover process will remain same with zonal fail over or regional failover. • We have opportunity to handle all the channel traffic across multiple zones. (50% from zone 1 and 50% from zone2). True active-active setup. • Any changes, to write or apps, can be promoted to one zone. After validating the change in the zone, the changes can be promoted to all zones. • Ready for cloud deployment, can route the channel traffic in a canary mode to minimize risk. Txns Intraday events SOD files KAFKA multi node cluster NAS folder SOR database File Data loader Intraday data loader Txn posting Aero spike Read services Write services Zone 1 (Active) Service layer File loaders Async message processors Async Messaging Systems of record Txn generators Service Consumers Web & Mobile channels Async Messaging/Kafka Zone2 Read services Write services File Data loader Intraday data loader Txn posting Aero spike Read services Write services Read services Write services
  • 8. Proprietary & Confidential | All rights reserved. © 2023 Aerospike, Inc. In closing a. Modernization journey is very rewarding b. Met all the objectives we started with c. Aerospike exceeded our expectations and became a critical component in the eco system d. Developed an industry leading performance reporting capability with aerospike as system of record Coming next a. Make the applications cloud ready b. Deploy in public cloud 8