SlideShare a Scribd company logo
1 of 8
Download to read offline
App Modernization with Aerospike
as an Intraday System of Record
Venkat Thamminana
Managing Director, Portfolio
Management Technology
Charles Schwab
Proprietary & Confidential | All rights reserved. © 2023 Aerospike, Inc.
Modernization goals
a. Vision- Build better, faster and cheaper solutions
b. Architectural principles
i. One operational data store
ii. No local caching at VM level
iii.Maximum code reuse
iv.Avoid or minimize calls outside CLR/JVM
v. App tier is just business logic and on light weight VMs
2
Proprietary & Confidential | All rights reserved. © 2023 Aerospike, Inc.
Trading architecture view- 2014 vs now
2014 view
a. All the core trading applications are on
mainframe
b. Limited skillset
c. Scaling is costly
d. Development takes time
e. Constraints on latency & throughput
f. Availability- DR is a challenge
Current view
a. All the client interfacing applications
are decoupled from mainframe
b. DB2 is retained as system of record for
legacy applications
c. Developed on dotNet platform with
aerospike as distributed database
d. Horizontally scalable
e. Latency is in 30 milliseconds and
throughput is 2 M transactions/min
f. Deployed in multiple data centers with
zone isolation strategy for high
availability
3
Proprietary & Confidential | All rights reserved. © 2023 Aerospike, Inc.
Modernization Strategy followed
a. Aerospike as intraday system of record
i. Migrate all the read apps
i. Have all the data in aerospike with near real time refresh
ii. Daily refresh, intraday refresh & weekly refresh as needed
iii. Deploy the business logic on app tier with data in aerospike
ii. Migrate write apps, retain DB2 as system of record
i. Post the transactions real time onto aerospike
ii. Async process to update data in DB2
b. Aerospike as system of record
i. Build all new capabilities
ii. Build for the resiliency for data
i. Not to leverage XDR- XDR can propagate data loss/corruption that happens in
one DC to other DCs making it harder to restore
ii. Zone isolation where each zone will have 100% of data.
4
Proprietary & Confidential | All rights reserved. © 2023 Aerospike, Inc.
A view of current stats
a. Aerospike DB level
a. Data stored per zone
a. ~150 TB
b. Transaction volumes
a. 75 Billions in a typical day
b. 20 Billion writes
c. 55 Billion reads
c. Latency
a. 99.9% of all read as well as writes are < 1 millisecond
d. Throughput
a. 1.1M/sec- Reads, 0.45 M/sec- writes
b. Application level
a. Latency- ~30 millisecond/transaction
b. Throughput- 2 M/min
5
Proprietary & Confidential | All rights reserved. © 2023 Aerospike, Inc.
6
1st
phase- all read applications are
migrated
2nd
phase- all write applications are
migrated
3rd
phase- All new capabilities are
developed with aerospike as system
of record.
Modernization journey- 3 phases
Proprietary & Confidential | All rights reserved. © 2023 Aerospike, Inc.
Zone Isolation deployment- multi zone view
Key call outs
• A new zone can be setup without disturbing
any other zone. Only interaction with other
zone is through async messaging apps.
• Failover from active zone to another zone
will be very quick and involve routing all the
channels traffic at load balancer level. Data is
consistent in all aerospike clusters, so no
impact to client experience with fail over.
• The failover process will remain same with
zonal fail over or regional failover.
• We have opportunity to handle all the
channel traffic across multiple zones. (50%
from zone 1 and 50% from zone2). True
active-active setup.
• Any changes, to write or apps, can be
promoted to one zone. After validating the
change in the zone, the changes can be
promoted to all zones.
• Ready for cloud deployment, can route the
channel traffic in a canary mode to minimize
risk.
Txns
Intraday
events
SOD files
KAFKA multi node cluster
NAS folder
SOR database
File Data loader
Intraday data
loader
Txn posting
Aero
spike
Read
services
Write
services
Zone 1 (Active)
Service layer
File loaders
Async message
processors
Async
Messaging
Systems of
record
Txn
generators
Service
Consumers
Web & Mobile channels
Async Messaging/Kafka
Zone2
Read
services
Write
services
File Data loader
Intraday data
loader
Txn posting
Aero
spike
Read
services
Write
services
Read
services
Write
services
Proprietary & Confidential | All rights reserved. © 2023 Aerospike, Inc.
In closing
a. Modernization journey is very rewarding
b. Met all the objectives we started with
c. Aerospike exceeded our expectations and became a critical
component in the eco system
d. Developed an industry leading performance reporting capability with
aerospike as system of record
Coming next
a. Make the applications cloud ready
b. Deploy in public cloud
8

More Related Content

Similar to App Modernization with Aerospike as an Intraday System of Record_Venkat Thamminana.pdf

HTTP_SS_ENTERPRISE_EN
HTTP_SS_ENTERPRISE_ENHTTP_SS_ENTERPRISE_EN
HTTP_SS_ENTERPRISE_ENBernd Thomsen
 
Introducing Events and Stream Processing into Nationwide Building Society (Ro...
Introducing Events and Stream Processing into Nationwide Building Society (Ro...Introducing Events and Stream Processing into Nationwide Building Society (Ro...
Introducing Events and Stream Processing into Nationwide Building Society (Ro...confluent
 
Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with K...
Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with K...Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with K...
Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with K...confluent
 
Structured Streaming Data Pipeline Using Kafka, Spark, and MapR-DB
Structured Streaming Data Pipeline Using Kafka, Spark, and MapR-DBStructured Streaming Data Pipeline Using Kafka, Spark, and MapR-DB
Structured Streaming Data Pipeline Using Kafka, Spark, and MapR-DBCarol McDonald
 
Nfv open stack-shuo-yang
Nfv open stack-shuo-yangNfv open stack-shuo-yang
Nfv open stack-shuo-yangOW2
 
Ignite 2017 - Windows Server Feature Release
Ignite 2017 - Windows Server Feature ReleaseIgnite 2017 - Windows Server Feature Release
Ignite 2017 - Windows Server Feature ReleaseTaylor Brown
 
Atmosphere 2014: Switching from monolithic approach to modular cloud computin...
Atmosphere 2014: Switching from monolithic approach to modular cloud computin...Atmosphere 2014: Switching from monolithic approach to modular cloud computin...
Atmosphere 2014: Switching from monolithic approach to modular cloud computin...PROIDEA
 
Optimize DR and Cloning with Logical Hostnames in Oracle E-Business Suite (OA...
Optimize DR and Cloning with Logical Hostnames in Oracle E-Business Suite (OA...Optimize DR and Cloning with Logical Hostnames in Oracle E-Business Suite (OA...
Optimize DR and Cloning with Logical Hostnames in Oracle E-Business Suite (OA...Andrejs Prokopjevs
 
Patterns and Pains of Migrating Legacy Applications to Kubernetes
Patterns and Pains of Migrating Legacy Applications to KubernetesPatterns and Pains of Migrating Legacy Applications to Kubernetes
Patterns and Pains of Migrating Legacy Applications to KubernetesQAware GmbH
 
Patterns and Pains of Migrating Legacy Applications to Kubernetes
Patterns and Pains of Migrating Legacy Applications to KubernetesPatterns and Pains of Migrating Legacy Applications to Kubernetes
Patterns and Pains of Migrating Legacy Applications to KubernetesJosef Adersberger
 
Deep Automation and ML-Driven Analytics for Application Services
Deep Automation and ML-Driven Analytics for Application ServicesDeep Automation and ML-Driven Analytics for Application Services
Deep Automation and ML-Driven Analytics for Application ServicesAvi Networks
 
Are you ready to be edgy? Bringing applications to the edge of the network
Are you ready to be edgy? Bringing applications to the edge of the networkAre you ready to be edgy? Bringing applications to the edge of the network
Are you ready to be edgy? Bringing applications to the edge of the networkMegan O'Keefe
 
Developing for Hybrid Cloud with Bluemix
Developing for Hybrid Cloud with BluemixDeveloping for Hybrid Cloud with Bluemix
Developing for Hybrid Cloud with BluemixRoberto Pozzi
 
Project COLA: Use Case to create a scalable application in the cloud based on...
Project COLA: Use Case to create a scalable application in the cloud based on...Project COLA: Use Case to create a scalable application in the cloud based on...
Project COLA: Use Case to create a scalable application in the cloud based on...Project COLA
 
GigaSpaces CCF 4 Xap
GigaSpaces CCF 4 XapGigaSpaces CCF 4 Xap
GigaSpaces CCF 4 XapShay Hassidim
 
SaaS Enablement of your existing application (Cloud Slam 2010)
SaaS Enablement of your existing application (Cloud Slam 2010)SaaS Enablement of your existing application (Cloud Slam 2010)
SaaS Enablement of your existing application (Cloud Slam 2010)Nati Shalom
 
CtrlS: Cloud Solutions for Retail & eCommerce
CtrlS: Cloud Solutions for Retail & eCommerceCtrlS: Cloud Solutions for Retail & eCommerce
CtrlS: Cloud Solutions for Retail & eCommerceeTailing India
 
Edge Computing Platforms and Protocols - Ph.D. thesis
Edge Computing Platforms and Protocols - Ph.D. thesisEdge Computing Platforms and Protocols - Ph.D. thesis
Edge Computing Platforms and Protocols - Ph.D. thesisNitinder Mohan
 

Similar to App Modernization with Aerospike as an Intraday System of Record_Venkat Thamminana.pdf (20)

HTTP_SS_ENTERPRISE_EN
HTTP_SS_ENTERPRISE_ENHTTP_SS_ENTERPRISE_EN
HTTP_SS_ENTERPRISE_EN
 
Introducing Events and Stream Processing into Nationwide Building Society (Ro...
Introducing Events and Stream Processing into Nationwide Building Society (Ro...Introducing Events and Stream Processing into Nationwide Building Society (Ro...
Introducing Events and Stream Processing into Nationwide Building Society (Ro...
 
Twelve Factor App
Twelve Factor AppTwelve Factor App
Twelve Factor App
 
Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with K...
Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with K...Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with K...
Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with K...
 
Structured Streaming Data Pipeline Using Kafka, Spark, and MapR-DB
Structured Streaming Data Pipeline Using Kafka, Spark, and MapR-DBStructured Streaming Data Pipeline Using Kafka, Spark, and MapR-DB
Structured Streaming Data Pipeline Using Kafka, Spark, and MapR-DB
 
Nfv open stack-shuo-yang
Nfv open stack-shuo-yangNfv open stack-shuo-yang
Nfv open stack-shuo-yang
 
Ignite 2017 - Windows Server Feature Release
Ignite 2017 - Windows Server Feature ReleaseIgnite 2017 - Windows Server Feature Release
Ignite 2017 - Windows Server Feature Release
 
Atmosphere 2014: Switching from monolithic approach to modular cloud computin...
Atmosphere 2014: Switching from monolithic approach to modular cloud computin...Atmosphere 2014: Switching from monolithic approach to modular cloud computin...
Atmosphere 2014: Switching from monolithic approach to modular cloud computin...
 
Optimize DR and Cloning with Logical Hostnames in Oracle E-Business Suite (OA...
Optimize DR and Cloning with Logical Hostnames in Oracle E-Business Suite (OA...Optimize DR and Cloning with Logical Hostnames in Oracle E-Business Suite (OA...
Optimize DR and Cloning with Logical Hostnames in Oracle E-Business Suite (OA...
 
Patterns and Pains of Migrating Legacy Applications to Kubernetes
Patterns and Pains of Migrating Legacy Applications to KubernetesPatterns and Pains of Migrating Legacy Applications to Kubernetes
Patterns and Pains of Migrating Legacy Applications to Kubernetes
 
Patterns and Pains of Migrating Legacy Applications to Kubernetes
Patterns and Pains of Migrating Legacy Applications to KubernetesPatterns and Pains of Migrating Legacy Applications to Kubernetes
Patterns and Pains of Migrating Legacy Applications to Kubernetes
 
Deep Automation and ML-Driven Analytics for Application Services
Deep Automation and ML-Driven Analytics for Application ServicesDeep Automation and ML-Driven Analytics for Application Services
Deep Automation and ML-Driven Analytics for Application Services
 
Are you ready to be edgy? Bringing applications to the edge of the network
Are you ready to be edgy? Bringing applications to the edge of the networkAre you ready to be edgy? Bringing applications to the edge of the network
Are you ready to be edgy? Bringing applications to the edge of the network
 
Developing for Hybrid Cloud with Bluemix
Developing for Hybrid Cloud with BluemixDeveloping for Hybrid Cloud with Bluemix
Developing for Hybrid Cloud with Bluemix
 
Project COLA: Use Case to create a scalable application in the cloud based on...
Project COLA: Use Case to create a scalable application in the cloud based on...Project COLA: Use Case to create a scalable application in the cloud based on...
Project COLA: Use Case to create a scalable application in the cloud based on...
 
GigaSpaces CCF 4 Xap
GigaSpaces CCF 4 XapGigaSpaces CCF 4 Xap
GigaSpaces CCF 4 Xap
 
SaaS Enablement of your existing application (Cloud Slam 2010)
SaaS Enablement of your existing application (Cloud Slam 2010)SaaS Enablement of your existing application (Cloud Slam 2010)
SaaS Enablement of your existing application (Cloud Slam 2010)
 
Infrastructure Strategies 2007
Infrastructure Strategies 2007Infrastructure Strategies 2007
Infrastructure Strategies 2007
 
CtrlS: Cloud Solutions for Retail & eCommerce
CtrlS: Cloud Solutions for Retail & eCommerceCtrlS: Cloud Solutions for Retail & eCommerce
CtrlS: Cloud Solutions for Retail & eCommerce
 
Edge Computing Platforms and Protocols - Ph.D. thesis
Edge Computing Platforms and Protocols - Ph.D. thesisEdge Computing Platforms and Protocols - Ph.D. thesis
Edge Computing Platforms and Protocols - Ph.D. thesis
 

More from Aerospike, Inc.

Building for a Real-time Data Future_Subbu Iyer.pdf
Building for a Real-time Data Future_Subbu Iyer.pdfBuilding for a Real-time Data Future_Subbu Iyer.pdf
Building for a Real-time Data Future_Subbu Iyer.pdfAerospike, Inc.
 
What a Modern Database Enables_Srini Srinivasan.pdf
What a Modern Database Enables_Srini Srinivasan.pdfWhat a Modern Database Enables_Srini Srinivasan.pdf
What a Modern Database Enables_Srini Srinivasan.pdfAerospike, Inc.
 
Aerospike & Unity_Connecting Developer Communities_Matt Dondelinger and Stace...
Aerospike & Unity_Connecting Developer Communities_Matt Dondelinger and Stace...Aerospike & Unity_Connecting Developer Communities_Matt Dondelinger and Stace...
Aerospike & Unity_Connecting Developer Communities_Matt Dondelinger and Stace...Aerospike, Inc.
 
Aerospike & AWS Working backward from the customer.pdf
Aerospike &  AWS Working backward from the customer.pdfAerospike &  AWS Working backward from the customer.pdf
Aerospike & AWS Working backward from the customer.pdfAerospike, Inc.
 
Update on Aerospike Database, Clients and Frameworks_Ronen Botzer.pdf
Update on Aerospike Database, Clients and Frameworks_Ronen Botzer.pdfUpdate on Aerospike Database, Clients and Frameworks_Ronen Botzer.pdf
Update on Aerospike Database, Clients and Frameworks_Ronen Botzer.pdfAerospike, Inc.
 
Developing for Real-time_Art Anderson.pdf
Developing for Real-time_Art Anderson.pdfDeveloping for Real-time_Art Anderson.pdf
Developing for Real-time_Art Anderson.pdfAerospike, Inc.
 
Aerospike Today and Tomorrow Product Roadmap 2023_Lenley Hensarling.pdf
Aerospike Today and Tomorrow Product Roadmap 2023_Lenley Hensarling.pdfAerospike Today and Tomorrow Product Roadmap 2023_Lenley Hensarling.pdf
Aerospike Today and Tomorrow Product Roadmap 2023_Lenley Hensarling.pdfAerospike, Inc.
 
Now in AI- How we got here_Ashwin Rao.pdf
Now in AI- How we got here_Ashwin Rao.pdfNow in AI- How we got here_Ashwin Rao.pdf
Now in AI- How we got here_Ashwin Rao.pdfAerospike, Inc.
 
Art of the Possible_Tim Faulkes.pdf
Art of the Possible_Tim Faulkes.pdfArt of the Possible_Tim Faulkes.pdf
Art of the Possible_Tim Faulkes.pdfAerospike, Inc.
 

More from Aerospike, Inc. (9)

Building for a Real-time Data Future_Subbu Iyer.pdf
Building for a Real-time Data Future_Subbu Iyer.pdfBuilding for a Real-time Data Future_Subbu Iyer.pdf
Building for a Real-time Data Future_Subbu Iyer.pdf
 
What a Modern Database Enables_Srini Srinivasan.pdf
What a Modern Database Enables_Srini Srinivasan.pdfWhat a Modern Database Enables_Srini Srinivasan.pdf
What a Modern Database Enables_Srini Srinivasan.pdf
 
Aerospike & Unity_Connecting Developer Communities_Matt Dondelinger and Stace...
Aerospike & Unity_Connecting Developer Communities_Matt Dondelinger and Stace...Aerospike & Unity_Connecting Developer Communities_Matt Dondelinger and Stace...
Aerospike & Unity_Connecting Developer Communities_Matt Dondelinger and Stace...
 
Aerospike & AWS Working backward from the customer.pdf
Aerospike &  AWS Working backward from the customer.pdfAerospike &  AWS Working backward from the customer.pdf
Aerospike & AWS Working backward from the customer.pdf
 
Update on Aerospike Database, Clients and Frameworks_Ronen Botzer.pdf
Update on Aerospike Database, Clients and Frameworks_Ronen Botzer.pdfUpdate on Aerospike Database, Clients and Frameworks_Ronen Botzer.pdf
Update on Aerospike Database, Clients and Frameworks_Ronen Botzer.pdf
 
Developing for Real-time_Art Anderson.pdf
Developing for Real-time_Art Anderson.pdfDeveloping for Real-time_Art Anderson.pdf
Developing for Real-time_Art Anderson.pdf
 
Aerospike Today and Tomorrow Product Roadmap 2023_Lenley Hensarling.pdf
Aerospike Today and Tomorrow Product Roadmap 2023_Lenley Hensarling.pdfAerospike Today and Tomorrow Product Roadmap 2023_Lenley Hensarling.pdf
Aerospike Today and Tomorrow Product Roadmap 2023_Lenley Hensarling.pdf
 
Now in AI- How we got here_Ashwin Rao.pdf
Now in AI- How we got here_Ashwin Rao.pdfNow in AI- How we got here_Ashwin Rao.pdf
Now in AI- How we got here_Ashwin Rao.pdf
 
Art of the Possible_Tim Faulkes.pdf
Art of the Possible_Tim Faulkes.pdfArt of the Possible_Tim Faulkes.pdf
Art of the Possible_Tim Faulkes.pdf
 

Recently uploaded

The Ultimate Prompt Engineering Guide for Generative AI: Get the Most Out of ...
The Ultimate Prompt Engineering Guide for Generative AI: Get the Most Out of ...The Ultimate Prompt Engineering Guide for Generative AI: Get the Most Out of ...
The Ultimate Prompt Engineering Guide for Generative AI: Get the Most Out of ...SOFTTECHHUB
 
Top 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development CompaniesTop 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development CompaniesTopCSSGallery
 
JavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate GuideJavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate GuidePixlogix Infotech
 
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...ScyllaDB
 
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?Paolo Missier
 
AI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by AnitarajAI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by AnitarajAnitaRaj43
 
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)Samir Dash
 
State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!Memoori
 
CORS (Kitworks Team Study 양다윗 발표자료 240510)
CORS (Kitworks Team Study 양다윗 발표자료 240510)CORS (Kitworks Team Study 양다윗 발표자료 240510)
CORS (Kitworks Team Study 양다윗 발표자료 240510)Wonjun Hwang
 
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...FIDO Alliance
 
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdfMuhammad Subhan
 
WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024Lorenzo Miniero
 
Introduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptxIntroduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptxFIDO Alliance
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightSafe Software
 
ChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps ProductivityChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps ProductivityVictorSzoltysek
 
Vector Search @ sw2con for slideshare.pptx
Vector Search @ sw2con for slideshare.pptxVector Search @ sw2con for slideshare.pptx
Vector Search @ sw2con for slideshare.pptxjbellis
 
Intro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptxIntro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptxFIDO Alliance
 
How we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfHow we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfSrushith Repakula
 
How to Check CNIC Information Online with Pakdata cf
How to Check CNIC Information Online with Pakdata cfHow to Check CNIC Information Online with Pakdata cf
How to Check CNIC Information Online with Pakdata cfdanishmna97
 

Recently uploaded (20)

The Ultimate Prompt Engineering Guide for Generative AI: Get the Most Out of ...
The Ultimate Prompt Engineering Guide for Generative AI: Get the Most Out of ...The Ultimate Prompt Engineering Guide for Generative AI: Get the Most Out of ...
The Ultimate Prompt Engineering Guide for Generative AI: Get the Most Out of ...
 
Top 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development CompaniesTop 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development Companies
 
JavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate GuideJavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate Guide
 
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
 
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
 
AI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by AnitarajAI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by Anitaraj
 
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
 
State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!
 
CORS (Kitworks Team Study 양다윗 발표자료 240510)
CORS (Kitworks Team Study 양다윗 발표자료 240510)CORS (Kitworks Team Study 양다윗 발표자료 240510)
CORS (Kitworks Team Study 양다윗 발표자료 240510)
 
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
 
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
 
WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024
 
Introduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptxIntroduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptx
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
ChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps ProductivityChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps Productivity
 
Vector Search @ sw2con for slideshare.pptx
Vector Search @ sw2con for slideshare.pptxVector Search @ sw2con for slideshare.pptx
Vector Search @ sw2con for slideshare.pptx
 
Intro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptxIntro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptx
 
How we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfHow we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdf
 
Overview of Hyperledger Foundation
Overview of Hyperledger FoundationOverview of Hyperledger Foundation
Overview of Hyperledger Foundation
 
How to Check CNIC Information Online with Pakdata cf
How to Check CNIC Information Online with Pakdata cfHow to Check CNIC Information Online with Pakdata cf
How to Check CNIC Information Online with Pakdata cf
 

App Modernization with Aerospike as an Intraday System of Record_Venkat Thamminana.pdf

  • 1. App Modernization with Aerospike as an Intraday System of Record Venkat Thamminana Managing Director, Portfolio Management Technology Charles Schwab
  • 2. Proprietary & Confidential | All rights reserved. © 2023 Aerospike, Inc. Modernization goals a. Vision- Build better, faster and cheaper solutions b. Architectural principles i. One operational data store ii. No local caching at VM level iii.Maximum code reuse iv.Avoid or minimize calls outside CLR/JVM v. App tier is just business logic and on light weight VMs 2
  • 3. Proprietary & Confidential | All rights reserved. © 2023 Aerospike, Inc. Trading architecture view- 2014 vs now 2014 view a. All the core trading applications are on mainframe b. Limited skillset c. Scaling is costly d. Development takes time e. Constraints on latency & throughput f. Availability- DR is a challenge Current view a. All the client interfacing applications are decoupled from mainframe b. DB2 is retained as system of record for legacy applications c. Developed on dotNet platform with aerospike as distributed database d. Horizontally scalable e. Latency is in 30 milliseconds and throughput is 2 M transactions/min f. Deployed in multiple data centers with zone isolation strategy for high availability 3
  • 4. Proprietary & Confidential | All rights reserved. © 2023 Aerospike, Inc. Modernization Strategy followed a. Aerospike as intraday system of record i. Migrate all the read apps i. Have all the data in aerospike with near real time refresh ii. Daily refresh, intraday refresh & weekly refresh as needed iii. Deploy the business logic on app tier with data in aerospike ii. Migrate write apps, retain DB2 as system of record i. Post the transactions real time onto aerospike ii. Async process to update data in DB2 b. Aerospike as system of record i. Build all new capabilities ii. Build for the resiliency for data i. Not to leverage XDR- XDR can propagate data loss/corruption that happens in one DC to other DCs making it harder to restore ii. Zone isolation where each zone will have 100% of data. 4
  • 5. Proprietary & Confidential | All rights reserved. © 2023 Aerospike, Inc. A view of current stats a. Aerospike DB level a. Data stored per zone a. ~150 TB b. Transaction volumes a. 75 Billions in a typical day b. 20 Billion writes c. 55 Billion reads c. Latency a. 99.9% of all read as well as writes are < 1 millisecond d. Throughput a. 1.1M/sec- Reads, 0.45 M/sec- writes b. Application level a. Latency- ~30 millisecond/transaction b. Throughput- 2 M/min 5
  • 6. Proprietary & Confidential | All rights reserved. © 2023 Aerospike, Inc. 6 1st phase- all read applications are migrated 2nd phase- all write applications are migrated 3rd phase- All new capabilities are developed with aerospike as system of record. Modernization journey- 3 phases
  • 7. Proprietary & Confidential | All rights reserved. © 2023 Aerospike, Inc. Zone Isolation deployment- multi zone view Key call outs • A new zone can be setup without disturbing any other zone. Only interaction with other zone is through async messaging apps. • Failover from active zone to another zone will be very quick and involve routing all the channels traffic at load balancer level. Data is consistent in all aerospike clusters, so no impact to client experience with fail over. • The failover process will remain same with zonal fail over or regional failover. • We have opportunity to handle all the channel traffic across multiple zones. (50% from zone 1 and 50% from zone2). True active-active setup. • Any changes, to write or apps, can be promoted to one zone. After validating the change in the zone, the changes can be promoted to all zones. • Ready for cloud deployment, can route the channel traffic in a canary mode to minimize risk. Txns Intraday events SOD files KAFKA multi node cluster NAS folder SOR database File Data loader Intraday data loader Txn posting Aero spike Read services Write services Zone 1 (Active) Service layer File loaders Async message processors Async Messaging Systems of record Txn generators Service Consumers Web & Mobile channels Async Messaging/Kafka Zone2 Read services Write services File Data loader Intraday data loader Txn posting Aero spike Read services Write services Read services Write services
  • 8. Proprietary & Confidential | All rights reserved. © 2023 Aerospike, Inc. In closing a. Modernization journey is very rewarding b. Met all the objectives we started with c. Aerospike exceeded our expectations and became a critical component in the eco system d. Developed an industry leading performance reporting capability with aerospike as system of record Coming next a. Make the applications cloud ready b. Deploy in public cloud 8