Primatics Financial - Parallel, High Throughput Risk Calculations On The Cloud


Published on

Published in: Technology, Economy & Finance
1 Comment
1 Like
  • I have a question about cloud computing in general and I think it applies to the financial world more than any...

    It seems to me that cloud computing is to the digital network world as perhaps nuclear power plants are to the energy world. There is no question that it is cheaper more efficient, and sustainable for the long term compared to the local networks and coal plants of the past. However are they not flawed in terms of the 1/1,000,000,000 accident. What protects the info if the cloud fails for an extended amount of time or whatever.

    Is it like the nuke plants that have back up diesel generators that are in worst shape than the rest of the plant at the time they are needed. It would seem that it would be far to easy to out grow the brick and mortar backup.

    I know Microsoft has already had an incident or two. granted these are the early days but at the same time it has only been a couple of years now. what happens when we get a big one??

    Seems like the financial records of an already fragile economy need to be grounded at some level,


    Finance Guy
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Primatics Financial - Parallel, High Throughput Risk Calculations On The Cloud

    1. 1. Evolv ™ Risk: Cloud Computing Use Case for Java One 2009 Nati Shalom CTO GigaSpaces Francis de la Cruz Manager , Argyn Kuketayev Senior Consultant, Primatics Financial
    2. 2. Use Case Outline <ul><li>Business Challenge </li></ul><ul><ul><li>Client Needs and Application Evolution </li></ul></ul><ul><ul><li>Business Needs </li></ul></ul><ul><li>Architectural Challenges </li></ul><ul><ul><li>Risk 1.5 Application Stack </li></ul></ul><ul><ul><li>Risk 2.0 Application Stack </li></ul></ul><ul><ul><li>Processing Unit diagram </li></ul></ul><ul><ul><li>Lessons Learned </li></ul></ul>
    3. 3. Business Case <ul><li>Many mid-size regional banks with sizeable mortgage portfolios </li></ul><ul><li>Outsource sophisticated mortgage credit risk modeling </li></ul><ul><li>Outsource IT infrastructure to perform costly computations, suited for on-demand PaaS </li></ul>
    4. 4. Primatics’ Story in Cloud Computing <ul><li>Company with roots in financial services and IT </li></ul><ul><li>Multiple clients in financial services, 2 products </li></ul><ul><li>2007 </li></ul><ul><ul><li>EVOLV Risk V1: Web-based hosted solution, a regional bank </li></ul></ul><ul><li>2008 </li></ul><ul><ul><li>V2: embrace Cloud computing, Amazon EC2 </li></ul></ul><ul><ul><li>V1.5: big national bank M&A, portfolio valuation, AWS EC2 </li></ul></ul><ul><li>2009 </li></ul><ul><ul><li>V2 “reloaded”: ground up redesign, GigaSpaces </li></ul></ul>
    5. 5. Business Needs: Accounting-Cashflows Risk Analytics Platform Stochastic (Monte Carlo) simulation: for each loan run 100 paths (360 months each) INPUT Loan Portfolio ( 100MB): 100k Loans x 1 KB data Forecast Scenarios (100MB): 1MB per simulation path Market History (<1MB) Assumptions, Setting, Dials (<1KB) OUTPUT Cashflows (3GB): 100k Loans x 360 months x 10 Doubles
    6. 6. Business Needs: Scale Many jobs by the same user Many users in a firm Many firms More loans, more simulations, longer time horizon Risk Analytics Platform
    7. 7. Overarching Challenges <ul><li>Quantitative financial applications (models) with heavy CPU load </li></ul><ul><li>Large volumes of data I/O </li></ul><ul><li>Infrastructure to support growing number of clients, and users </li></ul><ul><li>Varying load on the system, with spikes of heavy load </li></ul><ul><li>Avoid lock-in to cloud vendors </li></ul>
    8. 8. Evolv Risk 1.5 vs 2.0 Software Stack GIGASPACES Prior Grid Framework J2EE Platform Loans & securities Loans Web-Interface SSL Reporting Warehouse Model API Scenarios Loss & Valuation Securities Custom Templates Validation Pluggable Client models Model Validation & statistics Cohorts HPI rates Interest rates Market rates Provisioning Monitoring Job Scheduling Failover / Recovery Load Balancing AWS Billing Registration Management Loss Forecasts Valuations Discount rates Node Management OLAP Reports Auto Throttling SLA Space Based Architecture Scaling Manual Process Model Validation & statistics Provisioning Monitoring Billing AWS Registration AWS management Not In Architecture Auto Throttling Space Based Architecture SLA Node Management * Broker (MQ) Sun JMS Discovery Persistence Manager J2EE Platform Inbuilt models
    9. 9. Performance, Scalability, Data Security, Data Integrity
    10. 10. Performance, Scalability, Data Security, Data Integrity Primatics Gateway AWS Provisioning
    11. 11. Lessons Learned : Cloud Integration <ul><li>Provisioning </li></ul><ul><ul><li>Configuration API vs. Using Scripts </li></ul></ul><ul><li>Auto Throttling vs. Manual Throttling </li></ul><ul><li>Failover and Recovery provided by framework </li></ul><ul><li>Monitoring VIA GS Console and API vs in house application. </li></ul><ul><li>Infrastructure took 5 weeks vs 8 weeks to develop. </li></ul><ul><li>Achieving linear scalability was a matter of creating Processing Units. </li></ul>
    12. 12. Lessons Learned : Data and Processing <ul><li>Data Distribution </li></ul><ul><ul><li>Uses Spaces Architecture vs. In house developed JMS Broker and Discovery to push to Grid </li></ul></ul><ul><li>Deployment </li></ul><ul><ul><li>Uses GS API vs. Pushing data to grid or using machine images. </li></ul></ul>
    13. 13. Lessons Learned: <ul><li>Problems are now high class problems. </li></ul><ul><ul><li>GigaSpaces Framework spared us from low level problems. </li></ul></ul><ul><ul><li>Code written is for more answering ‘why’ not answering ‘how’. </li></ul></ul><ul><li>GigaSpaces: </li></ul><ul><ul><li>Provisioning out of the box </li></ul></ul><ul><ul><li>Failover and Recovery much easier </li></ul></ul><ul><ul><li>Monitoring through API and Console </li></ul></ul><ul><ul><li>SLA out of the box </li></ul></ul><ul><ul><li>Integrated into the Cloud </li></ul></ul><ul><ul><li>Significantly lowers the barrier of entry into Cloud computing </li></ul></ul>