SlideShare a Scribd company logo
1 of 26
Download to read offline
Managing Reference Data
      with MongoDB
Daniel Roberts
  Solution Architect
        10gen
Introduction

10gen is the company behind MongoDB –
the leading next generation database




 Document-         General               Open-
  Oriented         Purpose              Source



                      3
MongoDB functionality


                        MongoDB




 Relational




                             Key/Value or
                             Column Stores




                 4
Database Landscape
                     •  No Automatic Joins
                     •  Document Transactions
                     •  Fast, Scalable Read/Writes




                5
Relational Database Challenges
Data Types                    Agile Development
•  Unstructured data          •  Iterative
•  Semi-structured            •  Short development
   data                          cycles
•  Polymorphic data           •  New workloads




Volume of Data                New Architectures
•  Petabytes of data          •  Horizontal scaling
•  Trillions of records       •  Commodity servers
•  Tens of millions of        •  Cloud computing
   queries per second



                          6
Financial Services Use Cases

1.  Risk Analysis & Reporting
2.  Tick Data Capture & Analysis
3.  Portfolio and P&L Reporting
4.  Product Catalog and Trade Lifecycle Management
5.  Trade Repository
6.  Quantitative Analysis & Automated Trading
7.  Order Capture
8.  Reference Data



                                7
Reference Data

•  How do you globally distribute reference data?
   –  Polymorphic data
      •    Price / Products / Securities Master
      •    Counterparty information - KYC
      •    Corporate Actions
      •    Golden / Single source truth
   –  Often changing in structure,
      •  e.g. new products
   –  Often High volume
•  How is this typically solved today?



                                        8
Current Implementations

•  What do reference data solutions look like today?
•  Storage
   –  Relational Database or Caching Technologies
•  Replication
   –  ETL or Messaging
•  Complex, Costly and Brittle
   –  Maintenance
      •  schema changes
      •  infrastructure
   –  Multiple technologies

                              9
Why MongoDB?

•  What features in MongoDB are ideally suited for
   Global replicated reference data systems?

  1.  Dynamic and flexible schema




                          10
Relational: All Data is Column/Row

     IssID	
                IssuerName	
                      PVCurrency	
  
   117883	
          DWS	
  Vietnam	
  Fund	
                    USD	
  
    69461	
       Independence	
  III	
  Cdo	
  Ltd	
            USD	
  
   102862	
                 Zamano	
  Plc	
                      EUR	
  
    73277	
                  Green	
  Way	
                      BMD	
  
    65134	
      First	
  European	
  Growth	
  Inc.	
           CHF	
  



  SecID	
        EventID	
          Company_Mee9ng	
                 IssID	
  
 762288	
        407341	
                     AGM	
                117883	
  
 81198	
         243459	
                   SDCHG	
                 69461	
  
 422999	
        410626	
                     AGM	
                102862	
  
 422999	
        243440	
                   SDCHG	
                102862	
  
 75128	
          20056	
                    ISCHG	
                65134	
  




                                                         11
Instead Match the Data in your
Application
Relational             MongoDB
                  {!
                       !"IssID" : 65134,!
                       !"IssuerName" : "First European
                       !   !    !   !   !Growth Inc.",!
                       !"actions" : [!
                       !     !{!
                       !     !    !"Company_Meeting" : "ISCHG",!
                       !     !    !"EventID" : 20056,!
                       !     !    !"SecID" : 75128!
                       !     !},!
                       !     !{!
                       !     !    !"Company_Meeting" : "LSTAT",!
                       !     !    !"EventID" : 2716296,!
                       !     !    !"SecID" : 75128!
                       !     !}!
                       !]!
                  }!


                  12
Benefits of MongoDB’s Document Model

•  Expressiveness	
  of	
  Data	
  Modeling	
  
      –  A	
  single	
  document	
  can	
  express	
  and	
  encompass	
  a	
  wide	
  variety	
  of	
  noTons	
  
•  Flexible	
  Modeling	
  
    –  No	
  need	
  to	
  migrate	
  for	
  simple	
  extensions	
  
•  Simplifica9on	
  of	
  Data	
  Modeling	
  
    –  Fewer	
  collecTons	
  as	
  most	
  data	
  can	
  be	
  encapsulated	
  in	
  a	
  single	
  document	
  
•  Easier	
  Development	
  
      –  Developers	
  understand	
  documents	
  as	
  it	
  maps	
  well	
  to	
  their	
  data	
  structures	
  
•  Faster	
  Time	
  to	
  Market	
  
      –  Agile	
  development	
  means	
  faster	
  results	
  

 And	
  enables	
  beEer	
  data	
  locality	
  =>	
  faster	
  performance	
  and	
  scaling	
  


                                                         13
Why MongoDB?

•  What features in MongoDB are ideally suited for
   Globally replicated reference data systems?

  1.  Dynamic and flexible schema

  2.  Built in replication and high availability




                               14
High Availability




•  Automated replication and failover
•  Multi-data center support
•  Improved operational simplicity (e.g., HW swaps)
•  Data durability and consistency

                               15
Global Replication




                 16
Why MongoDB?

•  What features in MongoDB are ideally suited for
   Globally replicated reference data systems?

  1.  Dynamic and flexible schema

  2.  Built in replication and high availability

  3.  Tag Aware Sharding (Geo)




                               17
MongoDB Sharding




              18
Tag Aware Sharding


                EMEA
           NA




                       APAC




                19
1. Case Study: Global Broker Dealer -
     Reference Data Management

                                          ETL
                                                  ETL

                                                   ETL             ETL




                                                             ETL

Feeds & Batch data                          ETL
•  Pricing                    Source
•  Accounts                 Master Data                      ETL
•  Securities Master         (RDBMS)
•  Corporate actions

    Each represents
    •  People $
    •  Hardware $
                            Destination
    •  License $
                               Data
    •  Reg penalty $
                             (RDBMS)
    •  & other downstream
       problems



                                                        20
Solution with MongoDB

                                       Real-time
                                                       Real-time

                                                         Real-time           Real-time




                                                                     Real-time

Feeds & Batch data                                 Real-time
•  Pricing
•  Accounts                                                          Real-time
                          MongoDB
•  Securities Master
                           Primary
•  Corporate actions

    Each represents
    •  No people $
    •  Less hardware $
    •  Less license $
    •  No penalty $       MongoDB
    •  & many less       Secondaries
       problems



                                                               21
Case Study: Global investment bank

  Distribute reference data globally in real-time for
  fast local accessing and querying
         Problem                    Why MongoDB                        Results

•  Delays up to 20 hours in    •  Dynamic schema             •  Will save about
   distributing data via ETL      management: update            $40,000,000 in costs and
•  Had to manage 20               immediately & in one          penalties over 5 years
   distributed systems with       place
   same data                                                 •  Greater throughput means
                               •  Auto-replication: data        charging more to internal
•  Incurring regulatory           distributed in real-time      groups
   penalties from missing
   SLAs                        •  Both cache and database: •  Network and disk speed is
•  Stale data caused              cache always up-to-date     the bottleneck, not
   operational issues                                         software and applications
                               •  Simple data modeling &
                                  analysis: easy changes
                                  and understanding
                                             22
Summary

•  Why MongoDB for Reference Data solutions?

  1.  Dynamic and flexible schema

  2.  Built in replication and high availability

  3.  Tag Aware Sharding (Geo)




                               23
Q&A
Up And Coming

FS webinar in April - Tick database
•  http://www.10gen.com/webinar/using-mongodb-as-tick-database

FS webinar in April - Risk
•  http://www.10gen.com/webinar/mitigate-risk-with-mongodb

MongoDB Days - London, San Francisco, and NYC
•  http://www.10gen.com/events

MongoDB 2.4 Release
•  http://www.mongodb.org/downloads
Key Features

 JSON Data Model with                Auto-Sharding for
 Dynamic Schema                      Horizontal Scalability

                                     Rich, Document-Based
 Flexible, Full Index Support
                                     Queries

 Built-In Replication and
                                     Fast, In-Place Updates
 High Availability

 Aggregation Framework and
                                     GridFS for Large File Storage
 Map/Reduce




                                25
For More Information

 Resource                     User Data Management
                              Location

 MongoDB Downloads            www.mongodb.org/download

 Free Online Training         education.10gen.com

 Webinars and Events          www.10gen.com/events

 White Papers                 www.10gen.com/white-papers

 Customer Case Studies        www.10gen.com/customers

 Presentations                www.10gen.com/presentations

 Documentation                docs.mongodb.org

 Additional Info              info@10gen.com



                         26

More Related Content

What's hot

Understanding Reference Data with Aaron Zornes
Understanding Reference Data with Aaron ZornesUnderstanding Reference Data with Aaron Zornes
Understanding Reference Data with Aaron ZornesOrchestra Networks
 
Data Lake Architecture – Modern Strategies & Approaches
Data Lake Architecture – Modern Strategies & ApproachesData Lake Architecture – Modern Strategies & Approaches
Data Lake Architecture – Modern Strategies & ApproachesDATAVERSITY
 
Data Management is Data Governance
Data Management is Data GovernanceData Management is Data Governance
Data Management is Data GovernanceDATAVERSITY
 
Relational to Big Graph
Relational to Big GraphRelational to Big Graph
Relational to Big GraphNeo4j
 
Data Governance
Data GovernanceData Governance
Data GovernanceRob Lux
 
Big Data Architecture
Big Data ArchitectureBig Data Architecture
Big Data ArchitectureGuido Schmutz
 
Data Architecture for Data Governance
Data Architecture for Data GovernanceData Architecture for Data Governance
Data Architecture for Data GovernanceDATAVERSITY
 
Graph Databases for Master Data Management
Graph Databases for Master Data ManagementGraph Databases for Master Data Management
Graph Databases for Master Data ManagementNeo4j
 
Reference Data Management
Reference Data ManagementReference Data Management
Reference Data ManagementProfinit
 
Exploring Levels of Data Literacy
Exploring Levels of Data LiteracyExploring Levels of Data Literacy
Exploring Levels of Data LiteracyDATAVERSITY
 
Data strategy demistifying data
Data strategy demistifying dataData strategy demistifying data
Data strategy demistifying dataHans Verstraeten
 
Data Profiling, Data Catalogs and Metadata Harmonisation
Data Profiling, Data Catalogs and Metadata HarmonisationData Profiling, Data Catalogs and Metadata Harmonisation
Data Profiling, Data Catalogs and Metadata HarmonisationAlan McSweeney
 
Modern Metadata Strategies
Modern Metadata StrategiesModern Metadata Strategies
Modern Metadata StrategiesDATAVERSITY
 
Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?DATAVERSITY
 
Data Governance and Stewardship Roundtable
Data Governance and Stewardship RoundtableData Governance and Stewardship Roundtable
Data Governance and Stewardship RoundtableSumma
 
Intro to Data Vault 2.0 on Snowflake
Intro to Data Vault 2.0 on SnowflakeIntro to Data Vault 2.0 on Snowflake
Intro to Data Vault 2.0 on SnowflakeKent Graziano
 
Data Warehouse or Data Lake, Which Do I Choose?
Data Warehouse or Data Lake, Which Do I Choose?Data Warehouse or Data Lake, Which Do I Choose?
Data Warehouse or Data Lake, Which Do I Choose?DATAVERSITY
 
The Knowledge Graph Explosion
The Knowledge Graph ExplosionThe Knowledge Graph Explosion
The Knowledge Graph ExplosionNeo4j
 

What's hot (20)

Understanding Reference Data with Aaron Zornes
Understanding Reference Data with Aaron ZornesUnderstanding Reference Data with Aaron Zornes
Understanding Reference Data with Aaron Zornes
 
Data Lake Architecture – Modern Strategies & Approaches
Data Lake Architecture – Modern Strategies & ApproachesData Lake Architecture – Modern Strategies & Approaches
Data Lake Architecture – Modern Strategies & Approaches
 
Graph databases
Graph databasesGraph databases
Graph databases
 
Data Management is Data Governance
Data Management is Data GovernanceData Management is Data Governance
Data Management is Data Governance
 
Relational to Big Graph
Relational to Big GraphRelational to Big Graph
Relational to Big Graph
 
Data Governance
Data GovernanceData Governance
Data Governance
 
Big Data Architecture
Big Data ArchitectureBig Data Architecture
Big Data Architecture
 
Data Architecture for Data Governance
Data Architecture for Data GovernanceData Architecture for Data Governance
Data Architecture for Data Governance
 
Graph Databases for Master Data Management
Graph Databases for Master Data ManagementGraph Databases for Master Data Management
Graph Databases for Master Data Management
 
Reference Data Management
Reference Data ManagementReference Data Management
Reference Data Management
 
MDM and Reference Data
MDM and Reference DataMDM and Reference Data
MDM and Reference Data
 
Exploring Levels of Data Literacy
Exploring Levels of Data LiteracyExploring Levels of Data Literacy
Exploring Levels of Data Literacy
 
Data strategy demistifying data
Data strategy demistifying dataData strategy demistifying data
Data strategy demistifying data
 
Data Profiling, Data Catalogs and Metadata Harmonisation
Data Profiling, Data Catalogs and Metadata HarmonisationData Profiling, Data Catalogs and Metadata Harmonisation
Data Profiling, Data Catalogs and Metadata Harmonisation
 
Modern Metadata Strategies
Modern Metadata StrategiesModern Metadata Strategies
Modern Metadata Strategies
 
Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?
 
Data Governance and Stewardship Roundtable
Data Governance and Stewardship RoundtableData Governance and Stewardship Roundtable
Data Governance and Stewardship Roundtable
 
Intro to Data Vault 2.0 on Snowflake
Intro to Data Vault 2.0 on SnowflakeIntro to Data Vault 2.0 on Snowflake
Intro to Data Vault 2.0 on Snowflake
 
Data Warehouse or Data Lake, Which Do I Choose?
Data Warehouse or Data Lake, Which Do I Choose?Data Warehouse or Data Lake, Which Do I Choose?
Data Warehouse or Data Lake, Which Do I Choose?
 
The Knowledge Graph Explosion
The Knowledge Graph ExplosionThe Knowledge Graph Explosion
The Knowledge Graph Explosion
 

Viewers also liked

Credit Suisse, Reference Data Management on a Global Scale
Credit Suisse, Reference Data Management on a Global ScaleCredit Suisse, Reference Data Management on a Global Scale
Credit Suisse, Reference Data Management on a Global ScaleOrchestra Networks
 
Reference Data Integration: A Strategy for the Future
Reference Data Integration: A Strategy for the FutureReference Data Integration: A Strategy for the Future
Reference Data Integration: A Strategy for the FutureBarry Smith
 
Webinar: How MongoDB is Used to Manage Reference Data - May 2014
Webinar: How MongoDB is Used to Manage Reference Data - May 2014Webinar: How MongoDB is Used to Manage Reference Data - May 2014
Webinar: How MongoDB is Used to Manage Reference Data - May 2014MongoDB
 
MDM Institute: Why is Reference data mission critical now?
MDM Institute: Why is Reference data mission critical now?MDM Institute: Why is Reference data mission critical now?
MDM Institute: Why is Reference data mission critical now?Orchestra Networks
 
MongoDB Schema Design
MongoDB Schema DesignMongoDB Schema Design
MongoDB Schema Designaaronheckmann
 
An Elastic Metadata Store for eBay’s Media Platform
An Elastic Metadata Store for eBay’s Media PlatformAn Elastic Metadata Store for eBay’s Media Platform
An Elastic Metadata Store for eBay’s Media PlatformMongoDB
 
United Technologies, Hands On Reference Data Management For Corporate Finance...
United Technologies, Hands On Reference Data Management For Corporate Finance...United Technologies, Hands On Reference Data Management For Corporate Finance...
United Technologies, Hands On Reference Data Management For Corporate Finance...Orchestra Networks
 
Microservices with Apache Camel
Microservices with Apache CamelMicroservices with Apache Camel
Microservices with Apache CamelClaus Ibsen
 
Kafka Reliability - When it absolutely, positively has to be there
Kafka Reliability - When it absolutely, positively has to be thereKafka Reliability - When it absolutely, positively has to be there
Kafka Reliability - When it absolutely, positively has to be thereGwen (Chen) Shapira
 
How to identify the correct Master Data subject areas & tooling for your MDM...
How to identify the correct Master Data subject areas & tooling for your MDM...How to identify the correct Master Data subject areas & tooling for your MDM...
How to identify the correct Master Data subject areas & tooling for your MDM...Christopher Bradley
 

Viewers also liked (13)

Credit Suisse, Reference Data Management on a Global Scale
Credit Suisse, Reference Data Management on a Global ScaleCredit Suisse, Reference Data Management on a Global Scale
Credit Suisse, Reference Data Management on a Global Scale
 
Reference Data Management
Reference Data Management Reference Data Management
Reference Data Management
 
Reference Data Integration: A Strategy for the Future
Reference Data Integration: A Strategy for the FutureReference Data Integration: A Strategy for the Future
Reference Data Integration: A Strategy for the Future
 
Webinar: How MongoDB is Used to Manage Reference Data - May 2014
Webinar: How MongoDB is Used to Manage Reference Data - May 2014Webinar: How MongoDB is Used to Manage Reference Data - May 2014
Webinar: How MongoDB is Used to Manage Reference Data - May 2014
 
MDM Institute: Why is Reference data mission critical now?
MDM Institute: Why is Reference data mission critical now?MDM Institute: Why is Reference data mission critical now?
MDM Institute: Why is Reference data mission critical now?
 
MongoDB Schema Design
MongoDB Schema DesignMongoDB Schema Design
MongoDB Schema Design
 
An Elastic Metadata Store for eBay’s Media Platform
An Elastic Metadata Store for eBay’s Media PlatformAn Elastic Metadata Store for eBay’s Media Platform
An Elastic Metadata Store for eBay’s Media Platform
 
United Technologies, Hands On Reference Data Management For Corporate Finance...
United Technologies, Hands On Reference Data Management For Corporate Finance...United Technologies, Hands On Reference Data Management For Corporate Finance...
United Technologies, Hands On Reference Data Management For Corporate Finance...
 
Microservices with Apache Camel
Microservices with Apache CamelMicroservices with Apache Camel
Microservices with Apache Camel
 
Kafka Reliability - When it absolutely, positively has to be there
Kafka Reliability - When it absolutely, positively has to be thereKafka Reliability - When it absolutely, positively has to be there
Kafka Reliability - When it absolutely, positively has to be there
 
Big data analysis concepts and references
Big data analysis concepts and referencesBig data analysis concepts and references
Big data analysis concepts and references
 
Multidomain MDM at Amadeus
Multidomain MDM at AmadeusMultidomain MDM at Amadeus
Multidomain MDM at Amadeus
 
How to identify the correct Master Data subject areas & tooling for your MDM...
How to identify the correct Master Data subject areas & tooling for your MDM...How to identify the correct Master Data subject areas & tooling for your MDM...
How to identify the correct Master Data subject areas & tooling for your MDM...
 

Similar to Webinar: How Banks Manage Reference Data with MongoDB

MongoBD London 2013: Real World MongoDB: Use Cases from Financial Services pr...
MongoBD London 2013: Real World MongoDB: Use Cases from Financial Services pr...MongoBD London 2013: Real World MongoDB: Use Cases from Financial Services pr...
MongoBD London 2013: Real World MongoDB: Use Cases from Financial Services pr...MongoDB
 
MongoDB in FS
MongoDB in FSMongoDB in FS
MongoDB in FSMongoDB
 
L’architettura di Classe Enterprise di Nuova Generazione
L’architettura di Classe Enterprise di Nuova GenerazioneL’architettura di Classe Enterprise di Nuova Generazione
L’architettura di Classe Enterprise di Nuova GenerazioneMongoDB
 
When to Use MongoDB...and When You Should Not...
When to Use MongoDB...and When You Should Not...When to Use MongoDB...and When You Should Not...
When to Use MongoDB...and When You Should Not...MongoDB
 
L’architettura di classe enterprise di nuova generazione
L’architettura di classe enterprise di nuova generazioneL’architettura di classe enterprise di nuova generazione
L’architettura di classe enterprise di nuova generazioneMongoDB
 
Introducing MongoDB into your Organization
Introducing MongoDB into your OrganizationIntroducing MongoDB into your Organization
Introducing MongoDB into your OrganizationMongoDB
 
Enterprise Reporting with MongoDB and JasperSoft
Enterprise Reporting with MongoDB and JasperSoftEnterprise Reporting with MongoDB and JasperSoft
Enterprise Reporting with MongoDB and JasperSoftMongoDB
 
MongoDB Europe 2016 - The Rise of the Data Lake
MongoDB Europe 2016 - The Rise of the Data LakeMongoDB Europe 2016 - The Rise of the Data Lake
MongoDB Europe 2016 - The Rise of the Data LakeMongoDB
 
Webinar: How to Drive Business Value in Financial Services with MongoDB
Webinar: How to Drive Business Value in Financial Services with MongoDBWebinar: How to Drive Business Value in Financial Services with MongoDB
Webinar: How to Drive Business Value in Financial Services with MongoDBMongoDB
 
When to Use MongoDB
When to Use MongoDBWhen to Use MongoDB
When to Use MongoDBMongoDB
 
MongoDB Breakfast Milan - Mainframe Offloading Strategies
MongoDB Breakfast Milan -  Mainframe Offloading StrategiesMongoDB Breakfast Milan -  Mainframe Offloading Strategies
MongoDB Breakfast Milan - Mainframe Offloading StrategiesMongoDB
 
mongoDB: Driving a data revolution
mongoDB: Driving a data revolutionmongoDB: Driving a data revolution
mongoDB: Driving a data revolutionMongoDB
 
An Evening with MongoDB Detroit 2013
An Evening with MongoDB Detroit 2013An Evening with MongoDB Detroit 2013
An Evening with MongoDB Detroit 2013MongoDB
 
How to Place Data at the Center of Digital Transformation in BFSI
How to Place Data at the Center of Digital Transformation in BFSIHow to Place Data at the Center of Digital Transformation in BFSI
How to Place Data at the Center of Digital Transformation in BFSIDenodo
 
Overcoming Today's Data Challenges with MongoDB
Overcoming Today's Data Challenges with MongoDBOvercoming Today's Data Challenges with MongoDB
Overcoming Today's Data Challenges with MongoDBMongoDB
 
Enabling Telco to Build and Run Modern Applications
Enabling Telco to Build and Run Modern Applications Enabling Telco to Build and Run Modern Applications
Enabling Telco to Build and Run Modern Applications Tugdual Grall
 
An Enterprise Architect's View of MongoDB
An Enterprise Architect's View of MongoDBAn Enterprise Architect's View of MongoDB
An Enterprise Architect's View of MongoDBMongoDB
 
An Introduction to Big Data, NoSQL and MongoDB
An Introduction to Big Data, NoSQL and MongoDBAn Introduction to Big Data, NoSQL and MongoDB
An Introduction to Big Data, NoSQL and MongoDBWilliam LaForest
 
Nosql Now 2012: MongoDB Use Cases
Nosql Now 2012: MongoDB Use CasesNosql Now 2012: MongoDB Use Cases
Nosql Now 2012: MongoDB Use CasesMongoDB
 

Similar to Webinar: How Banks Manage Reference Data with MongoDB (20)

MongoBD London 2013: Real World MongoDB: Use Cases from Financial Services pr...
MongoBD London 2013: Real World MongoDB: Use Cases from Financial Services pr...MongoBD London 2013: Real World MongoDB: Use Cases from Financial Services pr...
MongoBD London 2013: Real World MongoDB: Use Cases from Financial Services pr...
 
MongoDB in FS
MongoDB in FSMongoDB in FS
MongoDB in FS
 
L’architettura di Classe Enterprise di Nuova Generazione
L’architettura di Classe Enterprise di Nuova GenerazioneL’architettura di Classe Enterprise di Nuova Generazione
L’architettura di Classe Enterprise di Nuova Generazione
 
When to Use MongoDB...and When You Should Not...
When to Use MongoDB...and When You Should Not...When to Use MongoDB...and When You Should Not...
When to Use MongoDB...and When You Should Not...
 
L’architettura di classe enterprise di nuova generazione
L’architettura di classe enterprise di nuova generazioneL’architettura di classe enterprise di nuova generazione
L’architettura di classe enterprise di nuova generazione
 
Introducing MongoDB into your Organization
Introducing MongoDB into your OrganizationIntroducing MongoDB into your Organization
Introducing MongoDB into your Organization
 
Enterprise Reporting with MongoDB and JasperSoft
Enterprise Reporting with MongoDB and JasperSoftEnterprise Reporting with MongoDB and JasperSoft
Enterprise Reporting with MongoDB and JasperSoft
 
Tech view on Regulatory Compliance
Tech view on Regulatory ComplianceTech view on Regulatory Compliance
Tech view on Regulatory Compliance
 
MongoDB Europe 2016 - The Rise of the Data Lake
MongoDB Europe 2016 - The Rise of the Data LakeMongoDB Europe 2016 - The Rise of the Data Lake
MongoDB Europe 2016 - The Rise of the Data Lake
 
Webinar: How to Drive Business Value in Financial Services with MongoDB
Webinar: How to Drive Business Value in Financial Services with MongoDBWebinar: How to Drive Business Value in Financial Services with MongoDB
Webinar: How to Drive Business Value in Financial Services with MongoDB
 
When to Use MongoDB
When to Use MongoDBWhen to Use MongoDB
When to Use MongoDB
 
MongoDB Breakfast Milan - Mainframe Offloading Strategies
MongoDB Breakfast Milan -  Mainframe Offloading StrategiesMongoDB Breakfast Milan -  Mainframe Offloading Strategies
MongoDB Breakfast Milan - Mainframe Offloading Strategies
 
mongoDB: Driving a data revolution
mongoDB: Driving a data revolutionmongoDB: Driving a data revolution
mongoDB: Driving a data revolution
 
An Evening with MongoDB Detroit 2013
An Evening with MongoDB Detroit 2013An Evening with MongoDB Detroit 2013
An Evening with MongoDB Detroit 2013
 
How to Place Data at the Center of Digital Transformation in BFSI
How to Place Data at the Center of Digital Transformation in BFSIHow to Place Data at the Center of Digital Transformation in BFSI
How to Place Data at the Center of Digital Transformation in BFSI
 
Overcoming Today's Data Challenges with MongoDB
Overcoming Today's Data Challenges with MongoDBOvercoming Today's Data Challenges with MongoDB
Overcoming Today's Data Challenges with MongoDB
 
Enabling Telco to Build and Run Modern Applications
Enabling Telco to Build and Run Modern Applications Enabling Telco to Build and Run Modern Applications
Enabling Telco to Build and Run Modern Applications
 
An Enterprise Architect's View of MongoDB
An Enterprise Architect's View of MongoDBAn Enterprise Architect's View of MongoDB
An Enterprise Architect's View of MongoDB
 
An Introduction to Big Data, NoSQL and MongoDB
An Introduction to Big Data, NoSQL and MongoDBAn Introduction to Big Data, NoSQL and MongoDB
An Introduction to Big Data, NoSQL and MongoDB
 
Nosql Now 2012: MongoDB Use Cases
Nosql Now 2012: MongoDB Use CasesNosql Now 2012: MongoDB Use Cases
Nosql Now 2012: MongoDB Use Cases
 

More from MongoDB

MongoDB SoCal 2020: Migrate Anything* to MongoDB Atlas
MongoDB SoCal 2020: Migrate Anything* to MongoDB AtlasMongoDB SoCal 2020: Migrate Anything* to MongoDB Atlas
MongoDB SoCal 2020: Migrate Anything* to MongoDB AtlasMongoDB
 
MongoDB SoCal 2020: Go on a Data Safari with MongoDB Charts!
MongoDB SoCal 2020: Go on a Data Safari with MongoDB Charts!MongoDB SoCal 2020: Go on a Data Safari with MongoDB Charts!
MongoDB SoCal 2020: Go on a Data Safari with MongoDB Charts!MongoDB
 
MongoDB SoCal 2020: Using MongoDB Services in Kubernetes: Any Platform, Devel...
MongoDB SoCal 2020: Using MongoDB Services in Kubernetes: Any Platform, Devel...MongoDB SoCal 2020: Using MongoDB Services in Kubernetes: Any Platform, Devel...
MongoDB SoCal 2020: Using MongoDB Services in Kubernetes: Any Platform, Devel...MongoDB
 
MongoDB SoCal 2020: A Complete Methodology of Data Modeling for MongoDB
MongoDB SoCal 2020: A Complete Methodology of Data Modeling for MongoDBMongoDB SoCal 2020: A Complete Methodology of Data Modeling for MongoDB
MongoDB SoCal 2020: A Complete Methodology of Data Modeling for MongoDBMongoDB
 
MongoDB SoCal 2020: From Pharmacist to Analyst: Leveraging MongoDB for Real-T...
MongoDB SoCal 2020: From Pharmacist to Analyst: Leveraging MongoDB for Real-T...MongoDB SoCal 2020: From Pharmacist to Analyst: Leveraging MongoDB for Real-T...
MongoDB SoCal 2020: From Pharmacist to Analyst: Leveraging MongoDB for Real-T...MongoDB
 
MongoDB SoCal 2020: Best Practices for Working with IoT and Time-series Data
MongoDB SoCal 2020: Best Practices for Working with IoT and Time-series DataMongoDB SoCal 2020: Best Practices for Working with IoT and Time-series Data
MongoDB SoCal 2020: Best Practices for Working with IoT and Time-series DataMongoDB
 
MongoDB SoCal 2020: MongoDB Atlas Jump Start
 MongoDB SoCal 2020: MongoDB Atlas Jump Start MongoDB SoCal 2020: MongoDB Atlas Jump Start
MongoDB SoCal 2020: MongoDB Atlas Jump StartMongoDB
 
MongoDB .local San Francisco 2020: Powering the new age data demands [Infosys]
MongoDB .local San Francisco 2020: Powering the new age data demands [Infosys]MongoDB .local San Francisco 2020: Powering the new age data demands [Infosys]
MongoDB .local San Francisco 2020: Powering the new age data demands [Infosys]MongoDB
 
MongoDB .local San Francisco 2020: Using Client Side Encryption in MongoDB 4.2
MongoDB .local San Francisco 2020: Using Client Side Encryption in MongoDB 4.2MongoDB .local San Francisco 2020: Using Client Side Encryption in MongoDB 4.2
MongoDB .local San Francisco 2020: Using Client Side Encryption in MongoDB 4.2MongoDB
 
MongoDB .local San Francisco 2020: Using MongoDB Services in Kubernetes: any ...
MongoDB .local San Francisco 2020: Using MongoDB Services in Kubernetes: any ...MongoDB .local San Francisco 2020: Using MongoDB Services in Kubernetes: any ...
MongoDB .local San Francisco 2020: Using MongoDB Services in Kubernetes: any ...MongoDB
 
MongoDB .local San Francisco 2020: Go on a Data Safari with MongoDB Charts!
MongoDB .local San Francisco 2020: Go on a Data Safari with MongoDB Charts!MongoDB .local San Francisco 2020: Go on a Data Safari with MongoDB Charts!
MongoDB .local San Francisco 2020: Go on a Data Safari with MongoDB Charts!MongoDB
 
MongoDB .local San Francisco 2020: From SQL to NoSQL -- Changing Your Mindset
MongoDB .local San Francisco 2020: From SQL to NoSQL -- Changing Your MindsetMongoDB .local San Francisco 2020: From SQL to NoSQL -- Changing Your Mindset
MongoDB .local San Francisco 2020: From SQL to NoSQL -- Changing Your MindsetMongoDB
 
MongoDB .local San Francisco 2020: MongoDB Atlas Jumpstart
MongoDB .local San Francisco 2020: MongoDB Atlas JumpstartMongoDB .local San Francisco 2020: MongoDB Atlas Jumpstart
MongoDB .local San Francisco 2020: MongoDB Atlas JumpstartMongoDB
 
MongoDB .local San Francisco 2020: Tips and Tricks++ for Querying and Indexin...
MongoDB .local San Francisco 2020: Tips and Tricks++ for Querying and Indexin...MongoDB .local San Francisco 2020: Tips and Tricks++ for Querying and Indexin...
MongoDB .local San Francisco 2020: Tips and Tricks++ for Querying and Indexin...MongoDB
 
MongoDB .local San Francisco 2020: Aggregation Pipeline Power++
MongoDB .local San Francisco 2020: Aggregation Pipeline Power++MongoDB .local San Francisco 2020: Aggregation Pipeline Power++
MongoDB .local San Francisco 2020: Aggregation Pipeline Power++MongoDB
 
MongoDB .local San Francisco 2020: A Complete Methodology of Data Modeling fo...
MongoDB .local San Francisco 2020: A Complete Methodology of Data Modeling fo...MongoDB .local San Francisco 2020: A Complete Methodology of Data Modeling fo...
MongoDB .local San Francisco 2020: A Complete Methodology of Data Modeling fo...MongoDB
 
MongoDB .local San Francisco 2020: MongoDB Atlas Data Lake Technical Deep Dive
MongoDB .local San Francisco 2020: MongoDB Atlas Data Lake Technical Deep DiveMongoDB .local San Francisco 2020: MongoDB Atlas Data Lake Technical Deep Dive
MongoDB .local San Francisco 2020: MongoDB Atlas Data Lake Technical Deep DiveMongoDB
 
MongoDB .local San Francisco 2020: Developing Alexa Skills with MongoDB & Golang
MongoDB .local San Francisco 2020: Developing Alexa Skills with MongoDB & GolangMongoDB .local San Francisco 2020: Developing Alexa Skills with MongoDB & Golang
MongoDB .local San Francisco 2020: Developing Alexa Skills with MongoDB & GolangMongoDB
 
MongoDB .local Paris 2020: Realm : l'ingrédient secret pour de meilleures app...
MongoDB .local Paris 2020: Realm : l'ingrédient secret pour de meilleures app...MongoDB .local Paris 2020: Realm : l'ingrédient secret pour de meilleures app...
MongoDB .local Paris 2020: Realm : l'ingrédient secret pour de meilleures app...MongoDB
 
MongoDB .local Paris 2020: Upply @MongoDB : Upply : Quand le Machine Learning...
MongoDB .local Paris 2020: Upply @MongoDB : Upply : Quand le Machine Learning...MongoDB .local Paris 2020: Upply @MongoDB : Upply : Quand le Machine Learning...
MongoDB .local Paris 2020: Upply @MongoDB : Upply : Quand le Machine Learning...MongoDB
 

More from MongoDB (20)

MongoDB SoCal 2020: Migrate Anything* to MongoDB Atlas
MongoDB SoCal 2020: Migrate Anything* to MongoDB AtlasMongoDB SoCal 2020: Migrate Anything* to MongoDB Atlas
MongoDB SoCal 2020: Migrate Anything* to MongoDB Atlas
 
MongoDB SoCal 2020: Go on a Data Safari with MongoDB Charts!
MongoDB SoCal 2020: Go on a Data Safari with MongoDB Charts!MongoDB SoCal 2020: Go on a Data Safari with MongoDB Charts!
MongoDB SoCal 2020: Go on a Data Safari with MongoDB Charts!
 
MongoDB SoCal 2020: Using MongoDB Services in Kubernetes: Any Platform, Devel...
MongoDB SoCal 2020: Using MongoDB Services in Kubernetes: Any Platform, Devel...MongoDB SoCal 2020: Using MongoDB Services in Kubernetes: Any Platform, Devel...
MongoDB SoCal 2020: Using MongoDB Services in Kubernetes: Any Platform, Devel...
 
MongoDB SoCal 2020: A Complete Methodology of Data Modeling for MongoDB
MongoDB SoCal 2020: A Complete Methodology of Data Modeling for MongoDBMongoDB SoCal 2020: A Complete Methodology of Data Modeling for MongoDB
MongoDB SoCal 2020: A Complete Methodology of Data Modeling for MongoDB
 
MongoDB SoCal 2020: From Pharmacist to Analyst: Leveraging MongoDB for Real-T...
MongoDB SoCal 2020: From Pharmacist to Analyst: Leveraging MongoDB for Real-T...MongoDB SoCal 2020: From Pharmacist to Analyst: Leveraging MongoDB for Real-T...
MongoDB SoCal 2020: From Pharmacist to Analyst: Leveraging MongoDB for Real-T...
 
MongoDB SoCal 2020: Best Practices for Working with IoT and Time-series Data
MongoDB SoCal 2020: Best Practices for Working with IoT and Time-series DataMongoDB SoCal 2020: Best Practices for Working with IoT and Time-series Data
MongoDB SoCal 2020: Best Practices for Working with IoT and Time-series Data
 
MongoDB SoCal 2020: MongoDB Atlas Jump Start
 MongoDB SoCal 2020: MongoDB Atlas Jump Start MongoDB SoCal 2020: MongoDB Atlas Jump Start
MongoDB SoCal 2020: MongoDB Atlas Jump Start
 
MongoDB .local San Francisco 2020: Powering the new age data demands [Infosys]
MongoDB .local San Francisco 2020: Powering the new age data demands [Infosys]MongoDB .local San Francisco 2020: Powering the new age data demands [Infosys]
MongoDB .local San Francisco 2020: Powering the new age data demands [Infosys]
 
MongoDB .local San Francisco 2020: Using Client Side Encryption in MongoDB 4.2
MongoDB .local San Francisco 2020: Using Client Side Encryption in MongoDB 4.2MongoDB .local San Francisco 2020: Using Client Side Encryption in MongoDB 4.2
MongoDB .local San Francisco 2020: Using Client Side Encryption in MongoDB 4.2
 
MongoDB .local San Francisco 2020: Using MongoDB Services in Kubernetes: any ...
MongoDB .local San Francisco 2020: Using MongoDB Services in Kubernetes: any ...MongoDB .local San Francisco 2020: Using MongoDB Services in Kubernetes: any ...
MongoDB .local San Francisco 2020: Using MongoDB Services in Kubernetes: any ...
 
MongoDB .local San Francisco 2020: Go on a Data Safari with MongoDB Charts!
MongoDB .local San Francisco 2020: Go on a Data Safari with MongoDB Charts!MongoDB .local San Francisco 2020: Go on a Data Safari with MongoDB Charts!
MongoDB .local San Francisco 2020: Go on a Data Safari with MongoDB Charts!
 
MongoDB .local San Francisco 2020: From SQL to NoSQL -- Changing Your Mindset
MongoDB .local San Francisco 2020: From SQL to NoSQL -- Changing Your MindsetMongoDB .local San Francisco 2020: From SQL to NoSQL -- Changing Your Mindset
MongoDB .local San Francisco 2020: From SQL to NoSQL -- Changing Your Mindset
 
MongoDB .local San Francisco 2020: MongoDB Atlas Jumpstart
MongoDB .local San Francisco 2020: MongoDB Atlas JumpstartMongoDB .local San Francisco 2020: MongoDB Atlas Jumpstart
MongoDB .local San Francisco 2020: MongoDB Atlas Jumpstart
 
MongoDB .local San Francisco 2020: Tips and Tricks++ for Querying and Indexin...
MongoDB .local San Francisco 2020: Tips and Tricks++ for Querying and Indexin...MongoDB .local San Francisco 2020: Tips and Tricks++ for Querying and Indexin...
MongoDB .local San Francisco 2020: Tips and Tricks++ for Querying and Indexin...
 
MongoDB .local San Francisco 2020: Aggregation Pipeline Power++
MongoDB .local San Francisco 2020: Aggregation Pipeline Power++MongoDB .local San Francisco 2020: Aggregation Pipeline Power++
MongoDB .local San Francisco 2020: Aggregation Pipeline Power++
 
MongoDB .local San Francisco 2020: A Complete Methodology of Data Modeling fo...
MongoDB .local San Francisco 2020: A Complete Methodology of Data Modeling fo...MongoDB .local San Francisco 2020: A Complete Methodology of Data Modeling fo...
MongoDB .local San Francisco 2020: A Complete Methodology of Data Modeling fo...
 
MongoDB .local San Francisco 2020: MongoDB Atlas Data Lake Technical Deep Dive
MongoDB .local San Francisco 2020: MongoDB Atlas Data Lake Technical Deep DiveMongoDB .local San Francisco 2020: MongoDB Atlas Data Lake Technical Deep Dive
MongoDB .local San Francisco 2020: MongoDB Atlas Data Lake Technical Deep Dive
 
MongoDB .local San Francisco 2020: Developing Alexa Skills with MongoDB & Golang
MongoDB .local San Francisco 2020: Developing Alexa Skills with MongoDB & GolangMongoDB .local San Francisco 2020: Developing Alexa Skills with MongoDB & Golang
MongoDB .local San Francisco 2020: Developing Alexa Skills with MongoDB & Golang
 
MongoDB .local Paris 2020: Realm : l'ingrédient secret pour de meilleures app...
MongoDB .local Paris 2020: Realm : l'ingrédient secret pour de meilleures app...MongoDB .local Paris 2020: Realm : l'ingrédient secret pour de meilleures app...
MongoDB .local Paris 2020: Realm : l'ingrédient secret pour de meilleures app...
 
MongoDB .local Paris 2020: Upply @MongoDB : Upply : Quand le Machine Learning...
MongoDB .local Paris 2020: Upply @MongoDB : Upply : Quand le Machine Learning...MongoDB .local Paris 2020: Upply @MongoDB : Upply : Quand le Machine Learning...
MongoDB .local Paris 2020: Upply @MongoDB : Upply : Quand le Machine Learning...
 

Webinar: How Banks Manage Reference Data with MongoDB

  • 1. Managing Reference Data with MongoDB
  • 2. Daniel Roberts Solution Architect 10gen
  • 3. Introduction 10gen is the company behind MongoDB – the leading next generation database Document- General Open- Oriented Purpose Source 3
  • 4. MongoDB functionality MongoDB Relational Key/Value or Column Stores 4
  • 5. Database Landscape •  No Automatic Joins •  Document Transactions •  Fast, Scalable Read/Writes 5
  • 6. Relational Database Challenges Data Types Agile Development •  Unstructured data •  Iterative •  Semi-structured •  Short development data cycles •  Polymorphic data •  New workloads Volume of Data New Architectures •  Petabytes of data •  Horizontal scaling •  Trillions of records •  Commodity servers •  Tens of millions of •  Cloud computing queries per second 6
  • 7. Financial Services Use Cases 1.  Risk Analysis & Reporting 2.  Tick Data Capture & Analysis 3.  Portfolio and P&L Reporting 4.  Product Catalog and Trade Lifecycle Management 5.  Trade Repository 6.  Quantitative Analysis & Automated Trading 7.  Order Capture 8.  Reference Data 7
  • 8. Reference Data •  How do you globally distribute reference data? –  Polymorphic data •  Price / Products / Securities Master •  Counterparty information - KYC •  Corporate Actions •  Golden / Single source truth –  Often changing in structure, •  e.g. new products –  Often High volume •  How is this typically solved today? 8
  • 9. Current Implementations •  What do reference data solutions look like today? •  Storage –  Relational Database or Caching Technologies •  Replication –  ETL or Messaging •  Complex, Costly and Brittle –  Maintenance •  schema changes •  infrastructure –  Multiple technologies 9
  • 10. Why MongoDB? •  What features in MongoDB are ideally suited for Global replicated reference data systems? 1.  Dynamic and flexible schema 10
  • 11. Relational: All Data is Column/Row IssID   IssuerName   PVCurrency   117883   DWS  Vietnam  Fund   USD   69461   Independence  III  Cdo  Ltd   USD   102862   Zamano  Plc   EUR   73277   Green  Way   BMD   65134   First  European  Growth  Inc.   CHF   SecID   EventID   Company_Mee9ng   IssID   762288   407341   AGM   117883   81198   243459   SDCHG   69461   422999   410626   AGM   102862   422999   243440   SDCHG   102862   75128   20056   ISCHG   65134   11
  • 12. Instead Match the Data in your Application Relational MongoDB {! !"IssID" : 65134,! !"IssuerName" : "First European ! ! ! ! !Growth Inc.",! !"actions" : [! ! !{! ! ! !"Company_Meeting" : "ISCHG",! ! ! !"EventID" : 20056,! ! ! !"SecID" : 75128! ! !},! ! !{! ! ! !"Company_Meeting" : "LSTAT",! ! ! !"EventID" : 2716296,! ! ! !"SecID" : 75128! ! !}! !]! }! 12
  • 13. Benefits of MongoDB’s Document Model •  Expressiveness  of  Data  Modeling   –  A  single  document  can  express  and  encompass  a  wide  variety  of  noTons   •  Flexible  Modeling   –  No  need  to  migrate  for  simple  extensions   •  Simplifica9on  of  Data  Modeling   –  Fewer  collecTons  as  most  data  can  be  encapsulated  in  a  single  document   •  Easier  Development   –  Developers  understand  documents  as  it  maps  well  to  their  data  structures   •  Faster  Time  to  Market   –  Agile  development  means  faster  results   And  enables  beEer  data  locality  =>  faster  performance  and  scaling   13
  • 14. Why MongoDB? •  What features in MongoDB are ideally suited for Globally replicated reference data systems? 1.  Dynamic and flexible schema 2.  Built in replication and high availability 14
  • 15. High Availability •  Automated replication and failover •  Multi-data center support •  Improved operational simplicity (e.g., HW swaps) •  Data durability and consistency 15
  • 17. Why MongoDB? •  What features in MongoDB are ideally suited for Globally replicated reference data systems? 1.  Dynamic and flexible schema 2.  Built in replication and high availability 3.  Tag Aware Sharding (Geo) 17
  • 19. Tag Aware Sharding EMEA NA APAC 19
  • 20. 1. Case Study: Global Broker Dealer - Reference Data Management ETL ETL ETL ETL ETL Feeds & Batch data ETL •  Pricing Source •  Accounts Master Data ETL •  Securities Master (RDBMS) •  Corporate actions Each represents •  People $ •  Hardware $ Destination •  License $ Data •  Reg penalty $ (RDBMS) •  & other downstream problems 20
  • 21. Solution with MongoDB Real-time Real-time Real-time Real-time Real-time Feeds & Batch data Real-time •  Pricing •  Accounts Real-time MongoDB •  Securities Master Primary •  Corporate actions Each represents •  No people $ •  Less hardware $ •  Less license $ •  No penalty $ MongoDB •  & many less Secondaries problems 21
  • 22. Case Study: Global investment bank Distribute reference data globally in real-time for fast local accessing and querying Problem Why MongoDB Results •  Delays up to 20 hours in •  Dynamic schema •  Will save about distributing data via ETL management: update $40,000,000 in costs and •  Had to manage 20 immediately & in one penalties over 5 years distributed systems with place same data •  Greater throughput means •  Auto-replication: data charging more to internal •  Incurring regulatory distributed in real-time groups penalties from missing SLAs •  Both cache and database: •  Network and disk speed is •  Stale data caused cache always up-to-date the bottleneck, not operational issues software and applications •  Simple data modeling & analysis: easy changes and understanding 22
  • 23. Summary •  Why MongoDB for Reference Data solutions? 1.  Dynamic and flexible schema 2.  Built in replication and high availability 3.  Tag Aware Sharding (Geo) 23
  • 24. Q&A Up And Coming FS webinar in April - Tick database •  http://www.10gen.com/webinar/using-mongodb-as-tick-database FS webinar in April - Risk •  http://www.10gen.com/webinar/mitigate-risk-with-mongodb MongoDB Days - London, San Francisco, and NYC •  http://www.10gen.com/events MongoDB 2.4 Release •  http://www.mongodb.org/downloads
  • 25. Key Features JSON Data Model with Auto-Sharding for Dynamic Schema Horizontal Scalability Rich, Document-Based Flexible, Full Index Support Queries Built-In Replication and Fast, In-Place Updates High Availability Aggregation Framework and GridFS for Large File Storage Map/Reduce 25
  • 26. For More Information Resource User Data Management Location MongoDB Downloads www.mongodb.org/download Free Online Training education.10gen.com Webinars and Events www.10gen.com/events White Papers www.10gen.com/white-papers Customer Case Studies www.10gen.com/customers Presentations www.10gen.com/presentations Documentation docs.mongodb.org Additional Info info@10gen.com 26