Financial Data Analytics with Hadoop


Published on

Adam Gugliciello, a 15-year veteran in Software Engineering and Systems Architecture specializes in highly available, parallel systems. In this session, we will answer common questions and demonstrate use cases on how Hadoop and Datameer help with asset management and risk management, fraud detection and data security. This presentation was given on January 24th at the CME Group's offices in Chicago, IL.

Published in: Technology
1 Comment
No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Financial Data Analytics with Hadoop

  1. 1. Datameer in Financial Services! © 2012 Datameer, Inc. All rights reserved. © 2012 Datameer, Inc. All rights reserved.
  2. 2. Datameer in Financial Services!Datameer’s customers have derived benefitsaround:!•  Data Quality for improving confidence in source systems for Compliance and risk!•  Asset movement and application analytics for SLA and pricing controls!•  Fraud analytics to reduce losses and cost of anti fraud efforts!•  Risk profiling for Value at Risk and Credit Risk!•  Operations and Living Archival cost reduction! © 2012 Datameer, Inc. All rights reserved.
  3. 3. Data Quality & Compliance!Focus: Profiling!!   Use profiling techniques to assess and score of client accounts!!   Run complex data quality rules and models!!   Build exception reporting!Focus: Data Quality!!   Enable data stewards to run ad hoc analysis and dashboards!!   Trace Data lineage through transformations and quality checks for audit trail automatically!!   Drive iterative processes to refine data and improve confidence in numbers being reported to regulatory bodies for concerns like Basel III and Dodd-Frank!!   Net result: reduce risk and cost!! © 2012 Datameer, Inc. All rights reserved.
  4. 4. Internal Asset Movement!Focus: Institutional Risk!   Identify departmental asset movement •  Actual “Rogue Trader” identified using Datameer!  Craft an early-warning system for future detection!  Aggregate sources and correlate!  Net result: reduced risk © 2012 Datameer, Inc. All rights reserved.
  5. 5. SLA Analytics!Focus: Infrastructure and Service Performance!   Companies are using Datameer to aggregate all logs to Hadoop!   Transform log-data into actionable insight into IT systems performance!   Measure conformance to existing SLA’s!   Reduce the batch window!   Net result: reduced costs © 2012 Datameer, Inc. All rights reserved.
  6. 6. Security & Fraud!Focus: Client protection!   Run statistical models against customer profiles!   Detect anomalies with pattern-recognition algorithms!   Identify and investigate identity theft!   Detect and prevent fraud!   Protect customer assets!   Net result: protected customers © 2012 Datameer, Inc. All rights reserved.
  7. 7. Client Risk Profiling!Focus: Bank Assets •  Identify profile-scoring features in loans and mortgages •  Build qualifying models with Datameer •  Test models against existing data •  Provide recurring reportsFocus: Client Assets •  Monitor risk across product offerings for all client assets •  Develop common base of client characteristics for models •  Analyze risk types: default, liquidity, attrition risk •  Monitor: transactions, web, email, chats and call logs (all of the different ways clients interact with the bank)!   Net result: correlation and increases agility © 2012 Datameer, Inc. All rights reserved.
  8. 8. Operational Archiving!Focus: Compliance and cost reduction •  Eliminate expensive taping and re-taping •  Keep records living for analytics ▶  Increase from 6 months of available data •  Improve Disaster Recovery!  Net result: Two orders of magnitude in archival cost reduction and improvement of business’ ability to use that data © 2012 Datameer, Inc. All rights reserved.
  9. 9. Dark Pools and Cost SavingsFocus: Trade and Partner Analysis!   Financial Institutions often hold large positions that they want to trade in ways that dont affect public markets!   Dark pools are private venues that enable trading for this practice!  It’s a Big Data problem •  Large volumes •  High velocity •  Low visibility! © 2012 Datameer, Inc. All rights reserved.
  10. 10. All talk, little action!Financial Information eXchange (FIX) Header   indica&on  of  interest,   ac&on  (quote/buy/sell/fulfill),   “symbol”,   “quan&ty”,   “price”   Footer   © 2012 Datameer, Inc. All rights reserved.
  11. 11. A Second in the life…! © 2012 Datameer, Inc. All rights reserved.
  12. 12. Analyze Order Families! Instrument   buy   sell  Vendor   Time   cancel   Order  Family  Analysis   © 2012 Datameer, Inc. All rights reserved.
  13. 13. Questions and Answers…! Follow Us © 2012 Datameer, Inc. All rights reserved.