"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
Huawei Helps CMB Construct a Big Data Platform for Financial IT Transformation
1. HUAWEI TECHNOLOGIES CO., LTD.
Huawei Helps CMB Construct a Big Data Platform for
Financial IT Transformation
Zhang Dazhen
IT Cloud Computing Product Line
2. HUAWEI TECHNOLOGIES CO., LTD. Page 2HUAWEI Confidential
Construct a Big Data Platform for Internet Finance
Transformation
Fierce competition calls for product prediction, service
innovation, and risk evaluation based on data analysis and
mining to improve competitiveness.
Traditional data warehouses can process only structured data
and have drawbacks of low scalability and high expansion
costs and cannot process large data sets of various types.
Challenges
Solution
Enterprise-level big data platform: high reliability, high
security, easy to develop and manage
First big data analysis and mining platform that supports
classified protection for financial data and over 1000 km
remote disaster recovery, and allows seamless integration
with enterprise applications.
Huawei has a kernel-level development project team that
provides consulting and customized service capabilities.
China Merchants Bank (CMB for short) has 125 branches, 1297 sub-branches,
1 specialized agencies (the Credit Card Center), 1 rep-office, and 2330 self-
service banks in over 120 cities. It has become a banking group that has a
financial services license and offers services, such as commercial banking,
finance leasing, fund management, life insurance, and investment outside
China. By the end of 2014, the group had a net profit of RMB55.911 billion,
with 8.06% year-on-year growth. CMB has led China's banking industry by
creating a synergy of "Profit, Quality, Scale" and a structure of core values
including "Service, Innovation and Stability".
Offline historical
details
Credit investigation
(3 to 5 weeks)
Financial data
Traditional data plane
Financial data, transaction context,
customer service text data, social data.
Huawei FusionInsight big data plane
Credit investigation
(2 to 5 seconds)
Online historical
details
Contingent
asset
Financial
network
Service innovation
Precision
recommendation
3. HUAWEI TECHNOLOGIES CO., LTD. Page 3HUAWEI Confidential
Online Query of Historical Transaction Details
x86 server x86 server x86 server x86 server
HDFS
ZooKeeper HBase/CTBase
Hadoop
Farmer data service
Service request access and dispatch
Distributed application container
Historical
transaction details
query service logic
…
Telephone banking
95555
Service system
in branches
Manager
(big data
management
center)
FusionInsight
Historical
transaction details
query service logic
Historical
transaction details
query service logic
Customer's pain points:
With Oracle, midrange computer, and high-end storage
architecture, I/O bottlenecks occur and the system supports
only online query of 4 TB historical transaction details of last
one year. For the historical transaction details of more than
one year, manual offline query on a data warehouse is
required, which consumes time.
Objective: real-time online query of 20 TB historical
transaction details of five years
Solution:
Huawei provides: FusionInsight Farmer data service
platform and FusionInsight Hadoop basic data platform.
CMB only needs to focus on compiling the service for
querying the historical records.
The FusionInsight Farmer data service platform supports
concurrent access to multiple service systems, allowing
real-time historical transaction details query.
4. HUAWEI TECHNOLOGIES CO., LTD. Page 4HUAWEI Confidential
Comprehensive Multi-dimensional Customer Behavior
Analysis
x86 server x86 server x86 server x86 server
HDFS
ZooKeeper HBase/CTBase
Miner data insight
Feature
management
Individual customer analysis
MR YARN
Hive
Mahout
algorithm library
Modeling
analysis
Data visibility
Enterprise customer analysis
…
Manager
(big data
management
center)
Hadoop
FusionInsight
Customer
feature
extraction
Small and
micro-loan
tendency
analysis
Financial
relationship
discovery
Contingent
asset
prediction
Enterprise
feature
extraction
Enterprise
public
opinion
analysis
Enterprise
settlement
relationship
Customer's pain points:
A traditional data warehouse has limited processing capability
so that Extract-Transform-Load (ETL) covers a small number of
data dimensions. In addition, existing tools that have expert
experience mechanisms are based on few-dimension analysis
so that the small and micro-loan tendency analysis and
contingent asset prediction have low accuracy.
Objective: full and multidimensional analysis, improved
mechanism, and improved analysis and prediction accuracy
Solution:
Huawei provides: FusionInsight Miner data insight platform
and FusionInsight Hadoop basic data platform. CMB only
needs to focus on compiling customer behavior analysis
services.
The FusionInsight Miner data insight platform can mine
customer features in 14000 dimensions based on big data full
modeling analysis, supporting multi-dimensional concurrent
customer behavior analysis.
Customer behavior analysis results are stored in HBase for
query.
5. HUAWEI TECHNOLOGIES CO., LTD. Page 5HUAWEI Confidential
small and micro-loan Tendency Analysis and Contingent
Asset Prediction
9 million customers
…
14000 dimensions of customer features
small and micro-loan tendency
analysis model
Carry out targeted marketing for
the top 20000 potential small
and micro-loan customers
Contingent financial asset
prediction model
Customer potential contingent
financial asset details
6. HUAWEI TECHNOLOGIES CO., LTD. Page 6HUAWEI Confidential
Real-time Credit Investigation Service Process
Computer/
Tablet
Logic to be
passed
Archiving Frond-end processor
Document
comparison
module
Preprocessing
module
Preprocessing
PBC
module
Public
security
bureau
module
External credit
UnionPay
module
Telecom
module
…
PBC database
Public security
bureau database
…
Sanctions list
module
Retail banking
module
Internal credit
Personnel risk
module
Abnormal
information
tracing module
Risk comparison
Market
promotion
problem risk
module
A-SCORE F-SCORE
Credit card score
Approval
information
prompt module
Recommended
quota module
Credit investigation process
Automatic
processing
module
Manual
approval
module
7. HUAWEI TECHNOLOGIES CO., LTD. Page 7HUAWEI Confidential
Real-time Credit Investigation Big Data Solution
x86 server x86 server x86 server x86 server
Credit card opening and
overdraft consumption
approval Frond-end processor
Customer's pain points:
As credit investigation data is stored in different
databases/warehouses, credit investigation data for credit card
opening and overdraft services is queried separately at different
times. In addition, more manual investigation is involved. As a
result, it takes about 15 days to handle these services, causing
low customer satisfaction.
Objective: two to five seconds for automatic credit
investigation and 20 minutes for service process completion
Solution:
Huawei provides: FusionInsight Farmer data service platform
and FusionInsight Hadoop basic data platform. CMB only
needs to focus on compiling the service for real-time credit
investigation.
FusionInsight Farmer data service platform provides
concurrent processing capabilities required by a credit
investigation process service system.
FusionInsight Farmer data service platform provides a real-
time workflow engine that can automatically perform each
service process based on a preset sequence.
HDFS
ZooKeeper HBase/CTBase
Hadoop
Farmer data service
Service access request and service provisioning
Manager
(big data
management
center)
FusionInsight
Distributed application container
Document
comparison
External
credit
Internal
credit
Risk
comparison
Credit
card
score
Recommended
quota
Workflow
engine
8. HUAWEI TECHNOLOGIES CO., LTD. Page 8HUAWEI Confidential
Real-time credit investigation
Customer Benefits
Historical transaction details query
• 20 TB historical transaction details of 5 years
are centrally stored, facilitating management
and expansion.
• Historical transaction details of 5 years can be
concurrently queried in multiple service systems
in real time, improving user experience.
Customer behavior analysis
Full and multi-dimensional analysis mode instead of a
traditional expert experience analysis mode:
• Two to five seconds for automatic credit
investigation and 20 minutes for completing credit
card opening and overdraft consumption approval,
improving customer satisfaction
• Real-time workflow engine simplifies real-time
automatic credit investigation service deployment.
Conversion volume
Top 864 Top 8653 Top 58107
13
329
74
469
662
200
Full and multi-
dimensional mode
Expert
experience mode
• Small and micro-loan propensity analysis: The conversion rate of top 10000 customers
increased by six times.
• Contingent asset prediction: The error rate of contingent financial asset prediction
decreased from 60% to 30%.
Error rate
60%
30%
Small and micro-loan
propensity analysis
Contingent asset prediction