MACHINE LEARNING
FOR AML COMPLIANCE
INFORM Risk & Fraud
Tuesday, 5th July 2022
Privacy Notice: This document and its content is the absolute property of INFORM GmbH and/or its subcontractors. The
reproduction, distribution, and utilization of this document and the communication of its contents to others without express
authorization are prohibited. Offenders will be held liable for the payment of damages. All rights are reserved Out the event
of the grant of a patent, utility model, or design.
Ph.D. Kevin Nagel
Data Scientist / Consultant
kevin.nagel@inform-software.com
7/1/2022
Refer to proprietary notice on title page 2
ANTI MONEY LAUNDERING
(AML) // A set of legally
obligated controls to monitor
suspicious activity at financial
institutions:-
• Know Your Customer
• Record Management
• Software Filtering
• New Technology
PLACEMENT LAYERING INTEGRATION
7/1/2022
Refer to proprietary notice on title page 3
MONEY LAUNDERING
€
MATTER OF MILLISECONDS
AUTHORIZATION
RISKSHIELD
7/1/2022
Refer to proprietary notice on title page 4
IP
7/1/2022
Refer to proprietary notice on title page 5
All Accounts
within a bank
Level 1 analyst
flags financial
transactions
via RiskShield TM
Level 2 analyst
reviews flagged
transactions
via RiskShield SAM
Level 3 analyst
& compliance team
files Suspicious
Activity Reports
(SAR)
Flagged
Accounts
Reported
Accounts
7/1/2022
Refer to proprietary notice on title page 6
ANTI MONEY LAUNDERING
Suspicious
Accounts
LOW
Flagged
Accounts
7/1/2022
Refer to proprietary notice on title page 7
Level 1 analyst
flags financial
transactions
via RiskShield TM
ML classifier
predicts response
label
via RiskShield ML
Level 3 analyst
& compliance team
files Suspicious
Activity Reports
(SAR)
All Accounts
within a bank
ANTI MONEY LAUNDERING
Reported
Accounts
MID
HIGH
TRAINING SET
isSAR = False 9,609 instances
isSAR = True 529 instances
TEST SET
isSAR = False 9,638 instances
isSAR = True 501 instances
AMLSim dataset
(www.kaggle.com)
with 20,277 accounts
and 337,738 transactions
7/1/2022
Refer to proprietary notice on title page 8
Account
Transactions
Amount
Incoming Outgoing
7/1/2022
Refer to proprietary notice on title page 9
7/1/2022
Refer to proprietary notice on title page 10
7/1/2022
Refer to proprietary notice on title page 11
A1 A2
A3 A4
TRAINING SET
cond1
cond2
A4
cond2
7/1/2022
Refer to proprietary notice on title page 12
ANOMALY DETECTION
// ISOLATION FOREST
7/1/2022
Refer to proprietary notice on title page 13
Min. class
Maj. class
Train
Test
7/1/2022
Refer to proprietary notice on title page 14
7/1/2022
Refer to proprietary notice on title page 15
YES
NO
ACTUAL
RESPONSE
LABEL
YES
PREDICTED
PROBABILITY
OF RESPONSE
PREDICTED
CLASS
LABEL
NO
NO
YES TRUE POSITVES
TRUE NEGATIVES
FALSE NEGATIVES
FALSE POSITVES
MODEL
PERFORMANCE
TRAINING
DATA
DATA INPUT MODEL OUTPUT
TN
CORRECT
UNSUSPICIOUS
TP
CORRECT
ALERT
FP
FALSE
ALERT
→ BACKLOG
FN
MISSED
ALERT
→ PENALTY
ACTUAL OUTCOME
NO SAR SAR
RESPONSE
PREDICTION
→ ACTION
NO SAR
→ PASS
SAR
→ ALERT
CORRECT ALERT RATE
= TP / (TP+FP)
SAR DETECTION RATE
= TP / (TP+FN)
7/1/2022
Refer to proprietary notice on title page 16
CORRECT ALERT
RATE
Abbreviations:
U = Unsuspicious
P = Penalty
S = Suspicious
B = Backlog
SAR DETECTION RATE
U
S
B
P
U
S
P
U
S
B
U
S
7/1/2022
Refer to proprietary notice on title page 17
7/1/2022
Refer to proprietary notice on title page 18
Pre-
dicted
Proba-
bility
SAR
Pre-
dicted
Proba-
bility
NO
SAR
153
549
9,437
ML Response Prediction Response = “LOW”
Response = “MID”
Response = “HIGH”
Operating Threshold: 76%
Operating Threshold: 96%
10,139
Accounts in
TEST SET
Level 2.1 Analyst
confirms FP
Level 2.3 Analyst
approves SAR
Level 2.2 Analyst
checks alert
7/1/2022
Refer to proprietary notice on title page 19
7/1/2022
Refer to proprietary notice on title page 20
MACHINE LEARNING FOR
AML COMPLIANCE // A set
of AI tools to detect risks and
criminal connections at
financial institutions:-
• Graph Analytics
• AML Alerts Triage
• Hybrid AI
ANTI MONEY LAUNDERING
(AML) // A set of legally
obligated controls to monitor
suspicious activity at financial
institutions:-
• Know Your Customer
• Record Management
• Software Filtering
• New Technology

DutchMLSchool 2022 - ML for AML Compliance

  • 1.
    MACHINE LEARNING FOR AMLCOMPLIANCE INFORM Risk & Fraud Tuesday, 5th July 2022 Privacy Notice: This document and its content is the absolute property of INFORM GmbH and/or its subcontractors. The reproduction, distribution, and utilization of this document and the communication of its contents to others without express authorization are prohibited. Offenders will be held liable for the payment of damages. All rights are reserved Out the event of the grant of a patent, utility model, or design. Ph.D. Kevin Nagel Data Scientist / Consultant kevin.nagel@inform-software.com
  • 2.
    7/1/2022 Refer to proprietarynotice on title page 2 ANTI MONEY LAUNDERING (AML) // A set of legally obligated controls to monitor suspicious activity at financial institutions:- • Know Your Customer • Record Management • Software Filtering • New Technology
  • 3.
    PLACEMENT LAYERING INTEGRATION 7/1/2022 Referto proprietary notice on title page 3 MONEY LAUNDERING
  • 4.
  • 5.
    7/1/2022 Refer to proprietarynotice on title page 5
  • 6.
    All Accounts within abank Level 1 analyst flags financial transactions via RiskShield TM Level 2 analyst reviews flagged transactions via RiskShield SAM Level 3 analyst & compliance team files Suspicious Activity Reports (SAR) Flagged Accounts Reported Accounts 7/1/2022 Refer to proprietary notice on title page 6 ANTI MONEY LAUNDERING Suspicious Accounts
  • 7.
    LOW Flagged Accounts 7/1/2022 Refer to proprietarynotice on title page 7 Level 1 analyst flags financial transactions via RiskShield TM ML classifier predicts response label via RiskShield ML Level 3 analyst & compliance team files Suspicious Activity Reports (SAR) All Accounts within a bank ANTI MONEY LAUNDERING Reported Accounts MID HIGH
  • 8.
    TRAINING SET isSAR =False 9,609 instances isSAR = True 529 instances TEST SET isSAR = False 9,638 instances isSAR = True 501 instances AMLSim dataset (www.kaggle.com) with 20,277 accounts and 337,738 transactions 7/1/2022 Refer to proprietary notice on title page 8
  • 9.
  • 10.
    7/1/2022 Refer to proprietarynotice on title page 10
  • 11.
    7/1/2022 Refer to proprietarynotice on title page 11
  • 12.
    A1 A2 A3 A4 TRAININGSET cond1 cond2 A4 cond2 7/1/2022 Refer to proprietary notice on title page 12 ANOMALY DETECTION // ISOLATION FOREST
  • 13.
    7/1/2022 Refer to proprietarynotice on title page 13
  • 14.
    Min. class Maj. class Train Test 7/1/2022 Referto proprietary notice on title page 14
  • 15.
    7/1/2022 Refer to proprietarynotice on title page 15 YES NO ACTUAL RESPONSE LABEL YES PREDICTED PROBABILITY OF RESPONSE PREDICTED CLASS LABEL NO NO YES TRUE POSITVES TRUE NEGATIVES FALSE NEGATIVES FALSE POSITVES MODEL PERFORMANCE TRAINING DATA DATA INPUT MODEL OUTPUT
  • 16.
    TN CORRECT UNSUSPICIOUS TP CORRECT ALERT FP FALSE ALERT → BACKLOG FN MISSED ALERT → PENALTY ACTUALOUTCOME NO SAR SAR RESPONSE PREDICTION → ACTION NO SAR → PASS SAR → ALERT CORRECT ALERT RATE = TP / (TP+FP) SAR DETECTION RATE = TP / (TP+FN) 7/1/2022 Refer to proprietary notice on title page 16
  • 17.
    CORRECT ALERT RATE Abbreviations: U =Unsuspicious P = Penalty S = Suspicious B = Backlog SAR DETECTION RATE U S B P U S P U S B U S 7/1/2022 Refer to proprietary notice on title page 17
  • 18.
    7/1/2022 Refer to proprietarynotice on title page 18
  • 19.
    Pre- dicted Proba- bility SAR Pre- dicted Proba- bility NO SAR 153 549 9,437 ML Response PredictionResponse = “LOW” Response = “MID” Response = “HIGH” Operating Threshold: 76% Operating Threshold: 96% 10,139 Accounts in TEST SET Level 2.1 Analyst confirms FP Level 2.3 Analyst approves SAR Level 2.2 Analyst checks alert 7/1/2022 Refer to proprietary notice on title page 19
  • 20.
    7/1/2022 Refer to proprietarynotice on title page 20 MACHINE LEARNING FOR AML COMPLIANCE // A set of AI tools to detect risks and criminal connections at financial institutions:- • Graph Analytics • AML Alerts Triage • Hybrid AI ANTI MONEY LAUNDERING (AML) // A set of legally obligated controls to monitor suspicious activity at financial institutions:- • Know Your Customer • Record Management • Software Filtering • New Technology