Kenneth Nielsen explains how LLMs & Graph fit together like hand in glove – not only for next level RAG, but also for laying the foundation for doing cross-org analytics not possible today, like KYC
Human Factors of XR: Using Human Factors to Design XR Systems
EY: Graphs as Critical Enablers for LLM-based Assistants- the Case of Customer Onboarding
1. Graphs as Critical Enablers for LLM-
based Assistants
- the Case of Customer Onboarding
Graph Summit
March 7, 2024
Kenneth HM Nielsen
Director, Head of AI & Data, EY Financial Services
2. Page 2
1. What is a
Knowledge
Graph
2. KYC…
what?
3. LLM-
empowering
KYC
Officers
4. Put some
perspective
on that!
Today’s agenda
3. Page 3
What is a Knowledge Graph?
Product
Regulation
Advisor
Governance
Board
Business unit
Customer
4. Page 4
KnowYour Customer (KYC) Process –The Manual Way (1/2)
Hi,
My name is Rick Sanchez, I am currently setting up a
company called Huonoja Aikomuksia and would like to
become a customer. The business purpose is to sell guns and
ammo, mainly for crypto.
I need a couple of accounts, with a smaller credit to get things
started. We will have some foreign transactions …
• Name: Rick Sanchez
• Business type: Limited Liability Company
• Purpose of the company: Sell guns and ammo for crypto
• Location: Copenhagen
• Number of employees: 2
• Gross profit (expected): app. 2 mDKK (2024)
• Foreign transactions: Yes
• Amount: …
8. Page 8
Using LLMs and business subject matter experts for constructing knowledge graphs enables next
level RAG and graph-derived insights
9. Page 9
Using LLMs and business subject matter experts for constructing knowledge graphs enables next
level RAG and graph-derived insights
10. Page 10
Using LLMs and business subject matter experts for constructing knowledge graphs enables next
level RAG and graph-derived insights
Renowned Scientist Entangled in Labor Abuse Scandal
Date: 17/08/2023
Reports surfaced late Sunday night that esteemed scientist Professor Farnsworth's venture, ABC Holding LP, is
implicated in forced labor ties, promptly sending shockwaves across the scientific and corporate communities.
Maneuvering swiftly in response to these allegations, a number of business partners have severed ties with ABC
Holding LP, leading to a rapid decline in its stock prices. The company's once stellar reputation is taking a hit, as
grim reports shed light on troubling links to overseas factories known for severe labor rights abuses.
Details of grueling work conditions, subpar compensation, and systematic exploitation present a harsh dichotomy
to the organized, progressive face of corporate operations widely promulgated today. This revelation places the
unassuming Professor Farnsworth under stringent scrutiny, marking a severe departure from his previously
celebrated figure in scientific and entrepreneurial circles.
While compelled partners are cutting connections with ABC Holding LP as the controversy unfolds, industry
groups and labor rights organizations have sounded a clarion call for corporate transparency in labor sourcing.
This scandal has further underscored the urgent need to intensify regulatory oversight in this area.
The old adage - the higher they climb, the harder they fall - seems to have been leveraged against Farnsworth's
enterprise. ABC Holding LP and Professor Farnsworth himself are currently positioned precariously on the
fulcrum of this unfolding scenario.
It remains yet to be seen how the company navigates through this storm, and more importantly, how it can restore
public confidence in the face of such pressing concerns threatening its very corporate fiber.
As we trail the ongoing saga, it is clear that pivotal decisions and revelations await that could shape not just the
future of ABC Holding LP, but also the broader arena of ethical business conduct.
11. Page 12
Themes where LLMs and Graphs form a Strong Symbioses forTaking your VAs to the Next
Level
“How will this new regulation impact us?”
“I wonder how this component fits with … “
“Who and how are our customers?”
Intro – AI&Data
LLMs+ Graph fit together like hand in glove – not only for next level RAG, but also for laying the foundation for doing cross-org analytics not possible today
Cannot take honor for calling graphs critical enablers, that goes to Gartner
A knowledge graph represents a network of real-world entities—such as objects, events, situations or concepts—and illustrates the relationship between them
A new corporate customer is being onboarded in the Bank.
No red flags are found in the onboarding process.
The owner is easy going and replies to any requests.
Nothing is found by the Bank’s usual systems: credit score, screening (AMS, PEP, Sanctions).
Is RICK a politically exposed person (PEP) or closely related to one?
Is Rick on a sanctions list, i.e. are we prohibited from having him as a customer off the bat?
…
External sources: is Rick associated to other companies? Does he owe the state a lot of money? Is he registered as a bad payer? Social media…
Time-consuming process with room for manual errors!
Three part-solution
GDPR scanner – developed over several years with DPOs, CCOs, etc…
LLMs made the solution even better
You can not only search across but actually do graph analytics on your structured and unstructured data
CVR2Graph module – start from anchor point (person, CVR number, etc…) and generate graph
Finally, the prompting front end ties it all together and makes all this information available to the KYC officer through the prompt
By having a knowledge graph available, the RAG is able to provide answers across complex patterns
C8H10N4O2 – something you all enjoy everyday
Information => make decision
Everything will be logged using a graph to ensure audit trail and identification of key data sources
Of course you can ask, why even do all this prompting, and you are right! …