SlideShare a Scribd company logo
1 of 30
Download to read offline
Geneva chapter
IntelligentDocumentProcessing
January 18th 2024
UiPath Community
The UiPath w ord mark, logos, and robots are registered trademarks ow ned by UiPath, Inc. and its affiliates. ©2023 UiPath. All rights reserved.
2
Agenda slide
01
02
03
Introduction
Intelligent Document Processing
Poll – Who is our Community?
3
Audrey Briffod
Our new chapter co-leader
Consultante UiPath depuis 2018
Certifiée UiPath
Innovation and Solution Manager RPA
chez Collaboration Betters The World
4
UiPath is a 3x Leader in IDP
By Everest Group, IDC, ISG, Gartner, and more
Capabilities
Strategies
Product
Portfolio/Capabilities
Competitive Strength
Everest Group Intelligent Document Processing (IDP) Products
PEAK Matrix ® Assessment 2023
IDC MarketScape: Worldwide Intelligent Document
Processing (IDP) 2023-2024 Vendor Assessment
ISG Provider Lens Intelligent Automation - Platforms
and Products - Intelligent Document Processing
“UiPath offers a holistic intelligent automation platform that
combines IDP, RPA, process mining, task mining, process
orchestration, and AI- / ML-based capabilities, including
communications mining for NLP and unstructured data
processing.”
“Customers and partners give UiPath high
marks for its ability to support and deliver
accurate IDP outputs across a range of
document types and use cases.”
“UiPath combines RPA, OCR, Machine Learning,
and Natural Language Processing to deliver
industry-leading capabilities for automated
document processing.”
5
IDP combines Document Understanding and Communications Mining capabilities to help customers automate document
processing from end to end. It delivers state-of-the-art Specialized AI and Generative AI (Gen AI) for all scenarios - documents
and communications, structured, semi-structured and unstructured.
IntelligentDocumentProcessing (IDP)
Introduction
Extracts relevant data from documents.
70+ pre-built models to analyze and
process different types of documents
across industries and domains.
Requests or emails with
attached documents:
• Multiple languages
• Various formats
• Handwriting
• Signatures
• Skewed & low-quality scans
• Checkboxes
• Tables
Human in the loop
Asking employees to validate the
results if required or in case of
inaccuracies and exceptions.
UiPath Automation
Route the extracted actions and data
to downstream systems for further
processing.
Extracts key intent, sentiment and
context data from messages. The latest
advances in AI and machine learning
(ML).
6
Gen AI-powered annotation
for faster model training
Seamless document
classification with Gen AI
Now, Document Understanding and Communications Mining
have enhanced their IDP capabilities with Gen AI integrations
Gen AI for unstructured data
extraction and question
answering
Communications
Mining
The UiPath w ord mark, logos, and robots are registered
trademarks ow ned by UiPath, Inc. and its affiliates.
©2023 UiPath. All rights reserved.
8
Emails, tickets, notes,
surveys, cases, etc.
Structured data to drive and trigger
process automations
API
ERP
RPA
CMS
CRM
Understand and action every message at speed and scale
1 3 Drive
Connect
CRM Notes
Email
Tickets
Service Desk
AI and NLP automate the interpretation
of every message in real time
2 Interpret
Connect
Train
Discover
Automate
9
Interpret the message... Extract key insights
Policy > Amendment> Address Change
Policy number Street City Zip code
XE-182943 20 W 34TH St New York 10001
XF-929381 96 Park Road Sheffield S5 8PL
Policy > Amendment> Name Change
Policy number First name Last Name
XE-182943 John Roberts
Communications Mining example: Insurance
Subject:Policyamendment
Created: June 29,8:33pm
From: Ed Crossey
To: support@
Hi Steve,
Our client wishes to change their name to John Roberts,
he's also moved to a new home, the new address is
20 W 34THSt , New York , 10001.
Can you please amend and issue updated docs?It's
policy XE-182943by the way.
And on XF-929381they've also moved,please can you
update it to 96 Park Road, Sheffield,S5 8PL.
Cheers,
Ed
10
Interpret the message... Extract key insights
Confirmation > CTM
Escalation
Follow up
Exception > Mismatch > Block
Subject:Trade processing,unmatched trades
Created: September19th, 8:22am
From: Lucy
To: tradeprocessing@investment-bank.com
Hello
This is the third time I have followed up on this issue.
These trades have been unmatched for 10 days because you’re
mismatched in CTM.
Can you provide a status update. This needs to be resolved ASAP.
Regards
Lucy
Status Update
Communications Mining example: Quality of Service
Urgent
-9.4
QoS
-6.8
Tone
11
| Communications Mining + RPA
Communications
Mining Stream
Queue Feeder
UiPath Orchestrator
Queue 2
Human-in-the-loop
Queue
Automation Process 1
Automation Process 2
Structured label & entity
predictions per message
with confidence scores
NLP Exceptions
Queue 1
Queue 3
Queue n
…
Automation Process 2
Automation Process n
Automation Process
logic for HITL
Communications
Feedback loop to iteratively
improve model & maximise future
high-confidence predictions
Human-in-the-loop for instances with multiple
above-threshold predictions,and NLP
exceptions withoutconfidentpredictions
12
Communicationsmonitoring
Real-time view of all service
communicationchannels. Measure,
monitor and improve.
How customers use Communications Mining
Communications Mining increases scalability, enhances the customer experience, and improves
governance and control. Communications Mining creates both analytics and automation opportunities.
Quality of service
Real-time, proactive flagging
of performanceissues and
identification of recovery opportunities.
Communicationsmining
Mine historic communications to
identify and quantify transformation
opportunities.
Voice of the customer
Understand and continuously improve
quality of service and the customer
experience.
Auto-triage
Automate the classification,
prioritization and routing of incoming
communications.
Case automation
Automate case creation in service desk
tools.
Query automation
E2E automate frequently
occurring transactional requests.
Monitor Automate
Mine
13
Every companyacross every industryprocesses
large volumesof unstructured communicationsdata
Enterprise
Healthcare
Banking& FinancialServices
Public Sector
Insurance
Manufacturing
B2B and B2C emails, tickets and messages
Sales and order management processes
Notes in core systems – e.g. CRM, ERP etc.
Customer service and support
KYC – Know Your Customer
Trade settlement & amendment processes
Front, middle & back office mailboxes
Client/ customer onboarding & support
KYC – Know Your Customer
Underwriting processes
Claims handling & processing
Patient registration & processing
Consent and assent processes
Health insurance claims
Immigration application & processing
Benefit application & processing
Citizen services, questions & feedback
Sales & order management processes
Shipping information
Customer & vendor communications
Customer queries & communications
Telecommunications eCommerce Energy& utilities
Customer complaints, service and support
Agent problem & resolution case notes
Customer queries (shipping, returns etc.)
Product feedback
Maintenance, outage and resolution notes
Customer complaints, service and support
Document
Understanding
The UiPath w ord mark, logos, and robots are registered
trademarks ow ned by UiPath, Inc. and its affiliates.
©2023 UiPath. All rights reserved.
15
Get your documents
processed intelligently
Teach your robots to understand documents
using AI-enhanced skills fordata extraction
and interpretation.
Drag and drop these capabilities directly into
your automation workflows to embed AI
16
Built for: RPA and citizen developers – no data science skills required
Built-in AI: Specialized AI models and Generative AI
Built as: SaaS, APIs, self-hosted or air-gapped integrated with UiPath Business Automation Platform
1 Receive
3 Act
2 Understand
Documents
• Multiple languages
• Various types & formats
• Handwriting & signatures
• Tables & checkboxes
• Skewed & low-quality scans
AI-powered processing Human in the loop UiPath Automation
• Initiate other automations
• Input into system of record
• Drive other actions
Validate the
extracted information
and handle exceptions
Digitize Classify Extract
17
Next-generation Document Understanding
with active learning
What?
Active learning is a next-gen AI-
powered experience within UiPath
Document Understanding
Why?
• Anyone can train AI models—no coding
or ML skills required
• 80% faster model training—from a
week, down to just a day
• Guidance on model optimization—
humans & AI collaborating together
• Instant model evaluation—built-in model
performance analytics
Where and when?
Private Preview via
Automation Cloud in 2023.10
18
Bringing a new unified experience to
training, deploying and monitoring your model
Previously across Document Understanding, Document Manager, AI Center
Build
Load samples,annotate, and
train your modelwith a guided
experience
Measure
Understand your model
performance
and how to improve it
Run
Deployand manage
your projects
with ease
Monitor
Monitor and audit
the performanceof
your automation
Note: Preview limitations: Currently we can classifyand annotate 40 common documenttypes,limited to out-of-the-box Specialized AI models,full listat https://docs.uipath.com/document-understanding/automation-
cloud/latest/user-guide/out-of-the-box-pre-trained-ml-packages;will be addressed and on roadmap for FA in 24.4
19
Next-gen Document Understanding
Experience with Active Learning:
Build
Build
Load samples,annotate,and train your
model with a guided experience
▪ Upload and manage your documents
▪ Classify documents automatically
▪ Use Generative AI to automatically annotate
fields that users validate
▪ Follow recommendations that guide you
on how to improve your model efficiently
▪ Model training occurs in the background
to see impact of user actions
Note: Preview limitations: Currently we can classifyand annotate 40 common documenttypes,limited to out-of-the-box Specialized AI models,full listat https://docs.uipath.com/document-understanding/automation-
cloud/latest/user-guide/out-of-the-box-pre-trained-ml-packages;will be addressed and on roadmap for FA in 24.4
20
Next-gen Document Understanding
Experience with Active Learning:
Measure
Measure
Understandyourmodelperformance
and how to improveit
▪ Evaluate your project readiness with model
metrics
▪ Model metrics indicate which parts of the
project need the most attention
▪ Identified and takes user to the part of the
project with recommended actions to
improve model performance
▪ See distribution of dataset
21
Next-gen Document Understanding
Experience with Active Learning:
Run
Run
Deployand manage yourprojects
with ease
▪ Evaluate your project readiness with model
Choose and deploy model in just a couple
of clicks
▪ Easily version your entire project
▪ Start working in studio, studio web, or via API
22
Next-gen Document Understanding
Experience with Active Learning:
Monitor
Monitor
Monitorand auditthe performance
of yourautomation
▪ Dashboard integrated to show business
outcomes of the automation
▪ Easily drill down into status of documents
being processed
▪ Visibility into human in the loop events –see
what the validator corrected for full
transparency
▪ Search through history of documents
processed
23
What is active learning?
Active learning is an approach unique to
UiPath and enables:
▪ Reduction of data samples
▪ A guided experience (no ML experience
required)
▪ Up to 80%+ faster model training
▪ Even more visibility into model
performance, with “Measure” phase
Active learning employs an iterative process between annotators and model to reduce
the amount of data required to train a ML model
Active Learning
Evaluate
Performance
Retrain and
Redeploy
ML Model
Human
Annotation
Identifies which data points will be most
informative to improving model performance
Without active learning, training is more of a “black box”
experience – you spend time labelling fields without knowing
it’s impact and need to deploy the model to see the results
24
Generative AI capabilities in Document Understanding
What?
Generative Annotation, Generative
Classification, Generative Extraction
Why?
Generative Annotation (Pre-labeling):
Annotate any document samples with Gen AI,
speeding training from a week to 1-2 days for
complex scenarios, or minutes for simpler forms
Generative Classification: Classifying
documents is fast and easy with Gen AI—
just define the document types; no need to write
rules or train new ML models
Generative Extraction: No need to train
custom ML models to answer questions and
summarize content in free-form unstructured
documents—use Gen AI instead
Where and when?
GA in Automation Cloud and activities
in 2023.10
25
Logic in the process to automatically determine if field(s) extracted correctly
Art of the possible with business rules
Character
validation
Basic math
Date validation
External source
verification
Invoice # = 7 digits
Total = Line Items + Tax
Valid date format
Verify against PO Record
PO
Number
Vendor ID Vendor
Name
5928452 12345 PROTECH
3758292 98734 LORANA
26
Model performance over time
ML modelage (time)
Initial (re)training
Post-processing + business rules
Finetune with
validated data
Out-of-the-box&
Pre-trained model
- Optimize based on required fields
- (Re)train ML model with your documents
- Business rules confirm/correct before SME
- Verified corrections finetune ML Model
Validation
Logic / matching
FTE verification
Extract
data
Straight through
processing rate - STP
! Important !
• Each improvementis specific
to yourenvironment
• Involve the documentSME /
business owner
• Experienced deployment
partner is huge value
27
Input as the message... Input as the attachment…
Output as key data
and insights
Validate againstCRM
Vendor match: PROTECH
Invoice match: 5727346
Notify for Approval
Human verifies total: $760
Requests
Policy No: 1863325
Address Line:20 W 34th
St. NY
Zip code: 10001
Admin Change> AddressChange
Policy > Renewal
Subject:Address change policy No. 1863325
Created: June 29,8:33pm
From: Ed Crossey
To: AaronChallis
Could you please update the address on the
above policy to 20 W 34th St., New York, NY
10001,USA.
My policy is due to renew next week, and I need
the address updated beforesigning the PO.
Feelthis is unnecessarily hard.
Automate emails and attachments
28
UiPath capabilities
Process example:Invoiceautomation
Inv oice Model
LLM Model
Robot Human
Receive email from
vendors to specific
inbox (Coupa)
TASK
COMPLETED
Review attachments
(invoices) in PDF
format
Validate if the
invoice number is in
the Coupa system
No:
Missing or invalid PO
Human support and
troubleshooting
Non-PO
Invoice Create
Yes:
Valid PO found
PO Flip
Either PO flip to invoice or
new invoice created and
saved in Coupa system
Exampleprocess
Key:
• Real time connectand analysis of emails
• Recognize specificintent, entities and emotion
• Pre-trained invoice model
• Extract all invoice details
• Validates invoice number against source system(s).
• Human in the loop validation.
• UiPath Automation Cloud PO Flip or invoice creation.
• Recordsupdated to reflectprocess updates.
Update email to vendor
written
• UiPath OpenAI Connectorprompts GPT to draft email update
response forvendor.
• UiPath Action Center for human in the loop validation of drafted email
• Automation cloud updates systems of record.
Poll
Who is our Community?
The UiPath w ord mark, logos, and robots are registered
trademarks ow ned by UiPath, Inc. and its affiliates.
©2023 UiPath. All rights reserved.
Thank you

More Related Content

Similar to Communauté UiPath Suisse romande - Séance de janvier 2024

Introduction to RPA and Document Understanding
Introduction to RPA and Document UnderstandingIntroduction to RPA and Document Understanding
Introduction to RPA and Document UnderstandingDiana Gray, MBA
 
Artificial intelligence capabilities overview yashowardhan sowale cwin18-india
Artificial intelligence capabilities overview yashowardhan sowale cwin18-indiaArtificial intelligence capabilities overview yashowardhan sowale cwin18-india
Artificial intelligence capabilities overview yashowardhan sowale cwin18-indiaCapgemini
 
Stermedia - AI and software solutions for manufacturing/industry 4.0
Stermedia - AI and software solutions for manufacturing/industry 4.0Stermedia - AI and software solutions for manufacturing/industry 4.0
Stermedia - AI and software solutions for manufacturing/industry 4.0stermedia
 
Kofax Glantus Spotlight Event
Kofax Glantus Spotlight EventKofax Glantus Spotlight Event
Kofax Glantus Spotlight EventJoe Keating
 
Flink Forward Berlin 2017: Bas Geerdink, Martijn Visser - Fast Data at ING - ...
Flink Forward Berlin 2017: Bas Geerdink, Martijn Visser - Fast Data at ING - ...Flink Forward Berlin 2017: Bas Geerdink, Martijn Visser - Fast Data at ING - ...
Flink Forward Berlin 2017: Bas Geerdink, Martijn Visser - Fast Data at ING - ...Flink Forward
 
Dell AI Telecom Webinar
Dell AI Telecom WebinarDell AI Telecom Webinar
Dell AI Telecom WebinarBill Wong
 
Your AI Transformation
Your AI Transformation Your AI Transformation
Your AI Transformation Sri Ambati
 
Reading the IBM AI Strategy for Business
Reading the IBM AI Strategy for BusinessReading the IBM AI Strategy for Business
Reading the IBM AI Strategy for BusinessPietro Leo
 
Session 2023-11.pptx
Session 2023-11.pptxSession 2023-11.pptx
Session 2023-11.pptxAndreeaTom
 
Three Dimensions of Data as a Service
Three Dimensions of Data as a ServiceThree Dimensions of Data as a Service
Three Dimensions of Data as a ServiceDenodo
 
How to analyze text data for AI and ML with Named Entity Recognition
How to analyze text data for AI and ML with Named Entity RecognitionHow to analyze text data for AI and ML with Named Entity Recognition
How to analyze text data for AI and ML with Named Entity RecognitionSkyl.ai
 
AI for Customer Service - How to Improve Contact Center Efficiency with Machi...
AI for Customer Service - How to Improve Contact Center Efficiency with Machi...AI for Customer Service - How to Improve Contact Center Efficiency with Machi...
AI for Customer Service - How to Improve Contact Center Efficiency with Machi...Skyl.ai
 
Ai digital (without videos)
Ai digital (without videos)Ai digital (without videos)
Ai digital (without videos)AnandSRao1962
 
Advanced AI Applications In Enterprises
Advanced AI Applications In EnterprisesAdvanced AI Applications In Enterprises
Advanced AI Applications In EnterprisesAnandSRao1962
 
AI Microservices APIs and Business Automation as a Service Denis Gagne
AI Microservices APIs and Business Automation as a Service    Denis GagneAI Microservices APIs and Business Automation as a Service    Denis Gagne
AI Microservices APIs and Business Automation as a Service Denis GagneDenis Gagné
 
2018-10-25 Group RPA - AA Deck.pptx
2018-10-25 Group RPA - AA Deck.pptx2018-10-25 Group RPA - AA Deck.pptx
2018-10-25 Group RPA - AA Deck.pptxsaubhagya ranjan
 
[MindsLab] company intro 201711
[MindsLab] company intro 201711[MindsLab] company intro 201711
[MindsLab] company intro 201711Taejoon Yoo
 
AI Overview and Capabilities
AI Overview and CapabilitiesAI Overview and Capabilities
AI Overview and CapabilitiesAnandSRao1962
 
MLSEV. Use Case: Robotic Process Automation and Machine Learning
MLSEV. Use Case: Robotic Process Automation and Machine LearningMLSEV. Use Case: Robotic Process Automation and Machine Learning
MLSEV. Use Case: Robotic Process Automation and Machine LearningBigML, Inc
 

Similar to Communauté UiPath Suisse romande - Séance de janvier 2024 (20)

Introduction to RPA and Document Understanding
Introduction to RPA and Document UnderstandingIntroduction to RPA and Document Understanding
Introduction to RPA and Document Understanding
 
Artificial intelligence capabilities overview yashowardhan sowale cwin18-india
Artificial intelligence capabilities overview yashowardhan sowale cwin18-indiaArtificial intelligence capabilities overview yashowardhan sowale cwin18-india
Artificial intelligence capabilities overview yashowardhan sowale cwin18-india
 
Stermedia - AI and software solutions for manufacturing/industry 4.0
Stermedia - AI and software solutions for manufacturing/industry 4.0Stermedia - AI and software solutions for manufacturing/industry 4.0
Stermedia - AI and software solutions for manufacturing/industry 4.0
 
Kofax Glantus Spotlight Event
Kofax Glantus Spotlight EventKofax Glantus Spotlight Event
Kofax Glantus Spotlight Event
 
Flink Forward Berlin 2017: Bas Geerdink, Martijn Visser - Fast Data at ING - ...
Flink Forward Berlin 2017: Bas Geerdink, Martijn Visser - Fast Data at ING - ...Flink Forward Berlin 2017: Bas Geerdink, Martijn Visser - Fast Data at ING - ...
Flink Forward Berlin 2017: Bas Geerdink, Martijn Visser - Fast Data at ING - ...
 
Dell AI Telecom Webinar
Dell AI Telecom WebinarDell AI Telecom Webinar
Dell AI Telecom Webinar
 
Your AI Transformation
Your AI Transformation Your AI Transformation
Your AI Transformation
 
Reading the IBM AI Strategy for Business
Reading the IBM AI Strategy for BusinessReading the IBM AI Strategy for Business
Reading the IBM AI Strategy for Business
 
Session 2023-11.pptx
Session 2023-11.pptxSession 2023-11.pptx
Session 2023-11.pptx
 
Three Dimensions of Data as a Service
Three Dimensions of Data as a ServiceThree Dimensions of Data as a Service
Three Dimensions of Data as a Service
 
How to analyze text data for AI and ML with Named Entity Recognition
How to analyze text data for AI and ML with Named Entity RecognitionHow to analyze text data for AI and ML with Named Entity Recognition
How to analyze text data for AI and ML with Named Entity Recognition
 
AI for Customer Service - How to Improve Contact Center Efficiency with Machi...
AI for Customer Service - How to Improve Contact Center Efficiency with Machi...AI for Customer Service - How to Improve Contact Center Efficiency with Machi...
AI for Customer Service - How to Improve Contact Center Efficiency with Machi...
 
The UiPath Platform.pdf
The UiPath Platform.pdfThe UiPath Platform.pdf
The UiPath Platform.pdf
 
Ai digital (without videos)
Ai digital (without videos)Ai digital (without videos)
Ai digital (without videos)
 
Advanced AI Applications In Enterprises
Advanced AI Applications In EnterprisesAdvanced AI Applications In Enterprises
Advanced AI Applications In Enterprises
 
AI Microservices APIs and Business Automation as a Service Denis Gagne
AI Microservices APIs and Business Automation as a Service    Denis GagneAI Microservices APIs and Business Automation as a Service    Denis Gagne
AI Microservices APIs and Business Automation as a Service Denis Gagne
 
2018-10-25 Group RPA - AA Deck.pptx
2018-10-25 Group RPA - AA Deck.pptx2018-10-25 Group RPA - AA Deck.pptx
2018-10-25 Group RPA - AA Deck.pptx
 
[MindsLab] company intro 201711
[MindsLab] company intro 201711[MindsLab] company intro 201711
[MindsLab] company intro 201711
 
AI Overview and Capabilities
AI Overview and CapabilitiesAI Overview and Capabilities
AI Overview and Capabilities
 
MLSEV. Use Case: Robotic Process Automation and Machine Learning
MLSEV. Use Case: Robotic Process Automation and Machine LearningMLSEV. Use Case: Robotic Process Automation and Machine Learning
MLSEV. Use Case: Robotic Process Automation and Machine Learning
 

More from UiPathCommunity

Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPathCommunity
 
WomenInAutomation2024: AI and Automation for eveyone
WomenInAutomation2024: AI and Automation for eveyoneWomenInAutomation2024: AI and Automation for eveyone
WomenInAutomation2024: AI and Automation for eveyoneUiPathCommunity
 
Dev Dives: Master advanced authentication and performance in Productivity Act...
Dev Dives: Master advanced authentication and performance in Productivity Act...Dev Dives: Master advanced authentication and performance in Productivity Act...
Dev Dives: Master advanced authentication and performance in Productivity Act...UiPathCommunity
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPathCommunity
 
Test Automation with Gen AI_Final_Presentation
Test Automation with Gen AI_Final_PresentationTest Automation with Gen AI_Final_Presentation
Test Automation with Gen AI_Final_PresentationUiPathCommunity
 
Dev Dives: Leverage APIs and Gen AI to power automations for RPA and software...
Dev Dives: Leverage APIs and Gen AI to power automations for RPA and software...Dev Dives: Leverage APIs and Gen AI to power automations for RPA and software...
Dev Dives: Leverage APIs and Gen AI to power automations for RPA and software...UiPathCommunity
 
Unleashing the force of AI-powered intelligent document processing
Unleashing the force of AI-powered intelligent document processingUnleashing the force of AI-powered intelligent document processing
Unleashing the force of AI-powered intelligent document processingUiPathCommunity
 
Dev Dives: Fast-track time to value with UiPath Solution Accelerators
Dev Dives: Fast-track time to value with UiPath Solution AcceleratorsDev Dives: Fast-track time to value with UiPath Solution Accelerators
Dev Dives: Fast-track time to value with UiPath Solution AcceleratorsUiPathCommunity
 
Dev Dives: Take your developer productivity to new heights with UiPath Autopi...
Dev Dives: Take your developer productivity to new heights with UiPath Autopi...Dev Dives: Take your developer productivity to new heights with UiPath Autopi...
Dev Dives: Take your developer productivity to new heights with UiPath Autopi...UiPathCommunity
 
UiPath Document Understanding_Day 3.pptx
UiPath Document Understanding_Day 3.pptxUiPath Document Understanding_Day 3.pptx
UiPath Document Understanding_Day 3.pptxUiPathCommunity
 
Dev Dives: Automate in full power with the latest Generative AI features in U...
Dev Dives: Automate in full power with the latest Generative AI features in U...Dev Dives: Automate in full power with the latest Generative AI features in U...
Dev Dives: Automate in full power with the latest Generative AI features in U...UiPathCommunity
 
Testautomatisierung: Heatmap für SAP und Community-Austausch
Testautomatisierung: Heatmap für SAP und Community-AustauschTestautomatisierung: Heatmap für SAP und Community-Austausch
Testautomatisierung: Heatmap für SAP und Community-AustauschUiPathCommunity
 
Dev Dives: Mastering AI-powered Document Understanding
Dev Dives: Mastering AI-powered Document UnderstandingDev Dives: Mastering AI-powered Document Understanding
Dev Dives: Mastering AI-powered Document UnderstandingUiPathCommunity
 
Africa Series 2 Session 6 - UiPath ReFramework
Africa Series 2 Session 6 - UiPath ReFrameworkAfrica Series 2 Session 6 - UiPath ReFramework
Africa Series 2 Session 6 - UiPath ReFrameworkUiPathCommunity
 
Africa Series 2 Session 7 - Introduction to UiPath APIs.pdf
Africa Series 2 Session 7 - Introduction to UiPath APIs.pdfAfrica Series 2 Session 7 - Introduction to UiPath APIs.pdf
Africa Series 2 Session 7 - Introduction to UiPath APIs.pdfUiPathCommunity
 
Africa Series 2, Session 5: UiPath Document Understanding
Africa Series 2, Session 5: UiPath Document UnderstandingAfrica Series 2, Session 5: UiPath Document Understanding
Africa Series 2, Session 5: UiPath Document UnderstandingUiPathCommunity
 
Dev Dives: Supercharge testing and RPA with coded automations
Dev Dives: Supercharge testing and RPA with coded automationsDev Dives: Supercharge testing and RPA with coded automations
Dev Dives: Supercharge testing and RPA with coded automationsUiPathCommunity
 

More from UiPathCommunity (20)

Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to Hero
 
WomenInAutomation2024: AI and Automation for eveyone
WomenInAutomation2024: AI and Automation for eveyoneWomenInAutomation2024: AI and Automation for eveyone
WomenInAutomation2024: AI and Automation for eveyone
 
Dev Dives: Master advanced authentication and performance in Productivity Act...
Dev Dives: Master advanced authentication and performance in Productivity Act...Dev Dives: Master advanced authentication and performance in Productivity Act...
Dev Dives: Master advanced authentication and performance in Productivity Act...
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation Developers
 
Test Automation with Gen AI_Final_Presentation
Test Automation with Gen AI_Final_PresentationTest Automation with Gen AI_Final_Presentation
Test Automation with Gen AI_Final_Presentation
 
Dev Dives: Leverage APIs and Gen AI to power automations for RPA and software...
Dev Dives: Leverage APIs and Gen AI to power automations for RPA and software...Dev Dives: Leverage APIs and Gen AI to power automations for RPA and software...
Dev Dives: Leverage APIs and Gen AI to power automations for RPA and software...
 
Unleashing the force of AI-powered intelligent document processing
Unleashing the force of AI-powered intelligent document processingUnleashing the force of AI-powered intelligent document processing
Unleashing the force of AI-powered intelligent document processing
 
Dev Dives: Fast-track time to value with UiPath Solution Accelerators
Dev Dives: Fast-track time to value with UiPath Solution AcceleratorsDev Dives: Fast-track time to value with UiPath Solution Accelerators
Dev Dives: Fast-track time to value with UiPath Solution Accelerators
 
Dev Dives: Take your developer productivity to new heights with UiPath Autopi...
Dev Dives: Take your developer productivity to new heights with UiPath Autopi...Dev Dives: Take your developer productivity to new heights with UiPath Autopi...
Dev Dives: Take your developer productivity to new heights with UiPath Autopi...
 
Azure CICD - Day1.pptx
Azure CICD - Day1.pptxAzure CICD - Day1.pptx
Azure CICD - Day1.pptx
 
DU Series - Day 4.pptx
DU Series - Day 4.pptxDU Series - Day 4.pptx
DU Series - Day 4.pptx
 
UiPath Document Understanding_Day 3.pptx
UiPath Document Understanding_Day 3.pptxUiPath Document Understanding_Day 3.pptx
UiPath Document Understanding_Day 3.pptx
 
Dev Dives: Automate in full power with the latest Generative AI features in U...
Dev Dives: Automate in full power with the latest Generative AI features in U...Dev Dives: Automate in full power with the latest Generative AI features in U...
Dev Dives: Automate in full power with the latest Generative AI features in U...
 
Testautomatisierung: Heatmap für SAP und Community-Austausch
Testautomatisierung: Heatmap für SAP und Community-AustauschTestautomatisierung: Heatmap für SAP und Community-Austausch
Testautomatisierung: Heatmap für SAP und Community-Austausch
 
Dev Dives: Mastering AI-powered Document Understanding
Dev Dives: Mastering AI-powered Document UnderstandingDev Dives: Mastering AI-powered Document Understanding
Dev Dives: Mastering AI-powered Document Understanding
 
Africa Series 2 Session 6 - UiPath ReFramework
Africa Series 2 Session 6 - UiPath ReFrameworkAfrica Series 2 Session 6 - UiPath ReFramework
Africa Series 2 Session 6 - UiPath ReFramework
 
Africa Series 2 Session 7 - Introduction to UiPath APIs.pdf
Africa Series 2 Session 7 - Introduction to UiPath APIs.pdfAfrica Series 2 Session 7 - Introduction to UiPath APIs.pdf
Africa Series 2 Session 7 - Introduction to UiPath APIs.pdf
 
Africa Series 2, Session 5: UiPath Document Understanding
Africa Series 2, Session 5: UiPath Document UnderstandingAfrica Series 2, Session 5: UiPath Document Understanding
Africa Series 2, Session 5: UiPath Document Understanding
 
Dev Dives: Supercharge testing and RPA with coded automations
Dev Dives: Supercharge testing and RPA with coded automationsDev Dives: Supercharge testing and RPA with coded automations
Dev Dives: Supercharge testing and RPA with coded automations
 

Recently uploaded

Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphNeo4j
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptxLBM Solutions
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksSoftradix Technologies
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Azure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAzure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAndikSusilo4
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?XfilesPro
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxKatpro Technologies
 

Recently uploaded (20)

Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptx
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other Frameworks
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Azure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAzure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & Application
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
 

Communauté UiPath Suisse romande - Séance de janvier 2024

  • 1. Geneva chapter IntelligentDocumentProcessing January 18th 2024 UiPath Community The UiPath w ord mark, logos, and robots are registered trademarks ow ned by UiPath, Inc. and its affiliates. ©2023 UiPath. All rights reserved.
  • 2. 2 Agenda slide 01 02 03 Introduction Intelligent Document Processing Poll – Who is our Community?
  • 3. 3 Audrey Briffod Our new chapter co-leader Consultante UiPath depuis 2018 Certifiée UiPath Innovation and Solution Manager RPA chez Collaboration Betters The World
  • 4. 4 UiPath is a 3x Leader in IDP By Everest Group, IDC, ISG, Gartner, and more Capabilities Strategies Product Portfolio/Capabilities Competitive Strength Everest Group Intelligent Document Processing (IDP) Products PEAK Matrix ® Assessment 2023 IDC MarketScape: Worldwide Intelligent Document Processing (IDP) 2023-2024 Vendor Assessment ISG Provider Lens Intelligent Automation - Platforms and Products - Intelligent Document Processing “UiPath offers a holistic intelligent automation platform that combines IDP, RPA, process mining, task mining, process orchestration, and AI- / ML-based capabilities, including communications mining for NLP and unstructured data processing.” “Customers and partners give UiPath high marks for its ability to support and deliver accurate IDP outputs across a range of document types and use cases.” “UiPath combines RPA, OCR, Machine Learning, and Natural Language Processing to deliver industry-leading capabilities for automated document processing.”
  • 5. 5 IDP combines Document Understanding and Communications Mining capabilities to help customers automate document processing from end to end. It delivers state-of-the-art Specialized AI and Generative AI (Gen AI) for all scenarios - documents and communications, structured, semi-structured and unstructured. IntelligentDocumentProcessing (IDP) Introduction Extracts relevant data from documents. 70+ pre-built models to analyze and process different types of documents across industries and domains. Requests or emails with attached documents: • Multiple languages • Various formats • Handwriting • Signatures • Skewed & low-quality scans • Checkboxes • Tables Human in the loop Asking employees to validate the results if required or in case of inaccuracies and exceptions. UiPath Automation Route the extracted actions and data to downstream systems for further processing. Extracts key intent, sentiment and context data from messages. The latest advances in AI and machine learning (ML).
  • 6. 6 Gen AI-powered annotation for faster model training Seamless document classification with Gen AI Now, Document Understanding and Communications Mining have enhanced their IDP capabilities with Gen AI integrations Gen AI for unstructured data extraction and question answering
  • 7. Communications Mining The UiPath w ord mark, logos, and robots are registered trademarks ow ned by UiPath, Inc. and its affiliates. ©2023 UiPath. All rights reserved.
  • 8. 8 Emails, tickets, notes, surveys, cases, etc. Structured data to drive and trigger process automations API ERP RPA CMS CRM Understand and action every message at speed and scale 1 3 Drive Connect CRM Notes Email Tickets Service Desk AI and NLP automate the interpretation of every message in real time 2 Interpret Connect Train Discover Automate
  • 9. 9 Interpret the message... Extract key insights Policy > Amendment> Address Change Policy number Street City Zip code XE-182943 20 W 34TH St New York 10001 XF-929381 96 Park Road Sheffield S5 8PL Policy > Amendment> Name Change Policy number First name Last Name XE-182943 John Roberts Communications Mining example: Insurance Subject:Policyamendment Created: June 29,8:33pm From: Ed Crossey To: support@ Hi Steve, Our client wishes to change their name to John Roberts, he's also moved to a new home, the new address is 20 W 34THSt , New York , 10001. Can you please amend and issue updated docs?It's policy XE-182943by the way. And on XF-929381they've also moved,please can you update it to 96 Park Road, Sheffield,S5 8PL. Cheers, Ed
  • 10. 10 Interpret the message... Extract key insights Confirmation > CTM Escalation Follow up Exception > Mismatch > Block Subject:Trade processing,unmatched trades Created: September19th, 8:22am From: Lucy To: tradeprocessing@investment-bank.com Hello This is the third time I have followed up on this issue. These trades have been unmatched for 10 days because you’re mismatched in CTM. Can you provide a status update. This needs to be resolved ASAP. Regards Lucy Status Update Communications Mining example: Quality of Service Urgent -9.4 QoS -6.8 Tone
  • 11. 11 | Communications Mining + RPA Communications Mining Stream Queue Feeder UiPath Orchestrator Queue 2 Human-in-the-loop Queue Automation Process 1 Automation Process 2 Structured label & entity predictions per message with confidence scores NLP Exceptions Queue 1 Queue 3 Queue n … Automation Process 2 Automation Process n Automation Process logic for HITL Communications Feedback loop to iteratively improve model & maximise future high-confidence predictions Human-in-the-loop for instances with multiple above-threshold predictions,and NLP exceptions withoutconfidentpredictions
  • 12. 12 Communicationsmonitoring Real-time view of all service communicationchannels. Measure, monitor and improve. How customers use Communications Mining Communications Mining increases scalability, enhances the customer experience, and improves governance and control. Communications Mining creates both analytics and automation opportunities. Quality of service Real-time, proactive flagging of performanceissues and identification of recovery opportunities. Communicationsmining Mine historic communications to identify and quantify transformation opportunities. Voice of the customer Understand and continuously improve quality of service and the customer experience. Auto-triage Automate the classification, prioritization and routing of incoming communications. Case automation Automate case creation in service desk tools. Query automation E2E automate frequently occurring transactional requests. Monitor Automate Mine
  • 13. 13 Every companyacross every industryprocesses large volumesof unstructured communicationsdata Enterprise Healthcare Banking& FinancialServices Public Sector Insurance Manufacturing B2B and B2C emails, tickets and messages Sales and order management processes Notes in core systems – e.g. CRM, ERP etc. Customer service and support KYC – Know Your Customer Trade settlement & amendment processes Front, middle & back office mailboxes Client/ customer onboarding & support KYC – Know Your Customer Underwriting processes Claims handling & processing Patient registration & processing Consent and assent processes Health insurance claims Immigration application & processing Benefit application & processing Citizen services, questions & feedback Sales & order management processes Shipping information Customer & vendor communications Customer queries & communications Telecommunications eCommerce Energy& utilities Customer complaints, service and support Agent problem & resolution case notes Customer queries (shipping, returns etc.) Product feedback Maintenance, outage and resolution notes Customer complaints, service and support
  • 14. Document Understanding The UiPath w ord mark, logos, and robots are registered trademarks ow ned by UiPath, Inc. and its affiliates. ©2023 UiPath. All rights reserved.
  • 15. 15 Get your documents processed intelligently Teach your robots to understand documents using AI-enhanced skills fordata extraction and interpretation. Drag and drop these capabilities directly into your automation workflows to embed AI
  • 16. 16 Built for: RPA and citizen developers – no data science skills required Built-in AI: Specialized AI models and Generative AI Built as: SaaS, APIs, self-hosted or air-gapped integrated with UiPath Business Automation Platform 1 Receive 3 Act 2 Understand Documents • Multiple languages • Various types & formats • Handwriting & signatures • Tables & checkboxes • Skewed & low-quality scans AI-powered processing Human in the loop UiPath Automation • Initiate other automations • Input into system of record • Drive other actions Validate the extracted information and handle exceptions Digitize Classify Extract
  • 17. 17 Next-generation Document Understanding with active learning What? Active learning is a next-gen AI- powered experience within UiPath Document Understanding Why? • Anyone can train AI models—no coding or ML skills required • 80% faster model training—from a week, down to just a day • Guidance on model optimization— humans & AI collaborating together • Instant model evaluation—built-in model performance analytics Where and when? Private Preview via Automation Cloud in 2023.10
  • 18. 18 Bringing a new unified experience to training, deploying and monitoring your model Previously across Document Understanding, Document Manager, AI Center Build Load samples,annotate, and train your modelwith a guided experience Measure Understand your model performance and how to improve it Run Deployand manage your projects with ease Monitor Monitor and audit the performanceof your automation Note: Preview limitations: Currently we can classifyand annotate 40 common documenttypes,limited to out-of-the-box Specialized AI models,full listat https://docs.uipath.com/document-understanding/automation- cloud/latest/user-guide/out-of-the-box-pre-trained-ml-packages;will be addressed and on roadmap for FA in 24.4
  • 19. 19 Next-gen Document Understanding Experience with Active Learning: Build Build Load samples,annotate,and train your model with a guided experience ▪ Upload and manage your documents ▪ Classify documents automatically ▪ Use Generative AI to automatically annotate fields that users validate ▪ Follow recommendations that guide you on how to improve your model efficiently ▪ Model training occurs in the background to see impact of user actions Note: Preview limitations: Currently we can classifyand annotate 40 common documenttypes,limited to out-of-the-box Specialized AI models,full listat https://docs.uipath.com/document-understanding/automation- cloud/latest/user-guide/out-of-the-box-pre-trained-ml-packages;will be addressed and on roadmap for FA in 24.4
  • 20. 20 Next-gen Document Understanding Experience with Active Learning: Measure Measure Understandyourmodelperformance and how to improveit ▪ Evaluate your project readiness with model metrics ▪ Model metrics indicate which parts of the project need the most attention ▪ Identified and takes user to the part of the project with recommended actions to improve model performance ▪ See distribution of dataset
  • 21. 21 Next-gen Document Understanding Experience with Active Learning: Run Run Deployand manage yourprojects with ease ▪ Evaluate your project readiness with model Choose and deploy model in just a couple of clicks ▪ Easily version your entire project ▪ Start working in studio, studio web, or via API
  • 22. 22 Next-gen Document Understanding Experience with Active Learning: Monitor Monitor Monitorand auditthe performance of yourautomation ▪ Dashboard integrated to show business outcomes of the automation ▪ Easily drill down into status of documents being processed ▪ Visibility into human in the loop events –see what the validator corrected for full transparency ▪ Search through history of documents processed
  • 23. 23 What is active learning? Active learning is an approach unique to UiPath and enables: ▪ Reduction of data samples ▪ A guided experience (no ML experience required) ▪ Up to 80%+ faster model training ▪ Even more visibility into model performance, with “Measure” phase Active learning employs an iterative process between annotators and model to reduce the amount of data required to train a ML model Active Learning Evaluate Performance Retrain and Redeploy ML Model Human Annotation Identifies which data points will be most informative to improving model performance Without active learning, training is more of a “black box” experience – you spend time labelling fields without knowing it’s impact and need to deploy the model to see the results
  • 24. 24 Generative AI capabilities in Document Understanding What? Generative Annotation, Generative Classification, Generative Extraction Why? Generative Annotation (Pre-labeling): Annotate any document samples with Gen AI, speeding training from a week to 1-2 days for complex scenarios, or minutes for simpler forms Generative Classification: Classifying documents is fast and easy with Gen AI— just define the document types; no need to write rules or train new ML models Generative Extraction: No need to train custom ML models to answer questions and summarize content in free-form unstructured documents—use Gen AI instead Where and when? GA in Automation Cloud and activities in 2023.10
  • 25. 25 Logic in the process to automatically determine if field(s) extracted correctly Art of the possible with business rules Character validation Basic math Date validation External source verification Invoice # = 7 digits Total = Line Items + Tax Valid date format Verify against PO Record PO Number Vendor ID Vendor Name 5928452 12345 PROTECH 3758292 98734 LORANA
  • 26. 26 Model performance over time ML modelage (time) Initial (re)training Post-processing + business rules Finetune with validated data Out-of-the-box& Pre-trained model - Optimize based on required fields - (Re)train ML model with your documents - Business rules confirm/correct before SME - Verified corrections finetune ML Model Validation Logic / matching FTE verification Extract data Straight through processing rate - STP ! Important ! • Each improvementis specific to yourenvironment • Involve the documentSME / business owner • Experienced deployment partner is huge value
  • 27. 27 Input as the message... Input as the attachment… Output as key data and insights Validate againstCRM Vendor match: PROTECH Invoice match: 5727346 Notify for Approval Human verifies total: $760 Requests Policy No: 1863325 Address Line:20 W 34th St. NY Zip code: 10001 Admin Change> AddressChange Policy > Renewal Subject:Address change policy No. 1863325 Created: June 29,8:33pm From: Ed Crossey To: AaronChallis Could you please update the address on the above policy to 20 W 34th St., New York, NY 10001,USA. My policy is due to renew next week, and I need the address updated beforesigning the PO. Feelthis is unnecessarily hard. Automate emails and attachments
  • 28. 28 UiPath capabilities Process example:Invoiceautomation Inv oice Model LLM Model Robot Human Receive email from vendors to specific inbox (Coupa) TASK COMPLETED Review attachments (invoices) in PDF format Validate if the invoice number is in the Coupa system No: Missing or invalid PO Human support and troubleshooting Non-PO Invoice Create Yes: Valid PO found PO Flip Either PO flip to invoice or new invoice created and saved in Coupa system Exampleprocess Key: • Real time connectand analysis of emails • Recognize specificintent, entities and emotion • Pre-trained invoice model • Extract all invoice details • Validates invoice number against source system(s). • Human in the loop validation. • UiPath Automation Cloud PO Flip or invoice creation. • Recordsupdated to reflectprocess updates. Update email to vendor written • UiPath OpenAI Connectorprompts GPT to draft email update response forvendor. • UiPath Action Center for human in the loop validation of drafted email • Automation cloud updates systems of record.
  • 29. Poll Who is our Community? The UiPath w ord mark, logos, and robots are registered trademarks ow ned by UiPath, Inc. and its affiliates. ©2023 UiPath. All rights reserved.