SlideShare a Scribd company logo

UiPath Document Understanding_Day 2.pptx

DU Series

1 of 21
Download to read offline
UiPath Document
Understanding
Automation Technical Lead,
Accelirate
Process documents intelligently
UiPath Document
Understanding
Process documents intelligently
Day 2 DU Series
VINOLIVAN NADAR
Automation Technical Lead, Accelirate
Agenda
Quick Recap on DU basics
DU Architecture
DU Framework
GenAI Capabilities
Hands-on
3
Platform components
Studio
Robots
Orchestrator
AI Center
Action Center
• Pre-trained models available out of the box
• Bring your own model – custom or 3rd party
• Retrain the models
• Core RPAtools
• Human validation
Automation
Hub
Process
Mining
Task
Mining
Studio
Family
Test
Manager
Chatbots
Action
Center
Assistant
DISCOVER
ENGAGE
BUILD
Document
Understanding
Marketplace
AI Center
Orchestrator
Apps
Task
Capture
Insights
MANAGE
GOVERN
MEASURE
Robots
RUN
Integration
Service
What is Document Understanding
Document
Understanding
Artificial
Intelligence
(AI)
Document
Processing
Robotic Process
Automation
(RPA)
Document understanding is the ability to
extract and interpret information and
meaning from a wide range of documents.
It emerges at the intersection of document
processing, AI, and RPA.
Not OCR
Not Computer Vision
5
Document Types
• Required information found in the
same place
• Fixed in format and can contain
handwriting, signatures, checkboxes​
• Like invoices, receipts, purchase
orders, medical bills, utility bills
• Containing fixed and variable parts
like tables
• No fixed format, free-form
sentences/paragraphs
• Like contracts, agreements, emails,
scripts, drug prescriptions, news
Structured documents Semi-structured documents Unstructured documents
6
Document Processing Approaches

Recommended

Introduction to RPA and Document Understanding
Introduction to RPA and Document UnderstandingIntroduction to RPA and Document Understanding
Introduction to RPA and Document UnderstandingDiana Gray, MBA
 
Unlocking the Power of UiPath: A Journey into Document Understanding
Unlocking the Power of UiPath: A Journey into Document UnderstandingUnlocking the Power of UiPath: A Journey into Document Understanding
Unlocking the Power of UiPath: A Journey into Document UnderstandingDianaGray10
 
Automation CoE at Scale Using Agile to build RPA
Automation CoE at Scale Using Agile to build RPAAutomation CoE at Scale Using Agile to build RPA
Automation CoE at Scale Using Agile to build RPAHexaware Technologies
 
2023.04.04, Automating Data Extraction with UiPath Document Understanding.pdf
2023.04.04, Automating Data Extraction with UiPath Document Understanding.pdf2023.04.04, Automating Data Extraction with UiPath Document Understanding.pdf
2023.04.04, Automating Data Extraction with UiPath Document Understanding.pdfTracy Dixon
 
Microsoft + OpenAI: Recent Updates (Machine Learning 15minutes! Broadcast #74)
Microsoft + OpenAI: Recent Updates (Machine Learning 15minutes! Broadcast #74)Microsoft + OpenAI: Recent Updates (Machine Learning 15minutes! Broadcast #74)
Microsoft + OpenAI: Recent Updates (Machine Learning 15minutes! Broadcast #74)Naoki (Neo) SATO
 

More Related Content

What's hot

AI and ML Series - Leveraging Generative AI and LLMs Using the UiPath Platfor...
AI and ML Series - Leveraging Generative AI and LLMs Using the UiPath Platfor...AI and ML Series - Leveraging Generative AI and LLMs Using the UiPath Platfor...
AI and ML Series - Leveraging Generative AI and LLMs Using the UiPath Platfor...DianaGray10
 
UiPath Automation Cloud - Best Practises session1.pptx
UiPath Automation Cloud - Best Practises session1.pptxUiPath Automation Cloud - Best Practises session1.pptx
UiPath Automation Cloud - Best Practises session1.pptxRohit Radhakrishnan
 
Leveraging Generative AI & Best practices
Leveraging Generative AI & Best practicesLeveraging Generative AI & Best practices
Leveraging Generative AI & Best practicesDianaGray10
 
RPA Portfolio Assessment
RPA Portfolio Assessment RPA Portfolio Assessment
RPA Portfolio Assessment Eric Rodman
 
GENERATIVE AI, THE FUTURE OF PRODUCTIVITY
GENERATIVE AI, THE FUTURE OF PRODUCTIVITYGENERATIVE AI, THE FUTURE OF PRODUCTIVITY
GENERATIVE AI, THE FUTURE OF PRODUCTIVITYAndre Muscat
 
Introduction to RPA_SummerSchool _ Welcome to the world of automation using U...
Introduction to RPA_SummerSchool _ Welcome to the world of automation using U...Introduction to RPA_SummerSchool _ Welcome to the world of automation using U...
Introduction to RPA_SummerSchool _ Welcome to the world of automation using U...Diana Gray, MBA
 
UiPath Community Event - UiPath Action Center and UiPath Apps - human in the ...
UiPath Community Event - UiPath Action Center and UiPath Apps - human in the ...UiPath Community Event - UiPath Action Center and UiPath Apps - human in the ...
UiPath Community Event - UiPath Action Center and UiPath Apps - human in the ...TomaszGaczynski
 
Generative AI Risks & Concerns
Generative AI Risks & ConcernsGenerative AI Risks & Concerns
Generative AI Risks & ConcernsAjitesh Kumar
 
Google Cloud GenAI Overview_071223.pptx
Google Cloud GenAI Overview_071223.pptxGoogle Cloud GenAI Overview_071223.pptx
Google Cloud GenAI Overview_071223.pptxVishPothapu
 
On the Application of AI for Failure Management: Problems, Solutions and Algo...
On the Application of AI for Failure Management: Problems, Solutions and Algo...On the Application of AI for Failure Management: Problems, Solutions and Algo...
On the Application of AI for Failure Management: Problems, Solutions and Algo...Jorge Cardoso
 
Using the power of Generative AI at scale
Using the power of Generative AI at scaleUsing the power of Generative AI at scale
Using the power of Generative AI at scaleMaxim Salnikov
 
Global Azure Bootcamp Pune 2023 - Lead the AI era with Microsoft Azure.pdf
Global Azure Bootcamp Pune 2023 -  Lead the AI era with Microsoft Azure.pdfGlobal Azure Bootcamp Pune 2023 -  Lead the AI era with Microsoft Azure.pdf
Global Azure Bootcamp Pune 2023 - Lead the AI era with Microsoft Azure.pdfAroh Shukla
 
Generative AI Use-cases for Enterprise - First Session
Generative AI Use-cases for Enterprise - First SessionGenerative AI Use-cases for Enterprise - First Session
Generative AI Use-cases for Enterprise - First SessionGene Leybzon
 
Setting up The Centre of Excellence for Rpa
Setting up The Centre of Excellence for RpaSetting up The Centre of Excellence for Rpa
Setting up The Centre of Excellence for RpaMohit Sharma (GAICD)
 
Intelligent Automation in Accounting and Finance with IMA Queens College Stud...
Intelligent Automation in Accounting and Finance with IMA Queens College Stud...Intelligent Automation in Accounting and Finance with IMA Queens College Stud...
Intelligent Automation in Accounting and Finance with IMA Queens College Stud...Diana Gray, MBA
 

What's hot (20)

AI and ML Series - Leveraging Generative AI and LLMs Using the UiPath Platfor...
AI and ML Series - Leveraging Generative AI and LLMs Using the UiPath Platfor...AI and ML Series - Leveraging Generative AI and LLMs Using the UiPath Platfor...
AI and ML Series - Leveraging Generative AI and LLMs Using the UiPath Platfor...
 
UiPath Automation Cloud - Best Practises session1.pptx
UiPath Automation Cloud - Best Practises session1.pptxUiPath Automation Cloud - Best Practises session1.pptx
UiPath Automation Cloud - Best Practises session1.pptx
 
Leveraging Generative AI & Best practices
Leveraging Generative AI & Best practicesLeveraging Generative AI & Best practices
Leveraging Generative AI & Best practices
 
Is AI generation the next platform shift?
Is AI generation the next platform shift?Is AI generation the next platform shift?
Is AI generation the next platform shift?
 
RPA Portfolio Assessment
RPA Portfolio Assessment RPA Portfolio Assessment
RPA Portfolio Assessment
 
GENERATIVE AI, THE FUTURE OF PRODUCTIVITY
GENERATIVE AI, THE FUTURE OF PRODUCTIVITYGENERATIVE AI, THE FUTURE OF PRODUCTIVITY
GENERATIVE AI, THE FUTURE OF PRODUCTIVITY
 
Introduction to RPA_SummerSchool _ Welcome to the world of automation using U...
Introduction to RPA_SummerSchool _ Welcome to the world of automation using U...Introduction to RPA_SummerSchool _ Welcome to the world of automation using U...
Introduction to RPA_SummerSchool _ Welcome to the world of automation using U...
 
Robotic Process Automation Webinar Slides
Robotic Process Automation Webinar SlidesRobotic Process Automation Webinar Slides
Robotic Process Automation Webinar Slides
 
UiPath Community Event - UiPath Action Center and UiPath Apps - human in the ...
UiPath Community Event - UiPath Action Center and UiPath Apps - human in the ...UiPath Community Event - UiPath Action Center and UiPath Apps - human in the ...
UiPath Community Event - UiPath Action Center and UiPath Apps - human in the ...
 
introduction Azure OpenAI by Usama wahab khan
introduction  Azure OpenAI by Usama wahab khanintroduction  Azure OpenAI by Usama wahab khan
introduction Azure OpenAI by Usama wahab khan
 
What is RPA?
What is RPA?What is RPA?
What is RPA?
 
Generative AI Risks & Concerns
Generative AI Risks & ConcernsGenerative AI Risks & Concerns
Generative AI Risks & Concerns
 
Google Cloud GenAI Overview_071223.pptx
Google Cloud GenAI Overview_071223.pptxGoogle Cloud GenAI Overview_071223.pptx
Google Cloud GenAI Overview_071223.pptx
 
On the Application of AI for Failure Management: Problems, Solutions and Algo...
On the Application of AI for Failure Management: Problems, Solutions and Algo...On the Application of AI for Failure Management: Problems, Solutions and Algo...
On the Application of AI for Failure Management: Problems, Solutions and Algo...
 
Using the power of Generative AI at scale
Using the power of Generative AI at scaleUsing the power of Generative AI at scale
Using the power of Generative AI at scale
 
Global Azure Bootcamp Pune 2023 - Lead the AI era with Microsoft Azure.pdf
Global Azure Bootcamp Pune 2023 -  Lead the AI era with Microsoft Azure.pdfGlobal Azure Bootcamp Pune 2023 -  Lead the AI era with Microsoft Azure.pdf
Global Azure Bootcamp Pune 2023 - Lead the AI era with Microsoft Azure.pdf
 
Generative AI Use-cases for Enterprise - First Session
Generative AI Use-cases for Enterprise - First SessionGenerative AI Use-cases for Enterprise - First Session
Generative AI Use-cases for Enterprise - First Session
 
Setting up The Centre of Excellence for Rpa
Setting up The Centre of Excellence for RpaSetting up The Centre of Excellence for Rpa
Setting up The Centre of Excellence for Rpa
 
Robotic Process Automation-RPA
Robotic Process Automation-RPARobotic Process Automation-RPA
Robotic Process Automation-RPA
 
Intelligent Automation in Accounting and Finance with IMA Queens College Stud...
Intelligent Automation in Accounting and Finance with IMA Queens College Stud...Intelligent Automation in Accounting and Finance with IMA Queens College Stud...
Intelligent Automation in Accounting and Finance with IMA Queens College Stud...
 

Similar to UiPath Document Understanding_Day 2.pptx

Dev Dives: Mastering AI-powered Document Understanding
Dev Dives: Mastering AI-powered Document UnderstandingDev Dives: Mastering AI-powered Document Understanding
Dev Dives: Mastering AI-powered Document UnderstandingUiPathCommunity
 
UiPath Document Understanding_Day 3.pptx
UiPath Document Understanding_Day 3.pptxUiPath Document Understanding_Day 3.pptx
UiPath Document Understanding_Day 3.pptxUiPathCommunity
 
Jade Intelligent Automation .pptx
Jade Intelligent Automation .pptxJade Intelligent Automation .pptx
Jade Intelligent Automation .pptxJaeJung29
 
Business Analytics Paradigm Change
Business Analytics Paradigm ChangeBusiness Analytics Paradigm Change
Business Analytics Paradigm ChangeDmitry Anoshin
 
Fast Data at ING – the why, what and how of the streaming analytics platform ...
Fast Data at ING – the why, what and how of the streaming analytics platform ...Fast Data at ING – the why, what and how of the streaming analytics platform ...
Fast Data at ING – the why, what and how of the streaming analytics platform ...Bas Geerdink
 
ADV Slides: What the Aspiring or New Data Scientist Needs to Know About the E...
ADV Slides: What the Aspiring or New Data Scientist Needs to Know About the E...ADV Slides: What the Aspiring or New Data Scientist Needs to Know About the E...
ADV Slides: What the Aspiring or New Data Scientist Needs to Know About the E...DATAVERSITY
 
The art of information architecture in Office 365
The art of information architecture in Office 365The art of information architecture in Office 365
The art of information architecture in Office 365Simon Rawson
 
Digital_IOT_(Microsoft_Solution).pdf
Digital_IOT_(Microsoft_Solution).pdfDigital_IOT_(Microsoft_Solution).pdf
Digital_IOT_(Microsoft_Solution).pdfssuserd23711
 
Top Financial Use Cases for Intelligent Document Processing | Use Cases of ID...
Top Financial Use Cases for Intelligent Document Processing | Use Cases of ID...Top Financial Use Cases for Intelligent Document Processing | Use Cases of ID...
Top Financial Use Cases for Intelligent Document Processing | Use Cases of ID...Emagia
 
The Three Levels of AP Automation
The Three Levels of AP AutomationThe Three Levels of AP Automation
The Three Levels of AP AutomationHelpSystems
 
Machine Teaching for workflow automation RIGA COMM 2020
Machine Teaching for workflow automation RIGA COMM 2020Machine Teaching for workflow automation RIGA COMM 2020
Machine Teaching for workflow automation RIGA COMM 2020Muntis Rudzitis
 
Accelerate Your PeopleSoft Accounts Payable Process Into Overdrive with Oracl...
Accelerate Your PeopleSoft Accounts Payable Process Into Overdrive with Oracl...Accelerate Your PeopleSoft Accounts Payable Process Into Overdrive with Oracl...
Accelerate Your PeopleSoft Accounts Payable Process Into Overdrive with Oracl...Fishbowl Solutions
 
SmartLattice eSmart Office
SmartLattice eSmart OfficeSmartLattice eSmart Office
SmartLattice eSmart OfficeSmart Lattice
 
JD Edwards Manufacturing Deep Dive Workshop
JD Edwards Manufacturing Deep Dive WorkshopJD Edwards Manufacturing Deep Dive Workshop
JD Edwards Manufacturing Deep Dive WorkshopTerillium
 
How Intelligent Document Processing is Driving Accounts Receivable (AR) and A...
How Intelligent Document Processing is Driving Accounts Receivable (AR) and A...How Intelligent Document Processing is Driving Accounts Receivable (AR) and A...
How Intelligent Document Processing is Driving Accounts Receivable (AR) and A...Emagia
 

Similar to UiPath Document Understanding_Day 2.pptx (20)

Dev Dives: Mastering AI-powered Document Understanding
Dev Dives: Mastering AI-powered Document UnderstandingDev Dives: Mastering AI-powered Document Understanding
Dev Dives: Mastering AI-powered Document Understanding
 
DU_SERIES_Session1.pdf
DU_SERIES_Session1.pdfDU_SERIES_Session1.pdf
DU_SERIES_Session1.pdf
 
UiPath Document Understanding_Day 3.pptx
UiPath Document Understanding_Day 3.pptxUiPath Document Understanding_Day 3.pptx
UiPath Document Understanding_Day 3.pptx
 
DU Series - Day 4.pptx
DU Series - Day 4.pptxDU Series - Day 4.pptx
DU Series - Day 4.pptx
 
Intelligent Data Extraction, Turning Content into Data, A Look at Advanced Ca...
Intelligent Data Extraction, Turning Content into Data, A Look at Advanced Ca...Intelligent Data Extraction, Turning Content into Data, A Look at Advanced Ca...
Intelligent Data Extraction, Turning Content into Data, A Look at Advanced Ca...
 
Jade Intelligent Automation .pptx
Jade Intelligent Automation .pptxJade Intelligent Automation .pptx
Jade Intelligent Automation .pptx
 
Business Analytics Paradigm Change
Business Analytics Paradigm ChangeBusiness Analytics Paradigm Change
Business Analytics Paradigm Change
 
Fast Data at ING – the why, what and how of the streaming analytics platform ...
Fast Data at ING – the why, what and how of the streaming analytics platform ...Fast Data at ING – the why, what and how of the streaming analytics platform ...
Fast Data at ING – the why, what and how of the streaming analytics platform ...
 
ADV Slides: What the Aspiring or New Data Scientist Needs to Know About the E...
ADV Slides: What the Aspiring or New Data Scientist Needs to Know About the E...ADV Slides: What the Aspiring or New Data Scientist Needs to Know About the E...
ADV Slides: What the Aspiring or New Data Scientist Needs to Know About the E...
 
Big Data + PeopleSoft = BIG WIN!
Big Data + PeopleSoft = BIG WIN!Big Data + PeopleSoft = BIG WIN!
Big Data + PeopleSoft = BIG WIN!
 
The art of information architecture in Office 365
The art of information architecture in Office 365The art of information architecture in Office 365
The art of information architecture in Office 365
 
Digital_IOT_(Microsoft_Solution).pdf
Digital_IOT_(Microsoft_Solution).pdfDigital_IOT_(Microsoft_Solution).pdf
Digital_IOT_(Microsoft_Solution).pdf
 
Top Financial Use Cases for Intelligent Document Processing | Use Cases of ID...
Top Financial Use Cases for Intelligent Document Processing | Use Cases of ID...Top Financial Use Cases for Intelligent Document Processing | Use Cases of ID...
Top Financial Use Cases for Intelligent Document Processing | Use Cases of ID...
 
The Three Levels of AP Automation
The Three Levels of AP AutomationThe Three Levels of AP Automation
The Three Levels of AP Automation
 
Machine Teaching for workflow automation RIGA COMM 2020
Machine Teaching for workflow automation RIGA COMM 2020Machine Teaching for workflow automation RIGA COMM 2020
Machine Teaching for workflow automation RIGA COMM 2020
 
Accelerate Your PeopleSoft Accounts Payable Process Into Overdrive with Oracl...
Accelerate Your PeopleSoft Accounts Payable Process Into Overdrive with Oracl...Accelerate Your PeopleSoft Accounts Payable Process Into Overdrive with Oracl...
Accelerate Your PeopleSoft Accounts Payable Process Into Overdrive with Oracl...
 
IT webinar 2016
IT webinar 2016IT webinar 2016
IT webinar 2016
 
SmartLattice eSmart Office
SmartLattice eSmart OfficeSmartLattice eSmart Office
SmartLattice eSmart Office
 
JD Edwards Manufacturing Deep Dive Workshop
JD Edwards Manufacturing Deep Dive WorkshopJD Edwards Manufacturing Deep Dive Workshop
JD Edwards Manufacturing Deep Dive Workshop
 
How Intelligent Document Processing is Driving Accounts Receivable (AR) and A...
How Intelligent Document Processing is Driving Accounts Receivable (AR) and A...How Intelligent Document Processing is Driving Accounts Receivable (AR) and A...
How Intelligent Document Processing is Driving Accounts Receivable (AR) and A...
 

More from RohitRadhakrishnan8

UiPath Community_Process Mining.pdf
UiPath Community_Process Mining.pdfUiPath Community_Process Mining.pdf
UiPath Community_Process Mining.pdfRohitRadhakrishnan8
 
UiPath Community_Automation Business Analysts.pptx
UiPath Community_Automation Business Analysts.pptxUiPath Community_Automation Business Analysts.pptx
UiPath Community_Automation Business Analysts.pptxRohitRadhakrishnan8
 
Role of a Solution Architect-1.pptx
Role of a Solution Architect-1.pptxRole of a Solution Architect-1.pptx
Role of a Solution Architect-1.pptxRohitRadhakrishnan8
 
Integration Service - Power and Govern API-based connection sharing.pptx
Integration Service - Power and Govern API-based connection sharing.pptxIntegration Service - Power and Govern API-based connection sharing.pptx
Integration Service - Power and Govern API-based connection sharing.pptxRohitRadhakrishnan8
 
Workday Community Session Final.pptx
Workday Community Session Final.pptxWorkday Community Session Final.pptx
Workday Community Session Final.pptxRohitRadhakrishnan8
 
CyberArkUIPath_RPA Final (2).pptx
CyberArkUIPath_RPA Final (2).pptxCyberArkUIPath_RPA Final (2).pptx
CyberArkUIPath_RPA Final (2).pptxRohitRadhakrishnan8
 
CyberArkUIPath_RPA Final (1).pptx
CyberArkUIPath_RPA Final (1).pptxCyberArkUIPath_RPA Final (1).pptx
CyberArkUIPath_RPA Final (1).pptxRohitRadhakrishnan8
 
CyberArkUIPath_RPA Final (2).pptx
CyberArkUIPath_RPA Final (2).pptxCyberArkUIPath_RPA Final (2).pptx
CyberArkUIPath_RPA Final (2).pptxRohitRadhakrishnan8
 

More from RohitRadhakrishnan8 (11)

UiPathAppsReloaded.pptx
UiPathAppsReloaded.pptxUiPathAppsReloaded.pptx
UiPathAppsReloaded.pptx
 
UiPath Community_Process Mining.pdf
UiPath Community_Process Mining.pdfUiPath Community_Process Mining.pdf
UiPath Community_Process Mining.pdf
 
Automation Suite PPT (2).pptx
Automation Suite PPT (2).pptxAutomation Suite PPT (2).pptx
Automation Suite PPT (2).pptx
 
UiPath Community_Automation Business Analysts.pptx
UiPath Community_Automation Business Analysts.pptxUiPath Community_Automation Business Analysts.pptx
UiPath Community_Automation Business Analysts.pptx
 
Role of a Solution Architect-1.pptx
Role of a Solution Architect-1.pptxRole of a Solution Architect-1.pptx
Role of a Solution Architect-1.pptx
 
Integration Service - Power and Govern API-based connection sharing.pptx
Integration Service - Power and Govern API-based connection sharing.pptxIntegration Service - Power and Govern API-based connection sharing.pptx
Integration Service - Power and Govern API-based connection sharing.pptx
 
Workday Community Session Final.pptx
Workday Community Session Final.pptxWorkday Community Session Final.pptx
Workday Community Session Final.pptx
 
Intro to MP.pptx
Intro to MP.pptxIntro to MP.pptx
Intro to MP.pptx
 
CyberArkUIPath_RPA Final (2).pptx
CyberArkUIPath_RPA Final (2).pptxCyberArkUIPath_RPA Final (2).pptx
CyberArkUIPath_RPA Final (2).pptx
 
CyberArkUIPath_RPA Final (1).pptx
CyberArkUIPath_RPA Final (1).pptxCyberArkUIPath_RPA Final (1).pptx
CyberArkUIPath_RPA Final (1).pptx
 
CyberArkUIPath_RPA Final (2).pptx
CyberArkUIPath_RPA Final (2).pptxCyberArkUIPath_RPA Final (2).pptx
CyberArkUIPath_RPA Final (2).pptx
 

Recently uploaded

Model Jaringan network jaringan komputer.pdf
Model Jaringan network jaringan komputer.pdfModel Jaringan network jaringan komputer.pdf
Model Jaringan network jaringan komputer.pdfgalfinprihardiputra0
 
NANOG 90: 'BGP in 2023' presented by Geoff Huston
NANOG 90: 'BGP in 2023' presented by Geoff HustonNANOG 90: 'BGP in 2023' presented by Geoff Huston
NANOG 90: 'BGP in 2023' presented by Geoff HustonAPNIC
 
Augmented and Mixed Reality Solutions for Frontline Medical Professionals
Augmented and Mixed Reality Solutions for Frontline Medical ProfessionalsAugmented and Mixed Reality Solutions for Frontline Medical Professionals
Augmented and Mixed Reality Solutions for Frontline Medical Professionalsthirdeyegen65
 
Augmented and Mixed Reality Solutions for Aerospace & Defense
Augmented and Mixed Reality Solutions for Aerospace & DefenseAugmented and Mixed Reality Solutions for Aerospace & Defense
Augmented and Mixed Reality Solutions for Aerospace & Defensethirdeyegen65
 
Biometrics Technology Intresting PPT
Biometrics Technology Intresting PPTBiometrics Technology Intresting PPT
Biometrics Technology Intresting PPTPraveenKumarThota7
 
Disobey 2024: Karri Huhtanen: Wi-Fi Roaming Security and Privacy
Disobey 2024: Karri Huhtanen: Wi-Fi Roaming Security and PrivacyDisobey 2024: Karri Huhtanen: Wi-Fi Roaming Security and Privacy
Disobey 2024: Karri Huhtanen: Wi-Fi Roaming Security and PrivacyKarri Huhtanen
 
DNS-OARC 42: Is the DNS ready for IPv6? presentation by Geoff Huston
DNS-OARC 42: Is the DNS ready for IPv6? presentation by Geoff HustonDNS-OARC 42: Is the DNS ready for IPv6? presentation by Geoff Huston
DNS-OARC 42: Is the DNS ready for IPv6? presentation by Geoff HustonAPNIC
 
AWS Overview of AWS Clarify, Feature Store, Hyper parameter Tuning
AWS Overview of AWS  Clarify, Feature Store, Hyper parameter TuningAWS Overview of AWS  Clarify, Feature Store, Hyper parameter Tuning
AWS Overview of AWS Clarify, Feature Store, Hyper parameter TuningVarun Garg
 
Regulation is Coming - Trusted Media Summit 2023
Regulation is Coming - Trusted Media Summit 2023Regulation is Coming - Trusted Media Summit 2023
Regulation is Coming - Trusted Media Summit 2023Damar Juniarto
 
Red shadows ringing in Japan's Cyberspace
Red shadows ringing in Japan's CyberspaceRed shadows ringing in Japan's Cyberspace
Red shadows ringing in Japan's Cyberspacesttyk
 

Recently uploaded (10)

Model Jaringan network jaringan komputer.pdf
Model Jaringan network jaringan komputer.pdfModel Jaringan network jaringan komputer.pdf
Model Jaringan network jaringan komputer.pdf
 
NANOG 90: 'BGP in 2023' presented by Geoff Huston
NANOG 90: 'BGP in 2023' presented by Geoff HustonNANOG 90: 'BGP in 2023' presented by Geoff Huston
NANOG 90: 'BGP in 2023' presented by Geoff Huston
 
Augmented and Mixed Reality Solutions for Frontline Medical Professionals
Augmented and Mixed Reality Solutions for Frontline Medical ProfessionalsAugmented and Mixed Reality Solutions for Frontline Medical Professionals
Augmented and Mixed Reality Solutions for Frontline Medical Professionals
 
Augmented and Mixed Reality Solutions for Aerospace & Defense
Augmented and Mixed Reality Solutions for Aerospace & DefenseAugmented and Mixed Reality Solutions for Aerospace & Defense
Augmented and Mixed Reality Solutions for Aerospace & Defense
 
Biometrics Technology Intresting PPT
Biometrics Technology Intresting PPTBiometrics Technology Intresting PPT
Biometrics Technology Intresting PPT
 
Disobey 2024: Karri Huhtanen: Wi-Fi Roaming Security and Privacy
Disobey 2024: Karri Huhtanen: Wi-Fi Roaming Security and PrivacyDisobey 2024: Karri Huhtanen: Wi-Fi Roaming Security and Privacy
Disobey 2024: Karri Huhtanen: Wi-Fi Roaming Security and Privacy
 
DNS-OARC 42: Is the DNS ready for IPv6? presentation by Geoff Huston
DNS-OARC 42: Is the DNS ready for IPv6? presentation by Geoff HustonDNS-OARC 42: Is the DNS ready for IPv6? presentation by Geoff Huston
DNS-OARC 42: Is the DNS ready for IPv6? presentation by Geoff Huston
 
AWS Overview of AWS Clarify, Feature Store, Hyper parameter Tuning
AWS Overview of AWS  Clarify, Feature Store, Hyper parameter TuningAWS Overview of AWS  Clarify, Feature Store, Hyper parameter Tuning
AWS Overview of AWS Clarify, Feature Store, Hyper parameter Tuning
 
Regulation is Coming - Trusted Media Summit 2023
Regulation is Coming - Trusted Media Summit 2023Regulation is Coming - Trusted Media Summit 2023
Regulation is Coming - Trusted Media Summit 2023
 
Red shadows ringing in Japan's Cyberspace
Red shadows ringing in Japan's CyberspaceRed shadows ringing in Japan's Cyberspace
Red shadows ringing in Japan's Cyberspace
 

UiPath Document Understanding_Day 2.pptx

  • 1. UiPath Document Understanding Automation Technical Lead, Accelirate Process documents intelligently UiPath Document Understanding Process documents intelligently Day 2 DU Series VINOLIVAN NADAR Automation Technical Lead, Accelirate
  • 2. Agenda Quick Recap on DU basics DU Architecture DU Framework GenAI Capabilities Hands-on
  • 3. 3 Platform components Studio Robots Orchestrator AI Center Action Center • Pre-trained models available out of the box • Bring your own model – custom or 3rd party • Retrain the models • Core RPAtools • Human validation Automation Hub Process Mining Task Mining Studio Family Test Manager Chatbots Action Center Assistant DISCOVER ENGAGE BUILD Document Understanding Marketplace AI Center Orchestrator Apps Task Capture Insights MANAGE GOVERN MEASURE Robots RUN Integration Service
  • 4. What is Document Understanding Document Understanding Artificial Intelligence (AI) Document Processing Robotic Process Automation (RPA) Document understanding is the ability to extract and interpret information and meaning from a wide range of documents. It emerges at the intersection of document processing, AI, and RPA. Not OCR Not Computer Vision
  • 5. 5 Document Types • Required information found in the same place • Fixed in format and can contain handwriting, signatures, checkboxes​ • Like invoices, receipts, purchase orders, medical bills, utility bills • Containing fixed and variable parts like tables • No fixed format, free-form sentences/paragraphs • Like contracts, agreements, emails, scripts, drug prescriptions, news Structured documents Semi-structured documents Unstructured documents
  • 7. 7 Document Processing Approaches  Relies on ML models  Processes less structured varying layouts like invoices or receipts  Understands even unknown complex documents ǃ Requires pre-trained ML models with further retraining capabilities Model-based [template-less approach]  Relies on rules and templates  Processes fixed in format structured data like forms or licenses  High accuracy for already known documents ǃ Requires extra costs for addition of templates/rules and ongoing maintenance ǃ Doesn’t work with unknown documents Rule-based [template-based approach]
  • 8. 8 Document Understanding Framework Load Taxonomy Defines document types and fields Classify Document ML Model Keywords Extract Data from document ML Model Rule based Export Extracted data for further storage Validate Classification & Retraining Human Validate Data Extraction & Retraining Human Validation Needed Validation Needed Digitization Machine readable When is Validation Needed? Classification method cannot classify document definitively ML Model Predicts a low confidence Score Extracted Data violates a business rule or data check
  • 9. 9 Document Understanding Architecture UiPath Studio Process ERP Receipt Request Data 1 PO Data Post-Processing + Business Rules Extraction Method 1 ML Invoice AI Center Document Taxonomy Fields and Layout Semi-Structured Structured Capture Text + Metadata • UiPath or 3rd Party OCR Split the file into documents • Forward to optimal extraction method Identify / Extract defined fields • Rules/Templates - Structured • ML Based - Semi-structured HITL • Validation Station • Document SME corrects data Inbox Read documents via OCR Split & Classify Automated data entry Extraction Method 2 ML Receipt Extraction Method 3 Form Extractor Validated Data Human in the Loop Receipt Request Form Receipt Request Form Receipt Request Form ML Skill PO Highly variable PO Highly variable “Pre-Human” Validation • Performed on Extracted Data • Math / Rules / Matching to System of Record Invoice Highly variable Invoice Highly variable Invoice Data ML Package Training Data 3 2 Field 1 Schema DU ML Model Invoice Data Receipt Request Data 1 Invoice Invoice Data PO Data Invoice Data Invoice Data Invoice Data Attachments, Body, URL • Fax/scanning system, folder, queue Straight Through Processing
  • 10. 10 Load Taxonomy • Define the collection of documents that you would want to process. • Describe what data you would like to extract.
  • 11. 11 • Obtaining the machine-readable text from a given file, OCR • It detects all the words in the document and their x-y coordinates • It can also detect other things on documents, such as handwritten text, checkboxes, signatures, or barcodes/QR codes, depending on the OCR engine used. • Output is raw text and metadata about the text. Raw text can be used for GPT processing Digitization
  • 12. 12 • Identify the type of documents in case of a process having multiple document types • Different Classifiers • Keyword Classifier: Classifies based on the keywords defined (no intelligence) • Intelligent Keyword Classifier: Can split the document and classify them (intelligence) • Document Classifier/ML Classifier: Uses ML Model to classify the document Classification
  • 13. 13 • Extraction is getting just the data you're interested in. • Different Extractors • Regex Extractor • Form Extractor • Forms AI • Semi-structured AI Extraction
  • 14. 14 • Human in the loop for validation and handle low confidence documents • Validation can be done for • Classification • Extraction Validation Task Classification Task Extraction Task
  • 15. 15 GenAI Capabilities in DU - Labelling Uses GenAI Capabilities for Data labelling
  • 16. 16 GenAI Capabilities in DU – Extraction Using OpenAI Package Using Generate Text Completion Task by using Prompts and documentText from Digitization
  • 17. 17 SUCCESS STORY 7000 invoices processed monthly 45 seconds avg invoice processing time 160+ hours saved monthly 93%+ straight through processing • Required a custom "Bill of Lading" field to be trained • Starting with out-of-the-box ML model significantly reduced effort • 6 weeks development + 6 weeks model Training (in parallel with development) Fuel invoice processing Customer: Wholesale Club
  • 18. 18 Use Case Architecture Shared Inbox Download Invoice Upload to Sharepoint Dispatcher Queue ML Extractor PDF Splitter Validate Results Ifrules or confidence not meet? HiTL Reconciliation Queue Get Item & Download Digitize [OCR] Load Taxonomy Yes No Get Item From Reconciliation Queue Add records to Salesforce FS_Dispatcher FS_DU Performer FS_ProcessReconciliation
  • 20. 20 Implementation • Determine Document Types to be processed • Determine Classification Method (Keywords/ML Model) • Define Taxonomy for each document • Train the ML Data Extraction Model for each document • Validate Model Performance and Retrain as needed • Deploy to Production and monitor model performance • Continuously retrain model based on data collected from human validation

Editor's Notes

  1. Daniel to Talk through components – High Level
  2. Ahmed Little intro to Document Processing Hand Over to Daniel for More Color.
  3. Ahmed to Explain this flow.
  4. Ahmed to Explain this flow.
  5. Ahmed to Explain this flow.
  6. Ahmed to Explain this flow.
  7. Daniel
  8. Ahmed