SlideShare a Scribd company logo

Survey on Factuality in LLM's.pptx

A presentation of a paper which talks about the different facets of factuality in LLM's

1 of 9
Download to read offline
Survey on Factuality in
Large Language Models
NEETHA SHERRA
CMPE 297
What is Factuality in LLM’s?
Capacity to generate content aligned with factual information
Encompasses related issues such as hallucinations, outdated information and domain specificity
The factuality problem has profound effects on usability, societal dynamics and economic landscapes
It can have legal implications too
Factuality Evaluation Metrics
Rule based evaluation metrics
Neural evaluation metrics
Human evaluation metrics
LLM-based metrics
Analysis of Factuality
Knowledge storage
Knowledge awareness
Contextual influence and knowledge conflicts
Causes of Factual Errors
Model level causes
Retrieval level causes
Inference level causes
Enhancement of Factuality
On standalone LLM generation
On retrieval-augmented generation
Domain factuality enhanced LLM’s

Recommended

The impact of e-learning on organisations, individuals and the curriculum
The impact of e-learning on organisations, individuals and the curriculumThe impact of e-learning on organisations, individuals and the curriculum
The impact of e-learning on organisations, individuals and the curriculumgrainne
 
4 Realities: What does future Access to Education Look Like?
4 Realities: What does future Access to Education Look Like?4 Realities: What does future Access to Education Look Like?
4 Realities: What does future Access to Education Look Like?Bryan Alexander
 
Blackboard Connect 5 for K12
Blackboard Connect 5 for K12Blackboard Connect 5 for K12
Blackboard Connect 5 for K12Blackboard
 
DLFAN Public Jan 2012
DLFAN Public Jan 2012DLFAN Public Jan 2012
DLFAN Public Jan 2012EdAdvance
 
Wallpaper (poster) on the internationalization of e-Learning
Wallpaper (poster) on the internationalization of e-LearningWallpaper (poster) on the internationalization of e-Learning
Wallpaper (poster) on the internationalization of e-LearningRichter Thomas
 
A Multilingual Spam Reviews Detection Based on Pre-Trained Word Embedding and...
A Multilingual Spam Reviews Detection Based on Pre-Trained Word Embedding and...A Multilingual Spam Reviews Detection Based on Pre-Trained Word Embedding and...
A Multilingual Spam Reviews Detection Based on Pre-Trained Word Embedding and...Shakas Technologies
 
K-12 Leadership Roundtable: Communication
K-12 Leadership Roundtable: CommunicationK-12 Leadership Roundtable: Communication
K-12 Leadership Roundtable: CommunicationBlackboard
 

More Related Content

Similar to Survey on Factuality in LLM's.pptx

Trends in Personal Health Information Mgmt
Trends in Personal Health Information MgmtTrends in Personal Health Information Mgmt
Trends in Personal Health Information MgmtJohn Moore
 
Content management process on m-Agriculture platforms
Content management process on m-Agriculture platformsContent management process on m-Agriculture platforms
Content management process on m-Agriculture platformsILRI
 
Case Higher Education Online Advocacy with California State University
Case Higher Education Online Advocacy with California State UniversityCase Higher Education Online Advocacy with California State University
Case Higher Education Online Advocacy with California State Universitymcdavis7
 
Russell Stalters - #InfoGov17 Keynote - Change When The Stakes Are High (Lear...
Russell Stalters - #InfoGov17 Keynote - Change When The Stakes Are High (Lear...Russell Stalters - #InfoGov17 Keynote - Change When The Stakes Are High (Lear...
Russell Stalters - #InfoGov17 Keynote - Change When The Stakes Are High (Lear...ARMA International
 
Coordination Dynamics in Free/Libre and Open Source Software
Coordination Dynamics in Free/Libre and Open Source SoftwareCoordination Dynamics in Free/Libre and Open Source Software
Coordination Dynamics in Free/Libre and Open Source SoftwareAndrea Wiggins
 
Next Generation Learning and the Innovation Imperative
Next Generation Learning and the Innovation ImperativeNext Generation Learning and the Innovation Imperative
Next Generation Learning and the Innovation ImperativePostsecondaryImprovement
 
Ece 1 2 3 April 2009 Edition
Ece 1 2 3 April 2009 EditionEce 1 2 3 April 2009 Edition
Ece 1 2 3 April 2009 Editionjohnrudy2
 
ECE 1.0-2.0-3.0 April 2009 Edition
ECE 1.0-2.0-3.0 April 2009 EditionECE 1.0-2.0-3.0 April 2009 Edition
ECE 1.0-2.0-3.0 April 2009 Editiongarymr
 
ISM Conference 2008 Presentation
ISM Conference 2008 PresentationISM Conference 2008 Presentation
ISM Conference 2008 Presentationhigdonla
 
SOLAR - learning analytics, the state of the art
SOLAR - learning analytics, the state of the artSOLAR - learning analytics, the state of the art
SOLAR - learning analytics, the state of the artRebecca Ferguson
 
Trends, challenges and developments in technologies that will influence the f...
Trends, challenges and developments in technologies that will influence the f...Trends, challenges and developments in technologies that will influence the f...
Trends, challenges and developments in technologies that will influence the f...Jason Zagami
 
Ifpri gender work overview july 2010 revised final
Ifpri gender work overview july 2010 revised finalIfpri gender work overview july 2010 revised final
Ifpri gender work overview july 2010 revised finalIFPRI Gender
 
Measuring massive multitask language understanding
Measuring massive multitask language understandingMeasuring massive multitask language understanding
Measuring massive multitask language understandingSan Kim
 
Pre K 12 Ndlw Power Point Elluminate Monday
Pre K 12 Ndlw Power Point Elluminate MondayPre K 12 Ndlw Power Point Elluminate Monday
Pre K 12 Ndlw Power Point Elluminate Mondayvideoreg
 
Role of Emerging Technologies in keeping the Library current
Role of Emerging Technologies in keeping the Library currentRole of Emerging Technologies in keeping the Library current
Role of Emerging Technologies in keeping the Library currentHeather Lambert
 
Friends Only: Examining a Privacy-Enhancing Behavior in Facebook
Friends Only: Examining a Privacy-Enhancing Behavior in FacebookFriends Only: Examining a Privacy-Enhancing Behavior in Facebook
Friends Only: Examining a Privacy-Enhancing Behavior in FacebookFred Stutzman
 

Similar to Survey on Factuality in LLM's.pptx (20)

Trends in Personal Health Information Mgmt
Trends in Personal Health Information MgmtTrends in Personal Health Information Mgmt
Trends in Personal Health Information Mgmt
 
Content management process on m-Agriculture platforms
Content management process on m-Agriculture platformsContent management process on m-Agriculture platforms
Content management process on m-Agriculture platforms
 
Case Higher Education Online Advocacy with California State University
Case Higher Education Online Advocacy with California State UniversityCase Higher Education Online Advocacy with California State University
Case Higher Education Online Advocacy with California State University
 
DLFAN
DLFANDLFAN
DLFAN
 
Russell Stalters - #InfoGov17 Keynote - Change When The Stakes Are High (Lear...
Russell Stalters - #InfoGov17 Keynote - Change When The Stakes Are High (Lear...Russell Stalters - #InfoGov17 Keynote - Change When The Stakes Are High (Lear...
Russell Stalters - #InfoGov17 Keynote - Change When The Stakes Are High (Lear...
 
Coordination Dynamics in Free/Libre and Open Source Software
Coordination Dynamics in Free/Libre and Open Source SoftwareCoordination Dynamics in Free/Libre and Open Source Software
Coordination Dynamics in Free/Libre and Open Source Software
 
Next Generation Learning and the Innovation Imperative
Next Generation Learning and the Innovation ImperativeNext Generation Learning and the Innovation Imperative
Next Generation Learning and the Innovation Imperative
 
Ece 1 2 3 April 2009 Edition
Ece 1 2 3 April 2009 EditionEce 1 2 3 April 2009 Edition
Ece 1 2 3 April 2009 Edition
 
ECE 1.0-2.0-3.0 April 2009 Edition
ECE 1.0-2.0-3.0 April 2009 EditionECE 1.0-2.0-3.0 April 2009 Edition
ECE 1.0-2.0-3.0 April 2009 Edition
 
M agri pp.ficarelli vs.2.2
M agri pp.ficarelli vs.2.2M agri pp.ficarelli vs.2.2
M agri pp.ficarelli vs.2.2
 
ISM Conference 2008 Presentation
ISM Conference 2008 PresentationISM Conference 2008 Presentation
ISM Conference 2008 Presentation
 
Informs
InformsInforms
Informs
 
SOLAR - learning analytics, the state of the art
SOLAR - learning analytics, the state of the artSOLAR - learning analytics, the state of the art
SOLAR - learning analytics, the state of the art
 
Trends, challenges and developments in technologies that will influence the f...
Trends, challenges and developments in technologies that will influence the f...Trends, challenges and developments in technologies that will influence the f...
Trends, challenges and developments in technologies that will influence the f...
 
Ifpri gender work overview july 2010 revised final
Ifpri gender work overview july 2010 revised finalIfpri gender work overview july 2010 revised final
Ifpri gender work overview july 2010 revised final
 
Measuring massive multitask language understanding
Measuring massive multitask language understandingMeasuring massive multitask language understanding
Measuring massive multitask language understanding
 
Using Technology for Adolescent Research
Using Technology for Adolescent Research Using Technology for Adolescent Research
Using Technology for Adolescent Research
 
Pre K 12 Ndlw Power Point Elluminate Monday
Pre K 12 Ndlw Power Point Elluminate MondayPre K 12 Ndlw Power Point Elluminate Monday
Pre K 12 Ndlw Power Point Elluminate Monday
 
Role of Emerging Technologies in keeping the Library current
Role of Emerging Technologies in keeping the Library currentRole of Emerging Technologies in keeping the Library current
Role of Emerging Technologies in keeping the Library current
 
Friends Only: Examining a Privacy-Enhancing Behavior in Facebook
Friends Only: Examining a Privacy-Enhancing Behavior in FacebookFriends Only: Examining a Privacy-Enhancing Behavior in Facebook
Friends Only: Examining a Privacy-Enhancing Behavior in Facebook
 

Recently uploaded

A Gentle Introduction to Text Analysis :)
A Gentle Introduction to Text Analysis :)A Gentle Introduction to Text Analysis :)
A Gentle Introduction to Text Analysis :)UNCResearchHub
 
Tips to Align with Your Salesforce Data Goals
Tips to Align with Your Salesforce Data GoalsTips to Align with Your Salesforce Data Goals
Tips to Align with Your Salesforce Data GoalsDataArchiva
 
Ratio analysis, Formulas, Advantage PPt.pptx
Ratio analysis, Formulas, Advantage PPt.pptxRatio analysis, Formulas, Advantage PPt.pptx
Ratio analysis, Formulas, Advantage PPt.pptxSugumarVenkai
 
Customer Satisfaction Data - Multiple Linear Regression Model.pdf
Customer Satisfaction Data -  Multiple Linear Regression Model.pdfCustomer Satisfaction Data -  Multiple Linear Regression Model.pdf
Customer Satisfaction Data - Multiple Linear Regression Model.pdfruwanp2000
 
Artificial Intelligence for Vision: A walkthrough of recent breakthroughs
Artificial Intelligence for Vision:  A walkthrough of recent breakthroughsArtificial Intelligence for Vision:  A walkthrough of recent breakthroughs
Artificial Intelligence for Vision: A walkthrough of recent breakthroughsNikolas Markou
 
Basics of Creating Graphs / Charts using Microsoft Excel
Basics of Creating Graphs / Charts using Microsoft ExcelBasics of Creating Graphs / Charts using Microsoft Excel
Basics of Creating Graphs / Charts using Microsoft ExcelTope Osanyintuyi
 
EXCEL-VLOOKUP-AND-HLOOKUP LECTURE NOTES ALL EXCEL VLOOKUP NOTES PDF
EXCEL-VLOOKUP-AND-HLOOKUP LECTURE NOTES ALL EXCEL VLOOKUP NOTES PDFEXCEL-VLOOKUP-AND-HLOOKUP LECTURE NOTES ALL EXCEL VLOOKUP NOTES PDF
EXCEL-VLOOKUP-AND-HLOOKUP LECTURE NOTES ALL EXCEL VLOOKUP NOTES PDFProject Cubicle
 
Choose your perfect jacket.pdf
Choose your perfect jacket.pdfChoose your perfect jacket.pdf
Choose your perfect jacket.pdfAlexia Trejo
 
itc limited word file.pdf...............
itc limited word file.pdf...............itc limited word file.pdf...............
itc limited word file.pdf...............mahetamanav24
 
fundamentals of digital imaging - POONAM.pptx
fundamentals of digital imaging - POONAM.pptxfundamentals of digital imaging - POONAM.pptx
fundamentals of digital imaging - POONAM.pptxPoonamRijal
 
ISO 27701:2022 Data Privacy New Version Presentation
ISO 27701:2022 Data Privacy New Version PresentationISO 27701:2022 Data Privacy New Version Presentation
ISO 27701:2022 Data Privacy New Version Presentationyogaallworks
 
What you need to know about Generative AI and Data Management?
What you need to know about Generative AI and Data Management?What you need to know about Generative AI and Data Management?
What you need to know about Generative AI and Data Management?Denodo
 
Introduction to data science.pdf-Definition,types and application of Data Sci...
Introduction to data science.pdf-Definition,types and application of Data Sci...Introduction to data science.pdf-Definition,types and application of Data Sci...
Introduction to data science.pdf-Definition,types and application of Data Sci...DrSumathyV
 
Unlocking New Insights Into the World of European Soccer Through the European...
Unlocking New Insights Into the World of European Soccer Through the European...Unlocking New Insights Into the World of European Soccer Through the European...
Unlocking New Insights Into the World of European Soccer Through the European...ThinkInnovation
 
Operations Data On Mobile - inSis Mobile App - Sample Screens
Operations Data On Mobile - inSis Mobile App - Sample ScreensOperations Data On Mobile - inSis Mobile App - Sample Screens
Operations Data On Mobile - inSis Mobile App - Sample ScreensKondapi V Siva Rama Brahmam
 
Cousera Cap Course Datasets containing datasets from a Fictional Fitness Trac...
Cousera Cap Course Datasets containing datasets from a Fictional Fitness Trac...Cousera Cap Course Datasets containing datasets from a Fictional Fitness Trac...
Cousera Cap Course Datasets containing datasets from a Fictional Fitness Trac...Samuel Chukwuma
 

Recently uploaded (17)

A Gentle Introduction to Text Analysis :)
A Gentle Introduction to Text Analysis :)A Gentle Introduction to Text Analysis :)
A Gentle Introduction to Text Analysis :)
 
Tips to Align with Your Salesforce Data Goals
Tips to Align with Your Salesforce Data GoalsTips to Align with Your Salesforce Data Goals
Tips to Align with Your Salesforce Data Goals
 
Ratio analysis, Formulas, Advantage PPt.pptx
Ratio analysis, Formulas, Advantage PPt.pptxRatio analysis, Formulas, Advantage PPt.pptx
Ratio analysis, Formulas, Advantage PPt.pptx
 
Electricity Year 2023_updated_22022024.pptx
Electricity Year 2023_updated_22022024.pptxElectricity Year 2023_updated_22022024.pptx
Electricity Year 2023_updated_22022024.pptx
 
Customer Satisfaction Data - Multiple Linear Regression Model.pdf
Customer Satisfaction Data -  Multiple Linear Regression Model.pdfCustomer Satisfaction Data -  Multiple Linear Regression Model.pdf
Customer Satisfaction Data - Multiple Linear Regression Model.pdf
 
Artificial Intelligence for Vision: A walkthrough of recent breakthroughs
Artificial Intelligence for Vision:  A walkthrough of recent breakthroughsArtificial Intelligence for Vision:  A walkthrough of recent breakthroughs
Artificial Intelligence for Vision: A walkthrough of recent breakthroughs
 
Basics of Creating Graphs / Charts using Microsoft Excel
Basics of Creating Graphs / Charts using Microsoft ExcelBasics of Creating Graphs / Charts using Microsoft Excel
Basics of Creating Graphs / Charts using Microsoft Excel
 
EXCEL-VLOOKUP-AND-HLOOKUP LECTURE NOTES ALL EXCEL VLOOKUP NOTES PDF
EXCEL-VLOOKUP-AND-HLOOKUP LECTURE NOTES ALL EXCEL VLOOKUP NOTES PDFEXCEL-VLOOKUP-AND-HLOOKUP LECTURE NOTES ALL EXCEL VLOOKUP NOTES PDF
EXCEL-VLOOKUP-AND-HLOOKUP LECTURE NOTES ALL EXCEL VLOOKUP NOTES PDF
 
Choose your perfect jacket.pdf
Choose your perfect jacket.pdfChoose your perfect jacket.pdf
Choose your perfect jacket.pdf
 
itc limited word file.pdf...............
itc limited word file.pdf...............itc limited word file.pdf...............
itc limited word file.pdf...............
 
fundamentals of digital imaging - POONAM.pptx
fundamentals of digital imaging - POONAM.pptxfundamentals of digital imaging - POONAM.pptx
fundamentals of digital imaging - POONAM.pptx
 
ISO 27701:2022 Data Privacy New Version Presentation
ISO 27701:2022 Data Privacy New Version PresentationISO 27701:2022 Data Privacy New Version Presentation
ISO 27701:2022 Data Privacy New Version Presentation
 
What you need to know about Generative AI and Data Management?
What you need to know about Generative AI and Data Management?What you need to know about Generative AI and Data Management?
What you need to know about Generative AI and Data Management?
 
Introduction to data science.pdf-Definition,types and application of Data Sci...
Introduction to data science.pdf-Definition,types and application of Data Sci...Introduction to data science.pdf-Definition,types and application of Data Sci...
Introduction to data science.pdf-Definition,types and application of Data Sci...
 
Unlocking New Insights Into the World of European Soccer Through the European...
Unlocking New Insights Into the World of European Soccer Through the European...Unlocking New Insights Into the World of European Soccer Through the European...
Unlocking New Insights Into the World of European Soccer Through the European...
 
Operations Data On Mobile - inSis Mobile App - Sample Screens
Operations Data On Mobile - inSis Mobile App - Sample ScreensOperations Data On Mobile - inSis Mobile App - Sample Screens
Operations Data On Mobile - inSis Mobile App - Sample Screens
 
Cousera Cap Course Datasets containing datasets from a Fictional Fitness Trac...
Cousera Cap Course Datasets containing datasets from a Fictional Fitness Trac...Cousera Cap Course Datasets containing datasets from a Fictional Fitness Trac...
Cousera Cap Course Datasets containing datasets from a Fictional Fitness Trac...
 

Survey on Factuality in LLM's.pptx