SlideShare a Scribd company logo
1 of 23
Download to read offline
ABOUT ME
Names: Pan Singh Dhoni
Work: Data & AI Expert, Independent
Researcher, Judge, Speaker, and thought
leader
Email ID: ps.dhoni@gmail.com
AGENDA
• WILL UNDERSTAND DATA AND ANALYTICS
TERMINOLOGY
• ARCHITECTURE: ENTERPRISE DATA
PLATFORM
• GENERATIVE AI, AND LARGE LANGUAGE
MODEL (LLM) INTRODUCTION
• MODEL SELECTION APPROACH, MODEL
FINE TUNING
• DATA ANALYSIS USING AI: GRAPH,
CHARTS, AND REPORTS GENERATION
USING AI
• DEVELOPER PRODUCTIVITY USING AI
• IMAGE PROCESSING USING GENERATIVE AI
• BUSINESS USE CASES FOR RETAIL
• AI: HANDLING RISKS AND CHALLENGES
2
Modernizing Data And Analytics using AI
3
DATA AND ANALYTICS TERMINOLOGY
• Ingestion, queue, ETL, Data Modeling, aggregation, data
engineering, Data Analytics, DQ, business partners, Analyst,
platform etc.
• Business Intelligence: Insight from the data in the form of reports,
Dashboards, and trends
• Machine Learning/ AI: Forecasting, Digital marketing, Revenue
growth
4
ENTERPRISE DATA PLATFORM
Bronze Gold
Data Quality
-Validation,
rules, prevention
Data Governance
- policies
- standards
Data Security
- Identity
- Access
ML/ AI
Vendors/
Apps
System of
Records 1
System of
Records n
.
.
.
Integra
tion
Layer
CDP
Business
partners
Business
use cases
Silver
Semantic Layer
Presentation Layer
5
A R T I F I C I A L I N T E L L I G E N C E ( A I )
AI is not a novel concept; it has been around for a long time, but major changes
have occurred on the infrastructure side with resources such as machines ranging
from CPUs and GPUs to TPUs becoming widely available. The major change is that
it is now widely accessible to small industries and the common man. The recent
surge in interest in OpenAI has proven this theory. The use cases remain the same;
the only change is in how to automate these use cases for industries of all sizes to
serve the common man.
6
Waterfall
Iterative
Agile
Primary Goal, time to Market Product
7
E N T E R P R I S E D A T A P L A T F O R M W I T H A I C A P A B I L I T I E S
Staging Layer
Data Serving
Layer
BI
ML/ AI
Vendors/
Apps
System of
Records 1
System of
Records n
.
.
.
Integra
tion
Layer
CDP
Business
partners
Business
partners/
decision Makers
Generative AI/ AI for better productivity & metrics
Data Quality
-Validation,
rules, prevention
Data Governance
- policies
- standards
Data Security
- Identity
- Access
Business
use cases
Smart
Ingestion
Smart
ETL
Smart
DQ, Data
Gov. &
Security
Smart
BI
Smart
Data
Model
Smart
Market
ing
8
GENERATIVE AI
LLM LIM Multimodal
Generative
AI
9
LLM MODELS
• Translate text into other languages
• Improve customer experience with chatbots and AI assistants
• Organize and classify customer feedback to the right departments
• Summarize large documents, such as earnings calls and legal
documents
• Create new marketing content
• Generate software code from natural language
Large language models (LLMs) are machine learning models that are very effective
at performing language-related tasks
GPT family of models (e.g., ChatGPT), BERT, Llama, MPT and Anthropic.
10
M O D E L S E L E C T I O N : O P E N S O U R C E O R P R O P R I E T A R Y
Assess model based on Privacy, Quality, Cost and Latency
Open-Source Models
• Use as off-the-shelf or fine tune
• provides flexibility for customizations
• can be smaller in size to save cost
• commercial / non-commercial use
Examples: LLaMA/ mosai etc.
Pros: Development is slow
Cons: Cost is low, no vendor lock-in
Proprietary (Paid) Models
• Usually offered as LLMs-as-a-service
• Some can be fine-tuned
• Restrictive licenses for usage and
modification
Examples: OpenAI, ChatGPT
Pros: Development is fast, quality will be better
Cons: Cost is high, Vendor lock-in, Data privacy/
Security
11
D O M A I N S P E C I F I C : F I N E T U N I N G
Company data
Schema, NRF
Data Schema
Retail Domain
Foundation Model
12
M O D E L T R A I N I N G : S C H E M A I N F O R M A T I O N
LLM Model
Database
Emp
(name
str (20),
age int
(5) …)
Send Schema to LLM model,
using prompt
13
B U S I N E S S V A L U E : R E T R I E V E V A L U A B L E I N F O R M A T I O N
Prompt to LLM
English Prompt
SQL Query
SQL Execution
Result Set
14
D A T A A N A L Y S I S / A N A L Y S T / B I
LLM Model
UI
Prompt to LLM
English Prompt
SQL Query
SQL Execution
Result Set
DB or Delta lake or S3 etc.
15
DEVELOPER ASSISTANCE
LLM Model
Editor
Code to LLM
Code
Result Set
Code correction
16
I M A G E P R O C E S S I N G U S I N G G E N A I
17
Parameter/Metric Non-Local Means Denoising CNN trained for Image Denoising Conclusion
Accuracy (MSE) / PSNR MSE = 15.0 PSNR = 18 dB (inversely related to MSE) The generative method (CNN)
outperforms the traditional method
(NLM) in terms of accuracy.
Processing Time 25 seconds in hours (training time): Very First Time The traditional method is significantly
faster for inference, while the generative
model requires more time for training.
Generalization Moderate High The generative model demonstrates
better generalization capabilities.
Interpretability High Not as high due to the inherent
complexity of CNNs.
Traditional methods tend to be more
interpretable.
18
GENERATIVE AI BENEFITS ACROSS INDUSTRY
Retail Auto Medical
Image
Forensics Image
Synthesis
19
FEW RETAIL USE CASES
• Business partners
• Inventory optimization
• Store employee performance improvement
• Theft protection
• Revenue increase (targeted marketing,
customer satisfaction)
20
ADDRESS ETHICAL ISSUES
Data Bias:
➢ Assess data slices -> update data
➢ Regulation
Toxic, discriminatory, exclusive model, Mis-information hazard:
➢ Assess data slices -> update data
➢ curate data for fine tuning
➢ Regulation
21
ADDRESS ETHICAL ISSUES
✓ Ensure proper data anonymization, encryption, and access controls
✓ Implement safeguards to access or disclosure of sensitive data during training/storage/inferences
✓ Establish data and model governance; version control, monitoring, auditing, data usage policy etc.
Ask question with vendors:
✓ will data will be shared with third party
✓ do you have data lineage that enables you to delete data from varios storage parts.
✓ history stored , is that secure?
22
REFERENCES
Google Scholar (Pan Singh Dhoni):
https://scholar.google.com/citations?user=PnVDB6MAAAAJ&hl=en
https://figshare.com/authors/Pan_Dhoni/16388907
1. https://docs.databricks.com/en/generative-ai/generative-ai.html
2. Synergizing Generative Artificial Intelligence and Cybersecurity: Roles of Generative Artificial Intelligence
Entities, Companies, Agencies and Government in Enhancing: Journal of Global Research in Computer
Sciences 14 (3), 16, 2023
3. Synergy in Technology How Generative AI Augments the Capabilities of Customer Data Platforms: Journal
of Mathematical Techniques and Computational Mathematics 2 (9), 396, 2023.
4. Synergizing Generative AI and Cybersecurity: Roles of Generative AI Entities, Companies, Agencies, and
Government in Enhancing Cybersecurity: TechRxiv
5. A cost-effective IT approach to rapidly build a data platform and integrate retail applications for small and
mid-size companies: TechRxiv
6. Exploring the Synergy between Generative AI, Data and Analytics in the Modern Age: TechRxiv
7. Enhancing Data Quality through Generative AI: An Empirical Study with Data: TechRxiv
8. Represented Advantages of generative AI in Image Processing paper at ICAAAIML-2023, SHARDA
UNIVERSITY
9. From Data to Decisions: Enhancing Retail with AI and Machine Learning, International Journal of
Computing and Engineering 5(1), 38-51, 2024.
10. https://docs.databricks.com/en/generative-ai/generative-ai.html
11. https://arxiv.org/abs/2303.08774
THANK YOU
Pan Singh Dhoni
ps.dhoni@gmail.com
https://www.linkedin.com/in/pandhoni/
8/06/20XX PITCH DECK 23

More Related Content

What's hot

Kelly Dowd - Leading Digital Transformation with AI and Human-Centered Design...
Kelly Dowd - Leading Digital Transformation with AI and Human-Centered Design...Kelly Dowd - Leading Digital Transformation with AI and Human-Centered Design...
Kelly Dowd - Leading Digital Transformation with AI and Human-Centered Design...SOLTUIONSpeople, THINKubators, THINKathons
 
Neha Shukla - Future of the AI Revolution - Building Ethical and Equitable T...
 Neha Shukla - Future of the AI Revolution - Building Ethical and Equitable T... Neha Shukla - Future of the AI Revolution - Building Ethical and Equitable T...
Neha Shukla - Future of the AI Revolution - Building Ethical and Equitable T...SOLTUIONSpeople, THINKubators, THINKathons
 
Leveraging Generative AI: Opportunities, Risks and Best Practices
Leveraging Generative AI: Opportunities, Risks and Best Practices Leveraging Generative AI: Opportunities, Risks and Best Practices
Leveraging Generative AI: Opportunities, Risks and Best Practices Social Samosa
 
Jordan Wilson - Expert Chats Train ChatGPT to be your employee with the PPP m...
Jordan Wilson - Expert Chats Train ChatGPT to be your employee with the PPP m...Jordan Wilson - Expert Chats Train ChatGPT to be your employee with the PPP m...
Jordan Wilson - Expert Chats Train ChatGPT to be your employee with the PPP m...SOLTUIONSpeople, THINKubators, THINKathons
 
Introduction to AI with Business Use Cases
Introduction to AI with Business Use CasesIntroduction to AI with Business Use Cases
Introduction to AI with Business Use CasesJack C Crawford
 

What's hot (20)

Kai Wang - AI for Innovation1.1r.pdf
Kai Wang - AI for Innovation1.1r.pdfKai Wang - AI for Innovation1.1r.pdf
Kai Wang - AI for Innovation1.1r.pdf
 
Kelly Dowd - Leading Digital Transformation with AI and Human-Centered Design...
Kelly Dowd - Leading Digital Transformation with AI and Human-Centered Design...Kelly Dowd - Leading Digital Transformation with AI and Human-Centered Design...
Kelly Dowd - Leading Digital Transformation with AI and Human-Centered Design...
 
Nils Vesk - Building an Innovative, Productive, AI empowered Culture.pdf
Nils Vesk - Building an Innovative, Productive, AI empowered Culture.pdfNils Vesk - Building an Innovative, Productive, AI empowered Culture.pdf
Nils Vesk - Building an Innovative, Productive, AI empowered Culture.pdf
 
Amir Feizpour - Knowledge-Ops and LLMs.pdf
Amir Feizpour - Knowledge-Ops and LLMs.pdfAmir Feizpour - Knowledge-Ops and LLMs.pdf
Amir Feizpour - Knowledge-Ops and LLMs.pdf
 
Dr. Nassim Belbaly - Decision Markin pai summit 3v2.pdf
Dr. Nassim Belbaly - Decision Markin pai summit 3v2.pdfDr. Nassim Belbaly - Decision Markin pai summit 3v2.pdf
Dr. Nassim Belbaly - Decision Markin pai summit 3v2.pdf
 
Marv Wexler - Transform Your with AI.pdf
Marv Wexler - Transform Your with AI.pdfMarv Wexler - Transform Your with AI.pdf
Marv Wexler - Transform Your with AI.pdf
 
Matt Lewis - The Hardest Thing-Final to Host.pdf
Matt Lewis - The Hardest Thing-Final to Host.pdfMatt Lewis - The Hardest Thing-Final to Host.pdf
Matt Lewis - The Hardest Thing-Final to Host.pdf
 
Neha Shukla - Future of the AI Revolution - Building Ethical and Equitable T...
 Neha Shukla - Future of the AI Revolution - Building Ethical and Equitable T... Neha Shukla - Future of the AI Revolution - Building Ethical and Equitable T...
Neha Shukla - Future of the AI Revolution - Building Ethical and Equitable T...
 
Jordan Wilson - Genius ChatGPT Tactis.pdf
Jordan Wilson - Genius ChatGPT Tactis.pdfJordan Wilson - Genius ChatGPT Tactis.pdf
Jordan Wilson - Genius ChatGPT Tactis.pdf
 
Terry Proto - AI Accelerates XR.pdf
Terry Proto - AI Accelerates XR.pdfTerry Proto - AI Accelerates XR.pdf
Terry Proto - AI Accelerates XR.pdf
 
Steve Cunningham - AI Innovation Summit.pdf
Steve Cunningham - AI Innovation Summit.pdfSteve Cunningham - AI Innovation Summit.pdf
Steve Cunningham - AI Innovation Summit.pdf
 
Carol Scott - Fast Track Your AI Journey.pdf
Carol Scott - Fast Track  Your AI Journey.pdfCarol Scott - Fast Track  Your AI Journey.pdf
Carol Scott - Fast Track Your AI Journey.pdf
 
Maisa Penha - Art of Possible.pdf
Maisa Penha - Art of Possible.pdfMaisa Penha - Art of Possible.pdf
Maisa Penha - Art of Possible.pdf
 
Tojin Eapen - Augmenting Creativity Using Gen AI.pdf
Tojin Eapen - Augmenting Creativity Using Gen AI.pdfTojin Eapen - Augmenting Creativity Using Gen AI.pdf
Tojin Eapen - Augmenting Creativity Using Gen AI.pdf
 
George Pace - Keeping Pace with ChatGPT.pdf
George Pace - Keeping Pace with ChatGPT.pdfGeorge Pace - Keeping Pace with ChatGPT.pdf
George Pace - Keeping Pace with ChatGPT.pdf
 
Leveraging Generative AI: Opportunities, Risks and Best Practices
Leveraging Generative AI: Opportunities, Risks and Best Practices Leveraging Generative AI: Opportunities, Risks and Best Practices
Leveraging Generative AI: Opportunities, Risks and Best Practices
 
Jordan Wilson - Expert Chats Train ChatGPT to be your employee with the PPP m...
Jordan Wilson - Expert Chats Train ChatGPT to be your employee with the PPP m...Jordan Wilson - Expert Chats Train ChatGPT to be your employee with the PPP m...
Jordan Wilson - Expert Chats Train ChatGPT to be your employee with the PPP m...
 
Introduction to AI with Business Use Cases
Introduction to AI with Business Use CasesIntroduction to AI with Business Use Cases
Introduction to AI with Business Use Cases
 
Jim Lecinski - Capturing the Power of AI in Marketing.pdf
Jim Lecinski - Capturing the Power of AI in Marketing.pdfJim Lecinski - Capturing the Power of AI in Marketing.pdf
Jim Lecinski - Capturing the Power of AI in Marketing.pdf
 
Future of conversational AI
Future of conversational AIFuture of conversational AI
Future of conversational AI
 

Similar to Pan Dhoni - Modernizing Data And Analytics using AI.pdf

DataOps - Big Data and AI World London - March 2020 - Harvinder Atwal
DataOps - Big Data and AI World London - March 2020 - Harvinder AtwalDataOps - Big Data and AI World London - March 2020 - Harvinder Atwal
DataOps - Big Data and AI World London - March 2020 - Harvinder AtwalHarvinder Atwal
 
How to analyze text data for AI and ML with Named Entity Recognition
How to analyze text data for AI and ML with Named Entity RecognitionHow to analyze text data for AI and ML with Named Entity Recognition
How to analyze text data for AI and ML with Named Entity RecognitionSkyl.ai
 
Entry Points – How to Get Rolling with Big Data Analytics
Entry Points – How to Get Rolling with Big Data AnalyticsEntry Points – How to Get Rolling with Big Data Analytics
Entry Points – How to Get Rolling with Big Data AnalyticsInside Analysis
 
Data - Science and Engineering slide at Bandungpy Sharing Session
Data - Science and Engineering slide at Bandungpy Sharing SessionData - Science and Engineering slide at Bandungpy Sharing Session
Data - Science and Engineering slide at Bandungpy Sharing SessionHendri Karisma
 
The Simple 5-Step Process for Creating a Winning Data Pipeline.pdf
The Simple 5-Step Process for Creating a Winning Data Pipeline.pdfThe Simple 5-Step Process for Creating a Winning Data Pipeline.pdf
The Simple 5-Step Process for Creating a Winning Data Pipeline.pdfData Science Council of America
 
Advanced Analytics and Machine Learning with Data Virtualization
Advanced Analytics and Machine Learning with Data VirtualizationAdvanced Analytics and Machine Learning with Data Virtualization
Advanced Analytics and Machine Learning with Data VirtualizationDenodo
 
Big Data Driven Solutions to Combat Covid' 19
Big Data Driven Solutions to Combat Covid' 19Big Data Driven Solutions to Combat Covid' 19
Big Data Driven Solutions to Combat Covid' 19Prof.Balakrishnan S
 
02 a holistic approach to big data
02 a holistic approach to big data02 a holistic approach to big data
02 a holistic approach to big dataRaul Chong
 
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...Aggregage
 
Building the Artificially Intelligent Enterprise
Building the Artificially Intelligent EnterpriseBuilding the Artificially Intelligent Enterprise
Building the Artificially Intelligent EnterpriseDatabricks
 
Global Big Data Conference Hyderabad-2Aug2013- Finance/Manufacturing Use Cases
Global Big Data Conference Hyderabad-2Aug2013- Finance/Manufacturing Use CasesGlobal Big Data Conference Hyderabad-2Aug2013- Finance/Manufacturing Use Cases
Global Big Data Conference Hyderabad-2Aug2013- Finance/Manufacturing Use CasesSanjay Sharma
 
Data Analytics Today - Data, Tech, and Regulation.pdf
Data Analytics Today - Data, Tech, and Regulation.pdfData Analytics Today - Data, Tech, and Regulation.pdf
Data Analytics Today - Data, Tech, and Regulation.pdfHendri Karisma
 
Biz Nova It Project Bonus Slides
Biz Nova It Project Bonus SlidesBiz Nova It Project Bonus Slides
Biz Nova It Project Bonus SlidesTyHowardPMP
 
Building the Cognitive Era : Big Data Strategies
Building the Cognitive Era : Big Data StrategiesBuilding the Cognitive Era : Big Data Strategies
Building the Cognitive Era : Big Data StrategiesKevin Sigliano
 
Agile Mumbai 2022 - Balvinder Kaur & Sushant Joshi | Real-Time Insights and A...
Agile Mumbai 2022 - Balvinder Kaur & Sushant Joshi | Real-Time Insights and A...Agile Mumbai 2022 - Balvinder Kaur & Sushant Joshi | Real-Time Insights and A...
Agile Mumbai 2022 - Balvinder Kaur & Sushant Joshi | Real-Time Insights and A...AgileNetwork
 
Big Data & Analytics, Peter Jönsson
Big Data & Analytics, Peter JönssonBig Data & Analytics, Peter Jönsson
Big Data & Analytics, Peter JönssonIBM Danmark
 
Gse uk-cedrinemadera-2018-shared
Gse uk-cedrinemadera-2018-sharedGse uk-cedrinemadera-2018-shared
Gse uk-cedrinemadera-2018-sharedcedrinemadera
 

Similar to Pan Dhoni - Modernizing Data And Analytics using AI.pdf (20)

DataOps - Big Data and AI World London - March 2020 - Harvinder Atwal
DataOps - Big Data and AI World London - March 2020 - Harvinder AtwalDataOps - Big Data and AI World London - March 2020 - Harvinder Atwal
DataOps - Big Data and AI World London - March 2020 - Harvinder Atwal
 
Evolve18 | Klassjan Tukker | Adobe Cloud Platform: The heart of Adobe Experie...
Evolve18 | Klassjan Tukker | Adobe Cloud Platform: The heart of Adobe Experie...Evolve18 | Klassjan Tukker | Adobe Cloud Platform: The heart of Adobe Experie...
Evolve18 | Klassjan Tukker | Adobe Cloud Platform: The heart of Adobe Experie...
 
How to analyze text data for AI and ML with Named Entity Recognition
How to analyze text data for AI and ML with Named Entity RecognitionHow to analyze text data for AI and ML with Named Entity Recognition
How to analyze text data for AI and ML with Named Entity Recognition
 
Entry Points – How to Get Rolling with Big Data Analytics
Entry Points – How to Get Rolling with Big Data AnalyticsEntry Points – How to Get Rolling with Big Data Analytics
Entry Points – How to Get Rolling with Big Data Analytics
 
Data - Science and Engineering slide at Bandungpy Sharing Session
Data - Science and Engineering slide at Bandungpy Sharing SessionData - Science and Engineering slide at Bandungpy Sharing Session
Data - Science and Engineering slide at Bandungpy Sharing Session
 
The Simple 5-Step Process for Creating a Winning Data Pipeline.pdf
The Simple 5-Step Process for Creating a Winning Data Pipeline.pdfThe Simple 5-Step Process for Creating a Winning Data Pipeline.pdf
The Simple 5-Step Process for Creating a Winning Data Pipeline.pdf
 
Advanced Analytics and Machine Learning with Data Virtualization
Advanced Analytics and Machine Learning with Data VirtualizationAdvanced Analytics and Machine Learning with Data Virtualization
Advanced Analytics and Machine Learning with Data Virtualization
 
Big Data Driven Solutions to Combat Covid' 19
Big Data Driven Solutions to Combat Covid' 19Big Data Driven Solutions to Combat Covid' 19
Big Data Driven Solutions to Combat Covid' 19
 
02 a holistic approach to big data
02 a holistic approach to big data02 a holistic approach to big data
02 a holistic approach to big data
 
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
 
Building the Artificially Intelligent Enterprise
Building the Artificially Intelligent EnterpriseBuilding the Artificially Intelligent Enterprise
Building the Artificially Intelligent Enterprise
 
Global Big Data Conference Hyderabad-2Aug2013- Finance/Manufacturing Use Cases
Global Big Data Conference Hyderabad-2Aug2013- Finance/Manufacturing Use CasesGlobal Big Data Conference Hyderabad-2Aug2013- Finance/Manufacturing Use Cases
Global Big Data Conference Hyderabad-2Aug2013- Finance/Manufacturing Use Cases
 
Data Analytics Today - Data, Tech, and Regulation.pdf
Data Analytics Today - Data, Tech, and Regulation.pdfData Analytics Today - Data, Tech, and Regulation.pdf
Data Analytics Today - Data, Tech, and Regulation.pdf
 
Biz Nova It Project Bonus Slides
Biz Nova It Project Bonus SlidesBiz Nova It Project Bonus Slides
Biz Nova It Project Bonus Slides
 
Building the Cognitive Era : Big Data Strategies
Building the Cognitive Era : Big Data StrategiesBuilding the Cognitive Era : Big Data Strategies
Building the Cognitive Era : Big Data Strategies
 
Agile Mumbai 2022 - Balvinder Kaur & Sushant Joshi | Real-Time Insights and A...
Agile Mumbai 2022 - Balvinder Kaur & Sushant Joshi | Real-Time Insights and A...Agile Mumbai 2022 - Balvinder Kaur & Sushant Joshi | Real-Time Insights and A...
Agile Mumbai 2022 - Balvinder Kaur & Sushant Joshi | Real-Time Insights and A...
 
Big Data & Analytics, Peter Jönsson
Big Data & Analytics, Peter JönssonBig Data & Analytics, Peter Jönsson
Big Data & Analytics, Peter Jönsson
 
Big Data Analytics
Big Data AnalyticsBig Data Analytics
Big Data Analytics
 
Gse uk-cedrinemadera-2018-shared
Gse uk-cedrinemadera-2018-sharedGse uk-cedrinemadera-2018-shared
Gse uk-cedrinemadera-2018-shared
 
Data Science and Analytics
Data Science and Analytics Data Science and Analytics
Data Science and Analytics
 

More from SOLTUIONSpeople, THINKubators, THINKathons (8)

Martez Knox - How AI is Redefining the Cannabis Industry (Final) (2).pdf
Martez Knox - How AI is Redefining the Cannabis Industry (Final) (2).pdfMartez Knox - How AI is Redefining the Cannabis Industry (Final) (2).pdf
Martez Knox - How AI is Redefining the Cannabis Industry (Final) (2).pdf
 
Theresa Fesinstine - AI Forward.pdf
Theresa Fesinstine - AI Forward.pdfTheresa Fesinstine - AI Forward.pdf
Theresa Fesinstine - AI Forward.pdf
 
James Feldman - AII Powered Business Tools.pdf
James Feldman - AII Powered Business Tools.pdfJames Feldman - AII Powered Business Tools.pdf
James Feldman - AII Powered Business Tools.pdf
 
Andy Roy - Conversational AI - Why We Must Build.pdf
Andy Roy - Conversational AI - Why We Must Build.pdfAndy Roy - Conversational AI - Why We Must Build.pdf
Andy Roy - Conversational AI - Why We Must Build.pdf
 
Ben Bressington - Buy Back Your Time and Increase Profits - 1 AI Strategy You...
Ben Bressington - Buy Back Your Time and Increase Profits - 1 AI Strategy You...Ben Bressington - Buy Back Your Time and Increase Profits - 1 AI Strategy You...
Ben Bressington - Buy Back Your Time and Increase Profits - 1 AI Strategy You...
 
Bryan Mattimore - AI Ideation and TIE.pdf
Bryan Mattimore - AI Ideation and TIE.pdfBryan Mattimore - AI Ideation and TIE.pdf
Bryan Mattimore - AI Ideation and TIE.pdf
 
Tom Nodine - How AI Helps Us Live Longer.pdf
Tom Nodine - How AI Helps Us Live Longer.pdfTom Nodine - How AI Helps Us Live Longer.pdf
Tom Nodine - How AI Helps Us Live Longer.pdf
 
Josh Cavalier - ChatGPT Prompt Strategies.pdf
Josh Cavalier - ChatGPT Prompt Strategies.pdfJosh Cavalier - ChatGPT Prompt Strategies.pdf
Josh Cavalier - ChatGPT Prompt Strategies.pdf
 

Recently uploaded

Ten Organizational Design Models to align structure and operations to busines...
Ten Organizational Design Models to align structure and operations to busines...Ten Organizational Design Models to align structure and operations to busines...
Ten Organizational Design Models to align structure and operations to busines...Seta Wicaksana
 
Innovation Conference 5th March 2024.pdf
Innovation Conference 5th March 2024.pdfInnovation Conference 5th March 2024.pdf
Innovation Conference 5th March 2024.pdfrichard876048
 
8447779800, Low rate Call girls in Saket Delhi NCR
8447779800, Low rate Call girls in Saket Delhi NCR8447779800, Low rate Call girls in Saket Delhi NCR
8447779800, Low rate Call girls in Saket Delhi NCRashishs7044
 
20200128 Ethical by Design - Whitepaper.pdf
20200128 Ethical by Design - Whitepaper.pdf20200128 Ethical by Design - Whitepaper.pdf
20200128 Ethical by Design - Whitepaper.pdfChris Skinner
 
Intermediate Accounting, Volume 2, 13th Canadian Edition by Donald E. Kieso t...
Intermediate Accounting, Volume 2, 13th Canadian Edition by Donald E. Kieso t...Intermediate Accounting, Volume 2, 13th Canadian Edition by Donald E. Kieso t...
Intermediate Accounting, Volume 2, 13th Canadian Edition by Donald E. Kieso t...ssuserf63bd7
 
NAB Show Exhibitor List 2024 - Exhibitors Data
NAB Show Exhibitor List 2024 - Exhibitors DataNAB Show Exhibitor List 2024 - Exhibitors Data
NAB Show Exhibitor List 2024 - Exhibitors DataExhibitors Data
 
Send Files | Sendbig.comSend Files | Sendbig.com
Send Files | Sendbig.comSend Files | Sendbig.comSend Files | Sendbig.comSend Files | Sendbig.com
Send Files | Sendbig.comSend Files | Sendbig.comSendBig4
 
Onemonitar Android Spy App Features: Explore Advanced Monitoring Capabilities
Onemonitar Android Spy App Features: Explore Advanced Monitoring CapabilitiesOnemonitar Android Spy App Features: Explore Advanced Monitoring Capabilities
Onemonitar Android Spy App Features: Explore Advanced Monitoring CapabilitiesOne Monitar
 
Pitch Deck Teardown: Geodesic.Life's $500k Pre-seed deck
Pitch Deck Teardown: Geodesic.Life's $500k Pre-seed deckPitch Deck Teardown: Geodesic.Life's $500k Pre-seed deck
Pitch Deck Teardown: Geodesic.Life's $500k Pre-seed deckHajeJanKamps
 
Flow Your Strategy at Flight Levels Day 2024
Flow Your Strategy at Flight Levels Day 2024Flow Your Strategy at Flight Levels Day 2024
Flow Your Strategy at Flight Levels Day 2024Kirill Klimov
 
Healthcare Feb. & Mar. Healthcare Newsletter
Healthcare Feb. & Mar. Healthcare NewsletterHealthcare Feb. & Mar. Healthcare Newsletter
Healthcare Feb. & Mar. Healthcare NewsletterJamesConcepcion7
 
APRIL2024_UKRAINE_xml_0000000000000 .pdf
APRIL2024_UKRAINE_xml_0000000000000 .pdfAPRIL2024_UKRAINE_xml_0000000000000 .pdf
APRIL2024_UKRAINE_xml_0000000000000 .pdfRbc Rbcua
 
8447779800, Low rate Call girls in Shivaji Enclave Delhi NCR
8447779800, Low rate Call girls in Shivaji Enclave Delhi NCR8447779800, Low rate Call girls in Shivaji Enclave Delhi NCR
8447779800, Low rate Call girls in Shivaji Enclave Delhi NCRashishs7044
 
The McKinsey 7S Framework: A Holistic Approach to Harmonizing All Parts of th...
The McKinsey 7S Framework: A Holistic Approach to Harmonizing All Parts of th...The McKinsey 7S Framework: A Holistic Approach to Harmonizing All Parts of th...
The McKinsey 7S Framework: A Holistic Approach to Harmonizing All Parts of th...Operational Excellence Consulting
 
Appkodes Tinder Clone Script with Customisable Solutions.pptx
Appkodes Tinder Clone Script with Customisable Solutions.pptxAppkodes Tinder Clone Script with Customisable Solutions.pptx
Appkodes Tinder Clone Script with Customisable Solutions.pptxappkodes
 
MAHA Global and IPR: Do Actions Speak Louder Than Words?
MAHA Global and IPR: Do Actions Speak Louder Than Words?MAHA Global and IPR: Do Actions Speak Louder Than Words?
MAHA Global and IPR: Do Actions Speak Louder Than Words?Olivia Kresic
 
Technical Leaders - Working with the Management Team
Technical Leaders - Working with the Management TeamTechnical Leaders - Working with the Management Team
Technical Leaders - Working with the Management TeamArik Fletcher
 

Recently uploaded (20)

Ten Organizational Design Models to align structure and operations to busines...
Ten Organizational Design Models to align structure and operations to busines...Ten Organizational Design Models to align structure and operations to busines...
Ten Organizational Design Models to align structure and operations to busines...
 
Call Us ➥9319373153▻Call Girls In North Goa
Call Us ➥9319373153▻Call Girls In North GoaCall Us ➥9319373153▻Call Girls In North Goa
Call Us ➥9319373153▻Call Girls In North Goa
 
Innovation Conference 5th March 2024.pdf
Innovation Conference 5th March 2024.pdfInnovation Conference 5th March 2024.pdf
Innovation Conference 5th March 2024.pdf
 
8447779800, Low rate Call girls in Saket Delhi NCR
8447779800, Low rate Call girls in Saket Delhi NCR8447779800, Low rate Call girls in Saket Delhi NCR
8447779800, Low rate Call girls in Saket Delhi NCR
 
WAM Corporate Presentation April 12 2024.pdf
WAM Corporate Presentation April 12 2024.pdfWAM Corporate Presentation April 12 2024.pdf
WAM Corporate Presentation April 12 2024.pdf
 
20200128 Ethical by Design - Whitepaper.pdf
20200128 Ethical by Design - Whitepaper.pdf20200128 Ethical by Design - Whitepaper.pdf
20200128 Ethical by Design - Whitepaper.pdf
 
Intermediate Accounting, Volume 2, 13th Canadian Edition by Donald E. Kieso t...
Intermediate Accounting, Volume 2, 13th Canadian Edition by Donald E. Kieso t...Intermediate Accounting, Volume 2, 13th Canadian Edition by Donald E. Kieso t...
Intermediate Accounting, Volume 2, 13th Canadian Edition by Donald E. Kieso t...
 
NAB Show Exhibitor List 2024 - Exhibitors Data
NAB Show Exhibitor List 2024 - Exhibitors DataNAB Show Exhibitor List 2024 - Exhibitors Data
NAB Show Exhibitor List 2024 - Exhibitors Data
 
The Bizz Quiz-E-Summit-E-Cell-IITPatna.pptx
The Bizz Quiz-E-Summit-E-Cell-IITPatna.pptxThe Bizz Quiz-E-Summit-E-Cell-IITPatna.pptx
The Bizz Quiz-E-Summit-E-Cell-IITPatna.pptx
 
Send Files | Sendbig.comSend Files | Sendbig.com
Send Files | Sendbig.comSend Files | Sendbig.comSend Files | Sendbig.comSend Files | Sendbig.com
Send Files | Sendbig.comSend Files | Sendbig.com
 
Onemonitar Android Spy App Features: Explore Advanced Monitoring Capabilities
Onemonitar Android Spy App Features: Explore Advanced Monitoring CapabilitiesOnemonitar Android Spy App Features: Explore Advanced Monitoring Capabilities
Onemonitar Android Spy App Features: Explore Advanced Monitoring Capabilities
 
Pitch Deck Teardown: Geodesic.Life's $500k Pre-seed deck
Pitch Deck Teardown: Geodesic.Life's $500k Pre-seed deckPitch Deck Teardown: Geodesic.Life's $500k Pre-seed deck
Pitch Deck Teardown: Geodesic.Life's $500k Pre-seed deck
 
Flow Your Strategy at Flight Levels Day 2024
Flow Your Strategy at Flight Levels Day 2024Flow Your Strategy at Flight Levels Day 2024
Flow Your Strategy at Flight Levels Day 2024
 
Healthcare Feb. & Mar. Healthcare Newsletter
Healthcare Feb. & Mar. Healthcare NewsletterHealthcare Feb. & Mar. Healthcare Newsletter
Healthcare Feb. & Mar. Healthcare Newsletter
 
APRIL2024_UKRAINE_xml_0000000000000 .pdf
APRIL2024_UKRAINE_xml_0000000000000 .pdfAPRIL2024_UKRAINE_xml_0000000000000 .pdf
APRIL2024_UKRAINE_xml_0000000000000 .pdf
 
8447779800, Low rate Call girls in Shivaji Enclave Delhi NCR
8447779800, Low rate Call girls in Shivaji Enclave Delhi NCR8447779800, Low rate Call girls in Shivaji Enclave Delhi NCR
8447779800, Low rate Call girls in Shivaji Enclave Delhi NCR
 
The McKinsey 7S Framework: A Holistic Approach to Harmonizing All Parts of th...
The McKinsey 7S Framework: A Holistic Approach to Harmonizing All Parts of th...The McKinsey 7S Framework: A Holistic Approach to Harmonizing All Parts of th...
The McKinsey 7S Framework: A Holistic Approach to Harmonizing All Parts of th...
 
Appkodes Tinder Clone Script with Customisable Solutions.pptx
Appkodes Tinder Clone Script with Customisable Solutions.pptxAppkodes Tinder Clone Script with Customisable Solutions.pptx
Appkodes Tinder Clone Script with Customisable Solutions.pptx
 
MAHA Global and IPR: Do Actions Speak Louder Than Words?
MAHA Global and IPR: Do Actions Speak Louder Than Words?MAHA Global and IPR: Do Actions Speak Louder Than Words?
MAHA Global and IPR: Do Actions Speak Louder Than Words?
 
Technical Leaders - Working with the Management Team
Technical Leaders - Working with the Management TeamTechnical Leaders - Working with the Management Team
Technical Leaders - Working with the Management Team
 

Pan Dhoni - Modernizing Data And Analytics using AI.pdf

  • 1. ABOUT ME Names: Pan Singh Dhoni Work: Data & AI Expert, Independent Researcher, Judge, Speaker, and thought leader Email ID: ps.dhoni@gmail.com
  • 2. AGENDA • WILL UNDERSTAND DATA AND ANALYTICS TERMINOLOGY • ARCHITECTURE: ENTERPRISE DATA PLATFORM • GENERATIVE AI, AND LARGE LANGUAGE MODEL (LLM) INTRODUCTION • MODEL SELECTION APPROACH, MODEL FINE TUNING • DATA ANALYSIS USING AI: GRAPH, CHARTS, AND REPORTS GENERATION USING AI • DEVELOPER PRODUCTIVITY USING AI • IMAGE PROCESSING USING GENERATIVE AI • BUSINESS USE CASES FOR RETAIL • AI: HANDLING RISKS AND CHALLENGES 2 Modernizing Data And Analytics using AI
  • 3. 3 DATA AND ANALYTICS TERMINOLOGY • Ingestion, queue, ETL, Data Modeling, aggregation, data engineering, Data Analytics, DQ, business partners, Analyst, platform etc. • Business Intelligence: Insight from the data in the form of reports, Dashboards, and trends • Machine Learning/ AI: Forecasting, Digital marketing, Revenue growth
  • 4. 4 ENTERPRISE DATA PLATFORM Bronze Gold Data Quality -Validation, rules, prevention Data Governance - policies - standards Data Security - Identity - Access ML/ AI Vendors/ Apps System of Records 1 System of Records n . . . Integra tion Layer CDP Business partners Business use cases Silver Semantic Layer Presentation Layer
  • 5. 5 A R T I F I C I A L I N T E L L I G E N C E ( A I ) AI is not a novel concept; it has been around for a long time, but major changes have occurred on the infrastructure side with resources such as machines ranging from CPUs and GPUs to TPUs becoming widely available. The major change is that it is now widely accessible to small industries and the common man. The recent surge in interest in OpenAI has proven this theory. The use cases remain the same; the only change is in how to automate these use cases for industries of all sizes to serve the common man.
  • 7. 7 E N T E R P R I S E D A T A P L A T F O R M W I T H A I C A P A B I L I T I E S Staging Layer Data Serving Layer BI ML/ AI Vendors/ Apps System of Records 1 System of Records n . . . Integra tion Layer CDP Business partners Business partners/ decision Makers Generative AI/ AI for better productivity & metrics Data Quality -Validation, rules, prevention Data Governance - policies - standards Data Security - Identity - Access Business use cases Smart Ingestion Smart ETL Smart DQ, Data Gov. & Security Smart BI Smart Data Model Smart Market ing
  • 8. 8 GENERATIVE AI LLM LIM Multimodal Generative AI
  • 9. 9 LLM MODELS • Translate text into other languages • Improve customer experience with chatbots and AI assistants • Organize and classify customer feedback to the right departments • Summarize large documents, such as earnings calls and legal documents • Create new marketing content • Generate software code from natural language Large language models (LLMs) are machine learning models that are very effective at performing language-related tasks GPT family of models (e.g., ChatGPT), BERT, Llama, MPT and Anthropic.
  • 10. 10 M O D E L S E L E C T I O N : O P E N S O U R C E O R P R O P R I E T A R Y Assess model based on Privacy, Quality, Cost and Latency Open-Source Models • Use as off-the-shelf or fine tune • provides flexibility for customizations • can be smaller in size to save cost • commercial / non-commercial use Examples: LLaMA/ mosai etc. Pros: Development is slow Cons: Cost is low, no vendor lock-in Proprietary (Paid) Models • Usually offered as LLMs-as-a-service • Some can be fine-tuned • Restrictive licenses for usage and modification Examples: OpenAI, ChatGPT Pros: Development is fast, quality will be better Cons: Cost is high, Vendor lock-in, Data privacy/ Security
  • 11. 11 D O M A I N S P E C I F I C : F I N E T U N I N G Company data Schema, NRF Data Schema Retail Domain Foundation Model
  • 12. 12 M O D E L T R A I N I N G : S C H E M A I N F O R M A T I O N LLM Model Database Emp (name str (20), age int (5) …) Send Schema to LLM model, using prompt
  • 13. 13 B U S I N E S S V A L U E : R E T R I E V E V A L U A B L E I N F O R M A T I O N Prompt to LLM English Prompt SQL Query SQL Execution Result Set
  • 14. 14 D A T A A N A L Y S I S / A N A L Y S T / B I LLM Model UI Prompt to LLM English Prompt SQL Query SQL Execution Result Set DB or Delta lake or S3 etc.
  • 15. 15 DEVELOPER ASSISTANCE LLM Model Editor Code to LLM Code Result Set Code correction
  • 16. 16 I M A G E P R O C E S S I N G U S I N G G E N A I
  • 17. 17 Parameter/Metric Non-Local Means Denoising CNN trained for Image Denoising Conclusion Accuracy (MSE) / PSNR MSE = 15.0 PSNR = 18 dB (inversely related to MSE) The generative method (CNN) outperforms the traditional method (NLM) in terms of accuracy. Processing Time 25 seconds in hours (training time): Very First Time The traditional method is significantly faster for inference, while the generative model requires more time for training. Generalization Moderate High The generative model demonstrates better generalization capabilities. Interpretability High Not as high due to the inherent complexity of CNNs. Traditional methods tend to be more interpretable.
  • 18. 18 GENERATIVE AI BENEFITS ACROSS INDUSTRY Retail Auto Medical Image Forensics Image Synthesis
  • 19. 19 FEW RETAIL USE CASES • Business partners • Inventory optimization • Store employee performance improvement • Theft protection • Revenue increase (targeted marketing, customer satisfaction)
  • 20. 20 ADDRESS ETHICAL ISSUES Data Bias: ➢ Assess data slices -> update data ➢ Regulation Toxic, discriminatory, exclusive model, Mis-information hazard: ➢ Assess data slices -> update data ➢ curate data for fine tuning ➢ Regulation
  • 21. 21 ADDRESS ETHICAL ISSUES ✓ Ensure proper data anonymization, encryption, and access controls ✓ Implement safeguards to access or disclosure of sensitive data during training/storage/inferences ✓ Establish data and model governance; version control, monitoring, auditing, data usage policy etc. Ask question with vendors: ✓ will data will be shared with third party ✓ do you have data lineage that enables you to delete data from varios storage parts. ✓ history stored , is that secure?
  • 22. 22 REFERENCES Google Scholar (Pan Singh Dhoni): https://scholar.google.com/citations?user=PnVDB6MAAAAJ&hl=en https://figshare.com/authors/Pan_Dhoni/16388907 1. https://docs.databricks.com/en/generative-ai/generative-ai.html 2. Synergizing Generative Artificial Intelligence and Cybersecurity: Roles of Generative Artificial Intelligence Entities, Companies, Agencies and Government in Enhancing: Journal of Global Research in Computer Sciences 14 (3), 16, 2023 3. Synergy in Technology How Generative AI Augments the Capabilities of Customer Data Platforms: Journal of Mathematical Techniques and Computational Mathematics 2 (9), 396, 2023. 4. Synergizing Generative AI and Cybersecurity: Roles of Generative AI Entities, Companies, Agencies, and Government in Enhancing Cybersecurity: TechRxiv 5. A cost-effective IT approach to rapidly build a data platform and integrate retail applications for small and mid-size companies: TechRxiv 6. Exploring the Synergy between Generative AI, Data and Analytics in the Modern Age: TechRxiv 7. Enhancing Data Quality through Generative AI: An Empirical Study with Data: TechRxiv 8. Represented Advantages of generative AI in Image Processing paper at ICAAAIML-2023, SHARDA UNIVERSITY 9. From Data to Decisions: Enhancing Retail with AI and Machine Learning, International Journal of Computing and Engineering 5(1), 38-51, 2024. 10. https://docs.databricks.com/en/generative-ai/generative-ai.html 11. https://arxiv.org/abs/2303.08774
  • 23. THANK YOU Pan Singh Dhoni ps.dhoni@gmail.com https://www.linkedin.com/in/pandhoni/ 8/06/20XX PITCH DECK 23