SlideShare a Scribd company logo
Language Analysis using
Machine learning:
An overview
Rudradeb Mitra
Bio
• AI researcher published 10
research papers on topics like
logical reasoning, language
analysis, Semantic web.
• Masters from University of
Cambridge, UK.
• Involved with startups since
2010.
• Machine learning enthusiast.
What is machine learning?
• Apply previously acquired
knowledge to new or novel
situation
• Search tree, neural network,
Bayesian reasoning, logic,…
• Boom and AI winter cycle
(1974-80, 1980-87)
Arthur Samuel with his checker playing machine
But something is happening
recently…..
• AlphaGo defeated world Go
champion.
• AP is going to use machine
created news articles for
sports coverage
• Deep Mind to check NHS eye
scans for disease analysis
• People have termed it similar
to Industrial revolution
Applications
• News articles (AP), robot lawyers, designers
(wix), car industry (google, apple), tour guides,
rockets….
• Open AI, facebook, google, microsoft, twitter…
• ….machine learning will affect all domains…..
Why now?
• Big data - What do we do with
it?
• Visualize, Analyze - Human
element
• Machine learning / Deep
neural network - Learn from
the data
Language understanding
• “A computer would deserve to
be called intelligent if it could
deceive a human into
believing that it is human.” -
Alan Turing
• Language is the form of
communication.
• Basic necessity in solving AI
problems in language
understanding.
Applications of NLP
• Topic modelling
• Text summarization
• Translation
• Sentiment analysis
• Image captions and descriptions …
Historic approaches…
• Syntax tree
• Semantic - RDF, OWL
• LSA - bag of words,
similar words appear
together.

Concepts are represented
as patterns of words.
Latent Dirichlet Analysis
• Start with document, bag of words and K topics
• Output - Documents are of what topics (in %)
• Randomly/semi-randomly assign each word to a topic
• All topic assignments except for the current word in
question are correct
• Improve by reassign ‘w’ a new topic. Choose topic t
with probability p(topic t | document d) * p(word w |
topic t)
Neural Networks
Back propagation
Deep Neural network
• Many layers / neurons
• Wide / Deep network
• Data + computations power
CBOW / skip gram
word2vec
word2vec
• Applications: Sentence auto fill, playlist, genes…
• Issues: Local context. Missing global context.
• GloVe
Recurrent Neural Network
LSTM
Sentiment Analysis with RNN
Convolutional Neural
Network
General learning algorithm
AlphaGo - Building intuition
• Took 150,000 games played by good
human players and used an artificial
neural network to find patterns
• Learned to predict with high
probability what move a human
player would take
• Play against itself, to get an estimate
of how likely a given board position
was to be a winning one -
Reinforcement learning
• No detailed knowledge of Go.
Instead analyzed thousands of prior
games and engaged in a lot of self-
play.
Thank You
Questions?
mitra.rudradeb@gmail.com
Feel free to email or add me on linkedin
Reinforcement learning

More Related Content

What's hot

Artificial Intelligence : The Future of AI
Artificial Intelligence : The Future of AIArtificial Intelligence : The Future of AI
Artificial Intelligence : The Future of AI
SOURABH KUMAR PANDEY
 
Artificial intelligence, machine learning and internet of things
Artificial intelligence, machine learning and internet of thingsArtificial intelligence, machine learning and internet of things
Artificial intelligence, machine learning and internet of things
Dr. Amit Gangwal Jain (MPharm., PhD.)
 
Artificial intelligence overview
Artificial intelligence overviewArtificial intelligence overview
Artificial intelligence overview
Auquall Inventive Services
 
Artificial intelligence (ai)
Artificial intelligence (ai)Artificial intelligence (ai)
Artificial intelligence (ai)
bijaya kc
 
We are Building Dystopia using AI & ML
We are Building Dystopia using AI & MLWe are Building Dystopia using AI & ML
We are Building Dystopia using AI & ML
Viral Parmar
 
AI, Machine Learning and Deep Learning - The Overview
AI, Machine Learning and Deep Learning - The OverviewAI, Machine Learning and Deep Learning - The Overview
AI, Machine Learning and Deep Learning - The Overview
Spotle.ai
 
Introduction to Artificial Intelligence and Machine Learning
Introduction to Artificial Intelligence and Machine Learning Introduction to Artificial Intelligence and Machine Learning
Introduction to Artificial Intelligence and Machine Learning
Emad Nabil
 
AI & ML Overview
AI & ML OverviewAI & ML Overview
AI & ML Overview
Charlotte Isabella Aspinall
 
Artificial intelligence slides beginners
Artificial intelligence slides beginners Artificial intelligence slides beginners
Artificial intelligence slides beginners
Antonio Fernandes
 
Artificial Intelligence - Overview
Artificial Intelligence - OverviewArtificial Intelligence - Overview
Artificial Intelligence - Overview
Mithileysh Sathiyanarayanan
 
What is AI ( Arificial Intelligence)?
What is AI ( Arificial Intelligence)?What is AI ( Arificial Intelligence)?
What is AI ( Arificial Intelligence)?
MyAssignmenthelp.com
 
Artificial intelligence (AI)
Artificial intelligence (AI)Artificial intelligence (AI)
Artificial intelligence (AI)
Fahad Farooq
 
A primer on Artificial Intelligence (AI) and Machine Learning (ML)
A primer on Artificial Intelligence (AI) and Machine Learning (ML)A primer on Artificial Intelligence (AI) and Machine Learning (ML)
A primer on Artificial Intelligence (AI) and Machine Learning (ML)
Yacine Ghalim
 
Ai in finance
Ai in financeAi in finance
Ai in finance
Vishwas N
 
Artificial intelligence
Artificial intelligenceArtificial intelligence
Artificial intelligence
Brainware University
 
Bringing AI to Business Intelligence
Bringing AI to Business IntelligenceBringing AI to Business Intelligence
Bringing AI to Business Intelligence
Si Krishan
 
Applications of artificial intelligence (AI) models for management decision m...
Applications of artificial intelligence (AI) models for management decision m...Applications of artificial intelligence (AI) models for management decision m...
Applications of artificial intelligence (AI) models for management decision m...
The Higher Education Academy
 
The Future of Machine Learning
The Future of Machine LearningThe Future of Machine Learning
The Future of Machine Learning
Russell Miles
 
Artificial Intelligence Introduction
Artificial Intelligence IntroductionArtificial Intelligence Introduction
Artificial Intelligence Introduction
Kirti Verma
 
Artificial Intelligence
Artificial IntelligenceArtificial Intelligence
Artificial Intelligence
Girish Naik
 

What's hot (20)

Artificial Intelligence : The Future of AI
Artificial Intelligence : The Future of AIArtificial Intelligence : The Future of AI
Artificial Intelligence : The Future of AI
 
Artificial intelligence, machine learning and internet of things
Artificial intelligence, machine learning and internet of thingsArtificial intelligence, machine learning and internet of things
Artificial intelligence, machine learning and internet of things
 
Artificial intelligence overview
Artificial intelligence overviewArtificial intelligence overview
Artificial intelligence overview
 
Artificial intelligence (ai)
Artificial intelligence (ai)Artificial intelligence (ai)
Artificial intelligence (ai)
 
We are Building Dystopia using AI & ML
We are Building Dystopia using AI & MLWe are Building Dystopia using AI & ML
We are Building Dystopia using AI & ML
 
AI, Machine Learning and Deep Learning - The Overview
AI, Machine Learning and Deep Learning - The OverviewAI, Machine Learning and Deep Learning - The Overview
AI, Machine Learning and Deep Learning - The Overview
 
Introduction to Artificial Intelligence and Machine Learning
Introduction to Artificial Intelligence and Machine Learning Introduction to Artificial Intelligence and Machine Learning
Introduction to Artificial Intelligence and Machine Learning
 
AI & ML Overview
AI & ML OverviewAI & ML Overview
AI & ML Overview
 
Artificial intelligence slides beginners
Artificial intelligence slides beginners Artificial intelligence slides beginners
Artificial intelligence slides beginners
 
Artificial Intelligence - Overview
Artificial Intelligence - OverviewArtificial Intelligence - Overview
Artificial Intelligence - Overview
 
What is AI ( Arificial Intelligence)?
What is AI ( Arificial Intelligence)?What is AI ( Arificial Intelligence)?
What is AI ( Arificial Intelligence)?
 
Artificial intelligence (AI)
Artificial intelligence (AI)Artificial intelligence (AI)
Artificial intelligence (AI)
 
A primer on Artificial Intelligence (AI) and Machine Learning (ML)
A primer on Artificial Intelligence (AI) and Machine Learning (ML)A primer on Artificial Intelligence (AI) and Machine Learning (ML)
A primer on Artificial Intelligence (AI) and Machine Learning (ML)
 
Ai in finance
Ai in financeAi in finance
Ai in finance
 
Artificial intelligence
Artificial intelligenceArtificial intelligence
Artificial intelligence
 
Bringing AI to Business Intelligence
Bringing AI to Business IntelligenceBringing AI to Business Intelligence
Bringing AI to Business Intelligence
 
Applications of artificial intelligence (AI) models for management decision m...
Applications of artificial intelligence (AI) models for management decision m...Applications of artificial intelligence (AI) models for management decision m...
Applications of artificial intelligence (AI) models for management decision m...
 
The Future of Machine Learning
The Future of Machine LearningThe Future of Machine Learning
The Future of Machine Learning
 
Artificial Intelligence Introduction
Artificial Intelligence IntroductionArtificial Intelligence Introduction
Artificial Intelligence Introduction
 
Artificial Intelligence
Artificial IntelligenceArtificial Intelligence
Artificial Intelligence
 

Similar to Natural language Analysis

Week1- Introduction.pptx
Week1- Introduction.pptxWeek1- Introduction.pptx
Week1- Introduction.pptx
fahmi324663
 
Esciencetalk
EsciencetalkEsciencetalk
Esciencetalk
dbgannon
 
Esciencetalk
EsciencetalkEsciencetalk
Big data 4 webmonday
Big data 4 webmondayBig data 4 webmonday
Big data 4 webmonday
Daniel Koller
 
Introduction to deep learning
Introduction to deep learningIntroduction to deep learning
Introduction to deep learning
Amr Rashed
 
Deep learning introduction
Deep learning introductionDeep learning introduction
Deep learning introduction
Adwait Bhave
 
Introduction to Text Mining
Introduction to Text MiningIntroduction to Text Mining
Introduction to Text Mining
Minha Hwang
 
Our World is Socio-technical
Our World is Socio-technicalOur World is Socio-technical
Our World is Socio-technical
Markus Luczak-Rösch
 
AI Technology Overview and Career Advice
AI Technology Overview and Career AdviceAI Technology Overview and Career Advice
AI Technology Overview and Career Advice
Kunling Geng
 
AILABS - Lecture Series - Is AI the New Electricity? - Advances In Machine Le...
AILABS - Lecture Series - Is AI the New Electricity? - Advances In Machine Le...AILABS - Lecture Series - Is AI the New Electricity? - Advances In Machine Le...
AILABS - Lecture Series - Is AI the New Electricity? - Advances In Machine Le...
AILABS Academy
 
An Introduction to Recent Advances in the Field of NLP
An Introduction to Recent Advances in the Field of NLPAn Introduction to Recent Advances in the Field of NLP
An Introduction to Recent Advances in the Field of NLP
Rrubaa Panchendrarajan
 
Machine Learning Overview: How did we get here ?
Machine Learning Overview: How did we get here ?Machine Learning Overview: How did we get here ?
Machine Learning Overview: How did we get here ?
Universitat Politècnica de Catalunya
 
Deep learning tutorial 9/2019
Deep learning tutorial 9/2019Deep learning tutorial 9/2019
Deep learning tutorial 9/2019
Amr Rashed
 
Deep Learning Tutorial
Deep Learning TutorialDeep Learning Tutorial
Deep Learning Tutorial
Amr Rashed
 
Artificial Intelligence by B. Ravikumar
Artificial Intelligence by B. RavikumarArtificial Intelligence by B. Ravikumar
Artificial Intelligence by B. Ravikumar
Garry D. Lasaga
 
Hacking Predictive Modeling - RoadSec 2018
Hacking Predictive Modeling - RoadSec 2018Hacking Predictive Modeling - RoadSec 2018
Hacking Predictive Modeling - RoadSec 2018
HJ van Veen
 
AI for Everyone: Master the Basics
AI for Everyone: Master the BasicsAI for Everyone: Master the Basics
AI for Everyone: Master the Basics
Stutty Srivastava
 
Data Science, Machine Learning and Neural Networks
Data Science, Machine Learning and Neural NetworksData Science, Machine Learning and Neural Networks
Data Science, Machine Learning and Neural Networks
BICA Labs
 
OWF14 - Big Data : The State of Machine Learning in 2014
OWF14 - Big Data : The State of Machine  Learning in 2014OWF14 - Big Data : The State of Machine  Learning in 2014
OWF14 - Big Data : The State of Machine Learning in 2014
Paris Open Source Summit
 
Ai introduction
Ai introductionAi introduction
Ai introduction
Babar Siraj
 

Similar to Natural language Analysis (20)

Week1- Introduction.pptx
Week1- Introduction.pptxWeek1- Introduction.pptx
Week1- Introduction.pptx
 
Esciencetalk
EsciencetalkEsciencetalk
Esciencetalk
 
Esciencetalk
EsciencetalkEsciencetalk
Esciencetalk
 
Big data 4 webmonday
Big data 4 webmondayBig data 4 webmonday
Big data 4 webmonday
 
Introduction to deep learning
Introduction to deep learningIntroduction to deep learning
Introduction to deep learning
 
Deep learning introduction
Deep learning introductionDeep learning introduction
Deep learning introduction
 
Introduction to Text Mining
Introduction to Text MiningIntroduction to Text Mining
Introduction to Text Mining
 
Our World is Socio-technical
Our World is Socio-technicalOur World is Socio-technical
Our World is Socio-technical
 
AI Technology Overview and Career Advice
AI Technology Overview and Career AdviceAI Technology Overview and Career Advice
AI Technology Overview and Career Advice
 
AILABS - Lecture Series - Is AI the New Electricity? - Advances In Machine Le...
AILABS - Lecture Series - Is AI the New Electricity? - Advances In Machine Le...AILABS - Lecture Series - Is AI the New Electricity? - Advances In Machine Le...
AILABS - Lecture Series - Is AI the New Electricity? - Advances In Machine Le...
 
An Introduction to Recent Advances in the Field of NLP
An Introduction to Recent Advances in the Field of NLPAn Introduction to Recent Advances in the Field of NLP
An Introduction to Recent Advances in the Field of NLP
 
Machine Learning Overview: How did we get here ?
Machine Learning Overview: How did we get here ?Machine Learning Overview: How did we get here ?
Machine Learning Overview: How did we get here ?
 
Deep learning tutorial 9/2019
Deep learning tutorial 9/2019Deep learning tutorial 9/2019
Deep learning tutorial 9/2019
 
Deep Learning Tutorial
Deep Learning TutorialDeep Learning Tutorial
Deep Learning Tutorial
 
Artificial Intelligence by B. Ravikumar
Artificial Intelligence by B. RavikumarArtificial Intelligence by B. Ravikumar
Artificial Intelligence by B. Ravikumar
 
Hacking Predictive Modeling - RoadSec 2018
Hacking Predictive Modeling - RoadSec 2018Hacking Predictive Modeling - RoadSec 2018
Hacking Predictive Modeling - RoadSec 2018
 
AI for Everyone: Master the Basics
AI for Everyone: Master the BasicsAI for Everyone: Master the Basics
AI for Everyone: Master the Basics
 
Data Science, Machine Learning and Neural Networks
Data Science, Machine Learning and Neural NetworksData Science, Machine Learning and Neural Networks
Data Science, Machine Learning and Neural Networks
 
OWF14 - Big Data : The State of Machine Learning in 2014
OWF14 - Big Data : The State of Machine  Learning in 2014OWF14 - Big Data : The State of Machine  Learning in 2014
OWF14 - Big Data : The State of Machine Learning in 2014
 
Ai introduction
Ai introductionAi introduction
Ai introduction
 

More from Rudradeb Mitra

Architecting IoT with Machine Learning
Architecting IoT with Machine LearningArchitecting IoT with Machine Learning
Architecting IoT with Machine Learning
Rudradeb Mitra
 
Growth : Crossing the chasm
Growth :  Crossing the chasmGrowth :  Crossing the chasm
Growth : Crossing the chasm
Rudradeb Mitra
 
Machine Learning: For the people, By the people, Of the people
Machine Learning: For the people, By the people, Of the peopleMachine Learning: For the people, By the people, Of the people
Machine Learning: For the people, By the people, Of the people
Rudradeb Mitra
 
Machine learning for retail banking
Machine learning for retail bankingMachine learning for retail banking
Machine learning for retail banking
Rudradeb Mitra
 
Successful adoption of Machine Learning
Successful adoption of Machine LearningSuccessful adoption of Machine Learning
Successful adoption of Machine Learning
Rudradeb Mitra
 
Machine Learning Adoption: Crossing the chasm for banking and insurance sector
Machine Learning Adoption: Crossing the chasm for banking and insurance sectorMachine Learning Adoption: Crossing the chasm for banking and insurance sector
Machine Learning Adoption: Crossing the chasm for banking and insurance sector
Rudradeb Mitra
 
Predictive Analytics to the rescue of IoT
Predictive Analytics to the rescue of IoTPredictive Analytics to the rescue of IoT
Predictive Analytics to the rescue of IoT
Rudradeb Mitra
 
Predictive Analytics using Neural Networks
Predictive Analytics using Neural NetworksPredictive Analytics using Neural Networks
Predictive Analytics using Neural Networks
Rudradeb Mitra
 
Predictive Analytics disrupting Product development
Predictive Analytics disrupting Product developmentPredictive Analytics disrupting Product development
Predictive Analytics disrupting Product development
Rudradeb Mitra
 
Predictive Analytics
Predictive Analytics Predictive Analytics
Predictive Analytics
Rudradeb Mitra
 
Artificial Intelligence: Case studies (what can you build)
Artificial Intelligence: Case studies (what can you build)Artificial Intelligence: Case studies (what can you build)
Artificial Intelligence: Case studies (what can you build)
Rudradeb Mitra
 
Predictive Analytics
Predictive Analytics Predictive Analytics
Predictive Analytics
Rudradeb Mitra
 
Machine learning disrupting car insurance industry
Machine learning disrupting car insurance industryMachine learning disrupting car insurance industry
Machine learning disrupting car insurance industry
Rudradeb Mitra
 
Ethical Artificial Intelligence
Ethical Artificial IntelligenceEthical Artificial Intelligence
Ethical Artificial Intelligence
Rudradeb Mitra
 

More from Rudradeb Mitra (14)

Architecting IoT with Machine Learning
Architecting IoT with Machine LearningArchitecting IoT with Machine Learning
Architecting IoT with Machine Learning
 
Growth : Crossing the chasm
Growth :  Crossing the chasmGrowth :  Crossing the chasm
Growth : Crossing the chasm
 
Machine Learning: For the people, By the people, Of the people
Machine Learning: For the people, By the people, Of the peopleMachine Learning: For the people, By the people, Of the people
Machine Learning: For the people, By the people, Of the people
 
Machine learning for retail banking
Machine learning for retail bankingMachine learning for retail banking
Machine learning for retail banking
 
Successful adoption of Machine Learning
Successful adoption of Machine LearningSuccessful adoption of Machine Learning
Successful adoption of Machine Learning
 
Machine Learning Adoption: Crossing the chasm for banking and insurance sector
Machine Learning Adoption: Crossing the chasm for banking and insurance sectorMachine Learning Adoption: Crossing the chasm for banking and insurance sector
Machine Learning Adoption: Crossing the chasm for banking and insurance sector
 
Predictive Analytics to the rescue of IoT
Predictive Analytics to the rescue of IoTPredictive Analytics to the rescue of IoT
Predictive Analytics to the rescue of IoT
 
Predictive Analytics using Neural Networks
Predictive Analytics using Neural NetworksPredictive Analytics using Neural Networks
Predictive Analytics using Neural Networks
 
Predictive Analytics disrupting Product development
Predictive Analytics disrupting Product developmentPredictive Analytics disrupting Product development
Predictive Analytics disrupting Product development
 
Predictive Analytics
Predictive Analytics Predictive Analytics
Predictive Analytics
 
Artificial Intelligence: Case studies (what can you build)
Artificial Intelligence: Case studies (what can you build)Artificial Intelligence: Case studies (what can you build)
Artificial Intelligence: Case studies (what can you build)
 
Predictive Analytics
Predictive Analytics Predictive Analytics
Predictive Analytics
 
Machine learning disrupting car insurance industry
Machine learning disrupting car insurance industryMachine learning disrupting car insurance industry
Machine learning disrupting car insurance industry
 
Ethical Artificial Intelligence
Ethical Artificial IntelligenceEthical Artificial Intelligence
Ethical Artificial Intelligence
 

Recently uploaded

Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
tolgahangng
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
Ivanti
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Kari Kakkonen
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
danishmna97
 
CAKE: Sharing Slices of Confidential Data on Blockchain
CAKE: Sharing Slices of Confidential Data on BlockchainCAKE: Sharing Slices of Confidential Data on Blockchain
CAKE: Sharing Slices of Confidential Data on Blockchain
Claudio Di Ciccio
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
Pixlogix Infotech
 
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceAI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
IndexBug
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
Aftab Hussain
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
akankshawande
 
OpenID AuthZEN Interop Read Out - Authorization
OpenID AuthZEN Interop Read Out - AuthorizationOpenID AuthZEN Interop Read Out - Authorization
OpenID AuthZEN Interop Read Out - Authorization
David Brossard
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Speck&Tech
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Zilliz
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
Octavian Nadolu
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc
 
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracyGraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
Tomaz Bratanic
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems S.M.S.A.
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
Uni Systems S.M.S.A.
 
Mariano G Tinti - Decoding SpaceX
Mariano G Tinti - Decoding SpaceXMariano G Tinti - Decoding SpaceX
Mariano G Tinti - Decoding SpaceX
Mariano Tinti
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
Matthew Sinclair
 

Recently uploaded (20)

Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
 
CAKE: Sharing Slices of Confidential Data on Blockchain
CAKE: Sharing Slices of Confidential Data on BlockchainCAKE: Sharing Slices of Confidential Data on Blockchain
CAKE: Sharing Slices of Confidential Data on Blockchain
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
 
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceAI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
 
OpenID AuthZEN Interop Read Out - Authorization
OpenID AuthZEN Interop Read Out - AuthorizationOpenID AuthZEN Interop Read Out - Authorization
OpenID AuthZEN Interop Read Out - Authorization
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
 
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracyGraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
 
Mariano G Tinti - Decoding SpaceX
Mariano G Tinti - Decoding SpaceXMariano G Tinti - Decoding SpaceX
Mariano G Tinti - Decoding SpaceX
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
 

Natural language Analysis

  • 1. Language Analysis using Machine learning: An overview Rudradeb Mitra
  • 2. Bio • AI researcher published 10 research papers on topics like logical reasoning, language analysis, Semantic web. • Masters from University of Cambridge, UK. • Involved with startups since 2010. • Machine learning enthusiast.
  • 3. What is machine learning? • Apply previously acquired knowledge to new or novel situation • Search tree, neural network, Bayesian reasoning, logic,… • Boom and AI winter cycle (1974-80, 1980-87) Arthur Samuel with his checker playing machine
  • 4. But something is happening recently….. • AlphaGo defeated world Go champion. • AP is going to use machine created news articles for sports coverage • Deep Mind to check NHS eye scans for disease analysis • People have termed it similar to Industrial revolution
  • 5. Applications • News articles (AP), robot lawyers, designers (wix), car industry (google, apple), tour guides, rockets…. • Open AI, facebook, google, microsoft, twitter… • ….machine learning will affect all domains…..
  • 6. Why now? • Big data - What do we do with it? • Visualize, Analyze - Human element • Machine learning / Deep neural network - Learn from the data
  • 7. Language understanding • “A computer would deserve to be called intelligent if it could deceive a human into believing that it is human.” - Alan Turing • Language is the form of communication. • Basic necessity in solving AI problems in language understanding.
  • 8. Applications of NLP • Topic modelling • Text summarization • Translation • Sentiment analysis • Image captions and descriptions …
  • 9. Historic approaches… • Syntax tree • Semantic - RDF, OWL • LSA - bag of words, similar words appear together.
 Concepts are represented as patterns of words.
  • 10. Latent Dirichlet Analysis • Start with document, bag of words and K topics • Output - Documents are of what topics (in %) • Randomly/semi-randomly assign each word to a topic • All topic assignments except for the current word in question are correct • Improve by reassign ‘w’ a new topic. Choose topic t with probability p(topic t | document d) * p(word w | topic t)
  • 13. Deep Neural network • Many layers / neurons • Wide / Deep network • Data + computations power
  • 14. CBOW / skip gram
  • 16. word2vec • Applications: Sentence auto fill, playlist, genes… • Issues: Local context. Missing global context. • GloVe
  • 18. LSTM
  • 22. AlphaGo - Building intuition • Took 150,000 games played by good human players and used an artificial neural network to find patterns • Learned to predict with high probability what move a human player would take • Play against itself, to get an estimate of how likely a given board position was to be a winning one - Reinforcement learning • No detailed knowledge of Go. Instead analyzed thousands of prior games and engaged in a lot of self- play.