SlideShare a Scribd company logo
1 of 2
Machine Translation
How does Google translation
work?
The History and Progress of
Machine Translation
Major machine translation services use
Artificial Neural Networks (ANN).
•Neural networks are a series of
algorithms that mimic the operations of
an animal brain to recognize
relationships between vast amounts of
data.
•They tend to resemble the
connections of neurons and synapses
found in the brain.
A Brief History of Machine Translation
The new field of “Machine Translation” appeared in early 1950s.
・Until the end of 1970s, Rule-Based Machine Translation(RBMT)
was the major approach. This word-based approach relies on
countless built-in linguistic rules and millions of bilingual
dictionaries for each pair.
・The next approach after RBMT was Statistical Machine
Translation(SMT). This approach analyzes existing translations
developed by humans. SMT is built on phrase-based systems.
・Neural Machine Translation(NMT) was introduced in the last
decade. NMT learns from each translation task and improves upon
each subsequent translation.
LSTM
Hook
Do you know memory which can
remember long term?
Key details
Long short-term memory(LSTM) is an artificial neural
network used in the fields of artificial intelligence and deep
learning.
A common LSTM unit is composed of 4.
1.cell 2.input gate 3.output gate 4.forget gate
LSTM networks are well-suited to 3 things based on time
series data.
1.Classifying 2. processing 3.making predictions
LSTMs were developed to deal with the vanishing gradient
problem that can be encountered when training traditional
RNNs.
More details
LSTM has feedback connections. Such a recurrent neural network (RNN) can
process not only single data points (such as images), but also entire sequences
of data (such as speech or video).
(RNN is a class of artificial neural networks where connections between nodes
can create a cycle, allowing output from some nodes to affect subsequent input
to the same nodes. )
For example, LSTM is applicable to tasks such as unsegmented,
connected handwriting recognition, speech recognition, machine translation,
robot control, video games, and healthcare.
The general architecture consists of a cell (the storage part of the LSTM unit)
and three "regulators" (input gates, output gates, and forget gates) of
information flow inside the LSTM unit, mostly called gates.
The "cells" are needed to keep track of dependencies between elements in the
input array.
The "input gates" control the degree to which new values flow into the cell.
The "forget gates" control the degree to which values remain in the cell.
The "output gates" control the degree to which values in the cell are used to
compute the output activation of the LSTM unit.

More Related Content

Similar to NLP.pptx

Long Short Term Memory LSTM
Long Short Term Memory LSTMLong Short Term Memory LSTM
Long Short Term Memory LSTM
Abdullah al Mamun
 
Nural network ER. Abhishek k. upadhyay
Nural network ER. Abhishek  k. upadhyayNural network ER. Abhishek  k. upadhyay
Nural network ER. Abhishek k. upadhyay
abhishek upadhyay
 
Computing with Directed Labeled Graphs
Computing with Directed Labeled GraphsComputing with Directed Labeled Graphs
Computing with Directed Labeled Graphs
Marko Rodriguez
 

Similar to NLP.pptx (20)

Long Short Term Memory LSTM
Long Short Term Memory LSTMLong Short Term Memory LSTM
Long Short Term Memory LSTM
 
EXPERIMENTS ON DIFFERENT RECURRENT NEURAL NETWORKS FOR ENGLISH-HINDI MACHINE ...
EXPERIMENTS ON DIFFERENT RECURRENT NEURAL NETWORKS FOR ENGLISH-HINDI MACHINE ...EXPERIMENTS ON DIFFERENT RECURRENT NEURAL NETWORKS FOR ENGLISH-HINDI MACHINE ...
EXPERIMENTS ON DIFFERENT RECURRENT NEURAL NETWORKS FOR ENGLISH-HINDI MACHINE ...
 
Artificial Neural Networking
Artificial Neural Networking Artificial Neural Networking
Artificial Neural Networking
 
Neural networking this is about neural networks
Neural networking this is about neural networksNeural networking this is about neural networks
Neural networking this is about neural networks
 
ANN.ppt
ANN.pptANN.ppt
ANN.ppt
 
Transformers AI PPT.pptx
Transformers AI PPT.pptxTransformers AI PPT.pptx
Transformers AI PPT.pptx
 
Nural network ER. Abhishek k. upadhyay
Nural network ER. Abhishek  k. upadhyayNural network ER. Abhishek  k. upadhyay
Nural network ER. Abhishek k. upadhyay
 
Quantum neural network
Quantum neural networkQuantum neural network
Quantum neural network
 
AI Chapter VIIProblem Solving Using Searching .pptx
AI Chapter VIIProblem Solving Using Searching .pptxAI Chapter VIIProblem Solving Using Searching .pptx
AI Chapter VIIProblem Solving Using Searching .pptx
 
BACKPROPOGATION ALGO.pdfLECTURE NOTES WITH SOLVED EXAMPLE AND FEED FORWARD NE...
BACKPROPOGATION ALGO.pdfLECTURE NOTES WITH SOLVED EXAMPLE AND FEED FORWARD NE...BACKPROPOGATION ALGO.pdfLECTURE NOTES WITH SOLVED EXAMPLE AND FEED FORWARD NE...
BACKPROPOGATION ALGO.pdfLECTURE NOTES WITH SOLVED EXAMPLE AND FEED FORWARD NE...
 
Lectweek1
Lectweek1Lectweek1
Lectweek1
 
Short story presentation
Short story presentationShort story presentation
Short story presentation
 
Voice Recognition Based Automation System for Medical Applications and for Ph...
Voice Recognition Based Automation System for Medical Applications and for Ph...Voice Recognition Based Automation System for Medical Applications and for Ph...
Voice Recognition Based Automation System for Medical Applications and for Ph...
 
Voice Recognition Based Automation System for Medical Applications and for Ph...
Voice Recognition Based Automation System for Medical Applications and for Ph...Voice Recognition Based Automation System for Medical Applications and for Ph...
Voice Recognition Based Automation System for Medical Applications and for Ph...
 
SoftComputing5
SoftComputing5SoftComputing5
SoftComputing5
 
Handwritten digit and symbol recognition using CNN.pptx
Handwritten digit and symbol recognition using CNN.pptxHandwritten digit and symbol recognition using CNN.pptx
Handwritten digit and symbol recognition using CNN.pptx
 
A ann neural Aj NN ghgh hghyt gWeek 1.pptx
A  ann neural Aj  NN ghgh hghyt gWeek 1.pptxA  ann neural Aj  NN ghgh hghyt gWeek 1.pptx
A ann neural Aj NN ghgh hghyt gWeek 1.pptx
 
Neural networks
Neural networksNeural networks
Neural networks
 
IRJET - Audio Emotion Analysis
IRJET - Audio Emotion AnalysisIRJET - Audio Emotion Analysis
IRJET - Audio Emotion Analysis
 
Computing with Directed Labeled Graphs
Computing with Directed Labeled GraphsComputing with Directed Labeled Graphs
Computing with Directed Labeled Graphs
 

More from john6938

Martial artist's guide to research writing
Martial artist's guide to research writingMartial artist's guide to research writing
Martial artist's guide to research writing
john6938
 

More from john6938 (20)

Martial artist's guide to research writing
Martial artist's guide to research writingMartial artist's guide to research writing
Martial artist's guide to research writing
 
Social Media Ethics.pptx
Social Media Ethics.pptxSocial Media Ethics.pptx
Social Media Ethics.pptx
 
Future of Information Ethics.pptx
Future of Information Ethics.pptxFuture of Information Ethics.pptx
Future of Information Ethics.pptx
 
Bioethics.pptx
Bioethics.pptxBioethics.pptx
Bioethics.pptx
 
Surveillance and security.pptx
Surveillance and security.pptxSurveillance and security.pptx
Surveillance and security.pptx
 
Introduction to Expert Systems.pptx
Introduction to Expert Systems.pptxIntroduction to Expert Systems.pptx
Introduction to Expert Systems.pptx
 
Starbuck.pptx
Starbuck.pptxStarbuck.pptx
Starbuck.pptx
 
Unit 4 Problem breakdown.pptx
Unit 4 Problem breakdown.pptxUnit 4 Problem breakdown.pptx
Unit 4 Problem breakdown.pptx
 
Image_recognition.pptx
Image_recognition.pptxImage_recognition.pptx
Image_recognition.pptx
 
Algorithms.pptx
Algorithms.pptxAlgorithms.pptx
Algorithms.pptx
 
Artificial_intelligence.pptx
Artificial_intelligence.pptxArtificial_intelligence.pptx
Artificial_intelligence.pptx
 
Image_generation.pptx
Image_generation.pptxImage_generation.pptx
Image_generation.pptx
 
Computer_Graphics.pptx
Computer_Graphics.pptxComputer_Graphics.pptx
Computer_Graphics.pptx
 
Security.pptx
Security.pptxSecurity.pptx
Security.pptx
 
Gravitational_wave_detection.pptx
Gravitational_wave_detection.pptxGravitational_wave_detection.pptx
Gravitational_wave_detection.pptx
 
Embedded_Systems.pptx
Embedded_Systems.pptxEmbedded_Systems.pptx
Embedded_Systems.pptx
 
Software_engineering.pptx
Software_engineering.pptxSoftware_engineering.pptx
Software_engineering.pptx
 
Quantum_computers.pptx
Quantum_computers.pptxQuantum_computers.pptx
Quantum_computers.pptx
 
Sensors_SLAM.pptx
Sensors_SLAM.pptxSensors_SLAM.pptx
Sensors_SLAM.pptx
 
Maths.pptx
Maths.pptxMaths.pptx
Maths.pptx
 

Recently uploaded

The basics of sentences session 4pptx.pptx
The basics of sentences session 4pptx.pptxThe basics of sentences session 4pptx.pptx
The basics of sentences session 4pptx.pptx
heathfieldcps1
 
IATP How-to Foreign Travel May 2024.pdff
IATP How-to Foreign Travel May 2024.pdffIATP How-to Foreign Travel May 2024.pdff
IATP How-to Foreign Travel May 2024.pdff
17thcssbs2
 

Recently uploaded (20)

Features of Video Calls in the Discuss Module in Odoo 17
Features of Video Calls in the Discuss Module in Odoo 17Features of Video Calls in the Discuss Module in Odoo 17
Features of Video Calls in the Discuss Module in Odoo 17
 
The Ball Poem- John Berryman_20240518_001617_0000.pptx
The Ball Poem- John Berryman_20240518_001617_0000.pptxThe Ball Poem- John Berryman_20240518_001617_0000.pptx
The Ball Poem- John Berryman_20240518_001617_0000.pptx
 
BỘ LUYỆN NGHE TIẾNG ANH 8 GLOBAL SUCCESS CẢ NĂM (GỒM 12 UNITS, MỖI UNIT GỒM 3...
BỘ LUYỆN NGHE TIẾNG ANH 8 GLOBAL SUCCESS CẢ NĂM (GỒM 12 UNITS, MỖI UNIT GỒM 3...BỘ LUYỆN NGHE TIẾNG ANH 8 GLOBAL SUCCESS CẢ NĂM (GỒM 12 UNITS, MỖI UNIT GỒM 3...
BỘ LUYỆN NGHE TIẾNG ANH 8 GLOBAL SUCCESS CẢ NĂM (GỒM 12 UNITS, MỖI UNIT GỒM 3...
 
How to Manage Closest Location in Odoo 17 Inventory
How to Manage Closest Location in Odoo 17 InventoryHow to Manage Closest Location in Odoo 17 Inventory
How to Manage Closest Location in Odoo 17 Inventory
 
TỔNG HỢP HƠN 100 ĐỀ THI THỬ TỐT NGHIỆP THPT VẬT LÝ 2024 - TỪ CÁC TRƯỜNG, TRƯ...
TỔNG HỢP HƠN 100 ĐỀ THI THỬ TỐT NGHIỆP THPT VẬT LÝ 2024 - TỪ CÁC TRƯỜNG, TRƯ...TỔNG HỢP HƠN 100 ĐỀ THI THỬ TỐT NGHIỆP THPT VẬT LÝ 2024 - TỪ CÁC TRƯỜNG, TRƯ...
TỔNG HỢP HƠN 100 ĐỀ THI THỬ TỐT NGHIỆP THPT VẬT LÝ 2024 - TỪ CÁC TRƯỜNG, TRƯ...
 
“O BEIJO” EM ARTE .
“O BEIJO” EM ARTE                       .“O BEIJO” EM ARTE                       .
“O BEIJO” EM ARTE .
 
The basics of sentences session 4pptx.pptx
The basics of sentences session 4pptx.pptxThe basics of sentences session 4pptx.pptx
The basics of sentences session 4pptx.pptx
 
2024_Student Session 2_ Set Plan Preparation.pptx
2024_Student Session 2_ Set Plan Preparation.pptx2024_Student Session 2_ Set Plan Preparation.pptx
2024_Student Session 2_ Set Plan Preparation.pptx
 
Morse OER Some Benefits and Challenges.pptx
Morse OER Some Benefits and Challenges.pptxMorse OER Some Benefits and Challenges.pptx
Morse OER Some Benefits and Challenges.pptx
 
An overview of the various scriptures in Hinduism
An overview of the various scriptures in HinduismAn overview of the various scriptures in Hinduism
An overview of the various scriptures in Hinduism
 
Discover the Dark Web .pdf InfosecTrain
Discover the Dark Web .pdf  InfosecTrainDiscover the Dark Web .pdf  InfosecTrain
Discover the Dark Web .pdf InfosecTrain
 
Championnat de France de Tennis de table/
Championnat de France de Tennis de table/Championnat de France de Tennis de table/
Championnat de France de Tennis de table/
 
Removal Strategy _ FEFO _ Working with Perishable Products in Odoo 17
Removal Strategy _ FEFO _ Working with Perishable Products in Odoo 17Removal Strategy _ FEFO _ Working with Perishable Products in Odoo 17
Removal Strategy _ FEFO _ Working with Perishable Products in Odoo 17
 
size separation d pharm 1st year pharmaceutics
size separation d pharm 1st year pharmaceuticssize separation d pharm 1st year pharmaceutics
size separation d pharm 1st year pharmaceutics
 
Dementia (Alzheimer & vasular dementia).
Dementia (Alzheimer & vasular dementia).Dementia (Alzheimer & vasular dementia).
Dementia (Alzheimer & vasular dementia).
 
Application of Matrices in real life. Presentation on application of matrices
Application of Matrices in real life. Presentation on application of matricesApplication of Matrices in real life. Presentation on application of matrices
Application of Matrices in real life. Presentation on application of matrices
 
slides CapTechTalks Webinar May 2024 Alexander Perry.pptx
slides CapTechTalks Webinar May 2024 Alexander Perry.pptxslides CapTechTalks Webinar May 2024 Alexander Perry.pptx
slides CapTechTalks Webinar May 2024 Alexander Perry.pptx
 
The Last Leaf, a short story by O. Henry
The Last Leaf, a short story by O. HenryThe Last Leaf, a short story by O. Henry
The Last Leaf, a short story by O. Henry
 
IATP How-to Foreign Travel May 2024.pdff
IATP How-to Foreign Travel May 2024.pdffIATP How-to Foreign Travel May 2024.pdff
IATP How-to Foreign Travel May 2024.pdff
 
How to Manage Notification Preferences in the Odoo 17
How to Manage Notification Preferences in the Odoo 17How to Manage Notification Preferences in the Odoo 17
How to Manage Notification Preferences in the Odoo 17
 

NLP.pptx

  • 1. Machine Translation How does Google translation work? The History and Progress of Machine Translation Major machine translation services use Artificial Neural Networks (ANN). •Neural networks are a series of algorithms that mimic the operations of an animal brain to recognize relationships between vast amounts of data. •They tend to resemble the connections of neurons and synapses found in the brain. A Brief History of Machine Translation The new field of “Machine Translation” appeared in early 1950s. ・Until the end of 1970s, Rule-Based Machine Translation(RBMT) was the major approach. This word-based approach relies on countless built-in linguistic rules and millions of bilingual dictionaries for each pair. ・The next approach after RBMT was Statistical Machine Translation(SMT). This approach analyzes existing translations developed by humans. SMT is built on phrase-based systems. ・Neural Machine Translation(NMT) was introduced in the last decade. NMT learns from each translation task and improves upon each subsequent translation.
  • 2. LSTM Hook Do you know memory which can remember long term? Key details Long short-term memory(LSTM) is an artificial neural network used in the fields of artificial intelligence and deep learning. A common LSTM unit is composed of 4. 1.cell 2.input gate 3.output gate 4.forget gate LSTM networks are well-suited to 3 things based on time series data. 1.Classifying 2. processing 3.making predictions LSTMs were developed to deal with the vanishing gradient problem that can be encountered when training traditional RNNs. More details LSTM has feedback connections. Such a recurrent neural network (RNN) can process not only single data points (such as images), but also entire sequences of data (such as speech or video). (RNN is a class of artificial neural networks where connections between nodes can create a cycle, allowing output from some nodes to affect subsequent input to the same nodes. ) For example, LSTM is applicable to tasks such as unsegmented, connected handwriting recognition, speech recognition, machine translation, robot control, video games, and healthcare. The general architecture consists of a cell (the storage part of the LSTM unit) and three "regulators" (input gates, output gates, and forget gates) of information flow inside the LSTM unit, mostly called gates. The "cells" are needed to keep track of dependencies between elements in the input array. The "input gates" control the degree to which new values flow into the cell. The "forget gates" control the degree to which values remain in the cell. The "output gates" control the degree to which values in the cell are used to compute the output activation of the LSTM unit.