Question Answering System
Alireza Torabian
Content
QA System
HumanResource
Problems Conclusion
ReferencesNeural
Network
QA System
QA System
HR
Problems
Neural
Network
Conclusion References 1
QA System
▶︎ AutoResponderwithNormalHumanLanguage
▶︎ Answer based on Knowledge Bases
▶︎ InformationRetrievalTechnologyandNaturalLanguageProcessing
QA System
HR
Problems
Neural
Network
Conclusion References 2
QA System
QA System
HR
Problems
Neural
Network
Conclusion References 3
HumanResourceProblems
Lack of
Full-time
HR
Low
Speed
FatigueHigh
Cost
QA System
HR
Problems
Neural
Network
Conclusion References 4
5
Neural Network
▶︎Machinelearningmethods
▶︎Predictoutput
▶︎InspiredbythenaturalNN
▶︎Hugenumberofneurons
QA System
HR
Problems
Neural
Network
Conclusion References 6
RecurrentNeuralNetwork
(RNN)
QA System
HR
Problems
Neural
Network
Conclusion References 7
LSTM
QA System
HR
Problems
Neural
Network
Conclusion References 8
LSTM CellRNN Cell
LSTM
QA System
HR
Problems
Neural
Network
Conclusion References 9
Information (State) Transmission Chain
LSTM
New input effect
QA System
HR
Problems
Neural
Network
Conclusion References 10
LSTM
QA System
HR
Problems
Neural
Network
Conclusion References 11
Calculate new information
LSTM
QA System
HR
Problems
Neural
Network
Conclusion References 12
Forget last and add new information
LSTM
QA System
HR
Problems
Neural
Network
Conclusion References 13
Calculate output
Seq2Seq Model
Encoder
Decoder
<END>
QA System
HR
Problems
Neural
Network
Conclusion References 14
Attention Mechanism
w1 w2 w3 w4 w5
LSTM
Bidirectional
LSTM
QA System
HR
Problems
Neural
Network
Conclusion References 15
Conclusion
QA System
HR
Problems
Neural
Network
Conclusion References 16
▶︎ Automated QA System
▶︎ Need QA Systems
▶︎ RNN
▶︎SequencetoSequenceModel
▶︎ Attention Mechanism
References
[1] A. Andrenucci, E. Sneiders, “Automated question answering: review of the main
approaches” (2005)
[2] Ilya Sutskever, Oriol Vinyals, Quoc V. Le, “Sequence to Sequence Learning with
Neural Networks” (2014)
[3] https://towardsdatascience.com/introduction-to-sequence-models-rnn-
bidirectional-rnn-lstm-gru-73927ec9df15
[4] https://github.com/ematvey/tensorflow-seq2seq-tutorials/blob/master/1-
seq2seq.ipynb
[5] http://colah.github.io/posts/2015-08-Understanding-LSTMs/
QA System
HR
Problems
Neural
Network
Conclusion References 17
Thank You

Question Answering Systems