SlideShare a Scribd company logo
Intern © Siemens AG 2017
Replicated Siamese LSTM in Ticketing System
for Similarity Learning and Retrieval
in Asymmetric Texts
Author(s): Pankaj Gupta1,2, Bernt Andrassy2, Hinrich Schütze1
Presenter: Pankaj Gupta @COLING2018 Santa Fe, NM USA. 20th August 2018
1CIS, University of Munich (LMU) | 2Machine Intelligence, Siemens AG | August 2018
Intern © Siemens AG 2017
May 2017Seite 2 Corporate Technology
Contributors
PANKAJ GUPTA
PhD Candidate @LMU
Research Scientist @Siemens
Munich Germany
Dr. Bernt Andrassy
Senior Key Expert @Siemens
Munich Germany
Prof. Hinrich Schütze
@University of Munich (LMU)
(PhD advisor)
Intern © Siemens AG 2017
May 2017Seite 3 Corporate Technology
Outline
➢ Problem Statement
- Industrial Diagnostic Ticketing System
- Asymmetric Textual Similarity
- Complementary Semantics in Similarity
➢ Background
- Siamese Neural Networks (Siamese-LSTM) in NLP
- Neural Autoregressive Topic Model (DocNADE)
➢ Proposal
- The Replicated Siamese LSTM for STS and IR
- Multi-Channel Manhattan Metric for Complementary Semantics
➢ Evaluations: STS and IR
Intern © Siemens AG 2017
May 2017Seite 4 Corporate Technology
Problem Statement: STS and IR
Semantic Textual Similarity (STS):
➢ Task to find out if the text pairs mean the same thing
➢ Information Retrieval (IR) and text understanding may be improved by
modeling the underlying semantic similarity between texts.
Intern © Siemens AG 2017
May 2017Seite 5 Corporate Technology
Problem Statement: Industrial Diagnostic Ticketing System
Goal: Retrieve a relevant solution for an input query
SUB DESC SOL
…… …… ……
…… …… ……
…… …… ……
SUB: Narrow Frequency Pulsations
DESC: Low and Narrow frequency pulsations were detected. Peak value for the Low Frequency Pulsations is 60 mbar.
SOL: The recommended action is that the machine should not run at load over 28 MW until resolved.
KB of Industrial Tickets
Intelligent Ticketing System (ITS)#TICKET
Intern © Siemens AG 2017
May 2017Seite 6 Corporate Technology
Problem Statement: Industrial Diagnostic Ticketing System
Goal: Retrieve a relevant solution for an input query
SUB DESC SOL
…… …… ……
…… …… ……
…… …… ……
SUB: Narrow Frequency Pulsations
DESC: Low and Narrow frequency pulsations were detected. Peak value for the Low Frequency Pulsations is 60 mbar.
SOL: The recommended action is that the machine should not run at load over 28 MW until resolved.
KB of Industrial Tickets
Intelligent Ticketing System (ITS)#TICKET
SUBJECT text
DESCRIPTION text
QUERY
Solution:
Recommended
Service Action text
Recommendation(s)
Intern © Siemens AG 2017
May 2017Seite 7 Corporate Technology
Problem Statement: Industrial Diagnostic Ticketing System
Goal: Retrieve a relevant solution for an input query
SUB:
GT Trip - Low Frequency Pulsations
DESC:
GT Tripped due to a sudden increase
in Low Frequency Pulsations.
Machine is restarted and now operating
normally. Alarm received was: GT ESD
Low Frequency Pulsation.
SUB: Narrow Frequency Pulsations
DESC: Low and Narrow frequency pulsations were detected.
Peak value for the Low Frequency Pulsations is 60 mbar.
SOL: The recommended action is that the machine should
not run at load over 28 MW until resolved.
The recommended action is that the
machine should not run at loads over
28 MW until resolved.
Recommendation(s)
QUERY
similarity
Retrieval
#TICKET
IN OUT
KB
ITS
Intern © Siemens AG 2017
May 2017Seite 8 Corporate Technology
Problem Statement: Industrial Diagnostic Ticketing System
Goal: Retrieve a relevant solution for an input query
SUB:
GT Trip - Low Frequency Pulsations
DESC:
GT Tripped due to a sudden increase
in Low Frequency Pulsations.
Machine is restarted and now operating
normally. Alarm received was: GT ESD
Low Frequency Pulsation.
SUB: Narrow Frequency Pulsations
DESC: Low and Narrow frequency pulsations were detected.
Peak value for the Low Frequency Pulsations is 60 mbar.
SOL: The recommended action is that the machine should
not run at load over 28 MW until resolved.
The recommended action is that the
machine should not run at loads over
28 MW until resolved.
Recommendation(s)
QUERY
similarity
#TICKET
IN OUT
KB
ITS
Retrieval
Intern © Siemens AG 2017
May 2017Seite 9 Corporate Technology
Problem Statement: Industrial Diagnostic Ticketing System
Goal: Retrieve a relevant solution for an input query
SUB:
GT Trip - Low Frequency Pulsations
DESC:
GT Tripped due to a sudden increase
in Low Frequency Pulsations.
Machine is restarted and now operating
normally. Alarm received was: GT ESD
Low Frequency Pulsation.
SUB: Narrow Frequency Pulsations
DESC: Low and Narrow frequency pulsations were detected.
Peak value for the Low Frequency Pulsations is 60 mbar.
SOL: The recommended action is that the machine should
not run at load over 28 MW until resolved.
The recommended action is that the
machine should not run at loads over
28 MW until resolved.
Recommendation(s)
QUERY
similarity
Retrieval
#TICKET
IN OUT
KB
ITS
Intern © Siemens AG 2017
May 2017Seite 10 Corporate Technology
Problem Statement: Industrial Diagnostic Ticketing System
Goal: Retrieve a relevant solution for an input query
SUB:
GT Trip - Low Frequency Pulsations
DESC:
GT Tripped due to a sudden increase
in Low Frequency Pulsations.
Machine is restarted and now operating
normally. Alarm received was: GT ESD
Low Frequency Pulsation.
SUB: Narrow Frequency Pulsations
DESC: Low and Narrow frequency pulsations were detected.
Peak value for the Low Frequency Pulsations is 60 mbar.
SOL: The recommended action is that the machine should
not run at load over 28 MW until resolved.
The recommended action is that the
machine should not run at loads over
28 MW until resolved.
Recommendation(s)
QUERY
similarity
#TICKET
IN OUT
KB
ITS
Intern © Siemens AG 2017
May 2017Seite 11 Corporate Technology
Problem Statement: Industrial Diagnostic Ticketing System
Goal: Retrieve a relevant solution for an input query
SUB:
GT Trip - Low Frequency Pulsations
DESC:
GT Tripped due to a sudden increase
in Low Frequency Pulsations.
Machine is restarted and now operating
normally. Alarm received was: GT ESD
Low Frequency Pulsation.
SUB: Narrow Frequency Pulsations
DESC: Low and Narrow frequency pulsations were detected.
Peak value for the Low Frequency Pulsations is 60 mbar.
SOL: The recommended action is that the machine should
not run at load over 28 MW until resolved.
The recommended action is that the
machine should not run at loads over
28 MW until resolved.
Recommendation(s)
QUERY
similarity
#TICKET
IN OUT
KB
cosine similarity
(low, narrow) = 0.26
ITS
Intern © Siemens AG 2017
May 2017Seite 12 Corporate Technology
Problem Statement: Industrial Diagnostic Ticketing System
Goal: Retrieve a relevant solution for an input query
SUB:
GT Trip - Low Frequency Pulsations
DESC:
GT Tripped due to a sudden increase
in Low Frequency Pulsations.
Machine is restarted and now operating
normally. Alarm received was: GT ESD
Low Frequency Pulsation.
SUB: Narrow Frequency Pulsations
DESC: Low and Narrow frequency pulsations were detected.
Peak value for the Low Frequency Pulsations is 60 mbar.
SOL: The recommended action is that the machine should
not run at load over 28 MW until resolved.
The recommended action is that the
machine should not run at loads over
28 MW until resolved.
Recommendation(s)
QUERY
similarity
#TICKET
IN OUT
KB
cosine similarity
(frequency, load) = 0.14
ITS
Intern © Siemens AG 2017
May 2017Seite 13 Corporate Technology
Problem Statement: Industrial Diagnostic Ticketing System
Goal: Retrieve a relevant solution for an input query
SUB: Narrow Frequency Pulsations
DESC: Low and Narrow frequency pulsations were detected.
Peak value for the Low Frequency Pulsations is 60 mbar .
SOL: The recommended action is that the machine should
not run at loads over 28 MW until resolved.
The recommended action is that the
machine should not run at loads over
28 MW until resolved.
Recommendation(s)
similarity
#TICKET
IN OUT
KB
cosine similarity
(frequency, mbar) = 0.25
SUB:
GT Trip - Low Frequency Pulsations
DESC:
GT Tripped due to a sudden increase
in Low Frequency Pulsations.
Machine is restarted and now operating
normally. Alarm received was: GT ESD
Low Frequency Pulsation.
QUERY
ITS
Intern © Siemens AG 2017
May 2017Seite 14 Corporate Technology
Problem Statement: Industrial Diagnostic Ticketing System
Goal: Retrieve a relevant solution for an input query
SUB: Narrow Frequency Pulsations
DESC: Low and Narrow frequency pulsations were detected.
Peak value for the Low Frequency Pulsations is 60 mbar .
SOL: The recommended action is that the machine should
not run at loads over 28 MW until resolved.
The recommended action is that the
machine should not run at loads over
28 MW until resolved.
Recommendation(s)
similarity
#TICKET
IN OUT
KBcosine similarity
(frequency, MW) = 0.08
SUB:
GT Trip - Low Frequency Pulsations
DESC:
GT Tripped due to a sudden increase
in Low Frequency Pulsations.
Machine is restarted and now operating
normally. Alarm received was: GT ESD
Low Frequency Pulsation.
QUERY
ITS
Intern © Siemens AG 2017
May 2017Seite 15 Corporate Technology
Problem Statement: Significant Term Mismatch
Goal: Retrieve a relevant solution for an input query
SOL: The recommended action is that the machine should
not run at loads over 28 MW until resolved.
The recommended action is that the
machine should not run at loads over
28 MW until resolved.
Recommendation(s)
similarity
#TICKET
IN OUT
KB(Significant Term Mismatch)
SUB:
GT Trip - Low Frequency Pulsations
QUERY
ITS
Intern © Siemens AG 2017
May 2017Seite 17 Corporate Technology
Problem Statement: Symmetric Textual Similarity
Goal: Retrieve a relevant solution for an input query
SUB: Narrow Frequency Pulsations
The recommended action is that the
machine should not run at loads over
28 MW until resolved.
Recommendation(s)
similarity
#TICKET
IN OUT
KB
Symmetric Text pairs
(short Vs short texts)
SUB:
GT Trip - Low Frequency Pulsations
QUERY
ITS
Intern © Siemens AG 2017
May 2017Seite 18 Corporate Technology
Problem Statement: Symmetric Textual Similarity
Goal: Retrieve a relevant solution for an input query
DESC: Low and Narrow frequency pulsations were detected.
Peak value for the Low Frequency Pulsations is 60 mbar .
The recommended action is that the
machine should not run at loads over
28 MW until resolved.
Recommendation(s)
similarity
#TICKET
IN OUT
KB
Symmetric Text pairs
(long Vs long texts)
DESC:
GT Tripped due to a sudden increase
in Low Frequency Pulsations.
Machine is restarted and now operating
normally. Alarm received was: GT ESD
Low Frequency Pulsation.
QUERY
ITS
Intern © Siemens AG 2017
May 2017Seite 19 Corporate Technology
Problem Statement: Asymmetric Textual Similarity
Goal: Retrieve a relevant solution for an input query
DESC: Low and Narrow frequency pulsations were detected.
Peak value for the Low Frequency Pulsations is 60 mbar .
The recommended action is that the
machine should not run at loads over
28 MW until resolved.
Recommendation(s)
similarity
#TICKET
IN OUT
KB
Asymmetric Text pairs
(short Vs multi-sentence texts)
SUB:
GT Trip - Low Frequency Pulsations
QUERY
ITS
Intern © Siemens AG 2017
May 2017Seite 20 Corporate Technology
Problem Statement: Asymmetric Textual Similarity
Goal: Retrieve a relevant solution for an input query
SOL: The recommended action is that the machine should
not run at loads over 28 MW until resolved.
The recommended action is that the
machine should not run at loads over
28 MW until resolved.
Recommendation(s)
similarity
#TICKET
IN OUT
KB
Asymmetric Text pairs
(short Vs multi-sentence texts)
SUB:
GT Trip - Low Frequency Pulsations
QUERY
ITS
Intern © Siemens AG 2017
May 2017Seite 21 Corporate Technology
Complementary Semantic Learning and Similarity
Goal: Retrieve a relevant solution for an input query
SUB: Narrow Frequency Pulsations
DESC: Low and Narrow frequency pulsations were detected.
Peak value for the Low Frequency Pulsations is 60 mbar .
SOL: The recommended action is that the machine should
not run at loads over 28 MW until resolved.
The recommended action is that the
machine should not run at loads over
28 MW until resolved.
Recommendation(s)
similarity
#TICKET
IN OUT
KB
Complementary Semantics
(Coarse Vs fine Granularity)
SUB:
GT Trip - Low Frequency Pulsations
DESC:
GT Tripped due to a sudden increase
in Low Frequency Pulsations.
Machine is restarted and now operating
normally. Alarm received was: GT ESD
Low Frequency Pulsation.
QUERY
ITS
Intern © Siemens AG 2017
May 2017Seite 22 Corporate Technology
Complementary Semantic Learning and Similarity
SUB: Narrow Frequency Pulsations
DESC: Low and Narrow frequency pulsations were detected.
Peak value for the Low Frequency Pulsations is 60 mbar .
SOL: The recommended action is that the machine should
not run at loads over 28 MW until resolved.
The recommended action is that the
machine should not run at loads over
28 MW until resolved.
Recommendation(s)
similarity
#TICKET
IN OUT
KB
Complementary Semantics
(Coarse Vs fine Granularity)
SUB:
GT Trip - Low Frequency Pulsations
DESC:
GT Tripped due to a sudden increase
in Low Frequency Pulsations.
Machine is restarted and now operating
normally. Alarm received was: GT ESD
Low Frequency Pulsation.
QUERY
similarity in latent topic semantics
ITS
Intern © Siemens AG 2017
May 2017Seite 23 Corporate Technology
Complementary Semantic Learning and Similarity
SUB: Narrow Frequency Pulsations
DESC: Low and Narrow frequency pulsations were detected.
Peak value for the Low Frequency Pulsations is 60 mbar .
SOL: The recommended action is that the machine should
not run at loads over 28 MW until resolved.
The recommended action is that the
machine should not run at loads over
28 MW until resolved.
Recommendation(s)
similarity
#TICKET
IN OUT
KB
Learn Complementary
Text Pair Representations
in a Highly Structured Space
SUB:
GT Trip - Low Frequency Pulsations
DESC:
GT Tripped due to a sudden increase
in Low Frequency Pulsations.
Machine is restarted and now operating
normally. Alarm received was: GT ESD
Low Frequency Pulsation.
QUERY
similarity in latent topic semantics
ITS
Intern © Siemens AG 2017
May 2017Seite 24 Corporate Technology
Background: Siamese Networks in NLP
Reference: Mueller and Thyagarajan, 2016
- dual-branch networks with tied weights
- non-linear metric learning with similarity information
- Invariant and selective representation directly through the
use of similarity and dissimilarity information
Intern © Siemens AG 2017
May 2017Seite 25 Corporate Technology
Background: Siamese Networks in NLP
Reference: Mueller and Thyagarajan, 2016
Limited to
sentence pairs
- dual-branch networks with tied weights
- non-linear metric learning with similarity information
- Invariant and selective representation directly through the
use of similarity and dissimilarity information
Intern © Siemens AG 2017
May 2017Seite 26 Corporate Technology
Background: Document Neural Autoregressive Topic Model (DocNADE)
Reference: Gupta et al. Document Informed Autoregressive Topic Models. Preprint: https://arxiv.org/pdf/1808.03793.pdf
- Learn word co-occureances across documents
- Extract latent topics (coarse grained representation)
- Optimise via reconstruction loss where, input should
be reproduced by the decoding part of the network.
Intern © Siemens AG 2017
May 2017Seite 27 Corporate Technology
Proposal: Multi-Channel, Replicated and Multi-Cross Level Siamese
Query Component(s)
subscripted
by 1 e.g., X1
Ticket Component(s)
subscripted
by 2 e.g., X2
Intern © Siemens AG 2017
May 2017Seite 28 Corporate Technology
Proposal: Multi-Channel, Replicated and Multi-Cross Level Siamese
DocNADE
DocNADE
DocNADE
DocNADE
DocNADE
Intern © Siemens AG 2017
May 2017Seite 29 Corporate Technology
Proposal: Multi-Channel, Replicated and Multi-Cross Level Siamese
Multi-channel for
Complementary Semantics !!!
DocNADE
DocNADE
DocNADE
DocNADE
DocNADE
Intern © Siemens AG 2017
May 2017Seite 30 Corporate Technology
Proposal: Multi-Channel, Replicated and Multi-Cross Level Siamese
Multi-channel for
Complementary Semantics !!!
DocNADE
DocNADE
DocNADE
DocNADE
DocNADE
Intern © Siemens AG 2017
May 2017Seite 31 Corporate Technology
Proposal: Multi-Channel, Replicated and Multi-Cross Level Siamese
Replicated !!!
W
W
W
W
W
DocNADE
DocNADE
DocNADE
DocNADE
DocNADE
Intern © Siemens AG 2017
May 2017Seite 32 Corporate Technology
Proposal: Multi-Channel, Replicated and Multi-Cross Level Siamese
Multi-level Similarity !!!
e.g. SUB1-SUB2, DESC1-DESC2
W
W
W
W
W
DocNADE
DocNADE
DocNADE
DocNADE
DocNADEi.e. symmetric textual similarities
Intern © Siemens AG 2017
May 2017Seite 33 Corporate Technology
Proposal: Multi-Channel, Replicated and Multi-Cross Level Siamese
Cross-level Similarity !!!
e.g. SUB1-DESC2, DESC1-SOL2, etc.
W
W
W
W
W
DocNADE
DocNADE
DocNADE
DocNADE
DocNADE
i.e. asymmetric textual similarities
Intern © Siemens AG 2017
May 2017Seite 34 Corporate Technology
Proposal: Multi-Channel, Replicated and Multi-Cross Level Siamese
Cross-level Similarity !!!
e.g. SUB1-DESC2, SUB1-SOL2, etc.
W
W
W
W
W
DocNADE
DocNADE
DocNADE
DocNADE
DocNADE
i.e. asymmetric textual similarities
Intern © Siemens AG 2017
May 2017Seite 35 Corporate Technology
Proposal: Multi-Channel, Replicated and Multi-Cross Level Siamese
Cross-level Similarity !!!
e.g. SUB1-DESC2, DESC1-SOL2, etc.
W
W
W
W
W
DocNADE
DocNADE
DocNADE
DocNADE
DocNADE
Intern © Siemens AG 2017
May 2017Seite 36 Corporate Technology
Proposal: Multi-Channel, Replicated and Multi-Cross Level Siamese
Cross-level Similarity !!!
e.g. SUB1-DESC2, DESC1-SUB2, etc.
W
W
W
W
W
DocNADE
DocNADE
DocNADE
DocNADE
DocNADE
i.e. asymmetric textual similarities
Intern © Siemens AG 2017
May 2017Seite 37 Corporate Technology
Proposal: Multi-Channel, Replicated and Multi-Cross Level Siamese
Overall Learning !!!
W
W
W
W
W
DocNADE
DocNADE
DocNADE
DocNADE
DocNADE
Intern © Siemens AG 2017
May 2017Seite 38 Corporate Technology
Proposal: Multi-Channel Manhattan Metric with Complementary Semantics
Multi-Channel Manhattan Metric
Intern © Siemens AG 2017
May 2017Seite 39 Corporate Technology
Proposal: Multi-Channel Manhattan Metric with Complementary Semantics
Weighted semantic distances
+ Weighted ‘level’ similarity
Multi-Channel Manhattan Metric
Intern © Siemens AG 2017
May 2017Seite 40 Corporate Technology
Evaluation
Intern © Siemens AG 2017
May 2017Seite 41 Corporate Technology
Evaluation
➢ Industrial Data Set
- 949 historical tickets in the KB
- 421 pairs labeled
- relatedness labels: YES (similar that provides correct solution): 5.0
REL (does not provide correct solution, but close to a solution): 3.0 and
NO (not related, not relevant and provides no correct solution): 1.0
- average length (#words) of SUB: (4.6); DESC: (65.0); SOL: (74.2).
➢ Baselines
- Unsupervised (topic and word embedding representations)
- Supervised (Siamese LSTM)
➢ Evaluation and Analysis the proposed Replicated Siamese LSTM
Intern © Siemens AG 2017
May 2017Seite 42 Corporate Technology
Evaluation: LDA Vs DocNADE
Intern © Siemens AG 2017
May 2017Seite 43 Corporate Technology
Evaluation: Unsupervised Baselines for STS and IR
SIMILARITY: Pearson correlation (r), Spearmans correlation coefficient (p), Mean Squared Error (MSE),
IR: Mean Average Precision@k (MAP@k) and Accuracy@k (Acc@k)
Topic (T) semantics from Query and Ticket components i.e. T(SUB1-SUB2), etc.
Intern © Siemens AG 2017
May 2017Seite 44 Corporate Technology
Evaluation: Unsupervised Baselines for STS and IR
SIMILARITY: Pearson correlation (r), Spearmans correlation coefficient (p), Mean Squared Error (MSE),
IR: Mean Average Precision@k (MAP@k) and Accuracy@k (Acc@k)
Topic (T) semantics from Query and Ticket components i.e. T(SUB1-SUB2), etc.
Intern © Siemens AG 2017
May 2017Seite 45 Corporate Technology
Evaluation: Unsupervised Baselines for STS and IR
Topic (T) semantics from Query and Ticket components i.e. T(SUB1-SUB2), etc.
SIMILARITY: Pearson correlation (r), Spearmans correlation coefficient (p), Mean Squared Error (MSE),
IR: Mean Average Precision@k (MAP@k) and Accuracy@k (Acc@k)
Intern © Siemens AG 2017
May 2017Seite 46 Corporate Technology
Evaluation: Unsupervised Baselines for STS and IR
Topic (T) semantics from Query and Ticket components i.e. T(SUB1-SUB2), etc.
Distributional Semantics (SumEmbedding) (E) for Query and Ticket components i.e.
E(SUB1-SUB2), . E(SUB1+DESC1-SUB2+DESC2+SOL2), etc.
Intern © Siemens AG 2017
May 2017Seite 47 Corporate Technology
Evaluation: Supervised Baselines for STS and IR
S-LSTM: Compute Similarity using Standard Siamese LSTM on a query and ticket components
Intern © Siemens AG 2017
May 2017Seite 48 Corporate Technology
Evaluation: Supervised Baselines for STS and IR
ML-LSTM: Multi-level similarity
Intern © Siemens AG 2017
May 2017Seite 49 Corporate Technology
Evaluation: Supervised Baselines for STS and IR
CL-LSTM: Cross-level similarity
Intern © Siemens AG 2017
May 2017Seite 50 Corporate Technology
Evaluation: Supervised Baselines for STS and IR
Multi-channel semantic similarity
Intern © Siemens AG 2017
May 2017Seite 51 Corporate Technology
Evaluation: Supervised Baselines for STS and IR
Multi-channel semantic similarity
7%
Intern © Siemens AG 2017
May 2017Seite 52 Corporate Technology
Qualitative Inspections for STS and IR
topics
Intern © Siemens AG 2017
May 2017Seite 53 Corporate Technology
Qualitative Inspections for STS and IR
topics
Intern © Siemens AG 2017
May 2017Seite 54 Corporate Technology
Conclusion
➢ Advancement of Siamese architecture for similarity learning in
asymmetric text pairs, instead of sentence pairs only
➢ Proposed Replicated Siamese LSTM with multi/cross level similarity
➢ Gain of 22% and 7% (Acc@10), respectively over unsupervised and supervised baselines in IR
➢ Demonstrated complementary semantics improved similarity/retrieval performance
➢ Address/Improve the real-world industrial application of ticketing system
Intern © Siemens AG 2017
May 2017Seite 55 Corporate Technology
Thanks !!!
W
W
W
W
W
DocNADE
DocNADE
DocNADE
DocNADE
DocNADE

More Related Content

Similar to Replicated Siamese LSTM in Ticketing System for Similarity Learning and Retrieval in Asymmetric Texts

Ananthprofilepln
AnanthprofileplnAnanthprofilepln
Ananthprofileplnananthch
 
Javier Garcia - Verdugo Sanchez - Six Sigma Training - W1 Process Capability
Javier Garcia - Verdugo Sanchez - Six Sigma Training - W1 Process CapabilityJavier Garcia - Verdugo Sanchez - Six Sigma Training - W1 Process Capability
Javier Garcia - Verdugo Sanchez - Six Sigma Training - W1 Process Capability
J. García - Verdugo
 
TMT SequenceL customer use cases and results
TMT SequenceL customer use cases and resultsTMT SequenceL customer use cases and results
TMT SequenceL customer use cases and results
Doug Norton
 
Danikor Product Catalog- Screw Feeder.pdf
Danikor Product Catalog- Screw Feeder.pdfDanikor Product Catalog- Screw Feeder.pdf
Danikor Product Catalog- Screw Feeder.pdf
thietkevietthinh
 
Group 10
Group 10Group 10
LEGaTO: Low-Energy Heterogeneous Computing Use of AI in the project
LEGaTO: Low-Energy Heterogeneous Computing Use of AI in the projectLEGaTO: Low-Energy Heterogeneous Computing Use of AI in the project
LEGaTO: Low-Energy Heterogeneous Computing Use of AI in the project
LEGATO project
 
James Goss - Motor Design Limited
James Goss - Motor Design Limited James Goss - Motor Design Limited
James Goss - Motor Design Limited
cwiemeexpo
 
Performance Evaluation of Various CMOS Full Adder Designs: A Review
Performance Evaluation of  Various CMOS Full Adder Designs: A ReviewPerformance Evaluation of  Various CMOS Full Adder Designs: A Review
Performance Evaluation of Various CMOS Full Adder Designs: A Review
IRJET Journal
 
Low power in vlsi with upf basics part 1
Low power in vlsi with upf basics part 1Low power in vlsi with upf basics part 1
Low power in vlsi with upf basics part 1
SUNODH GARLAPATI
 
Intelligent Production: Deploying IoT and cloud-based machine learning to opt...
Intelligent Production: Deploying IoT and cloud-based machine learning to opt...Intelligent Production: Deploying IoT and cloud-based machine learning to opt...
Intelligent Production: Deploying IoT and cloud-based machine learning to opt...
Amazon Web Services
 
Nidec asi capability overview for oil&gas applications
Nidec asi capability overview for oil&gas applicationsNidec asi capability overview for oil&gas applications
Nidec asi capability overview for oil&gas applications
Nidec Corporation
 
Multi-Objective Optimization of Solar Cells Thermal Uniformity Using Combined...
Multi-Objective Optimization of Solar Cells Thermal Uniformity Using Combined...Multi-Objective Optimization of Solar Cells Thermal Uniformity Using Combined...
Multi-Objective Optimization of Solar Cells Thermal Uniformity Using Combined...eArtius, Inc.
 
IRJET- Energy Efficient One Bit Subtractor Circuits for Computing Application...
IRJET- Energy Efficient One Bit Subtractor Circuits for Computing Application...IRJET- Energy Efficient One Bit Subtractor Circuits for Computing Application...
IRJET- Energy Efficient One Bit Subtractor Circuits for Computing Application...
IRJET Journal
 
autoTVM
autoTVMautoTVM
autoTVM
Yi-Wen Hung
 
Accelerating Data Science With GPUs
Accelerating Data Science With GPUsAccelerating Data Science With GPUs
Accelerating Data Science With GPUs
iguazio
 
A Technique for Dynamic Range Improvement of Intermodulation Distortion Produ...
A Technique for Dynamic Range Improvement of Intermodulation Distortion Produ...A Technique for Dynamic Range Improvement of Intermodulation Distortion Produ...
A Technique for Dynamic Range Improvement of Intermodulation Distortion Produ...
Pete Sarson, PH.D
 
A Methodology for Automatic GPU Kernel Optimization
A Methodology for Automatic GPU Kernel OptimizationA Methodology for Automatic GPU Kernel Optimization
A Methodology for Automatic GPU Kernel Optimization
NECST Lab @ Politecnico di Milano
 

Similar to Replicated Siamese LSTM in Ticketing System for Similarity Learning and Retrieval in Asymmetric Texts (20)

Ananthprofilepln
AnanthprofileplnAnanthprofilepln
Ananthprofilepln
 
Javier Garcia - Verdugo Sanchez - Six Sigma Training - W1 Process Capability
Javier Garcia - Verdugo Sanchez - Six Sigma Training - W1 Process CapabilityJavier Garcia - Verdugo Sanchez - Six Sigma Training - W1 Process Capability
Javier Garcia - Verdugo Sanchez - Six Sigma Training - W1 Process Capability
 
TMT SequenceL customer use cases and results
TMT SequenceL customer use cases and resultsTMT SequenceL customer use cases and results
TMT SequenceL customer use cases and results
 
Magma trcak b
Magma  trcak bMagma  trcak b
Magma trcak b
 
Danikor Product Catalog- Screw Feeder.pdf
Danikor Product Catalog- Screw Feeder.pdfDanikor Product Catalog- Screw Feeder.pdf
Danikor Product Catalog- Screw Feeder.pdf
 
Group 10
Group 10Group 10
Group 10
 
LEGaTO: Low-Energy Heterogeneous Computing Use of AI in the project
LEGaTO: Low-Energy Heterogeneous Computing Use of AI in the projectLEGaTO: Low-Energy Heterogeneous Computing Use of AI in the project
LEGaTO: Low-Energy Heterogeneous Computing Use of AI in the project
 
Ndabeni_Thobekile_212125710
Ndabeni_Thobekile_212125710Ndabeni_Thobekile_212125710
Ndabeni_Thobekile_212125710
 
James Goss - Motor Design Limited
James Goss - Motor Design Limited James Goss - Motor Design Limited
James Goss - Motor Design Limited
 
Performance Evaluation of Various CMOS Full Adder Designs: A Review
Performance Evaluation of  Various CMOS Full Adder Designs: A ReviewPerformance Evaluation of  Various CMOS Full Adder Designs: A Review
Performance Evaluation of Various CMOS Full Adder Designs: A Review
 
Low power in vlsi with upf basics part 1
Low power in vlsi with upf basics part 1Low power in vlsi with upf basics part 1
Low power in vlsi with upf basics part 1
 
Intelligent Production: Deploying IoT and cloud-based machine learning to opt...
Intelligent Production: Deploying IoT and cloud-based machine learning to opt...Intelligent Production: Deploying IoT and cloud-based machine learning to opt...
Intelligent Production: Deploying IoT and cloud-based machine learning to opt...
 
Project Presentation
Project PresentationProject Presentation
Project Presentation
 
Nidec asi capability overview for oil&gas applications
Nidec asi capability overview for oil&gas applicationsNidec asi capability overview for oil&gas applications
Nidec asi capability overview for oil&gas applications
 
Multi-Objective Optimization of Solar Cells Thermal Uniformity Using Combined...
Multi-Objective Optimization of Solar Cells Thermal Uniformity Using Combined...Multi-Objective Optimization of Solar Cells Thermal Uniformity Using Combined...
Multi-Objective Optimization of Solar Cells Thermal Uniformity Using Combined...
 
IRJET- Energy Efficient One Bit Subtractor Circuits for Computing Application...
IRJET- Energy Efficient One Bit Subtractor Circuits for Computing Application...IRJET- Energy Efficient One Bit Subtractor Circuits for Computing Application...
IRJET- Energy Efficient One Bit Subtractor Circuits for Computing Application...
 
autoTVM
autoTVMautoTVM
autoTVM
 
Accelerating Data Science With GPUs
Accelerating Data Science With GPUsAccelerating Data Science With GPUs
Accelerating Data Science With GPUs
 
A Technique for Dynamic Range Improvement of Intermodulation Distortion Produ...
A Technique for Dynamic Range Improvement of Intermodulation Distortion Produ...A Technique for Dynamic Range Improvement of Intermodulation Distortion Produ...
A Technique for Dynamic Range Improvement of Intermodulation Distortion Produ...
 
A Methodology for Automatic GPU Kernel Optimization
A Methodology for Automatic GPU Kernel OptimizationA Methodology for Automatic GPU Kernel Optimization
A Methodology for Automatic GPU Kernel Optimization
 

More from Pankaj Gupta, PhD

textTOvec: Deep Contextualized Neural Autoregressive Topic Models of Language...
textTOvec: Deep Contextualized Neural Autoregressive Topic Models of Language...textTOvec: Deep Contextualized Neural Autoregressive Topic Models of Language...
textTOvec: Deep Contextualized Neural Autoregressive Topic Models of Language...
Pankaj Gupta, PhD
 
Neural NLP Models of Information Extraction
Neural NLP Models of Information ExtractionNeural NLP Models of Information Extraction
Neural NLP Models of Information Extraction
Pankaj Gupta, PhD
 
Poster: Neural Relation ExtractionWithin and Across Sentence Boundaries
Poster: Neural Relation ExtractionWithin and Across Sentence BoundariesPoster: Neural Relation ExtractionWithin and Across Sentence Boundaries
Poster: Neural Relation ExtractionWithin and Across Sentence Boundaries
Pankaj Gupta, PhD
 
Poster: Document Informed Neural Autoregressive Topic Models with Distributio...
Poster: Document Informed Neural Autoregressive Topic Models with Distributio...Poster: Document Informed Neural Autoregressive Topic Models with Distributio...
Poster: Document Informed Neural Autoregressive Topic Models with Distributio...
Pankaj Gupta, PhD
 
Document Informed Neural Autoregressive Topic Models with Distributional Prior
Document Informed Neural Autoregressive Topic Models with Distributional PriorDocument Informed Neural Autoregressive Topic Models with Distributional Prior
Document Informed Neural Autoregressive Topic Models with Distributional Prior
Pankaj Gupta, PhD
 
Neural Relation ExtractionWithin and Across Sentence Boundaries
Neural Relation ExtractionWithin and Across Sentence BoundariesNeural Relation ExtractionWithin and Across Sentence Boundaries
Neural Relation ExtractionWithin and Across Sentence Boundaries
Pankaj Gupta, PhD
 
Deep Learning for Information Extraction in Natural Language Text
Deep Learning for Information Extraction in Natural Language TextDeep Learning for Information Extraction in Natural Language Text
Deep Learning for Information Extraction in Natural Language Text
Pankaj Gupta, PhD
 
textTOvec: DEEP CONTEXTUALIZED NEURAL AUTOREGRESSIVE TOPIC MODELS OF LANGUAGE...
textTOvec: DEEP CONTEXTUALIZED NEURAL AUTOREGRESSIVE TOPIC MODELS OF LANGUAGE...textTOvec: DEEP CONTEXTUALIZED NEURAL AUTOREGRESSIVE TOPIC MODELS OF LANGUAGE...
textTOvec: DEEP CONTEXTUALIZED NEURAL AUTOREGRESSIVE TOPIC MODELS OF LANGUAGE...
Pankaj Gupta, PhD
 
Pankaj Gupta CV / Resume
Pankaj Gupta CV / ResumePankaj Gupta CV / Resume
Pankaj Gupta CV / Resume
Pankaj Gupta, PhD
 
LISA: Explaining RNN Judgments via Layer-wIse Semantic Accumulation and Examp...
LISA: Explaining RNN Judgments via Layer-wIse Semantic Accumulation and Examp...LISA: Explaining RNN Judgments via Layer-wIse Semantic Accumulation and Examp...
LISA: Explaining RNN Judgments via Layer-wIse Semantic Accumulation and Examp...
Pankaj Gupta, PhD
 
Joint Bootstrapping Machines for High Confidence Relation Extraction
Joint Bootstrapping Machines for High Confidence Relation ExtractionJoint Bootstrapping Machines for High Confidence Relation Extraction
Joint Bootstrapping Machines for High Confidence Relation Extraction
Pankaj Gupta, PhD
 
RNN-RSM (Topics over Time) | NAACL2018 conference talk
RNN-RSM (Topics over Time) | NAACL2018 conference talkRNN-RSM (Topics over Time) | NAACL2018 conference talk
RNN-RSM (Topics over Time) | NAACL2018 conference talk
Pankaj Gupta, PhD
 
Lecture 07: Representation and Distributional Learning by Pankaj Gupta
Lecture 07: Representation and Distributional Learning by Pankaj GuptaLecture 07: Representation and Distributional Learning by Pankaj Gupta
Lecture 07: Representation and Distributional Learning by Pankaj Gupta
Pankaj Gupta, PhD
 
Lecture 05: Recurrent Neural Networks / Deep Learning by Pankaj Gupta
Lecture 05: Recurrent Neural Networks / Deep Learning by Pankaj GuptaLecture 05: Recurrent Neural Networks / Deep Learning by Pankaj Gupta
Lecture 05: Recurrent Neural Networks / Deep Learning by Pankaj Gupta
Pankaj Gupta, PhD
 

More from Pankaj Gupta, PhD (14)

textTOvec: Deep Contextualized Neural Autoregressive Topic Models of Language...
textTOvec: Deep Contextualized Neural Autoregressive Topic Models of Language...textTOvec: Deep Contextualized Neural Autoregressive Topic Models of Language...
textTOvec: Deep Contextualized Neural Autoregressive Topic Models of Language...
 
Neural NLP Models of Information Extraction
Neural NLP Models of Information ExtractionNeural NLP Models of Information Extraction
Neural NLP Models of Information Extraction
 
Poster: Neural Relation ExtractionWithin and Across Sentence Boundaries
Poster: Neural Relation ExtractionWithin and Across Sentence BoundariesPoster: Neural Relation ExtractionWithin and Across Sentence Boundaries
Poster: Neural Relation ExtractionWithin and Across Sentence Boundaries
 
Poster: Document Informed Neural Autoregressive Topic Models with Distributio...
Poster: Document Informed Neural Autoregressive Topic Models with Distributio...Poster: Document Informed Neural Autoregressive Topic Models with Distributio...
Poster: Document Informed Neural Autoregressive Topic Models with Distributio...
 
Document Informed Neural Autoregressive Topic Models with Distributional Prior
Document Informed Neural Autoregressive Topic Models with Distributional PriorDocument Informed Neural Autoregressive Topic Models with Distributional Prior
Document Informed Neural Autoregressive Topic Models with Distributional Prior
 
Neural Relation ExtractionWithin and Across Sentence Boundaries
Neural Relation ExtractionWithin and Across Sentence BoundariesNeural Relation ExtractionWithin and Across Sentence Boundaries
Neural Relation ExtractionWithin and Across Sentence Boundaries
 
Deep Learning for Information Extraction in Natural Language Text
Deep Learning for Information Extraction in Natural Language TextDeep Learning for Information Extraction in Natural Language Text
Deep Learning for Information Extraction in Natural Language Text
 
textTOvec: DEEP CONTEXTUALIZED NEURAL AUTOREGRESSIVE TOPIC MODELS OF LANGUAGE...
textTOvec: DEEP CONTEXTUALIZED NEURAL AUTOREGRESSIVE TOPIC MODELS OF LANGUAGE...textTOvec: DEEP CONTEXTUALIZED NEURAL AUTOREGRESSIVE TOPIC MODELS OF LANGUAGE...
textTOvec: DEEP CONTEXTUALIZED NEURAL AUTOREGRESSIVE TOPIC MODELS OF LANGUAGE...
 
Pankaj Gupta CV / Resume
Pankaj Gupta CV / ResumePankaj Gupta CV / Resume
Pankaj Gupta CV / Resume
 
LISA: Explaining RNN Judgments via Layer-wIse Semantic Accumulation and Examp...
LISA: Explaining RNN Judgments via Layer-wIse Semantic Accumulation and Examp...LISA: Explaining RNN Judgments via Layer-wIse Semantic Accumulation and Examp...
LISA: Explaining RNN Judgments via Layer-wIse Semantic Accumulation and Examp...
 
Joint Bootstrapping Machines for High Confidence Relation Extraction
Joint Bootstrapping Machines for High Confidence Relation ExtractionJoint Bootstrapping Machines for High Confidence Relation Extraction
Joint Bootstrapping Machines for High Confidence Relation Extraction
 
RNN-RSM (Topics over Time) | NAACL2018 conference talk
RNN-RSM (Topics over Time) | NAACL2018 conference talkRNN-RSM (Topics over Time) | NAACL2018 conference talk
RNN-RSM (Topics over Time) | NAACL2018 conference talk
 
Lecture 07: Representation and Distributional Learning by Pankaj Gupta
Lecture 07: Representation and Distributional Learning by Pankaj GuptaLecture 07: Representation and Distributional Learning by Pankaj Gupta
Lecture 07: Representation and Distributional Learning by Pankaj Gupta
 
Lecture 05: Recurrent Neural Networks / Deep Learning by Pankaj Gupta
Lecture 05: Recurrent Neural Networks / Deep Learning by Pankaj GuptaLecture 05: Recurrent Neural Networks / Deep Learning by Pankaj Gupta
Lecture 05: Recurrent Neural Networks / Deep Learning by Pankaj Gupta
 

Recently uploaded

20240520 Planning a Circuit Simulator in JavaScript.pptx
20240520 Planning a Circuit Simulator in JavaScript.pptx20240520 Planning a Circuit Simulator in JavaScript.pptx
20240520 Planning a Circuit Simulator in JavaScript.pptx
Sharon Liu
 
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
yqqaatn0
 
DERIVATION OF MODIFIED BERNOULLI EQUATION WITH VISCOUS EFFECTS AND TERMINAL V...
DERIVATION OF MODIFIED BERNOULLI EQUATION WITH VISCOUS EFFECTS AND TERMINAL V...DERIVATION OF MODIFIED BERNOULLI EQUATION WITH VISCOUS EFFECTS AND TERMINAL V...
DERIVATION OF MODIFIED BERNOULLI EQUATION WITH VISCOUS EFFECTS AND TERMINAL V...
Wasswaderrick3
 
Nutraceutical market, scope and growth: Herbal drug technology
Nutraceutical market, scope and growth: Herbal drug technologyNutraceutical market, scope and growth: Herbal drug technology
Nutraceutical market, scope and growth: Herbal drug technology
Lokesh Patil
 
Orion Air Quality Monitoring Systems - CWS
Orion Air Quality Monitoring Systems - CWSOrion Air Quality Monitoring Systems - CWS
Orion Air Quality Monitoring Systems - CWS
Columbia Weather Systems
 
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốtmô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
HongcNguyn6
 
DMARDs Pharmacolgy Pharm D 5th Semester.pdf
DMARDs Pharmacolgy Pharm D 5th Semester.pdfDMARDs Pharmacolgy Pharm D 5th Semester.pdf
DMARDs Pharmacolgy Pharm D 5th Semester.pdf
fafyfskhan251kmf
 
Unveiling the Energy Potential of Marshmallow Deposits.pdf
Unveiling the Energy Potential of Marshmallow Deposits.pdfUnveiling the Energy Potential of Marshmallow Deposits.pdf
Unveiling the Energy Potential of Marshmallow Deposits.pdf
Erdal Coalmaker
 
Anemia_ types_clinical significance.pptx
Anemia_ types_clinical significance.pptxAnemia_ types_clinical significance.pptx
Anemia_ types_clinical significance.pptx
muralinath2
 
Deep Software Variability and Frictionless Reproducibility
Deep Software Variability and Frictionless ReproducibilityDeep Software Variability and Frictionless Reproducibility
Deep Software Variability and Frictionless Reproducibility
University of Rennes, INSA Rennes, Inria/IRISA, CNRS
 
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills MN
 
ESR spectroscopy in liquid food and beverages.pptx
ESR spectroscopy in liquid food and beverages.pptxESR spectroscopy in liquid food and beverages.pptx
ESR spectroscopy in liquid food and beverages.pptx
PRIYANKA PATEL
 
The use of Nauplii and metanauplii artemia in aquaculture (brine shrimp).pptx
The use of Nauplii and metanauplii artemia in aquaculture (brine shrimp).pptxThe use of Nauplii and metanauplii artemia in aquaculture (brine shrimp).pptx
The use of Nauplii and metanauplii artemia in aquaculture (brine shrimp).pptx
MAGOTI ERNEST
 
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
yqqaatn0
 
Nucleic Acid-its structural and functional complexity.
Nucleic Acid-its structural and functional complexity.Nucleic Acid-its structural and functional complexity.
Nucleic Acid-its structural and functional complexity.
Nistarini College, Purulia (W.B) India
 
What is greenhouse gasses and how many gasses are there to affect the Earth.
What is greenhouse gasses and how many gasses are there to affect the Earth.What is greenhouse gasses and how many gasses are there to affect the Earth.
What is greenhouse gasses and how many gasses are there to affect the Earth.
moosaasad1975
 
Seminar of U.V. Spectroscopy by SAMIR PANDA
 Seminar of U.V. Spectroscopy by SAMIR PANDA Seminar of U.V. Spectroscopy by SAMIR PANDA
Seminar of U.V. Spectroscopy by SAMIR PANDA
SAMIR PANDA
 
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Ana Luísa Pinho
 
Richard's aventures in two entangled wonderlands
Richard's aventures in two entangled wonderlandsRichard's aventures in two entangled wonderlands
Richard's aventures in two entangled wonderlands
Richard Gill
 
THEMATIC APPERCEPTION TEST(TAT) cognitive abilities, creativity, and critic...
THEMATIC  APPERCEPTION  TEST(TAT) cognitive abilities, creativity, and critic...THEMATIC  APPERCEPTION  TEST(TAT) cognitive abilities, creativity, and critic...
THEMATIC APPERCEPTION TEST(TAT) cognitive abilities, creativity, and critic...
Abdul Wali Khan University Mardan,kP,Pakistan
 

Recently uploaded (20)

20240520 Planning a Circuit Simulator in JavaScript.pptx
20240520 Planning a Circuit Simulator in JavaScript.pptx20240520 Planning a Circuit Simulator in JavaScript.pptx
20240520 Planning a Circuit Simulator in JavaScript.pptx
 
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
 
DERIVATION OF MODIFIED BERNOULLI EQUATION WITH VISCOUS EFFECTS AND TERMINAL V...
DERIVATION OF MODIFIED BERNOULLI EQUATION WITH VISCOUS EFFECTS AND TERMINAL V...DERIVATION OF MODIFIED BERNOULLI EQUATION WITH VISCOUS EFFECTS AND TERMINAL V...
DERIVATION OF MODIFIED BERNOULLI EQUATION WITH VISCOUS EFFECTS AND TERMINAL V...
 
Nutraceutical market, scope and growth: Herbal drug technology
Nutraceutical market, scope and growth: Herbal drug technologyNutraceutical market, scope and growth: Herbal drug technology
Nutraceutical market, scope and growth: Herbal drug technology
 
Orion Air Quality Monitoring Systems - CWS
Orion Air Quality Monitoring Systems - CWSOrion Air Quality Monitoring Systems - CWS
Orion Air Quality Monitoring Systems - CWS
 
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốtmô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
 
DMARDs Pharmacolgy Pharm D 5th Semester.pdf
DMARDs Pharmacolgy Pharm D 5th Semester.pdfDMARDs Pharmacolgy Pharm D 5th Semester.pdf
DMARDs Pharmacolgy Pharm D 5th Semester.pdf
 
Unveiling the Energy Potential of Marshmallow Deposits.pdf
Unveiling the Energy Potential of Marshmallow Deposits.pdfUnveiling the Energy Potential of Marshmallow Deposits.pdf
Unveiling the Energy Potential of Marshmallow Deposits.pdf
 
Anemia_ types_clinical significance.pptx
Anemia_ types_clinical significance.pptxAnemia_ types_clinical significance.pptx
Anemia_ types_clinical significance.pptx
 
Deep Software Variability and Frictionless Reproducibility
Deep Software Variability and Frictionless ReproducibilityDeep Software Variability and Frictionless Reproducibility
Deep Software Variability and Frictionless Reproducibility
 
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
 
ESR spectroscopy in liquid food and beverages.pptx
ESR spectroscopy in liquid food and beverages.pptxESR spectroscopy in liquid food and beverages.pptx
ESR spectroscopy in liquid food and beverages.pptx
 
The use of Nauplii and metanauplii artemia in aquaculture (brine shrimp).pptx
The use of Nauplii and metanauplii artemia in aquaculture (brine shrimp).pptxThe use of Nauplii and metanauplii artemia in aquaculture (brine shrimp).pptx
The use of Nauplii and metanauplii artemia in aquaculture (brine shrimp).pptx
 
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
 
Nucleic Acid-its structural and functional complexity.
Nucleic Acid-its structural and functional complexity.Nucleic Acid-its structural and functional complexity.
Nucleic Acid-its structural and functional complexity.
 
What is greenhouse gasses and how many gasses are there to affect the Earth.
What is greenhouse gasses and how many gasses are there to affect the Earth.What is greenhouse gasses and how many gasses are there to affect the Earth.
What is greenhouse gasses and how many gasses are there to affect the Earth.
 
Seminar of U.V. Spectroscopy by SAMIR PANDA
 Seminar of U.V. Spectroscopy by SAMIR PANDA Seminar of U.V. Spectroscopy by SAMIR PANDA
Seminar of U.V. Spectroscopy by SAMIR PANDA
 
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
 
Richard's aventures in two entangled wonderlands
Richard's aventures in two entangled wonderlandsRichard's aventures in two entangled wonderlands
Richard's aventures in two entangled wonderlands
 
THEMATIC APPERCEPTION TEST(TAT) cognitive abilities, creativity, and critic...
THEMATIC  APPERCEPTION  TEST(TAT) cognitive abilities, creativity, and critic...THEMATIC  APPERCEPTION  TEST(TAT) cognitive abilities, creativity, and critic...
THEMATIC APPERCEPTION TEST(TAT) cognitive abilities, creativity, and critic...
 

Replicated Siamese LSTM in Ticketing System for Similarity Learning and Retrieval in Asymmetric Texts

  • 1. Intern © Siemens AG 2017 Replicated Siamese LSTM in Ticketing System for Similarity Learning and Retrieval in Asymmetric Texts Author(s): Pankaj Gupta1,2, Bernt Andrassy2, Hinrich Schütze1 Presenter: Pankaj Gupta @COLING2018 Santa Fe, NM USA. 20th August 2018 1CIS, University of Munich (LMU) | 2Machine Intelligence, Siemens AG | August 2018
  • 2. Intern © Siemens AG 2017 May 2017Seite 2 Corporate Technology Contributors PANKAJ GUPTA PhD Candidate @LMU Research Scientist @Siemens Munich Germany Dr. Bernt Andrassy Senior Key Expert @Siemens Munich Germany Prof. Hinrich Schütze @University of Munich (LMU) (PhD advisor)
  • 3. Intern © Siemens AG 2017 May 2017Seite 3 Corporate Technology Outline ➢ Problem Statement - Industrial Diagnostic Ticketing System - Asymmetric Textual Similarity - Complementary Semantics in Similarity ➢ Background - Siamese Neural Networks (Siamese-LSTM) in NLP - Neural Autoregressive Topic Model (DocNADE) ➢ Proposal - The Replicated Siamese LSTM for STS and IR - Multi-Channel Manhattan Metric for Complementary Semantics ➢ Evaluations: STS and IR
  • 4. Intern © Siemens AG 2017 May 2017Seite 4 Corporate Technology Problem Statement: STS and IR Semantic Textual Similarity (STS): ➢ Task to find out if the text pairs mean the same thing ➢ Information Retrieval (IR) and text understanding may be improved by modeling the underlying semantic similarity between texts.
  • 5. Intern © Siemens AG 2017 May 2017Seite 5 Corporate Technology Problem Statement: Industrial Diagnostic Ticketing System Goal: Retrieve a relevant solution for an input query SUB DESC SOL …… …… …… …… …… …… …… …… …… SUB: Narrow Frequency Pulsations DESC: Low and Narrow frequency pulsations were detected. Peak value for the Low Frequency Pulsations is 60 mbar. SOL: The recommended action is that the machine should not run at load over 28 MW until resolved. KB of Industrial Tickets Intelligent Ticketing System (ITS)#TICKET
  • 6. Intern © Siemens AG 2017 May 2017Seite 6 Corporate Technology Problem Statement: Industrial Diagnostic Ticketing System Goal: Retrieve a relevant solution for an input query SUB DESC SOL …… …… …… …… …… …… …… …… …… SUB: Narrow Frequency Pulsations DESC: Low and Narrow frequency pulsations were detected. Peak value for the Low Frequency Pulsations is 60 mbar. SOL: The recommended action is that the machine should not run at load over 28 MW until resolved. KB of Industrial Tickets Intelligent Ticketing System (ITS)#TICKET SUBJECT text DESCRIPTION text QUERY Solution: Recommended Service Action text Recommendation(s)
  • 7. Intern © Siemens AG 2017 May 2017Seite 7 Corporate Technology Problem Statement: Industrial Diagnostic Ticketing System Goal: Retrieve a relevant solution for an input query SUB: GT Trip - Low Frequency Pulsations DESC: GT Tripped due to a sudden increase in Low Frequency Pulsations. Machine is restarted and now operating normally. Alarm received was: GT ESD Low Frequency Pulsation. SUB: Narrow Frequency Pulsations DESC: Low and Narrow frequency pulsations were detected. Peak value for the Low Frequency Pulsations is 60 mbar. SOL: The recommended action is that the machine should not run at load over 28 MW until resolved. The recommended action is that the machine should not run at loads over 28 MW until resolved. Recommendation(s) QUERY similarity Retrieval #TICKET IN OUT KB ITS
  • 8. Intern © Siemens AG 2017 May 2017Seite 8 Corporate Technology Problem Statement: Industrial Diagnostic Ticketing System Goal: Retrieve a relevant solution for an input query SUB: GT Trip - Low Frequency Pulsations DESC: GT Tripped due to a sudden increase in Low Frequency Pulsations. Machine is restarted and now operating normally. Alarm received was: GT ESD Low Frequency Pulsation. SUB: Narrow Frequency Pulsations DESC: Low and Narrow frequency pulsations were detected. Peak value for the Low Frequency Pulsations is 60 mbar. SOL: The recommended action is that the machine should not run at load over 28 MW until resolved. The recommended action is that the machine should not run at loads over 28 MW until resolved. Recommendation(s) QUERY similarity #TICKET IN OUT KB ITS Retrieval
  • 9. Intern © Siemens AG 2017 May 2017Seite 9 Corporate Technology Problem Statement: Industrial Diagnostic Ticketing System Goal: Retrieve a relevant solution for an input query SUB: GT Trip - Low Frequency Pulsations DESC: GT Tripped due to a sudden increase in Low Frequency Pulsations. Machine is restarted and now operating normally. Alarm received was: GT ESD Low Frequency Pulsation. SUB: Narrow Frequency Pulsations DESC: Low and Narrow frequency pulsations were detected. Peak value for the Low Frequency Pulsations is 60 mbar. SOL: The recommended action is that the machine should not run at load over 28 MW until resolved. The recommended action is that the machine should not run at loads over 28 MW until resolved. Recommendation(s) QUERY similarity Retrieval #TICKET IN OUT KB ITS
  • 10. Intern © Siemens AG 2017 May 2017Seite 10 Corporate Technology Problem Statement: Industrial Diagnostic Ticketing System Goal: Retrieve a relevant solution for an input query SUB: GT Trip - Low Frequency Pulsations DESC: GT Tripped due to a sudden increase in Low Frequency Pulsations. Machine is restarted and now operating normally. Alarm received was: GT ESD Low Frequency Pulsation. SUB: Narrow Frequency Pulsations DESC: Low and Narrow frequency pulsations were detected. Peak value for the Low Frequency Pulsations is 60 mbar. SOL: The recommended action is that the machine should not run at load over 28 MW until resolved. The recommended action is that the machine should not run at loads over 28 MW until resolved. Recommendation(s) QUERY similarity #TICKET IN OUT KB ITS
  • 11. Intern © Siemens AG 2017 May 2017Seite 11 Corporate Technology Problem Statement: Industrial Diagnostic Ticketing System Goal: Retrieve a relevant solution for an input query SUB: GT Trip - Low Frequency Pulsations DESC: GT Tripped due to a sudden increase in Low Frequency Pulsations. Machine is restarted and now operating normally. Alarm received was: GT ESD Low Frequency Pulsation. SUB: Narrow Frequency Pulsations DESC: Low and Narrow frequency pulsations were detected. Peak value for the Low Frequency Pulsations is 60 mbar. SOL: The recommended action is that the machine should not run at load over 28 MW until resolved. The recommended action is that the machine should not run at loads over 28 MW until resolved. Recommendation(s) QUERY similarity #TICKET IN OUT KB cosine similarity (low, narrow) = 0.26 ITS
  • 12. Intern © Siemens AG 2017 May 2017Seite 12 Corporate Technology Problem Statement: Industrial Diagnostic Ticketing System Goal: Retrieve a relevant solution for an input query SUB: GT Trip - Low Frequency Pulsations DESC: GT Tripped due to a sudden increase in Low Frequency Pulsations. Machine is restarted and now operating normally. Alarm received was: GT ESD Low Frequency Pulsation. SUB: Narrow Frequency Pulsations DESC: Low and Narrow frequency pulsations were detected. Peak value for the Low Frequency Pulsations is 60 mbar. SOL: The recommended action is that the machine should not run at load over 28 MW until resolved. The recommended action is that the machine should not run at loads over 28 MW until resolved. Recommendation(s) QUERY similarity #TICKET IN OUT KB cosine similarity (frequency, load) = 0.14 ITS
  • 13. Intern © Siemens AG 2017 May 2017Seite 13 Corporate Technology Problem Statement: Industrial Diagnostic Ticketing System Goal: Retrieve a relevant solution for an input query SUB: Narrow Frequency Pulsations DESC: Low and Narrow frequency pulsations were detected. Peak value for the Low Frequency Pulsations is 60 mbar . SOL: The recommended action is that the machine should not run at loads over 28 MW until resolved. The recommended action is that the machine should not run at loads over 28 MW until resolved. Recommendation(s) similarity #TICKET IN OUT KB cosine similarity (frequency, mbar) = 0.25 SUB: GT Trip - Low Frequency Pulsations DESC: GT Tripped due to a sudden increase in Low Frequency Pulsations. Machine is restarted and now operating normally. Alarm received was: GT ESD Low Frequency Pulsation. QUERY ITS
  • 14. Intern © Siemens AG 2017 May 2017Seite 14 Corporate Technology Problem Statement: Industrial Diagnostic Ticketing System Goal: Retrieve a relevant solution for an input query SUB: Narrow Frequency Pulsations DESC: Low and Narrow frequency pulsations were detected. Peak value for the Low Frequency Pulsations is 60 mbar . SOL: The recommended action is that the machine should not run at loads over 28 MW until resolved. The recommended action is that the machine should not run at loads over 28 MW until resolved. Recommendation(s) similarity #TICKET IN OUT KBcosine similarity (frequency, MW) = 0.08 SUB: GT Trip - Low Frequency Pulsations DESC: GT Tripped due to a sudden increase in Low Frequency Pulsations. Machine is restarted and now operating normally. Alarm received was: GT ESD Low Frequency Pulsation. QUERY ITS
  • 15. Intern © Siemens AG 2017 May 2017Seite 15 Corporate Technology Problem Statement: Significant Term Mismatch Goal: Retrieve a relevant solution for an input query SOL: The recommended action is that the machine should not run at loads over 28 MW until resolved. The recommended action is that the machine should not run at loads over 28 MW until resolved. Recommendation(s) similarity #TICKET IN OUT KB(Significant Term Mismatch) SUB: GT Trip - Low Frequency Pulsations QUERY ITS
  • 16. Intern © Siemens AG 2017 May 2017Seite 17 Corporate Technology Problem Statement: Symmetric Textual Similarity Goal: Retrieve a relevant solution for an input query SUB: Narrow Frequency Pulsations The recommended action is that the machine should not run at loads over 28 MW until resolved. Recommendation(s) similarity #TICKET IN OUT KB Symmetric Text pairs (short Vs short texts) SUB: GT Trip - Low Frequency Pulsations QUERY ITS
  • 17. Intern © Siemens AG 2017 May 2017Seite 18 Corporate Technology Problem Statement: Symmetric Textual Similarity Goal: Retrieve a relevant solution for an input query DESC: Low and Narrow frequency pulsations were detected. Peak value for the Low Frequency Pulsations is 60 mbar . The recommended action is that the machine should not run at loads over 28 MW until resolved. Recommendation(s) similarity #TICKET IN OUT KB Symmetric Text pairs (long Vs long texts) DESC: GT Tripped due to a sudden increase in Low Frequency Pulsations. Machine is restarted and now operating normally. Alarm received was: GT ESD Low Frequency Pulsation. QUERY ITS
  • 18. Intern © Siemens AG 2017 May 2017Seite 19 Corporate Technology Problem Statement: Asymmetric Textual Similarity Goal: Retrieve a relevant solution for an input query DESC: Low and Narrow frequency pulsations were detected. Peak value for the Low Frequency Pulsations is 60 mbar . The recommended action is that the machine should not run at loads over 28 MW until resolved. Recommendation(s) similarity #TICKET IN OUT KB Asymmetric Text pairs (short Vs multi-sentence texts) SUB: GT Trip - Low Frequency Pulsations QUERY ITS
  • 19. Intern © Siemens AG 2017 May 2017Seite 20 Corporate Technology Problem Statement: Asymmetric Textual Similarity Goal: Retrieve a relevant solution for an input query SOL: The recommended action is that the machine should not run at loads over 28 MW until resolved. The recommended action is that the machine should not run at loads over 28 MW until resolved. Recommendation(s) similarity #TICKET IN OUT KB Asymmetric Text pairs (short Vs multi-sentence texts) SUB: GT Trip - Low Frequency Pulsations QUERY ITS
  • 20. Intern © Siemens AG 2017 May 2017Seite 21 Corporate Technology Complementary Semantic Learning and Similarity Goal: Retrieve a relevant solution for an input query SUB: Narrow Frequency Pulsations DESC: Low and Narrow frequency pulsations were detected. Peak value for the Low Frequency Pulsations is 60 mbar . SOL: The recommended action is that the machine should not run at loads over 28 MW until resolved. The recommended action is that the machine should not run at loads over 28 MW until resolved. Recommendation(s) similarity #TICKET IN OUT KB Complementary Semantics (Coarse Vs fine Granularity) SUB: GT Trip - Low Frequency Pulsations DESC: GT Tripped due to a sudden increase in Low Frequency Pulsations. Machine is restarted and now operating normally. Alarm received was: GT ESD Low Frequency Pulsation. QUERY ITS
  • 21. Intern © Siemens AG 2017 May 2017Seite 22 Corporate Technology Complementary Semantic Learning and Similarity SUB: Narrow Frequency Pulsations DESC: Low and Narrow frequency pulsations were detected. Peak value for the Low Frequency Pulsations is 60 mbar . SOL: The recommended action is that the machine should not run at loads over 28 MW until resolved. The recommended action is that the machine should not run at loads over 28 MW until resolved. Recommendation(s) similarity #TICKET IN OUT KB Complementary Semantics (Coarse Vs fine Granularity) SUB: GT Trip - Low Frequency Pulsations DESC: GT Tripped due to a sudden increase in Low Frequency Pulsations. Machine is restarted and now operating normally. Alarm received was: GT ESD Low Frequency Pulsation. QUERY similarity in latent topic semantics ITS
  • 22. Intern © Siemens AG 2017 May 2017Seite 23 Corporate Technology Complementary Semantic Learning and Similarity SUB: Narrow Frequency Pulsations DESC: Low and Narrow frequency pulsations were detected. Peak value for the Low Frequency Pulsations is 60 mbar . SOL: The recommended action is that the machine should not run at loads over 28 MW until resolved. The recommended action is that the machine should not run at loads over 28 MW until resolved. Recommendation(s) similarity #TICKET IN OUT KB Learn Complementary Text Pair Representations in a Highly Structured Space SUB: GT Trip - Low Frequency Pulsations DESC: GT Tripped due to a sudden increase in Low Frequency Pulsations. Machine is restarted and now operating normally. Alarm received was: GT ESD Low Frequency Pulsation. QUERY similarity in latent topic semantics ITS
  • 23. Intern © Siemens AG 2017 May 2017Seite 24 Corporate Technology Background: Siamese Networks in NLP Reference: Mueller and Thyagarajan, 2016 - dual-branch networks with tied weights - non-linear metric learning with similarity information - Invariant and selective representation directly through the use of similarity and dissimilarity information
  • 24. Intern © Siemens AG 2017 May 2017Seite 25 Corporate Technology Background: Siamese Networks in NLP Reference: Mueller and Thyagarajan, 2016 Limited to sentence pairs - dual-branch networks with tied weights - non-linear metric learning with similarity information - Invariant and selective representation directly through the use of similarity and dissimilarity information
  • 25. Intern © Siemens AG 2017 May 2017Seite 26 Corporate Technology Background: Document Neural Autoregressive Topic Model (DocNADE) Reference: Gupta et al. Document Informed Autoregressive Topic Models. Preprint: https://arxiv.org/pdf/1808.03793.pdf - Learn word co-occureances across documents - Extract latent topics (coarse grained representation) - Optimise via reconstruction loss where, input should be reproduced by the decoding part of the network.
  • 26. Intern © Siemens AG 2017 May 2017Seite 27 Corporate Technology Proposal: Multi-Channel, Replicated and Multi-Cross Level Siamese Query Component(s) subscripted by 1 e.g., X1 Ticket Component(s) subscripted by 2 e.g., X2
  • 27. Intern © Siemens AG 2017 May 2017Seite 28 Corporate Technology Proposal: Multi-Channel, Replicated and Multi-Cross Level Siamese DocNADE DocNADE DocNADE DocNADE DocNADE
  • 28. Intern © Siemens AG 2017 May 2017Seite 29 Corporate Technology Proposal: Multi-Channel, Replicated and Multi-Cross Level Siamese Multi-channel for Complementary Semantics !!! DocNADE DocNADE DocNADE DocNADE DocNADE
  • 29. Intern © Siemens AG 2017 May 2017Seite 30 Corporate Technology Proposal: Multi-Channel, Replicated and Multi-Cross Level Siamese Multi-channel for Complementary Semantics !!! DocNADE DocNADE DocNADE DocNADE DocNADE
  • 30. Intern © Siemens AG 2017 May 2017Seite 31 Corporate Technology Proposal: Multi-Channel, Replicated and Multi-Cross Level Siamese Replicated !!! W W W W W DocNADE DocNADE DocNADE DocNADE DocNADE
  • 31. Intern © Siemens AG 2017 May 2017Seite 32 Corporate Technology Proposal: Multi-Channel, Replicated and Multi-Cross Level Siamese Multi-level Similarity !!! e.g. SUB1-SUB2, DESC1-DESC2 W W W W W DocNADE DocNADE DocNADE DocNADE DocNADEi.e. symmetric textual similarities
  • 32. Intern © Siemens AG 2017 May 2017Seite 33 Corporate Technology Proposal: Multi-Channel, Replicated and Multi-Cross Level Siamese Cross-level Similarity !!! e.g. SUB1-DESC2, DESC1-SOL2, etc. W W W W W DocNADE DocNADE DocNADE DocNADE DocNADE i.e. asymmetric textual similarities
  • 33. Intern © Siemens AG 2017 May 2017Seite 34 Corporate Technology Proposal: Multi-Channel, Replicated and Multi-Cross Level Siamese Cross-level Similarity !!! e.g. SUB1-DESC2, SUB1-SOL2, etc. W W W W W DocNADE DocNADE DocNADE DocNADE DocNADE i.e. asymmetric textual similarities
  • 34. Intern © Siemens AG 2017 May 2017Seite 35 Corporate Technology Proposal: Multi-Channel, Replicated and Multi-Cross Level Siamese Cross-level Similarity !!! e.g. SUB1-DESC2, DESC1-SOL2, etc. W W W W W DocNADE DocNADE DocNADE DocNADE DocNADE
  • 35. Intern © Siemens AG 2017 May 2017Seite 36 Corporate Technology Proposal: Multi-Channel, Replicated and Multi-Cross Level Siamese Cross-level Similarity !!! e.g. SUB1-DESC2, DESC1-SUB2, etc. W W W W W DocNADE DocNADE DocNADE DocNADE DocNADE i.e. asymmetric textual similarities
  • 36. Intern © Siemens AG 2017 May 2017Seite 37 Corporate Technology Proposal: Multi-Channel, Replicated and Multi-Cross Level Siamese Overall Learning !!! W W W W W DocNADE DocNADE DocNADE DocNADE DocNADE
  • 37. Intern © Siemens AG 2017 May 2017Seite 38 Corporate Technology Proposal: Multi-Channel Manhattan Metric with Complementary Semantics Multi-Channel Manhattan Metric
  • 38. Intern © Siemens AG 2017 May 2017Seite 39 Corporate Technology Proposal: Multi-Channel Manhattan Metric with Complementary Semantics Weighted semantic distances + Weighted ‘level’ similarity Multi-Channel Manhattan Metric
  • 39. Intern © Siemens AG 2017 May 2017Seite 40 Corporate Technology Evaluation
  • 40. Intern © Siemens AG 2017 May 2017Seite 41 Corporate Technology Evaluation ➢ Industrial Data Set - 949 historical tickets in the KB - 421 pairs labeled - relatedness labels: YES (similar that provides correct solution): 5.0 REL (does not provide correct solution, but close to a solution): 3.0 and NO (not related, not relevant and provides no correct solution): 1.0 - average length (#words) of SUB: (4.6); DESC: (65.0); SOL: (74.2). ➢ Baselines - Unsupervised (topic and word embedding representations) - Supervised (Siamese LSTM) ➢ Evaluation and Analysis the proposed Replicated Siamese LSTM
  • 41. Intern © Siemens AG 2017 May 2017Seite 42 Corporate Technology Evaluation: LDA Vs DocNADE
  • 42. Intern © Siemens AG 2017 May 2017Seite 43 Corporate Technology Evaluation: Unsupervised Baselines for STS and IR SIMILARITY: Pearson correlation (r), Spearmans correlation coefficient (p), Mean Squared Error (MSE), IR: Mean Average Precision@k (MAP@k) and Accuracy@k (Acc@k) Topic (T) semantics from Query and Ticket components i.e. T(SUB1-SUB2), etc.
  • 43. Intern © Siemens AG 2017 May 2017Seite 44 Corporate Technology Evaluation: Unsupervised Baselines for STS and IR SIMILARITY: Pearson correlation (r), Spearmans correlation coefficient (p), Mean Squared Error (MSE), IR: Mean Average Precision@k (MAP@k) and Accuracy@k (Acc@k) Topic (T) semantics from Query and Ticket components i.e. T(SUB1-SUB2), etc.
  • 44. Intern © Siemens AG 2017 May 2017Seite 45 Corporate Technology Evaluation: Unsupervised Baselines for STS and IR Topic (T) semantics from Query and Ticket components i.e. T(SUB1-SUB2), etc. SIMILARITY: Pearson correlation (r), Spearmans correlation coefficient (p), Mean Squared Error (MSE), IR: Mean Average Precision@k (MAP@k) and Accuracy@k (Acc@k)
  • 45. Intern © Siemens AG 2017 May 2017Seite 46 Corporate Technology Evaluation: Unsupervised Baselines for STS and IR Topic (T) semantics from Query and Ticket components i.e. T(SUB1-SUB2), etc. Distributional Semantics (SumEmbedding) (E) for Query and Ticket components i.e. E(SUB1-SUB2), . E(SUB1+DESC1-SUB2+DESC2+SOL2), etc.
  • 46. Intern © Siemens AG 2017 May 2017Seite 47 Corporate Technology Evaluation: Supervised Baselines for STS and IR S-LSTM: Compute Similarity using Standard Siamese LSTM on a query and ticket components
  • 47. Intern © Siemens AG 2017 May 2017Seite 48 Corporate Technology Evaluation: Supervised Baselines for STS and IR ML-LSTM: Multi-level similarity
  • 48. Intern © Siemens AG 2017 May 2017Seite 49 Corporate Technology Evaluation: Supervised Baselines for STS and IR CL-LSTM: Cross-level similarity
  • 49. Intern © Siemens AG 2017 May 2017Seite 50 Corporate Technology Evaluation: Supervised Baselines for STS and IR Multi-channel semantic similarity
  • 50. Intern © Siemens AG 2017 May 2017Seite 51 Corporate Technology Evaluation: Supervised Baselines for STS and IR Multi-channel semantic similarity 7%
  • 51. Intern © Siemens AG 2017 May 2017Seite 52 Corporate Technology Qualitative Inspections for STS and IR topics
  • 52. Intern © Siemens AG 2017 May 2017Seite 53 Corporate Technology Qualitative Inspections for STS and IR topics
  • 53. Intern © Siemens AG 2017 May 2017Seite 54 Corporate Technology Conclusion ➢ Advancement of Siamese architecture for similarity learning in asymmetric text pairs, instead of sentence pairs only ➢ Proposed Replicated Siamese LSTM with multi/cross level similarity ➢ Gain of 22% and 7% (Acc@10), respectively over unsupervised and supervised baselines in IR ➢ Demonstrated complementary semantics improved similarity/retrieval performance ➢ Address/Improve the real-world industrial application of ticketing system
  • 54. Intern © Siemens AG 2017 May 2017Seite 55 Corporate Technology Thanks !!! W W W W W DocNADE DocNADE DocNADE DocNADE DocNADE