SlideShare a Scribd company logo
1 of 34
Download to read offline
An Unsupervised Neural Attention Model for Aspect Extraction
arXivtimes
2018/08/23
TIS
An Unsupervised Neural Attention Model for Aspect Extraction
ACL 2017
Ruidan He, Wee Sun Lee, Hwee Tou Ng, and Daniel Dahlmeier
• Ruidan He
• https://aclanthology.coli.uni-saarland.de/papers/P17-1036/p17-1036
• Code https://github.com/ruidan/Unsupervised-Aspect-Extraction
2
3
•
• attention model aspect term
•
• aspect
• aspect
•
•
•
• aspect extraction attention
•
• aspect
4
1.
2.
3.
4.
5
1.
• Aspect Extraction
•
•
• Attention Model
2.
3.
4.
aspect extraction
— Aspect extraction
Aspect : the target of opinion( ) entity
6
• Aspect Extraction
1.
The beef was tender and melted in my mouth
The beef was tender and melted in my mouth
0.04 0.5 0.1 0.2 0.03 0.2 0.06 0 0.1
Model
Rule-based
Approach
•
•
•
Supervised
Approach
• •
•
Unsupervised
Approach
•
•
• aspect term
e.g. food aspect
service aspect
term 7
•
1.
8
•
1.
aspect term food aspect
service aspect term
aspect term attention
aspect
This pie looks delicious but the service is bad
attention 0.04 0.2 0.1 0.2 0.03 0 0.2 0 0.1
attention 0.01 0.4 0.04 0.3 0.02 0 0.5 0 0.3
9
•
1.
Attention Model
Autoencoder Model
• Attention in CV
Attention:
scoring function attention weights
10
1.
11
encoder layer word
hidden state decoder layer
attention model
hidden state
1.
• Attention in NLP
Image from https://blog.heuritech.com/2016/01/20/attention-mechanism/
Machine Translation: English to French
12
1.
2.
• Attention Model
• Autoencoder Part(unsupervised)
• Aspect Term Embedding Extraction
• Aspect Naming
3.
4.
13
•
1.
— aspect term
(e.g. “beef”, “pork”, “service”)
— aspect term
aspect
(e.g., cluster “beef ”, “pork”, “pasta” , and “tomato”into aspect “food” )
2.
14
•
Attention Model
Autoencoder Model
2.
• : Sentence embedding (weighted sum of word embedding)
zs =
nX
i=1
aiewi
(4)
<latexit sha1_base64="wJLcO9TTYJd09k5++MBvvL6YjB0=">AAACj3ichVG7SiRBFD2271kfoybCJo3iogbDbREUQRkw0czXqOBo092WWtgv+zGizfyAkZnBRissIqZiqmDiD2xgtumyoQsmBnunZ0BU1FtU1alT99w6VWX6tgwjovs6pb6hsam5pTXzpa29ozPb1b0cenFgiYLl2V6wahqhsKUrCpGMbLHqB8JwTFusmLvTlf2VkghC6blL0YEv1h1j25Vb0jIipvTs8KEeqpNqMYwdPZGTWnkjccuqoUtV6Mm+LstqcS82NtXB0SE92085SkN9C7Qa6M/nL1t/A5jzsmcoYhMeLMRwIOAiYmzDQMhtDRoIPnPrSJgLGMl0X6CMDGtjzhKcYTC7y+M2r9ZqrMvrSs0wVVt8is09YKWKAfpF5/RAd3RBf+jp3VpJWqPi5YBns6oVvt551Lv4+KnK4TnCzrPqQ88RtjCeepXs3U+Zyi2sqr50ePKwOLEwkHyjU/rL/n/QPd3yDdzSP+vnvFj4jgx/gPb6ud+C5ZGcRjltnn9iAtVowVf0YZDfewx5zGAOBT73GFe4xo3SpYwpU0q+mqrU1TQ9eBHK7H+4xZr5</latexit><latexit sha1_base64="TUD0XPL47NJY6uIzcK4QBBbTkjA=">AAACj3icSyrIySwuMTC4ycjEzMLKxs7BycXNw8vHLyAoFFacX1qUnBqanJ+TXxSRlFicmpOZlxpaklmSkxpRUJSamJuUkxqelO0Mkg8vSy0qzszPCympLEiNzU1Mz8tMy0xOLAEKxQtoVcUXK9gqxBSX5sZXZ9oa1sZV59UqJMZnKqTGV5fHZ9YqxBSWJqYoaJhoxgsoG+gZgIECJsMQylB2cNjCeefH5N8B+QLLGWIYUhjyGZIZShlyGVIZ8hhKgOwchkSGYiCMZjBkMGAoAIrFMlQDxYqArEywfCpDLQMXUG8pUFUqUEUiUDQbSKYDedFQ0TwgH2RmMVh3MtCWHCAuAupUYFA1uGqw0uCzwQmD1QYvDf7gNKsabAbILZVAOgmiN7Ugnr9LIvg7QV25QLqEIQOhC6+bSxjSGCzAbs0Eur0ALALyRTJEf1nV9M/BVkGq1WoGiwxeA92/0OCmwWGgD/LKviQvDUwNms3ABYwAQ/TgxmSEGekZGugZBgJjwooBAjgYpBmUGDSA4W3O4MDgwRDAEAq0dwLDNob9DAeYBJnMmeyYHCBKmRiheoQZUACTJwBJqZ17</latexit><latexit sha1_base64="TUD0XPL47NJY6uIzcK4QBBbTkjA=">AAACj3icSyrIySwuMTC4ycjEzMLKxs7BycXNw8vHLyAoFFacX1qUnBqanJ+TXxSRlFicmpOZlxpaklmSkxpRUJSamJuUkxqelO0Mkg8vSy0qzszPCympLEiNzU1Mz8tMy0xOLAEKxQtoVcUXK9gqxBSX5sZXZ9oa1sZV59UqJMZnKqTGV5fHZ9YqxBSWJqYoaJhoxgsoG+gZgIECJsMQylB2cNjCeefH5N8B+QLLGWIYUhjyGZIZShlyGVIZ8hhKgOwchkSGYiCMZjBkMGAoAIrFMlQDxYqArEywfCpDLQMXUG8pUFUqUEUiUDQbSKYDedFQ0TwgH2RmMVh3MtCWHCAuAupUYFA1uGqw0uCzwQmD1QYvDf7gNKsabAbILZVAOgmiN7Ugnr9LIvg7QV25QLqEIQOhC6+bSxjSGCzAbs0Eur0ALALyRTJEf1nV9M/BVkGq1WoGiwxeA92/0OCmwWGgD/LKviQvDUwNms3ABYwAQ/TgxmSEGekZGugZBgJjwooBAjgYpBmUGDSA4W3O4MDgwRDAEAq0dwLDNob9DAeYBJnMmeyYHCBKmRiheoQZUACTJwBJqZ17</latexit><latexit sha1_base64="RrLIrT6FD3nYQvdA1XJCu8DiArc=">AAACj3ichVFNSxtBGH5ca7Wp1sReCr0sDZboIbwrQiSgBLzYm1+JgkmX3XXUIfvlfkR0yR/oyZuHnlooIr332kIv/oEe8hPEo4VeeuibzYJYaX2HmXnmmfd555kZ07dlGBH1hpThRyOPR8ee5J6OTzybzBemGqEXB5aoW57tBdumEQpbuqIeycgW234gDMe0xZbZXu7vb3VEEErP3YyOfdFyjH1X7knLiJjS87Mneqguqs0wdvRELmrdt4nbVQ1dqkJPjnTZVZuHsbGrluZn9HyRypSGeh9oGSgii1Uvf44mduHBQgwHAi4ixjYMhNx2oIHgM9dCwlzASKb7Al3kWBtzluAMg9k2j/u82slYl9f9mmGqtvgUm3vAShXT9IMu6IYu6TNd0e9/1krSGn0vxzybA63w9cl3LzZ+PahyeI5wcKv6r+cIe1hIvUr27qdM/xbWQN85ObvZqK5PJ6/pI12z/w/Uo+98A7fz0/q0JtbfI8cfoP393PdBY66sUVlbo2Ktmn3FGF7iFUr83hXUsIJV1PncU3zBV3xTCkpFWVJqg1RlKNM8x51Q3vwB2FSY3A==</latexit>
zs<latexit sha1_base64="hvgbNff5B+9OnNLVU3Kb9zV4P9A=">AAACZnichVG7SgNBFD1ZXzFqEhVRECQYIlbhro1iFbCxzMMYQSXsrpO4ZLO77G4CMfgDgq0prBRERPwKG3/Aws5SsYxgY+HNJiAq6h1m5syZe+6cmVFtQ3c9ooeA1Nc/MDgUHA6NjI6FI9HxiU3XqjmayGuWYTlbquIKQzdF3tM9Q2zZjlCqqiEKamWts1+oC8fVLXPDa9hit6qUTb2ka4rHVO6g6BajcUqSH7GfQO6BeCo6d/MIIG1FL7GDPVjQUEMVAiY8xgYUuNy2IYNgM7eLJnMOI93fFzhEiLU1zhKcoTBb4bHMq+0ea/K6U9P11RqfYnB3WBlDgu7pitp0R9f0TO+/1mr6NTpeGjyrXa2wi5Gjmdzbv6oqzx72P1V/evZQworvVWfvts90bqF19fWDVju3mk00F+icXtj/GT3QLd/ArL9qFxmRPUWIP0D+/tw/weZSUqaknOGfWEU3gpjFPBb5vZeRwjrSyPO5ZRzjBK3AkxSWpqTpbqoU6Gkm8SWk2AeICIzP</latexit><latexit sha1_base64="ZHTzYmNEzaNefnjGlgizFG658BQ=">AAACZnichVHLSsNAFD2N7/poVURBkKIorsqNG8VVwY3LPmwr1FKSONbQNAlJWtDiDwiCK7twpSAi0n8Q3PgDXfQPFJcKblx4mxZERb3DzJw5c8+dMzOqbeiuR9QKSD29ff0Dg0PB4ZHRsVB4fCLjWhVHE2nNMixnW1VcYeimSHu6Z4ht2xFKWTVEVi1ttPezVeG4umVueQe2yJeVoqnv6ZriMZU6LLiF8AJFyY/ITyB3wUIsPNdont414lb4GjvYhQUNFZQhYMJjbECByy0HGQSbuTxqzDmMdH9f4AhB1lY4S3CGwmyJxyKvcl3W5HW7puurNT7F4O6wMoJFatINvdAD3dITvf9aq+bXaHs54FntaIVdCB3PpN7+VZV59rD/qfrTs4c9rPledfZu+0z7FlpHXz2sv6TWk4u1JbqkZ/Z/QS265xuY1VftKiGS5wjyB8jfn/snyKxEZYrKCf6JdXRiELOYxzK/9ypi2EQcaT63iBOcoR54lMakKWm6kyoFuppJfAkp8gESlY7B</latexit><latexit sha1_base64="ZHTzYmNEzaNefnjGlgizFG658BQ=">AAACZnichVHLSsNAFD2N7/poVURBkKIorsqNG8VVwY3LPmwr1FKSONbQNAlJWtDiDwiCK7twpSAi0n8Q3PgDXfQPFJcKblx4mxZERb3DzJw5c8+dMzOqbeiuR9QKSD29ff0Dg0PB4ZHRsVB4fCLjWhVHE2nNMixnW1VcYeimSHu6Z4ht2xFKWTVEVi1ttPezVeG4umVueQe2yJeVoqnv6ZriMZU6LLiF8AJFyY/ITyB3wUIsPNdont414lb4GjvYhQUNFZQhYMJjbECByy0HGQSbuTxqzDmMdH9f4AhB1lY4S3CGwmyJxyKvcl3W5HW7puurNT7F4O6wMoJFatINvdAD3dITvf9aq+bXaHs54FntaIVdCB3PpN7+VZV59rD/qfrTs4c9rPledfZu+0z7FlpHXz2sv6TWk4u1JbqkZ/Z/QS265xuY1VftKiGS5wjyB8jfn/snyKxEZYrKCf6JdXRiELOYxzK/9ypi2EQcaT63iBOcoR54lMakKWm6kyoFuppJfAkp8gESlY7B</latexit><latexit sha1_base64="LyascO/L8hfhwTcWC5hQh+gFxbY=">AAACZnichVHLSsNAFD2Nr1ofrYoouCmWiqty40bpquDGpW3tA1RKEscaTJOQpIW2+AOCW7twpSAifoYbf8BF/0BxqeDGhbdpQLSod5iZM2fuuXNmRrUN3fWIuiFpaHhkdCw8HpmYnJqOxmZmi65VdzRR0CzDcsqq4gpDN0XB0z1DlG1HKDXVECX1eLO3X2oIx9Utc8dr2mK/plRN/VDXFI+pfKviVmIJSpEf8UEgByCBILat2A32cAALGuqoQcCEx9iAApfbLmQQbOb20WbOYaT7+wIniLC2zlmCMxRmj3ms8mo3YE1e92q6vlrjUwzuDivjSNIj3dIrPdAdPdPHr7Xafo2elybPal8r7Er0dDH//q+qxrOHoy/Vn549HGLD96qzd9tnerfQ+vpGq/OaT+eS7RW6ohf2f0lduucbmI037TorcheI8AfIP597EBTXUjKl5CwlMungK8JYwjJW+b3XkcEWtlHgc6s4wzk6oSdpWpqXFvqpUijQzOFbSPFP5teK1A==</latexit>
• : i attention score ( )ai<latexit sha1_base64="sfl9+Tt+FAxuCcxtpQufcRHmHg8=">AAACZnichVG7SgNBFD1ZXzE+siqiIEhQFKtw10ZJFbCxVGNUUAm76xiHbHaX3U0gBn9AsDWFlYKIiF9h4w9Y2Fkqlgo2Ft7dBERFvcPMnDlzz50zM4ZrST8guo8pbe0dnV3x7kRPb19/Uh0YXPOdimeKvOlYjrdh6L6wpC3ygQwsseF6Qi8bllg3Sgvh/npVeL507NWg5ortsl605a409YCpnF6QBXWS0hRF6ifQWmAyq45fPwBYctQLbGEHDkxUUIaAjYCxBR0+t01oILjMbaPOnMdIRvsCB0iwtsJZgjN0Zks8Fnm12WJtXoc1/Uht8ikWd4+VKUzRHV3SC93SFT3R+6+16lGN0EuNZ6OpFW4heTiae/tXVeY5wN6n6k/PAXYxH3mV7N2NmPAWZlNf3W+85DIrU/VpOqNn9n9K93TDN7Crr+b5slg5QYI/QPv+3D/B2mxao7S2zD+RQTPiGMMEZvi955DFIpaQ53OLOMIxGrFHpV8ZVkaaqUqspRnCl1BSH0HWjKw=</latexit><latexit sha1_base64="MITNhmmbUWK85o3qgnfBnwoUL+g=">AAACZnichVG7SgNBFD1ZXzG+oiIKggRFsQp3bZRUARvLPEwUVMLuOsbBze6yuwnE4A8IgpUWVgoiIvkHwcYfSOEfKJYKNhbebAKiot5hZs6cuefOmRndMaXnEz2ElI7Oru6ecG+kr39gcCg6PJL37LJriJxhm7a7rmueMKUlcr70TbHuuEIr6aZY0/eWm/trFeF60rZW/aojtkpa0ZI70tB8prJaQRaiMxSnIGI/gdoGM8noVL1xfFtP2dErbGIbNgyUUYKABZ+xCQ0etw2oIDjMbaHGnMtIBvsCB4iwtsxZgjM0Zvd4LPJqo81avG7W9AK1waeY3F1WxjBLDbqmF7qnG3qi919r1YIaTS9VnvWWVjiFocOJ7Nu/qhLPPnY/VX969rGDpcCrZO9OwDRvYbT0lf3Tl2wiM1ubowt6Zv/n9EB3fAOr8mpcpkXmDBH+APX7c/8E+YW4SnE1zT+RQCvCmMQ05vm9F5HEClLI8blFHOEEp6FHZVAZU8ZbqUqorRnFl1BiH8xUjp4=</latexit><latexit sha1_base64="MITNhmmbUWK85o3qgnfBnwoUL+g=">AAACZnichVG7SgNBFD1ZXzG+oiIKggRFsQp3bZRUARvLPEwUVMLuOsbBze6yuwnE4A8IgpUWVgoiIvkHwcYfSOEfKJYKNhbebAKiot5hZs6cuefOmRndMaXnEz2ElI7Oru6ecG+kr39gcCg6PJL37LJriJxhm7a7rmueMKUlcr70TbHuuEIr6aZY0/eWm/trFeF60rZW/aojtkpa0ZI70tB8prJaQRaiMxSnIGI/gdoGM8noVL1xfFtP2dErbGIbNgyUUYKABZ+xCQ0etw2oIDjMbaHGnMtIBvsCB4iwtsxZgjM0Zvd4LPJqo81avG7W9AK1waeY3F1WxjBLDbqmF7qnG3qi919r1YIaTS9VnvWWVjiFocOJ7Nu/qhLPPnY/VX969rGDpcCrZO9OwDRvYbT0lf3Tl2wiM1ubowt6Zv/n9EB3fAOr8mpcpkXmDBH+APX7c/8E+YW4SnE1zT+RQCvCmMQ05vm9F5HEClLI8blFHOEEp6FHZVAZU8ZbqUqorRnFl1BiH8xUjp4=</latexit><latexit sha1_base64="cm2DdYGGl4bckJ1+Vb9VWzXZAIc=">AAACZnichVG7SgNBFD1ZXzE+EhVRsAmGiFW4a6OkCthYxsSooBJ210kc3Owuu5tADP6AYGsKKwUR8TNs/AGL/IFiqWBj4c1mQVTUO8zMmTP33Dkzozum9HyiTkTp6x8YHIoOx0ZGx8bjiYnJTc+uu4YoGbZpu9u65glTWqLkS98U244rtJpuii39cLW7v9UQridta8NvOmKvplUtWZGG5jNV1MqynEhRhoJI/gRqCFIII28nrrGLfdgwUEcNAhZ8xiY0eNx2oILgMLeHFnMuIxnsCxwjxto6ZwnO0Jg95LHKq52QtXjdrekFaoNPMbm7rEwiTQ90Qy90T7f0RO+/1moFNbpemjzrPa1wyvGT2eLbv6oazz4OPlV/evZRwUrgVbJ3J2C6tzB6+sZR+6WYLaRbC3RJz+z/gjp0xzewGq/G1boonCPGH6B+f+6fYHMpo1JGXadULht+RRRzmMciv/cyclhDHiU+t4pTnKEdeVTGlWllppeqRELNFL6EkvwAoKWKsQ==</latexit>
ai =
exp(di)
Pn
j=1 exp(dj)
(3)
<latexit sha1_base64="fuywcypyvFUz2zplcejlvnEx1xU=">AAACn3ichVHLThRBFD20oDCKM+jGxE3rBDKzmdxWEwwJCcEFrMwADo8w2KnuqYGCftmPidCZH+AHWLBRE0OMn2Fi3OnGBZ9gXELCxgV3ejoxQoTb6apT595z61SVFTgqiomOB7Qbg0M3bw2PFG7fGb1bLI3dW478JLRlw/YdP1y1RCQd5clGrGJHrgahFK7lyBVr50Uvv9KRYaR871W8G8gNV2x6qq1sETNllqaEqfRpvdkOhZ025dug0jJVtZs2o8Q10+1po/s69bp6ntmuMnyTiJZeeVo1S2WqURb6ZWDkoIw86n7pCE204MNGAhcSHmLGDgQi/tZhgBAwt4GUuZCRyvISXRRYm3CV5ArB7A6Pm7xaz1mP172eUaa2eReH/5CVOsbpJ32iE/pGn+kX/flvrzTr0fOyy7PV18rALO4/WDq7VuXyHGPrr+pKzzHaeJ55Vew9yJjeKey+vrN3cLI0tTieTtAH+s3+39MxfeETeJ1T++OCXDxEgR/AuHjdl8Hyk5pBNWPhWXlmNn+KYTzEY1T4vicxg3nU0eB93+ErvuOH9kib015q9X6pNpBr7uOf0NbOAfeUn1Y=</latexit><latexit sha1_base64="fuywcypyvFUz2zplcejlvnEx1xU=">AAACn3ichVHLThRBFD20oDCKM+jGxE3rBDKzmdxWEwwJCcEFrMwADo8w2KnuqYGCftmPidCZH+AHWLBRE0OMn2Fi3OnGBZ9gXELCxgV3ejoxQoTb6apT595z61SVFTgqiomOB7Qbg0M3bw2PFG7fGb1bLI3dW478JLRlw/YdP1y1RCQd5clGrGJHrgahFK7lyBVr50Uvv9KRYaR871W8G8gNV2x6qq1sETNllqaEqfRpvdkOhZ025dug0jJVtZs2o8Q10+1po/s69bp6ntmuMnyTiJZeeVo1S2WqURb6ZWDkoIw86n7pCE204MNGAhcSHmLGDgQi/tZhgBAwt4GUuZCRyvISXRRYm3CV5ArB7A6Pm7xaz1mP172eUaa2eReH/5CVOsbpJ32iE/pGn+kX/flvrzTr0fOyy7PV18rALO4/WDq7VuXyHGPrr+pKzzHaeJ55Vew9yJjeKey+vrN3cLI0tTieTtAH+s3+39MxfeETeJ1T++OCXDxEgR/AuHjdl8Hyk5pBNWPhWXlmNn+KYTzEY1T4vicxg3nU0eB93+ErvuOH9kib015q9X6pNpBr7uOf0NbOAfeUn1Y=</latexit><latexit sha1_base64="fuywcypyvFUz2zplcejlvnEx1xU=">AAACn3ichVHLThRBFD20oDCKM+jGxE3rBDKzmdxWEwwJCcEFrMwADo8w2KnuqYGCftmPidCZH+AHWLBRE0OMn2Fi3OnGBZ9gXELCxgV3ejoxQoTb6apT595z61SVFTgqiomOB7Qbg0M3bw2PFG7fGb1bLI3dW478JLRlw/YdP1y1RCQd5clGrGJHrgahFK7lyBVr50Uvv9KRYaR871W8G8gNV2x6qq1sETNllqaEqfRpvdkOhZ025dug0jJVtZs2o8Q10+1po/s69bp6ntmuMnyTiJZeeVo1S2WqURb6ZWDkoIw86n7pCE204MNGAhcSHmLGDgQi/tZhgBAwt4GUuZCRyvISXRRYm3CV5ArB7A6Pm7xaz1mP172eUaa2eReH/5CVOsbpJ32iE/pGn+kX/flvrzTr0fOyy7PV18rALO4/WDq7VuXyHGPrr+pKzzHaeJ55Vew9yJjeKey+vrN3cLI0tTieTtAH+s3+39MxfeETeJ1T++OCXDxEgR/AuHjdl8Hyk5pBNWPhWXlmNn+KYTzEY1T4vicxg3nU0eB93+ErvuOH9kib015q9X6pNpBr7uOf0NbOAfeUn1Y=</latexit><latexit sha1_base64="fuywcypyvFUz2zplcejlvnEx1xU=">AAACn3ichVHLThRBFD20oDCKM+jGxE3rBDKzmdxWEwwJCcEFrMwADo8w2KnuqYGCftmPidCZH+AHWLBRE0OMn2Fi3OnGBZ9gXELCxgV3ejoxQoTb6apT595z61SVFTgqiomOB7Qbg0M3bw2PFG7fGb1bLI3dW478JLRlw/YdP1y1RCQd5clGrGJHrgahFK7lyBVr50Uvv9KRYaR871W8G8gNV2x6qq1sETNllqaEqfRpvdkOhZ025dug0jJVtZs2o8Q10+1po/s69bp6ntmuMnyTiJZeeVo1S2WqURb6ZWDkoIw86n7pCE204MNGAhcSHmLGDgQi/tZhgBAwt4GUuZCRyvISXRRYm3CV5ArB7A6Pm7xaz1mP172eUaa2eReH/5CVOsbpJ32iE/pGn+kX/flvrzTr0fOyy7PV18rALO4/WDq7VuXyHGPrr+pKzzHaeJ55Vew9yJjeKey+vrN3cLI0tTieTtAH+s3+39MxfeETeJ1T++OCXDxEgR/AuHjdl8Hyk5pBNWPhWXlmNn+KYTzEY1T4vicxg3nU0eB93+ErvuOH9kib015q9X6pNpBr7uOf0NbOAfeUn1Y=</latexit>
di = eT
wi
· M · ys (2)<latexit sha1_base64="r2zrnYCLhJ6/weO5BSVQOHEh2iw=">AAAClHichVHPSxtBGH2u1tq0aqpQCl4GRdFL/NaLIgqCFHppiT+igtFldzPawc3udncSSZdAz72XHnpSKCL+AR482kL/gR78E0qPFrx48Msmpaio3zAzb95875s3M07oqVgTnbUZ7R2POh93Pck8fdbd05t93rcSB5XIlQU38IJozbFj6SlfFrTSnlwLI2mXHU+uOjvzjf3VqoxiFfjLuhbKjbK97ast5dqaKSs7XrKUmBXSSnYtVd9Mluui6JYCLcSbf6BmxaL4vmKXxOjEmJUdohylIW4DswWG5gbzxx8B5IPsAYooIYCLCsqQ8KEZe7ARc1uHCULI3AYS5iJGKt2XqCPD2gpnSc6wmd3hcZtX6y3W53WjZpyqXT7F4x6xUmCYftEhndNPOqLfdHlnrSSt0fBS49lpamVo9X56uXTxoKrMs8a7/6p7PWtsYSr1qth7mDKNW7hNffXDl/Ol6cXhZIT26Q/736MzOuUb+NW/7rcFufgVGf4A8+Zz3wYrEzmTcuYC/8Q0mtGFAQxilN97EnN4jTwKfO5nnOA7fhgvjBlj3njVTDXaWpp+XAvj7RUU55vX</latexit><latexit sha1_base64="5rk7zsUmHOMtcGb4j5DC8OQuWbQ=">AAAClHicSyrIySwuMTC4ycjEzMLKxs7BycXNw8vHLyAoFFacX1qUnBqanJ+TXxSRlFicmpOZlxpaklmSkxpRUJSamJuUkxqelO0Mkg8vSy0qzszPCympLEiNzU1Mz8tMy0xOLAEKxQvop8RnKtgqpMZXl8dn1sZVh9QqxCSn5JcoKPjCGJXxxQoxhaWJKQoaRprxAsoGegZgoIDJMIQylB2UArY3mOQeC8gXWM4Qw5DCkM+QzFDKkMuQypDHUAJk5zAkMhQDYTSDIYMBQwFQLJahGihWBGRlguVTGWoZuIB6S4GqUoEqEoGi2UAyHciLhormAfkgM4vBupOBtuQAcRFQpwKDqsFVg5UGnw1OGKw2eGnwB6dZ1WAzQG6pBNJJEL2pBfH8XRLB3wnqygXSJQwZCF143VzCkMZgAXZrJtDtBWARkC+SIfrLqqZ/DrYKUq1WM1hk8Bro/oUGNw0OA32QV/YleWlgatBsBi5gBBiiBzcmI8xIz9BAzzAQGBNWDBDAwSDNoMSgAQxvcwYHBg+GAIZQoL1TGXYzHGE4yiTGZMPkzOQKUcrECNUjzIACmPwAofGdPg==</latexit><latexit sha1_base64="5rk7zsUmHOMtcGb4j5DC8OQuWbQ=">AAAClHicSyrIySwuMTC4ycjEzMLKxs7BycXNw8vHLyAoFFacX1qUnBqanJ+TXxSRlFicmpOZlxpaklmSkxpRUJSamJuUkxqelO0Mkg8vSy0qzszPCympLEiNzU1Mz8tMy0xOLAEKxQvop8RnKtgqpMZXl8dn1sZVh9QqxCSn5JcoKPjCGJXxxQoxhaWJKQoaRprxAsoGegZgoIDJMIQylB2UArY3mOQeC8gXWM4Qw5DCkM+QzFDKkMuQypDHUAJk5zAkMhQDYTSDIYMBQwFQLJahGihWBGRlguVTGWoZuIB6S4GqUoEqEoGi2UAyHciLhormAfkgM4vBupOBtuQAcRFQpwKDqsFVg5UGnw1OGKw2eGnwB6dZ1WAzQG6pBNJJEL2pBfH8XRLB3wnqygXSJQwZCF143VzCkMZgAXZrJtDtBWARkC+SIfrLqqZ/DrYKUq1WM1hk8Bro/oUGNw0OA32QV/YleWlgatBsBi5gBBiiBzcmI8xIz9BAzzAQGBNWDBDAwSDNoMSgAQxvcwYHBg+GAIZQoL1TGXYzHGE4yiTGZMPkzOQKUcrECNUjzIACmPwAofGdPg==</latexit><latexit sha1_base64="gxPVx+cyH8AU6abpYLABUy0EzZE=">AAAClHichVHLShxBFD12TGLGJE4iBMFN4WAwm8ltNwliQBDBjeJrVHBM091TmsKe7ra7ZsLYzA+4FxeuFCQEP8GlCv6ACz9BsjTgxkXu9HQIiWhuUVWnTt1z61SVE3oq1kSXHcajzsdPnnY9y3U/f/GyJ//q9WIc1CJXltzAC6Jlx46lp3xZ0kp7cjmMpF11PLnkbIy39pfqMopV4C/oRihXq/a6r9aUa2umrPz7iqXEJyGt5Kulmp+ThaYou5VACzH1GzSsWJQ3a3ZFDA2/s/IFKlIa4i4wM1BAFjNB/hvKqCCAixqqkPChGXuwEXNbgQlCyNwqEuYiRirdl2gix9oaZ0nOsJnd4HGdVysZ6/O6VTNO1S6f4nGPWCkwSBf0na7pnI7oim7vrZWkNVpeGjw7ba0MrZ7tvvmb/6qqPGt8+aN60LPGGj6mXhV7D1OmdQu3ra9v7V7Pj8wNJm/pgH6w/326pBO+gV//6R7Oyrk95PgDzH+f+y5YHC6aVDRnqTA2kn1FF/oxgCF+7w8YwyRmUOJzd3CMU5wZb4xRY9yYaKcaHZmmF3+FMf0Lk/qZ7g==</latexit>
:
Attention Model
• : i
• : Sentence embedding (word embedding
ewi<latexit sha1_base64="x4l3zHzubRCvfB0YWbX/UAg3yw0=">AAACanichVE9SwNBFJyc3/ErRhA1jRgVq/DORrEK2FhqYoygEu7OVZdc7o67S0RDShs7K8FUCiLiz7DxD1jY2Yp2EWwsfLkERIP6lt2dnX3zdnZXd0zp+USPIaWtvaOzq7sn3NvXPzAYGYque3bRNUTGsE3b3dA1T5jSEhlf+qbYcFyhFXRTZPX8Un0/WxKuJ21rzT90xHZB27PkrjQ0n6msyJUPcrKSi8QpQUFMtAK1CeLJ8eORJwArduQaW9iBDQNFFCBgwWdsQoPHbRMqCA5z2ygz5zKSwb5ABWHWFjlLcIbGbJ7HPV5tNlmL1/WaXqA2+BSTu8vKCUzTA91Qje7plp7p49da5aBG3cshz3pDK5zc4Mlo+v1fVYFnH/tfqj89+9jFQuBVsncnYOq3MBr60tFZLb2Ymi7P0CW9sP8LeqQ7voFVejOuVkWqijB/gPrzuVvB+lxCpYS6yj+xiEZ0I4ZJzPJ7zyOJZawgE7g7xTmqoVclqowpsUaqEmpqhvEtlKlPPhuOgA==</latexit><latexit sha1_base64="3sS7tnQeSlXgw8YyNMmYjFK6rcs=">AAACanichVG7SgNBFD1ZXzG+ooL4aIIvrMJdG8UqYGOZRGOEKGF3HXVws7vsbiIxpLSxsxJMpSAifoaNPyAofoFop2Bj4c0mICrqHWbmzJl77pyZ0R1Tej7RfUhpaW1r7wh3Rrq6e3r7ov0Dq55ddA2RMWzTdtd0zROmtETGl74p1hxXaAXdFFl9d7G+ny0J15O2teKXHbFR0LYtuSUNzWcqK/KVvbys5qMTFKcgYj+B2gQTidGDoYeeO0ra0QusYxM2DBRRgIAFn7EJDR63HFQQHOY2UGHOZSSDfYEqIqwtcpbgDI3ZXR63eZVrshav6zW9QG3wKSZ3l5UxTNEtXdIL3dAVPdL7r7UqQY26lzLPekMrnHzf4fDy27+qAs8+dj5Vf3r2sYX5wKtk707A1G9hNPSl/eOX5YX0VGWazuiJ/Z/SPV3zDazSq3GeEukaIvwB6vfn/glWZ+MqxdUU/8QCGhHGGMYxw+89hwSWkEQmcHeEE9RCz8qAMqKMNVKVUFMziC+hTH4ALSyPkA==</latexit><latexit sha1_base64="3sS7tnQeSlXgw8YyNMmYjFK6rcs=">AAACanichVG7SgNBFD1ZXzG+ooL4aIIvrMJdG8UqYGOZRGOEKGF3HXVws7vsbiIxpLSxsxJMpSAifoaNPyAofoFop2Bj4c0mICrqHWbmzJl77pyZ0R1Tej7RfUhpaW1r7wh3Rrq6e3r7ov0Dq55ddA2RMWzTdtd0zROmtETGl74p1hxXaAXdFFl9d7G+ny0J15O2teKXHbFR0LYtuSUNzWcqK/KVvbys5qMTFKcgYj+B2gQTidGDoYeeO0ra0QusYxM2DBRRgIAFn7EJDR63HFQQHOY2UGHOZSSDfYEqIqwtcpbgDI3ZXR63eZVrshav6zW9QG3wKSZ3l5UxTNEtXdIL3dAVPdL7r7UqQY26lzLPekMrnHzf4fDy27+qAs8+dj5Vf3r2sYX5wKtk707A1G9hNPSl/eOX5YX0VGWazuiJ/Z/SPV3zDazSq3GeEukaIvwB6vfn/glWZ+MqxdUU/8QCGhHGGMYxw+89hwSWkEQmcHeEE9RCz8qAMqKMNVKVUFMziC+hTH4ALSyPkA==</latexit><latexit sha1_base64="q/67vEdv5/qfCynVHvOkFP3jeew=">AAACanichVHLSsNAFD2N7/po1Y3SjVgVV+XGjdJVwY1LX7VCLSGJow6mSUjSSi3+gDtXgq4URMTPcOMPuOgniO4U3LjwJg2IinqHmTlz5p47Z2YM15J+QNRKKB2dXd09vX3J/oHBoVR6eGTDd2qeKYqmYznepqH7wpK2KAYysMSm6wm9aliiZOwvhvuluvB86djrQcMVlaq+a8sdaeoBUyWhNQ80eaSls5SjKCZ+AjUGWcSx7KSvsYVtODBRQxUCNgLGFnT43MpQQXCZq6DJnMdIRvsCR0iytsZZgjN0Zvd53OVVOWZtXoc1/Uht8ikWd4+VE5imB7qhF7qnW3qk919rNaMaoZcGz0ZbK1wtdTy29vavqspzgL1P1Z+eA+xgIfIq2bsbMeEtzLa+fnj6spZfnW7O0CU9sf8LatEd38Cuv5pXK2L1HEn+APX7c/8EG3M5lXLqCmUL+fgrepHBJGb5vedRwBKWUYzcneAM54lnZUQZVzLtVCURa0bxJZSpD+INjKs=</latexit>
ys<latexit sha1_base64="AoogSymyxANrC1i1gQiSe0cBUuY=">AAACZnichVG7SgNBFD3Z+IhRY3yhYBMMEatw10ZJFbCxzMNEQSXsrpO4uNlddjeBGARrwdYUVgoi4j/Y2PgDFvkDxVLBxsKbTUBU1DvMzJkz99w5M6Pahu56RO2AFOzrHxgMDYWHR0YjY9HxiaJr1RxNFDTLsJxNVXGFoZui4OmeITZtRyhV1RAb6v5qZ3+jLhxXt8x1r2GLnapSMfWyrikeU/lGyS1F45QkP2I/gdwD8fTUbfAIQMaKXmEbu7CgoYYqBEx4jA0ocLltQQbBZm4HTeYcRrq/L3CIMGtrnCU4Q2F2n8cKr7Z6rMnrTk3XV2t8isHdYWUMCXqga3qhe7qhJ3r/tVbTr9Hx0uBZ7WqFXRo7ns2//auq8uxh71P1p2cPZaz4XnX2bvtM5xZaV18/aL3kU7lEc4Eu6Jn9n1Ob7vgGZv1Vu8yK3BnC/AHy9+f+CYpLSZmScpZ/IoVuhDCHeSzyey8jjTVkUOBzKzjBKVqBRykiTUsz3VQp0NNM4ktIsQ/MIYxo</latexit><latexit sha1_base64="5tYp+UfNh6PcG0m4QoFgXkqbYBA=">AAACZnichVG7SgNBFD3Z+IyPxBcKNkGJWIW7NopVwMbSJCYRYgi76yQu2ewuu5tADP6AYKuFlYKI+A82NmksLfIHiqWCjYU3m4CoqHeYmTNn7rlzZka1Dd31iNoBKdjXPzA4NBwaGR0bD0cmJrOuVXM0kdEsw3J2VMUVhm6KjKd7htixHaFUVUPk1MpGZz9XF46rW+a217BFoaqUTb2ka4rHVLpRdIuRRYqTH9GfQO6BxcT0bdC+b9W2rMgVdrEHCxpqqELAhMfYgAKXWx4yCDZzBTSZcxjp/r7AIUKsrXGW4AyF2QqPZV7le6zJ605N11drfIrB3WFlFDF6oGt6oRbd0BO9/1qr6dfoeGnwrHa1wi6Gj+bSb/+qqjx72P9U/enZQwlrvledvds+07mF1tXXD05f0uupWHOJLuiZ/Z9Tm+74Bmb9VbtMitQZQvwB8vfn/gmyK3GZ4nKSf2Id3RjCPBawzO+9igQ2sYUMn1vGMU5wGniUxqUZababKgV6mil8CSn6AWWpjmI=</latexit><latexit sha1_base64="5tYp+UfNh6PcG0m4QoFgXkqbYBA=">AAACZnichVG7SgNBFD3Z+IyPxBcKNkGJWIW7NopVwMbSJCYRYgi76yQu2ewuu5tADP6AYKuFlYKI+A82NmksLfIHiqWCjYU3m4CoqHeYmTNn7rlzZka1Dd31iNoBKdjXPzA4NBwaGR0bD0cmJrOuVXM0kdEsw3J2VMUVhm6KjKd7htixHaFUVUPk1MpGZz9XF46rW+a217BFoaqUTb2ka4rHVLpRdIuRRYqTH9GfQO6BxcT0bdC+b9W2rMgVdrEHCxpqqELAhMfYgAKXWx4yCDZzBTSZcxjp/r7AIUKsrXGW4AyF2QqPZV7le6zJ605N11drfIrB3WFlFDF6oGt6oRbd0BO9/1qr6dfoeGnwrHa1wi6Gj+bSb/+qqjx72P9U/enZQwlrvledvds+07mF1tXXD05f0uupWHOJLuiZ/Z9Tm+74Bmb9VbtMitQZQvwB8vfn/gmyK3GZ4nKSf2Id3RjCPBawzO+9igQ2sYUMn1vGMU5wGniUxqUZababKgV6mil8CSn6AWWpjmI=</latexit><latexit sha1_base64="Ud69PkePSfMi5E39aaMWb5CULcM=">AAACZnichVHLSsNAFD2Nr1pfVREFN8VScVVu3CiuCm5c9mFbQUtJ4rQG0yQkaaEWf0BwaxeuFETEz3DjD7joHyguK7hx4W0aEC3qHWbmzJl77pyZUW1Ddz2iTkgaGh4ZHQuPRyYmp6ZnorNzBdeqO5rIa5ZhOXuq4gpDN0Xe0z1D7NmOUGqqIYrq8XZvv9gQjqtb5q7XtEWpplRNvaJrisdUrll2y9E4JcmP2CCQAxBHEGkreosDHMKChjpqEDDhMTagwOW2DxkEm7kSWsw5jHR/X+AUEdbWOUtwhsLsMY9VXu0HrMnrXk3XV2t8isHdYWUMCXqiO+rSI93TC338Wqvl1+h5afKs9rXCLs+cLeXe/1XVePZw9KX607OHCjZ9rzp7t32mdwutr2+ctLu5rWyitUrX9Mr+r6hDD3wDs/Gm3WRE9hIR/gD553MPgsJ6UqaknKF4aiv4ijCWsYI1fu8NpLCDNPJ8bhXnuEA79CxNSwvSYj9VCgWaeXwLKfYJ5NWK0w==</latexit>
ys =
1
n
nX
i=1
ewi
(1)
<latexit sha1_base64="1Cal3UOTlXZJ8XrIv6Y0otp8wzs=">AAACl3ichVE9SxxRFD2OH1k3RldtFJshYtBmuWMTERYXhGDpalYF1wwz41t9OF/Ox8o67B/wDxiwUghBbK1tLOIfSGGXNqQ0kMbCO7MLIYrxDvPeuefdc99575m+LcOI6LZL6e7p7XuV68+/HngzOFQYHlkLvTiwRNXybC/YMI1Q2NIV1UhGttjwA2E4pi3Wzb3FdH29IYJQeu7HqOmLLcfYcWVdWkbElF6YbeqhWlJr9cCwEq2VuC21FsaOnsiS1vqUpkJPDnTJ9H5sbKvT2oxemKQiZaE+BVoHTJbLl/0/ACx7ha+oYRseLMRwIOAiYmzDQMjfJjQQfOa2kDAXMJLZukALedbGXCW4wmB2j8cdzjY7rMt52jPM1BbvYvMfsFLFFH2nc7qjG7qgn3T/bK8k65F6afJstrXC14eOxlb/vKhyeI6w+1f1X88R6pjLvEr27mdMegqrrW8cHt+tzq9MJe/ojH6x/1O6pWs+gdv4bX2piJUT5PkBtMfX/RSszRY1KmoVfol5tCOHCbzFNN/3e5SxhGVUed/PuMI33CjjyoLyQVlqlypdHc0o/gml8gAqFZ6j</latexit><latexit sha1_base64="sk6hrNyOXbnpwTVNWbTaqdBn9eY=">AAACl3ichVFNSxtRFD0Zbavph9FuWtwMFcVuwh03iiAGCuLSGBMFo8PM+KIP56vzEUmH/IFuXSh0pVBK6bZrNy7MH+hC6B8oXSoo2EXvTAKlFe0d5r1zz7vnvvPeM31bhhHReU7p63/w8NHAYP7xk6fPhgrDI7XQiwNLVC3P9oI10wiFLV1RjWRkizU/EIZj2mLV3H2Trq82RRBKz12JWr7YcIxtVzakZURM6YWplh6qc2q9ERhWorUTt63Ww9jREzmntTfTVOjJni6ZfhsbW+qk9lovjFGRslBvA60Hxkqlr4Pfr/dvlrzCJ9SxBQ8WYjgQcBExtmEg5G8dGgg+cxtImAsYyWxdoI08a2OuElxhMLvL4zZn6z3W5TztGWZqi3ex+Q9YqWKcvtFnuqAOfaEf9OvOXknWI/XS4tnsaoWvD71/Ubn6r8rhOcLOH9W9niM0MJN5lezdz5j0FFZX33x3cFGZXR5PJuiYfrL/IzqnUz6B27y0PpbF8gfk+QG0f6/7NqhNFTUqamV+iVl0YwCjeIVJvu9plLCIJVR530Oc4Awd5aUyrywoi91SJdfTPMdfoZR/A7rqoSU=</latexit><latexit sha1_base64="sk6hrNyOXbnpwTVNWbTaqdBn9eY=">AAACl3ichVFNSxtRFD0Zbavph9FuWtwMFcVuwh03iiAGCuLSGBMFo8PM+KIP56vzEUmH/IFuXSh0pVBK6bZrNy7MH+hC6B8oXSoo2EXvTAKlFe0d5r1zz7vnvvPeM31bhhHReU7p63/w8NHAYP7xk6fPhgrDI7XQiwNLVC3P9oI10wiFLV1RjWRkizU/EIZj2mLV3H2Trq82RRBKz12JWr7YcIxtVzakZURM6YWplh6qc2q9ERhWorUTt63Ww9jREzmntTfTVOjJni6ZfhsbW+qk9lovjFGRslBvA60Hxkqlr4Pfr/dvlrzCJ9SxBQ8WYjgQcBExtmEg5G8dGgg+cxtImAsYyWxdoI08a2OuElxhMLvL4zZn6z3W5TztGWZqi3ex+Q9YqWKcvtFnuqAOfaEf9OvOXknWI/XS4tnsaoWvD71/Ubn6r8rhOcLOH9W9niM0MJN5lezdz5j0FFZX33x3cFGZXR5PJuiYfrL/IzqnUz6B27y0PpbF8gfk+QG0f6/7NqhNFTUqamV+iVl0YwCjeIVJvu9plLCIJVR530Oc4Awd5aUyrywoi91SJdfTPMdfoZR/A7rqoSU=</latexit><latexit sha1_base64="KQ7nMOuXb3dxBHOvfkjfYOvEBns=">AAACl3ichVHLShxBFD22muiocdSN4qZxUHQz3HYTEUQhEFw6mlHBMU13W2MK+5V+jEya+QF/IIGsEhAR/8GNC/2BLPwEcangxoW3exrEiHqbrjr31D23TlWZvi3DiOiyQ+ns6n73vqe30Nc/8GGwODS8HnpxYImq5dlesGkaobClK6qRjGyx6QfCcExbbJh7n9L1jYYIQum5X6KmL7YdY9eVdWkZEVN6cbaph+qCWqsHhpVorcRtqbUwdvRELmitr2kq9GRfl0x/j40ddVqb0YslKlMW6nOg5aCEPFa84hFq2IEHCzEcCLiIGNswEPK3BQ0En7ltJMwFjGS2LtBCgbUxVwmuMJjd43GXs62cdTlPe4aZ2uJdbP4DVqqYpH90TDd0QSd0Rfcv9kqyHqmXJs9mWyt8ffBgdO3uTZXDc4Rvj6pXPUeoYy7zKtm7nzHpKay2vvHj583a/OpkMkV/6Zr9/6FLOuMTuI1b67AiVn+jwA+g/X/dz8H6bFmjslah0tJ8/hQ9GMcEpvm+P2IJy1hBlff9hVOc40IZUxaVz8pyu1TpyDUjeBJK5QFJpJyG</latexit>
2.
• : i attention score( )
• :
di<latexit sha1_base64="HDo6EPc0yTcKCeuU2EkeD0II/qY=">AAACZ3ichVG7SgNBFD1ZXzE+EhUkIEhUFKtw10ZJFbCx1MREQSXsrqMO2ewuu5tADP6Aha2ClYKIiF9h4w9YpLMVywg2Ft7dBERFvcPMnDlzz50zM7pjSs8nakaUru6e3r5of2xgcGg4nhgZLXp21TVEwbBN293UNU+Y0hIFX/qm2HRcoVV0U2zo5eVgf6MmXE/a1rpfd8RORdu35J40ND+gdksyVUrMUJrCSP0EagfMZBOTd08AVu3ENbaxCxsGqqhAwILP2IQGj9sWVBAc5nbQYM5lJMN9gSPEWFvlLMEZGrNlHvd5tdVhLV4HNb1QbfApJneXlSnM0iPdUIse6Jae6f3XWo2wRuClzrPe1gqnFD9O5t/+VVV49nHwqfrTs489LIVeJXt3Qia4hdHW1w5PW/lMbrYxR5f0wv4vqEn3fAOr9mpcrYncOWL8Aer35/4JigtpldLqGv9EBu2IYgLTmOf3XkQWK1hFgc89wAlOcRZ5VuLKuJJspyqRjmYMX0KZ+gCubIzZ</latexit><latexit sha1_base64="VHetlw7Ew+UOXDHZUtuC1SLcmB0=">AAACZ3ichVHLSsNAFD2N7/poVRBBkKoorsqNG8VVwY1L21ot1FKSOOpgmoQkLWjxB1yIOwVXCiIi/QfBjT/gop8gLhXcuPAmLYgW9Q4zc+bMPXfOzOiOKT2fqBFROjq7unt6+6L9A4NDsfjwyIZnV1xD5AzbtN28rnnClJbI+dI3Rd5xhVbWTbGp768E+5tV4XrSttb9A0cUy9quJXekofkBtV2SiVJ8hpIURqIdqC0wk4pP1p9O7+trdvwGW9iGDQMVlCFgwWdsQoPHrQAVBIe5ImrMuYxkuC9whChrK5wlOENjdp/HXV4VWqzF66CmF6oNPsXk7rIygVl6olt6pUe6o2f6+LVWLawReDngWW9qhVOKHY9n3/9VlXn2sfel+tOzjx0shV4le3dCJriF0dRXD89es8uZ2docXdEL+7+kBj3wDazqm3GdFpkLRPkD1J/P3Q42FpIqJdU0/8QymtGLCUxjnt97ESmsYg05PncPJzjDeeRZiSljyngzVYm0NKP4FsrUJzj5jss=</latexit><latexit sha1_base64="VHetlw7Ew+UOXDHZUtuC1SLcmB0=">AAACZ3ichVHLSsNAFD2N7/poVRBBkKoorsqNG8VVwY1L21ot1FKSOOpgmoQkLWjxB1yIOwVXCiIi/QfBjT/gop8gLhXcuPAmLYgW9Q4zc+bMPXfOzOiOKT2fqBFROjq7unt6+6L9A4NDsfjwyIZnV1xD5AzbtN28rnnClJbI+dI3Rd5xhVbWTbGp768E+5tV4XrSttb9A0cUy9quJXekofkBtV2SiVJ8hpIURqIdqC0wk4pP1p9O7+trdvwGW9iGDQMVlCFgwWdsQoPHrQAVBIe5ImrMuYxkuC9whChrK5wlOENjdp/HXV4VWqzF66CmF6oNPsXk7rIygVl6olt6pUe6o2f6+LVWLawReDngWW9qhVOKHY9n3/9VlXn2sfel+tOzjx0shV4le3dCJriF0dRXD89es8uZ2docXdEL+7+kBj3wDazqm3GdFpkLRPkD1J/P3Q42FpIqJdU0/8QymtGLCUxjnt97ESmsYg05PncPJzjDeeRZiSljyngzVYm0NKP4FsrUJzj5jss=</latexit><latexit sha1_base64="3KKJsiy/4yy6Whk0cRXct0CXTYo=">AAACZ3ichVHLSsNAFD2Nr1ofrQpScFMtFVflxo3iSnDjslWrgpaSpKMOpklI0kIt/oALtxVcKYiIn+HGH3DRTxCXCm5ceJMGRIt6h5k5c+aeO2dmdMeUnk/UiSl9/QODQ/HhxMjo2HgyNTG57dl11xAlwzZtd1fXPGFKS5R86Zti13GFVtNNsaMfrwX7Ow3hetK2tvymI8o17dCSB9LQ/ICqVmSmkspSnsLI9AI1AllEUbBTt9hHFTYM1FGDgAWfsQkNHrc9qCA4zJXRYs5lJMN9gVMkWFvnLMEZGrPHPB7yai9iLV4HNb1QbfApJneXlRnk6Inu6JUe6Z6e6ePXWq2wRuClybPe1QqnkjxLb77/q6rx7OPoS/WnZx8HWA69SvbuhExwC6Orb5y0XzdXNnKtebqmF/Z/RR164BtYjTfjpig2LpHgD1B/Pncv2F7Mq5RXi5RdXYm+Io4ZzGGB33sJq1hHASU+9wjnaOMi9qwklWkl3U1VYpFmCt9Cmf0EDUqK3g==</latexit>
M<latexit sha1_base64="W8S+ufNyAiI/KQ/9yIwkIwmJtm0=">AAACZHichVG7SgNBFD1ZXzFGjYogCBIMilW4a6PYGLCxEUxiNBBD2F0ncXFf7G4CGvwBbRULKxUR8ScEG39AxB8QxFLBxsKbTUBU1DvMzJkz99w5M6M6hu75RA8hqa29o7Mr3B3pifb29ccGBlc9u+pqIqfZhu3mVcUThm6JnK/7hsg7rlBM1RBr6tZCY3+tJlxPt60Vf9sRRVOpWHpZ1xSfqfRSKZagJAUR/wnkFkjMX5/dg2PZjl1gHRuwoaEKEwIWfMYGFHjcCpBBcJgros6cy0gP9gV2EWFtlbMEZyjMbvFY4VWhxVq8btT0ArXGpxjcXVbGMUF3dEkvdEtX9ETvv9aqBzUaXrZ5Vpta4ZT690ayb/+qTJ59bH6q/vTso4zZwKvO3p2AadxCa+prO0cv2bnMRH2STumZ/Z/QA93wDazaq3aeFpljRPgD5O/P/ROsTidlSsppSqTm0IwwRjGOKX7vGaSwiGXk+FyBfRzgMPQoRaUhabiZKoVamiF8CWnsAyd8jDo=</latexit><latexit sha1_base64="392Oq/iF+3Uj8gswZiH7+mGaYfo=">AAACZHichVHLSsNAFD2N71q1WgRBkGJRXJUbN4ogCm7cCH3YKtRSkjhqME1Ckha0+AO6VVy48oWIPyG48QdE+gOCuKzgxoW3aUFU1DvMzJkz99w5M6Pahu56RNWA1NLa1t7R2RXsDvX09oX7B7KuVXI0kdEsw3JWVcUVhm6KjKd7hli1HaEUVUOsqNsL9f2VsnBc3TKXvR1b5IvKpqlv6JriMZVcKoRjFCc/oj+B3ASxudvzx+CsfZGwwldYwzosaCihCAETHmMDClxuOcgg2MzlUWHOYaT7+wJ7CLK2xFmCMxRmt3nc5FWuyZq8rtd0fbXGpxjcHVZGMUYPdE01uqcbeqb3X2tV/Bp1Lzs8qw2tsAt9+0Ppt39VRZ49bH2q/vTsYQPTvledvds+U7+F1tCXd49r6ZnUWGWczuiF/Z9Sle74Bmb5VbtMitQJgvwB8vfn/gmyk3GZ4nKSYvMzaEQnhjGKCX7vKcxjEQlk+FyBAxziKPAkhaSINNhIlQJNTQRfQhr5AJ7tjZU=</latexit><latexit sha1_base64="392Oq/iF+3Uj8gswZiH7+mGaYfo=">AAACZHichVHLSsNAFD2N71q1WgRBkGJRXJUbN4ogCm7cCH3YKtRSkjhqME1Ckha0+AO6VVy48oWIPyG48QdE+gOCuKzgxoW3aUFU1DvMzJkz99w5M6Pahu56RNWA1NLa1t7R2RXsDvX09oX7B7KuVXI0kdEsw3JWVcUVhm6KjKd7hli1HaEUVUOsqNsL9f2VsnBc3TKXvR1b5IvKpqlv6JriMZVcKoRjFCc/oj+B3ASxudvzx+CsfZGwwldYwzosaCihCAETHmMDClxuOcgg2MzlUWHOYaT7+wJ7CLK2xFmCMxRmt3nc5FWuyZq8rtd0fbXGpxjcHVZGMUYPdE01uqcbeqb3X2tV/Bp1Lzs8qw2tsAt9+0Ppt39VRZ49bH2q/vTsYQPTvledvds+U7+F1tCXd49r6ZnUWGWczuiF/Z9Sle74Bmb5VbtMitQJgvwB8vfn/gmyk3GZ4nKSYvMzaEQnhjGKCX7vKcxjEQlk+FyBAxziKPAkhaSINNhIlQJNTQRfQhr5AJ7tjZU=</latexit><latexit sha1_base64="lESrIxjkeVnoByuWQ/p081PsFVc=">AAACZHichVG7SgNBFD1Z3/EVDYIgiBgUq3DXRrESbGyEPEwUVGR3ncTFfbE7CWjwB7RVLKwURMTPsPEHLPIDglgq2Fh4d7MgKuodZubMmXvunJnRPcsMJFEzobS1d3R2dfcke/v6BwZTQ8PlwK35higZruX667oWCMt0REma0hLrni80W7fEmr63FO6v1YUfmK6zKvc9sWVrVcesmIYmmcqvbKcylKUoJn4CNQYZxJFzU9fYxA5cGKjBhoADydiChoDbBlQQPOa20GDOZ2RG+wKHSLK2xlmCMzRm93is8mojZh1ehzWDSG3wKRZ3n5UTmKIHuqEXuqdbeqL3X2s1ohqhl32e9ZZWeNuDR6PFt39VNs8Su5+qPz1LVDAfeTXZuxcx4S2Mlr5+cPZSXChMNabpkp7Z/wU16Y5v4NRfjau8KJwjyR+gfn/un6A8m1Upq+Yps7gQf0U3xjCJGX7vOSxiGTmU+FyBY5zgNPGo9ClpZaSVqiRiTRpfQhn/AJykicE=</latexit>
E<latexit sha1_base64="aL00XsgYV9g18QA3LhnuBxpM3z8=">AAACZHichVG7SgNBFD1ZXzFGjYogCBIMilW4a6PYGBDB0iRGAzGE3XUSF/fF7iagwR/QVrGwUhERf0Kw8QdE/AFBLBVsLLzZBERFvcPMnDlzz50zM6pj6J5P9BCS2to7OrvC3ZGeaG9ff2xgcNWzq64mcppt2G5eVTxh6JbI+bpviLzjCsVUDbGmbi009tdqwvV021rxtx1RNJWKpZd1TfGZSi+WYglKUhDxn0BugcT89dk9OJbt2AXWsQEbGqowIWDBZ2xAgcetABkEh7ki6sy5jPRgX2AXEdZWOUtwhsLsFo8VXhVarMXrRk0vUGt8isHdZWUcE3RHl/RCt3RFT/T+a616UKPhZZtntakVTql/byT79q/K5NnH5qfqT88+ypgNvOrs3QmYxi20pr62c/SSnctM1CfplJ7Z/wk90A3fwKq9audpkTlGhD9A/v7cP8HqdFKmpJymRGoOzQhjFOOY4veeQQpLWEaOzxXYxwEOQ49SVBqShpupUqilGcKXkMY+ABd8jDI=</latexit><latexit sha1_base64="IJ2Og9vuKJ2sgquaItWHO2yxC3Y=">AAACZHichVHLSsNAFD2N71q1WgRBkGJRXJUbN4ogCiK47MNWoZaSxFGDaRKStKDFH9Ct4sKVL0T8CcGNPyDSHxDEZQU3LrxNC6Ki3mFmzpy5586ZGdU2dNcjqgaklta29o7OrmB3qKe3L9w/kHWtkqOJjGYZlrOqKq4wdFNkPN0zxKrtCKWoGmJF3V6o76+UhePqlrns7dgiX1Q2TX1D1xSPqeRiIRyjOPkR/QnkJojN3Z4/Bmfti4QVvsIa1mFBQwlFCJjwGBtQ4HLLQQbBZi6PCnMOI93fF9hDkLUlzhKcoTC7zeMmr3JN1uR1vabrqzU+xeDusDKKMXqga6rRPd3QM73/Wqvi16h72eFZbWiFXejbH0q//asq8uxh61P1p2cPG5j2vers3faZ+i20hr68e1xLz6TGKuN0Ri/s/5SqdMc3MMuv2mVSpE4Q5A+Qvz/3T5CdjMsUl5MUm59BIzoxjFFM8HtPYR5LSCDD5woc4BBHgScpJEWkwUaqFGhqIvgS0sgHju2NjQ==</latexit><latexit sha1_base64="IJ2Og9vuKJ2sgquaItWHO2yxC3Y=">AAACZHichVHLSsNAFD2N71q1WgRBkGJRXJUbN4ogCiK47MNWoZaSxFGDaRKStKDFH9Ct4sKVL0T8CcGNPyDSHxDEZQU3LrxNC6Ki3mFmzpy5586ZGdU2dNcjqgaklta29o7OrmB3qKe3L9w/kHWtkqOJjGYZlrOqKq4wdFNkPN0zxKrtCKWoGmJF3V6o76+UhePqlrns7dgiX1Q2TX1D1xSPqeRiIRyjOPkR/QnkJojN3Z4/Bmfti4QVvsIa1mFBQwlFCJjwGBtQ4HLLQQbBZi6PCnMOI93fF9hDkLUlzhKcoTC7zeMmr3JN1uR1vabrqzU+xeDusDKKMXqga6rRPd3QM73/Wqvi16h72eFZbWiFXejbH0q//asq8uxh61P1p2cPG5j2vers3faZ+i20hr68e1xLz6TGKuN0Ri/s/5SqdMc3MMuv2mVSpE4Q5A+Qvz/3T5CdjMsUl5MUm59BIzoxjFFM8HtPYR5LSCDD5woc4BBHgScpJEWkwUaqFGhqIvgS0sgHju2NjQ==</latexit><latexit sha1_base64="2gk4boKvAqCP/WlM5qi0mQR/d04=">AAACZHichVG7SgNBFD1Z3/EVDYIgiBgUq3DXRrESRLDMw0RBRXbXSVzcF7uTgAZ/QFvFwkpBRPwMG3/AIj8giKWCjYV3Nwuiot5hZs6cuefOmRnds8xAEjUTSlt7R2dXd0+yt69/YDA1NFwO3JpviJLhWq6/rmuBsExHlKQpLbHu+UKzdUus6XtL4f5aXfiB6Tqrct8TW7ZWdcyKaWiSqfzydipDWYpi4idQY5BBHDk3dY1N7MCFgRpsCDiQjC1oCLhtQAXBY24LDeZ8Rma0L3CIJGtrnCU4Q2N2j8cqrzZi1uF1WDOI1AafYnH3WTmBKXqgG3qhe7qlJ3r/tVYjqhF62edZb2mFtz14NFp8+1dl8yyx+6n607NEBfORV5O9exET3sJo6esHZy/FhcJUY5ou6Zn9X1CT7vgGTv3VuMqLwjmS/AHq9+f+CcqzWZWyap4yiwvxV3RjDJOY4feewyJWkEOJzxU4xglOE49Kn5JWRlqpSiLWpPEllPEPjKSJuQ==</latexit>
15
Sentence This beef looks delicious but the service is bad
Without ai 0.1 0.1 0.1 0.1 0.1 0.1 0.1 0.1 0.1
With ai 0.05 0.24 0.11 0.12 0.12 0.01 0.12 0.09 0.11
Autoencoder part(unsupervised)
16
• : sentence embedding
• : aspect
embedding matrix
T<latexit sha1_base64="U8zv4FkV9T8kWJTl5u2J+C0lY3k=">AAACZHichVG7SgNBFD1ZXzG+okEQBBFDxCrctVHSKNhYJtGYgIrsrpO4ZF/sbgIa/AFtFQsrFRHxJwQbf0AkPyCIpYKNhTebgGhQ7zAzZ87cc+fMjOoYuucT1UNSR2dXd0+4N9LXPzA4FB0eWfPsiquJnGYbtltQFU8YuiVyvu4bouC4QjFVQ+TV8lJjP18Vrqfb1qq/64hNUylZelHXFJ+pzOpWNE5JCmKyHcgtEF+4vXgER9qOXmED27ChoQITAhZ8xgYUeNzWIYPgMLeJGnMuIz3YF9hHhLUVzhKcoTBb5rHEq/UWa/G6UdML1BqfYnB3WTmJBD3QNb3SPd3QM338WqsW1Gh42eVZbWqFszV0MLby/q/K5NnHzpfqT88+ipgPvOrs3QmYxi20pr66d/K6ksomatN0Ti/s/4zqdMc3sKpv2mVGZE8R4Q+Qfz53O1ibTcqUlDMUX0yhGWGMYwoz/N5zWMQy0sjxuQKHOMJx6Enql2LSaDNVCrU0MXwLaeITNXyMQQ==</latexit><latexit sha1_base64="76T0xNTZSrtAgEsx9f+4anWEsYY=">AAACZHichVHLSsNAFD2N71q1KoIgSLFUXJUbN4ogCm5cWrUqVJEkTmtoXiRpQYs/oFvFhStfiPgTght/QMQfEMRlBTcuvEkLokW9w8ycOXPPnTMzqmPonk/0FJGamlta29o7op2xru6eeG/fimeXXE1kNduw3TVV8YShWyLr674h1hxXKKZqiFW1OBfsr5aF6+m2tezvOGLDVAqWntc1xWcqs7wZT1Kawkg0ArkOkjO354/RaediwY5fYR1bsKGhBBMCFnzGBhR43HKQQXCY20CFOZeRHu4L7CHK2hJnCc5QmC3yWOBVrs5avA5qeqFa41MM7i4rE0jRA11Tle7phl7o49dalbBG4GWHZ7WmFc5mz/7g0vu/KpNnH9tfqj89+8hjMvSqs3cnZIJbaDV9efe4ujS1mKqM0hm9sv9TeqI7voFVftMuM2LxBFH+APnnczeClfG0TGk5Q8nZKdSiHUMYwRi/9wRmMY8FZPlcgQMc4ijyLMWkfmmglipF6pp+fAtp+BOs7Y2c</latexit><latexit sha1_base64="76T0xNTZSrtAgEsx9f+4anWEsYY=">AAACZHichVHLSsNAFD2N71q1KoIgSLFUXJUbN4ogCm5cWrUqVJEkTmtoXiRpQYs/oFvFhStfiPgTght/QMQfEMRlBTcuvEkLokW9w8ycOXPPnTMzqmPonk/0FJGamlta29o7op2xru6eeG/fimeXXE1kNduw3TVV8YShWyLr674h1hxXKKZqiFW1OBfsr5aF6+m2tezvOGLDVAqWntc1xWcqs7wZT1Kawkg0ArkOkjO354/RaediwY5fYR1bsKGhBBMCFnzGBhR43HKQQXCY20CFOZeRHu4L7CHK2hJnCc5QmC3yWOBVrs5avA5qeqFa41MM7i4rE0jRA11Tle7phl7o49dalbBG4GWHZ7WmFc5mz/7g0vu/KpNnH9tfqj89+8hjMvSqs3cnZIJbaDV9efe4ujS1mKqM0hm9sv9TeqI7voFVftMuM2LxBFH+APnnczeClfG0TGk5Q8nZKdSiHUMYwRi/9wRmMY8FZPlcgQMc4ijyLMWkfmmglipF6pp+fAtp+BOs7Y2c</latexit><latexit sha1_base64="uP1+27ByLsb5noLVGIpqNIFk+kU=">AAACZHichVG7SgNBFD1Z3zGaqAiCIMEQsQp3bRQrwcbSqFEhiuyukzhkX+xuAhr8AW0VCysFEfEzbPwBC39AEEsFGwvvbhZEg3qHmTlz5p47Z2Z015R+QPSYUDo6u7p7evuS/amBwXRmaHjdd+qeIUqGYzrepq75wpS2KAUyMMWm6wnN0k2xodcWw/2NhvB86dhrwb4rti2tasuKNLSAqeLaTiZHBYoi2w7UGOQQx7KTucYWduHAQB0WBGwEjE1o8LmVoYLgMreNJnMeIxntCxwiydo6ZwnO0Jit8VjlVTlmbV6HNf1IbfApJnePlVnk6YFu6JXu6Zae6ePXWs2oRuhln2e9pRXuTvpobPX9X5XFc4C9L9WfngNUMBd5lezdjZjwFkZL3zg4e12dX8k3p+iSXtj/BT3SHd/AbrwZV0Wxco4kf4D687nbwfpMQaWCWqTcwnz8Fb0YxySm+b1nsYAlLKPE5woc4wSniSclpYwoo61UJRFrRvAtlIlPqqSJyA==</latexit>
rs = TT
· pt (6)<latexit sha1_base64="1cwaS5a4T2iGUxSDNmMe5jkMb7Q=">AAACgnichVHLLgRBFD3ae7wGGyGSjlewmNwmQYREYmPpMYPE0OnuKXT0dLfumkmYWImNH7CwIhEROz7Bxg9Y+ASxJLGxcKdnEkFwK1V16tQ9t05Vmb5jh5LosUKprKquqa2rjzU0NjW3xFvblkMvF1giZXmOF6yaRigc2xUpaUtHrPqBMLKmI1bMndni/kpeBKHtuUm554v1rLHl2pu2ZUim9Hh3oIfqtJrcSKppK+NJ1delmt7NGRl1cGxIj/dSgqJQfwKtDHpnOo/6wDHvxS+RRgYeLOSQhYALydiBgZDbGjQQfObWUWAuYGRH+wIHiLE2x1mCMwxmd3jc4tVamXV5XawZRmqLT3G4B6xU0U8PdEUvdE/X9ETvv9YqRDWKXvZ4Nkta4estxx1Lb/+qsjxLbH+q/vQssYmJyKvN3v2IKd7CKunz+ycvS5OL/YUBOqdn9n9Gj3THN3Dzr9bFglg8RYw/QPv+3D/B8khCo4S2wD8xiVLUoQs9GOT3HscM5jCPFJ97iCvc4FapUoYVTRktpSoVZU07voQy9QEarJPf</latexit><latexit sha1_base64="zUck8IkKmsnYlnlg6FLiassNeIw=">AAACgnicSyrIySwuMTC4ycjEzMLKxs7BycXNw8vHLyAoFFacX1qUnBqanJ+TXxSRlFicmpOZlxpaklmSkxpRUJSamJuUkxqelO0Mkg8vSy0qzszPCympLEiNzU1Mz8tMy0xOLAEKxQvIFsUXK9gqhMSFKMQkp+SXKBTElyjEFJYmpihomGnGCygb6BmAgQImwxDKUHaQalX+Vu+7LyBfYDlDDEMKQz5DMkMpQy5DKkMeQwmQncOQyFAMhNEMhgwGDAVAsViGaqBYEZCVCZZPZahl4ALqLQWqSgWqSASKZgPJdCAvGiqaB+SDzCwG604G2pIDxEVAnQoMqgZXDVYafDY4YbDa4KXBH5xmVYPNALmlEkgnQfSmFsTzd0kEfyeoKxdIlzBkIHThdXMJQxqDBditmUC3F4BFQL5Ihugvq5r+OdgqSLVazWCRwWug+xca3DQ4DPRBXtmX5KWBqUGzGbiAEWCIHtyYjDAjPUMDPcNAYExYMUAAB4M0gxKDBjC8zRkcGDwYAhhCgfY2M6xk2MSwmYmFSYvJkMkYopSJEapHmAEFMNkAAKfAll4=</latexit><latexit sha1_base64="zUck8IkKmsnYlnlg6FLiassNeIw=">AAACgnicSyrIySwuMTC4ycjEzMLKxs7BycXNw8vHLyAoFFacX1qUnBqanJ+TXxSRlFicmpOZlxpaklmSkxpRUJSamJuUkxqelO0Mkg8vSy0qzszPCympLEiNzU1Mz8tMy0xOLAEKxQvIFsUXK9gqhMSFKMQkp+SXKBTElyjEFJYmpihomGnGCygb6BmAgQImwxDKUHaQalX+Vu+7LyBfYDlDDEMKQz5DMkMpQy5DKkMeQwmQncOQyFAMhNEMhgwGDAVAsViGaqBYEZCVCZZPZahl4ALqLQWqSgWqSASKZgPJdCAvGiqaB+SDzCwG604G2pIDxEVAnQoMqgZXDVYafDY4YbDa4KXBH5xmVYPNALmlEkgnQfSmFsTzd0kEfyeoKxdIlzBkIHThdXMJQxqDBditmUC3F4BFQL5Ihugvq5r+OdgqSLVazWCRwWug+xca3DQ4DPRBXtmX5KWBqUGzGbiAEWCIHtyYjDAjPUMDPcNAYExYMUAAB4M0gxKDBjC8zRkcGDwYAhhCgfY2M6xk2MSwmYmFSYvJkMkYopSJEapHmAEFMNkAAKfAll4=</latexit><latexit sha1_base64="ztHqAfxINm7NDtHnJAs9s0up6yE=">AAACgnichVHLLgRBFD3ae7wGG4lIOiYEi8ltEkRIJDaWHjNIDJ3unkJHT3frrpmEiZWdH7CwIhEROz7Bxg9Y+ASxJLGxcKenE0FwK1V16tQ9t05Vmb5jh5LosUapratvaGxqTrS0trV3JDu7VkKvGFgia3mOF6yZRigc2xVZaUtHrPmBMAqmI1bN3bnK/mpJBKHtuRm574uNgrHt2lu2ZUim9GRfoIfqjJrZzKg5K+9J1delmtsrGnl1aHxYT6YoTVGoP4EWgxTiWPCSl8ghDw8WiihAwIVk7MBAyG0dGgg+cxsoMxcwsqN9gUMkWFvkLMEZBrO7PG7zaj1mXV5XaoaR2uJTHO4BK1UM0ANd0Qvd0zU90fuvtcpRjYqXfZ7Nqlb4esdxz/Lbv6oCzxI7n6o/PUtsYTLyarN3P2Iqt7Cq+tLBycvy1NJAeZDO6Zn9n9Ej3fEN3NKrdbEolk6R4A/Qvj/3T7AymtYorS1SanYq/oom9KIfQ/zeE5jFPBaQ5XOPcIUb3Cp1yoiiKWPVVKUm1nTjSyjTHz6Wktw=</latexit>
: k*d, 14*200
d1 d2 d199 d200
k1
k2
k14
…
…
2.
• : K aspect embedding
K aspect
• : Sentence embedding (weighted
sum of word embedding)
• :
pt
zs<latexit sha1_base64="hvgbNff5B+9OnNLVU3Kb9zV4P9A=">AAACZnichVG7SgNBFD1ZXzFqEhVRECQYIlbhro1iFbCxzMMYQSXsrpO4ZLO77G4CMfgDgq0prBRERPwKG3/Aws5SsYxgY+HNJiAq6h1m5syZe+6cmVFtQ3c9ooeA1Nc/MDgUHA6NjI6FI9HxiU3XqjmayGuWYTlbquIKQzdF3tM9Q2zZjlCqqiEKamWts1+oC8fVLXPDa9hit6qUTb2ka4rHVO6g6BajcUqSH7GfQO6BeCo6d/MIIG1FL7GDPVjQUEMVAiY8xgYUuNy2IYNgM7eLJnMOI93fFzhEiLU1zhKcoTBb4bHMq+0ea/K6U9P11RqfYnB3WBlDgu7pitp0R9f0TO+/1mr6NTpeGjyrXa2wi5Gjmdzbv6oqzx72P1V/evZQworvVWfvts90bqF19fWDVju3mk00F+icXtj/GT3QLd/ArL9qFxmRPUWIP0D+/tw/weZSUqaknOGfWEU3gpjFPBb5vZeRwjrSyPO5ZRzjBK3AkxSWpqTpbqoU6Gkm8SWk2AeICIzP</latexit><latexit sha1_base64="ZHTzYmNEzaNefnjGlgizFG658BQ=">AAACZnichVHLSsNAFD2N7/poVURBkKIorsqNG8VVwY3LPmwr1FKSONbQNAlJWtDiDwiCK7twpSAi0n8Q3PgDXfQPFJcKblx4mxZERb3DzJw5c8+dMzOqbeiuR9QKSD29ff0Dg0PB4ZHRsVB4fCLjWhVHE2nNMixnW1VcYeimSHu6Z4ht2xFKWTVEVi1ttPezVeG4umVueQe2yJeVoqnv6ZriMZU6LLiF8AJFyY/ITyB3wUIsPNdont414lb4GjvYhQUNFZQhYMJjbECByy0HGQSbuTxqzDmMdH9f4AhB1lY4S3CGwmyJxyKvcl3W5HW7puurNT7F4O6wMoJFatINvdAD3dITvf9aq+bXaHs54FntaIVdCB3PpN7+VZV59rD/qfrTs4c9rPledfZu+0z7FlpHXz2sv6TWk4u1JbqkZ/Z/QS265xuY1VftKiGS5wjyB8jfn/snyKxEZYrKCf6JdXRiELOYxzK/9ypi2EQcaT63iBOcoR54lMakKWm6kyoFuppJfAkp8gESlY7B</latexit><latexit sha1_base64="ZHTzYmNEzaNefnjGlgizFG658BQ=">AAACZnichVHLSsNAFD2N7/poVURBkKIorsqNG8VVwY3LPmwr1FKSONbQNAlJWtDiDwiCK7twpSAi0n8Q3PgDXfQPFJcKblx4mxZERb3DzJw5c8+dMzOqbeiuR9QKSD29ff0Dg0PB4ZHRsVB4fCLjWhVHE2nNMixnW1VcYeimSHu6Z4ht2xFKWTVEVi1ttPezVeG4umVueQe2yJeVoqnv6ZriMZU6LLiF8AJFyY/ITyB3wUIsPNdont414lb4GjvYhQUNFZQhYMJjbECByy0HGQSbuTxqzDmMdH9f4AhB1lY4S3CGwmyJxyKvcl3W5HW7puurNT7F4O6wMoJFatINvdAD3dITvf9aq+bXaHs54FntaIVdCB3PpN7+VZV59rD/qfrTs4c9rPledfZu+0z7FlpHXz2sv6TWk4u1JbqkZ/Z/QS265xuY1VftKiGS5wjyB8jfn/snyKxEZYrKCf6JdXRiELOYxzK/9ypi2EQcaT63iBOcoR54lMakKWm6kyoFuppJfAkp8gESlY7B</latexit><latexit sha1_base64="LyascO/L8hfhwTcWC5hQh+gFxbY=">AAACZnichVHLSsNAFD2Nr1ofrYoouCmWiqty40bpquDGpW3tA1RKEscaTJOQpIW2+AOCW7twpSAifoYbf8BF/0BxqeDGhbdpQLSod5iZM2fuuXNmRrUN3fWIuiFpaHhkdCw8HpmYnJqOxmZmi65VdzRR0CzDcsqq4gpDN0XB0z1DlG1HKDXVECX1eLO3X2oIx9Utc8dr2mK/plRN/VDXFI+pfKviVmIJSpEf8UEgByCBILat2A32cAALGuqoQcCEx9iAApfbLmQQbOb20WbOYaT7+wIniLC2zlmCMxRmj3ms8mo3YE1e92q6vlrjUwzuDivjSNIj3dIrPdAdPdPHr7Xafo2elybPal8r7Er0dDH//q+qxrOHoy/Vn549HGLD96qzd9tnerfQ+vpGq/OaT+eS7RW6ohf2f0lduucbmI037TorcheI8AfIP597EBTXUjKl5CwlMungK8JYwjJW+b3XkcEWtlHgc6s4wzk6oSdpWpqXFvqpUijQzOFbSPFP5teK1A==</latexit>
W, b<latexit sha1_base64="bG1wmlwYy5IEj1jra+NjgyJcSTg=">AAACZ3ichVG7SgNBFD3Z+IyPxAcSsIlKxELCXRsllWBj6SuJoCHsrpNkyWZ32d0EYhCsLWwVrBRExH+wsfEHLPyEYBnBxsK7m4CoqHeYmTNn7rlzZka1Dd31iJ5DUrint69/YDAyNDwyGo2NjWddq+ZoIqNZhuXsqoorDN0UGU/3DLFrO0KpqobIqZU1fz9XF46rW+aO17BFvqqUTL2oa4rnU7nFhFqIzVGKgkj8BHIXzK1O3oePAWxYsRvs4wAWNNRQhYAJj7EBBS63Pcgg2Mzl0WTOYaQH+wJHiLC2xlmCMxRmKzyWeLXXZU1e+zXdQK3xKQZ3h5UJJOmJbqlNj3RHLXr/tVYzqOF7afCsdrTCLkRP4ttv/6qqPHsof6r+9OyhiJXAq87e7YDxb6F19PXDs/Z2eivZnKcremH/l/RMD3wDs/6qXW+KrQtE+APk78/9E2SXUjKl5E3+iTQ6MYBpzGKB33sZq1jHBjJ8bhmnOMN5qCVFpSkp3kmVQl3NBL6ENPMBZbGMLA==</latexit><latexit sha1_base64="SHrtUeKmjMLGp+w82kq5yOboN6A=">AAACZ3ichVG7SgNBFD3Z+IyPxAcSsImGiIWEuzZKKsHG0lceoCK76yQu2ewuu5tADP6Aha2ClYKI+A82NmksLfyEYBnBxsK7m4CoqHeYmTNn7rlzZka1Dd31iJ5DUrint69/YDAyNDwyGo2Njedcq+poIqtZhuUUVMUVhm6KrKd7hijYjlAqqiHyannV38/XhOPqlrnt1W2xV1FKpl7UNcXzqfxCQt2PJSlNQSR+ArkLkiuT92H7sVldt2I32MUBLGioogIBEx5jAwpcbjuQQbCZ20ODOYeRHuwLHCPC2ipnCc5QmC3zWOLVTpc1ee3XdAO1xqcY3B1WJpCiJ7qlNjXpjlr0/mutRlDD91LnWe1ohb0fPYlvvf2rqvDs4fBT9adnD0UsB1519m4HjH8LraOvHZ21tzKbqcYcXdEL+7+kZ3rgG5i1V+16Q2xeIMIfIH9/7p8gt5iWKS1v8E9k0IkBTGMW8/zeS1jBGtaR5XMPcYoznIdaUlSakuKdVCnU1UzgS0gzH/8qjiY=</latexit><latexit sha1_base64="SHrtUeKmjMLGp+w82kq5yOboN6A=">AAACZ3ichVG7SgNBFD3Z+IyPxAcSsImGiIWEuzZKKsHG0lceoCK76yQu2ewuu5tADP6Aha2ClYKI+A82NmksLfyEYBnBxsK7m4CoqHeYmTNn7rlzZka1Dd31iJ5DUrint69/YDAyNDwyGo2Njedcq+poIqtZhuUUVMUVhm6KrKd7hijYjlAqqiHyannV38/XhOPqlrnt1W2xV1FKpl7UNcXzqfxCQt2PJSlNQSR+ArkLkiuT92H7sVldt2I32MUBLGioogIBEx5jAwpcbjuQQbCZ20ODOYeRHuwLHCPC2ipnCc5QmC3zWOLVTpc1ee3XdAO1xqcY3B1WJpCiJ7qlNjXpjlr0/mutRlDD91LnWe1ohb0fPYlvvf2rqvDs4fBT9adnD0UsB1519m4HjH8LraOvHZ21tzKbqcYcXdEL+7+kZ3rgG5i1V+16Q2xeIMIfIH9/7p8gt5iWKS1v8E9k0IkBTGMW8/zeS1jBGtaR5XMPcYoznIdaUlSakuKdVCnU1UzgS0gzH/8qjiY=</latexit><latexit sha1_base64="M6B8fBDh0dSaCWH2eSPZX/uus4A=">AAACZ3ichVG7SgNBFD1Z3/GRqCABm2iIWEi4a6NYBWwsNTFGiEF210myuC92NwEN/oCFbQQrBRHxM2z8AYt8glgq2Fh4d7MgKuodZubMmXvunJlRHUP3fKJuTOrrHxgcGh6Jj46NTySSk1M7nt10NVHSbMN2d1XFE4ZuiZKv+4bYdVyhmKohyurherBfbgnX021r2z9yRNVU6pZe0zXFD6jyUlrdT2YoR2GkfwI5AhlEsWknb7CHA9jQ0IQJAQs+YwMKPG4VyCA4zFXRZs5lpIf7AieIs7bJWYIzFGYPeazzqhKxFq+Dml6o1vgUg7vLyjSy9Ei39EIPdEdP9P5rrXZYI/ByxLPa0wpnP3GaKr79qzJ59tH4VP3p2UcNq6FXnb07IRPcQuvpW8edl+JaIdteoCt6Zv+X1KV7voHVetWut0ThAnH+APn7c/8EO8s5mXLyFmXya9FXDGMW81jk915BHhvYRInPbeAMHZzHnqSENCOleqlSLNJM40tIcx9+ZYqX</latexit>
rs<latexit sha1_base64="DOHXvCyt5sY/KcMwWz23dbJ1QTw=">AAACZnichVG7SgNBFD1Z3/EVFVEQJBgiVuGujWIVsLFMjNFADGF3ncQl+2J3E9DgDwi2prBSEBHxK2z8AQs7S8Uygo2FN5uAaFDvMDNnztxz58yM6hi65xM9hqSe3r7+gcGh8PDI6Nh4ZGJy27Orriaymm3Ybk5VPGHolsj6um+InOMKxVQNsaNW1lv7OzXherptbfkHjiiYStnSS7qm+Exl3KJXjMQoQUFEu4HcAbFkZP72CUDKjlxhF3uwoaEKEwIWfMYGFHjc8pBBcJgroM6cy0gP9gWOEGZtlbMEZyjMVngs8yrfYS1et2p6gVrjUwzuLiujiNMDXVOT7umGXujj11r1oEbLywHPalsrnOL48Wzm/V+VybOP/S/Vn559lLAaeNXZuxMwrVtobX3tsNHMrG3G64t0Qa/s/5we6Y5vYNXetMu02DxDmD9A/vnc3WB7OSFTQk7zT6yhHYOYwwKW+L1XkMQGUsjyuWWc4BSN0LM0Jk1LM+1UKdTRTOFbSNFPd/iMxw==</latexit><latexit sha1_base64="tonuSrn9Vsj0j83J4P+hKavOCCM=">AAACZnichVHLSsNAFD2Nr1pfVREFQYpFcVVu3CiuCm5cqrW2UEtJ4rQG0yQkaUGLPyAIruzClYKIiP8guPEHXPQPFJcV3LjwNimIFvUOM3PmzD13zsyotqG7HlEjJHV19/T2hfsjA4NDwyPR0bFt16o4mkhrlmE5WVVxhaGbIu3pniGytiOUsmqIjLq/2trPVIXj6pa55R3YIl9WSqZe1DXFYyrlFNxCNE4J8iPWCeQ2iCejM3dPp/d361b0GjvYhQUNFZQhYMJjbECByy0HGQSbuTxqzDmMdH9f4AgR1lY4S3CGwuw+jyVe5dqsyetWTddXa3yKwd1hZQxz9EQ31KRHuqUX+vi1Vs2v0fJywLMaaIVdGDmeSr3/qyrz7GHvS/WnZw9FLPtedfZu+0zrFlqgrx7Wm6mVzbnaPF3SK/u/oAY98A3M6pt2tSE2zxHhD5B/Pncn2F5MyJSQN/gnVhBEGNOYxQK/9xKSWMM60nxuCSc4Qz30LA1LE9JkkCqF2ppxfAsp9gkChY65</latexit><latexit sha1_base64="tonuSrn9Vsj0j83J4P+hKavOCCM=">AAACZnichVHLSsNAFD2Nr1pfVREFQYpFcVVu3CiuCm5cqrW2UEtJ4rQG0yQkaUGLPyAIruzClYKIiP8guPEHXPQPFJcV3LjwNimIFvUOM3PmzD13zsyotqG7HlEjJHV19/T2hfsjA4NDwyPR0bFt16o4mkhrlmE5WVVxhaGbIu3pniGytiOUsmqIjLq/2trPVIXj6pa55R3YIl9WSqZe1DXFYyrlFNxCNE4J8iPWCeQ2iCejM3dPp/d361b0GjvYhQUNFZQhYMJjbECByy0HGQSbuTxqzDmMdH9f4AgR1lY4S3CGwuw+jyVe5dqsyetWTddXa3yKwd1hZQxz9EQ31KRHuqUX+vi1Vs2v0fJywLMaaIVdGDmeSr3/qyrz7GHvS/WnZw9FLPtedfZu+0zrFlqgrx7Wm6mVzbnaPF3SK/u/oAY98A3M6pt2tSE2zxHhD5B/Pncn2F5MyJSQN/gnVhBEGNOYxQK/9xKSWMM60nxuCSc4Qz30LA1LE9JkkCqF2ppxfAsp9gkChY65</latexit><latexit sha1_base64="PZWA6exi+w5eRaGSTLkCrm4+BJI=">AAACZnichVHLSsNAFD2Nr1ofrYoouCmWiqty40bpquDGZR+2FVRKEqc1mCYhSQu1+AOCW7twpSAifoYbf8BF/0BxWcGNC2/TgKiod5iZM2fuuXNmRrUN3fWIuiFpaHhkdCw8HpmYnJqOxmZmS67VcDRR1CzDcnZUxRWGboqip3uG2LEdodRVQ5TVo83+frkpHFe3zG2vZYv9ulIz9aquKR5TBafiVmIJSpEf8Z9ADkACQWSt2A32cAALGhqoQ8CEx9iAApfbLmQQbOb20WbOYaT7+wIniLC2wVmCMxRmj3is8Wo3YE1e92u6vlrjUwzuDivjSNIj3VKPHuiOnun911ptv0bfS4tndaAVdiV6ulh4+1dV59nD4afqT88eqtjwvers3faZ/i20gb553OkV0vlke4Wu6IX9X1KX7vkGZvNVu86J/AUi/AHy9+f+CUprKZlSco4SmXTwFWEsYRmr/N7ryGALWRT53BrOcI5O6EmalualhUGqFAo0c/gSUvwD1seKzA==</latexit>
T<latexit sha1_base64="U8zv4FkV9T8kWJTl5u2J+C0lY3k=">AAACZHichVG7SgNBFD1ZXzG+okEQBBFDxCrctVHSKNhYJtGYgIrsrpO4ZF/sbgIa/AFtFQsrFRHxJwQbf0AkPyCIpYKNhTebgGhQ7zAzZ87cc+fMjOoYuucT1UNSR2dXd0+4N9LXPzA4FB0eWfPsiquJnGYbtltQFU8YuiVyvu4bouC4QjFVQ+TV8lJjP18Vrqfb1qq/64hNUylZelHXFJ+pzOpWNE5JCmKyHcgtEF+4vXgER9qOXmED27ChoQITAhZ8xgYUeNzWIYPgMLeJGnMuIz3YF9hHhLUVzhKcoTBb5rHEq/UWa/G6UdML1BqfYnB3WTmJBD3QNb3SPd3QM338WqsW1Gh42eVZbWqFszV0MLby/q/K5NnHzpfqT88+ipgPvOrs3QmYxi20pr66d/K6ksomatN0Ti/s/4zqdMc3sKpv2mVGZE8R4Q+Qfz53O1ibTcqUlDMUX0yhGWGMYwoz/N5zWMQy0sjxuQKHOMJx6Enql2LSaDNVCrU0MXwLaeITNXyMQQ==</latexit><latexit sha1_base64="76T0xNTZSrtAgEsx9f+4anWEsYY=">AAACZHichVHLSsNAFD2N71q1KoIgSLFUXJUbN4ogCm5cWrUqVJEkTmtoXiRpQYs/oFvFhStfiPgTght/QMQfEMRlBTcuvEkLokW9w8ycOXPPnTMzqmPonk/0FJGamlta29o7op2xru6eeG/fimeXXE1kNduw3TVV8YShWyLr674h1hxXKKZqiFW1OBfsr5aF6+m2tezvOGLDVAqWntc1xWcqs7wZT1Kawkg0ArkOkjO354/RaediwY5fYR1bsKGhBBMCFnzGBhR43HKQQXCY20CFOZeRHu4L7CHK2hJnCc5QmC3yWOBVrs5avA5qeqFa41MM7i4rE0jRA11Tle7phl7o49dalbBG4GWHZ7WmFc5mz/7g0vu/KpNnH9tfqj89+8hjMvSqs3cnZIJbaDV9efe4ujS1mKqM0hm9sv9TeqI7voFVftMuM2LxBFH+APnnczeClfG0TGk5Q8nZKdSiHUMYwRi/9wRmMY8FZPlcgQMc4ijyLMWkfmmglipF6pp+fAtp+BOs7Y2c</latexit><latexit sha1_base64="76T0xNTZSrtAgEsx9f+4anWEsYY=">AAACZHichVHLSsNAFD2N71q1KoIgSLFUXJUbN4ogCm5cWrUqVJEkTmtoXiRpQYs/oFvFhStfiPgTght/QMQfEMRlBTcuvEkLokW9w8ycOXPPnTMzqmPonk/0FJGamlta29o7op2xru6eeG/fimeXXE1kNduw3TVV8YShWyLr674h1hxXKKZqiFW1OBfsr5aF6+m2tezvOGLDVAqWntc1xWcqs7wZT1Kawkg0ArkOkjO354/RaediwY5fYR1bsKGhBBMCFnzGBhR43HKQQXCY20CFOZeRHu4L7CHK2hJnCc5QmC3yWOBVrs5avA5qeqFa41MM7i4rE0jRA11Tle7phl7o49dalbBG4GWHZ7WmFc5mz/7g0vu/KpNnH9tfqj89+8hjMvSqs3cnZIJbaDV9efe4ujS1mKqM0hm9sv9TeqI7voFVftMuM2LxBFH+APnnczeClfG0TGk5Q8nZKdSiHUMYwRi/9wRmMY8FZPlcgQMc4ijyLMWkfmmglipF6pp+fAtp+BOs7Y2c</latexit><latexit sha1_base64="uP1+27ByLsb5noLVGIpqNIFk+kU=">AAACZHichVG7SgNBFD1Z3zGaqAiCIMEQsQp3bRQrwcbSqFEhiuyukzhkX+xuAhr8AW0VCysFEfEzbPwBC39AEEsFGwvvbhZEg3qHmTlz5p47Z2Z015R+QPSYUDo6u7p7evuS/amBwXRmaHjdd+qeIUqGYzrepq75wpS2KAUyMMWm6wnN0k2xodcWw/2NhvB86dhrwb4rti2tasuKNLSAqeLaTiZHBYoi2w7UGOQQx7KTucYWduHAQB0WBGwEjE1o8LmVoYLgMreNJnMeIxntCxwiydo6ZwnO0Jit8VjlVTlmbV6HNf1IbfApJnePlVnk6YFu6JXu6Zae6ePXWs2oRuhln2e9pRXuTvpobPX9X5XFc4C9L9WfngNUMBd5lezdjZjwFkZL3zg4e12dX8k3p+iSXtj/BT3SHd/AbrwZV0Wxco4kf4D687nbwfpMQaWCWqTcwnz8Fb0YxySm+b1nsYAlLKPE5woc4wSniSclpYwoo61UJRFrRvAtlIlPqqSJyA==</latexit>
pt = softmax(W · zs + b) (5)<latexit sha1_base64="KNH8XHzGwXzGWE5/+Oy1FBgE0yw=">AAACmHichVFNSxtBGH5cbbWxbaK9FHsZDJZIIbyrlpZCIdSD9abRGMHIsruZ6OJ+uTsJavAP+AekeFIoRfwRHrzYH9CDP0E8KvTSQ9/dLJRW2r7DzDzzzPu888yMFbpOrIiu+rT+gQcPB4ce5YYfP3maL4yMrsRBO7JlzQ7cIFq1zFi6ji9rylGuXA0jaXqWK+vW1myyX+/IKHYCf1nthnLdMzd8p+XYpmLKKEyHhhLvRUPJHRV53ThoKc/c2RelumjYzUCJPSMWr4Q1KRrbbbMpSq8nc0ahSGVKQ9wHegaKyGIhKHxBA00EsNGGBwkfirELEzG3NegghMyto8tcxMhJ9yX2kWNtm7MkZ5jMbvG4wau1jPV5ndSMU7XNp7jcI1YKTNA3OqVbuqQzuqYff63VTWskXnZ5tnpaGRr5g+dL3/+r8nhW2Pyl+qdnhRbepl4d9h6mTHILu6fv7B3eLr2rTnRf0gndsP9juqILvoHfubM/L8rqEZIP0P987vtgZaqsU1lfnClWPmRfMYQXGEeJ3/sNKviIBdT43E84xyW+amNaRZvT5nupWl+meYbfQqv+BPsqm14=</latexit><latexit sha1_base64="KNH8XHzGwXzGWE5/+Oy1FBgE0yw=">AAACmHichVFNSxtBGH5cbbWxbaK9FHsZDJZIIbyrlpZCIdSD9abRGMHIsruZ6OJ+uTsJavAP+AekeFIoRfwRHrzYH9CDP0E8KvTSQ9/dLJRW2r7DzDzzzPu888yMFbpOrIiu+rT+gQcPB4ce5YYfP3maL4yMrsRBO7JlzQ7cIFq1zFi6ji9rylGuXA0jaXqWK+vW1myyX+/IKHYCf1nthnLdMzd8p+XYpmLKKEyHhhLvRUPJHRV53ThoKc/c2RelumjYzUCJPSMWr4Q1KRrbbbMpSq8nc0ahSGVKQ9wHegaKyGIhKHxBA00EsNGGBwkfirELEzG3NegghMyto8tcxMhJ9yX2kWNtm7MkZ5jMbvG4wau1jPV5ndSMU7XNp7jcI1YKTNA3OqVbuqQzuqYff63VTWskXnZ5tnpaGRr5g+dL3/+r8nhW2Pyl+qdnhRbepl4d9h6mTHILu6fv7B3eLr2rTnRf0gndsP9juqILvoHfubM/L8rqEZIP0P987vtgZaqsU1lfnClWPmRfMYQXGEeJ3/sNKviIBdT43E84xyW+amNaRZvT5nupWl+meYbfQqv+BPsqm14=</latexit><latexit sha1_base64="KNH8XHzGwXzGWE5/+Oy1FBgE0yw=">AAACmHichVFNSxtBGH5cbbWxbaK9FHsZDJZIIbyrlpZCIdSD9abRGMHIsruZ6OJ+uTsJavAP+AekeFIoRfwRHrzYH9CDP0E8KvTSQ9/dLJRW2r7DzDzzzPu888yMFbpOrIiu+rT+gQcPB4ce5YYfP3maL4yMrsRBO7JlzQ7cIFq1zFi6ji9rylGuXA0jaXqWK+vW1myyX+/IKHYCf1nthnLdMzd8p+XYpmLKKEyHhhLvRUPJHRV53ThoKc/c2RelumjYzUCJPSMWr4Q1KRrbbbMpSq8nc0ahSGVKQ9wHegaKyGIhKHxBA00EsNGGBwkfirELEzG3NegghMyto8tcxMhJ9yX2kWNtm7MkZ5jMbvG4wau1jPV5ndSMU7XNp7jcI1YKTNA3OqVbuqQzuqYff63VTWskXnZ5tnpaGRr5g+dL3/+r8nhW2Pyl+qdnhRbepl4d9h6mTHILu6fv7B3eLr2rTnRf0gndsP9juqILvoHfubM/L8rqEZIP0P987vtgZaqsU1lfnClWPmRfMYQXGEeJ3/sNKviIBdT43E84xyW+amNaRZvT5nupWl+meYbfQqv+BPsqm14=</latexit><latexit sha1_base64="KNH8XHzGwXzGWE5/+Oy1FBgE0yw=">AAACmHichVFNSxtBGH5cbbWxbaK9FHsZDJZIIbyrlpZCIdSD9abRGMHIsruZ6OJ+uTsJavAP+AekeFIoRfwRHrzYH9CDP0E8KvTSQ9/dLJRW2r7DzDzzzPu888yMFbpOrIiu+rT+gQcPB4ce5YYfP3maL4yMrsRBO7JlzQ7cIFq1zFi6ji9rylGuXA0jaXqWK+vW1myyX+/IKHYCf1nthnLdMzd8p+XYpmLKKEyHhhLvRUPJHRV53ThoKc/c2RelumjYzUCJPSMWr4Q1KRrbbbMpSq8nc0ahSGVKQ9wHegaKyGIhKHxBA00EsNGGBwkfirELEzG3NegghMyto8tcxMhJ9yX2kWNtm7MkZ5jMbvG4wau1jPV5ndSMU7XNp7jcI1YKTNA3OqVbuqQzuqYff63VTWskXnZ5tnpaGRr5g+dL3/+r8nhW2Pyl+qdnhRbepl4d9h6mTHILu6fv7B3eLr2rTnRf0gndsP9juqILvoHfubM/L8rqEZIP0P987vtgZaqsU1lfnClWPmRfMYQXGEeJ3/sNKviIBdT43E84xyW+amNaRZvT5nupWl+meYbfQqv+BPsqm14=</latexit>
17
Sentence 1
Atten
tion
Layer
Sentence 2
Sentence 3
beef
pork
waiter
E
E
E
Aspect 3
TAspect 1
Aspect 2
T
T
aspect term embedding extraction
…
ai<latexit sha1_base64="sfl9+Tt+FAxuCcxtpQufcRHmHg8=">AAACZnichVG7SgNBFD1ZXzE+siqiIEhQFKtw10ZJFbCxVGNUUAm76xiHbHaX3U0gBn9AsDWFlYKIiF9h4w9Y2Fkqlgo2Ft7dBERFvcPMnDlzz50zM4ZrST8guo8pbe0dnV3x7kRPb19/Uh0YXPOdimeKvOlYjrdh6L6wpC3ygQwsseF6Qi8bllg3Sgvh/npVeL507NWg5ortsl605a409YCpnF6QBXWS0hRF6ifQWmAyq45fPwBYctQLbGEHDkxUUIaAjYCxBR0+t01oILjMbaPOnMdIRvsCB0iwtsJZgjN0Zks8Fnm12WJtXoc1/Uht8ikWd4+VKUzRHV3SC93SFT3R+6+16lGN0EuNZ6OpFW4heTiae/tXVeY5wN6n6k/PAXYxH3mV7N2NmPAWZlNf3W+85DIrU/VpOqNn9n9K93TDN7Crr+b5slg5QYI/QPv+3D/B2mxao7S2zD+RQTPiGMMEZvi955DFIpaQ53OLOMIxGrFHpV8ZVkaaqUqspRnCl1BSH0HWjKw=</latexit><latexit sha1_base64="MITNhmmbUWK85o3qgnfBnwoUL+g=">AAACZnichVG7SgNBFD1ZXzG+oiIKggRFsQp3bZRUARvLPEwUVMLuOsbBze6yuwnE4A8IgpUWVgoiIvkHwcYfSOEfKJYKNhbebAKiot5hZs6cuefOmRndMaXnEz2ElI7Oru6ecG+kr39gcCg6PJL37LJriJxhm7a7rmueMKUlcr70TbHuuEIr6aZY0/eWm/trFeF60rZW/aojtkpa0ZI70tB8prJaQRaiMxSnIGI/gdoGM8noVL1xfFtP2dErbGIbNgyUUYKABZ+xCQ0etw2oIDjMbaHGnMtIBvsCB4iwtsxZgjM0Zvd4LPJqo81avG7W9AK1waeY3F1WxjBLDbqmF7qnG3qi919r1YIaTS9VnvWWVjiFocOJ7Nu/qhLPPnY/VX969rGDpcCrZO9OwDRvYbT0lf3Tl2wiM1ubowt6Zv/n9EB3fAOr8mpcpkXmDBH+APX7c/8E+YW4SnE1zT+RQCvCmMQ05vm9F5HEClLI8blFHOEEp6FHZVAZU8ZbqUqorRnFl1BiH8xUjp4=</latexit><latexit sha1_base64="MITNhmmbUWK85o3qgnfBnwoUL+g=">AAACZnichVG7SgNBFD1ZXzG+oiIKggRFsQp3bZRUARvLPEwUVMLuOsbBze6yuwnE4A8IgpUWVgoiIvkHwcYfSOEfKJYKNhbebAKiot5hZs6cuefOmRndMaXnEz2ElI7Oru6ecG+kr39gcCg6PJL37LJriJxhm7a7rmueMKUlcr70TbHuuEIr6aZY0/eWm/trFeF60rZW/aojtkpa0ZI70tB8prJaQRaiMxSnIGI/gdoGM8noVL1xfFtP2dErbGIbNgyUUYKABZ+xCQ0etw2oIDjMbaHGnMtIBvsCB4iwtsxZgjM0Zvd4LPJqo81avG7W9AK1waeY3F1WxjBLDbqmF7qnG3qi919r1YIaTS9VnvWWVjiFocOJ7Nu/qhLPPnY/VX969rGDpcCrZO9OwDRvYbT0lf3Tl2wiM1ubowt6Zv/n9EB3fAOr8mpcpkXmDBH+APX7c/8E+YW4SnE1zT+RQCvCmMQ05vm9F5HEClLI8blFHOEEp6FHZVAZU8ZbqUqorRnFl1BiH8xUjp4=</latexit><latexit sha1_base64="cm2DdYGGl4bckJ1+Vb9VWzXZAIc=">AAACZnichVG7SgNBFD1ZXzE+EhVRsAmGiFW4a6OkCthYxsSooBJ210kc3Owuu5tADP6AYGsKKwUR8TNs/AGL/IFiqWBj4c1mQVTUO8zMmTP33Dkzozum9HyiTkTp6x8YHIoOx0ZGx8bjiYnJTc+uu4YoGbZpu9u65glTWqLkS98U244rtJpuii39cLW7v9UQridta8NvOmKvplUtWZGG5jNV1MqynEhRhoJI/gRqCFIII28nrrGLfdgwUEcNAhZ8xiY0eNx2oILgMLeHFnMuIxnsCxwjxto6ZwnO0Jg95LHKq52QtXjdrekFaoNPMbm7rEwiTQ90Qy90T7f0RO+/1moFNbpemjzrPa1wyvGT2eLbv6oazz4OPlV/evZRwUrgVbJ3J2C6tzB6+sZR+6WYLaRbC3RJz+z/gjp0xzewGq/G1boonCPGH6B+f+6fYHMpo1JGXadULht+RRRzmMciv/cyclhDHiU+t4pTnKEdeVTGlWllppeqRELNFL6EkvwAoKWKsQ==</latexit>
ai<latexit sha1_base64="sfl9+Tt+FAxuCcxtpQufcRHmHg8=">AAACZnichVG7SgNBFD1ZXzE+siqiIEhQFKtw10ZJFbCxVGNUUAm76xiHbHaX3U0gBn9AsDWFlYKIiF9h4w9Y2Fkqlgo2Ft7dBERFvcPMnDlzz50zM4ZrST8guo8pbe0dnV3x7kRPb19/Uh0YXPOdimeKvOlYjrdh6L6wpC3ygQwsseF6Qi8bllg3Sgvh/npVeL507NWg5ortsl605a409YCpnF6QBXWS0hRF6ifQWmAyq45fPwBYctQLbGEHDkxUUIaAjYCxBR0+t01oILjMbaPOnMdIRvsCB0iwtsJZgjN0Zks8Fnm12WJtXoc1/Uht8ikWd4+VKUzRHV3SC93SFT3R+6+16lGN0EuNZ6OpFW4heTiae/tXVeY5wN6n6k/PAXYxH3mV7N2NmPAWZlNf3W+85DIrU/VpOqNn9n9K93TDN7Crr+b5slg5QYI/QPv+3D/B2mxao7S2zD+RQTPiGMMEZvi955DFIpaQ53OLOMIxGrFHpV8ZVkaaqUqspRnCl1BSH0HWjKw=</latexit><latexit sha1_base64="MITNhmmbUWK85o3qgnfBnwoUL+g=">AAACZnichVG7SgNBFD1ZXzG+oiIKggRFsQp3bZRUARvLPEwUVMLuOsbBze6yuwnE4A8IgpUWVgoiIvkHwcYfSOEfKJYKNhbebAKiot5hZs6cuefOmRndMaXnEz2ElI7Oru6ecG+kr39gcCg6PJL37LJriJxhm7a7rmueMKUlcr70TbHuuEIr6aZY0/eWm/trFeF60rZW/aojtkpa0ZI70tB8prJaQRaiMxSnIGI/gdoGM8noVL1xfFtP2dErbGIbNgyUUYKABZ+xCQ0etw2oIDjMbaHGnMtIBvsCB4iwtsxZgjM0Zvd4LPJqo81avG7W9AK1waeY3F1WxjBLDbqmF7qnG3qi919r1YIaTS9VnvWWVjiFocOJ7Nu/qhLPPnY/VX969rGDpcCrZO9OwDRvYbT0lf3Tl2wiM1ubowt6Zv/n9EB3fAOr8mpcpkXmDBH+APX7c/8E+YW4SnE1zT+RQCvCmMQ05vm9F5HEClLI8blFHOEEp6FHZVAZU8ZbqUqorRnFl1BiH8xUjp4=</latexit><latexit sha1_base64="MITNhmmbUWK85o3qgnfBnwoUL+g=">AAACZnichVG7SgNBFD1ZXzG+oiIKggRFsQp3bZRUARvLPEwUVMLuOsbBze6yuwnE4A8IgpUWVgoiIvkHwcYfSOEfKJYKNhbebAKiot5hZs6cuefOmRndMaXnEz2ElI7Oru6ecG+kr39gcCg6PJL37LJriJxhm7a7rmueMKUlcr70TbHuuEIr6aZY0/eWm/trFeF60rZW/aojtkpa0ZI70tB8prJaQRaiMxSnIGI/gdoGM8noVL1xfFtP2dErbGIbNgyUUYKABZ+xCQ0etw2oIDjMbaHGnMtIBvsCB4iwtsxZgjM0Zvd4LPJqo81avG7W9AK1waeY3F1WxjBLDbqmF7qnG3qi919r1YIaTS9VnvWWVjiFocOJ7Nu/qhLPPnY/VX969rGDpcCrZO9OwDRvYbT0lf3Tl2wiM1ubowt6Zv/n9EB3fAOr8mpcpkXmDBH+APX7c/8E+YW4SnE1zT+RQCvCmMQ05vm9F5HEClLI8blFHOEEp6FHZVAZU8ZbqUqorRnFl1BiH8xUjp4=</latexit><latexit sha1_base64="cm2DdYGGl4bckJ1+Vb9VWzXZAIc=">AAACZnichVG7SgNBFD1ZXzE+EhVRsAmGiFW4a6OkCthYxsSooBJ210kc3Owuu5tADP6AYGsKKwUR8TNs/AGL/IFiqWBj4c1mQVTUO8zMmTP33Dkzozum9HyiTkTp6x8YHIoOx0ZGx8bjiYnJTc+uu4YoGbZpu9u65glTWqLkS98U244rtJpuii39cLW7v9UQridta8NvOmKvplUtWZGG5jNV1MqynEhRhoJI/gRqCFIII28nrrGLfdgwUEcNAhZ8xiY0eNx2oILgMLeHFnMuIxnsCxwjxto6ZwnO0Jg95LHKq52QtXjdrekFaoNPMbm7rEwiTQ90Qy90T7f0RO+/1moFNbpemjzrPa1wyvGT2eLbv6oazz4OPlV/evZRwUrgVbJ3J2C6tzB6+sZR+6WYLaRbC3RJz+z/gjp0xzewGq/G1boonCPGH6B+f+6fYHMpo1JGXadULht+RRRzmMciv/cyclhDHiU+t4pTnKEdeVTGlWllppeqRELNFL6EkvwAoKWKsQ==</latexit>
ai<latexit sha1_base64="sfl9+Tt+FAxuCcxtpQufcRHmHg8=">AAACZnichVG7SgNBFD1ZXzE+siqiIEhQFKtw10ZJFbCxVGNUUAm76xiHbHaX3U0gBn9AsDWFlYKIiF9h4w9Y2Fkqlgo2Ft7dBERFvcPMnDlzz50zM4ZrST8guo8pbe0dnV3x7kRPb19/Uh0YXPOdimeKvOlYjrdh6L6wpC3ygQwsseF6Qi8bllg3Sgvh/npVeL507NWg5ortsl605a409YCpnF6QBXWS0hRF6ifQWmAyq45fPwBYctQLbGEHDkxUUIaAjYCxBR0+t01oILjMbaPOnMdIRvsCB0iwtsJZgjN0Zks8Fnm12WJtXoc1/Uht8ikWd4+VKUzRHV3SC93SFT3R+6+16lGN0EuNZ6OpFW4heTiae/tXVeY5wN6n6k/PAXYxH3mV7N2NmPAWZlNf3W+85DIrU/VpOqNn9n9K93TDN7Crr+b5slg5QYI/QPv+3D/B2mxao7S2zD+RQTPiGMMEZvi955DFIpaQ53OLOMIxGrFHpV8ZVkaaqUqspRnCl1BSH0HWjKw=</latexit><latexit sha1_base64="MITNhmmbUWK85o3qgnfBnwoUL+g=">AAACZnichVG7SgNBFD1ZXzG+oiIKggRFsQp3bZRUARvLPEwUVMLuOsbBze6yuwnE4A8IgpUWVgoiIvkHwcYfSOEfKJYKNhbebAKiot5hZs6cuefOmRndMaXnEz2ElI7Oru6ecG+kr39gcCg6PJL37LJriJxhm7a7rmueMKUlcr70TbHuuEIr6aZY0/eWm/trFeF60rZW/aojtkpa0ZI70tB8prJaQRaiMxSnIGI/gdoGM8noVL1xfFtP2dErbGIbNgyUUYKABZ+xCQ0etw2oIDjMbaHGnMtIBvsCB4iwtsxZgjM0Zvd4LPJqo81avG7W9AK1waeY3F1WxjBLDbqmF7qnG3qi919r1YIaTS9VnvWWVjiFocOJ7Nu/qhLPPnY/VX969rGDpcCrZO9OwDRvYbT0lf3Tl2wiM1ubowt6Zv/n9EB3fAOr8mpcpkXmDBH+APX7c/8E+YW4SnE1zT+RQCvCmMQ05vm9F5HEClLI8blFHOEEp6FHZVAZU8ZbqUqorRnFl1BiH8xUjp4=</latexit><latexit sha1_base64="MITNhmmbUWK85o3qgnfBnwoUL+g=">AAACZnichVG7SgNBFD1ZXzG+oiIKggRFsQp3bZRUARvLPEwUVMLuOsbBze6yuwnE4A8IgpUWVgoiIvkHwcYfSOEfKJYKNhbebAKiot5hZs6cuefOmRndMaXnEz2ElI7Oru6ecG+kr39gcCg6PJL37LJriJxhm7a7rmueMKUlcr70TbHuuEIr6aZY0/eWm/trFeF60rZW/aojtkpa0ZI70tB8prJaQRaiMxSnIGI/gdoGM8noVL1xfFtP2dErbGIbNgyUUYKABZ+xCQ0etw2oIDjMbaHGnMtIBvsCB4iwtsxZgjM0Zvd4LPJqo81avG7W9AK1waeY3F1WxjBLDbqmF7qnG3qi919r1YIaTS9VnvWWVjiFocOJ7Nu/qhLPPnY/VX969rGDpcCrZO9OwDRvYbT0lf3Tl2wiM1ubowt6Zv/n9EB3fAOr8mpcpkXmDBH+APX7c/8E+YW4SnE1zT+RQCvCmMQ05vm9F5HEClLI8blFHOEEp6FHZVAZU8ZbqUqorRnFl1BiH8xUjp4=</latexit><latexit sha1_base64="cm2DdYGGl4bckJ1+Vb9VWzXZAIc=">AAACZnichVG7SgNBFD1ZXzE+EhVRsAmGiFW4a6OkCthYxsSooBJ210kc3Owuu5tADP6AYGsKKwUR8TNs/AGL/IFiqWBj4c1mQVTUO8zMmTP33Dkzozum9HyiTkTp6x8YHIoOx0ZGx8bjiYnJTc+uu4YoGbZpu9u65glTWqLkS98U244rtJpuii39cLW7v9UQridta8NvOmKvplUtWZGG5jNV1MqynEhRhoJI/gRqCFIII28nrrGLfdgwUEcNAhZ8xiY0eNx2oILgMLeHFnMuIxnsCxwjxto6ZwnO0Jg95LHKq52QtXjdrekFaoNPMbm7rEwiTQ90Qy90T7f0RO+/1moFNbpemjzrPa1wyvGT2eLbv6oazz4OPlV/evZRwUrgVbJ3J2C6tzB6+sZR+6WYLaRbC3RJz+z/gjp0xzewGq/G1boonCPGH6B+f+6fYHMpo1JGXadULht+RRRzmMciv/cyclhDHiU+t4pTnKEdeVTGlWllppeqRELNFL6EkvwAoKWKsQ==</latexit>
ewbeef<latexit sha1_base64="nTAQr0FYpdZwnsl4h7BILRSDiAo=">AAACb3ichVHLSsNAFD2N7/qqulAUpFQU3ZQbN4qrghuXrdpWUClJnGpomoQkrWjoD/gBunChFkTEnxDc+AMu+gniSiq4ceFtWhAt6h1m5syZe+6cmVFtQ3c9olpI6ujs6u7p7Qv3DwwODUdGRjOuVXI0kdYsw3K2VMUVhm6KtKd7htiyHaEUVUNk1cJqYz9bFo6rW+amd2SL3aKyb+p5XVM8pnZEzj/M+aoQ+UolF5mhOAURbQdyC8wkYtXJewBJK3KDHezBgoYSihAw4TE2oMDltg0ZBJu5XfjMOYz0YF+ggjBrS5wlOENhtsDjPq+2W6zJ60ZNN1BrfIrB3WFlFLP0RLdUp0e6o2f6+LWWH9RoeDniWW1qhZ0bPpnYeP9XVeTZw8GX6k/PHvJYDrzq7N0OmMYttKa+fHxW31hZn/XnqEov7P+KavTANzDLb9p1SqyfI8wfIP987naQWYzLFJdT/BMraEYvphDDPL/3EhJYQxJpPtfGKS5wGXqVxqVpKdpMlUItzRi+hbTwCV84kNw=</latexit><latexit sha1_base64="syCDN1MN6Fh7l0LYJ9DhTdRJUxw=">AAACb3ichVHLSsNAFD2N7/po1YWiIEWpKEi5caO4Ety41GqtoBKSONXQNAlJWtHQH/ADdOHCB4iIW8EPcOMPuPATxJVUcOPC27QgWtQ7zMyZM/fcOTOjOabh+URPEampuaW1rb0j2tnV3ROL9/ateXbR1UVGt03bXddUT5iGJTK+4Zti3XGFWtBMkdXyC9X9bEm4nmFbq/6+I7YK6o5l5Axd9ZnaFEqwpwSaELlyWYmPUYrCSDQCuQ7G5kcvhm7vptJLdvwKm9iGDR1FFCBgwWdsQoXHbQMyCA5zWwiYcxkZ4b5AGVHWFjlLcIbKbJ7HHV5t1FmL19WaXqjW+RSTu8vKBJL0SNdUoQe6oWf6+LVWENaoetnnWatphaPEDgdX3v9VFXj2sful+tOzjxxmQ68Ge3dCpnoLvaYvHRxXVubSyWCcLuiF/Z/TE93zDazSm365LNIniPIHyD+fuxGsTadkSsnL/BNzqEU7hjGKCX7vGcxjEUvI8LkOjnCKs8irNCCNSIlaqhSpa/rxLaTJT3xFkgU=</latexit><latexit sha1_base64="syCDN1MN6Fh7l0LYJ9DhTdRJUxw=">AAACb3ichVHLSsNAFD2N7/po1YWiIEWpKEi5caO4Ety41GqtoBKSONXQNAlJWtHQH/ADdOHCB4iIW8EPcOMPuPATxJVUcOPC27QgWtQ7zMyZM/fcOTOjOabh+URPEampuaW1rb0j2tnV3ROL9/ateXbR1UVGt03bXddUT5iGJTK+4Zti3XGFWtBMkdXyC9X9bEm4nmFbq/6+I7YK6o5l5Axd9ZnaFEqwpwSaELlyWYmPUYrCSDQCuQ7G5kcvhm7vptJLdvwKm9iGDR1FFCBgwWdsQoXHbQMyCA5zWwiYcxkZ4b5AGVHWFjlLcIbKbJ7HHV5t1FmL19WaXqjW+RSTu8vKBJL0SNdUoQe6oWf6+LVWENaoetnnWatphaPEDgdX3v9VFXj2sful+tOzjxxmQ68Ge3dCpnoLvaYvHRxXVubSyWCcLuiF/Z/TE93zDazSm365LNIniPIHyD+fuxGsTadkSsnL/BNzqEU7hjGKCX7vGcxjEUvI8LkOjnCKs8irNCCNSIlaqhSpa/rxLaTJT3xFkgU=</latexit><latexit sha1_base64="YNu79Lt3u+Fb/pnKAm3SIfRvcog=">AAACb3ichVHLSsNAFD2Nr1pfVRcKghSLopty40bpquDGZatWBZWQxKkG0yQkaaWG/oAfoAsXPkBE/Aw3/oALP0FciYIbF96kAVFR7zAzZ87cc+fMjOaYhucTPSSktvaOzq5kd6qnt69/ID04tOrZNVcXZd02bXddUz1hGpYo+4ZvinXHFWpVM8WatrcQ7q/VhesZtrXiNxyxVVV3LKNi6KrP1KZQgn0l0ISoNJtKOks5iiLzE8gxyCKOop2+wia2YUNHDVUIWPAZm1DhcduADILD3BYC5lxGRrQv0ESKtTXOEpyhMrvH4w6vNmLW4nVY04vUOp9icndZmcEk3dM1vdAd3dAjvf9aK4hqhF4aPGstrXCUgcPR5bd/VVWefex+qv707KOC+cirwd6diAlvobf09YPjl+X80mQwRRf0xP7P6YFu+QZW/VW/LImlE6T4A+Tvz/0TrM7mZMrJJcoW8vFXJDGGCUzze8+hgEUUUeZzHRzhFGeJZ2lEGpcyrVQpEWuG8SWkmQ/yYI7+</latexit>
ewpork<latexit sha1_base64="A84rQjWnEeSSuC8YvW7pjybznz8=">AAACb3ichVHLSsNAFD2N7/po1YWiIKVF0U25caO4Ety4rI9qoS0liaOGpklI0oqG/oAfoAsXakFE/AnBjT/gwk8QV1LBjQtv04JoUe8wM2fO3HPnzIxqG7rrET2FpI7Oru6e3r5w/8DgUCQ6PLLlWmVHE2nNMiwnoyquMHRTpD3dM0TGdoRSUg2xrRZXGvvbFeG4umVueoe2yJeUPVPf1TXFYyonCv5Bwbctp1itFqIJSlIQsXYgt0BiOV6buAOQsqLXyGEHFjSUUYKACY+xAQUutyxkEGzm8vCZcxjpwb5AFWHWljlLcIbCbJHHPV5lW6zJ60ZNN1BrfIrB3WFlDNP0SDdUpwe6pWf6+LWWH9RoeDnkWW1qhV2IHI9vvP+rKvHsYf9L9adnD7tYDLzq7N0OmMYttKa+cnRa31han/ZnqEYv7P+Snuieb2BW3rSrNbF+hjB/gPzzudvB1nxSpqS8xj+xhGb0YhJxzPJ7L2AZq0ghzefaOME5LkKv0pg0JcWaqVKopRnFt5DmPgGz15EG</latexit><latexit sha1_base64="HbvIJHyGHTyWelCGOiM6BTF2gqI=">AAACb3ichVHLSsNAFD2N7/qqulAUpLQoClJu3CiuBDcutdpW0BKSOGpomoQkrWjoD/gBunDhA0TEreAHuPEHXPgJ4koU3LjwNi2IFvUOM3PmzD13zsxojml4PtFjRGpqbmlta++IdnZ19/TG+vqznl1ydZHRbdN21zTVE6ZhiYxv+KZYc1yhFjVT5LTCQnU/VxauZ9jWqr/niHxR3baMLUNXfaY2hBLsKoFju4VKRYklKUVhxBuBXAfJ+cT58M3tVHrJjl1iA5uwoaOEIgQs+IxNqPC4rUMGwWEuj4A5l5ER7gtUEGVtibMEZ6jMFnjc5tV6nbV4Xa3phWqdTzG5u6yMY4we6Ipe6Z6u6Yk+fq0VhDWqXvZ41mpa4Si9B0Mr7/+qijz72PlS/enZxxZmQ68Ge3dCpnoLvaYv7x+9rsylx4JxOqdn9n9Gj3THN7DKb/rFskgfI8ofIP987kaQnU7JlJKX+SfmUIt2jCCBCX7vGcxjEUvI8LkODnGC08iLNCiNSvFaqhSpawbwLaTJT9Dkki8=</latexit><latexit sha1_base64="HbvIJHyGHTyWelCGOiM6BTF2gqI=">AAACb3ichVHLSsNAFD2N7/qqulAUpLQoClJu3CiuBDcutdpW0BKSOGpomoQkrWjoD/gBunDhA0TEreAHuPEHXPgJ4koU3LjwNi2IFvUOM3PmzD13zsxojml4PtFjRGpqbmlta++IdnZ19/TG+vqznl1ydZHRbdN21zTVE6ZhiYxv+KZYc1yhFjVT5LTCQnU/VxauZ9jWqr/niHxR3baMLUNXfaY2hBLsKoFju4VKRYklKUVhxBuBXAfJ+cT58M3tVHrJjl1iA5uwoaOEIgQs+IxNqPC4rUMGwWEuj4A5l5ER7gtUEGVtibMEZ6jMFnjc5tV6nbV4Xa3phWqdTzG5u6yMY4we6Ipe6Z6u6Yk+fq0VhDWqXvZ41mpa4Si9B0Mr7/+qijz72PlS/enZxxZmQ68Ge3dCpnoLvaYv7x+9rsylx4JxOqdn9n9Gj3THN7DKb/rFskgfI8ofIP987kaQnU7JlJKX+SfmUIt2jCCBCX7vGcxjEUvI8LkODnGC08iLNCiNSvFaqhSpawbwLaTJT9Dkki8=</latexit><latexit sha1_base64="bFDS3QHKWLbLL8KP8JOmnxi5p6Q=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgU3ZQbN4orwY1L29pWaEtJ4qihaRKStKKhP+AH6MKFDxARP8ONP+CinyCuRMGNC2/TgGhR7zAzZ87cc+fMjGobuusRNSNSV3dPb1//QHRwaHhkNDY2nnOtmqOJrGYZlrOtKq4wdFNkPd0zxLbtCKWqGiKvVtZb+/m6cFzdMre8Q1uUqsqeqe/qmuIxVRRl/6Ds25ZTaTTKsQQlKYh4J5BDkEAYm1bsBkXswIKGGqoQMOExNqDA5VaADILNXAk+cw4jPdgXaCDK2hpnCc5QmK3wuMerQsiavG7VdAO1xqcY3B1WxjFHj3RLr/RAd/REH7/W8oMaLS+HPKttrbDLo8dTmfd/VVWePex/qf707GEXK4FXnb3bAdO6hdbW149OXzOr6Tl/nq7omf1fUpPu+QZm/U27Ton0GaL8AfLP5+4EuaWkTEk5RYm11fAr+jGNWSzwey9jDRvYRJbPtXGCc1xEXqRJaUaKt1OlSKiZwLeQFj8BRw6PKA==</latexit>
ewwaiter<latexit sha1_base64="PmNoZsFA+652kk3B2CbeiL5tq2I=">AAACcXichVG7SgNBFD1Z3/GRqCA+mqAoghDu2ihWgo1lfMQEfITdddQhm91ldxLRkNLGH1CwiiAifoaNP2BhZyuWEWwsvNkEREW9M7tz5sw9d87MmJ4tA0X0GNFaWtvaOzq7ot09vX2xeP/ARuAWfUukLdd2/axpBMKWjkgrqWyR9XxhFExbZMz8Un09UxJ+IF1nXR15Yrtg7DtyT1qGYmpH5MqH3A2phF+p5OITlKQwEj+B3gQTi6MnQ08AUm78GlvYhQsLRRQg4EAxtmEg4LYJHQSPuW2UmfMZyXBdoIIoa4ucJTjDYDbP/32ebTZZh+f1mkGotngXmz+flQlM0gPdUI3u6Zae6f3XWuWwRt3LEY9mQyu8XOx0eO3tX1WBR4WDT9WfnhX2MB96lezdC5n6KayGvnR8VltbWJ0sT9ElvbD/Kj3SHZ/AKb1aVyti9QJRfgD9+3X/BBuzSZ2S+gq/xAIa0YkxjGOa73sOi1hGCmne18c5qriM1LQRLaGNN1K1SFMziC+hzXwAmJiR4Q==</latexit><latexit sha1_base64="A3sYpOu9isJ0z+a3pVf+h27HhXg=">AAACcXichVHLSsNAFD2N7/poVRAfm6IoglBu3CiuCm5c1kdV8FGSOOpgmoRkWtHSpRt/QMFVCyLiZ7jxBwTFLxCXFdy48DYtiIp6Z5I5c+aeO2dmTM+WgSJ6jGhNzS2tbe0d0c6u7p5YvLdvNXDzviUylmu7/rppBMKWjsgoqWyx7vnCyJm2WDMP5mvrawXhB9J1VtSRJ7Zyxp4jd6VlKKa2RbZ4yN2QSvilUjY+RkkKI/ET6A0wlho+GXjqfqC0G7/CJnbgwkIeOQg4UIxtGAi4bUAHwWNuC0XmfEYyXBcoIcraPGcJzjCYPeD/Hs82GqzD81rNIFRbvIvNn8/KBMbpnq6pSnd0Q8/0/mutYlij5uWIR7OuFV42djq4/PavKsejwv6n6k/PCruYDb1K9u6FTO0UVl1fOD6rLs8tjRcnqEIv7L9Mj3TLJ3AKr9bloli6QJQfQP9+3T/B6nRSp6S+yC8xh3q0YwSjmOT7nkEKC0gjw/v6OEcZlUhVG9IS2mg9VYs0NP34EtrUB4epkvE=</latexit><latexit sha1_base64="A3sYpOu9isJ0z+a3pVf+h27HhXg=">AAACcXichVHLSsNAFD2N7/poVRAfm6IoglBu3CiuCm5c1kdV8FGSOOpgmoRkWtHSpRt/QMFVCyLiZ7jxBwTFLxCXFdy48DYtiIp6Z5I5c+aeO2dmTM+WgSJ6jGhNzS2tbe0d0c6u7p5YvLdvNXDzviUylmu7/rppBMKWjsgoqWyx7vnCyJm2WDMP5mvrawXhB9J1VtSRJ7Zyxp4jd6VlKKa2RbZ4yN2QSvilUjY+RkkKI/ET6A0wlho+GXjqfqC0G7/CJnbgwkIeOQg4UIxtGAi4bUAHwWNuC0XmfEYyXBcoIcraPGcJzjCYPeD/Hs82GqzD81rNIFRbvIvNn8/KBMbpnq6pSnd0Q8/0/mutYlij5uWIR7OuFV42djq4/PavKsejwv6n6k/PCruYDb1K9u6FTO0UVl1fOD6rLs8tjRcnqEIv7L9Mj3TLJ3AKr9bloli6QJQfQP9+3T/B6nRSp6S+yC8xh3q0YwSjmOT7nkEKC0gjw/v6OEcZlUhVG9IS2mg9VYs0NP34EtrUB4epkvE=</latexit><latexit sha1_base64="qYqXi/PPbz9w5bcVow2/0UI+iYE=">AAACcXichVHLSsNAFD2Nr1pfVTeKm2JRBKHcuFFcCW5c1tZWwUdJ4qhD0yQk04qW/oA/oOBKQUT8DDf+gIt+gris4MaFt2lAVNQ7k8yZM/fcOTNjerYMFFEzpnV19/T2xfsTA4NDwyPJ0bFi4FZ9SxQs13b9LdMIhC0dUVBS2WLL84VRMW2xaZZX2+ubNeEH0nU21IkndivGoSMPpGUopvZEqX7M3ZBK+I1GKZmmDIWR+gn0CKQRRdZN3mIH+3BhoYoKBBwoxjYMBNy2oYPgMbeLOnM+IxmuCzSQYG2VswRnGMyW+X/Is+2IdXjerhmEaot3sfnzWZnCDD3RHbXoke7pmd5/rVUPa7S9nPBodrTCK42cTeTf/lVVeFQ4+lT96VnhAEuhV8nevZBpn8Lq6Gun5638cm6mPkvX9ML+r6hJD3wCp/Zq3ayL3CUS/AD69+v+CYoLGZ0y+jqlV5ajp4hjCtOY4/texArWkEWB9/VxgStcx1rapJbSpjupWizSjONLaPMfPJmQDA==</latexit>
ea1<latexit sha1_base64="oUNvzmX9/Q/2kBv/HWBuen/9i7U=">AAACanichVG7SgNBFD1ZXzG+YgTx0YhRsQp3bZRUARtLE40RNITddaKL+2J3E4hLShs7K0ErBRHxM2z8AQs7W9FOwcbCm01ANKh3mJkzZ+65c2ZGdQzd84keIlJHZ1d3T7Q31tc/MDgUH05seHbF1UResw3b3VQVTxi6JfK+7hti03GFYqqGKKj7y439QlW4nm5b637NEUVT2bX0sq4pPlMFUQqUklwvxZOUojCm2oHcAsnMxOHoI4BVO36FbezAhoYKTAhY8BkbUOBx24IMgsNcEQFzLiM93BeoI8baCmcJzlCY3edxl1dbLdbidaOmF6o1PsXg7rJyCrN0T9f0Snd0Q0/08WutIKzR8FLjWW1qhVMaOhpbe/9XZfLsY+9L9adnH2UshV519u6ETOMWWlNfPTh5XUvnZoM5uqBn9n9OD3TLN7Cqb9plVuTOEOMPkH8+dzvYWEjJlJKz/BNpNCOKSUxjnt97ERmsYBX50N0xTnEWeZES0rg02UyVIi3NCL6FNPMJoZKOMg==</latexit><latexit sha1_base64="zSu/UQ6tuJkNyPBCnyRg61cqFRo=">AAACanichVHLSsNAFD2Nr1qt1griY1PUiqty40ZxJbhx6au2UEtJ4rSGpklI0oIWl27cuRJ0pSAifoYbf0BQ/ALRnYIbF94kBVFR7zAzZ87cc+fMjGobuusR3UektvaOzq5od6ynN97XnxhIbrhW3dFEVrMMy8mriisM3RRZT/cMkbcdodRUQ+TU6qK/n2sIx9Utc93bsUWxplRMvaxrisdUTpSaSkneKyUmKENBpH4CuQUmFkb3hx7id7RsJS6wiS1Y0FBHDQImPMYGFLjcCpBBsJkrosmcw0gP9gX2EGNtnbMEZyjMVnms8KrQYk1e+zXdQK3xKQZ3h5UppOmWLumFbuiKHun911rNoIbvZYdnNdQKu9R/MLz29q+qxrOH7U/Vn549lDEXeNXZux0w/i20UN/YPXpZm19NN6fojJ7Y/ynd0zXfwGy8aucrYvUEMf4A+ftz/wQbMxmZMvIK/8Q8wohiDOOY5veexQKWsIxs4O4QxziJPEtJaUQaC1OlSEsziC8hTX4AkKOPQg==</latexit><latexit sha1_base64="zSu/UQ6tuJkNyPBCnyRg61cqFRo=">AAACanichVHLSsNAFD2Nr1qt1griY1PUiqty40ZxJbhx6au2UEtJ4rSGpklI0oIWl27cuRJ0pSAifoYbf0BQ/ALRnYIbF94kBVFR7zAzZ87cc+fMjGobuusR3UektvaOzq5od6ynN97XnxhIbrhW3dFEVrMMy8mriisM3RRZT/cMkbcdodRUQ+TU6qK/n2sIx9Utc93bsUWxplRMvaxrisdUTpSaSkneKyUmKENBpH4CuQUmFkb3hx7id7RsJS6wiS1Y0FBHDQImPMYGFLjcCpBBsJkrosmcw0gP9gX2EGNtnbMEZyjMVnms8KrQYk1e+zXdQK3xKQZ3h5UppOmWLumFbuiKHun911rNoIbvZYdnNdQKu9R/MLz29q+qxrOH7U/Vn549lDEXeNXZux0w/i20UN/YPXpZm19NN6fojJ7Y/ynd0zXfwGy8aucrYvUEMf4A+ftz/wQbMxmZMvIK/8Q8wohiDOOY5veexQKWsIxs4O4QxziJPEtJaUQaC1OlSEsziC8hTX4AkKOPQg==</latexit><latexit sha1_base64="rVJnwvKu3gz6WXFTzIDiaG0RX7A=">AAACanichVG7SgNBFD1ZXzE+EmOjpBGjYhXu2ihWARvLaMwDooTddRKXbHaX3U1AQ37AzkowlYKI+Bk2/oBFPkG0U7Cx8GazIBrUO8zMmTP33Dkzo9qG7npE3ZA0NDwyOhYej0xMTk1HYzPxvGs1HE3kNMuwnKKquMLQTZHzdM8QRdsRSl01REGtbfX2C03huLpl7nnHtjioK1VTr+ia4jFVEOWWUpbb5ViSUuTHwiCQA5BEEBkrdoN9HMKChgbqEDDhMTagwOVWggyCzdwBWsw5jHR/X6CNCGsbnCU4Q2G2xmOVV6WANXndq+n6ao1PMbg7rFzAMj3SLb3SA93RE338Wqvl1+h5OeZZ7WuFXY6ezmXf/1XVefZw9KX607OHCjZ8rzp7t32mdwutr2+enL9mN3eXWyt0Rc/s/5K6dM83MJtv2vWO2O0gwh8g/3zuQZBfS8mUkncomd4MviKMBBaxyu+9jjS2kUHOd3eGC3RCL1JcmpcS/VQpFGhm8S2kpU9Fk4xd</latexit>
ea2<latexit sha1_base64="TTkL6jI9GCXBM9X+kQJFyX3cBMA=">AAACanichVG7SgNBFD1ZXzG+YgTx0YgvrMLdNEqqgI2lJsYEooTdddTFfbG7CcQlpY2dlWAqBRHxM2z8AQs7W9FOwcbCm01AVNQ7zMyZM/fcOTOjOobu+UT3Eamjs6u7J9ob6+sfGByKDyc2PLviaiKv2YbtFlXFE4Zuibyv+4YoOq5QTNUQBXV/ublfqArX021r3a85YstUdi19R9cUn6mCKAdKOVUvx2coSWFM/QRyG8xkJg5HHwCs2vFLbGIbNjRUYELAgs/YgAKPWwkyCA5zWwiYcxnp4b5AHTHWVjhLcIbC7D6Pu7wqtVmL182aXqjW+BSDu8vKKczRHV3RC93SNT3S+6+1grBG00uNZ7WlFU556Ggs9/avyuTZx96n6k/PPnawFHrV2bsTMs1baC199eDkJZfOzgXzdE5P7P+M7umGb2BVX7WLNZFtIMYfIH9/7p9gI5WUKSmv8U+k0YooJjGNBX7vRWSwglXkQ3fHOEUj8iwlpHFpspUqRdqaEXwJafYDo5OOMw==</latexit><latexit sha1_base64="ONn+cBEq9zcXSl6Z+bW+mPupURk=">AAACanichVHLSsNAFD2N7/qqFcTHplgVV+XGjeJKcOOyrdYKtZQkjhqaJiFJC7W4dOPOlWBXCiLiZ7jxBwTFLxDdKbhx4U1SEBX1DjNz5sw9d87MqLahux7RfURqa+/o7Oruifb29Q8Mxobi665VdTSR0yzDcjZUxRWGboqcp3uG2LAdoVRUQ+TV8rK/n68Jx9Utc82r26JYUXZMfVvXFI+pvCg1lNLcfimWpBQFkfgJ5BZILo0fjDz031Hail1gE1uwoKGKCgRMeIwNKHC5FSCDYDNXRIM5h5Ee7AvsI8raKmcJzlCYLfO4w6tCizV57dd0A7XGpxjcHVYmME23dEkvdENX9Ejvv9ZqBDV8L3We1VAr7NLg4ejq27+qCs8edj9Vf3r2sI2FwKvO3u2A8W+hhfra3vHL6mJ2ujFDZ/TE/k/pnq75BmbtVTvPiGwTUf4A+ftz/wTrcymZUnKGf2IRYXRjApOY5feexxJWkEYucHeEEzQjz1JcGpMmwlQp0tIM40tIUx+SpI9D</latexit><latexit sha1_base64="ONn+cBEq9zcXSl6Z+bW+mPupURk=">AAACanichVHLSsNAFD2N7/qqFcTHplgVV+XGjeJKcOOyrdYKtZQkjhqaJiFJC7W4dOPOlWBXCiLiZ7jxBwTFLxDdKbhx4U1SEBX1DjNz5sw9d87MqLahux7RfURqa+/o7Oruifb29Q8Mxobi665VdTSR0yzDcjZUxRWGboqcp3uG2LAdoVRUQ+TV8rK/n68Jx9Utc82r26JYUXZMfVvXFI+pvCg1lNLcfimWpBQFkfgJ5BZILo0fjDz031Hail1gE1uwoKGKCgRMeIwNKHC5FSCDYDNXRIM5h5Ee7AvsI8raKmcJzlCYLfO4w6tCizV57dd0A7XGpxjcHVYmME23dEkvdENX9Ejvv9ZqBDV8L3We1VAr7NLg4ejq27+qCs8edj9Vf3r2sI2FwKvO3u2A8W+hhfra3vHL6mJ2ujFDZ/TE/k/pnq75BmbtVTvPiGwTUf4A+ftz/wTrcymZUnKGf2IRYXRjApOY5feexxJWkEYucHeEEzQjz1JcGpMmwlQp0tIM40tIUx+SpI9D</latexit><latexit sha1_base64="BTtFoxlR4BXMJOI/nmCaKcgrdoY=">AAACanichVG7SgNBFD1ZXzE+ErVRbMQYsQp3bRSrgI1losYIMSy760QX98XuJqCLP2BnJWilICJ+ho0/YOEniHYKNhbe3SyIinqHmTlz5p47Z2Y01zT8gOghJXV19/T2pfszA4NDw9ncyOiG77Q8XVR1x3S8TU31hWnYohoYgSk2XU+olmaKmra3HO3X2sLzDcdeD/Zd0bDUHdtoGroaMFUTSqgq84dKLk9FimPqJ5ATkEcSZSd3hS1sw4GOFiwI2AgYm1Dhc6tDBsFlroGQOY+REe8LHCLD2hZnCc5Qmd3jcYdX9YS1eR3V9GO1zqeY3D1WTqFA93RNL3RHN/RI77/WCuMakZd9nrWOVrhK9mh87e1flcVzgN1P1Z+eAzSxGHs12LsbM9Et9I6+fXDysra0Wghn6YKe2P85PdAt38Buv+qXFbF6hgx/gPz9uX+CjfmiTEW5QvnSUvIVaUxiGnP83gsoYQVlVGN3xzjFWepZGpUmpMlOqpRKNGP4EtLMB0eUjF4=</latexit>
ea3<latexit sha1_base64="+EUKCBkDH442Xtz/a5eiyniH6VM=">AAACanichVG7SgNBFD1ZXzE+EiOIj0bUiFW4q4WSKmBjqYkxgkrYXSe6ZF/sbgIxpLSxsxJMpSAifoaNP2BhZyvaKdhYeLMJiIp6h5k5c+aeO2dmVMfQPZ/oPiR1dHZ194R7I339A4PR2FB8w7PLriZymm3Y7qaqeMLQLZHzdd8Qm44rFFM1RF4tLTf38xXherptrftVR+yYyp6lF3VN8ZnKi0JNKSzUC7FpSlIQkz+B3AbT6fHDkQcAq3bsEtvYhQ0NZZgQsOAzNqDA47YFGQSHuR3UmHMZ6cG+QB0R1pY5S3CGwmyJxz1ebbVZi9fNml6g1vgUg7vLykkk6I6u6IVu6Zoe6f3XWrWgRtNLlWe1pRVOIXo0mn37V2Xy7GP/U/WnZx9FLAVedfbuBEzzFlpLXzk4ecmmMonaLJ3TE/s/o3u64RtYlVftYk1kGojwB8jfn/sn2JhPypSU1/gnUmhFGBOYwhy/9yLSWMEqcoG7Y5yiEXqW4tKYNNFKlUJtzTC+hDTzAaWUjjQ=</latexit><latexit sha1_base64="Z5mnY1a05PYKBE2DYRF6o8ynmik=">AAACanichVG7SgNBFD1ZXzE+EiOIj0aMilW4q4WSKmBjmURjBA1hdx11yWZ32d0EYkhpY2clmEpBRPwMG39AUPwC0U7BxsKbTUBU1DvMzJkz99w5M6Pahu56RPcBqaOzq7sn2Bvq6x8YDEeGouuuVXY0kdUsw3I2VMUVhm6KrKd7htiwHaGUVEPk1OJycz9XEY6rW+aaV7VFvqTsmvqOrikeUzlRqCmFhXohEqM4+TH5E8htEEuOH4w8DNxRyopcYAvbsKChjBIETHiMDShwuW1CBsFmLo8acw4j3d8XqCPE2jJnCc5QmC3yuMurzTZr8rpZ0/XVGp9icHdYOYkZuqVLeqEbuqJHev+1Vs2v0fRS5VltaYVdCB+Orr79qyrx7GHvU/WnZw87WPK96uzd9pnmLbSWvrJ//LKayMzUZumMntj/Kd3TNd/ArLxq52mRaSDEHyB/f+6fYH0+LlNcTvNPJNCKICYwhTl+70UksYIUsr67I5ygEXiWotKYNNFKlQJtzTC+hDT9AZSlj0Q=</latexit><latexit sha1_base64="Z5mnY1a05PYKBE2DYRF6o8ynmik=">AAACanichVG7SgNBFD1ZXzE+EiOIj0aMilW4q4WSKmBjmURjBA1hdx11yWZ32d0EYkhpY2clmEpBRPwMG39AUPwC0U7BxsKbTUBU1DvMzJkz99w5M6Pahu56RPcBqaOzq7sn2Bvq6x8YDEeGouuuVXY0kdUsw3I2VMUVhm6KrKd7htiwHaGUVEPk1OJycz9XEY6rW+aaV7VFvqTsmvqOrikeUzlRqCmFhXohEqM4+TH5E8htEEuOH4w8DNxRyopcYAvbsKChjBIETHiMDShwuW1CBsFmLo8acw4j3d8XqCPE2jJnCc5QmC3yuMurzTZr8rpZ0/XVGp9icHdYOYkZuqVLeqEbuqJHev+1Vs2v0fRS5VltaYVdCB+Orr79qyrx7GHvU/WnZw87WPK96uzd9pnmLbSWvrJ//LKayMzUZumMntj/Kd3TNd/ArLxq52mRaSDEHyB/f+6fYH0+LlNcTvNPJNCKICYwhTl+70UksYIUsr67I5ygEXiWotKYNNFKlQJtzTC+hDT9AZSlj0Q=</latexit><latexit sha1_base64="toqpx3Nzxk1YZYS40zFRmHJMjEU=">AAACanichVG7SgNBFD1ZXzG+YmwUGzFGrMJdLRSrgI1lHuYBMYTddRIXN7vL7iagIT9gZyWYSkFE/Awbf8DCTxDtFGwsvNksiIp6h5k5c+aeO2dmVNvQXY/oISQNDA4Nj4RHI2PjE5NT0elYwbWajibymmVYTklVXGHopsh7umeIku0IpaEaoqgebPX2iy3huLpl7niHtqg0lLqp13RN8Zgqimpbqa51qtE4JcmPhZ9ADkAcQaSt6BV2sQcLGppoQMCEx9iAApdbGTIINnMVtJlzGOn+vkAHEdY2OUtwhsLsAY91XpUD1uR1r6brqzU+xeDusHIBCbqna3qhO7qhR3r/tVbbr9Hzcsiz2tcKuzp1PJt7+1fV4NnD/qfqT88eatjwvers3faZ3i20vr51dPqS28wm2st0QU/s/5we6JZvYLZetcuMyHYR4Q+Qvz/3T1BYTcqUlDMUT20GXxHGPBaxwu+9jhS2kUbed3eCM3RDz1JMmpPm+6lSKNDM4EtISx9JlYxf</latexit>
ea1<latexit sha1_base64="oUNvzmX9/Q/2kBv/HWBuen/9i7U=">AAACanichVG7SgNBFD1ZXzG+YgTx0YhRsQp3bZRUARtLE40RNITddaKL+2J3E4hLShs7K0ErBRHxM2z8AQs7W9FOwcbCm01ANKh3mJkzZ+65c2ZGdQzd84keIlJHZ1d3T7Q31tc/MDgUH05seHbF1UResw3b3VQVTxi6JfK+7hti03GFYqqGKKj7y439QlW4nm5b637NEUVT2bX0sq4pPlMFUQqUklwvxZOUojCm2oHcAsnMxOHoI4BVO36FbezAhoYKTAhY8BkbUOBx24IMgsNcEQFzLiM93BeoI8baCmcJzlCY3edxl1dbLdbidaOmF6o1PsXg7rJyCrN0T9f0Snd0Q0/08WutIKzR8FLjWW1qhVMaOhpbe/9XZfLsY+9L9adnH2UshV519u6ETOMWWlNfPTh5XUvnZoM5uqBn9n9OD3TLN7Cqb9plVuTOEOMPkH8+dzvYWEjJlJKz/BNpNCOKSUxjnt97ERmsYBX50N0xTnEWeZES0rg02UyVIi3NCL6FNPMJoZKOMg==</latexit><latexit sha1_base64="zSu/UQ6tuJkNyPBCnyRg61cqFRo=">AAACanichVHLSsNAFD2Nr1qt1griY1PUiqty40ZxJbhx6au2UEtJ4rSGpklI0oIWl27cuRJ0pSAifoYbf0BQ/ALRnYIbF94kBVFR7zAzZ87cc+fMjGobuusR3UektvaOzq5od6ynN97XnxhIbrhW3dFEVrMMy8mriisM3RRZT/cMkbcdodRUQ+TU6qK/n2sIx9Utc93bsUWxplRMvaxrisdUTpSaSkneKyUmKENBpH4CuQUmFkb3hx7id7RsJS6wiS1Y0FBHDQImPMYGFLjcCpBBsJkrosmcw0gP9gX2EGNtnbMEZyjMVnms8KrQYk1e+zXdQK3xKQZ3h5UppOmWLumFbuiKHun911rNoIbvZYdnNdQKu9R/MLz29q+qxrOH7U/Vn549lDEXeNXZux0w/i20UN/YPXpZm19NN6fojJ7Y/ynd0zXfwGy8aucrYvUEMf4A+ftz/wQbMxmZMvIK/8Q8wohiDOOY5veexQKWsIxs4O4QxziJPEtJaUQaC1OlSEsziC8hTX4AkKOPQg==</latexit><latexit sha1_base64="zSu/UQ6tuJkNyPBCnyRg61cqFRo=">AAACanichVHLSsNAFD2Nr1qt1griY1PUiqty40ZxJbhx6au2UEtJ4rSGpklI0oIWl27cuRJ0pSAifoYbf0BQ/ALRnYIbF94kBVFR7zAzZ87cc+fMjGobuusR3UektvaOzq5od6ynN97XnxhIbrhW3dFEVrMMy8mriisM3RRZT/cMkbcdodRUQ+TU6qK/n2sIx9Utc93bsUWxplRMvaxrisdUTpSaSkneKyUmKENBpH4CuQUmFkb3hx7id7RsJS6wiS1Y0FBHDQImPMYGFLjcCpBBsJkrosmcw0gP9gX2EGNtnbMEZyjMVnms8KrQYk1e+zXdQK3xKQZ3h5UppOmWLumFbuiKHun911rNoIbvZYdnNdQKu9R/MLz29q+qxrOH7U/Vn549lDEXeNXZux0w/i20UN/YPXpZm19NN6fojJ7Y/ynd0zXfwGy8aucrYvUEMf4A+ftz/wQbMxmZMvIK/8Q8wohiDOOY5veexQKWsIxs4O4QxziJPEtJaUQaC1OlSEsziC8hTX4AkKOPQg==</latexit><latexit sha1_base64="rVJnwvKu3gz6WXFTzIDiaG0RX7A=">AAACanichVG7SgNBFD1ZXzE+EmOjpBGjYhXu2ihWARvLaMwDooTddRKXbHaX3U1AQ37AzkowlYKI+Bk2/oBFPkG0U7Cx8GazIBrUO8zMmTP33Dkzo9qG7npE3ZA0NDwyOhYej0xMTk1HYzPxvGs1HE3kNMuwnKKquMLQTZHzdM8QRdsRSl01REGtbfX2C03huLpl7nnHtjioK1VTr+ia4jFVEOWWUpbb5ViSUuTHwiCQA5BEEBkrdoN9HMKChgbqEDDhMTagwOVWggyCzdwBWsw5jHR/X6CNCGsbnCU4Q2G2xmOVV6WANXndq+n6ao1PMbg7rFzAMj3SLb3SA93RE338Wqvl1+h5OeZZ7WuFXY6ezmXf/1XVefZw9KX607OHCjZ8rzp7t32mdwutr2+enL9mN3eXWyt0Rc/s/5K6dM83MJtv2vWO2O0gwh8g/3zuQZBfS8mUkncomd4MviKMBBaxyu+9jjS2kUHOd3eGC3RCL1JcmpcS/VQpFGhm8S2kpU9Fk4xd</latexit>
ea2<latexit sha1_base64="TTkL6jI9GCXBM9X+kQJFyX3cBMA=">AAACanichVG7SgNBFD1ZXzG+YgTx0YgvrMLdNEqqgI2lJsYEooTdddTFfbG7CcQlpY2dlWAqBRHxM2z8AQs7W9FOwcbCm01AVNQ7zMyZM/fcOTOjOobu+UT3Eamjs6u7J9ob6+sfGByKDyc2PLviaiKv2YbtFlXFE4Zuibyv+4YoOq5QTNUQBXV/ublfqArX021r3a85YstUdi19R9cUn6mCKAdKOVUvx2coSWFM/QRyG8xkJg5HHwCs2vFLbGIbNjRUYELAgs/YgAKPWwkyCA5zWwiYcxnp4b5AHTHWVjhLcIbC7D6Pu7wqtVmL182aXqjW+BSDu8vKKczRHV3RC93SNT3S+6+1grBG00uNZ7WlFU556Ggs9/avyuTZx96n6k/PPnawFHrV2bsTMs1baC199eDkJZfOzgXzdE5P7P+M7umGb2BVX7WLNZFtIMYfIH9/7p9gI5WUKSmv8U+k0YooJjGNBX7vRWSwglXkQ3fHOEUj8iwlpHFpspUqRdqaEXwJafYDo5OOMw==</latexit><latexit sha1_base64="ONn+cBEq9zcXSl6Z+bW+mPupURk=">AAACanichVHLSsNAFD2N7/qqFcTHplgVV+XGjeJKcOOyrdYKtZQkjhqaJiFJC7W4dOPOlWBXCiLiZ7jxBwTFLxDdKbhx4U1SEBX1DjNz5sw9d87MqLahux7RfURqa+/o7Oruifb29Q8Mxobi665VdTSR0yzDcjZUxRWGboqcp3uG2LAdoVRUQ+TV8rK/n68Jx9Utc82r26JYUXZMfVvXFI+pvCg1lNLcfimWpBQFkfgJ5BZILo0fjDz031Hail1gE1uwoKGKCgRMeIwNKHC5FSCDYDNXRIM5h5Ee7AvsI8raKmcJzlCYLfO4w6tCizV57dd0A7XGpxjcHVYmME23dEkvdENX9Ejvv9ZqBDV8L3We1VAr7NLg4ejq27+qCs8edj9Vf3r2sI2FwKvO3u2A8W+hhfra3vHL6mJ2ujFDZ/TE/k/pnq75BmbtVTvPiGwTUf4A+ftz/wTrcymZUnKGf2IRYXRjApOY5feexxJWkEYucHeEEzQjz1JcGpMmwlQp0tIM40tIUx+SpI9D</latexit><latexit sha1_base64="ONn+cBEq9zcXSl6Z+bW+mPupURk=">AAACanichVHLSsNAFD2N7/qqFcTHplgVV+XGjeJKcOOyrdYKtZQkjhqaJiFJC7W4dOPOlWBXCiLiZ7jxBwTFLxDdKbhx4U1SEBX1DjNz5sw9d87MqLahux7RfURqa+/o7Oruifb29Q8Mxobi665VdTSR0yzDcjZUxRWGboqcp3uG2LAdoVRUQ+TV8rK/n68Jx9Utc82r26JYUXZMfVvXFI+pvCg1lNLcfimWpBQFkfgJ5BZILo0fjDz031Hail1gE1uwoKGKCgRMeIwNKHC5FSCDYDNXRIM5h5Ee7AvsI8raKmcJzlCYLfO4w6tCizV57dd0A7XGpxjcHVYmME23dEkvdENX9Ejvv9ZqBDV8L3We1VAr7NLg4ejq27+qCs8edj9Vf3r2sI2FwKvO3u2A8W+hhfra3vHL6mJ2ujFDZ/TE/k/pnq75BmbtVTvPiGwTUf4A+ftz/wTrcymZUnKGf2IRYXRjApOY5feexxJWkEYucHeEEzQjz1JcGpMmwlQp0tIM40tIUx+SpI9D</latexit><latexit sha1_base64="BTtFoxlR4BXMJOI/nmCaKcgrdoY=">AAACanichVG7SgNBFD1ZXzE+ErVRbMQYsQp3bRSrgI1losYIMSy760QX98XuJqCLP2BnJWilICJ+ho0/YOEniHYKNhbe3SyIinqHmTlz5p47Z2Y01zT8gOghJXV19/T2pfszA4NDw9ncyOiG77Q8XVR1x3S8TU31hWnYohoYgSk2XU+olmaKmra3HO3X2sLzDcdeD/Zd0bDUHdtoGroaMFUTSqgq84dKLk9FimPqJ5ATkEcSZSd3hS1sw4GOFiwI2AgYm1Dhc6tDBsFlroGQOY+REe8LHCLD2hZnCc5Qmd3jcYdX9YS1eR3V9GO1zqeY3D1WTqFA93RNL3RHN/RI77/WCuMakZd9nrWOVrhK9mh87e1flcVzgN1P1Z+eAzSxGHs12LsbM9Et9I6+fXDysra0Wghn6YKe2P85PdAt38Buv+qXFbF6hgx/gPz9uX+CjfmiTEW5QvnSUvIVaUxiGnP83gsoYQVlVGN3xzjFWepZGpUmpMlOqpRKNGP4EtLMB0eUjF4=</latexit>
ea14<latexit sha1_base64="A+VZyWY04q37jvYqDrePV0X7cO0=">AAACbXichVG7SgNBFD1Z3/GRqCiiIkHxUYW7IiipBBtLX4lilLC7TuLiZnfZ3QTiktLGWrAQBQUR8TNs/AELO1uxsIhgY+HNJiAq6h1m5syZe+6cmVFtQ3c9ooeQ1NDY1NzS2hZu7+jsikS7e1KuVXA0kdQsw3I2VMUVhm6KpKd7htiwHaHkVUOsq3sL1f31onBc3TLXvJIttvNKztSzuqZ4TG2KjK9kfHmmXM5ExyhOQcR+ArkOxuYHD/ofASxZ0StsYQcWNBSQh4AJj7EBBS63NGQQbOa24TPnMNKDfYEywqwtcJbgDIXZPR5zvErXWZPX1ZpuoNb4FIO7w8oYxumerqlCd3RDT/T+ay0/qFH1UuJZrWmFnYkcDqy+/avK8+xh91P1p2cPWcwFXnX2bgdM9RZaTV/cP66sJlbG/Qm6oGf2f04PdMs3MIuv2uWyWDlBmD9A/v7cP0FqOi5TXF7mn0igFq0Ywiim+L1nMY9FLCHJ55o4winOQi9SnzQsjdRSpVBd04svIU1+AHM5j3w=</latexit><latexit sha1_base64="d5dkFwYMjrRVW4ZWJb1a69SGAfg=">AAACbXichVHLSsNAFD2Nr1pfVVFERcRSdVVuRFC6Krhx6atVfFCSOGowTUKSFmro0o1rwYUoKIiIn+HGHxAsfoG4cKHgxoW3aUFU1DvMzJkz99w5M6Pahu56ROWQVFff0NgUbo60tLa1d0Q7uzKulXc0kdYsw3JWVMUVhm6KtKd7hlixHaHkVEMsq7szlf3lgnBc3TKXvKItNnLKtqlv6ZriMbUqsr6S9eXJUikbjVGCghj+CeQaiKX693sf2u5pzopeYh2bsKAhjxwETHiMDShwua1BBsFmbgM+cw4jPdgXKCHC2jxnCc5QmN3lcZtXazXW5HWlphuoNT7F4O6wchhxuqMreqFbuqZHev+1lh/UqHgp8qxWtcLOdhz0Lb79q8rx7GHnU/WnZw9bmA686uzdDpjKLbSqvrB39LKYXIj7o3ROT+z/jMp0wzcwC6/axbxYOEaEP0D+/tw/QWYiIVNCnuefSKIaYQxgBOP83lNIYRZzSPO5Jg5xgtPQs9QjDUpD1VQpVNN040tIYx9iSpCM</latexit><latexit sha1_base64="d5dkFwYMjrRVW4ZWJb1a69SGAfg=">AAACbXichVHLSsNAFD2Nr1pfVVFERcRSdVVuRFC6Krhx6atVfFCSOGowTUKSFmro0o1rwYUoKIiIn+HGHxAsfoG4cKHgxoW3aUFU1DvMzJkz99w5M6Pahu56ROWQVFff0NgUbo60tLa1d0Q7uzKulXc0kdYsw3JWVMUVhm6KtKd7hlixHaHkVEMsq7szlf3lgnBc3TKXvKItNnLKtqlv6ZriMbUqsr6S9eXJUikbjVGCghj+CeQaiKX693sf2u5pzopeYh2bsKAhjxwETHiMDShwua1BBsFmbgM+cw4jPdgXKCHC2jxnCc5QmN3lcZtXazXW5HWlphuoNT7F4O6wchhxuqMreqFbuqZHev+1lh/UqHgp8qxWtcLOdhz0Lb79q8rx7GHnU/WnZw9bmA686uzdDpjKLbSqvrB39LKYXIj7o3ROT+z/jMp0wzcwC6/axbxYOEaEP0D+/tw/QWYiIVNCnuefSKIaYQxgBOP83lNIYRZzSPO5Jg5xgtPQs9QjDUpD1VQpVNN040tIYx9iSpCM</latexit><latexit sha1_base64="ssKOVKh6cPO0GqY8b0mrYArDyhY=">AAACbXichVHLSsNAFD2N7/qqiiAoIpaqq3IjguJKcOPSV6v4ICRxqqF5kaSFGvoDrgUXoqAgIn6GG3/AhZ8gLlxUcOPC2zQgKuodZubMmXvunJnRXNPwA6LHhNTU3NLa1t6R7Ozq7ulN9fXnfafk6SKnO6bjbWqqL0zDFrnACEyx6XpCtTRTbGjFxfr+Rll4vuHY60HFFbuWum8bBUNXA6a2hBKqSijPVKtKKk1ZimLsJ5BjkEYcy07qGjvYgwMdJVgQsBEwNqHC57YNGQSXuV2EzHmMjGhfoIoka0ucJThDZbbI4z6vtmPW5nW9ph+pdT7F5O6xcgwZeqAbqtE93dITvf9aK4xq1L1UeNYaWuEqvUdDa2//qiyeAxx8qv70HKCAucirwd7diKnfQm/oy4cntbX51Uw4QZf0zP4v6JHu+AZ2+VW/WhGrp0jyB8jfn/snyE9nZcrKK5RemI+/oh3DGMcUv/csFrCEZeT4XBvHOMN54kUalEak0UaqlIg1A/gS0uQHFzqNpw==</latexit>
2.
aspect embedding
E: word embedding weights
a: attention score
T: aspect embedding weights
Sentence This beef looks delicious but the service is bad
a_i 0.05 0.24 0.11 0.12 0.12 0.01 0.12 0.09 0.11
Aspect
term
beef
Distance Calculation
:
:
:
:
:
:
a1: beef, pork, …
a2: waiter, …
a5: cocktial, …
a14: response, …
:
:
:
:
:
:
a1: Main Dishes
a2: Staff
:
:
:
:
:
:
a5: Drink
a14: Service
Top Aspect Terms Assigning Aspect Names
aspect
ewbeef<latexit sha1_base64="nTAQr0FYpdZwnsl4h7BILRSDiAo=">AAACb3ichVHLSsNAFD2N7/qqulAUpFQU3ZQbN4qrghuXrdpWUClJnGpomoQkrWjoD/gBunChFkTEnxDc+AMu+gniSiq4ceFtWhAt6h1m5syZe+6cmVFtQ3c9olpI6ujs6u7p7Qv3DwwODUdGRjOuVXI0kdYsw3K2VMUVhm6KtKd7htiyHaEUVUNk1cJqYz9bFo6rW+amd2SL3aKyb+p5XVM8pnZEzj/M+aoQ+UolF5mhOAURbQdyC8wkYtXJewBJK3KDHezBgoYSihAw4TE2oMDltg0ZBJu5XfjMOYz0YF+ggjBrS5wlOENhtsDjPq+2W6zJ60ZNN1BrfIrB3WFlFLP0RLdUp0e6o2f6+LWWH9RoeDniWW1qhZ0bPpnYeP9XVeTZw8GX6k/PHvJYDrzq7N0OmMYttKa+fHxW31hZn/XnqEov7P+KavTANzDLb9p1SqyfI8wfIP987naQWYzLFJdT/BMraEYvphDDPL/3EhJYQxJpPtfGKS5wGXqVxqVpKdpMlUItzRi+hbTwCV84kNw=</latexit><latexit sha1_base64="syCDN1MN6Fh7l0LYJ9DhTdRJUxw=">AAACb3ichVHLSsNAFD2N7/po1YWiIEWpKEi5caO4Ety41GqtoBKSONXQNAlJWtHQH/ADdOHCB4iIW8EPcOMPuPATxJVUcOPC27QgWtQ7zMyZM/fcOTOjOabh+URPEampuaW1rb0j2tnV3ROL9/ateXbR1UVGt03bXddUT5iGJTK+4Zti3XGFWtBMkdXyC9X9bEm4nmFbq/6+I7YK6o5l5Axd9ZnaFEqwpwSaELlyWYmPUYrCSDQCuQ7G5kcvhm7vptJLdvwKm9iGDR1FFCBgwWdsQoXHbQMyCA5zWwiYcxkZ4b5AGVHWFjlLcIbKbJ7HHV5t1FmL19WaXqjW+RSTu8vKBJL0SNdUoQe6oWf6+LVWENaoetnnWatphaPEDgdX3v9VFXj2sful+tOzjxxmQ68Ge3dCpnoLvaYvHRxXVubSyWCcLuiF/Z/TE93zDazSm365LNIniPIHyD+fuxGsTadkSsnL/BNzqEU7hjGKCX7vGcxjEUvI8LkOjnCKs8irNCCNSIlaqhSpa/rxLaTJT3xFkgU=</latexit><latexit sha1_base64="syCDN1MN6Fh7l0LYJ9DhTdRJUxw=">AAACb3ichVHLSsNAFD2N7/po1YWiIEWpKEi5caO4Ety41GqtoBKSONXQNAlJWtHQH/ADdOHCB4iIW8EPcOMPuPATxJVUcOPC27QgWtQ7zMyZM/fcOTOjOabh+URPEampuaW1rb0j2tnV3ROL9/ateXbR1UVGt03bXddUT5iGJTK+4Zti3XGFWtBMkdXyC9X9bEm4nmFbq/6+I7YK6o5l5Axd9ZnaFEqwpwSaELlyWYmPUYrCSDQCuQ7G5kcvhm7vptJLdvwKm9iGDR1FFCBgwWdsQoXHbQMyCA5zWwiYcxkZ4b5AGVHWFjlLcIbKbJ7HHV5t1FmL19WaXqjW+RSTu8vKBJL0SNdUoQe6oWf6+LVWENaoetnnWatphaPEDgdX3v9VFXj2sful+tOzjxxmQ68Ge3dCpnoLvaYvHRxXVubSyWCcLuiF/Z/TE93zDazSm365LNIniPIHyD+fuxGsTadkSsnL/BNzqEU7hjGKCX7vGcxjEUvI8LkOjnCKs8irNCCNSIlaqhSpa/rxLaTJT3xFkgU=</latexit><latexit sha1_base64="YNu79Lt3u+Fb/pnKAm3SIfRvcog=">AAACb3ichVHLSsNAFD2Nr1pfVRcKghSLopty40bpquDGZatWBZWQxKkG0yQkaaWG/oAfoAsXPkBE/Aw3/oALP0FciYIbF96kAVFR7zAzZ87cc+fMjOaYhucTPSSktvaOzq5kd6qnt69/ID04tOrZNVcXZd02bXddUz1hGpYo+4ZvinXHFWpVM8WatrcQ7q/VhesZtrXiNxyxVVV3LKNi6KrP1KZQgn0l0ISoNJtKOks5iiLzE8gxyCKOop2+wia2YUNHDVUIWPAZm1DhcduADILD3BYC5lxGRrQv0ESKtTXOEpyhMrvH4w6vNmLW4nVY04vUOp9icndZmcEk3dM1vdAd3dAjvf9aK4hqhF4aPGstrXCUgcPR5bd/VVWefex+qv707KOC+cirwd6diAlvobf09YPjl+X80mQwRRf0xP7P6YFu+QZW/VW/LImlE6T4A+Tvz/0TrM7mZMrJJcoW8vFXJDGGCUzze8+hgEUUUeZzHRzhFGeJZ2lEGpcyrVQpEWuG8SWkmQ/yYI7+</latexit>
ewpork<latexit sha1_base64="A84rQjWnEeSSuC8YvW7pjybznz8=">AAACb3ichVHLSsNAFD2N7/po1YWiIKVF0U25caO4Ety4rI9qoS0liaOGpklI0oqG/oAfoAsXakFE/AnBjT/gwk8QV1LBjQtv04JoUe8wM2fO3HPnzIxqG7rrET2FpI7Oru6e3r5w/8DgUCQ6PLLlWmVHE2nNMiwnoyquMHRTpD3dM0TGdoRSUg2xrRZXGvvbFeG4umVueoe2yJeUPVPf1TXFYyonCv5Bwbctp1itFqIJSlIQsXYgt0BiOV6buAOQsqLXyGEHFjSUUYKACY+xAQUutyxkEGzm8vCZcxjpwb5AFWHWljlLcIbCbJHHPV5lW6zJ60ZNN1BrfIrB3WFlDNP0SDdUpwe6pWf6+LWWH9RoeDnkWW1qhV2IHI9vvP+rKvHsYf9L9adnD7tYDLzq7N0OmMYttKa+cnRa31han/ZnqEYv7P+Snuieb2BW3rSrNbF+hjB/gPzzudvB1nxSpqS8xj+xhGb0YhJxzPJ7L2AZq0ghzefaOME5LkKv0pg0JcWaqVKopRnFt5DmPgGz15EG</latexit><latexit sha1_base64="HbvIJHyGHTyWelCGOiM6BTF2gqI=">AAACb3ichVHLSsNAFD2N7/qqulAUpLQoClJu3CiuBDcutdpW0BKSOGpomoQkrWjoD/gBunDhA0TEreAHuPEHXPgJ4koU3LjwNi2IFvUOM3PmzD13zsxojml4PtFjRGpqbmlta++IdnZ19/TG+vqznl1ydZHRbdN21zTVE6ZhiYxv+KZYc1yhFjVT5LTCQnU/VxauZ9jWqr/niHxR3baMLUNXfaY2hBLsKoFju4VKRYklKUVhxBuBXAfJ+cT58M3tVHrJjl1iA5uwoaOEIgQs+IxNqPC4rUMGwWEuj4A5l5ER7gtUEGVtibMEZ6jMFnjc5tV6nbV4Xa3phWqdTzG5u6yMY4we6Ipe6Z6u6Yk+fq0VhDWqXvZ41mpa4Si9B0Mr7/+qijz72PlS/enZxxZmQ68Ge3dCpnoLvaYv7x+9rsylx4JxOqdn9n9Gj3THN7DKb/rFskgfI8ofIP987kaQnU7JlJKX+SfmUIt2jCCBCX7vGcxjEUvI8LkODnGC08iLNCiNSvFaqhSpawbwLaTJT9Dkki8=</latexit><latexit sha1_base64="HbvIJHyGHTyWelCGOiM6BTF2gqI=">AAACb3ichVHLSsNAFD2N7/qqulAUpLQoClJu3CiuBDcutdpW0BKSOGpomoQkrWjoD/gBunDhA0TEreAHuPEHXPgJ4koU3LjwNi2IFvUOM3PmzD13zsxojml4PtFjRGpqbmlta++IdnZ19/TG+vqznl1ydZHRbdN21zTVE6ZhiYxv+KZYc1yhFjVT5LTCQnU/VxauZ9jWqr/niHxR3baMLUNXfaY2hBLsKoFju4VKRYklKUVhxBuBXAfJ+cT58M3tVHrJjl1iA5uwoaOEIgQs+IxNqPC4rUMGwWEuj4A5l5ER7gtUEGVtibMEZ6jMFnjc5tV6nbV4Xa3phWqdTzG5u6yMY4we6Ipe6Z6u6Yk+fq0VhDWqXvZ41mpa4Si9B0Mr7/+qijz72PlS/enZxxZmQ68Ge3dCpnoLvaYv7x+9rsylx4JxOqdn9n9Gj3THN7DKb/rFskgfI8ofIP987kaQnU7JlJKX+SfmUIt2jCCBCX7vGcxjEUvI8LkODnGC08iLNCiNSvFaqhSpawbwLaTJT9Dkki8=</latexit><latexit sha1_base64="bFDS3QHKWLbLL8KP8JOmnxi5p6Q=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgU3ZQbN4orwY1L29pWaEtJ4qihaRKStKKhP+AH6MKFDxARP8ONP+CinyCuRMGNC2/TgGhR7zAzZ87cc+fMjGobuusRNSNSV3dPb1//QHRwaHhkNDY2nnOtmqOJrGYZlrOtKq4wdFNkPd0zxLbtCKWqGiKvVtZb+/m6cFzdMre8Q1uUqsqeqe/qmuIxVRRl/6Ds25ZTaTTKsQQlKYh4J5BDkEAYm1bsBkXswIKGGqoQMOExNqDA5VaADILNXAk+cw4jPdgXaCDK2hpnCc5QmK3wuMerQsiavG7VdAO1xqcY3B1WxjFHj3RLr/RAd/REH7/W8oMaLS+HPKttrbDLo8dTmfd/VVWePex/qf707GEXK4FXnb3bAdO6hdbW149OXzOr6Tl/nq7omf1fUpPu+QZm/U27Ton0GaL8AfLP5+4EuaWkTEk5RYm11fAr+jGNWSzwey9jDRvYRJbPtXGCc1xEXqRJaUaKt1OlSKiZwLeQFj8BRw6PKA==</latexit>
ewwaiter<latexit sha1_base64="PmNoZsFA+652kk3B2CbeiL5tq2I=">AAACcXichVG7SgNBFD1Z3/GRqCA+mqAoghDu2ihWgo1lfMQEfITdddQhm91ldxLRkNLGH1CwiiAifoaNP2BhZyuWEWwsvNkEREW9M7tz5sw9d87MmJ4tA0X0GNFaWtvaOzq7ot09vX2xeP/ARuAWfUukLdd2/axpBMKWjkgrqWyR9XxhFExbZMz8Un09UxJ+IF1nXR15Yrtg7DtyT1qGYmpH5MqH3A2phF+p5OITlKQwEj+B3gQTi6MnQ08AUm78GlvYhQsLRRQg4EAxtmEg4LYJHQSPuW2UmfMZyXBdoIIoa4ucJTjDYDbP/32ebTZZh+f1mkGotngXmz+flQlM0gPdUI3u6Zae6f3XWuWwRt3LEY9mQyu8XOx0eO3tX1WBR4WDT9WfnhX2MB96lezdC5n6KayGvnR8VltbWJ0sT9ElvbD/Kj3SHZ/AKb1aVyti9QJRfgD9+3X/BBuzSZ2S+gq/xAIa0YkxjGOa73sOi1hGCmne18c5qriM1LQRLaGNN1K1SFMziC+hzXwAmJiR4Q==</latexit><latexit sha1_base64="A3sYpOu9isJ0z+a3pVf+h27HhXg=">AAACcXichVHLSsNAFD2N7/poVRAfm6IoglBu3CiuCm5c1kdV8FGSOOpgmoRkWtHSpRt/QMFVCyLiZ7jxBwTFLxCXFdy48DYtiIp6Z5I5c+aeO2dmTM+WgSJ6jGhNzS2tbe0d0c6u7p5YvLdvNXDzviUylmu7/rppBMKWjsgoqWyx7vnCyJm2WDMP5mvrawXhB9J1VtSRJ7Zyxp4jd6VlKKa2RbZ4yN2QSvilUjY+RkkKI/ET6A0wlho+GXjqfqC0G7/CJnbgwkIeOQg4UIxtGAi4bUAHwWNuC0XmfEYyXBcoIcraPGcJzjCYPeD/Hs82GqzD81rNIFRbvIvNn8/KBMbpnq6pSnd0Q8/0/mutYlij5uWIR7OuFV42djq4/PavKsejwv6n6k/PCruYDb1K9u6FTO0UVl1fOD6rLs8tjRcnqEIv7L9Mj3TLJ3AKr9bloli6QJQfQP9+3T/B6nRSp6S+yC8xh3q0YwSjmOT7nkEKC0gjw/v6OEcZlUhVG9IS2mg9VYs0NP34EtrUB4epkvE=</latexit><latexit sha1_base64="A3sYpOu9isJ0z+a3pVf+h27HhXg=">AAACcXichVHLSsNAFD2N7/poVRAfm6IoglBu3CiuCm5c1kdV8FGSOOpgmoRkWtHSpRt/QMFVCyLiZ7jxBwTFLxCXFdy48DYtiIp6Z5I5c+aeO2dmTM+WgSJ6jGhNzS2tbe0d0c6u7p5YvLdvNXDzviUylmu7/rppBMKWjsgoqWyx7vnCyJm2WDMP5mvrawXhB9J1VtSRJ7Zyxp4jd6VlKKa2RbZ4yN2QSvilUjY+RkkKI/ET6A0wlho+GXjqfqC0G7/CJnbgwkIeOQg4UIxtGAi4bUAHwWNuC0XmfEYyXBcoIcraPGcJzjCYPeD/Hs82GqzD81rNIFRbvIvNn8/KBMbpnq6pSnd0Q8/0/mutYlij5uWIR7OuFV42djq4/PavKsejwv6n6k/PCruYDb1K9u6FTO0UVl1fOD6rLs8tjRcnqEIv7L9Mj3TLJ3AKr9bloli6QJQfQP9+3T/B6nRSp6S+yC8xh3q0YwSjmOT7nkEKC0gjw/v6OEcZlUhVG9IS2mg9VYs0NP34EtrUB4epkvE=</latexit><latexit sha1_base64="qYqXi/PPbz9w5bcVow2/0UI+iYE=">AAACcXichVHLSsNAFD2Nr1pfVTeKm2JRBKHcuFFcCW5c1tZWwUdJ4qhD0yQk04qW/oA/oOBKQUT8DDf+gIt+gris4MaFt2lAVNQ7k8yZM/fcOTNjerYMFFEzpnV19/T2xfsTA4NDwyPJ0bFi4FZ9SxQs13b9LdMIhC0dUVBS2WLL84VRMW2xaZZX2+ubNeEH0nU21IkndivGoSMPpGUopvZEqX7M3ZBK+I1GKZmmDIWR+gn0CKQRRdZN3mIH+3BhoYoKBBwoxjYMBNy2oYPgMbeLOnM+IxmuCzSQYG2VswRnGMyW+X/Is+2IdXjerhmEaot3sfnzWZnCDD3RHbXoke7pmd5/rVUPa7S9nPBodrTCK42cTeTf/lVVeFQ4+lT96VnhAEuhV8nevZBpn8Lq6Gun5638cm6mPkvX9ML+r6hJD3wCp/Zq3ayL3CUS/AD69+v+CYoLGZ0y+jqlV5ajp4hjCtOY4/texArWkEWB9/VxgStcx1rapJbSpjupWizSjONLaPMfPJmQDA==</latexit>
ewcocktial<latexit sha1_base64="8HJFznyVgGBG0Jl5kcjmfLuqKTw=">AAACdXichVFNLyxBFD3TPt88H42NRCTiezVu2xAriY2lr0HiSae7FCrT093prhmhM3/AH7BgQ+KJ+Bk2EmsLP0EsSWws3OmZRBDcSlWdOnXPrVNVbuipWBPdZ4yGxqbmltY/2b9t7R2dZlf3ahyUIiHzIvCCaN11YukpX+a10p5cDyPpFF1PrrmFuer+WllGsQr8Fb0fys2is+OrbSUczZRtmtJO9uxEBKKgleNVKrY5RDlKY+ArsOpgaLZv7BYcC4F5gX/YQgCBEoqQ8KEZe3AQc9uABULI3CYS5iJGKt2XqCDL2hJnSc5wmC3wuMOrjTrr87paM07Vgk/xuEesHMAI3dElPdENXdEDvX5bK0lrVL3s8+zWtDK0Ow97l19+VRV51th9V/3oWWMb06lXxd7DlKneQtT05YOjp+WZpZFklM7okf2f0j1d8w388rM4X5RLx8jyB1ifn/srWJ3MWZSzFvknZlCLVvRhEOP83lOYxTwWkOdzyzjBOf5nXox+Y9gYraUambqmBx/CmHgD+YeSXA==</latexit><latexit sha1_base64="7a7FAzQgyauTWn52K1Sj5qH3gyc=">AAACdXichVHPSxtBGH3Z2jZNf7jWS0EEqSb2lH7bSyUnwYtHTZooaFh2p5M4ZLO77E4iugQ8+w940EsLtoh/Ri+ldw/+CbbHFLz04JdNQDS0/YaZefPme9+8mXFDT8Wa6DJjPJh4+Ohx9knu6bPnLybNqZe1OOhEQlZF4AXRpuvE0lO+rGqlPbkZRtJpu57ccFsrg/2NroxiFfgf9F4o622n6auGEo5myjZNaSe7diIC0dLK8Xo925ynIqUxNw6sEZhfnln88VP3DtYC8yu28REBBDpoQ8KHZuzBQcxtCxYIIXN1JMxFjFS6L9FDjrUdzpKc4TDb4rHJq60R6/N6UDNO1YJP8bhHrJxDni7ojPr0nc7piv78tVaS1hh42ePZHWplaE8evqpc/1fV5llj51b1T88aDSylXhV7D1NmcAsx1Hf3j/qVUjmfFOgz/WL/n+iSvvEN/O5vcbouy8fI8QdY9597HNTeFS0qWuv8EyUMI4sZvMYbfu/3WMYq1lDlc7s4wSm+ZK6NWWPBKAxTjcxIM407Yby9AUNrlLY=</latexit><latexit sha1_base64="7a7FAzQgyauTWn52K1Sj5qH3gyc=">AAACdXichVHPSxtBGH3Z2jZNf7jWS0EEqSb2lH7bSyUnwYtHTZooaFh2p5M4ZLO77E4iugQ8+w940EsLtoh/Ri+ldw/+CbbHFLz04JdNQDS0/YaZefPme9+8mXFDT8Wa6DJjPJh4+Ohx9knu6bPnLybNqZe1OOhEQlZF4AXRpuvE0lO+rGqlPbkZRtJpu57ccFsrg/2NroxiFfgf9F4o622n6auGEo5myjZNaSe7diIC0dLK8Xo925ynIqUxNw6sEZhfnln88VP3DtYC8yu28REBBDpoQ8KHZuzBQcxtCxYIIXN1JMxFjFS6L9FDjrUdzpKc4TDb4rHJq60R6/N6UDNO1YJP8bhHrJxDni7ojPr0nc7piv78tVaS1hh42ePZHWplaE8evqpc/1fV5llj51b1T88aDSylXhV7D1NmcAsx1Hf3j/qVUjmfFOgz/WL/n+iSvvEN/O5vcbouy8fI8QdY9597HNTeFS0qWuv8EyUMI4sZvMYbfu/3WMYq1lDlc7s4wSm+ZK6NWWPBKAxTjcxIM407Yby9AUNrlLY=</latexit><latexit sha1_base64="bs8QlLljyYde7WbNFuyzJJm+ZMk=">AAACVXichVG7SgNBFD1ZX3F9JMFGsAmGiFW4a6NYCTaWeZgHxBB2N6Mu2ewuu5tADP5AWgsLKwUR8TNs/AGL9DZiGcHGwrubgKiod5iZM2fm3DlzR3NMw/OJBhFpYnJqeiY6K8/NywuLsfh8ybPbri6Kum3abkVTPWEalij6hm+KiuMKtaWZoqw1d4P9cke4nmFb+37XEbWWemQZh4au+kxl6/EUZSiM5E+gjEEK47DjNzhAAzZ0tNGCgAWfsQkVHrcqFBAc5mroMecyMsJ9gVPIrG3zKcEnVGabPB7xqjpmLV4HOb1QrfMtJneXlUmk6ZFuaUgPdEfP9P5rrl6YI/DS5VkbaYVTj/WXC2//qlo8+zj+VP3p2cchtkKvBnt3QiZ4hT7Sd07Oh4XtfLq3Rlf0wv4vaUD3/AKr86pf50T+AjLXX/le7Z+gtJFRKKPkCFGsYBXrXOZN7GAPWRT5ugb6OIs8SbKUGP2TFBl/WAJfQlr6AAYJh7c=</latexit><latexit sha1_base64="sWBrZaEvS/eEo57+vJsgnYDVZGs=">AAACanichVHLLgRBFD3TXmO8mpVEJOIVq8ltG2IlsbH0GiRIp7sUKtPT3emuGaEzP+AHLNiQIOIzbPyAxXyCWJLYWLjTM4kguJWqOnWqzq1Tdd3QU7EmqmWMlta29o5sZ66ru6e3z+zvXo+DciRkQQReEG26Tiw95cuCVtqTm2EknZLryQ23uFDf36jIKFaBv6aPQrlTcvZ9taeEo5myTVPayaGdiEAUtXK8atU2xyhPaYz8BFYTjKEZS4F5g23sIoBAGSVI+NCMPTiIuW3BAiFkbgcJcxEjle5LVJFjbZlPST7hMFvkcZ9XW03W53U9Z5yqBd/icY9YOYIJeqRbeqEHuqMnev81V5LmqHs54tltaGVo950Mrr79qyrxrHHwqfrTs8YeZlOvir2HKVN/hWjoK8enL6tzKxPJJF3SM/u/oBrd8wv8yqu4WpYrZ8hxAazv3/0TrE/nLcpby4QshjCKKf7mGcxjEUso8HUVnOMK15k3Y9gYb5TKyDRrNoAvYUx+AFjUkDo=</latexit><latexit sha1_base64="sWBrZaEvS/eEo57+vJsgnYDVZGs=">AAACanichVHLLgRBFD3TXmO8mpVEJOIVq8ltG2IlsbH0GiRIp7sUKtPT3emuGaEzP+AHLNiQIOIzbPyAxXyCWJLYWLjTM4kguJWqOnWqzq1Tdd3QU7EmqmWMlta29o5sZ66ru6e3z+zvXo+DciRkQQReEG26Tiw95cuCVtqTm2EknZLryQ23uFDf36jIKFaBv6aPQrlTcvZ9taeEo5myTVPayaGdiEAUtXK8atU2xyhPaYz8BFYTjKEZS4F5g23sIoBAGSVI+NCMPTiIuW3BAiFkbgcJcxEjle5LVJFjbZlPST7hMFvkcZ9XW03W53U9Z5yqBd/icY9YOYIJeqRbeqEHuqMnev81V5LmqHs54tltaGVo950Mrr79qyrxrHHwqfrTs8YeZlOvir2HKVN/hWjoK8enL6tzKxPJJF3SM/u/oBrd8wv8yqu4WpYrZ8hxAazv3/0TrE/nLcpby4QshjCKKf7mGcxjEUso8HUVnOMK15k3Y9gYb5TKyDRrNoAvYUx+AFjUkDo=</latexit><latexit sha1_base64="0UPNXTQXnrq7zvB0as9gwdeadD8=">AAACdXichVHLSuRAFD0dn9M+OjobQQSxVVy1N24UV8JsZuljWgWVkJSlFp1OQlLdoqF/wB+YhW4UdBA/w40/4MJPGFwquHHh7XRAVNRbVNWpU/fcOlXlhp6KNdFdzmhr7+js6v6R7+nt6y+YA4OrcVCLhCyLwAuiddeJpad8WdZKe3I9jKRTdT255lZ+NffX6jKKVeD/0Qeh3Ko6u77aUcLRTNmmKe1k305EICpaOV6jYZtFKlEaox+BlYEislgMzH/YxDYCCNRQhYQPzdiDg5jbBiwQQua2kDAXMVLpvkQDedbWOEtyhsNshcddXm1krM/rZs04VQs+xeMesXIUE3RLl/RAN3RF/+n501pJWqPp5YBnt6WVoV04Glp5+lZV5Vlj71X1pWeNHcylXhV7D1OmeQvR0tcP/z6szC9PJJN0Rvfs/5Tu6Jpv4NcfxfmSXD5Gnj/Aev/cH8HqTMmikrVExYX57Cu6MYwxTPF7z2IBv7GIMp9bxwnOcZF7MkaMcWOylWrkMs1PvAlj+gWWO5EP</latexit><latexit sha1_base64="0UPNXTQXnrq7zvB0as9gwdeadD8=">AAACdXichVHLSuRAFD0dn9M+OjobQQSxVVy1N24UV8JsZuljWgWVkJSlFp1OQlLdoqF/wB+YhW4UdBA/w40/4MJPGFwquHHh7XRAVNRbVNWpU/fcOlXlhp6KNdFdzmhr7+js6v6R7+nt6y+YA4OrcVCLhCyLwAuiddeJpad8WdZKe3I9jKRTdT255lZ+NffX6jKKVeD/0Qeh3Ko6u77aUcLRTNmmKe1k305EICpaOV6jYZtFKlEaox+BlYEislgMzH/YxDYCCNRQhYQPzdiDg5jbBiwQQua2kDAXMVLpvkQDedbWOEtyhsNshcddXm1krM/rZs04VQs+xeMesXIUE3RLl/RAN3RF/+n501pJWqPp5YBnt6WVoV04Glp5+lZV5Vlj71X1pWeNHcylXhV7D1OmeQvR0tcP/z6szC9PJJN0Rvfs/5Tu6Jpv4NcfxfmSXD5Gnj/Aev/cH8HqTMmikrVExYX57Cu6MYwxTPF7z2IBv7GIMp9bxwnOcZF7MkaMcWOylWrkMs1PvAlj+gWWO5EP</latexit><latexit sha1_base64="7a7FAzQgyauTWn52K1Sj5qH3gyc=">AAACdXichVHPSxtBGH3Z2jZNf7jWS0EEqSb2lH7bSyUnwYtHTZooaFh2p5M4ZLO77E4iugQ8+w940EsLtoh/Ri+ldw/+CbbHFLz04JdNQDS0/YaZefPme9+8mXFDT8Wa6DJjPJh4+Ohx9knu6bPnLybNqZe1OOhEQlZF4AXRpuvE0lO+rGqlPbkZRtJpu57ccFsrg/2NroxiFfgf9F4o622n6auGEo5myjZNaSe7diIC0dLK8Xo925ynIqUxNw6sEZhfnln88VP3DtYC8yu28REBBDpoQ8KHZuzBQcxtCxYIIXN1JMxFjFS6L9FDjrUdzpKc4TDb4rHJq60R6/N6UDNO1YJP8bhHrJxDni7ojPr0nc7piv78tVaS1hh42ePZHWplaE8evqpc/1fV5llj51b1T88aDSylXhV7D1NmcAsx1Hf3j/qVUjmfFOgz/WL/n+iSvvEN/O5vcbouy8fI8QdY9597HNTeFS0qWuv8EyUMI4sZvMYbfu/3WMYq1lDlc7s4wSm+ZK6NWWPBKAxTjcxIM407Yby9AUNrlLY=</latexit><latexit sha1_base64="7a7FAzQgyauTWn52K1Sj5qH3gyc=">AAACdXichVHPSxtBGH3Z2jZNf7jWS0EEqSb2lH7bSyUnwYtHTZooaFh2p5M4ZLO77E4iugQ8+w940EsLtoh/Ri+ldw/+CbbHFLz04JdNQDS0/YaZefPme9+8mXFDT8Wa6DJjPJh4+Ohx9knu6bPnLybNqZe1OOhEQlZF4AXRpuvE0lO+rGqlPbkZRtJpu57ccFsrg/2NroxiFfgf9F4o622n6auGEo5myjZNaSe7diIC0dLK8Xo925ynIqUxNw6sEZhfnln88VP3DtYC8yu28REBBDpoQ8KHZuzBQcxtCxYIIXN1JMxFjFS6L9FDjrUdzpKc4TDb4rHJq60R6/N6UDNO1YJP8bhHrJxDni7ojPr0nc7piv78tVaS1hh42ePZHWplaE8evqpc/1fV5llj51b1T88aDSylXhV7D1NmcAsx1Hf3j/qVUjmfFOgz/WL/n+iSvvEN/O5vcbouy8fI8QdY9597HNTeFS0qWuv8EyUMI4sZvMYbfu/3WMYq1lDlc7s4wSm+ZK6NWWPBKAxTjcxIM407Yby9AUNrlLY=</latexit><latexit sha1_base64="7a7FAzQgyauTWn52K1Sj5qH3gyc=">AAACdXichVHPSxtBGH3Z2jZNf7jWS0EEqSb2lH7bSyUnwYtHTZooaFh2p5M4ZLO77E4iugQ8+w940EsLtoh/Ri+ldw/+CbbHFLz04JdNQDS0/YaZefPme9+8mXFDT8Wa6DJjPJh4+Ohx9knu6bPnLybNqZe1OOhEQlZF4AXRpuvE0lO+rGqlPbkZRtJpu57ccFsrg/2NroxiFfgf9F4o622n6auGEo5myjZNaSe7diIC0dLK8Xo925ynIqUxNw6sEZhfnln88VP3DtYC8yu28REBBDpoQ8KHZuzBQcxtCxYIIXN1JMxFjFS6L9FDjrUdzpKc4TDb4rHJq60R6/N6UDNO1YJP8bhHrJxDni7ojPr0nc7piv78tVaS1hh42ePZHWplaE8evqpc/1fV5llj51b1T88aDSylXhV7D1NmcAsx1Hf3j/qVUjmfFOgz/WL/n+iSvvEN/O5vcbouy8fI8QdY9597HNTeFS0qWuv8EyUMI4sZvMYbfu/3WMYq1lDlc7s4wSm+ZK6NWWPBKAxTjcxIM407Yby9AUNrlLY=</latexit><latexit sha1_base64="7a7FAzQgyauTWn52K1Sj5qH3gyc=">AAACdXichVHPSxtBGH3Z2jZNf7jWS0EEqSb2lH7bSyUnwYtHTZooaFh2p5M4ZLO77E4iugQ8+w940EsLtoh/Ri+ldw/+CbbHFLz04JdNQDS0/YaZefPme9+8mXFDT8Wa6DJjPJh4+Ohx9knu6bPnLybNqZe1OOhEQlZF4AXRpuvE0lO+rGqlPbkZRtJpu57ccFsrg/2NroxiFfgf9F4o622n6auGEo5myjZNaSe7diIC0dLK8Xo925ynIqUxNw6sEZhfnln88VP3DtYC8yu28REBBDpoQ8KHZuzBQcxtCxYIIXN1JMxFjFS6L9FDjrUdzpKc4TDb4rHJq60R6/N6UDNO1YJP8bhHrJxDni7ojPr0nc7piv78tVaS1hh42ePZHWplaE8evqpc/1fV5llj51b1T88aDSylXhV7D1NmcAsx1Hf3j/qVUjmfFOgz/WL/n+iSvvEN/O5vcbouy8fI8QdY9597HNTeFS0qWuv8EyUMI4sZvMYbfu/3WMYq1lDlc7s4wSm+ZK6NWWPBKAxTjcxIM407Yby9AUNrlLY=</latexit><latexit sha1_base64="0UPNXTQXnrq7zvB0as9gwdeadD8=">AAACdXichVHLSuRAFD0dn9M+OjobQQSxVVy1N24UV8JsZuljWgWVkJSlFp1OQlLdoqF/wB+YhW4UdBA/w40/4MJPGFwquHHh7XRAVNRbVNWpU/fcOlXlhp6KNdFdzmhr7+js6v6R7+nt6y+YA4OrcVCLhCyLwAuiddeJpad8WdZKe3I9jKRTdT255lZ+NffX6jKKVeD/0Qeh3Ko6u77aUcLRTNmmKe1k305EICpaOV6jYZtFKlEaox+BlYEislgMzH/YxDYCCNRQhYQPzdiDg5jbBiwQQua2kDAXMVLpvkQDedbWOEtyhsNshcddXm1krM/rZs04VQs+xeMesXIUE3RLl/RAN3RF/+n501pJWqPp5YBnt6WVoV04Glp5+lZV5Vlj71X1pWeNHcylXhV7D1OmeQvR0tcP/z6szC9PJJN0Rvfs/5Tu6Jpv4NcfxfmSXD5Gnj/Aev/cH8HqTMmikrVExYX57Cu6MYwxTPF7z2IBv7GIMp9bxwnOcZF7MkaMcWOylWrkMs1PvAlj+gWWO5EP</latexit>
ewresponse<latexit sha1_base64="hngTAhHM/ixYcrISH2cdlT07acI=">AAACdXichVHLSsNAFD2Nr1pfUTeCCOILV/XGjdKV4MZlba0KKiGJ0xqaF0la0dAf8Adc6EZBRfwL3fgDLvoJ4lKhGxfepgVRUe8wM2fO3HPnzIzuWWYQEtUTUkdnV3dPsjfV1z8wOCQPj2wGbsU3RMFwLdff1rVAWKYjCqEZWmLb84Vm65bY0surzf2tqvAD03U2wiNP7NlayTGLpqGFTKmyLNToUI18EXiuE4haTZWnKU1xTP4EShtMr0xl78GRdeUb7GIfLgxUYEPAQcjYgoaA2w4UEDzm9hAx5zMy432BGlKsrXCW4AyN2TKPJV7ttFmH182aQaw2+BSLu8/KSczSE93SKz3SHT3T+6+1orhG08sRz3pLKzx16GQs3/hXZfMc4uBT9afnEEUsx15N9u7FTPMWRktfPT59zWdys9EcXdIL+7+gOj3wDZzqm3G1LnJnSPEHKN+f+yfYXEwrlFbW+ScyaEUS45jCPL/3ElawhiwKfG4V57jCdaIhTUgz0lwrVUq0NaP4EtLCB4wokqg=</latexit><latexit sha1_base64="LgUEOfvEZlucjr1L0ucsf2dejUs=">AAACdXichVHLSsNAFD2Nr1ofjboRRBAfxVW96cbSVcGNy/qoCiohiVMNTZOQpJUa+gNuXLrQjYKK+BXixh9w4SeISwU3LrxNC6Ki3mFmzpy5586ZGd21TD8geoxJHZ1d3T3x3kRf/8BgUh4aXvOdqmeIouFYjreha76wTFsUAzOwxIbrCa2iW2JdLy8099drwvNNx14N6q7Yrmi7tlkyDS1gSpVloYb7augJ33VsXzQaqjxFaYpi4idQ2mAqP1m4fT/KZAuOfIUt7MCBgSoqELARMLagwee2CQUEl7lthMx5jMxoX6CBBGurnCU4Q2O2zOMurzbbrM3rZk0/Uht8isXdY+UEZuiBrumF7umGnuj911phVKPppc6z3tIKV00ejq68/auq8Bxg71P1p+cAJWQjryZ7dyOmeQujpa8dHL+s5JZnwhSd0zP7P6NHuuMb2LVX42JJLJ8gwR+gfH/un2Atk1YorSzxT+TQijjGMIlZfu955LGIAop8bg2nuMBl7E0al6alVCtVirU1I/gS0twHHNiUnA==</latexit><latexit sha1_base64="LgUEOfvEZlucjr1L0ucsf2dejUs=">AAACdXichVHLSsNAFD2Nr1ofjboRRBAfxVW96cbSVcGNy/qoCiohiVMNTZOQpJUa+gNuXLrQjYKK+BXixh9w4SeISwU3LrxNC6Ki3mFmzpy5586ZGd21TD8geoxJHZ1d3T3x3kRf/8BgUh4aXvOdqmeIouFYjreha76wTFsUAzOwxIbrCa2iW2JdLy8099drwvNNx14N6q7Yrmi7tlkyDS1gSpVloYb7augJ33VsXzQaqjxFaYpi4idQ2mAqP1m4fT/KZAuOfIUt7MCBgSoqELARMLagwee2CQUEl7lthMx5jMxoX6CBBGurnCU4Q2O2zOMurzbbrM3rZk0/Uht8isXdY+UEZuiBrumF7umGnuj911phVKPppc6z3tIKV00ejq68/auq8Bxg71P1p+cAJWQjryZ7dyOmeQujpa8dHL+s5JZnwhSd0zP7P6NHuuMb2LVX42JJLJ8gwR+gfH/un2Atk1YorSzxT+TQijjGMIlZfu955LGIAop8bg2nuMBl7E0al6alVCtVirU1I/gS0twHHNiUnA==</latexit><latexit sha1_base64="51hvYFkYkO9rd+MPiBiyAKhiIOw=">AAACdXichVHLSsNAFD2Nr1pfUTeCCMVqcVVv3CiuCm5cWrVaUAlJnGowTUKSVjT0B/wBF7pRqCJ+hht/wIWfIC4rdOPC2zQgKuodZubMmXvunJnRXcv0A6LnhNTV3dPbl+xPDQwODY/Io2NbvlP1DFE0HMvxSrrmC8u0RTEwA0uUXE9oFd0S2/rRSnt/uyY833TszeDEFXsV7cA2y6ahBUypsizU8FgNPeG7ju2Lel2VM5SjKNI/gRKDDOJYc+Rb7GIfDgxUUYGAjYCxBQ0+tx0oILjM7SFkzmNkRvsCdaRYW+UswRkas0c8HvBqJ2ZtXrdr+pHa4FMs7h4r05ilJ7qjJj3SPb3Q+6+1wqhG28sJz3pHK1x15Gxio/WvqsJzgMNP1Z+eA5SxFHk12bsbMe1bGB197fS8ubG8Phtm6Zpe2f8VPdMD38CuvRmNgli/QIo/QPn+3D/B1kJOoZxSoEx+Of6KJCYxjTl+70XksYo1FPncGi7RwE2iJU1JM1K2kyolYs04voQ0/wHhI5E0</latexit>
2.
18
clustering naming
aspect term embedding aspect
embedding
aspect aspect
term
aspect term true aspect labelaspect name
19
2.
20
1.
2.
3.
• Dataset
• Aspect Quality Evaluation
• Coherence score
• User Evaluation
• Aspect Identification
• Effectiveness of Attention Model
4.
Dataset
• LocLDA: LDA
• K-means:
• meansSAS:
• BTM: (twitter ) biterm
21


The wait staff is nice, but they are kind of inattentive
3.
Unsupervised Neural Attention Model for Aspect Extraction
Unsupervised Neural Attention Model for Aspect Extraction
Unsupervised Neural Attention Model for Aspect Extraction
Unsupervised Neural Attention Model for Aspect Extraction
Unsupervised Neural Attention Model for Aspect Extraction
Unsupervised Neural Attention Model for Aspect Extraction
Unsupervised Neural Attention Model for Aspect Extraction
Unsupervised Neural Attention Model for Aspect Extraction
Unsupervised Neural Attention Model for Aspect Extraction
Unsupervised Neural Attention Model for Aspect Extraction
Unsupervised Neural Attention Model for Aspect Extraction
Unsupervised Neural Attention Model for Aspect Extraction
Unsupervised Neural Attention Model for Aspect Extraction

More Related Content

Recently uploaded

BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASEBATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASEOrtus Solutions, Corp
 
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer DataAdobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer DataBradBedford3
 
XpertSolvers: Your Partner in Building Innovative Software Solutions
XpertSolvers: Your Partner in Building Innovative Software SolutionsXpertSolvers: Your Partner in Building Innovative Software Solutions
XpertSolvers: Your Partner in Building Innovative Software SolutionsMehedi Hasan Shohan
 
The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdf
The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdfThe Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdf
The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdfkalichargn70th171
 
chapter--4-software-project-planning.ppt
chapter--4-software-project-planning.pptchapter--4-software-project-planning.ppt
chapter--4-software-project-planning.pptkotipi9215
 
Project Based Learning (A.I).pptx detail explanation
Project Based Learning (A.I).pptx detail explanationProject Based Learning (A.I).pptx detail explanation
Project Based Learning (A.I).pptx detail explanationkaushalgiri8080
 
Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝soniya singh
 
Der Spagat zwischen BIAS und FAIRNESS (2024)
Der Spagat zwischen BIAS und FAIRNESS (2024)Der Spagat zwischen BIAS und FAIRNESS (2024)
Der Spagat zwischen BIAS und FAIRNESS (2024)OPEN KNOWLEDGE GmbH
 
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideBuilding Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideChristina Lin
 
why an Opensea Clone Script might be your perfect match.pdf
why an Opensea Clone Script might be your perfect match.pdfwhy an Opensea Clone Script might be your perfect match.pdf
why an Opensea Clone Script might be your perfect match.pdfjoe51371421
 
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...MyIntelliSource, Inc.
 
Asset Management Software - Infographic
Asset Management Software - InfographicAsset Management Software - Infographic
Asset Management Software - InfographicHr365.us smith
 
Professional Resume Template for Software Developers
Professional Resume Template for Software DevelopersProfessional Resume Template for Software Developers
Professional Resume Template for Software DevelopersVinodh Ram
 
Automate your Kamailio Test Calls - Kamailio World 2024
Automate your Kamailio Test Calls - Kamailio World 2024Automate your Kamailio Test Calls - Kamailio World 2024
Automate your Kamailio Test Calls - Kamailio World 2024Andreas Granig
 
What is Binary Language? Computer Number Systems
What is Binary Language?  Computer Number SystemsWhat is Binary Language?  Computer Number Systems
What is Binary Language? Computer Number SystemsJheuzeDellosa
 
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...stazi3110
 
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...Christina Lin
 
EY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityEY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityNeo4j
 
Cloud Management Software Platforms: OpenStack
Cloud Management Software Platforms: OpenStackCloud Management Software Platforms: OpenStack
Cloud Management Software Platforms: OpenStackVICTOR MAESTRE RAMIREZ
 
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样umasea
 

Recently uploaded (20)

BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASEBATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
 
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer DataAdobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
 
XpertSolvers: Your Partner in Building Innovative Software Solutions
XpertSolvers: Your Partner in Building Innovative Software SolutionsXpertSolvers: Your Partner in Building Innovative Software Solutions
XpertSolvers: Your Partner in Building Innovative Software Solutions
 
The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdf
The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdfThe Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdf
The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdf
 
chapter--4-software-project-planning.ppt
chapter--4-software-project-planning.pptchapter--4-software-project-planning.ppt
chapter--4-software-project-planning.ppt
 
Project Based Learning (A.I).pptx detail explanation
Project Based Learning (A.I).pptx detail explanationProject Based Learning (A.I).pptx detail explanation
Project Based Learning (A.I).pptx detail explanation
 
Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝
 
Der Spagat zwischen BIAS und FAIRNESS (2024)
Der Spagat zwischen BIAS und FAIRNESS (2024)Der Spagat zwischen BIAS und FAIRNESS (2024)
Der Spagat zwischen BIAS und FAIRNESS (2024)
 
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideBuilding Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
 
why an Opensea Clone Script might be your perfect match.pdf
why an Opensea Clone Script might be your perfect match.pdfwhy an Opensea Clone Script might be your perfect match.pdf
why an Opensea Clone Script might be your perfect match.pdf
 
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
 
Asset Management Software - Infographic
Asset Management Software - InfographicAsset Management Software - Infographic
Asset Management Software - Infographic
 
Professional Resume Template for Software Developers
Professional Resume Template for Software DevelopersProfessional Resume Template for Software Developers
Professional Resume Template for Software Developers
 
Automate your Kamailio Test Calls - Kamailio World 2024
Automate your Kamailio Test Calls - Kamailio World 2024Automate your Kamailio Test Calls - Kamailio World 2024
Automate your Kamailio Test Calls - Kamailio World 2024
 
What is Binary Language? Computer Number Systems
What is Binary Language?  Computer Number SystemsWhat is Binary Language?  Computer Number Systems
What is Binary Language? Computer Number Systems
 
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
 
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
 
EY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityEY_Graph Database Powered Sustainability
EY_Graph Database Powered Sustainability
 
Cloud Management Software Platforms: OpenStack
Cloud Management Software Platforms: OpenStackCloud Management Software Platforms: OpenStack
Cloud Management Software Platforms: OpenStack
 
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
 

Featured

How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Applitools
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at WorkGetSmarter
 
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...DevGAMM Conference
 
Barbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationBarbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationErica Santiago
 
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellGood Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellSaba Software
 
Introduction to C Programming Language
Introduction to C Programming LanguageIntroduction to C Programming Language
Introduction to C Programming LanguageSimplilearn
 

Featured (20)

How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
 
ChatGPT webinar slides
ChatGPT webinar slidesChatGPT webinar slides
ChatGPT webinar slides
 
More than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike RoutesMore than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike Routes
 
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
 
Barbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationBarbie - Brand Strategy Presentation
Barbie - Brand Strategy Presentation
 
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellGood Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
 
Introduction to C Programming Language
Introduction to C Programming LanguageIntroduction to C Programming Language
Introduction to C Programming Language
 

Unsupervised Neural Attention Model for Aspect Extraction

  • 1. An Unsupervised Neural Attention Model for Aspect Extraction arXivtimes 2018/08/23 TIS
  • 2. An Unsupervised Neural Attention Model for Aspect Extraction ACL 2017 Ruidan He, Wee Sun Lee, Hwee Tou Ng, and Daniel Dahlmeier • Ruidan He • https://aclanthology.coli.uni-saarland.de/papers/P17-1036/p17-1036 • Code https://github.com/ruidan/Unsupervised-Aspect-Extraction 2
  • 3. 3 • • attention model aspect term • • aspect • aspect • • • • aspect extraction attention • • aspect
  • 5. 5 1. • Aspect Extraction • • • Attention Model 2. 3. 4.
  • 6. aspect extraction — Aspect extraction Aspect : the target of opinion( ) entity 6 • Aspect Extraction 1. The beef was tender and melted in my mouth The beef was tender and melted in my mouth 0.04 0.5 0.1 0.2 0.03 0.2 0.06 0 0.1 Model
  • 8. 8 • 1. aspect term food aspect service aspect term aspect term attention aspect This pie looks delicious but the service is bad attention 0.04 0.2 0.1 0.2 0.03 0 0.2 0 0.1 attention 0.01 0.4 0.04 0.3 0.02 0 0.5 0 0.3
  • 10. • Attention in CV Attention: scoring function attention weights 10 1.
  • 11. 11 encoder layer word hidden state decoder layer attention model hidden state 1. • Attention in NLP Image from https://blog.heuritech.com/2016/01/20/attention-mechanism/ Machine Translation: English to French
  • 12. 12 1. 2. • Attention Model • Autoencoder Part(unsupervised) • Aspect Term Embedding Extraction • Aspect Naming 3. 4.
  • 13. 13 • 1. — aspect term (e.g. “beef”, “pork”, “service”) — aspect term aspect (e.g., cluster “beef ”, “pork”, “pasta” , and “tomato”into aspect “food” ) 2.
  • 15. • : Sentence embedding (weighted sum of word embedding) zs = nX i=1 aiewi (4) <latexit sha1_base64="wJLcO9TTYJd09k5++MBvvL6YjB0=">AAACj3ichVG7SiRBFD2271kfoybCJo3iogbDbREUQRkw0czXqOBo092WWtgv+zGizfyAkZnBRissIqZiqmDiD2xgtumyoQsmBnunZ0BU1FtU1alT99w6VWX6tgwjovs6pb6hsam5pTXzpa29ozPb1b0cenFgiYLl2V6wahqhsKUrCpGMbLHqB8JwTFusmLvTlf2VkghC6blL0YEv1h1j25Vb0jIipvTs8KEeqpNqMYwdPZGTWnkjccuqoUtV6Mm+LstqcS82NtXB0SE92085SkN9C7Qa6M/nL1t/A5jzsmcoYhMeLMRwIOAiYmzDQMhtDRoIPnPrSJgLGMl0X6CMDGtjzhKcYTC7y+M2r9ZqrMvrSs0wVVt8is09YKWKAfpF5/RAd3RBf+jp3VpJWqPi5YBns6oVvt551Lv4+KnK4TnCzrPqQ88RtjCeepXs3U+Zyi2sqr50ePKwOLEwkHyjU/rL/n/QPd3yDdzSP+vnvFj4jgx/gPb6ud+C5ZGcRjltnn9iAtVowVf0YZDfewx5zGAOBT73GFe4xo3SpYwpU0q+mqrU1TQ9eBHK7H+4xZr5</latexit><latexit sha1_base64="TUD0XPL47NJY6uIzcK4QBBbTkjA=">AAACj3icSyrIySwuMTC4ycjEzMLKxs7BycXNw8vHLyAoFFacX1qUnBqanJ+TXxSRlFicmpOZlxpaklmSkxpRUJSamJuUkxqelO0Mkg8vSy0qzszPCympLEiNzU1Mz8tMy0xOLAEKxQtoVcUXK9gqxBSX5sZXZ9oa1sZV59UqJMZnKqTGV5fHZ9YqxBSWJqYoaJhoxgsoG+gZgIECJsMQylB2cNjCeefH5N8B+QLLGWIYUhjyGZIZShlyGVIZ8hhKgOwchkSGYiCMZjBkMGAoAIrFMlQDxYqArEywfCpDLQMXUG8pUFUqUEUiUDQbSKYDedFQ0TwgH2RmMVh3MtCWHCAuAupUYFA1uGqw0uCzwQmD1QYvDf7gNKsabAbILZVAOgmiN7Ugnr9LIvg7QV25QLqEIQOhC6+bSxjSGCzAbs0Eur0ALALyRTJEf1nV9M/BVkGq1WoGiwxeA92/0OCmwWGgD/LKviQvDUwNms3ABYwAQ/TgxmSEGekZGugZBgJjwooBAjgYpBmUGDSA4W3O4MDgwRDAEAq0dwLDNob9DAeYBJnMmeyYHCBKmRiheoQZUACTJwBJqZ17</latexit><latexit sha1_base64="TUD0XPL47NJY6uIzcK4QBBbTkjA=">AAACj3icSyrIySwuMTC4ycjEzMLKxs7BycXNw8vHLyAoFFacX1qUnBqanJ+TXxSRlFicmpOZlxpaklmSkxpRUJSamJuUkxqelO0Mkg8vSy0qzszPCympLEiNzU1Mz8tMy0xOLAEKxQtoVcUXK9gqxBSX5sZXZ9oa1sZV59UqJMZnKqTGV5fHZ9YqxBSWJqYoaJhoxgsoG+gZgIECJsMQylB2cNjCeefH5N8B+QLLGWIYUhjyGZIZShlyGVIZ8hhKgOwchkSGYiCMZjBkMGAoAIrFMlQDxYqArEywfCpDLQMXUG8pUFUqUEUiUDQbSKYDedFQ0TwgH2RmMVh3MtCWHCAuAupUYFA1uGqw0uCzwQmD1QYvDf7gNKsabAbILZVAOgmiN7Ugnr9LIvg7QV25QLqEIQOhC6+bSxjSGCzAbs0Eur0ALALyRTJEf1nV9M/BVkGq1WoGiwxeA92/0OCmwWGgD/LKviQvDUwNms3ABYwAQ/TgxmSEGekZGugZBgJjwooBAjgYpBmUGDSA4W3O4MDgwRDAEAq0dwLDNob9DAeYBJnMmeyYHCBKmRiheoQZUACTJwBJqZ17</latexit><latexit sha1_base64="RrLIrT6FD3nYQvdA1XJCu8DiArc=">AAACj3ichVFNSxtBGH5ca7Wp1sReCr0sDZboIbwrQiSgBLzYm1+JgkmX3XXUIfvlfkR0yR/oyZuHnlooIr332kIv/oEe8hPEo4VeeuibzYJYaX2HmXnmmfd555kZ07dlGBH1hpThRyOPR8ee5J6OTzybzBemGqEXB5aoW57tBdumEQpbuqIeycgW234gDMe0xZbZXu7vb3VEEErP3YyOfdFyjH1X7knLiJjS87Mneqguqs0wdvRELmrdt4nbVQ1dqkJPjnTZVZuHsbGrluZn9HyRypSGeh9oGSgii1Uvf44mduHBQgwHAi4ixjYMhNx2oIHgM9dCwlzASKb7Al3kWBtzluAMg9k2j/u82slYl9f9mmGqtvgUm3vAShXT9IMu6IYu6TNd0e9/1krSGn0vxzybA63w9cl3LzZ+PahyeI5wcKv6r+cIe1hIvUr27qdM/xbWQN85ObvZqK5PJ6/pI12z/w/Uo+98A7fz0/q0JtbfI8cfoP393PdBY66sUVlbo2Ktmn3FGF7iFUr83hXUsIJV1PncU3zBV3xTCkpFWVJqg1RlKNM8x51Q3vwB2FSY3A==</latexit> zs<latexit sha1_base64="hvgbNff5B+9OnNLVU3Kb9zV4P9A=">AAACZnichVG7SgNBFD1ZXzFqEhVRECQYIlbhro1iFbCxzMMYQSXsrpO4ZLO77G4CMfgDgq0prBRERPwKG3/Aws5SsYxgY+HNJiAq6h1m5syZe+6cmVFtQ3c9ooeA1Nc/MDgUHA6NjI6FI9HxiU3XqjmayGuWYTlbquIKQzdF3tM9Q2zZjlCqqiEKamWts1+oC8fVLXPDa9hit6qUTb2ka4rHVO6g6BajcUqSH7GfQO6BeCo6d/MIIG1FL7GDPVjQUEMVAiY8xgYUuNy2IYNgM7eLJnMOI93fFzhEiLU1zhKcoTBb4bHMq+0ea/K6U9P11RqfYnB3WBlDgu7pitp0R9f0TO+/1mr6NTpeGjyrXa2wi5Gjmdzbv6oqzx72P1V/evZQworvVWfvts90bqF19fWDVju3mk00F+icXtj/GT3QLd/ArL9qFxmRPUWIP0D+/tw/weZSUqaknOGfWEU3gpjFPBb5vZeRwjrSyPO5ZRzjBK3AkxSWpqTpbqoU6Gkm8SWk2AeICIzP</latexit><latexit sha1_base64="ZHTzYmNEzaNefnjGlgizFG658BQ=">AAACZnichVHLSsNAFD2N7/poVURBkKIorsqNG8VVwY3LPmwr1FKSONbQNAlJWtDiDwiCK7twpSAi0n8Q3PgDXfQPFJcKblx4mxZERb3DzJw5c8+dMzOqbeiuR9QKSD29ff0Dg0PB4ZHRsVB4fCLjWhVHE2nNMixnW1VcYeimSHu6Z4ht2xFKWTVEVi1ttPezVeG4umVueQe2yJeVoqnv6ZriMZU6LLiF8AJFyY/ITyB3wUIsPNdont414lb4GjvYhQUNFZQhYMJjbECByy0HGQSbuTxqzDmMdH9f4AhB1lY4S3CGwmyJxyKvcl3W5HW7puurNT7F4O6wMoJFatINvdAD3dITvf9aq+bXaHs54FntaIVdCB3PpN7+VZV59rD/qfrTs4c9rPledfZu+0z7FlpHXz2sv6TWk4u1JbqkZ/Z/QS265xuY1VftKiGS5wjyB8jfn/snyKxEZYrKCf6JdXRiELOYxzK/9ypi2EQcaT63iBOcoR54lMakKWm6kyoFuppJfAkp8gESlY7B</latexit><latexit sha1_base64="ZHTzYmNEzaNefnjGlgizFG658BQ=">AAACZnichVHLSsNAFD2N7/poVURBkKIorsqNG8VVwY3LPmwr1FKSONbQNAlJWtDiDwiCK7twpSAi0n8Q3PgDXfQPFJcKblx4mxZERb3DzJw5c8+dMzOqbeiuR9QKSD29ff0Dg0PB4ZHRsVB4fCLjWhVHE2nNMixnW1VcYeimSHu6Z4ht2xFKWTVEVi1ttPezVeG4umVueQe2yJeVoqnv6ZriMZU6LLiF8AJFyY/ITyB3wUIsPNdont414lb4GjvYhQUNFZQhYMJjbECByy0HGQSbuTxqzDmMdH9f4AhB1lY4S3CGwmyJxyKvcl3W5HW7puurNT7F4O6wMoJFatINvdAD3dITvf9aq+bXaHs54FntaIVdCB3PpN7+VZV59rD/qfrTs4c9rPledfZu+0z7FlpHXz2sv6TWk4u1JbqkZ/Z/QS265xuY1VftKiGS5wjyB8jfn/snyKxEZYrKCf6JdXRiELOYxzK/9ypi2EQcaT63iBOcoR54lMakKWm6kyoFuppJfAkp8gESlY7B</latexit><latexit sha1_base64="LyascO/L8hfhwTcWC5hQh+gFxbY=">AAACZnichVHLSsNAFD2Nr1ofrYoouCmWiqty40bpquDGpW3tA1RKEscaTJOQpIW2+AOCW7twpSAifoYbf8BF/0BxqeDGhbdpQLSod5iZM2fuuXNmRrUN3fWIuiFpaHhkdCw8HpmYnJqOxmZmi65VdzRR0CzDcsqq4gpDN0XB0z1DlG1HKDXVECX1eLO3X2oIx9Utc8dr2mK/plRN/VDXFI+pfKviVmIJSpEf8UEgByCBILat2A32cAALGuqoQcCEx9iAApfbLmQQbOb20WbOYaT7+wIniLC2zlmCMxRmj3ms8mo3YE1e92q6vlrjUwzuDivjSNIj3dIrPdAdPdPHr7Xafo2elybPal8r7Er0dDH//q+qxrOHoy/Vn549HGLD96qzd9tnerfQ+vpGq/OaT+eS7RW6ohf2f0lduucbmI037TorcheI8AfIP597EBTXUjKl5CwlMungK8JYwjJW+b3XkcEWtlHgc6s4wzk6oSdpWpqXFvqpUijQzOFbSPFP5teK1A==</latexit> • : i attention score ( )ai<latexit sha1_base64="sfl9+Tt+FAxuCcxtpQufcRHmHg8=">AAACZnichVG7SgNBFD1ZXzE+siqiIEhQFKtw10ZJFbCxVGNUUAm76xiHbHaX3U0gBn9AsDWFlYKIiF9h4w9Y2Fkqlgo2Ft7dBERFvcPMnDlzz50zM4ZrST8guo8pbe0dnV3x7kRPb19/Uh0YXPOdimeKvOlYjrdh6L6wpC3ygQwsseF6Qi8bllg3Sgvh/npVeL507NWg5ortsl605a409YCpnF6QBXWS0hRF6ifQWmAyq45fPwBYctQLbGEHDkxUUIaAjYCxBR0+t01oILjMbaPOnMdIRvsCB0iwtsJZgjN0Zks8Fnm12WJtXoc1/Uht8ikWd4+VKUzRHV3SC93SFT3R+6+16lGN0EuNZ6OpFW4heTiae/tXVeY5wN6n6k/PAXYxH3mV7N2NmPAWZlNf3W+85DIrU/VpOqNn9n9K93TDN7Crr+b5slg5QYI/QPv+3D/B2mxao7S2zD+RQTPiGMMEZvi955DFIpaQ53OLOMIxGrFHpV8ZVkaaqUqspRnCl1BSH0HWjKw=</latexit><latexit sha1_base64="MITNhmmbUWK85o3qgnfBnwoUL+g=">AAACZnichVG7SgNBFD1ZXzG+oiIKggRFsQp3bZRUARvLPEwUVMLuOsbBze6yuwnE4A8IgpUWVgoiIvkHwcYfSOEfKJYKNhbebAKiot5hZs6cuefOmRndMaXnEz2ElI7Oru6ecG+kr39gcCg6PJL37LJriJxhm7a7rmueMKUlcr70TbHuuEIr6aZY0/eWm/trFeF60rZW/aojtkpa0ZI70tB8prJaQRaiMxSnIGI/gdoGM8noVL1xfFtP2dErbGIbNgyUUYKABZ+xCQ0etw2oIDjMbaHGnMtIBvsCB4iwtsxZgjM0Zvd4LPJqo81avG7W9AK1waeY3F1WxjBLDbqmF7qnG3qi919r1YIaTS9VnvWWVjiFocOJ7Nu/qhLPPnY/VX969rGDpcCrZO9OwDRvYbT0lf3Tl2wiM1ubowt6Zv/n9EB3fAOr8mpcpkXmDBH+APX7c/8E+YW4SnE1zT+RQCvCmMQ05vm9F5HEClLI8blFHOEEp6FHZVAZU8ZbqUqorRnFl1BiH8xUjp4=</latexit><latexit sha1_base64="MITNhmmbUWK85o3qgnfBnwoUL+g=">AAACZnichVG7SgNBFD1ZXzG+oiIKggRFsQp3bZRUARvLPEwUVMLuOsbBze6yuwnE4A8IgpUWVgoiIvkHwcYfSOEfKJYKNhbebAKiot5hZs6cuefOmRndMaXnEz2ElI7Oru6ecG+kr39gcCg6PJL37LJriJxhm7a7rmueMKUlcr70TbHuuEIr6aZY0/eWm/trFeF60rZW/aojtkpa0ZI70tB8prJaQRaiMxSnIGI/gdoGM8noVL1xfFtP2dErbGIbNgyUUYKABZ+xCQ0etw2oIDjMbaHGnMtIBvsCB4iwtsxZgjM0Zvd4LPJqo81avG7W9AK1waeY3F1WxjBLDbqmF7qnG3qi919r1YIaTS9VnvWWVjiFocOJ7Nu/qhLPPnY/VX969rGDpcCrZO9OwDRvYbT0lf3Tl2wiM1ubowt6Zv/n9EB3fAOr8mpcpkXmDBH+APX7c/8E+YW4SnE1zT+RQCvCmMQ05vm9F5HEClLI8blFHOEEp6FHZVAZU8ZbqUqorRnFl1BiH8xUjp4=</latexit><latexit sha1_base64="cm2DdYGGl4bckJ1+Vb9VWzXZAIc=">AAACZnichVG7SgNBFD1ZXzE+EhVRsAmGiFW4a6OkCthYxsSooBJ210kc3Owuu5tADP6AYGsKKwUR8TNs/AGL/IFiqWBj4c1mQVTUO8zMmTP33Dkzozum9HyiTkTp6x8YHIoOx0ZGx8bjiYnJTc+uu4YoGbZpu9u65glTWqLkS98U244rtJpuii39cLW7v9UQridta8NvOmKvplUtWZGG5jNV1MqynEhRhoJI/gRqCFIII28nrrGLfdgwUEcNAhZ8xiY0eNx2oILgMLeHFnMuIxnsCxwjxto6ZwnO0Jg95LHKq52QtXjdrekFaoNPMbm7rEwiTQ90Qy90T7f0RO+/1moFNbpemjzrPa1wyvGT2eLbv6oazz4OPlV/evZRwUrgVbJ3J2C6tzB6+sZR+6WYLaRbC3RJz+z/gjp0xzewGq/G1boonCPGH6B+f+6fYHMpo1JGXadULht+RRRzmMciv/cyclhDHiU+t4pTnKEdeVTGlWllppeqRELNFL6EkvwAoKWKsQ==</latexit> ai = exp(di) Pn j=1 exp(dj) (3) <latexit sha1_base64="fuywcypyvFUz2zplcejlvnEx1xU=">AAACn3ichVHLThRBFD20oDCKM+jGxE3rBDKzmdxWEwwJCcEFrMwADo8w2KnuqYGCftmPidCZH+AHWLBRE0OMn2Fi3OnGBZ9gXELCxgV3ejoxQoTb6apT595z61SVFTgqiomOB7Qbg0M3bw2PFG7fGb1bLI3dW478JLRlw/YdP1y1RCQd5clGrGJHrgahFK7lyBVr50Uvv9KRYaR871W8G8gNV2x6qq1sETNllqaEqfRpvdkOhZ025dug0jJVtZs2o8Q10+1po/s69bp6ntmuMnyTiJZeeVo1S2WqURb6ZWDkoIw86n7pCE204MNGAhcSHmLGDgQi/tZhgBAwt4GUuZCRyvISXRRYm3CV5ArB7A6Pm7xaz1mP172eUaa2eReH/5CVOsbpJ32iE/pGn+kX/flvrzTr0fOyy7PV18rALO4/WDq7VuXyHGPrr+pKzzHaeJ55Vew9yJjeKey+vrN3cLI0tTieTtAH+s3+39MxfeETeJ1T++OCXDxEgR/AuHjdl8Hyk5pBNWPhWXlmNn+KYTzEY1T4vicxg3nU0eB93+ErvuOH9kib015q9X6pNpBr7uOf0NbOAfeUn1Y=</latexit><latexit sha1_base64="fuywcypyvFUz2zplcejlvnEx1xU=">AAACn3ichVHLThRBFD20oDCKM+jGxE3rBDKzmdxWEwwJCcEFrMwADo8w2KnuqYGCftmPidCZH+AHWLBRE0OMn2Fi3OnGBZ9gXELCxgV3ejoxQoTb6apT595z61SVFTgqiomOB7Qbg0M3bw2PFG7fGb1bLI3dW478JLRlw/YdP1y1RCQd5clGrGJHrgahFK7lyBVr50Uvv9KRYaR871W8G8gNV2x6qq1sETNllqaEqfRpvdkOhZ025dug0jJVtZs2o8Q10+1po/s69bp6ntmuMnyTiJZeeVo1S2WqURb6ZWDkoIw86n7pCE204MNGAhcSHmLGDgQi/tZhgBAwt4GUuZCRyvISXRRYm3CV5ArB7A6Pm7xaz1mP172eUaa2eReH/5CVOsbpJ32iE/pGn+kX/flvrzTr0fOyy7PV18rALO4/WDq7VuXyHGPrr+pKzzHaeJ55Vew9yJjeKey+vrN3cLI0tTieTtAH+s3+39MxfeETeJ1T++OCXDxEgR/AuHjdl8Hyk5pBNWPhWXlmNn+KYTzEY1T4vicxg3nU0eB93+ErvuOH9kib015q9X6pNpBr7uOf0NbOAfeUn1Y=</latexit><latexit sha1_base64="fuywcypyvFUz2zplcejlvnEx1xU=">AAACn3ichVHLThRBFD20oDCKM+jGxE3rBDKzmdxWEwwJCcEFrMwADo8w2KnuqYGCftmPidCZH+AHWLBRE0OMn2Fi3OnGBZ9gXELCxgV3ejoxQoTb6apT595z61SVFTgqiomOB7Qbg0M3bw2PFG7fGb1bLI3dW478JLRlw/YdP1y1RCQd5clGrGJHrgahFK7lyBVr50Uvv9KRYaR871W8G8gNV2x6qq1sETNllqaEqfRpvdkOhZ025dug0jJVtZs2o8Q10+1po/s69bp6ntmuMnyTiJZeeVo1S2WqURb6ZWDkoIw86n7pCE204MNGAhcSHmLGDgQi/tZhgBAwt4GUuZCRyvISXRRYm3CV5ArB7A6Pm7xaz1mP172eUaa2eReH/5CVOsbpJ32iE/pGn+kX/flvrzTr0fOyy7PV18rALO4/WDq7VuXyHGPrr+pKzzHaeJ55Vew9yJjeKey+vrN3cLI0tTieTtAH+s3+39MxfeETeJ1T++OCXDxEgR/AuHjdl8Hyk5pBNWPhWXlmNn+KYTzEY1T4vicxg3nU0eB93+ErvuOH9kib015q9X6pNpBr7uOf0NbOAfeUn1Y=</latexit><latexit sha1_base64="fuywcypyvFUz2zplcejlvnEx1xU=">AAACn3ichVHLThRBFD20oDCKM+jGxE3rBDKzmdxWEwwJCcEFrMwADo8w2KnuqYGCftmPidCZH+AHWLBRE0OMn2Fi3OnGBZ9gXELCxgV3ejoxQoTb6apT595z61SVFTgqiomOB7Qbg0M3bw2PFG7fGb1bLI3dW478JLRlw/YdP1y1RCQd5clGrGJHrgahFK7lyBVr50Uvv9KRYaR871W8G8gNV2x6qq1sETNllqaEqfRpvdkOhZ025dug0jJVtZs2o8Q10+1po/s69bp6ntmuMnyTiJZeeVo1S2WqURb6ZWDkoIw86n7pCE204MNGAhcSHmLGDgQi/tZhgBAwt4GUuZCRyvISXRRYm3CV5ArB7A6Pm7xaz1mP172eUaa2eReH/5CVOsbpJ32iE/pGn+kX/flvrzTr0fOyy7PV18rALO4/WDq7VuXyHGPrr+pKzzHaeJ55Vew9yJjeKey+vrN3cLI0tTieTtAH+s3+39MxfeETeJ1T++OCXDxEgR/AuHjdl8Hyk5pBNWPhWXlmNn+KYTzEY1T4vicxg3nU0eB93+ErvuOH9kib015q9X6pNpBr7uOf0NbOAfeUn1Y=</latexit> di = eT wi · M · ys (2)<latexit sha1_base64="r2zrnYCLhJ6/weO5BSVQOHEh2iw=">AAAClHichVHPSxtBGH2u1tq0aqpQCl4GRdFL/NaLIgqCFHppiT+igtFldzPawc3udncSSZdAz72XHnpSKCL+AR482kL/gR78E0qPFrx48Msmpaio3zAzb95875s3M07oqVgTnbUZ7R2POh93Pck8fdbd05t93rcSB5XIlQU38IJozbFj6SlfFrTSnlwLI2mXHU+uOjvzjf3VqoxiFfjLuhbKjbK97ast5dqaKSs7XrKUmBXSSnYtVd9Mluui6JYCLcSbf6BmxaL4vmKXxOjEmJUdohylIW4DswWG5gbzxx8B5IPsAYooIYCLCsqQ8KEZe7ARc1uHCULI3AYS5iJGKt2XqCPD2gpnSc6wmd3hcZtX6y3W53WjZpyqXT7F4x6xUmCYftEhndNPOqLfdHlnrSSt0fBS49lpamVo9X56uXTxoKrMs8a7/6p7PWtsYSr1qth7mDKNW7hNffXDl/Ol6cXhZIT26Q/736MzOuUb+NW/7rcFufgVGf4A8+Zz3wYrEzmTcuYC/8Q0mtGFAQxilN97EnN4jTwKfO5nnOA7fhgvjBlj3njVTDXaWpp+XAvj7RUU55vX</latexit><latexit sha1_base64="5rk7zsUmHOMtcGb4j5DC8OQuWbQ=">AAAClHicSyrIySwuMTC4ycjEzMLKxs7BycXNw8vHLyAoFFacX1qUnBqanJ+TXxSRlFicmpOZlxpaklmSkxpRUJSamJuUkxqelO0Mkg8vSy0qzszPCympLEiNzU1Mz8tMy0xOLAEKxQvop8RnKtgqpMZXl8dn1sZVh9QqxCSn5JcoKPjCGJXxxQoxhaWJKQoaRprxAsoGegZgoIDJMIQylB2UArY3mOQeC8gXWM4Qw5DCkM+QzFDKkMuQypDHUAJk5zAkMhQDYTSDIYMBQwFQLJahGihWBGRlguVTGWoZuIB6S4GqUoEqEoGi2UAyHciLhormAfkgM4vBupOBtuQAcRFQpwKDqsFVg5UGnw1OGKw2eGnwB6dZ1WAzQG6pBNJJEL2pBfH8XRLB3wnqygXSJQwZCF143VzCkMZgAXZrJtDtBWARkC+SIfrLqqZ/DrYKUq1WM1hk8Bro/oUGNw0OA32QV/YleWlgatBsBi5gBBiiBzcmI8xIz9BAzzAQGBNWDBDAwSDNoMSgAQxvcwYHBg+GAIZQoL1TGXYzHGE4yiTGZMPkzOQKUcrECNUjzIACmPwAofGdPg==</latexit><latexit sha1_base64="5rk7zsUmHOMtcGb4j5DC8OQuWbQ=">AAAClHicSyrIySwuMTC4ycjEzMLKxs7BycXNw8vHLyAoFFacX1qUnBqanJ+TXxSRlFicmpOZlxpaklmSkxpRUJSamJuUkxqelO0Mkg8vSy0qzszPCympLEiNzU1Mz8tMy0xOLAEKxQvop8RnKtgqpMZXl8dn1sZVh9QqxCSn5JcoKPjCGJXxxQoxhaWJKQoaRprxAsoGegZgoIDJMIQylB2UArY3mOQeC8gXWM4Qw5DCkM+QzFDKkMuQypDHUAJk5zAkMhQDYTSDIYMBQwFQLJahGihWBGRlguVTGWoZuIB6S4GqUoEqEoGi2UAyHciLhormAfkgM4vBupOBtuQAcRFQpwKDqsFVg5UGnw1OGKw2eGnwB6dZ1WAzQG6pBNJJEL2pBfH8XRLB3wnqygXSJQwZCF143VzCkMZgAXZrJtDtBWARkC+SIfrLqqZ/DrYKUq1WM1hk8Bro/oUGNw0OA32QV/YleWlgatBsBi5gBBiiBzcmI8xIz9BAzzAQGBNWDBDAwSDNoMSgAQxvcwYHBg+GAIZQoL1TGXYzHGE4yiTGZMPkzOQKUcrECNUjzIACmPwAofGdPg==</latexit><latexit sha1_base64="gxPVx+cyH8AU6abpYLABUy0EzZE=">AAAClHichVHLShxBFD12TGLGJE4iBMFN4WAwm8ltNwliQBDBjeJrVHBM091TmsKe7ra7ZsLYzA+4FxeuFCQEP8GlCv6ACz9BsjTgxkXu9HQIiWhuUVWnTt1z61SVE3oq1kSXHcajzsdPnnY9y3U/f/GyJ//q9WIc1CJXltzAC6Jlx46lp3xZ0kp7cjmMpF11PLnkbIy39pfqMopV4C/oRihXq/a6r9aUa2umrPz7iqXEJyGt5Kulmp+ThaYou5VACzH1GzSsWJQ3a3ZFDA2/s/IFKlIa4i4wM1BAFjNB/hvKqCCAixqqkPChGXuwEXNbgQlCyNwqEuYiRirdl2gix9oaZ0nOsJnd4HGdVysZ6/O6VTNO1S6f4nGPWCkwSBf0na7pnI7oim7vrZWkNVpeGjw7ba0MrZ7tvvmb/6qqPGt8+aN60LPGGj6mXhV7D1OmdQu3ra9v7V7Pj8wNJm/pgH6w/326pBO+gV//6R7Oyrk95PgDzH+f+y5YHC6aVDRnqTA2kn1FF/oxgCF+7w8YwyRmUOJzd3CMU5wZb4xRY9yYaKcaHZmmF3+FMf0Lk/qZ7g==</latexit> : Attention Model • : i • : Sentence embedding (word embedding ewi<latexit sha1_base64="x4l3zHzubRCvfB0YWbX/UAg3yw0=">AAACanichVE9SwNBFJyc3/ErRhA1jRgVq/DORrEK2FhqYoygEu7OVZdc7o67S0RDShs7K8FUCiLiz7DxD1jY2Yp2EWwsfLkERIP6lt2dnX3zdnZXd0zp+USPIaWtvaOzq7sn3NvXPzAYGYque3bRNUTGsE3b3dA1T5jSEhlf+qbYcFyhFXRTZPX8Un0/WxKuJ21rzT90xHZB27PkrjQ0n6msyJUPcrKSi8QpQUFMtAK1CeLJ8eORJwArduQaW9iBDQNFFCBgwWdsQoPHbRMqCA5z2ygz5zKSwb5ABWHWFjlLcIbGbJ7HPV5tNlmL1/WaXqA2+BSTu8vKCUzTA91Qje7plp7p49da5aBG3cshz3pDK5zc4Mlo+v1fVYFnH/tfqj89+9jFQuBVsncnYOq3MBr60tFZLb2Ymi7P0CW9sP8LeqQ7voFVejOuVkWqijB/gPrzuVvB+lxCpYS6yj+xiEZ0I4ZJzPJ7zyOJZawgE7g7xTmqoVclqowpsUaqEmpqhvEtlKlPPhuOgA==</latexit><latexit sha1_base64="3sS7tnQeSlXgw8YyNMmYjFK6rcs=">AAACanichVG7SgNBFD1ZXzG+ooL4aIIvrMJdG8UqYGOZRGOEKGF3HXVws7vsbiIxpLSxsxJMpSAifoaNPyAofoFop2Bj4c0mICrqHWbmzJl77pyZ0R1Tej7RfUhpaW1r7wh3Rrq6e3r7ov0Dq55ddA2RMWzTdtd0zROmtETGl74p1hxXaAXdFFl9d7G+ny0J15O2teKXHbFR0LYtuSUNzWcqK/KVvbys5qMTFKcgYj+B2gQTidGDoYeeO0ra0QusYxM2DBRRgIAFn7EJDR63HFQQHOY2UGHOZSSDfYEqIqwtcpbgDI3ZXR63eZVrshav6zW9QG3wKSZ3l5UxTNEtXdIL3dAVPdL7r7UqQY26lzLPekMrnHzf4fDy27+qAs8+dj5Vf3r2sYX5wKtk707A1G9hNPSl/eOX5YX0VGWazuiJ/Z/SPV3zDazSq3GeEukaIvwB6vfn/glWZ+MqxdUU/8QCGhHGGMYxw+89hwSWkEQmcHeEE9RCz8qAMqKMNVKVUFMziC+hTH4ALSyPkA==</latexit><latexit sha1_base64="3sS7tnQeSlXgw8YyNMmYjFK6rcs=">AAACanichVG7SgNBFD1ZXzG+ooL4aIIvrMJdG8UqYGOZRGOEKGF3HXVws7vsbiIxpLSxsxJMpSAifoaNPyAofoFop2Bj4c0mICrqHWbmzJl77pyZ0R1Tej7RfUhpaW1r7wh3Rrq6e3r7ov0Dq55ddA2RMWzTdtd0zROmtETGl74p1hxXaAXdFFl9d7G+ny0J15O2teKXHbFR0LYtuSUNzWcqK/KVvbys5qMTFKcgYj+B2gQTidGDoYeeO0ra0QusYxM2DBRRgIAFn7EJDR63HFQQHOY2UGHOZSSDfYEqIqwtcpbgDI3ZXR63eZVrshav6zW9QG3wKSZ3l5UxTNEtXdIL3dAVPdL7r7UqQY26lzLPekMrnHzf4fDy27+qAs8+dj5Vf3r2sYX5wKtk707A1G9hNPSl/eOX5YX0VGWazuiJ/Z/SPV3zDazSq3GeEukaIvwB6vfn/glWZ+MqxdUU/8QCGhHGGMYxw+89hwSWkEQmcHeEE9RCz8qAMqKMNVKVUFMziC+hTH4ALSyPkA==</latexit><latexit sha1_base64="q/67vEdv5/qfCynVHvOkFP3jeew=">AAACanichVHLSsNAFD2N7/po1Y3SjVgVV+XGjdJVwY1LX7VCLSGJow6mSUjSSi3+gDtXgq4URMTPcOMPuOgniO4U3LjwJg2IinqHmTlz5p47Z2YM15J+QNRKKB2dXd09vX3J/oHBoVR6eGTDd2qeKYqmYznepqH7wpK2KAYysMSm6wm9aliiZOwvhvuluvB86djrQcMVlaq+a8sdaeoBUyWhNQ80eaSls5SjKCZ+AjUGWcSx7KSvsYVtODBRQxUCNgLGFnT43MpQQXCZq6DJnMdIRvsCR0iytsZZgjN0Zvd53OVVOWZtXoc1/Uht8ikWd4+VE5imB7qhF7qnW3qk919rNaMaoZcGz0ZbK1wtdTy29vavqspzgL1P1Z+eA+xgIfIq2bsbMeEtzLa+fnj6spZfnW7O0CU9sf8LatEd38Cuv5pXK2L1HEn+APX7c/8EG3M5lXLqCmUL+fgrepHBJGb5vedRwBKWUYzcneAM54lnZUQZVzLtVCURa0bxJZSpD+INjKs=</latexit> ys<latexit sha1_base64="AoogSymyxANrC1i1gQiSe0cBUuY=">AAACZnichVG7SgNBFD3Z+IhRY3yhYBMMEatw10ZJFbCxzMNEQSXsrpO4uNlddjeBGARrwdYUVgoi4j/Y2PgDFvkDxVLBxsKbTUBU1DvMzJkz99w5M6Pahu56RO2AFOzrHxgMDYWHR0YjY9HxiaJr1RxNFDTLsJxNVXGFoZui4OmeITZtRyhV1RAb6v5qZ3+jLhxXt8x1r2GLnapSMfWyrikeU/lGyS1F45QkP2I/gdwD8fTUbfAIQMaKXmEbu7CgoYYqBEx4jA0ocLltQQbBZm4HTeYcRrq/L3CIMGtrnCU4Q2F2n8cKr7Z6rMnrTk3XV2t8isHdYWUMCXqga3qhe7qhJ3r/tVbTr9Hx0uBZ7WqFXRo7ns2//auq8uxh71P1p2cPZaz4XnX2bvtM5xZaV18/aL3kU7lEc4Eu6Jn9n1Ob7vgGZv1Vu8yK3BnC/AHy9+f+CYpLSZmScpZ/IoVuhDCHeSzyey8jjTVkUOBzKzjBKVqBRykiTUsz3VQp0NNM4ktIsQ/MIYxo</latexit><latexit sha1_base64="5tYp+UfNh6PcG0m4QoFgXkqbYBA=">AAACZnichVG7SgNBFD3Z+IyPxBcKNkGJWIW7NopVwMbSJCYRYgi76yQu2ewuu5tADP6AYKuFlYKI+A82NmksLfIHiqWCjYU3m4CoqHeYmTNn7rlzZka1Dd31iNoBKdjXPzA4NBwaGR0bD0cmJrOuVXM0kdEsw3J2VMUVhm6KjKd7htixHaFUVUPk1MpGZz9XF46rW+a217BFoaqUTb2ka4rHVLpRdIuRRYqTH9GfQO6BxcT0bdC+b9W2rMgVdrEHCxpqqELAhMfYgAKXWx4yCDZzBTSZcxjp/r7AIUKsrXGW4AyF2QqPZV7le6zJ605N11drfIrB3WFlFDF6oGt6oRbd0BO9/1qr6dfoeGnwrHa1wi6Gj+bSb/+qqjx72P9U/enZQwlrvledvds+07mF1tXXD05f0uupWHOJLuiZ/Z9Tm+74Bmb9VbtMitQZQvwB8vfn/gmyK3GZ4nKSf2Id3RjCPBawzO+9igQ2sYUMn1vGMU5wGniUxqUZababKgV6mil8CSn6AWWpjmI=</latexit><latexit sha1_base64="5tYp+UfNh6PcG0m4QoFgXkqbYBA=">AAACZnichVG7SgNBFD3Z+IyPxBcKNkGJWIW7NopVwMbSJCYRYgi76yQu2ewuu5tADP6AYKuFlYKI+A82NmksLfIHiqWCjYU3m4CoqHeYmTNn7rlzZka1Dd31iNoBKdjXPzA4NBwaGR0bD0cmJrOuVXM0kdEsw3J2VMUVhm6KjKd7htixHaFUVUPk1MpGZz9XF46rW+a217BFoaqUTb2ka4rHVLpRdIuRRYqTH9GfQO6BxcT0bdC+b9W2rMgVdrEHCxpqqELAhMfYgAKXWx4yCDZzBTSZcxjp/r7AIUKsrXGW4AyF2QqPZV7le6zJ605N11drfIrB3WFlFDF6oGt6oRbd0BO9/1qr6dfoeGnwrHa1wi6Gj+bSb/+qqjx72P9U/enZQwlrvledvds+07mF1tXXD05f0uupWHOJLuiZ/Z9Tm+74Bmb9VbtMitQZQvwB8vfn/gmyK3GZ4nKSf2Id3RjCPBawzO+9igQ2sYUMn1vGMU5wGniUxqUZababKgV6mil8CSn6AWWpjmI=</latexit><latexit sha1_base64="Ud69PkePSfMi5E39aaMWb5CULcM=">AAACZnichVHLSsNAFD2Nr1pfVREFN8VScVVu3CiuCm5c9mFbQUtJ4rQG0yQkaaEWf0BwaxeuFETEz3DjD7joHyguK7hx4W0aEC3qHWbmzJl77pyZUW1Ddz2iTkgaGh4ZHQuPRyYmp6ZnorNzBdeqO5rIa5ZhOXuq4gpDN0Xe0z1D7NmOUGqqIYrq8XZvv9gQjqtb5q7XtEWpplRNvaJrisdUrll2y9E4JcmP2CCQAxBHEGkreosDHMKChjpqEDDhMTagwOW2DxkEm7kSWsw5jHR/X+AUEdbWOUtwhsLsMY9VXu0HrMnrXk3XV2t8isHdYWUMCXqiO+rSI93TC338Wqvl1+h5afKs9rXCLs+cLeXe/1XVePZw9KX607OHCjZ9rzp7t32mdwutr2+ctLu5rWyitUrX9Mr+r6hDD3wDs/Gm3WRE9hIR/gD553MPgsJ6UqaknKF4aiv4ijCWsYI1fu8NpLCDNPJ8bhXnuEA79CxNSwvSYj9VCgWaeXwLKfYJ5NWK0w==</latexit> ys = 1 n nX i=1 ewi (1) <latexit sha1_base64="1Cal3UOTlXZJ8XrIv6Y0otp8wzs=">AAACl3ichVE9SxxRFD2OH1k3RldtFJshYtBmuWMTERYXhGDpalYF1wwz41t9OF/Ox8o67B/wDxiwUghBbK1tLOIfSGGXNqQ0kMbCO7MLIYrxDvPeuefdc99575m+LcOI6LZL6e7p7XuV68+/HngzOFQYHlkLvTiwRNXybC/YMI1Q2NIV1UhGttjwA2E4pi3Wzb3FdH29IYJQeu7HqOmLLcfYcWVdWkbElF6YbeqhWlJr9cCwEq2VuC21FsaOnsiS1vqUpkJPDnTJ9H5sbKvT2oxemKQiZaE+BVoHTJbLl/0/ACx7ha+oYRseLMRwIOAiYmzDQMjfJjQQfOa2kDAXMJLZukALedbGXCW4wmB2j8cdzjY7rMt52jPM1BbvYvMfsFLFFH2nc7qjG7qgn3T/bK8k65F6afJstrXC14eOxlb/vKhyeI6w+1f1X88R6pjLvEr27mdMegqrrW8cHt+tzq9MJe/ojH6x/1O6pWs+gdv4bX2piJUT5PkBtMfX/RSszRY1KmoVfol5tCOHCbzFNN/3e5SxhGVUed/PuMI33CjjyoLyQVlqlypdHc0o/gml8gAqFZ6j</latexit><latexit sha1_base64="sk6hrNyOXbnpwTVNWbTaqdBn9eY=">AAACl3ichVFNSxtRFD0Zbavph9FuWtwMFcVuwh03iiAGCuLSGBMFo8PM+KIP56vzEUmH/IFuXSh0pVBK6bZrNy7MH+hC6B8oXSoo2EXvTAKlFe0d5r1zz7vnvvPeM31bhhHReU7p63/w8NHAYP7xk6fPhgrDI7XQiwNLVC3P9oI10wiFLV1RjWRkizU/EIZj2mLV3H2Trq82RRBKz12JWr7YcIxtVzakZURM6YWplh6qc2q9ERhWorUTt63Ww9jREzmntTfTVOjJni6ZfhsbW+qk9lovjFGRslBvA60Hxkqlr4Pfr/dvlrzCJ9SxBQ8WYjgQcBExtmEg5G8dGgg+cxtImAsYyWxdoI08a2OuElxhMLvL4zZn6z3W5TztGWZqi3ex+Q9YqWKcvtFnuqAOfaEf9OvOXknWI/XS4tnsaoWvD71/Ubn6r8rhOcLOH9W9niM0MJN5lezdz5j0FFZX33x3cFGZXR5PJuiYfrL/IzqnUz6B27y0PpbF8gfk+QG0f6/7NqhNFTUqamV+iVl0YwCjeIVJvu9plLCIJVR530Oc4Awd5aUyrywoi91SJdfTPMdfoZR/A7rqoSU=</latexit><latexit sha1_base64="sk6hrNyOXbnpwTVNWbTaqdBn9eY=">AAACl3ichVFNSxtRFD0Zbavph9FuWtwMFcVuwh03iiAGCuLSGBMFo8PM+KIP56vzEUmH/IFuXSh0pVBK6bZrNy7MH+hC6B8oXSoo2EXvTAKlFe0d5r1zz7vnvvPeM31bhhHReU7p63/w8NHAYP7xk6fPhgrDI7XQiwNLVC3P9oI10wiFLV1RjWRkizU/EIZj2mLV3H2Trq82RRBKz12JWr7YcIxtVzakZURM6YWplh6qc2q9ERhWorUTt63Ww9jREzmntTfTVOjJni6ZfhsbW+qk9lovjFGRslBvA60Hxkqlr4Pfr/dvlrzCJ9SxBQ8WYjgQcBExtmEg5G8dGgg+cxtImAsYyWxdoI08a2OuElxhMLvL4zZn6z3W5TztGWZqi3ex+Q9YqWKcvtFnuqAOfaEf9OvOXknWI/XS4tnsaoWvD71/Ubn6r8rhOcLOH9W9niM0MJN5lezdz5j0FFZX33x3cFGZXR5PJuiYfrL/IzqnUz6B27y0PpbF8gfk+QG0f6/7NqhNFTUqamV+iVl0YwCjeIVJvu9plLCIJVR530Oc4Awd5aUyrywoi91SJdfTPMdfoZR/A7rqoSU=</latexit><latexit sha1_base64="KQ7nMOuXb3dxBHOvfkjfYOvEBns=">AAACl3ichVHLShxBFD22muiocdSN4qZxUHQz3HYTEUQhEFw6mlHBMU13W2MK+5V+jEya+QF/IIGsEhAR/8GNC/2BLPwEcangxoW3exrEiHqbrjr31D23TlWZvi3DiOiyQ+ns6n73vqe30Nc/8GGwODS8HnpxYImq5dlesGkaobClK6qRjGyx6QfCcExbbJh7n9L1jYYIQum5X6KmL7YdY9eVdWkZEVN6cbaph+qCWqsHhpVorcRtqbUwdvRELmitr2kq9GRfl0x/j40ddVqb0YslKlMW6nOg5aCEPFa84hFq2IEHCzEcCLiIGNswEPK3BQ0En7ltJMwFjGS2LtBCgbUxVwmuMJjd43GXs62cdTlPe4aZ2uJdbP4DVqqYpH90TDd0QSd0Rfcv9kqyHqmXJs9mWyt8ffBgdO3uTZXDc4Rvj6pXPUeoYy7zKtm7nzHpKay2vvHj583a/OpkMkV/6Zr9/6FLOuMTuI1b67AiVn+jwA+g/X/dz8H6bFmjslah0tJ8/hQ9GMcEpvm+P2IJy1hBlff9hVOc40IZUxaVz8pyu1TpyDUjeBJK5QFJpJyG</latexit> 2. • : i attention score( ) • : di<latexit sha1_base64="HDo6EPc0yTcKCeuU2EkeD0II/qY=">AAACZ3ichVG7SgNBFD1ZXzE+EhUkIEhUFKtw10ZJFbCx1MREQSXsrqMO2ewuu5tADP6Aha2ClYKIiF9h4w9YpLMVywg2Ft7dBERFvcPMnDlzz50zM7pjSs8nakaUru6e3r5of2xgcGg4nhgZLXp21TVEwbBN293UNU+Y0hIFX/qm2HRcoVV0U2zo5eVgf6MmXE/a1rpfd8RORdu35J40ND+gdksyVUrMUJrCSP0EagfMZBOTd08AVu3ENbaxCxsGqqhAwILP2IQGj9sWVBAc5nbQYM5lJMN9gSPEWFvlLMEZGrNlHvd5tdVhLV4HNb1QbfApJneXlSnM0iPdUIse6Jae6f3XWo2wRuClzrPe1gqnFD9O5t/+VVV49nHwqfrTs489LIVeJXt3Qia4hdHW1w5PW/lMbrYxR5f0wv4vqEn3fAOr9mpcrYncOWL8Aer35/4JigtpldLqGv9EBu2IYgLTmOf3XkQWK1hFgc89wAlOcRZ5VuLKuJJspyqRjmYMX0KZ+gCubIzZ</latexit><latexit sha1_base64="VHetlw7Ew+UOXDHZUtuC1SLcmB0=">AAACZ3ichVHLSsNAFD2N7/poVRBBkKoorsqNG8VVwY1L21ot1FKSOOpgmoQkLWjxB1yIOwVXCiIi/QfBjT/gop8gLhXcuPAmLYgW9Q4zc+bMPXfOzOiOKT2fqBFROjq7unt6+6L9A4NDsfjwyIZnV1xD5AzbtN28rnnClJbI+dI3Rd5xhVbWTbGp768E+5tV4XrSttb9A0cUy9quJXekofkBtV2SiVJ8hpIURqIdqC0wk4pP1p9O7+trdvwGW9iGDQMVlCFgwWdsQoPHrQAVBIe5ImrMuYxkuC9whChrK5wlOENjdp/HXV4VWqzF66CmF6oNPsXk7rIygVl6olt6pUe6o2f6+LVWLawReDngWW9qhVOKHY9n3/9VlXn2sfel+tOzjx0shV4le3dCJriF0dRXD89es8uZ2docXdEL+7+kBj3wDazqm3GdFpkLRPkD1J/P3Q42FpIqJdU0/8QymtGLCUxjnt97ESmsYg05PncPJzjDeeRZiSljyngzVYm0NKP4FsrUJzj5jss=</latexit><latexit sha1_base64="VHetlw7Ew+UOXDHZUtuC1SLcmB0=">AAACZ3ichVHLSsNAFD2N7/poVRBBkKoorsqNG8VVwY1L21ot1FKSOOpgmoQkLWjxB1yIOwVXCiIi/QfBjT/gop8gLhXcuPAmLYgW9Q4zc+bMPXfOzOiOKT2fqBFROjq7unt6+6L9A4NDsfjwyIZnV1xD5AzbtN28rnnClJbI+dI3Rd5xhVbWTbGp768E+5tV4XrSttb9A0cUy9quJXekofkBtV2SiVJ8hpIURqIdqC0wk4pP1p9O7+trdvwGW9iGDQMVlCFgwWdsQoPHrQAVBIe5ImrMuYxkuC9whChrK5wlOENjdp/HXV4VWqzF66CmF6oNPsXk7rIygVl6olt6pUe6o2f6+LVWLawReDngWW9qhVOKHY9n3/9VlXn2sfel+tOzjx0shV4le3dCJriF0dRXD89es8uZ2docXdEL+7+kBj3wDazqm3GdFpkLRPkD1J/P3Q42FpIqJdU0/8QymtGLCUxjnt97ESmsYg05PncPJzjDeeRZiSljyngzVYm0NKP4FsrUJzj5jss=</latexit><latexit sha1_base64="3KKJsiy/4yy6Whk0cRXct0CXTYo=">AAACZ3ichVHLSsNAFD2Nr1ofrQpScFMtFVflxo3iSnDjslWrgpaSpKMOpklI0kIt/oALtxVcKYiIn+HGH3DRTxCXCm5ceJMGRIt6h5k5c+aeO2dmdMeUnk/UiSl9/QODQ/HhxMjo2HgyNTG57dl11xAlwzZtd1fXPGFKS5R86Zti13GFVtNNsaMfrwX7Ow3hetK2tvymI8o17dCSB9LQ/ICqVmSmkspSnsLI9AI1AllEUbBTt9hHFTYM1FGDgAWfsQkNHrc9qCA4zJXRYs5lJMN9gVMkWFvnLMEZGrPHPB7yai9iLV4HNb1QbfApJneXlRnk6Inu6JUe6Z6e6ePXWq2wRuClybPe1QqnkjxLb77/q6rx7OPoS/WnZx8HWA69SvbuhExwC6Orb5y0XzdXNnKtebqmF/Z/RR164BtYjTfjpig2LpHgD1B/Pncv2F7Mq5RXi5RdXYm+Io4ZzGGB33sJq1hHASU+9wjnaOMi9qwklWkl3U1VYpFmCt9Cmf0EDUqK3g==</latexit> M<latexit sha1_base64="W8S+ufNyAiI/KQ/9yIwkIwmJtm0=">AAACZHichVG7SgNBFD1ZXzFGjYogCBIMilW4a6PYGLCxEUxiNBBD2F0ncXFf7G4CGvwBbRULKxUR8ScEG39AxB8QxFLBxsKbTUBU1DvMzJkz99w5M6M6hu75RA8hqa29o7Mr3B3pifb29ccGBlc9u+pqIqfZhu3mVcUThm6JnK/7hsg7rlBM1RBr6tZCY3+tJlxPt60Vf9sRRVOpWHpZ1xSfqfRSKZagJAUR/wnkFkjMX5/dg2PZjl1gHRuwoaEKEwIWfMYGFHjcCpBBcJgros6cy0gP9gV2EWFtlbMEZyjMbvFY4VWhxVq8btT0ArXGpxjcXVbGMUF3dEkvdEtX9ETvv9aqBzUaXrZ5Vpta4ZT690ayb/+qTJ59bH6q/vTso4zZwKvO3p2AadxCa+prO0cv2bnMRH2STumZ/Z/QA93wDazaq3aeFpljRPgD5O/P/ROsTidlSsppSqTm0IwwRjGOKX7vGaSwiGXk+FyBfRzgMPQoRaUhabiZKoVamiF8CWnsAyd8jDo=</latexit><latexit sha1_base64="392Oq/iF+3Uj8gswZiH7+mGaYfo=">AAACZHichVHLSsNAFD2N71q1WgRBkGJRXJUbN4ogCm7cCH3YKtRSkjhqME1Ckha0+AO6VVy48oWIPyG48QdE+gOCuKzgxoW3aUFU1DvMzJkz99w5M6Pahu56RNWA1NLa1t7R2RXsDvX09oX7B7KuVXI0kdEsw3JWVcUVhm6KjKd7hli1HaEUVUOsqNsL9f2VsnBc3TKXvR1b5IvKpqlv6JriMZVcKoRjFCc/oj+B3ASxudvzx+CsfZGwwldYwzosaCihCAETHmMDClxuOcgg2MzlUWHOYaT7+wJ7CLK2xFmCMxRmt3nc5FWuyZq8rtd0fbXGpxjcHVZGMUYPdE01uqcbeqb3X2tV/Bp1Lzs8qw2tsAt9+0Ppt39VRZ49bH2q/vTsYQPTvledvds+U7+F1tCXd49r6ZnUWGWczuiF/Z9Sle74Bmb5VbtMitQJgvwB8vfn/gmyk3GZ4nKSYvMzaEQnhjGKCX7vKcxjEQlk+FyBAxziKPAkhaSINNhIlQJNTQRfQhr5AJ7tjZU=</latexit><latexit sha1_base64="392Oq/iF+3Uj8gswZiH7+mGaYfo=">AAACZHichVHLSsNAFD2N71q1WgRBkGJRXJUbN4ogCm7cCH3YKtRSkjhqME1Ckha0+AO6VVy48oWIPyG48QdE+gOCuKzgxoW3aUFU1DvMzJkz99w5M6Pahu56RNWA1NLa1t7R2RXsDvX09oX7B7KuVXI0kdEsw3JWVcUVhm6KjKd7hli1HaEUVUOsqNsL9f2VsnBc3TKXvR1b5IvKpqlv6JriMZVcKoRjFCc/oj+B3ASxudvzx+CsfZGwwldYwzosaCihCAETHmMDClxuOcgg2MzlUWHOYaT7+wJ7CLK2xFmCMxRmt3nc5FWuyZq8rtd0fbXGpxjcHVZGMUYPdE01uqcbeqb3X2tV/Bp1Lzs8qw2tsAt9+0Ppt39VRZ49bH2q/vTsYQPTvledvds+U7+F1tCXd49r6ZnUWGWczuiF/Z9Sle74Bmb5VbtMitQJgvwB8vfn/gmyk3GZ4nKSYvMzaEQnhjGKCX7vKcxjEQlk+FyBAxziKPAkhaSINNhIlQJNTQRfQhr5AJ7tjZU=</latexit><latexit sha1_base64="lESrIxjkeVnoByuWQ/p081PsFVc=">AAACZHichVG7SgNBFD1Z3/EVDYIgiBgUq3DXRrESbGyEPEwUVGR3ncTFfbE7CWjwB7RVLKwURMTPsPEHLPIDglgq2Fh4d7MgKuodZubMmXvunJnRPcsMJFEzobS1d3R2dfcke/v6BwZTQ8PlwK35higZruX667oWCMt0REma0hLrni80W7fEmr63FO6v1YUfmK6zKvc9sWVrVcesmIYmmcqvbKcylKUoJn4CNQYZxJFzU9fYxA5cGKjBhoADydiChoDbBlQQPOa20GDOZ2RG+wKHSLK2xlmCMzRm93is8mojZh1ehzWDSG3wKRZ3n5UTmKIHuqEXuqdbeqL3X2s1ohqhl32e9ZZWeNuDR6PFt39VNs8Su5+qPz1LVDAfeTXZuxcx4S2Mlr5+cPZSXChMNabpkp7Z/wU16Y5v4NRfjau8KJwjyR+gfn/un6A8m1Upq+Yps7gQf0U3xjCJGX7vOSxiGTmU+FyBY5zgNPGo9ClpZaSVqiRiTRpfQhn/AJykicE=</latexit> E<latexit sha1_base64="aL00XsgYV9g18QA3LhnuBxpM3z8=">AAACZHichVG7SgNBFD1ZXzFGjYogCBIMilW4a6PYGBDB0iRGAzGE3XUSF/fF7iagwR/QVrGwUhERf0Kw8QdE/AFBLBVsLLzZBERFvcPMnDlzz50zM6pj6J5P9BCS2to7OrvC3ZGeaG9ff2xgcNWzq64mcppt2G5eVTxh6JbI+bpviLzjCsVUDbGmbi009tdqwvV021rxtx1RNJWKpZd1TfGZSi+WYglKUhDxn0BugcT89dk9OJbt2AXWsQEbGqowIWDBZ2xAgcetABkEh7ki6sy5jPRgX2AXEdZWOUtwhsLsFo8VXhVarMXrRk0vUGt8isHdZWUcE3RHl/RCt3RFT/T+a616UKPhZZtntakVTql/byT79q/K5NnH5qfqT88+ypgNvOrs3QmYxi20pr62c/SSnctM1CfplJ7Z/wk90A3fwKq9audpkTlGhD9A/v7cP8HqdFKmpJymRGoOzQhjFOOY4veeQQpLWEaOzxXYxwEOQ49SVBqShpupUqilGcKXkMY+ABd8jDI=</latexit><latexit sha1_base64="IJ2Og9vuKJ2sgquaItWHO2yxC3Y=">AAACZHichVHLSsNAFD2N71q1WgRBkGJRXJUbN4ogCiK47MNWoZaSxFGDaRKStKDFH9Ct4sKVL0T8CcGNPyDSHxDEZQU3LrxNC6Ki3mFmzpy5586ZGdU2dNcjqgaklta29o7OrmB3qKe3L9w/kHWtkqOJjGYZlrOqKq4wdFNkPN0zxKrtCKWoGmJF3V6o76+UhePqlrns7dgiX1Q2TX1D1xSPqeRiIRyjOPkR/QnkJojN3Z4/Bmfti4QVvsIa1mFBQwlFCJjwGBtQ4HLLQQbBZi6PCnMOI93fF9hDkLUlzhKcoTC7zeMmr3JN1uR1vabrqzU+xeDusDKKMXqga6rRPd3QM73/Wqvi16h72eFZbWiFXejbH0q//asq8uxh61P1p2cPG5j2vers3faZ+i20hr68e1xLz6TGKuN0Ri/s/5SqdMc3MMuv2mVSpE4Q5A+Qvz/3T5CdjMsUl5MUm59BIzoxjFFM8HtPYR5LSCDD5woc4BBHgScpJEWkwUaqFGhqIvgS0sgHju2NjQ==</latexit><latexit sha1_base64="IJ2Og9vuKJ2sgquaItWHO2yxC3Y=">AAACZHichVHLSsNAFD2N71q1WgRBkGJRXJUbN4ogCiK47MNWoZaSxFGDaRKStKDFH9Ct4sKVL0T8CcGNPyDSHxDEZQU3LrxNC6Ki3mFmzpy5586ZGdU2dNcjqgaklta29o7OrmB3qKe3L9w/kHWtkqOJjGYZlrOqKq4wdFNkPN0zxKrtCKWoGmJF3V6o76+UhePqlrns7dgiX1Q2TX1D1xSPqeRiIRyjOPkR/QnkJojN3Z4/Bmfti4QVvsIa1mFBQwlFCJjwGBtQ4HLLQQbBZi6PCnMOI93fF9hDkLUlzhKcoTC7zeMmr3JN1uR1vabrqzU+xeDusDKKMXqga6rRPd3QM73/Wqvi16h72eFZbWiFXejbH0q//asq8uxh61P1p2cPG5j2vers3faZ+i20hr68e1xLz6TGKuN0Ri/s/5SqdMc3MMuv2mVSpE4Q5A+Qvz/3T5CdjMsUl5MUm59BIzoxjFFM8HtPYR5LSCDD5woc4BBHgScpJEWkwUaqFGhqIvgS0sgHju2NjQ==</latexit><latexit sha1_base64="2gk4boKvAqCP/WlM5qi0mQR/d04=">AAACZHichVG7SgNBFD1Z3/EVDYIgiBgUq3DXRrESRLDMw0RBRXbXSVzcF7uTgAZ/QFvFwkpBRPwMG3/AIj8giKWCjYV3Nwuiot5hZs6cuefOmRnds8xAEjUTSlt7R2dXd0+yt69/YDA1NFwO3JpviJLhWq6/rmuBsExHlKQpLbHu+UKzdUus6XtL4f5aXfiB6Tqrct8TW7ZWdcyKaWiSqfzydipDWYpi4idQY5BBHDk3dY1N7MCFgRpsCDiQjC1oCLhtQAXBY24LDeZ8Rma0L3CIJGtrnCU4Q2N2j8cqrzZi1uF1WDOI1AafYnH3WTmBKXqgG3qhe7qlJ3r/tVYjqhF62edZb2mFtz14NFp8+1dl8yyx+6n607NEBfORV5O9exET3sJo6esHZy/FhcJUY5ou6Zn9X1CT7vgGTv3VuMqLwjmS/AHq9+f+CcqzWZWyap4yiwvxV3RjDJOY4feewyJWkEOJzxU4xglOE49Kn5JWRlqpSiLWpPEllPEPjKSJuQ==</latexit> 15 Sentence This beef looks delicious but the service is bad Without ai 0.1 0.1 0.1 0.1 0.1 0.1 0.1 0.1 0.1 With ai 0.05 0.24 0.11 0.12 0.12 0.01 0.12 0.09 0.11
  • 16. Autoencoder part(unsupervised) 16 • : sentence embedding • : aspect embedding matrix T<latexit sha1_base64="U8zv4FkV9T8kWJTl5u2J+C0lY3k=">AAACZHichVG7SgNBFD1ZXzG+okEQBBFDxCrctVHSKNhYJtGYgIrsrpO4ZF/sbgIa/AFtFQsrFRHxJwQbf0AkPyCIpYKNhTebgGhQ7zAzZ87cc+fMjOoYuucT1UNSR2dXd0+4N9LXPzA4FB0eWfPsiquJnGYbtltQFU8YuiVyvu4bouC4QjFVQ+TV8lJjP18Vrqfb1qq/64hNUylZelHXFJ+pzOpWNE5JCmKyHcgtEF+4vXgER9qOXmED27ChoQITAhZ8xgYUeNzWIYPgMLeJGnMuIz3YF9hHhLUVzhKcoTBb5rHEq/UWa/G6UdML1BqfYnB3WTmJBD3QNb3SPd3QM338WqsW1Gh42eVZbWqFszV0MLby/q/K5NnHzpfqT88+ipgPvOrs3QmYxi20pr66d/K6ksomatN0Ti/s/4zqdMc3sKpv2mVGZE8R4Q+Qfz53O1ibTcqUlDMUX0yhGWGMYwoz/N5zWMQy0sjxuQKHOMJx6Enql2LSaDNVCrU0MXwLaeITNXyMQQ==</latexit><latexit sha1_base64="76T0xNTZSrtAgEsx9f+4anWEsYY=">AAACZHichVHLSsNAFD2N71q1KoIgSLFUXJUbN4ogCm5cWrUqVJEkTmtoXiRpQYs/oFvFhStfiPgTght/QMQfEMRlBTcuvEkLokW9w8ycOXPPnTMzqmPonk/0FJGamlta29o7op2xru6eeG/fimeXXE1kNduw3TVV8YShWyLr674h1hxXKKZqiFW1OBfsr5aF6+m2tezvOGLDVAqWntc1xWcqs7wZT1Kawkg0ArkOkjO354/RaediwY5fYR1bsKGhBBMCFnzGBhR43HKQQXCY20CFOZeRHu4L7CHK2hJnCc5QmC3yWOBVrs5avA5qeqFa41MM7i4rE0jRA11Tle7phl7o49dalbBG4GWHZ7WmFc5mz/7g0vu/KpNnH9tfqj89+8hjMvSqs3cnZIJbaDV9efe4ujS1mKqM0hm9sv9TeqI7voFVftMuM2LxBFH+APnnczeClfG0TGk5Q8nZKdSiHUMYwRi/9wRmMY8FZPlcgQMc4ijyLMWkfmmglipF6pp+fAtp+BOs7Y2c</latexit><latexit sha1_base64="76T0xNTZSrtAgEsx9f+4anWEsYY=">AAACZHichVHLSsNAFD2N71q1KoIgSLFUXJUbN4ogCm5cWrUqVJEkTmtoXiRpQYs/oFvFhStfiPgTght/QMQfEMRlBTcuvEkLokW9w8ycOXPPnTMzqmPonk/0FJGamlta29o7op2xru6eeG/fimeXXE1kNduw3TVV8YShWyLr674h1hxXKKZqiFW1OBfsr5aF6+m2tezvOGLDVAqWntc1xWcqs7wZT1Kawkg0ArkOkjO354/RaediwY5fYR1bsKGhBBMCFnzGBhR43HKQQXCY20CFOZeRHu4L7CHK2hJnCc5QmC3yWOBVrs5avA5qeqFa41MM7i4rE0jRA11Tle7phl7o49dalbBG4GWHZ7WmFc5mz/7g0vu/KpNnH9tfqj89+8hjMvSqs3cnZIJbaDV9efe4ujS1mKqM0hm9sv9TeqI7voFVftMuM2LxBFH+APnnczeClfG0TGk5Q8nZKdSiHUMYwRi/9wRmMY8FZPlcgQMc4ijyLMWkfmmglipF6pp+fAtp+BOs7Y2c</latexit><latexit sha1_base64="uP1+27ByLsb5noLVGIpqNIFk+kU=">AAACZHichVG7SgNBFD1Z3zGaqAiCIMEQsQp3bRQrwcbSqFEhiuyukzhkX+xuAhr8AW0VCysFEfEzbPwBC39AEEsFGwvvbhZEg3qHmTlz5p47Z2Z015R+QPSYUDo6u7p7evuS/amBwXRmaHjdd+qeIUqGYzrepq75wpS2KAUyMMWm6wnN0k2xodcWw/2NhvB86dhrwb4rti2tasuKNLSAqeLaTiZHBYoi2w7UGOQQx7KTucYWduHAQB0WBGwEjE1o8LmVoYLgMreNJnMeIxntCxwiydo6ZwnO0Jit8VjlVTlmbV6HNf1IbfApJnePlVnk6YFu6JXu6Zae6ePXWs2oRuhln2e9pRXuTvpobPX9X5XFc4C9L9WfngNUMBd5lezdjZjwFkZL3zg4e12dX8k3p+iSXtj/BT3SHd/AbrwZV0Wxco4kf4D687nbwfpMQaWCWqTcwnz8Fb0YxySm+b1nsYAlLKPE5woc4wSniSclpYwoo61UJRFrRvAtlIlPqqSJyA==</latexit> rs = TT · pt (6)<latexit sha1_base64="1cwaS5a4T2iGUxSDNmMe5jkMb7Q=">AAACgnichVHLLgRBFD3ae7wGGyGSjlewmNwmQYREYmPpMYPE0OnuKXT0dLfumkmYWImNH7CwIhEROz7Bxg9Y+ASxJLGxcKdnEkFwK1V16tQ9t05Vmb5jh5LosUKprKquqa2rjzU0NjW3xFvblkMvF1giZXmOF6yaRigc2xUpaUtHrPqBMLKmI1bMndni/kpeBKHtuUm554v1rLHl2pu2ZUim9Hh3oIfqtJrcSKppK+NJ1delmt7NGRl1cGxIj/dSgqJQfwKtDHpnOo/6wDHvxS+RRgYeLOSQhYALydiBgZDbGjQQfObWUWAuYGRH+wIHiLE2x1mCMwxmd3jc4tVamXV5XawZRmqLT3G4B6xU0U8PdEUvdE/X9ETvv9YqRDWKXvZ4Nkta4estxx1Lb/+qsjxLbH+q/vQssYmJyKvN3v2IKd7CKunz+ycvS5OL/YUBOqdn9n9Gj3THN3Dzr9bFglg8RYw/QPv+3D/B8khCo4S2wD8xiVLUoQs9GOT3HscM5jCPFJ97iCvc4FapUoYVTRktpSoVZU07voQy9QEarJPf</latexit><latexit sha1_base64="zUck8IkKmsnYlnlg6FLiassNeIw=">AAACgnicSyrIySwuMTC4ycjEzMLKxs7BycXNw8vHLyAoFFacX1qUnBqanJ+TXxSRlFicmpOZlxpaklmSkxpRUJSamJuUkxqelO0Mkg8vSy0qzszPCympLEiNzU1Mz8tMy0xOLAEKxQvIFsUXK9gqhMSFKMQkp+SXKBTElyjEFJYmpihomGnGCygb6BmAgQImwxDKUHaQalX+Vu+7LyBfYDlDDEMKQz5DMkMpQy5DKkMeQwmQncOQyFAMhNEMhgwGDAVAsViGaqBYEZCVCZZPZahl4ALqLQWqSgWqSASKZgPJdCAvGiqaB+SDzCwG604G2pIDxEVAnQoMqgZXDVYafDY4YbDa4KXBH5xmVYPNALmlEkgnQfSmFsTzd0kEfyeoKxdIlzBkIHThdXMJQxqDBditmUC3F4BFQL5Ihugvq5r+OdgqSLVazWCRwWug+xca3DQ4DPRBXtmX5KWBqUGzGbiAEWCIHtyYjDAjPUMDPcNAYExYMUAAB4M0gxKDBjC8zRkcGDwYAhhCgfY2M6xk2MSwmYmFSYvJkMkYopSJEapHmAEFMNkAAKfAll4=</latexit><latexit sha1_base64="zUck8IkKmsnYlnlg6FLiassNeIw=">AAACgnicSyrIySwuMTC4ycjEzMLKxs7BycXNw8vHLyAoFFacX1qUnBqanJ+TXxSRlFicmpOZlxpaklmSkxpRUJSamJuUkxqelO0Mkg8vSy0qzszPCympLEiNzU1Mz8tMy0xOLAEKxQvIFsUXK9gqhMSFKMQkp+SXKBTElyjEFJYmpihomGnGCygb6BmAgQImwxDKUHaQalX+Vu+7LyBfYDlDDEMKQz5DMkMpQy5DKkMeQwmQncOQyFAMhNEMhgwGDAVAsViGaqBYEZCVCZZPZahl4ALqLQWqSgWqSASKZgPJdCAvGiqaB+SDzCwG604G2pIDxEVAnQoMqgZXDVYafDY4YbDa4KXBH5xmVYPNALmlEkgnQfSmFsTzd0kEfyeoKxdIlzBkIHThdXMJQxqDBditmUC3F4BFQL5Ihugvq5r+OdgqSLVazWCRwWug+xca3DQ4DPRBXtmX5KWBqUGzGbiAEWCIHtyYjDAjPUMDPcNAYExYMUAAB4M0gxKDBjC8zRkcGDwYAhhCgfY2M6xk2MSwmYmFSYvJkMkYopSJEapHmAEFMNkAAKfAll4=</latexit><latexit sha1_base64="ztHqAfxINm7NDtHnJAs9s0up6yE=">AAACgnichVHLLgRBFD3ae7wGG4lIOiYEi8ltEkRIJDaWHjNIDJ3unkJHT3frrpmEiZWdH7CwIhEROz7Bxg9Y+ASxJLGxcKenE0FwK1V16tQ9t05Vmb5jh5LosUapratvaGxqTrS0trV3JDu7VkKvGFgia3mOF6yZRigc2xVZaUtHrPmBMAqmI1bN3bnK/mpJBKHtuRm574uNgrHt2lu2ZUim9GRfoIfqjJrZzKg5K+9J1delmtsrGnl1aHxYT6YoTVGoP4EWgxTiWPCSl8ghDw8WiihAwIVk7MBAyG0dGgg+cxsoMxcwsqN9gUMkWFvkLMEZBrO7PG7zaj1mXV5XaoaR2uJTHO4BK1UM0ANd0Qvd0zU90fuvtcpRjYqXfZ7Nqlb4esdxz/Lbv6oCzxI7n6o/PUtsYTLyarN3P2Iqt7Cq+tLBycvy1NJAeZDO6Zn9n9Ej3fEN3NKrdbEolk6R4A/Qvj/3T7AymtYorS1SanYq/oom9KIfQ/zeE5jFPBaQ5XOPcIUb3Cp1yoiiKWPVVKUm1nTjSyjTHz6Wktw=</latexit> : k*d, 14*200 d1 d2 d199 d200 k1 k2 k14 … … 2. • : K aspect embedding K aspect • : Sentence embedding (weighted sum of word embedding) • : pt zs<latexit sha1_base64="hvgbNff5B+9OnNLVU3Kb9zV4P9A=">AAACZnichVG7SgNBFD1ZXzFqEhVRECQYIlbhro1iFbCxzMMYQSXsrpO4ZLO77G4CMfgDgq0prBRERPwKG3/Aws5SsYxgY+HNJiAq6h1m5syZe+6cmVFtQ3c9ooeA1Nc/MDgUHA6NjI6FI9HxiU3XqjmayGuWYTlbquIKQzdF3tM9Q2zZjlCqqiEKamWts1+oC8fVLXPDa9hit6qUTb2ka4rHVO6g6BajcUqSH7GfQO6BeCo6d/MIIG1FL7GDPVjQUEMVAiY8xgYUuNy2IYNgM7eLJnMOI93fFzhEiLU1zhKcoTBb4bHMq+0ea/K6U9P11RqfYnB3WBlDgu7pitp0R9f0TO+/1mr6NTpeGjyrXa2wi5Gjmdzbv6oqzx72P1V/evZQworvVWfvts90bqF19fWDVju3mk00F+icXtj/GT3QLd/ArL9qFxmRPUWIP0D+/tw/weZSUqaknOGfWEU3gpjFPBb5vZeRwjrSyPO5ZRzjBK3AkxSWpqTpbqoU6Gkm8SWk2AeICIzP</latexit><latexit sha1_base64="ZHTzYmNEzaNefnjGlgizFG658BQ=">AAACZnichVHLSsNAFD2N7/poVURBkKIorsqNG8VVwY3LPmwr1FKSONbQNAlJWtDiDwiCK7twpSAi0n8Q3PgDXfQPFJcKblx4mxZERb3DzJw5c8+dMzOqbeiuR9QKSD29ff0Dg0PB4ZHRsVB4fCLjWhVHE2nNMixnW1VcYeimSHu6Z4ht2xFKWTVEVi1ttPezVeG4umVueQe2yJeVoqnv6ZriMZU6LLiF8AJFyY/ITyB3wUIsPNdont414lb4GjvYhQUNFZQhYMJjbECByy0HGQSbuTxqzDmMdH9f4AhB1lY4S3CGwmyJxyKvcl3W5HW7puurNT7F4O6wMoJFatINvdAD3dITvf9aq+bXaHs54FntaIVdCB3PpN7+VZV59rD/qfrTs4c9rPledfZu+0z7FlpHXz2sv6TWk4u1JbqkZ/Z/QS265xuY1VftKiGS5wjyB8jfn/snyKxEZYrKCf6JdXRiELOYxzK/9ypi2EQcaT63iBOcoR54lMakKWm6kyoFuppJfAkp8gESlY7B</latexit><latexit sha1_base64="ZHTzYmNEzaNefnjGlgizFG658BQ=">AAACZnichVHLSsNAFD2N7/poVURBkKIorsqNG8VVwY3LPmwr1FKSONbQNAlJWtDiDwiCK7twpSAi0n8Q3PgDXfQPFJcKblx4mxZERb3DzJw5c8+dMzOqbeiuR9QKSD29ff0Dg0PB4ZHRsVB4fCLjWhVHE2nNMixnW1VcYeimSHu6Z4ht2xFKWTVEVi1ttPezVeG4umVueQe2yJeVoqnv6ZriMZU6LLiF8AJFyY/ITyB3wUIsPNdont414lb4GjvYhQUNFZQhYMJjbECByy0HGQSbuTxqzDmMdH9f4AhB1lY4S3CGwmyJxyKvcl3W5HW7puurNT7F4O6wMoJFatINvdAD3dITvf9aq+bXaHs54FntaIVdCB3PpN7+VZV59rD/qfrTs4c9rPledfZu+0z7FlpHXz2sv6TWk4u1JbqkZ/Z/QS265xuY1VftKiGS5wjyB8jfn/snyKxEZYrKCf6JdXRiELOYxzK/9ypi2EQcaT63iBOcoR54lMakKWm6kyoFuppJfAkp8gESlY7B</latexit><latexit sha1_base64="LyascO/L8hfhwTcWC5hQh+gFxbY=">AAACZnichVHLSsNAFD2Nr1ofrYoouCmWiqty40bpquDGpW3tA1RKEscaTJOQpIW2+AOCW7twpSAifoYbf8BF/0BxqeDGhbdpQLSod5iZM2fuuXNmRrUN3fWIuiFpaHhkdCw8HpmYnJqOxmZmi65VdzRR0CzDcsqq4gpDN0XB0z1DlG1HKDXVECX1eLO3X2oIx9Utc8dr2mK/plRN/VDXFI+pfKviVmIJSpEf8UEgByCBILat2A32cAALGuqoQcCEx9iAApfbLmQQbOb20WbOYaT7+wIniLC2zlmCMxRmj3ms8mo3YE1e92q6vlrjUwzuDivjSNIj3dIrPdAdPdPHr7Xafo2elybPal8r7Er0dDH//q+qxrOHoy/Vn549HGLD96qzd9tnerfQ+vpGq/OaT+eS7RW6ohf2f0lduucbmI037TorcheI8AfIP597EBTXUjKl5CwlMungK8JYwjJW+b3XkcEWtlHgc6s4wzk6oSdpWpqXFvqpUijQzOFbSPFP5teK1A==</latexit> W, b<latexit sha1_base64="bG1wmlwYy5IEj1jra+NjgyJcSTg=">AAACZ3ichVG7SgNBFD3Z+IyPxAcSsIlKxELCXRsllWBj6SuJoCHsrpNkyWZ32d0EYhCsLWwVrBRExH+wsfEHLPyEYBnBxsK7m4CoqHeYmTNn7rlzZka1Dd31iJ5DUrint69/YDAyNDwyGo2NjWddq+ZoIqNZhuXsqoorDN0UGU/3DLFrO0KpqobIqZU1fz9XF46rW+aO17BFvqqUTL2oa4rnU7nFhFqIzVGKgkj8BHIXzK1O3oePAWxYsRvs4wAWNNRQhYAJj7EBBS63Pcgg2Mzl0WTOYaQH+wJHiLC2xlmCMxRmKzyWeLXXZU1e+zXdQK3xKQZ3h5UJJOmJbqlNj3RHLXr/tVYzqOF7afCsdrTCLkRP4ttv/6qqPHsof6r+9OyhiJXAq87e7YDxb6F19PXDs/Z2eivZnKcremH/l/RMD3wDs/6qXW+KrQtE+APk78/9E2SXUjKl5E3+iTQ6MYBpzGKB33sZq1jHBjJ8bhmnOMN5qCVFpSkp3kmVQl3NBL6ENPMBZbGMLA==</latexit><latexit sha1_base64="SHrtUeKmjMLGp+w82kq5yOboN6A=">AAACZ3ichVG7SgNBFD3Z+IyPxAcSsImGiIWEuzZKKsHG0lceoCK76yQu2ewuu5tADP6Aha2ClYKI+A82NmksLfyEYBnBxsK7m4CoqHeYmTNn7rlzZka1Dd31iJ5DUrint69/YDAyNDwyGo2Njedcq+poIqtZhuUUVMUVhm6KrKd7hijYjlAqqiHyannV38/XhOPqlrnt1W2xV1FKpl7UNcXzqfxCQt2PJSlNQSR+ArkLkiuT92H7sVldt2I32MUBLGioogIBEx5jAwpcbjuQQbCZ20ODOYeRHuwLHCPC2ipnCc5QmC3zWOLVTpc1ee3XdAO1xqcY3B1WJpCiJ7qlNjXpjlr0/mutRlDD91LnWe1ohb0fPYlvvf2rqvDs4fBT9adnD0UsB1519m4HjH8LraOvHZ21tzKbqcYcXdEL+7+kZ3rgG5i1V+16Q2xeIMIfIH9/7p8gt5iWKS1v8E9k0IkBTGMW8/zeS1jBGtaR5XMPcYoznIdaUlSakuKdVCnU1UzgS0gzH/8qjiY=</latexit><latexit sha1_base64="SHrtUeKmjMLGp+w82kq5yOboN6A=">AAACZ3ichVG7SgNBFD3Z+IyPxAcSsImGiIWEuzZKKsHG0lceoCK76yQu2ewuu5tADP6Aha2ClYKI+A82NmksLfyEYBnBxsK7m4CoqHeYmTNn7rlzZka1Dd31iJ5DUrint69/YDAyNDwyGo2Njedcq+poIqtZhuUUVMUVhm6KrKd7hijYjlAqqiHyannV38/XhOPqlrnt1W2xV1FKpl7UNcXzqfxCQt2PJSlNQSR+ArkLkiuT92H7sVldt2I32MUBLGioogIBEx5jAwpcbjuQQbCZ20ODOYeRHuwLHCPC2ipnCc5QmC3zWOLVTpc1ee3XdAO1xqcY3B1WJpCiJ7qlNjXpjlr0/mutRlDD91LnWe1ohb0fPYlvvf2rqvDs4fBT9adnD0UsB1519m4HjH8LraOvHZ21tzKbqcYcXdEL+7+kZ3rgG5i1V+16Q2xeIMIfIH9/7p8gt5iWKS1v8E9k0IkBTGMW8/zeS1jBGtaR5XMPcYoznIdaUlSakuKdVCnU1UzgS0gzH/8qjiY=</latexit><latexit sha1_base64="M6B8fBDh0dSaCWH2eSPZX/uus4A=">AAACZ3ichVG7SgNBFD1Z3/GRqCABm2iIWEi4a6NYBWwsNTFGiEF210myuC92NwEN/oCFbQQrBRHxM2z8AYt8glgq2Fh4d7MgKuodZubMmXvunJlRHUP3fKJuTOrrHxgcGh6Jj46NTySSk1M7nt10NVHSbMN2d1XFE4ZuiZKv+4bYdVyhmKohyurherBfbgnX021r2z9yRNVU6pZe0zXFD6jyUlrdT2YoR2GkfwI5AhlEsWknb7CHA9jQ0IQJAQs+YwMKPG4VyCA4zFXRZs5lpIf7AieIs7bJWYIzFGYPeazzqhKxFq+Dml6o1vgUg7vLyjSy9Ei39EIPdEdP9P5rrXZYI/ByxLPa0wpnP3GaKr79qzJ59tH4VP3p2UcNq6FXnb07IRPcQuvpW8edl+JaIdteoCt6Zv+X1KV7voHVetWut0ThAnH+APn7c/8EO8s5mXLyFmXya9FXDGMW81jk915BHhvYRInPbeAMHZzHnqSENCOleqlSLNJM40tIcx9+ZYqX</latexit> rs<latexit sha1_base64="DOHXvCyt5sY/KcMwWz23dbJ1QTw=">AAACZnichVG7SgNBFD1Z3/EVFVEQJBgiVuGujWIVsLFMjNFADGF3ncQl+2J3E9DgDwi2prBSEBHxK2z8AQs7S8Uygo2FN5uAaFDvMDNnztxz58yM6hi65xM9hqSe3r7+gcGh8PDI6Nh4ZGJy27Orriaymm3Ybk5VPGHolsj6um+InOMKxVQNsaNW1lv7OzXherptbfkHjiiYStnSS7qm+Exl3KJXjMQoQUFEu4HcAbFkZP72CUDKjlxhF3uwoaEKEwIWfMYGFHjc8pBBcJgroM6cy0gP9gWOEGZtlbMEZyjMVngs8yrfYS1et2p6gVrjUwzuLiujiNMDXVOT7umGXujj11r1oEbLywHPalsrnOL48Wzm/V+VybOP/S/Vn559lLAaeNXZuxMwrVtobX3tsNHMrG3G64t0Qa/s/5we6Y5vYNXetMu02DxDmD9A/vnc3WB7OSFTQk7zT6yhHYOYwwKW+L1XkMQGUsjyuWWc4BSN0LM0Jk1LM+1UKdTRTOFbSNFPd/iMxw==</latexit><latexit sha1_base64="tonuSrn9Vsj0j83J4P+hKavOCCM=">AAACZnichVHLSsNAFD2Nr1pfVREFQYpFcVVu3CiuCm5cqrW2UEtJ4rQG0yQkaUGLPyAIruzClYKIiP8guPEHXPQPFJcV3LjwNimIFvUOM3PmzD13zsyotqG7HlEjJHV19/T2hfsjA4NDwyPR0bFt16o4mkhrlmE5WVVxhaGbIu3pniGytiOUsmqIjLq/2trPVIXj6pa55R3YIl9WSqZe1DXFYyrlFNxCNE4J8iPWCeQ2iCejM3dPp/d361b0GjvYhQUNFZQhYMJjbECByy0HGQSbuTxqzDmMdH9f4AgR1lY4S3CGwuw+jyVe5dqsyetWTddXa3yKwd1hZQxz9EQ31KRHuqUX+vi1Vs2v0fJywLMaaIVdGDmeSr3/qyrz7GHvS/WnZw9FLPtedfZu+0zrFlqgrx7Wm6mVzbnaPF3SK/u/oAY98A3M6pt2tSE2zxHhD5B/Pncn2F5MyJSQN/gnVhBEGNOYxQK/9xKSWMM60nxuCSc4Qz30LA1LE9JkkCqF2ppxfAsp9gkChY65</latexit><latexit sha1_base64="tonuSrn9Vsj0j83J4P+hKavOCCM=">AAACZnichVHLSsNAFD2Nr1pfVREFQYpFcVVu3CiuCm5cqrW2UEtJ4rQG0yQkaUGLPyAIruzClYKIiP8guPEHXPQPFJcV3LjwNimIFvUOM3PmzD13zsyotqG7HlEjJHV19/T2hfsjA4NDwyPR0bFt16o4mkhrlmE5WVVxhaGbIu3pniGytiOUsmqIjLq/2trPVIXj6pa55R3YIl9WSqZe1DXFYyrlFNxCNE4J8iPWCeQ2iCejM3dPp/d361b0GjvYhQUNFZQhYMJjbECByy0HGQSbuTxqzDmMdH9f4AgR1lY4S3CGwuw+jyVe5dqsyetWTddXa3yKwd1hZQxz9EQ31KRHuqUX+vi1Vs2v0fJywLMaaIVdGDmeSr3/qyrz7GHvS/WnZw9FLPtedfZu+0zrFlqgrx7Wm6mVzbnaPF3SK/u/oAY98A3M6pt2tSE2zxHhD5B/Pncn2F5MyJSQN/gnVhBEGNOYxQK/9xKSWMM60nxuCSc4Qz30LA1LE9JkkCqF2ppxfAsp9gkChY65</latexit><latexit sha1_base64="PZWA6exi+w5eRaGSTLkCrm4+BJI=">AAACZnichVHLSsNAFD2Nr1ofrYoouCmWiqty40bpquDGZR+2FVRKEqc1mCYhSQu1+AOCW7twpSAifoYbf8BF/0BxWcGNC2/TgKiod5iZM2fuuXNmRrUN3fWIuiFpaHhkdCw8HpmYnJqOxmZmS67VcDRR1CzDcnZUxRWGboqip3uG2LEdodRVQ5TVo83+frkpHFe3zG2vZYv9ulIz9aquKR5TBafiVmIJSpEf8Z9ADkACQWSt2A32cAALGhqoQ8CEx9iAApfbLmQQbOb20WbOYaT7+wIniLC2wVmCMxRmj3is8Wo3YE1e92u6vlrjUwzuDivjSNIj3VKPHuiOnun911ptv0bfS4tndaAVdiV6ulh4+1dV59nD4afqT88eqtjwvers3faZ/i20gb553OkV0vlke4Wu6IX9X1KX7vkGZvNVu86J/AUi/AHy9+f+CUprKZlSco4SmXTwFWEsYRmr/N7ryGALWRT53BrOcI5O6EmalualhUGqFAo0c/gSUvwD1seKzA==</latexit> T<latexit sha1_base64="U8zv4FkV9T8kWJTl5u2J+C0lY3k=">AAACZHichVG7SgNBFD1ZXzG+okEQBBFDxCrctVHSKNhYJtGYgIrsrpO4ZF/sbgIa/AFtFQsrFRHxJwQbf0AkPyCIpYKNhTebgGhQ7zAzZ87cc+fMjOoYuucT1UNSR2dXd0+4N9LXPzA4FB0eWfPsiquJnGYbtltQFU8YuiVyvu4bouC4QjFVQ+TV8lJjP18Vrqfb1qq/64hNUylZelHXFJ+pzOpWNE5JCmKyHcgtEF+4vXgER9qOXmED27ChoQITAhZ8xgYUeNzWIYPgMLeJGnMuIz3YF9hHhLUVzhKcoTBb5rHEq/UWa/G6UdML1BqfYnB3WTmJBD3QNb3SPd3QM338WqsW1Gh42eVZbWqFszV0MLby/q/K5NnHzpfqT88+ipgPvOrs3QmYxi20pr66d/K6ksomatN0Ti/s/4zqdMc3sKpv2mVGZE8R4Q+Qfz53O1ibTcqUlDMUX0yhGWGMYwoz/N5zWMQy0sjxuQKHOMJx6Enql2LSaDNVCrU0MXwLaeITNXyMQQ==</latexit><latexit sha1_base64="76T0xNTZSrtAgEsx9f+4anWEsYY=">AAACZHichVHLSsNAFD2N71q1KoIgSLFUXJUbN4ogCm5cWrUqVJEkTmtoXiRpQYs/oFvFhStfiPgTght/QMQfEMRlBTcuvEkLokW9w8ycOXPPnTMzqmPonk/0FJGamlta29o7op2xru6eeG/fimeXXE1kNduw3TVV8YShWyLr674h1hxXKKZqiFW1OBfsr5aF6+m2tezvOGLDVAqWntc1xWcqs7wZT1Kawkg0ArkOkjO354/RaediwY5fYR1bsKGhBBMCFnzGBhR43HKQQXCY20CFOZeRHu4L7CHK2hJnCc5QmC3yWOBVrs5avA5qeqFa41MM7i4rE0jRA11Tle7phl7o49dalbBG4GWHZ7WmFc5mz/7g0vu/KpNnH9tfqj89+8hjMvSqs3cnZIJbaDV9efe4ujS1mKqM0hm9sv9TeqI7voFVftMuM2LxBFH+APnnczeClfG0TGk5Q8nZKdSiHUMYwRi/9wRmMY8FZPlcgQMc4ijyLMWkfmmglipF6pp+fAtp+BOs7Y2c</latexit><latexit sha1_base64="76T0xNTZSrtAgEsx9f+4anWEsYY=">AAACZHichVHLSsNAFD2N71q1KoIgSLFUXJUbN4ogCm5cWrUqVJEkTmtoXiRpQYs/oFvFhStfiPgTght/QMQfEMRlBTcuvEkLokW9w8ycOXPPnTMzqmPonk/0FJGamlta29o7op2xru6eeG/fimeXXE1kNduw3TVV8YShWyLr674h1hxXKKZqiFW1OBfsr5aF6+m2tezvOGLDVAqWntc1xWcqs7wZT1Kawkg0ArkOkjO354/RaediwY5fYR1bsKGhBBMCFnzGBhR43HKQQXCY20CFOZeRHu4L7CHK2hJnCc5QmC3yWOBVrs5avA5qeqFa41MM7i4rE0jRA11Tle7phl7o49dalbBG4GWHZ7WmFc5mz/7g0vu/KpNnH9tfqj89+8hjMvSqs3cnZIJbaDV9efe4ujS1mKqM0hm9sv9TeqI7voFVftMuM2LxBFH+APnnczeClfG0TGk5Q8nZKdSiHUMYwRi/9wRmMY8FZPlcgQMc4ijyLMWkfmmglipF6pp+fAtp+BOs7Y2c</latexit><latexit sha1_base64="uP1+27ByLsb5noLVGIpqNIFk+kU=">AAACZHichVG7SgNBFD1Z3zGaqAiCIMEQsQp3bRQrwcbSqFEhiuyukzhkX+xuAhr8AW0VCysFEfEzbPwBC39AEEsFGwvvbhZEg3qHmTlz5p47Z2Z015R+QPSYUDo6u7p7evuS/amBwXRmaHjdd+qeIUqGYzrepq75wpS2KAUyMMWm6wnN0k2xodcWw/2NhvB86dhrwb4rti2tasuKNLSAqeLaTiZHBYoi2w7UGOQQx7KTucYWduHAQB0WBGwEjE1o8LmVoYLgMreNJnMeIxntCxwiydo6ZwnO0Jit8VjlVTlmbV6HNf1IbfApJnePlVnk6YFu6JXu6Zae6ePXWs2oRuhln2e9pRXuTvpobPX9X5XFc4C9L9WfngNUMBd5lezdjZjwFkZL3zg4e12dX8k3p+iSXtj/BT3SHd/AbrwZV0Wxco4kf4D687nbwfpMQaWCWqTcwnz8Fb0YxySm+b1nsYAlLKPE5woc4wSniSclpYwoo61UJRFrRvAtlIlPqqSJyA==</latexit> pt = softmax(W · zs + b) (5)<latexit sha1_base64="KNH8XHzGwXzGWE5/+Oy1FBgE0yw=">AAACmHichVFNSxtBGH5cbbWxbaK9FHsZDJZIIbyrlpZCIdSD9abRGMHIsruZ6OJ+uTsJavAP+AekeFIoRfwRHrzYH9CDP0E8KvTSQ9/dLJRW2r7DzDzzzPu888yMFbpOrIiu+rT+gQcPB4ce5YYfP3maL4yMrsRBO7JlzQ7cIFq1zFi6ji9rylGuXA0jaXqWK+vW1myyX+/IKHYCf1nthnLdMzd8p+XYpmLKKEyHhhLvRUPJHRV53ThoKc/c2RelumjYzUCJPSMWr4Q1KRrbbbMpSq8nc0ahSGVKQ9wHegaKyGIhKHxBA00EsNGGBwkfirELEzG3NegghMyto8tcxMhJ9yX2kWNtm7MkZ5jMbvG4wau1jPV5ndSMU7XNp7jcI1YKTNA3OqVbuqQzuqYff63VTWskXnZ5tnpaGRr5g+dL3/+r8nhW2Pyl+qdnhRbepl4d9h6mTHILu6fv7B3eLr2rTnRf0gndsP9juqILvoHfubM/L8rqEZIP0P987vtgZaqsU1lfnClWPmRfMYQXGEeJ3/sNKviIBdT43E84xyW+amNaRZvT5nupWl+meYbfQqv+BPsqm14=</latexit><latexit sha1_base64="KNH8XHzGwXzGWE5/+Oy1FBgE0yw=">AAACmHichVFNSxtBGH5cbbWxbaK9FHsZDJZIIbyrlpZCIdSD9abRGMHIsruZ6OJ+uTsJavAP+AekeFIoRfwRHrzYH9CDP0E8KvTSQ9/dLJRW2r7DzDzzzPu888yMFbpOrIiu+rT+gQcPB4ce5YYfP3maL4yMrsRBO7JlzQ7cIFq1zFi6ji9rylGuXA0jaXqWK+vW1myyX+/IKHYCf1nthnLdMzd8p+XYpmLKKEyHhhLvRUPJHRV53ThoKc/c2RelumjYzUCJPSMWr4Q1KRrbbbMpSq8nc0ahSGVKQ9wHegaKyGIhKHxBA00EsNGGBwkfirELEzG3NegghMyto8tcxMhJ9yX2kWNtm7MkZ5jMbvG4wau1jPV5ndSMU7XNp7jcI1YKTNA3OqVbuqQzuqYff63VTWskXnZ5tnpaGRr5g+dL3/+r8nhW2Pyl+qdnhRbepl4d9h6mTHILu6fv7B3eLr2rTnRf0gndsP9juqILvoHfubM/L8rqEZIP0P987vtgZaqsU1lfnClWPmRfMYQXGEeJ3/sNKviIBdT43E84xyW+amNaRZvT5nupWl+meYbfQqv+BPsqm14=</latexit><latexit sha1_base64="KNH8XHzGwXzGWE5/+Oy1FBgE0yw=">AAACmHichVFNSxtBGH5cbbWxbaK9FHsZDJZIIbyrlpZCIdSD9abRGMHIsruZ6OJ+uTsJavAP+AekeFIoRfwRHrzYH9CDP0E8KvTSQ9/dLJRW2r7DzDzzzPu888yMFbpOrIiu+rT+gQcPB4ce5YYfP3maL4yMrsRBO7JlzQ7cIFq1zFi6ji9rylGuXA0jaXqWK+vW1myyX+/IKHYCf1nthnLdMzd8p+XYpmLKKEyHhhLvRUPJHRV53ThoKc/c2RelumjYzUCJPSMWr4Q1KRrbbbMpSq8nc0ahSGVKQ9wHegaKyGIhKHxBA00EsNGGBwkfirELEzG3NegghMyto8tcxMhJ9yX2kWNtm7MkZ5jMbvG4wau1jPV5ndSMU7XNp7jcI1YKTNA3OqVbuqQzuqYff63VTWskXnZ5tnpaGRr5g+dL3/+r8nhW2Pyl+qdnhRbepl4d9h6mTHILu6fv7B3eLr2rTnRf0gndsP9juqILvoHfubM/L8rqEZIP0P987vtgZaqsU1lfnClWPmRfMYQXGEeJ3/sNKviIBdT43E84xyW+amNaRZvT5nupWl+meYbfQqv+BPsqm14=</latexit><latexit sha1_base64="KNH8XHzGwXzGWE5/+Oy1FBgE0yw=">AAACmHichVFNSxtBGH5cbbWxbaK9FHsZDJZIIbyrlpZCIdSD9abRGMHIsruZ6OJ+uTsJavAP+AekeFIoRfwRHrzYH9CDP0E8KvTSQ9/dLJRW2r7DzDzzzPu888yMFbpOrIiu+rT+gQcPB4ce5YYfP3maL4yMrsRBO7JlzQ7cIFq1zFi6ji9rylGuXA0jaXqWK+vW1myyX+/IKHYCf1nthnLdMzd8p+XYpmLKKEyHhhLvRUPJHRV53ThoKc/c2RelumjYzUCJPSMWr4Q1KRrbbbMpSq8nc0ahSGVKQ9wHegaKyGIhKHxBA00EsNGGBwkfirELEzG3NegghMyto8tcxMhJ9yX2kWNtm7MkZ5jMbvG4wau1jPV5ndSMU7XNp7jcI1YKTNA3OqVbuqQzuqYff63VTWskXnZ5tnpaGRr5g+dL3/+r8nhW2Pyl+qdnhRbepl4d9h6mTHILu6fv7B3eLr2rTnRf0gndsP9juqILvoHfubM/L8rqEZIP0P987vtgZaqsU1lfnClWPmRfMYQXGEeJ3/sNKviIBdT43E84xyW+amNaRZvT5nupWl+meYbfQqv+BPsqm14=</latexit>
  • 17. 17 Sentence 1 Atten tion Layer Sentence 2 Sentence 3 beef pork waiter E E E Aspect 3 TAspect 1 Aspect 2 T T aspect term embedding extraction … ai<latexit sha1_base64="sfl9+Tt+FAxuCcxtpQufcRHmHg8=">AAACZnichVG7SgNBFD1ZXzE+siqiIEhQFKtw10ZJFbCxVGNUUAm76xiHbHaX3U0gBn9AsDWFlYKIiF9h4w9Y2Fkqlgo2Ft7dBERFvcPMnDlzz50zM4ZrST8guo8pbe0dnV3x7kRPb19/Uh0YXPOdimeKvOlYjrdh6L6wpC3ygQwsseF6Qi8bllg3Sgvh/npVeL507NWg5ortsl605a409YCpnF6QBXWS0hRF6ifQWmAyq45fPwBYctQLbGEHDkxUUIaAjYCxBR0+t01oILjMbaPOnMdIRvsCB0iwtsJZgjN0Zks8Fnm12WJtXoc1/Uht8ikWd4+VKUzRHV3SC93SFT3R+6+16lGN0EuNZ6OpFW4heTiae/tXVeY5wN6n6k/PAXYxH3mV7N2NmPAWZlNf3W+85DIrU/VpOqNn9n9K93TDN7Crr+b5slg5QYI/QPv+3D/B2mxao7S2zD+RQTPiGMMEZvi955DFIpaQ53OLOMIxGrFHpV8ZVkaaqUqspRnCl1BSH0HWjKw=</latexit><latexit sha1_base64="MITNhmmbUWK85o3qgnfBnwoUL+g=">AAACZnichVG7SgNBFD1ZXzG+oiIKggRFsQp3bZRUARvLPEwUVMLuOsbBze6yuwnE4A8IgpUWVgoiIvkHwcYfSOEfKJYKNhbebAKiot5hZs6cuefOmRndMaXnEz2ElI7Oru6ecG+kr39gcCg6PJL37LJriJxhm7a7rmueMKUlcr70TbHuuEIr6aZY0/eWm/trFeF60rZW/aojtkpa0ZI70tB8prJaQRaiMxSnIGI/gdoGM8noVL1xfFtP2dErbGIbNgyUUYKABZ+xCQ0etw2oIDjMbaHGnMtIBvsCB4iwtsxZgjM0Zvd4LPJqo81avG7W9AK1waeY3F1WxjBLDbqmF7qnG3qi919r1YIaTS9VnvWWVjiFocOJ7Nu/qhLPPnY/VX969rGDpcCrZO9OwDRvYbT0lf3Tl2wiM1ubowt6Zv/n9EB3fAOr8mpcpkXmDBH+APX7c/8E+YW4SnE1zT+RQCvCmMQ05vm9F5HEClLI8blFHOEEp6FHZVAZU8ZbqUqorRnFl1BiH8xUjp4=</latexit><latexit sha1_base64="MITNhmmbUWK85o3qgnfBnwoUL+g=">AAACZnichVG7SgNBFD1ZXzG+oiIKggRFsQp3bZRUARvLPEwUVMLuOsbBze6yuwnE4A8IgpUWVgoiIvkHwcYfSOEfKJYKNhbebAKiot5hZs6cuefOmRndMaXnEz2ElI7Oru6ecG+kr39gcCg6PJL37LJriJxhm7a7rmueMKUlcr70TbHuuEIr6aZY0/eWm/trFeF60rZW/aojtkpa0ZI70tB8prJaQRaiMxSnIGI/gdoGM8noVL1xfFtP2dErbGIbNgyUUYKABZ+xCQ0etw2oIDjMbaHGnMtIBvsCB4iwtsxZgjM0Zvd4LPJqo81avG7W9AK1waeY3F1WxjBLDbqmF7qnG3qi919r1YIaTS9VnvWWVjiFocOJ7Nu/qhLPPnY/VX969rGDpcCrZO9OwDRvYbT0lf3Tl2wiM1ubowt6Zv/n9EB3fAOr8mpcpkXmDBH+APX7c/8E+YW4SnE1zT+RQCvCmMQ05vm9F5HEClLI8blFHOEEp6FHZVAZU8ZbqUqorRnFl1BiH8xUjp4=</latexit><latexit sha1_base64="cm2DdYGGl4bckJ1+Vb9VWzXZAIc=">AAACZnichVG7SgNBFD1ZXzE+EhVRsAmGiFW4a6OkCthYxsSooBJ210kc3Owuu5tADP6AYGsKKwUR8TNs/AGL/IFiqWBj4c1mQVTUO8zMmTP33Dkzozum9HyiTkTp6x8YHIoOx0ZGx8bjiYnJTc+uu4YoGbZpu9u65glTWqLkS98U244rtJpuii39cLW7v9UQridta8NvOmKvplUtWZGG5jNV1MqynEhRhoJI/gRqCFIII28nrrGLfdgwUEcNAhZ8xiY0eNx2oILgMLeHFnMuIxnsCxwjxto6ZwnO0Jg95LHKq52QtXjdrekFaoNPMbm7rEwiTQ90Qy90T7f0RO+/1moFNbpemjzrPa1wyvGT2eLbv6oazz4OPlV/evZRwUrgVbJ3J2C6tzB6+sZR+6WYLaRbC3RJz+z/gjp0xzewGq/G1boonCPGH6B+f+6fYHMpo1JGXadULht+RRRzmMciv/cyclhDHiU+t4pTnKEdeVTGlWllppeqRELNFL6EkvwAoKWKsQ==</latexit> ai<latexit sha1_base64="sfl9+Tt+FAxuCcxtpQufcRHmHg8=">AAACZnichVG7SgNBFD1ZXzE+siqiIEhQFKtw10ZJFbCxVGNUUAm76xiHbHaX3U0gBn9AsDWFlYKIiF9h4w9Y2Fkqlgo2Ft7dBERFvcPMnDlzz50zM4ZrST8guo8pbe0dnV3x7kRPb19/Uh0YXPOdimeKvOlYjrdh6L6wpC3ygQwsseF6Qi8bllg3Sgvh/npVeL507NWg5ortsl605a409YCpnF6QBXWS0hRF6ifQWmAyq45fPwBYctQLbGEHDkxUUIaAjYCxBR0+t01oILjMbaPOnMdIRvsCB0iwtsJZgjN0Zks8Fnm12WJtXoc1/Uht8ikWd4+VKUzRHV3SC93SFT3R+6+16lGN0EuNZ6OpFW4heTiae/tXVeY5wN6n6k/PAXYxH3mV7N2NmPAWZlNf3W+85DIrU/VpOqNn9n9K93TDN7Crr+b5slg5QYI/QPv+3D/B2mxao7S2zD+RQTPiGMMEZvi955DFIpaQ53OLOMIxGrFHpV8ZVkaaqUqspRnCl1BSH0HWjKw=</latexit><latexit sha1_base64="MITNhmmbUWK85o3qgnfBnwoUL+g=">AAACZnichVG7SgNBFD1ZXzG+oiIKggRFsQp3bZRUARvLPEwUVMLuOsbBze6yuwnE4A8IgpUWVgoiIvkHwcYfSOEfKJYKNhbebAKiot5hZs6cuefOmRndMaXnEz2ElI7Oru6ecG+kr39gcCg6PJL37LJriJxhm7a7rmueMKUlcr70TbHuuEIr6aZY0/eWm/trFeF60rZW/aojtkpa0ZI70tB8prJaQRaiMxSnIGI/gdoGM8noVL1xfFtP2dErbGIbNgyUUYKABZ+xCQ0etw2oIDjMbaHGnMtIBvsCB4iwtsxZgjM0Zvd4LPJqo81avG7W9AK1waeY3F1WxjBLDbqmF7qnG3qi919r1YIaTS9VnvWWVjiFocOJ7Nu/qhLPPnY/VX969rGDpcCrZO9OwDRvYbT0lf3Tl2wiM1ubowt6Zv/n9EB3fAOr8mpcpkXmDBH+APX7c/8E+YW4SnE1zT+RQCvCmMQ05vm9F5HEClLI8blFHOEEp6FHZVAZU8ZbqUqorRnFl1BiH8xUjp4=</latexit><latexit sha1_base64="MITNhmmbUWK85o3qgnfBnwoUL+g=">AAACZnichVG7SgNBFD1ZXzG+oiIKggRFsQp3bZRUARvLPEwUVMLuOsbBze6yuwnE4A8IgpUWVgoiIvkHwcYfSOEfKJYKNhbebAKiot5hZs6cuefOmRndMaXnEz2ElI7Oru6ecG+kr39gcCg6PJL37LJriJxhm7a7rmueMKUlcr70TbHuuEIr6aZY0/eWm/trFeF60rZW/aojtkpa0ZI70tB8prJaQRaiMxSnIGI/gdoGM8noVL1xfFtP2dErbGIbNgyUUYKABZ+xCQ0etw2oIDjMbaHGnMtIBvsCB4iwtsxZgjM0Zvd4LPJqo81avG7W9AK1waeY3F1WxjBLDbqmF7qnG3qi919r1YIaTS9VnvWWVjiFocOJ7Nu/qhLPPnY/VX969rGDpcCrZO9OwDRvYbT0lf3Tl2wiM1ubowt6Zv/n9EB3fAOr8mpcpkXmDBH+APX7c/8E+YW4SnE1zT+RQCvCmMQ05vm9F5HEClLI8blFHOEEp6FHZVAZU8ZbqUqorRnFl1BiH8xUjp4=</latexit><latexit sha1_base64="cm2DdYGGl4bckJ1+Vb9VWzXZAIc=">AAACZnichVG7SgNBFD1ZXzE+EhVRsAmGiFW4a6OkCthYxsSooBJ210kc3Owuu5tADP6AYGsKKwUR8TNs/AGL/IFiqWBj4c1mQVTUO8zMmTP33Dkzozum9HyiTkTp6x8YHIoOx0ZGx8bjiYnJTc+uu4YoGbZpu9u65glTWqLkS98U244rtJpuii39cLW7v9UQridta8NvOmKvplUtWZGG5jNV1MqynEhRhoJI/gRqCFIII28nrrGLfdgwUEcNAhZ8xiY0eNx2oILgMLeHFnMuIxnsCxwjxto6ZwnO0Jg95LHKq52QtXjdrekFaoNPMbm7rEwiTQ90Qy90T7f0RO+/1moFNbpemjzrPa1wyvGT2eLbv6oazz4OPlV/evZRwUrgVbJ3J2C6tzB6+sZR+6WYLaRbC3RJz+z/gjp0xzewGq/G1boonCPGH6B+f+6fYHMpo1JGXadULht+RRRzmMciv/cyclhDHiU+t4pTnKEdeVTGlWllppeqRELNFL6EkvwAoKWKsQ==</latexit> ai<latexit sha1_base64="sfl9+Tt+FAxuCcxtpQufcRHmHg8=">AAACZnichVG7SgNBFD1ZXzE+siqiIEhQFKtw10ZJFbCxVGNUUAm76xiHbHaX3U0gBn9AsDWFlYKIiF9h4w9Y2Fkqlgo2Ft7dBERFvcPMnDlzz50zM4ZrST8guo8pbe0dnV3x7kRPb19/Uh0YXPOdimeKvOlYjrdh6L6wpC3ygQwsseF6Qi8bllg3Sgvh/npVeL507NWg5ortsl605a409YCpnF6QBXWS0hRF6ifQWmAyq45fPwBYctQLbGEHDkxUUIaAjYCxBR0+t01oILjMbaPOnMdIRvsCB0iwtsJZgjN0Zks8Fnm12WJtXoc1/Uht8ikWd4+VKUzRHV3SC93SFT3R+6+16lGN0EuNZ6OpFW4heTiae/tXVeY5wN6n6k/PAXYxH3mV7N2NmPAWZlNf3W+85DIrU/VpOqNn9n9K93TDN7Crr+b5slg5QYI/QPv+3D/B2mxao7S2zD+RQTPiGMMEZvi955DFIpaQ53OLOMIxGrFHpV8ZVkaaqUqspRnCl1BSH0HWjKw=</latexit><latexit sha1_base64="MITNhmmbUWK85o3qgnfBnwoUL+g=">AAACZnichVG7SgNBFD1ZXzG+oiIKggRFsQp3bZRUARvLPEwUVMLuOsbBze6yuwnE4A8IgpUWVgoiIvkHwcYfSOEfKJYKNhbebAKiot5hZs6cuefOmRndMaXnEz2ElI7Oru6ecG+kr39gcCg6PJL37LJriJxhm7a7rmueMKUlcr70TbHuuEIr6aZY0/eWm/trFeF60rZW/aojtkpa0ZI70tB8prJaQRaiMxSnIGI/gdoGM8noVL1xfFtP2dErbGIbNgyUUYKABZ+xCQ0etw2oIDjMbaHGnMtIBvsCB4iwtsxZgjM0Zvd4LPJqo81avG7W9AK1waeY3F1WxjBLDbqmF7qnG3qi919r1YIaTS9VnvWWVjiFocOJ7Nu/qhLPPnY/VX969rGDpcCrZO9OwDRvYbT0lf3Tl2wiM1ubowt6Zv/n9EB3fAOr8mpcpkXmDBH+APX7c/8E+YW4SnE1zT+RQCvCmMQ05vm9F5HEClLI8blFHOEEp6FHZVAZU8ZbqUqorRnFl1BiH8xUjp4=</latexit><latexit sha1_base64="MITNhmmbUWK85o3qgnfBnwoUL+g=">AAACZnichVG7SgNBFD1ZXzG+oiIKggRFsQp3bZRUARvLPEwUVMLuOsbBze6yuwnE4A8IgpUWVgoiIvkHwcYfSOEfKJYKNhbebAKiot5hZs6cuefOmRndMaXnEz2ElI7Oru6ecG+kr39gcCg6PJL37LJriJxhm7a7rmueMKUlcr70TbHuuEIr6aZY0/eWm/trFeF60rZW/aojtkpa0ZI70tB8prJaQRaiMxSnIGI/gdoGM8noVL1xfFtP2dErbGIbNgyUUYKABZ+xCQ0etw2oIDjMbaHGnMtIBvsCB4iwtsxZgjM0Zvd4LPJqo81avG7W9AK1waeY3F1WxjBLDbqmF7qnG3qi919r1YIaTS9VnvWWVjiFocOJ7Nu/qhLPPnY/VX969rGDpcCrZO9OwDRvYbT0lf3Tl2wiM1ubowt6Zv/n9EB3fAOr8mpcpkXmDBH+APX7c/8E+YW4SnE1zT+RQCvCmMQ05vm9F5HEClLI8blFHOEEp6FHZVAZU8ZbqUqorRnFl1BiH8xUjp4=</latexit><latexit sha1_base64="cm2DdYGGl4bckJ1+Vb9VWzXZAIc=">AAACZnichVG7SgNBFD1ZXzE+EhVRsAmGiFW4a6OkCthYxsSooBJ210kc3Owuu5tADP6AYGsKKwUR8TNs/AGL/IFiqWBj4c1mQVTUO8zMmTP33Dkzozum9HyiTkTp6x8YHIoOx0ZGx8bjiYnJTc+uu4YoGbZpu9u65glTWqLkS98U244rtJpuii39cLW7v9UQridta8NvOmKvplUtWZGG5jNV1MqynEhRhoJI/gRqCFIII28nrrGLfdgwUEcNAhZ8xiY0eNx2oILgMLeHFnMuIxnsCxwjxto6ZwnO0Jg95LHKq52QtXjdrekFaoNPMbm7rEwiTQ90Qy90T7f0RO+/1moFNbpemjzrPa1wyvGT2eLbv6oazz4OPlV/evZRwUrgVbJ3J2C6tzB6+sZR+6WYLaRbC3RJz+z/gjp0xzewGq/G1boonCPGH6B+f+6fYHMpo1JGXadULht+RRRzmMciv/cyclhDHiU+t4pTnKEdeVTGlWllppeqRELNFL6EkvwAoKWKsQ==</latexit> ewbeef<latexit sha1_base64="nTAQr0FYpdZwnsl4h7BILRSDiAo=">AAACb3ichVHLSsNAFD2N7/qqulAUpFQU3ZQbN4qrghuXrdpWUClJnGpomoQkrWjoD/gBunChFkTEnxDc+AMu+gniSiq4ceFtWhAt6h1m5syZe+6cmVFtQ3c9olpI6ujs6u7p7Qv3DwwODUdGRjOuVXI0kdYsw3K2VMUVhm6KtKd7htiyHaEUVUNk1cJqYz9bFo6rW+amd2SL3aKyb+p5XVM8pnZEzj/M+aoQ+UolF5mhOAURbQdyC8wkYtXJewBJK3KDHezBgoYSihAw4TE2oMDltg0ZBJu5XfjMOYz0YF+ggjBrS5wlOENhtsDjPq+2W6zJ60ZNN1BrfIrB3WFlFLP0RLdUp0e6o2f6+LWWH9RoeDniWW1qhZ0bPpnYeP9XVeTZw8GX6k/PHvJYDrzq7N0OmMYttKa+fHxW31hZn/XnqEov7P+KavTANzDLb9p1SqyfI8wfIP987naQWYzLFJdT/BMraEYvphDDPL/3EhJYQxJpPtfGKS5wGXqVxqVpKdpMlUItzRi+hbTwCV84kNw=</latexit><latexit sha1_base64="syCDN1MN6Fh7l0LYJ9DhTdRJUxw=">AAACb3ichVHLSsNAFD2N7/po1YWiIEWpKEi5caO4Ety41GqtoBKSONXQNAlJWtHQH/ADdOHCB4iIW8EPcOMPuPATxJVUcOPC27QgWtQ7zMyZM/fcOTOjOabh+URPEampuaW1rb0j2tnV3ROL9/ateXbR1UVGt03bXddUT5iGJTK+4Zti3XGFWtBMkdXyC9X9bEm4nmFbq/6+I7YK6o5l5Axd9ZnaFEqwpwSaELlyWYmPUYrCSDQCuQ7G5kcvhm7vptJLdvwKm9iGDR1FFCBgwWdsQoXHbQMyCA5zWwiYcxkZ4b5AGVHWFjlLcIbKbJ7HHV5t1FmL19WaXqjW+RSTu8vKBJL0SNdUoQe6oWf6+LVWENaoetnnWatphaPEDgdX3v9VFXj2sful+tOzjxxmQ68Ge3dCpnoLvaYvHRxXVubSyWCcLuiF/Z/TE93zDazSm365LNIniPIHyD+fuxGsTadkSsnL/BNzqEU7hjGKCX7vGcxjEUvI8LkOjnCKs8irNCCNSIlaqhSpa/rxLaTJT3xFkgU=</latexit><latexit sha1_base64="syCDN1MN6Fh7l0LYJ9DhTdRJUxw=">AAACb3ichVHLSsNAFD2N7/po1YWiIEWpKEi5caO4Ety41GqtoBKSONXQNAlJWtHQH/ADdOHCB4iIW8EPcOMPuPATxJVUcOPC27QgWtQ7zMyZM/fcOTOjOabh+URPEampuaW1rb0j2tnV3ROL9/ateXbR1UVGt03bXddUT5iGJTK+4Zti3XGFWtBMkdXyC9X9bEm4nmFbq/6+I7YK6o5l5Axd9ZnaFEqwpwSaELlyWYmPUYrCSDQCuQ7G5kcvhm7vptJLdvwKm9iGDR1FFCBgwWdsQoXHbQMyCA5zWwiYcxkZ4b5AGVHWFjlLcIbKbJ7HHV5t1FmL19WaXqjW+RSTu8vKBJL0SNdUoQe6oWf6+LVWENaoetnnWatphaPEDgdX3v9VFXj2sful+tOzjxxmQ68Ge3dCpnoLvaYvHRxXVubSyWCcLuiF/Z/TE93zDazSm365LNIniPIHyD+fuxGsTadkSsnL/BNzqEU7hjGKCX7vGcxjEUvI8LkOjnCKs8irNCCNSIlaqhSpa/rxLaTJT3xFkgU=</latexit><latexit sha1_base64="YNu79Lt3u+Fb/pnKAm3SIfRvcog=">AAACb3ichVHLSsNAFD2Nr1pfVRcKghSLopty40bpquDGZatWBZWQxKkG0yQkaaWG/oAfoAsXPkBE/Aw3/oALP0FciYIbF96kAVFR7zAzZ87cc+fMjOaYhucTPSSktvaOzq5kd6qnt69/ID04tOrZNVcXZd02bXddUz1hGpYo+4ZvinXHFWpVM8WatrcQ7q/VhesZtrXiNxyxVVV3LKNi6KrP1KZQgn0l0ISoNJtKOks5iiLzE8gxyCKOop2+wia2YUNHDVUIWPAZm1DhcduADILD3BYC5lxGRrQv0ESKtTXOEpyhMrvH4w6vNmLW4nVY04vUOp9icndZmcEk3dM1vdAd3dAjvf9aK4hqhF4aPGstrXCUgcPR5bd/VVWefex+qv707KOC+cirwd6diAlvobf09YPjl+X80mQwRRf0xP7P6YFu+QZW/VW/LImlE6T4A+Tvz/0TrM7mZMrJJcoW8vFXJDGGCUzze8+hgEUUUeZzHRzhFGeJZ2lEGpcyrVQpEWuG8SWkmQ/yYI7+</latexit> ewpork<latexit sha1_base64="A84rQjWnEeSSuC8YvW7pjybznz8=">AAACb3ichVHLSsNAFD2N7/po1YWiIKVF0U25caO4Ety4rI9qoS0liaOGpklI0oqG/oAfoAsXakFE/AnBjT/gwk8QV1LBjQtv04JoUe8wM2fO3HPnzIxqG7rrET2FpI7Oru6e3r5w/8DgUCQ6PLLlWmVHE2nNMiwnoyquMHRTpD3dM0TGdoRSUg2xrRZXGvvbFeG4umVueoe2yJeUPVPf1TXFYyonCv5Bwbctp1itFqIJSlIQsXYgt0BiOV6buAOQsqLXyGEHFjSUUYKACY+xAQUutyxkEGzm8vCZcxjpwb5AFWHWljlLcIbCbJHHPV5lW6zJ60ZNN1BrfIrB3WFlDNP0SDdUpwe6pWf6+LWWH9RoeDnkWW1qhV2IHI9vvP+rKvHsYf9L9adnD7tYDLzq7N0OmMYttKa+cnRa31han/ZnqEYv7P+Snuieb2BW3rSrNbF+hjB/gPzzudvB1nxSpqS8xj+xhGb0YhJxzPJ7L2AZq0ghzefaOME5LkKv0pg0JcWaqVKopRnFt5DmPgGz15EG</latexit><latexit sha1_base64="HbvIJHyGHTyWelCGOiM6BTF2gqI=">AAACb3ichVHLSsNAFD2N7/qqulAUpLQoClJu3CiuBDcutdpW0BKSOGpomoQkrWjoD/gBunDhA0TEreAHuPEHXPgJ4koU3LjwNi2IFvUOM3PmzD13zsxojml4PtFjRGpqbmlta++IdnZ19/TG+vqznl1ydZHRbdN21zTVE6ZhiYxv+KZYc1yhFjVT5LTCQnU/VxauZ9jWqr/niHxR3baMLUNXfaY2hBLsKoFju4VKRYklKUVhxBuBXAfJ+cT58M3tVHrJjl1iA5uwoaOEIgQs+IxNqPC4rUMGwWEuj4A5l5ER7gtUEGVtibMEZ6jMFnjc5tV6nbV4Xa3phWqdTzG5u6yMY4we6Ipe6Z6u6Yk+fq0VhDWqXvZ41mpa4Si9B0Mr7/+qijz72PlS/enZxxZmQ68Ge3dCpnoLvaYv7x+9rsylx4JxOqdn9n9Gj3THN7DKb/rFskgfI8ofIP987kaQnU7JlJKX+SfmUIt2jCCBCX7vGcxjEUvI8LkODnGC08iLNCiNSvFaqhSpawbwLaTJT9Dkki8=</latexit><latexit sha1_base64="HbvIJHyGHTyWelCGOiM6BTF2gqI=">AAACb3ichVHLSsNAFD2N7/qqulAUpLQoClJu3CiuBDcutdpW0BKSOGpomoQkrWjoD/gBunDhA0TEreAHuPEHXPgJ4koU3LjwNi2IFvUOM3PmzD13zsxojml4PtFjRGpqbmlta++IdnZ19/TG+vqznl1ydZHRbdN21zTVE6ZhiYxv+KZYc1yhFjVT5LTCQnU/VxauZ9jWqr/niHxR3baMLUNXfaY2hBLsKoFju4VKRYklKUVhxBuBXAfJ+cT58M3tVHrJjl1iA5uwoaOEIgQs+IxNqPC4rUMGwWEuj4A5l5ER7gtUEGVtibMEZ6jMFnjc5tV6nbV4Xa3phWqdTzG5u6yMY4we6Ipe6Z6u6Yk+fq0VhDWqXvZ41mpa4Si9B0Mr7/+qijz72PlS/enZxxZmQ68Ge3dCpnoLvaYv7x+9rsylx4JxOqdn9n9Gj3THN7DKb/rFskgfI8ofIP987kaQnU7JlJKX+SfmUIt2jCCBCX7vGcxjEUvI8LkODnGC08iLNCiNSvFaqhSpawbwLaTJT9Dkki8=</latexit><latexit sha1_base64="bFDS3QHKWLbLL8KP8JOmnxi5p6Q=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgU3ZQbN4orwY1L29pWaEtJ4qihaRKStKKhP+AH6MKFDxARP8ONP+CinyCuRMGNC2/TgGhR7zAzZ87cc+fMjGobuusRNSNSV3dPb1//QHRwaHhkNDY2nnOtmqOJrGYZlrOtKq4wdFNkPd0zxLbtCKWqGiKvVtZb+/m6cFzdMre8Q1uUqsqeqe/qmuIxVRRl/6Ds25ZTaTTKsQQlKYh4J5BDkEAYm1bsBkXswIKGGqoQMOExNqDA5VaADILNXAk+cw4jPdgXaCDK2hpnCc5QmK3wuMerQsiavG7VdAO1xqcY3B1WxjFHj3RLr/RAd/REH7/W8oMaLS+HPKttrbDLo8dTmfd/VVWePex/qf707GEXK4FXnb3bAdO6hdbW149OXzOr6Tl/nq7omf1fUpPu+QZm/U27Ton0GaL8AfLP5+4EuaWkTEk5RYm11fAr+jGNWSzwey9jDRvYRJbPtXGCc1xEXqRJaUaKt1OlSKiZwLeQFj8BRw6PKA==</latexit> ewwaiter<latexit sha1_base64="PmNoZsFA+652kk3B2CbeiL5tq2I=">AAACcXichVG7SgNBFD1Z3/GRqCA+mqAoghDu2ihWgo1lfMQEfITdddQhm91ldxLRkNLGH1CwiiAifoaNP2BhZyuWEWwsvNkEREW9M7tz5sw9d87MmJ4tA0X0GNFaWtvaOzq7ot09vX2xeP/ARuAWfUukLdd2/axpBMKWjkgrqWyR9XxhFExbZMz8Un09UxJ+IF1nXR15Yrtg7DtyT1qGYmpH5MqH3A2phF+p5OITlKQwEj+B3gQTi6MnQ08AUm78GlvYhQsLRRQg4EAxtmEg4LYJHQSPuW2UmfMZyXBdoIIoa4ucJTjDYDbP/32ebTZZh+f1mkGotngXmz+flQlM0gPdUI3u6Zae6f3XWuWwRt3LEY9mQyu8XOx0eO3tX1WBR4WDT9WfnhX2MB96lezdC5n6KayGvnR8VltbWJ0sT9ElvbD/Kj3SHZ/AKb1aVyti9QJRfgD9+3X/BBuzSZ2S+gq/xAIa0YkxjGOa73sOi1hGCmne18c5qriM1LQRLaGNN1K1SFMziC+hzXwAmJiR4Q==</latexit><latexit sha1_base64="A3sYpOu9isJ0z+a3pVf+h27HhXg=">AAACcXichVHLSsNAFD2N7/poVRAfm6IoglBu3CiuCm5c1kdV8FGSOOpgmoRkWtHSpRt/QMFVCyLiZ7jxBwTFLxCXFdy48DYtiIp6Z5I5c+aeO2dmTM+WgSJ6jGhNzS2tbe0d0c6u7p5YvLdvNXDzviUylmu7/rppBMKWjsgoqWyx7vnCyJm2WDMP5mvrawXhB9J1VtSRJ7Zyxp4jd6VlKKa2RbZ4yN2QSvilUjY+RkkKI/ET6A0wlho+GXjqfqC0G7/CJnbgwkIeOQg4UIxtGAi4bUAHwWNuC0XmfEYyXBcoIcraPGcJzjCYPeD/Hs82GqzD81rNIFRbvIvNn8/KBMbpnq6pSnd0Q8/0/mutYlij5uWIR7OuFV42djq4/PavKsejwv6n6k/PCruYDb1K9u6FTO0UVl1fOD6rLs8tjRcnqEIv7L9Mj3TLJ3AKr9bloli6QJQfQP9+3T/B6nRSp6S+yC8xh3q0YwSjmOT7nkEKC0gjw/v6OEcZlUhVG9IS2mg9VYs0NP34EtrUB4epkvE=</latexit><latexit sha1_base64="A3sYpOu9isJ0z+a3pVf+h27HhXg=">AAACcXichVHLSsNAFD2N7/poVRAfm6IoglBu3CiuCm5c1kdV8FGSOOpgmoRkWtHSpRt/QMFVCyLiZ7jxBwTFLxCXFdy48DYtiIp6Z5I5c+aeO2dmTM+WgSJ6jGhNzS2tbe0d0c6u7p5YvLdvNXDzviUylmu7/rppBMKWjsgoqWyx7vnCyJm2WDMP5mvrawXhB9J1VtSRJ7Zyxp4jd6VlKKa2RbZ4yN2QSvilUjY+RkkKI/ET6A0wlho+GXjqfqC0G7/CJnbgwkIeOQg4UIxtGAi4bUAHwWNuC0XmfEYyXBcoIcraPGcJzjCYPeD/Hs82GqzD81rNIFRbvIvNn8/KBMbpnq6pSnd0Q8/0/mutYlij5uWIR7OuFV42djq4/PavKsejwv6n6k/PCruYDb1K9u6FTO0UVl1fOD6rLs8tjRcnqEIv7L9Mj3TLJ3AKr9bloli6QJQfQP9+3T/B6nRSp6S+yC8xh3q0YwSjmOT7nkEKC0gjw/v6OEcZlUhVG9IS2mg9VYs0NP34EtrUB4epkvE=</latexit><latexit sha1_base64="qYqXi/PPbz9w5bcVow2/0UI+iYE=">AAACcXichVHLSsNAFD2Nr1pfVTeKm2JRBKHcuFFcCW5c1tZWwUdJ4qhD0yQk04qW/oA/oOBKQUT8DDf+gIt+gris4MaFt2lAVNQ7k8yZM/fcOTNjerYMFFEzpnV19/T2xfsTA4NDwyPJ0bFi4FZ9SxQs13b9LdMIhC0dUVBS2WLL84VRMW2xaZZX2+ubNeEH0nU21IkndivGoSMPpGUopvZEqX7M3ZBK+I1GKZmmDIWR+gn0CKQRRdZN3mIH+3BhoYoKBBwoxjYMBNy2oYPgMbeLOnM+IxmuCzSQYG2VswRnGMyW+X/Is+2IdXjerhmEaot3sfnzWZnCDD3RHbXoke7pmd5/rVUPa7S9nPBodrTCK42cTeTf/lVVeFQ4+lT96VnhAEuhV8nevZBpn8Lq6Gun5638cm6mPkvX9ML+r6hJD3wCp/Zq3ayL3CUS/AD69+v+CYoLGZ0y+jqlV5ajp4hjCtOY4/texArWkEWB9/VxgStcx1rapJbSpjupWizSjONLaPMfPJmQDA==</latexit> ea1<latexit sha1_base64="oUNvzmX9/Q/2kBv/HWBuen/9i7U=">AAACanichVG7SgNBFD1ZXzG+YgTx0YhRsQp3bZRUARtLE40RNITddaKL+2J3E4hLShs7K0ErBRHxM2z8AQs7W9FOwcbCm01ANKh3mJkzZ+65c2ZGdQzd84keIlJHZ1d3T7Q31tc/MDgUH05seHbF1UResw3b3VQVTxi6JfK+7hti03GFYqqGKKj7y439QlW4nm5b637NEUVT2bX0sq4pPlMFUQqUklwvxZOUojCm2oHcAsnMxOHoI4BVO36FbezAhoYKTAhY8BkbUOBx24IMgsNcEQFzLiM93BeoI8baCmcJzlCY3edxl1dbLdbidaOmF6o1PsXg7rJyCrN0T9f0Snd0Q0/08WutIKzR8FLjWW1qhVMaOhpbe/9XZfLsY+9L9adnH2UshV519u6ETOMWWlNfPTh5XUvnZoM5uqBn9n9OD3TLN7Cqb9plVuTOEOMPkH8+dzvYWEjJlJKz/BNpNCOKSUxjnt97ERmsYBX50N0xTnEWeZES0rg02UyVIi3NCL6FNPMJoZKOMg==</latexit><latexit sha1_base64="zSu/UQ6tuJkNyPBCnyRg61cqFRo=">AAACanichVHLSsNAFD2Nr1qt1griY1PUiqty40ZxJbhx6au2UEtJ4rSGpklI0oIWl27cuRJ0pSAifoYbf0BQ/ALRnYIbF94kBVFR7zAzZ87cc+fMjGobuusR3UektvaOzq5od6ynN97XnxhIbrhW3dFEVrMMy8mriisM3RRZT/cMkbcdodRUQ+TU6qK/n2sIx9Utc93bsUWxplRMvaxrisdUTpSaSkneKyUmKENBpH4CuQUmFkb3hx7id7RsJS6wiS1Y0FBHDQImPMYGFLjcCpBBsJkrosmcw0gP9gX2EGNtnbMEZyjMVnms8KrQYk1e+zXdQK3xKQZ3h5UppOmWLumFbuiKHun911rNoIbvZYdnNdQKu9R/MLz29q+qxrOH7U/Vn549lDEXeNXZux0w/i20UN/YPXpZm19NN6fojJ7Y/ynd0zXfwGy8aucrYvUEMf4A+ftz/wQbMxmZMvIK/8Q8wohiDOOY5veexQKWsIxs4O4QxziJPEtJaUQaC1OlSEsziC8hTX4AkKOPQg==</latexit><latexit sha1_base64="zSu/UQ6tuJkNyPBCnyRg61cqFRo=">AAACanichVHLSsNAFD2Nr1qt1griY1PUiqty40ZxJbhx6au2UEtJ4rSGpklI0oIWl27cuRJ0pSAifoYbf0BQ/ALRnYIbF94kBVFR7zAzZ87cc+fMjGobuusR3UektvaOzq5od6ynN97XnxhIbrhW3dFEVrMMy8mriisM3RRZT/cMkbcdodRUQ+TU6qK/n2sIx9Utc93bsUWxplRMvaxrisdUTpSaSkneKyUmKENBpH4CuQUmFkb3hx7id7RsJS6wiS1Y0FBHDQImPMYGFLjcCpBBsJkrosmcw0gP9gX2EGNtnbMEZyjMVnms8KrQYk1e+zXdQK3xKQZ3h5UppOmWLumFbuiKHun911rNoIbvZYdnNdQKu9R/MLz29q+qxrOH7U/Vn549lDEXeNXZux0w/i20UN/YPXpZm19NN6fojJ7Y/ynd0zXfwGy8aucrYvUEMf4A+ftz/wQbMxmZMvIK/8Q8wohiDOOY5veexQKWsIxs4O4QxziJPEtJaUQaC1OlSEsziC8hTX4AkKOPQg==</latexit><latexit sha1_base64="rVJnwvKu3gz6WXFTzIDiaG0RX7A=">AAACanichVG7SgNBFD1ZXzE+EmOjpBGjYhXu2ihWARvLaMwDooTddRKXbHaX3U1AQ37AzkowlYKI+Bk2/oBFPkG0U7Cx8GazIBrUO8zMmTP33Dkzo9qG7npE3ZA0NDwyOhYej0xMTk1HYzPxvGs1HE3kNMuwnKKquMLQTZHzdM8QRdsRSl01REGtbfX2C03huLpl7nnHtjioK1VTr+ia4jFVEOWWUpbb5ViSUuTHwiCQA5BEEBkrdoN9HMKChgbqEDDhMTagwOVWggyCzdwBWsw5jHR/X6CNCGsbnCU4Q2G2xmOVV6WANXndq+n6ao1PMbg7rFzAMj3SLb3SA93RE338Wqvl1+h5OeZZ7WuFXY6ezmXf/1XVefZw9KX607OHCjZ8rzp7t32mdwutr2+enL9mN3eXWyt0Rc/s/5K6dM83MJtv2vWO2O0gwh8g/3zuQZBfS8mUkncomd4MviKMBBaxyu+9jjS2kUHOd3eGC3RCL1JcmpcS/VQpFGhm8S2kpU9Fk4xd</latexit> ea2<latexit sha1_base64="TTkL6jI9GCXBM9X+kQJFyX3cBMA=">AAACanichVG7SgNBFD1ZXzG+YgTx0YgvrMLdNEqqgI2lJsYEooTdddTFfbG7CcQlpY2dlWAqBRHxM2z8AQs7W9FOwcbCm01AVNQ7zMyZM/fcOTOjOobu+UT3Eamjs6u7J9ob6+sfGByKDyc2PLviaiKv2YbtFlXFE4Zuibyv+4YoOq5QTNUQBXV/ublfqArX021r3a85YstUdi19R9cUn6mCKAdKOVUvx2coSWFM/QRyG8xkJg5HHwCs2vFLbGIbNjRUYELAgs/YgAKPWwkyCA5zWwiYcxnp4b5AHTHWVjhLcIbC7D6Pu7wqtVmL182aXqjW+BSDu8vKKczRHV3RC93SNT3S+6+1grBG00uNZ7WlFU556Ggs9/avyuTZx96n6k/PPnawFHrV2bsTMs1baC199eDkJZfOzgXzdE5P7P+M7umGb2BVX7WLNZFtIMYfIH9/7p9gI5WUKSmv8U+k0YooJjGNBX7vRWSwglXkQ3fHOEUj8iwlpHFpspUqRdqaEXwJafYDo5OOMw==</latexit><latexit sha1_base64="ONn+cBEq9zcXSl6Z+bW+mPupURk=">AAACanichVHLSsNAFD2N7/qqFcTHplgVV+XGjeJKcOOyrdYKtZQkjhqaJiFJC7W4dOPOlWBXCiLiZ7jxBwTFLxDdKbhx4U1SEBX1DjNz5sw9d87MqLahux7RfURqa+/o7Oruifb29Q8Mxobi665VdTSR0yzDcjZUxRWGboqcp3uG2LAdoVRUQ+TV8rK/n68Jx9Utc82r26JYUXZMfVvXFI+pvCg1lNLcfimWpBQFkfgJ5BZILo0fjDz031Hail1gE1uwoKGKCgRMeIwNKHC5FSCDYDNXRIM5h5Ee7AvsI8raKmcJzlCYLfO4w6tCizV57dd0A7XGpxjcHVYmME23dEkvdENX9Ejvv9ZqBDV8L3We1VAr7NLg4ejq27+qCs8edj9Vf3r2sI2FwKvO3u2A8W+hhfra3vHL6mJ2ujFDZ/TE/k/pnq75BmbtVTvPiGwTUf4A+ftz/wTrcymZUnKGf2IRYXRjApOY5feexxJWkEYucHeEEzQjz1JcGpMmwlQp0tIM40tIUx+SpI9D</latexit><latexit sha1_base64="ONn+cBEq9zcXSl6Z+bW+mPupURk=">AAACanichVHLSsNAFD2N7/qqFcTHplgVV+XGjeJKcOOyrdYKtZQkjhqaJiFJC7W4dOPOlWBXCiLiZ7jxBwTFLxDdKbhx4U1SEBX1DjNz5sw9d87MqLahux7RfURqa+/o7Oruifb29Q8Mxobi665VdTSR0yzDcjZUxRWGboqcp3uG2LAdoVRUQ+TV8rK/n68Jx9Utc82r26JYUXZMfVvXFI+pvCg1lNLcfimWpBQFkfgJ5BZILo0fjDz031Hail1gE1uwoKGKCgRMeIwNKHC5FSCDYDNXRIM5h5Ee7AvsI8raKmcJzlCYLfO4w6tCizV57dd0A7XGpxjcHVYmME23dEkvdENX9Ejvv9ZqBDV8L3We1VAr7NLg4ejq27+qCs8edj9Vf3r2sI2FwKvO3u2A8W+hhfra3vHL6mJ2ujFDZ/TE/k/pnq75BmbtVTvPiGwTUf4A+ftz/wTrcymZUnKGf2IRYXRjApOY5feexxJWkEYucHeEEzQjz1JcGpMmwlQp0tIM40tIUx+SpI9D</latexit><latexit sha1_base64="BTtFoxlR4BXMJOI/nmCaKcgrdoY=">AAACanichVG7SgNBFD1ZXzE+ErVRbMQYsQp3bRSrgI1losYIMSy760QX98XuJqCLP2BnJWilICJ+ho0/YOEniHYKNhbe3SyIinqHmTlz5p47Z2Y01zT8gOghJXV19/T2pfszA4NDw9ncyOiG77Q8XVR1x3S8TU31hWnYohoYgSk2XU+olmaKmra3HO3X2sLzDcdeD/Zd0bDUHdtoGroaMFUTSqgq84dKLk9FimPqJ5ATkEcSZSd3hS1sw4GOFiwI2AgYm1Dhc6tDBsFlroGQOY+REe8LHCLD2hZnCc5Qmd3jcYdX9YS1eR3V9GO1zqeY3D1WTqFA93RNL3RHN/RI77/WCuMakZd9nrWOVrhK9mh87e1flcVzgN1P1Z+eAzSxGHs12LsbM9Et9I6+fXDysra0Wghn6YKe2P85PdAt38Buv+qXFbF6hgx/gPz9uX+CjfmiTEW5QvnSUvIVaUxiGnP83gsoYQVlVGN3xzjFWepZGpUmpMlOqpRKNGP4EtLMB0eUjF4=</latexit> ea3<latexit sha1_base64="+EUKCBkDH442Xtz/a5eiyniH6VM=">AAACanichVG7SgNBFD1ZXzE+EiOIj0bUiFW4q4WSKmBjqYkxgkrYXSe6ZF/sbgIxpLSxsxJMpSAifoaNP2BhZyvaKdhYeLMJiIp6h5k5c+aeO2dmVMfQPZ/oPiR1dHZ194R7I339A4PR2FB8w7PLriZymm3Y7qaqeMLQLZHzdd8Qm44rFFM1RF4tLTf38xXherptrftVR+yYyp6lF3VN8ZnKi0JNKSzUC7FpSlIQkz+B3AbT6fHDkQcAq3bsEtvYhQ0NZZgQsOAzNqDA47YFGQSHuR3UmHMZ6cG+QB0R1pY5S3CGwmyJxz1ebbVZi9fNml6g1vgUg7vLykkk6I6u6IVu6Zoe6f3XWrWgRtNLlWe1pRVOIXo0mn37V2Xy7GP/U/WnZx9FLAVedfbuBEzzFlpLXzk4ecmmMonaLJ3TE/s/o3u64RtYlVftYk1kGojwB8jfn/sn2JhPypSU1/gnUmhFGBOYwhy/9yLSWMEqcoG7Y5yiEXqW4tKYNNFKlUJtzTC+hDTzAaWUjjQ=</latexit><latexit sha1_base64="Z5mnY1a05PYKBE2DYRF6o8ynmik=">AAACanichVG7SgNBFD1ZXzE+EiOIj0aMilW4q4WSKmBjmURjBA1hdx11yWZ32d0EYkhpY2clmEpBRPwMG39AUPwC0U7BxsKbTUBU1DvMzJkz99w5M6Pahu56RPcBqaOzq7sn2Bvq6x8YDEeGouuuVXY0kdUsw3I2VMUVhm6KrKd7htiwHaGUVEPk1OJycz9XEY6rW+aaV7VFvqTsmvqOrikeUzlRqCmFhXohEqM4+TH5E8htEEuOH4w8DNxRyopcYAvbsKChjBIETHiMDShwuW1CBsFmLo8acw4j3d8XqCPE2jJnCc5QmC3yuMurzTZr8rpZ0/XVGp9icHdYOYkZuqVLeqEbuqJHev+1Vs2v0fRS5VltaYVdCB+Orr79qyrx7GHvU/WnZw87WPK96uzd9pnmLbSWvrJ//LKayMzUZumMntj/Kd3TNd/ArLxq52mRaSDEHyB/f+6fYH0+LlNcTvNPJNCKICYwhTl+70UksYIUsr67I5ygEXiWotKYNNFKlQJtzTC+hDT9AZSlj0Q=</latexit><latexit sha1_base64="Z5mnY1a05PYKBE2DYRF6o8ynmik=">AAACanichVG7SgNBFD1ZXzE+EiOIj0aMilW4q4WSKmBjmURjBA1hdx11yWZ32d0EYkhpY2clmEpBRPwMG39AUPwC0U7BxsKbTUBU1DvMzJkz99w5M6Pahu56RPcBqaOzq7sn2Bvq6x8YDEeGouuuVXY0kdUsw3I2VMUVhm6KrKd7htiwHaGUVEPk1OJycz9XEY6rW+aaV7VFvqTsmvqOrikeUzlRqCmFhXohEqM4+TH5E8htEEuOH4w8DNxRyopcYAvbsKChjBIETHiMDShwuW1CBsFmLo8acw4j3d8XqCPE2jJnCc5QmC3yuMurzTZr8rpZ0/XVGp9icHdYOYkZuqVLeqEbuqJHev+1Vs2v0fRS5VltaYVdCB+Orr79qyrx7GHvU/WnZw87WPK96uzd9pnmLbSWvrJ//LKayMzUZumMntj/Kd3TNd/ArLxq52mRaSDEHyB/f+6fYH0+LlNcTvNPJNCKICYwhTl+70UksYIUsr67I5ygEXiWotKYNNFKlQJtzTC+hDT9AZSlj0Q=</latexit><latexit sha1_base64="toqpx3Nzxk1YZYS40zFRmHJMjEU=">AAACanichVG7SgNBFD1ZXzG+YmwUGzFGrMJdLRSrgI1lHuYBMYTddRIXN7vL7iagIT9gZyWYSkFE/Awbf8DCTxDtFGwsvNksiIp6h5k5c+aeO2dmVNvQXY/oISQNDA4Nj4RHI2PjE5NT0elYwbWajibymmVYTklVXGHopsh7umeIku0IpaEaoqgebPX2iy3huLpl7niHtqg0lLqp13RN8Zgqimpbqa51qtE4JcmPhZ9ADkAcQaSt6BV2sQcLGppoQMCEx9iAApdbGTIINnMVtJlzGOn+vkAHEdY2OUtwhsLsAY91XpUD1uR1r6brqzU+xeDusHIBCbqna3qhO7qhR3r/tVbbr9Hzcsiz2tcKuzp1PJt7+1fV4NnD/qfqT88eatjwvers3faZ3i20vr51dPqS28wm2st0QU/s/5we6JZvYLZetcuMyHYR4Q+Qvz/3T1BYTcqUlDMUT20GXxHGPBaxwu+9jhS2kUbed3eCM3RDz1JMmpPm+6lSKNDM4EtISx9JlYxf</latexit> ea1<latexit sha1_base64="oUNvzmX9/Q/2kBv/HWBuen/9i7U=">AAACanichVG7SgNBFD1ZXzG+YgTx0YhRsQp3bZRUARtLE40RNITddaKL+2J3E4hLShs7K0ErBRHxM2z8AQs7W9FOwcbCm01ANKh3mJkzZ+65c2ZGdQzd84keIlJHZ1d3T7Q31tc/MDgUH05seHbF1UResw3b3VQVTxi6JfK+7hti03GFYqqGKKj7y439QlW4nm5b637NEUVT2bX0sq4pPlMFUQqUklwvxZOUojCm2oHcAsnMxOHoI4BVO36FbezAhoYKTAhY8BkbUOBx24IMgsNcEQFzLiM93BeoI8baCmcJzlCY3edxl1dbLdbidaOmF6o1PsXg7rJyCrN0T9f0Snd0Q0/08WutIKzR8FLjWW1qhVMaOhpbe/9XZfLsY+9L9adnH2UshV519u6ETOMWWlNfPTh5XUvnZoM5uqBn9n9OD3TLN7Cqb9plVuTOEOMPkH8+dzvYWEjJlJKz/BNpNCOKSUxjnt97ERmsYBX50N0xTnEWeZES0rg02UyVIi3NCL6FNPMJoZKOMg==</latexit><latexit sha1_base64="zSu/UQ6tuJkNyPBCnyRg61cqFRo=">AAACanichVHLSsNAFD2Nr1qt1griY1PUiqty40ZxJbhx6au2UEtJ4rSGpklI0oIWl27cuRJ0pSAifoYbf0BQ/ALRnYIbF94kBVFR7zAzZ87cc+fMjGobuusR3UektvaOzq5od6ynN97XnxhIbrhW3dFEVrMMy8mriisM3RRZT/cMkbcdodRUQ+TU6qK/n2sIx9Utc93bsUWxplRMvaxrisdUTpSaSkneKyUmKENBpH4CuQUmFkb3hx7id7RsJS6wiS1Y0FBHDQImPMYGFLjcCpBBsJkrosmcw0gP9gX2EGNtnbMEZyjMVnms8KrQYk1e+zXdQK3xKQZ3h5UppOmWLumFbuiKHun911rNoIbvZYdnNdQKu9R/MLz29q+qxrOH7U/Vn549lDEXeNXZux0w/i20UN/YPXpZm19NN6fojJ7Y/ynd0zXfwGy8aucrYvUEMf4A+ftz/wQbMxmZMvIK/8Q8wohiDOOY5veexQKWsIxs4O4QxziJPEtJaUQaC1OlSEsziC8hTX4AkKOPQg==</latexit><latexit sha1_base64="zSu/UQ6tuJkNyPBCnyRg61cqFRo=">AAACanichVHLSsNAFD2Nr1qt1griY1PUiqty40ZxJbhx6au2UEtJ4rSGpklI0oIWl27cuRJ0pSAifoYbf0BQ/ALRnYIbF94kBVFR7zAzZ87cc+fMjGobuusR3UektvaOzq5od6ynN97XnxhIbrhW3dFEVrMMy8mriisM3RRZT/cMkbcdodRUQ+TU6qK/n2sIx9Utc93bsUWxplRMvaxrisdUTpSaSkneKyUmKENBpH4CuQUmFkb3hx7id7RsJS6wiS1Y0FBHDQImPMYGFLjcCpBBsJkrosmcw0gP9gX2EGNtnbMEZyjMVnms8KrQYk1e+zXdQK3xKQZ3h5UppOmWLumFbuiKHun911rNoIbvZYdnNdQKu9R/MLz29q+qxrOH7U/Vn549lDEXeNXZux0w/i20UN/YPXpZm19NN6fojJ7Y/ynd0zXfwGy8aucrYvUEMf4A+ftz/wQbMxmZMvIK/8Q8wohiDOOY5veexQKWsIxs4O4QxziJPEtJaUQaC1OlSEsziC8hTX4AkKOPQg==</latexit><latexit sha1_base64="rVJnwvKu3gz6WXFTzIDiaG0RX7A=">AAACanichVG7SgNBFD1ZXzE+EmOjpBGjYhXu2ihWARvLaMwDooTddRKXbHaX3U1AQ37AzkowlYKI+Bk2/oBFPkG0U7Cx8GazIBrUO8zMmTP33Dkzo9qG7npE3ZA0NDwyOhYej0xMTk1HYzPxvGs1HE3kNMuwnKKquMLQTZHzdM8QRdsRSl01REGtbfX2C03huLpl7nnHtjioK1VTr+ia4jFVEOWWUpbb5ViSUuTHwiCQA5BEEBkrdoN9HMKChgbqEDDhMTagwOVWggyCzdwBWsw5jHR/X6CNCGsbnCU4Q2G2xmOVV6WANXndq+n6ao1PMbg7rFzAMj3SLb3SA93RE338Wqvl1+h5OeZZ7WuFXY6ezmXf/1XVefZw9KX607OHCjZ8rzp7t32mdwutr2+enL9mN3eXWyt0Rc/s/5K6dM83MJtv2vWO2O0gwh8g/3zuQZBfS8mUkncomd4MviKMBBaxyu+9jjS2kUHOd3eGC3RCL1JcmpcS/VQpFGhm8S2kpU9Fk4xd</latexit> ea2<latexit sha1_base64="TTkL6jI9GCXBM9X+kQJFyX3cBMA=">AAACanichVG7SgNBFD1ZXzG+YgTx0YgvrMLdNEqqgI2lJsYEooTdddTFfbG7CcQlpY2dlWAqBRHxM2z8AQs7W9FOwcbCm01AVNQ7zMyZM/fcOTOjOobu+UT3Eamjs6u7J9ob6+sfGByKDyc2PLviaiKv2YbtFlXFE4Zuibyv+4YoOq5QTNUQBXV/ublfqArX021r3a85YstUdi19R9cUn6mCKAdKOVUvx2coSWFM/QRyG8xkJg5HHwCs2vFLbGIbNjRUYELAgs/YgAKPWwkyCA5zWwiYcxnp4b5AHTHWVjhLcIbC7D6Pu7wqtVmL182aXqjW+BSDu8vKKczRHV3RC93SNT3S+6+1grBG00uNZ7WlFU556Ggs9/avyuTZx96n6k/PPnawFHrV2bsTMs1baC199eDkJZfOzgXzdE5P7P+M7umGb2BVX7WLNZFtIMYfIH9/7p9gI5WUKSmv8U+k0YooJjGNBX7vRWSwglXkQ3fHOEUj8iwlpHFpspUqRdqaEXwJafYDo5OOMw==</latexit><latexit sha1_base64="ONn+cBEq9zcXSl6Z+bW+mPupURk=">AAACanichVHLSsNAFD2N7/qqFcTHplgVV+XGjeJKcOOyrdYKtZQkjhqaJiFJC7W4dOPOlWBXCiLiZ7jxBwTFLxDdKbhx4U1SEBX1DjNz5sw9d87MqLahux7RfURqa+/o7Oruifb29Q8Mxobi665VdTSR0yzDcjZUxRWGboqcp3uG2LAdoVRUQ+TV8rK/n68Jx9Utc82r26JYUXZMfVvXFI+pvCg1lNLcfimWpBQFkfgJ5BZILo0fjDz031Hail1gE1uwoKGKCgRMeIwNKHC5FSCDYDNXRIM5h5Ee7AvsI8raKmcJzlCYLfO4w6tCizV57dd0A7XGpxjcHVYmME23dEkvdENX9Ejvv9ZqBDV8L3We1VAr7NLg4ejq27+qCs8edj9Vf3r2sI2FwKvO3u2A8W+hhfra3vHL6mJ2ujFDZ/TE/k/pnq75BmbtVTvPiGwTUf4A+ftz/wTrcymZUnKGf2IRYXRjApOY5feexxJWkEYucHeEEzQjz1JcGpMmwlQp0tIM40tIUx+SpI9D</latexit><latexit sha1_base64="ONn+cBEq9zcXSl6Z+bW+mPupURk=">AAACanichVHLSsNAFD2N7/qqFcTHplgVV+XGjeJKcOOyrdYKtZQkjhqaJiFJC7W4dOPOlWBXCiLiZ7jxBwTFLxDdKbhx4U1SEBX1DjNz5sw9d87MqLahux7RfURqa+/o7Oruifb29Q8Mxobi665VdTSR0yzDcjZUxRWGboqcp3uG2LAdoVRUQ+TV8rK/n68Jx9Utc82r26JYUXZMfVvXFI+pvCg1lNLcfimWpBQFkfgJ5BZILo0fjDz031Hail1gE1uwoKGKCgRMeIwNKHC5FSCDYDNXRIM5h5Ee7AvsI8raKmcJzlCYLfO4w6tCizV57dd0A7XGpxjcHVYmME23dEkvdENX9Ejvv9ZqBDV8L3We1VAr7NLg4ejq27+qCs8edj9Vf3r2sI2FwKvO3u2A8W+hhfra3vHL6mJ2ujFDZ/TE/k/pnq75BmbtVTvPiGwTUf4A+ftz/wTrcymZUnKGf2IRYXRjApOY5feexxJWkEYucHeEEzQjz1JcGpMmwlQp0tIM40tIUx+SpI9D</latexit><latexit sha1_base64="BTtFoxlR4BXMJOI/nmCaKcgrdoY=">AAACanichVG7SgNBFD1ZXzE+ErVRbMQYsQp3bRSrgI1losYIMSy760QX98XuJqCLP2BnJWilICJ+ho0/YOEniHYKNhbe3SyIinqHmTlz5p47Z2Y01zT8gOghJXV19/T2pfszA4NDw9ncyOiG77Q8XVR1x3S8TU31hWnYohoYgSk2XU+olmaKmra3HO3X2sLzDcdeD/Zd0bDUHdtoGroaMFUTSqgq84dKLk9FimPqJ5ATkEcSZSd3hS1sw4GOFiwI2AgYm1Dhc6tDBsFlroGQOY+REe8LHCLD2hZnCc5Qmd3jcYdX9YS1eR3V9GO1zqeY3D1WTqFA93RNL3RHN/RI77/WCuMakZd9nrWOVrhK9mh87e1flcVzgN1P1Z+eAzSxGHs12LsbM9Et9I6+fXDysra0Wghn6YKe2P85PdAt38Buv+qXFbF6hgx/gPz9uX+CjfmiTEW5QvnSUvIVaUxiGnP83gsoYQVlVGN3xzjFWepZGpUmpMlOqpRKNGP4EtLMB0eUjF4=</latexit> ea14<latexit sha1_base64="A+VZyWY04q37jvYqDrePV0X7cO0=">AAACbXichVG7SgNBFD1Z3/GRqCiiIkHxUYW7IiipBBtLX4lilLC7TuLiZnfZ3QTiktLGWrAQBQUR8TNs/AELO1uxsIhgY+HNJiAq6h1m5syZe+6cmVFtQ3c9ooeQ1NDY1NzS2hZu7+jsikS7e1KuVXA0kdQsw3I2VMUVhm6KpKd7htiwHaHkVUOsq3sL1f31onBc3TLXvJIttvNKztSzuqZ4TG2KjK9kfHmmXM5ExyhOQcR+ArkOxuYHD/ofASxZ0StsYQcWNBSQh4AJj7EBBS63NGQQbOa24TPnMNKDfYEywqwtcJbgDIXZPR5zvErXWZPX1ZpuoNb4FIO7w8oYxumerqlCd3RDT/T+ay0/qFH1UuJZrWmFnYkcDqy+/avK8+xh91P1p2cPWcwFXnX2bgdM9RZaTV/cP66sJlbG/Qm6oGf2f04PdMs3MIuv2uWyWDlBmD9A/v7cP0FqOi5TXF7mn0igFq0Ywiim+L1nMY9FLCHJ55o4winOQi9SnzQsjdRSpVBd04svIU1+AHM5j3w=</latexit><latexit sha1_base64="d5dkFwYMjrRVW4ZWJb1a69SGAfg=">AAACbXichVHLSsNAFD2Nr1pfVVFERcRSdVVuRFC6Krhx6atVfFCSOGowTUKSFmro0o1rwYUoKIiIn+HGHxAsfoG4cKHgxoW3aUFU1DvMzJkz99w5M6Pahu56ROWQVFff0NgUbo60tLa1d0Q7uzKulXc0kdYsw3JWVMUVhm6KtKd7hlixHaHkVEMsq7szlf3lgnBc3TKXvKItNnLKtqlv6ZriMbUqsr6S9eXJUikbjVGCghj+CeQaiKX693sf2u5pzopeYh2bsKAhjxwETHiMDShwua1BBsFmbgM+cw4jPdgXKCHC2jxnCc5QmN3lcZtXazXW5HWlphuoNT7F4O6wchhxuqMreqFbuqZHev+1lh/UqHgp8qxWtcLOdhz0Lb79q8rx7GHnU/WnZw9bmA686uzdDpjKLbSqvrB39LKYXIj7o3ROT+z/jMp0wzcwC6/axbxYOEaEP0D+/tw/QWYiIVNCnuefSKIaYQxgBOP83lNIYRZzSPO5Jg5xgtPQs9QjDUpD1VQpVNN040tIYx9iSpCM</latexit><latexit sha1_base64="d5dkFwYMjrRVW4ZWJb1a69SGAfg=">AAACbXichVHLSsNAFD2Nr1pfVVFERcRSdVVuRFC6Krhx6atVfFCSOGowTUKSFmro0o1rwYUoKIiIn+HGHxAsfoG4cKHgxoW3aUFU1DvMzJkz99w5M6Pahu56ROWQVFff0NgUbo60tLa1d0Q7uzKulXc0kdYsw3JWVMUVhm6KtKd7hlixHaHkVEMsq7szlf3lgnBc3TKXvKItNnLKtqlv6ZriMbUqsr6S9eXJUikbjVGCghj+CeQaiKX693sf2u5pzopeYh2bsKAhjxwETHiMDShwua1BBsFmbgM+cw4jPdgXKCHC2jxnCc5QmN3lcZtXazXW5HWlphuoNT7F4O6wchhxuqMreqFbuqZHev+1lh/UqHgp8qxWtcLOdhz0Lb79q8rx7GHnU/WnZw9bmA686uzdDpjKLbSqvrB39LKYXIj7o3ROT+z/jMp0wzcwC6/axbxYOEaEP0D+/tw/QWYiIVNCnuefSKIaYQxgBOP83lNIYRZzSPO5Jg5xgtPQs9QjDUpD1VQpVNN040tIYx9iSpCM</latexit><latexit sha1_base64="ssKOVKh6cPO0GqY8b0mrYArDyhY=">AAACbXichVHLSsNAFD2N7/qqiiAoIpaqq3IjguJKcOPSV6v4ICRxqqF5kaSFGvoDrgUXoqAgIn6GG3/AhZ8gLlxUcOPC2zQgKuodZubMmXvunJnRXNPwA6LHhNTU3NLa1t6R7Ozq7ulN9fXnfafk6SKnO6bjbWqqL0zDFrnACEyx6XpCtTRTbGjFxfr+Rll4vuHY60HFFbuWum8bBUNXA6a2hBKqSijPVKtKKk1ZimLsJ5BjkEYcy07qGjvYgwMdJVgQsBEwNqHC57YNGQSXuV2EzHmMjGhfoIoka0ucJThDZbbI4z6vtmPW5nW9ph+pdT7F5O6xcgwZeqAbqtE93dITvf9aK4xq1L1UeNYaWuEqvUdDa2//qiyeAxx8qv70HKCAucirwd7diKnfQm/oy4cntbX51Uw4QZf0zP4v6JHu+AZ2+VW/WhGrp0jyB8jfn/snyE9nZcrKK5RemI+/oh3DGMcUv/csFrCEZeT4XBvHOMN54kUalEak0UaqlIg1A/gS0uQHFzqNpw==</latexit> 2. aspect embedding E: word embedding weights a: attention score T: aspect embedding weights Sentence This beef looks delicious but the service is bad a_i 0.05 0.24 0.11 0.12 0.12 0.01 0.12 0.09 0.11 Aspect term beef
  • 18. Distance Calculation : : : : : : a1: beef, pork, … a2: waiter, … a5: cocktial, … a14: response, … : : : : : : a1: Main Dishes a2: Staff : : : : : : a5: Drink a14: Service Top Aspect Terms Assigning Aspect Names aspect ewbeef<latexit sha1_base64="nTAQr0FYpdZwnsl4h7BILRSDiAo=">AAACb3ichVHLSsNAFD2N7/qqulAUpFQU3ZQbN4qrghuXrdpWUClJnGpomoQkrWjoD/gBunChFkTEnxDc+AMu+gniSiq4ceFtWhAt6h1m5syZe+6cmVFtQ3c9olpI6ujs6u7p7Qv3DwwODUdGRjOuVXI0kdYsw3K2VMUVhm6KtKd7htiyHaEUVUNk1cJqYz9bFo6rW+amd2SL3aKyb+p5XVM8pnZEzj/M+aoQ+UolF5mhOAURbQdyC8wkYtXJewBJK3KDHezBgoYSihAw4TE2oMDltg0ZBJu5XfjMOYz0YF+ggjBrS5wlOENhtsDjPq+2W6zJ60ZNN1BrfIrB3WFlFLP0RLdUp0e6o2f6+LWWH9RoeDniWW1qhZ0bPpnYeP9XVeTZw8GX6k/PHvJYDrzq7N0OmMYttKa+fHxW31hZn/XnqEov7P+KavTANzDLb9p1SqyfI8wfIP987naQWYzLFJdT/BMraEYvphDDPL/3EhJYQxJpPtfGKS5wGXqVxqVpKdpMlUItzRi+hbTwCV84kNw=</latexit><latexit sha1_base64="syCDN1MN6Fh7l0LYJ9DhTdRJUxw=">AAACb3ichVHLSsNAFD2N7/po1YWiIEWpKEi5caO4Ety41GqtoBKSONXQNAlJWtHQH/ADdOHCB4iIW8EPcOMPuPATxJVUcOPC27QgWtQ7zMyZM/fcOTOjOabh+URPEampuaW1rb0j2tnV3ROL9/ateXbR1UVGt03bXddUT5iGJTK+4Zti3XGFWtBMkdXyC9X9bEm4nmFbq/6+I7YK6o5l5Axd9ZnaFEqwpwSaELlyWYmPUYrCSDQCuQ7G5kcvhm7vptJLdvwKm9iGDR1FFCBgwWdsQoXHbQMyCA5zWwiYcxkZ4b5AGVHWFjlLcIbKbJ7HHV5t1FmL19WaXqjW+RSTu8vKBJL0SNdUoQe6oWf6+LVWENaoetnnWatphaPEDgdX3v9VFXj2sful+tOzjxxmQ68Ge3dCpnoLvaYvHRxXVubSyWCcLuiF/Z/TE93zDazSm365LNIniPIHyD+fuxGsTadkSsnL/BNzqEU7hjGKCX7vGcxjEUvI8LkOjnCKs8irNCCNSIlaqhSpa/rxLaTJT3xFkgU=</latexit><latexit sha1_base64="syCDN1MN6Fh7l0LYJ9DhTdRJUxw=">AAACb3ichVHLSsNAFD2N7/po1YWiIEWpKEi5caO4Ety41GqtoBKSONXQNAlJWtHQH/ADdOHCB4iIW8EPcOMPuPATxJVUcOPC27QgWtQ7zMyZM/fcOTOjOabh+URPEampuaW1rb0j2tnV3ROL9/ateXbR1UVGt03bXddUT5iGJTK+4Zti3XGFWtBMkdXyC9X9bEm4nmFbq/6+I7YK6o5l5Axd9ZnaFEqwpwSaELlyWYmPUYrCSDQCuQ7G5kcvhm7vptJLdvwKm9iGDR1FFCBgwWdsQoXHbQMyCA5zWwiYcxkZ4b5AGVHWFjlLcIbKbJ7HHV5t1FmL19WaXqjW+RSTu8vKBJL0SNdUoQe6oWf6+LVWENaoetnnWatphaPEDgdX3v9VFXj2sful+tOzjxxmQ68Ge3dCpnoLvaYvHRxXVubSyWCcLuiF/Z/TE93zDazSm365LNIniPIHyD+fuxGsTadkSsnL/BNzqEU7hjGKCX7vGcxjEUvI8LkOjnCKs8irNCCNSIlaqhSpa/rxLaTJT3xFkgU=</latexit><latexit sha1_base64="YNu79Lt3u+Fb/pnKAm3SIfRvcog=">AAACb3ichVHLSsNAFD2Nr1pfVRcKghSLopty40bpquDGZatWBZWQxKkG0yQkaaWG/oAfoAsXPkBE/Aw3/oALP0FciYIbF96kAVFR7zAzZ87cc+fMjOaYhucTPSSktvaOzq5kd6qnt69/ID04tOrZNVcXZd02bXddUz1hGpYo+4ZvinXHFWpVM8WatrcQ7q/VhesZtrXiNxyxVVV3LKNi6KrP1KZQgn0l0ISoNJtKOks5iiLzE8gxyCKOop2+wia2YUNHDVUIWPAZm1DhcduADILD3BYC5lxGRrQv0ESKtTXOEpyhMrvH4w6vNmLW4nVY04vUOp9icndZmcEk3dM1vdAd3dAjvf9aK4hqhF4aPGstrXCUgcPR5bd/VVWefex+qv707KOC+cirwd6diAlvobf09YPjl+X80mQwRRf0xP7P6YFu+QZW/VW/LImlE6T4A+Tvz/0TrM7mZMrJJcoW8vFXJDGGCUzze8+hgEUUUeZzHRzhFGeJZ2lEGpcyrVQpEWuG8SWkmQ/yYI7+</latexit> ewpork<latexit sha1_base64="A84rQjWnEeSSuC8YvW7pjybznz8=">AAACb3ichVHLSsNAFD2N7/po1YWiIKVF0U25caO4Ety4rI9qoS0liaOGpklI0oqG/oAfoAsXakFE/AnBjT/gwk8QV1LBjQtv04JoUe8wM2fO3HPnzIxqG7rrET2FpI7Oru6e3r5w/8DgUCQ6PLLlWmVHE2nNMiwnoyquMHRTpD3dM0TGdoRSUg2xrRZXGvvbFeG4umVueoe2yJeUPVPf1TXFYyonCv5Bwbctp1itFqIJSlIQsXYgt0BiOV6buAOQsqLXyGEHFjSUUYKACY+xAQUutyxkEGzm8vCZcxjpwb5AFWHWljlLcIbCbJHHPV5lW6zJ60ZNN1BrfIrB3WFlDNP0SDdUpwe6pWf6+LWWH9RoeDnkWW1qhV2IHI9vvP+rKvHsYf9L9adnD7tYDLzq7N0OmMYttKa+cnRa31han/ZnqEYv7P+Snuieb2BW3rSrNbF+hjB/gPzzudvB1nxSpqS8xj+xhGb0YhJxzPJ7L2AZq0ghzefaOME5LkKv0pg0JcWaqVKopRnFt5DmPgGz15EG</latexit><latexit sha1_base64="HbvIJHyGHTyWelCGOiM6BTF2gqI=">AAACb3ichVHLSsNAFD2N7/qqulAUpLQoClJu3CiuBDcutdpW0BKSOGpomoQkrWjoD/gBunDhA0TEreAHuPEHXPgJ4koU3LjwNi2IFvUOM3PmzD13zsxojml4PtFjRGpqbmlta++IdnZ19/TG+vqznl1ydZHRbdN21zTVE6ZhiYxv+KZYc1yhFjVT5LTCQnU/VxauZ9jWqr/niHxR3baMLUNXfaY2hBLsKoFju4VKRYklKUVhxBuBXAfJ+cT58M3tVHrJjl1iA5uwoaOEIgQs+IxNqPC4rUMGwWEuj4A5l5ER7gtUEGVtibMEZ6jMFnjc5tV6nbV4Xa3phWqdTzG5u6yMY4we6Ipe6Z6u6Yk+fq0VhDWqXvZ41mpa4Si9B0Mr7/+qijz72PlS/enZxxZmQ68Ge3dCpnoLvaYv7x+9rsylx4JxOqdn9n9Gj3THN7DKb/rFskgfI8ofIP987kaQnU7JlJKX+SfmUIt2jCCBCX7vGcxjEUvI8LkODnGC08iLNCiNSvFaqhSpawbwLaTJT9Dkki8=</latexit><latexit sha1_base64="HbvIJHyGHTyWelCGOiM6BTF2gqI=">AAACb3ichVHLSsNAFD2N7/qqulAUpLQoClJu3CiuBDcutdpW0BKSOGpomoQkrWjoD/gBunDhA0TEreAHuPEHXPgJ4koU3LjwNi2IFvUOM3PmzD13zsxojml4PtFjRGpqbmlta++IdnZ19/TG+vqznl1ydZHRbdN21zTVE6ZhiYxv+KZYc1yhFjVT5LTCQnU/VxauZ9jWqr/niHxR3baMLUNXfaY2hBLsKoFju4VKRYklKUVhxBuBXAfJ+cT58M3tVHrJjl1iA5uwoaOEIgQs+IxNqPC4rUMGwWEuj4A5l5ER7gtUEGVtibMEZ6jMFnjc5tV6nbV4Xa3phWqdTzG5u6yMY4we6Ipe6Z6u6Yk+fq0VhDWqXvZ41mpa4Si9B0Mr7/+qijz72PlS/enZxxZmQ68Ge3dCpnoLvaYv7x+9rsylx4JxOqdn9n9Gj3THN7DKb/rFskgfI8ofIP987kaQnU7JlJKX+SfmUIt2jCCBCX7vGcxjEUvI8LkODnGC08iLNCiNSvFaqhSpawbwLaTJT9Dkki8=</latexit><latexit sha1_base64="bFDS3QHKWLbLL8KP8JOmnxi5p6Q=">AAACb3ichVHLSsNAFD2N7/qqulAQpFgU3ZQbN4orwY1L29pWaEtJ4qihaRKStKKhP+AH6MKFDxARP8ONP+CinyCuRMGNC2/TgGhR7zAzZ87cc+fMjGobuusRNSNSV3dPb1//QHRwaHhkNDY2nnOtmqOJrGYZlrOtKq4wdFNkPd0zxLbtCKWqGiKvVtZb+/m6cFzdMre8Q1uUqsqeqe/qmuIxVRRl/6Ds25ZTaTTKsQQlKYh4J5BDkEAYm1bsBkXswIKGGqoQMOExNqDA5VaADILNXAk+cw4jPdgXaCDK2hpnCc5QmK3wuMerQsiavG7VdAO1xqcY3B1WxjFHj3RLr/RAd/REH7/W8oMaLS+HPKttrbDLo8dTmfd/VVWePex/qf707GEXK4FXnb3bAdO6hdbW149OXzOr6Tl/nq7omf1fUpPu+QZm/U27Ton0GaL8AfLP5+4EuaWkTEk5RYm11fAr+jGNWSzwey9jDRvYRJbPtXGCc1xEXqRJaUaKt1OlSKiZwLeQFj8BRw6PKA==</latexit> ewwaiter<latexit sha1_base64="PmNoZsFA+652kk3B2CbeiL5tq2I=">AAACcXichVG7SgNBFD1Z3/GRqCA+mqAoghDu2ihWgo1lfMQEfITdddQhm91ldxLRkNLGH1CwiiAifoaNP2BhZyuWEWwsvNkEREW9M7tz5sw9d87MmJ4tA0X0GNFaWtvaOzq7ot09vX2xeP/ARuAWfUukLdd2/axpBMKWjkgrqWyR9XxhFExbZMz8Un09UxJ+IF1nXR15Yrtg7DtyT1qGYmpH5MqH3A2phF+p5OITlKQwEj+B3gQTi6MnQ08AUm78GlvYhQsLRRQg4EAxtmEg4LYJHQSPuW2UmfMZyXBdoIIoa4ucJTjDYDbP/32ebTZZh+f1mkGotngXmz+flQlM0gPdUI3u6Zae6f3XWuWwRt3LEY9mQyu8XOx0eO3tX1WBR4WDT9WfnhX2MB96lezdC5n6KayGvnR8VltbWJ0sT9ElvbD/Kj3SHZ/AKb1aVyti9QJRfgD9+3X/BBuzSZ2S+gq/xAIa0YkxjGOa73sOi1hGCmne18c5qriM1LQRLaGNN1K1SFMziC+hzXwAmJiR4Q==</latexit><latexit sha1_base64="A3sYpOu9isJ0z+a3pVf+h27HhXg=">AAACcXichVHLSsNAFD2N7/poVRAfm6IoglBu3CiuCm5c1kdV8FGSOOpgmoRkWtHSpRt/QMFVCyLiZ7jxBwTFLxCXFdy48DYtiIp6Z5I5c+aeO2dmTM+WgSJ6jGhNzS2tbe0d0c6u7p5YvLdvNXDzviUylmu7/rppBMKWjsgoqWyx7vnCyJm2WDMP5mvrawXhB9J1VtSRJ7Zyxp4jd6VlKKa2RbZ4yN2QSvilUjY+RkkKI/ET6A0wlho+GXjqfqC0G7/CJnbgwkIeOQg4UIxtGAi4bUAHwWNuC0XmfEYyXBcoIcraPGcJzjCYPeD/Hs82GqzD81rNIFRbvIvNn8/KBMbpnq6pSnd0Q8/0/mutYlij5uWIR7OuFV42djq4/PavKsejwv6n6k/PCruYDb1K9u6FTO0UVl1fOD6rLs8tjRcnqEIv7L9Mj3TLJ3AKr9bloli6QJQfQP9+3T/B6nRSp6S+yC8xh3q0YwSjmOT7nkEKC0gjw/v6OEcZlUhVG9IS2mg9VYs0NP34EtrUB4epkvE=</latexit><latexit sha1_base64="A3sYpOu9isJ0z+a3pVf+h27HhXg=">AAACcXichVHLSsNAFD2N7/poVRAfm6IoglBu3CiuCm5c1kdV8FGSOOpgmoRkWtHSpRt/QMFVCyLiZ7jxBwTFLxCXFdy48DYtiIp6Z5I5c+aeO2dmTM+WgSJ6jGhNzS2tbe0d0c6u7p5YvLdvNXDzviUylmu7/rppBMKWjsgoqWyx7vnCyJm2WDMP5mvrawXhB9J1VtSRJ7Zyxp4jd6VlKKa2RbZ4yN2QSvilUjY+RkkKI/ET6A0wlho+GXjqfqC0G7/CJnbgwkIeOQg4UIxtGAi4bUAHwWNuC0XmfEYyXBcoIcraPGcJzjCYPeD/Hs82GqzD81rNIFRbvIvNn8/KBMbpnq6pSnd0Q8/0/mutYlij5uWIR7OuFV42djq4/PavKsejwv6n6k/PCruYDb1K9u6FTO0UVl1fOD6rLs8tjRcnqEIv7L9Mj3TLJ3AKr9bloli6QJQfQP9+3T/B6nRSp6S+yC8xh3q0YwSjmOT7nkEKC0gjw/v6OEcZlUhVG9IS2mg9VYs0NP34EtrUB4epkvE=</latexit><latexit sha1_base64="qYqXi/PPbz9w5bcVow2/0UI+iYE=">AAACcXichVHLSsNAFD2Nr1pfVTeKm2JRBKHcuFFcCW5c1tZWwUdJ4qhD0yQk04qW/oA/oOBKQUT8DDf+gIt+gris4MaFt2lAVNQ7k8yZM/fcOTNjerYMFFEzpnV19/T2xfsTA4NDwyPJ0bFi4FZ9SxQs13b9LdMIhC0dUVBS2WLL84VRMW2xaZZX2+ubNeEH0nU21IkndivGoSMPpGUopvZEqX7M3ZBK+I1GKZmmDIWR+gn0CKQRRdZN3mIH+3BhoYoKBBwoxjYMBNy2oYPgMbeLOnM+IxmuCzSQYG2VswRnGMyW+X/Is+2IdXjerhmEaot3sfnzWZnCDD3RHbXoke7pmd5/rVUPa7S9nPBodrTCK42cTeTf/lVVeFQ4+lT96VnhAEuhV8nevZBpn8Lq6Gun5638cm6mPkvX9ML+r6hJD3wCp/Zq3ayL3CUS/AD69+v+CYoLGZ0y+jqlV5ajp4hjCtOY4/texArWkEWB9/VxgStcx1rapJbSpjupWizSjONLaPMfPJmQDA==</latexit> ewcocktial<latexit sha1_base64="8HJFznyVgGBG0Jl5kcjmfLuqKTw=">AAACdXichVFNLyxBFD3TPt88H42NRCTiezVu2xAriY2lr0HiSae7FCrT093prhmhM3/AH7BgQ+KJ+Bk2EmsLP0EsSWws3OmZRBDcSlWdOnXPrVNVbuipWBPdZ4yGxqbmltY/2b9t7R2dZlf3ahyUIiHzIvCCaN11YukpX+a10p5cDyPpFF1PrrmFuer+WllGsQr8Fb0fys2is+OrbSUczZRtmtJO9uxEBKKgleNVKrY5RDlKY+ArsOpgaLZv7BYcC4F5gX/YQgCBEoqQ8KEZe3AQc9uABULI3CYS5iJGKt2XqCDL2hJnSc5wmC3wuMOrjTrr87paM07Vgk/xuEesHMAI3dElPdENXdEDvX5bK0lrVL3s8+zWtDK0Ow97l19+VRV51th9V/3oWWMb06lXxd7DlKneQtT05YOjp+WZpZFklM7okf2f0j1d8w388rM4X5RLx8jyB1ifn/srWJ3MWZSzFvknZlCLVvRhEOP83lOYxTwWkOdzyzjBOf5nXox+Y9gYraUambqmBx/CmHgD+YeSXA==</latexit><latexit sha1_base64="7a7FAzQgyauTWn52K1Sj5qH3gyc=">AAACdXichVHPSxtBGH3Z2jZNf7jWS0EEqSb2lH7bSyUnwYtHTZooaFh2p5M4ZLO77E4iugQ8+w940EsLtoh/Ri+ldw/+CbbHFLz04JdNQDS0/YaZefPme9+8mXFDT8Wa6DJjPJh4+Ohx9knu6bPnLybNqZe1OOhEQlZF4AXRpuvE0lO+rGqlPbkZRtJpu57ccFsrg/2NroxiFfgf9F4o622n6auGEo5myjZNaSe7diIC0dLK8Xo925ynIqUxNw6sEZhfnln88VP3DtYC8yu28REBBDpoQ8KHZuzBQcxtCxYIIXN1JMxFjFS6L9FDjrUdzpKc4TDb4rHJq60R6/N6UDNO1YJP8bhHrJxDni7ojPr0nc7piv78tVaS1hh42ePZHWplaE8evqpc/1fV5llj51b1T88aDSylXhV7D1NmcAsx1Hf3j/qVUjmfFOgz/WL/n+iSvvEN/O5vcbouy8fI8QdY9597HNTeFS0qWuv8EyUMI4sZvMYbfu/3WMYq1lDlc7s4wSm+ZK6NWWPBKAxTjcxIM407Yby9AUNrlLY=</latexit><latexit sha1_base64="7a7FAzQgyauTWn52K1Sj5qH3gyc=">AAACdXichVHPSxtBGH3Z2jZNf7jWS0EEqSb2lH7bSyUnwYtHTZooaFh2p5M4ZLO77E4iugQ8+w940EsLtoh/Ri+ldw/+CbbHFLz04JdNQDS0/YaZefPme9+8mXFDT8Wa6DJjPJh4+Ohx9knu6bPnLybNqZe1OOhEQlZF4AXRpuvE0lO+rGqlPbkZRtJpu57ccFsrg/2NroxiFfgf9F4o622n6auGEo5myjZNaSe7diIC0dLK8Xo925ynIqUxNw6sEZhfnln88VP3DtYC8yu28REBBDpoQ8KHZuzBQcxtCxYIIXN1JMxFjFS6L9FDjrUdzpKc4TDb4rHJq60R6/N6UDNO1YJP8bhHrJxDni7ojPr0nc7piv78tVaS1hh42ePZHWplaE8evqpc/1fV5llj51b1T88aDSylXhV7D1NmcAsx1Hf3j/qVUjmfFOgz/WL/n+iSvvEN/O5vcbouy8fI8QdY9597HNTeFS0qWuv8EyUMI4sZvMYbfu/3WMYq1lDlc7s4wSm+ZK6NWWPBKAxTjcxIM407Yby9AUNrlLY=</latexit><latexit sha1_base64="bs8QlLljyYde7WbNFuyzJJm+ZMk=">AAACVXichVG7SgNBFD1ZX3F9JMFGsAmGiFW4a6NYCTaWeZgHxBB2N6Mu2ewuu5tADP5AWgsLKwUR8TNs/AGL9DZiGcHGwrubgKiod5iZM2fm3DlzR3NMw/OJBhFpYnJqeiY6K8/NywuLsfh8ybPbri6Kum3abkVTPWEalij6hm+KiuMKtaWZoqw1d4P9cke4nmFb+37XEbWWemQZh4au+kxl6/EUZSiM5E+gjEEK47DjNzhAAzZ0tNGCgAWfsQkVHrcqFBAc5mroMecyMsJ9gVPIrG3zKcEnVGabPB7xqjpmLV4HOb1QrfMtJneXlUmk6ZFuaUgPdEfP9P5rrl6YI/DS5VkbaYVTj/WXC2//qlo8+zj+VP3p2cchtkKvBnt3QiZ4hT7Sd07Oh4XtfLq3Rlf0wv4vaUD3/AKr86pf50T+AjLXX/le7Z+gtJFRKKPkCFGsYBXrXOZN7GAPWRT5ugb6OIs8SbKUGP2TFBl/WAJfQlr6AAYJh7c=</latexit><latexit sha1_base64="sWBrZaEvS/eEo57+vJsgnYDVZGs=">AAACanichVHLLgRBFD3TXmO8mpVEJOIVq8ltG2IlsbH0GiRIp7sUKtPT3emuGaEzP+AHLNiQIOIzbPyAxXyCWJLYWLjTM4kguJWqOnWqzq1Tdd3QU7EmqmWMlta29o5sZ66ru6e3z+zvXo+DciRkQQReEG26Tiw95cuCVtqTm2EknZLryQ23uFDf36jIKFaBv6aPQrlTcvZ9taeEo5myTVPayaGdiEAUtXK8atU2xyhPaYz8BFYTjKEZS4F5g23sIoBAGSVI+NCMPTiIuW3BAiFkbgcJcxEjle5LVJFjbZlPST7hMFvkcZ9XW03W53U9Z5yqBd/icY9YOYIJeqRbeqEHuqMnev81V5LmqHs54tltaGVo950Mrr79qyrxrHHwqfrTs8YeZlOvir2HKVN/hWjoK8enL6tzKxPJJF3SM/u/oBrd8wv8yqu4WpYrZ8hxAazv3/0TrE/nLcpby4QshjCKKf7mGcxjEUso8HUVnOMK15k3Y9gYb5TKyDRrNoAvYUx+AFjUkDo=</latexit><latexit sha1_base64="sWBrZaEvS/eEo57+vJsgnYDVZGs=">AAACanichVHLLgRBFD3TXmO8mpVEJOIVq8ltG2IlsbH0GiRIp7sUKtPT3emuGaEzP+AHLNiQIOIzbPyAxXyCWJLYWLjTM4kguJWqOnWqzq1Tdd3QU7EmqmWMlta29o5sZ66ru6e3z+zvXo+DciRkQQReEG26Tiw95cuCVtqTm2EknZLryQ23uFDf36jIKFaBv6aPQrlTcvZ9taeEo5myTVPayaGdiEAUtXK8atU2xyhPaYz8BFYTjKEZS4F5g23sIoBAGSVI+NCMPTiIuW3BAiFkbgcJcxEjle5LVJFjbZlPST7hMFvkcZ9XW03W53U9Z5yqBd/icY9YOYIJeqRbeqEHuqMnev81V5LmqHs54tltaGVo950Mrr79qyrxrHHwqfrTs8YeZlOvir2HKVN/hWjoK8enL6tzKxPJJF3SM/u/oBrd8wv8yqu4WpYrZ8hxAazv3/0TrE/nLcpby4QshjCKKf7mGcxjEUso8HUVnOMK15k3Y9gYb5TKyDRrNoAvYUx+AFjUkDo=</latexit><latexit sha1_base64="0UPNXTQXnrq7zvB0as9gwdeadD8=">AAACdXichVHLSuRAFD0dn9M+OjobQQSxVVy1N24UV8JsZuljWgWVkJSlFp1OQlLdoqF/wB+YhW4UdBA/w40/4MJPGFwquHHh7XRAVNRbVNWpU/fcOlXlhp6KNdFdzmhr7+js6v6R7+nt6y+YA4OrcVCLhCyLwAuiddeJpad8WdZKe3I9jKRTdT255lZ+NffX6jKKVeD/0Qeh3Ko6u77aUcLRTNmmKe1k305EICpaOV6jYZtFKlEaox+BlYEislgMzH/YxDYCCNRQhYQPzdiDg5jbBiwQQua2kDAXMVLpvkQDedbWOEtyhsNshcddXm1krM/rZs04VQs+xeMesXIUE3RLl/RAN3RF/+n501pJWqPp5YBnt6WVoV04Glp5+lZV5Vlj71X1pWeNHcylXhV7D1OmeQvR0tcP/z6szC9PJJN0Rvfs/5Tu6Jpv4NcfxfmSXD5Gnj/Aev/cH8HqTMmikrVExYX57Cu6MYwxTPF7z2IBv7GIMp9bxwnOcZF7MkaMcWOylWrkMs1PvAlj+gWWO5EP</latexit><latexit sha1_base64="0UPNXTQXnrq7zvB0as9gwdeadD8=">AAACdXichVHLSuRAFD0dn9M+OjobQQSxVVy1N24UV8JsZuljWgWVkJSlFp1OQlLdoqF/wB+YhW4UdBA/w40/4MJPGFwquHHh7XRAVNRbVNWpU/fcOlXlhp6KNdFdzmhr7+js6v6R7+nt6y+YA4OrcVCLhCyLwAuiddeJpad8WdZKe3I9jKRTdT255lZ+NffX6jKKVeD/0Qeh3Ko6u77aUcLRTNmmKe1k305EICpaOV6jYZtFKlEaox+BlYEislgMzH/YxDYCCNRQhYQPzdiDg5jbBiwQQua2kDAXMVLpvkQDedbWOEtyhsNshcddXm1krM/rZs04VQs+xeMesXIUE3RLl/RAN3RF/+n501pJWqPp5YBnt6WVoV04Glp5+lZV5Vlj71X1pWeNHcylXhV7D1OmeQvR0tcP/z6szC9PJJN0Rvfs/5Tu6Jpv4NcfxfmSXD5Gnj/Aev/cH8HqTMmikrVExYX57Cu6MYwxTPF7z2IBv7GIMp9bxwnOcZF7MkaMcWOylWrkMs1PvAlj+gWWO5EP</latexit><latexit sha1_base64="7a7FAzQgyauTWn52K1Sj5qH3gyc=">AAACdXichVHPSxtBGH3Z2jZNf7jWS0EEqSb2lH7bSyUnwYtHTZooaFh2p5M4ZLO77E4iugQ8+w940EsLtoh/Ri+ldw/+CbbHFLz04JdNQDS0/YaZefPme9+8mXFDT8Wa6DJjPJh4+Ohx9knu6bPnLybNqZe1OOhEQlZF4AXRpuvE0lO+rGqlPbkZRtJpu57ccFsrg/2NroxiFfgf9F4o622n6auGEo5myjZNaSe7diIC0dLK8Xo925ynIqUxNw6sEZhfnln88VP3DtYC8yu28REBBDpoQ8KHZuzBQcxtCxYIIXN1JMxFjFS6L9FDjrUdzpKc4TDb4rHJq60R6/N6UDNO1YJP8bhHrJxDni7ojPr0nc7piv78tVaS1hh42ePZHWplaE8evqpc/1fV5llj51b1T88aDSylXhV7D1NmcAsx1Hf3j/qVUjmfFOgz/WL/n+iSvvEN/O5vcbouy8fI8QdY9597HNTeFS0qWuv8EyUMI4sZvMYbfu/3WMYq1lDlc7s4wSm+ZK6NWWPBKAxTjcxIM407Yby9AUNrlLY=</latexit><latexit sha1_base64="7a7FAzQgyauTWn52K1Sj5qH3gyc=">AAACdXichVHPSxtBGH3Z2jZNf7jWS0EEqSb2lH7bSyUnwYtHTZooaFh2p5M4ZLO77E4iugQ8+w940EsLtoh/Ri+ldw/+CbbHFLz04JdNQDS0/YaZefPme9+8mXFDT8Wa6DJjPJh4+Ohx9knu6bPnLybNqZe1OOhEQlZF4AXRpuvE0lO+rGqlPbkZRtJpu57ccFsrg/2NroxiFfgf9F4o622n6auGEo5myjZNaSe7diIC0dLK8Xo925ynIqUxNw6sEZhfnln88VP3DtYC8yu28REBBDpoQ8KHZuzBQcxtCxYIIXN1JMxFjFS6L9FDjrUdzpKc4TDb4rHJq60R6/N6UDNO1YJP8bhHrJxDni7ojPr0nc7piv78tVaS1hh42ePZHWplaE8evqpc/1fV5llj51b1T88aDSylXhV7D1NmcAsx1Hf3j/qVUjmfFOgz/WL/n+iSvvEN/O5vcbouy8fI8QdY9597HNTeFS0qWuv8EyUMI4sZvMYbfu/3WMYq1lDlc7s4wSm+ZK6NWWPBKAxTjcxIM407Yby9AUNrlLY=</latexit><latexit sha1_base64="7a7FAzQgyauTWn52K1Sj5qH3gyc=">AAACdXichVHPSxtBGH3Z2jZNf7jWS0EEqSb2lH7bSyUnwYtHTZooaFh2p5M4ZLO77E4iugQ8+w940EsLtoh/Ri+ldw/+CbbHFLz04JdNQDS0/YaZefPme9+8mXFDT8Wa6DJjPJh4+Ohx9knu6bPnLybNqZe1OOhEQlZF4AXRpuvE0lO+rGqlPbkZRtJpu57ccFsrg/2NroxiFfgf9F4o622n6auGEo5myjZNaSe7diIC0dLK8Xo925ynIqUxNw6sEZhfnln88VP3DtYC8yu28REBBDpoQ8KHZuzBQcxtCxYIIXN1JMxFjFS6L9FDjrUdzpKc4TDb4rHJq60R6/N6UDNO1YJP8bhHrJxDni7ojPr0nc7piv78tVaS1hh42ePZHWplaE8evqpc/1fV5llj51b1T88aDSylXhV7D1NmcAsx1Hf3j/qVUjmfFOgz/WL/n+iSvvEN/O5vcbouy8fI8QdY9597HNTeFS0qWuv8EyUMI4sZvMYbfu/3WMYq1lDlc7s4wSm+ZK6NWWPBKAxTjcxIM407Yby9AUNrlLY=</latexit><latexit sha1_base64="7a7FAzQgyauTWn52K1Sj5qH3gyc=">AAACdXichVHPSxtBGH3Z2jZNf7jWS0EEqSb2lH7bSyUnwYtHTZooaFh2p5M4ZLO77E4iugQ8+w940EsLtoh/Ri+ldw/+CbbHFLz04JdNQDS0/YaZefPme9+8mXFDT8Wa6DJjPJh4+Ohx9knu6bPnLybNqZe1OOhEQlZF4AXRpuvE0lO+rGqlPbkZRtJpu57ccFsrg/2NroxiFfgf9F4o622n6auGEo5myjZNaSe7diIC0dLK8Xo925ynIqUxNw6sEZhfnln88VP3DtYC8yu28REBBDpoQ8KHZuzBQcxtCxYIIXN1JMxFjFS6L9FDjrUdzpKc4TDb4rHJq60R6/N6UDNO1YJP8bhHrJxDni7ojPr0nc7piv78tVaS1hh42ePZHWplaE8evqpc/1fV5llj51b1T88aDSylXhV7D1NmcAsx1Hf3j/qVUjmfFOgz/WL/n+iSvvEN/O5vcbouy8fI8QdY9597HNTeFS0qWuv8EyUMI4sZvMYbfu/3WMYq1lDlc7s4wSm+ZK6NWWPBKAxTjcxIM407Yby9AUNrlLY=</latexit><latexit sha1_base64="0UPNXTQXnrq7zvB0as9gwdeadD8=">AAACdXichVHLSuRAFD0dn9M+OjobQQSxVVy1N24UV8JsZuljWgWVkJSlFp1OQlLdoqF/wB+YhW4UdBA/w40/4MJPGFwquHHh7XRAVNRbVNWpU/fcOlXlhp6KNdFdzmhr7+js6v6R7+nt6y+YA4OrcVCLhCyLwAuiddeJpad8WdZKe3I9jKRTdT255lZ+NffX6jKKVeD/0Qeh3Ko6u77aUcLRTNmmKe1k305EICpaOV6jYZtFKlEaox+BlYEislgMzH/YxDYCCNRQhYQPzdiDg5jbBiwQQua2kDAXMVLpvkQDedbWOEtyhsNshcddXm1krM/rZs04VQs+xeMesXIUE3RLl/RAN3RF/+n501pJWqPp5YBnt6WVoV04Glp5+lZV5Vlj71X1pWeNHcylXhV7D1OmeQvR0tcP/z6szC9PJJN0Rvfs/5Tu6Jpv4NcfxfmSXD5Gnj/Aev/cH8HqTMmikrVExYX57Cu6MYwxTPF7z2IBv7GIMp9bxwnOcZF7MkaMcWOylWrkMs1PvAlj+gWWO5EP</latexit> ewresponse<latexit sha1_base64="hngTAhHM/ixYcrISH2cdlT07acI=">AAACdXichVHLSsNAFD2Nr1pfUTeCCOILV/XGjdKV4MZlba0KKiGJ0xqaF0la0dAf8Adc6EZBRfwL3fgDLvoJ4lKhGxfepgVRUe8wM2fO3HPnzIzuWWYQEtUTUkdnV3dPsjfV1z8wOCQPj2wGbsU3RMFwLdff1rVAWKYjCqEZWmLb84Vm65bY0surzf2tqvAD03U2wiNP7NlayTGLpqGFTKmyLNToUI18EXiuE4haTZWnKU1xTP4EShtMr0xl78GRdeUb7GIfLgxUYEPAQcjYgoaA2w4UEDzm9hAx5zMy432BGlKsrXCW4AyN2TKPJV7ttFmH182aQaw2+BSLu8/KSczSE93SKz3SHT3T+6+1orhG08sRz3pLKzx16GQs3/hXZfMc4uBT9afnEEUsx15N9u7FTPMWRktfPT59zWdys9EcXdIL+7+gOj3wDZzqm3G1LnJnSPEHKN+f+yfYXEwrlFbW+ScyaEUS45jCPL/3ElawhiwKfG4V57jCdaIhTUgz0lwrVUq0NaP4EtLCB4wokqg=</latexit><latexit sha1_base64="LgUEOfvEZlucjr1L0ucsf2dejUs=">AAACdXichVHLSsNAFD2Nr1ofjboRRBAfxVW96cbSVcGNy/qoCiohiVMNTZOQpJUa+gNuXLrQjYKK+BXixh9w4SeISwU3LrxNC6Ki3mFmzpy5586ZGd21TD8geoxJHZ1d3T3x3kRf/8BgUh4aXvOdqmeIouFYjreha76wTFsUAzOwxIbrCa2iW2JdLy8099drwvNNx14N6q7Yrmi7tlkyDS1gSpVloYb7augJ33VsXzQaqjxFaYpi4idQ2mAqP1m4fT/KZAuOfIUt7MCBgSoqELARMLagwee2CQUEl7lthMx5jMxoX6CBBGurnCU4Q2O2zOMurzbbrM3rZk0/Uht8isXdY+UEZuiBrumF7umGnuj911phVKPppc6z3tIKV00ejq68/auq8Bxg71P1p+cAJWQjryZ7dyOmeQujpa8dHL+s5JZnwhSd0zP7P6NHuuMb2LVX42JJLJ8gwR+gfH/un2Atk1YorSzxT+TQijjGMIlZfu955LGIAop8bg2nuMBl7E0al6alVCtVirU1I/gS0twHHNiUnA==</latexit><latexit sha1_base64="LgUEOfvEZlucjr1L0ucsf2dejUs=">AAACdXichVHLSsNAFD2Nr1ofjboRRBAfxVW96cbSVcGNy/qoCiohiVMNTZOQpJUa+gNuXLrQjYKK+BXixh9w4SeISwU3LrxNC6Ki3mFmzpy5586ZGd21TD8geoxJHZ1d3T3x3kRf/8BgUh4aXvOdqmeIouFYjreha76wTFsUAzOwxIbrCa2iW2JdLy8099drwvNNx14N6q7Yrmi7tlkyDS1gSpVloYb7augJ33VsXzQaqjxFaYpi4idQ2mAqP1m4fT/KZAuOfIUt7MCBgSoqELARMLagwee2CQUEl7lthMx5jMxoX6CBBGurnCU4Q2O2zOMurzbbrM3rZk0/Uht8isXdY+UEZuiBrumF7umGnuj911phVKPppc6z3tIKV00ejq68/auq8Bxg71P1p+cAJWQjryZ7dyOmeQujpa8dHL+s5JZnwhSd0zP7P6NHuuMb2LVX42JJLJ8gwR+gfH/un2Atk1YorSzxT+TQijjGMIlZfu955LGIAop8bg2nuMBl7E0al6alVCtVirU1I/gS0twHHNiUnA==</latexit><latexit sha1_base64="51hvYFkYkO9rd+MPiBiyAKhiIOw=">AAACdXichVHLSsNAFD2Nr1pfUTeCCMVqcVVv3CiuCm5cWrVaUAlJnGowTUKSVjT0B/wBF7pRqCJ+hht/wIWfIC4rdOPC2zQgKuodZubMmXvunJnRXcv0A6LnhNTV3dPbl+xPDQwODY/Io2NbvlP1DFE0HMvxSrrmC8u0RTEwA0uUXE9oFd0S2/rRSnt/uyY833TszeDEFXsV7cA2y6ahBUypsizU8FgNPeG7ju2Lel2VM5SjKNI/gRKDDOJYc+Rb7GIfDgxUUYGAjYCxBQ0+tx0oILjM7SFkzmNkRvsCdaRYW+UswRkas0c8HvBqJ2ZtXrdr+pHa4FMs7h4r05ilJ7qjJj3SPb3Q+6+1wqhG28sJz3pHK1x15Gxio/WvqsJzgMNP1Z+eA5SxFHk12bsbMe1bGB197fS8ubG8Phtm6Zpe2f8VPdMD38CuvRmNgli/QIo/QPn+3D/B1kJOoZxSoEx+Of6KJCYxjTl+70XksYo1FPncGi7RwE2iJU1JM1K2kyolYs04voQ0/wHhI5E0</latexit> 2. 18 clustering naming aspect term embedding aspect embedding aspect aspect term
  • 19. aspect term true aspect labelaspect name 19 2.
  • 20. 20 1. 2. 3. • Dataset • Aspect Quality Evaluation • Coherence score • User Evaluation • Aspect Identification • Effectiveness of Attention Model 4.
  • 21. Dataset • LocLDA: LDA • K-means: • meansSAS: • BTM: (twitter ) biterm 21 
 The wait staff is nice, but they are kind of inattentive 3.