An approach to semantics word extraction by applying language phonology in rakuten
An approach to semantics word extraction by applying language phonology in rakuten
In its daily business activities, Rakuten has experienced massive and diverse increases in the quantity of data, for example, product information, merchant information, and customer activities (e.g., queries, emails, reviews, helpdesk, etc.). In view of this, the identification of each entity is vitally important for an e-commerce search engine to find those exactly what the users want. An approach of matching semantic information is very useful in solving the variety of representations and meanings of those entities since the variations of user-created entities cannot be resolved in all cases. One very basic but powerful approach is therefore to consolidate a dictionary and to update this dictionary through the data-driven extraction of entities. A phonetic-based approach is a useful method of identifying these entities. Our method consists of three parts: preprocessing, measuring phonetic similarity,and postprocessing. Our model is trained on phonetic representations of unlabeled data using an unsupervised EM algorithm and is tested on the extraction of entity-word pairs. On average, the results of testing achieved the highest level of performance.
More Related Content
More from Rakuten Group, Inc.
More from Rakuten Group, Inc.(20)
Recently uploaded
Recently uploaded(20)
![[2023] Putting the R! in R&D.pdf](https://cdn.slidesharecdn.com/ss_thumbnails/2023puttingtherinrd-231122234738-294b2909-thumbnail.jpg?width=768&fit=bounds)
An approach to semantics word extraction by applying language phonology in rakuten
- 2. 2
- 5. 5 籠 篭 バスケット ヘアーアイロン
- 6. 6
- 7. 7 ワンピース デザイン ボタニカル柄 ミセス ファッション キャロルグレイ … … … … … …
- 8. 8 … … ワンピース デザイン ボタニカル柄 ミセス ファッション キャロルグレイ … …
- 9. 9 • •
- 10. 10 • • •
- 13. 13 ʋ A part of CLSG