This document provides an overview of preferred natural language processing infrastructure and techniques. It discusses recurrent neural networks, statistical machine translation tools like GIZA++ and Moses, voice recognition systems from NICT and NTT, topic modeling using latent Dirichlet allocation, dependency parsing with minimum spanning trees, and recursive neural networks for natural language tasks. References are provided for several papers on these methods.

1. Preferred Infrastructure
2015/03/16
in

2. 人間が日常的に使っている自然言語をコン
ピュータに処理させる一連の技術であり、
人工知能と言語学の一分野である。

3. 2
!
!

4. ! 2008
! 2008
! 2011
!
! Jubatus
NLP 2014-

8. 1

9. [ 12]

10. ! A B
! 1
This is a pen

11. [Brown
+93]
! x
y
! x y
y=This is a penx=
argmaxy P(y|x)

12. !
!
!
!
!
!
argmaxy P(y|x) = argmaxy P(x|y) P(y)

14. !
!

15. [Sutskever
+14]
!
! Recurrent Neural Network Long
Short-Term Memory

16. !
!
!
!
!
!
!

17. ! GIZA++ Moses
!
https://code.google.com/p/giza-pp/ http://www.statmt.org/moses/

18. ! 2010/08 NICT VoiceTra
! 2014/09 NTT
! 2015/01 Google
http://voicetra-plus.jp/

21. !
!

22. Latent Dirichlet Allocation [Blei+03]
!
!
!
[Blei+03]

23. MST Parser [McDonald+05]
!
! O(n3) Chu-Liu-Edmonds
O(n2)
[McDonald+05]

24. [McDonald07]
! Relevancy
! Redundancy
! {0, 1}

26. IPSJ-ONE
Kevin Duh

27. !
!

28. 2
!
!

29. [Socher+11]
!
! Recursive Neural
Network
[Socher+11]

30. !
!
!
!
!
!
!

31. [ +13]
!
!

32. !
! Apple Siri
! NTT
! Yahoo!
!
! Gunosy
! SmartNews

33. !
!
!
!
!
!

34. 1/2
! [ 12] .
.
NLP2012 .
! [Brown+93] P. Brown, S. Della Pietra, V. Della Pietra, R. Mercer.
The mathematics of statistical machine translation: parameter
estimation.
Computational Linguistics, 19(2), 1993.
! [Sutskever+14] I. Sutskever, O. Vinyals, Q. V. Le.
Sequence to Sequence Learning with Neural Networks.
NIPS 2014.

35. 2/2
! [Blei+03] D. M. Blei, A. Y. Ng, M. I. Jordan.
Latent Dirichlet Allocation.
JMLR 2003.
! [McDonald+05] R. McDonald, F. Pereira, K. Ribarov, J. Hajic.
Non-projective Dependency Parsing using Spanning Tree Algorithms.
HLT-EMNLP 2005.
! [McDonald07] R. McDonald.
A Study of Global Inference Algorithms in Multi-Document
Summarization.
Advances in Information Retrieval, 2007.
! [Socher+11] R. Socher, C. Lin, A. Y. Ng, C. D. Manning.
Parsing Natural Scenes and Natural Language with Recursive Neural
Networks.
ICML 2011.
! [ +13] , , , , .
.
JSAI 2013.