The document discusses a new morphological analyzer for Japanese text called PNE, which was developed by the Database Center for Life Science. PNE improves on existing morphological analyzers like ChaSen and MeCab by incorporating context-sensitive analysis. It uses a conditional random field model trained on large annotated corpora to determine part-of-speech tags and morphological analysis based on surrounding words. The analyzer was shown to achieve higher accuracy than previous tools on tasks involving blog text and biological literature.

1. :
:
:
:
NAIST
(DBCLS)
DBCLS (PNE)
20
PNE
ChaSen( ) MeCab
( ) [1]
Blog
[2]
1

2. :
:
NAIST
NAIST
NAIST
NAIST
NAIST NAIST
NAIST
NAIST
NAIST
[1] Taku Kudo, Kaoru Yamamoto, and Yuji Matsumoto. Applying conditional random elds to
Japanese morphological analysis. In Proceedings of EMNLP, pp. 230–237, 2004.
[2] . . , Vol.10,
No.1, pp. 27–45, 2003 1
2