Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Introduction to Japanese Morphological Analysis

14,857 views

Published on

  • Be the first to comment

Introduction to Japanese Morphological Analysis

  1. 1. ‣ ‣ ‣ ‣
  2. 2. % echo | mecab , , , ,*,*, , , , , ,*,*,*, , , , , ,*,*,*, , , , ,*,*, , , , , EOS ‣ ‣
  3. 3. Input
  4. 4. Dictionary Input
  5. 5. Dictionary Input common_prefix_search( )
  6. 6. Dictionary Input common_prefix_search( )
  7. 7. Dictionary Input common_prefix_search( )
  8. 8. Dictionary Input common_prefix_search( )
  9. 9. Dictionary Input common_prefix_search( )
  10. 10. Dictionary Input common_prefix_search( ) not matched
  11. 11. Dictionary Input
  12. 12. 
 
 3 1 6,7 25 4 Dictionary
  13. 13. 
 
 3 1 6,7 25 4 Dictionary common_prefix_search( )
  14. 14. ‣ ‣ ‣
  15. 15. Generating cost (Dictionary) Connecting cost 21356245 3003 9428 -310 -283 -9617 -386 1285, 1285 1293, 1293 1303, 1303 0 1293, 1293
  16. 16. Generating cost (Dictionary) Connecting cost 21356245 3003 9428 -310 -283 -9617 -386 1285, 1285 1293, 1293 1303, 1303 0 1293, 1293 7729 2504
  17. 17. % echo | mecab -F "%m,%Hnt%phl,%phr,%pw,%pC,%pcn" -N2 , , , , ,*,*, , , 1293,1293,3003,-310,2693 , , , ,*,*,*, , , 1303,1303,9428,-9617,2504 EOS , , ,*,*,*,*, , , 1285,1285,6245,-283,5962 , , , , ,*,*, , , 1293,1293,2135,-368,7729 EOS ← left context, right context, generating cost, connecting cost, cumulative cost
  18. 18. ‣ ‣ ‣ ‣
  19. 19. 
 
 
 


×