おひろめ会〜教師なしワード抽出

1,481 views

Published on

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,481
On SlideShare
0
From Embeds
0
Number of Embeds
57
Actions
Shares
0
Downloads
6
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

おひろめ会〜教師なしワード抽出

  1. 1. 1
  2. 2. ex.ipadic 2
  3. 3. ✓ ✓ ✓ - - - ✓“ ” ✓ 3
  4. 4. I like Masashi Sada.→I/like/Masashi/Sada/ → → 4
  5. 5. ipadic NAIST-jdic Unidic → / - - / - / - - - / - - - / - - / - / 5
  6. 6. / → / / - - / - / - / - / - - / - 6
  7. 7. → / - - - / - / - / - / - / - / - / - / - / 7
  8. 8. ( ) → / - / l/ ∋/ →/ - →/ - / - 8
  9. 9. ( ) → / - / - / / - / - / - / - / - 9
  10. 10. • • • 10
  11. 11. http://chasen.org/~daiti-m/paper/jfssa2009segment.pdf • • n-gram / Pitman-Yor / Gibbs / ... 11
  12. 12. 12
  13. 13. 13
  14. 14. 14
  15. 15. 15
  16. 16. Web • Web • MeCab TRIE 16
  17. 17. 17
  18. 18. • • Web • (´ ω `) 18
  19. 19. ✓ ✓ ✓ - - - ✓“ ” ✓ 19
  20. 20. 20
  21. 21. 21
  22. 22. 22
  23. 23. 23
  24. 24. 24
  25. 25. 25
  26. 26. 26
  27. 27. 27
  28. 28. 28
  29. 29. 29
  30. 30. 30
  31. 31. ✓ ✓ ✓ - - - ✓“ ” ✓ 31
  32. 32. Google IME Web “ ” Twitter 32
  33. 33. 2003: http://2boy.org/~yuta/publications/nl158-slides.pdf 33
  34. 34. × × 34
  35. 35. 35
  36. 36. 36
  37. 37. 37
  38. 38. • • • 38
  39. 39. ..... ..... ...... 39
  40. 40. ..... ..... ...... 40
  41. 41. 41
  42. 42. ↓ 42
  43. 43. Hadoop n-gram NameNode× DataNode× 100 (Latin) 40 50 25 ( ) 5 10 43
  44. 44. • • n-gram 44
  45. 45. Lingua::LanguageGuesser http://gensen.dl.itc.u-tokyo.ac.jp/LanguageGuesser/LanguageGuesser_demo_ja.html “just do it.” ”‫“ﻋﻴﺪ ﺍﳊﺐ‬ 45
  46. 46. Unicode Twitter TimeZone 46
  47. 47. TF-IDF TF-IDF 47
  48. 48. REST API Streaming API Streaming API(sample API http://apiwiki.twitter.com/Streaming-API-Documentation firehose API 1/25 1/30 48
  49. 49. Google Java API http://code.google.com/p/google-api-translate-java/ 49
  50. 50. ✓ ✓ ✓ - - - ✓“ ” ✓ 50
  51. 51. 51
  52. 52. http://chinese.dsturgeon.net/text.pl?node=1081&if=gb 52
  53. 53. ...... ※ 53
  54. 54. http://www.aozora.gr.jp/index_pages/person1095.html 54
  55. 55. ...... 12 55
  56. 56. http://www.sainet.or.jp/~eshibuya/ 56
  57. 57. ...... 25 57
  58. 58. http://www.nhk.or.jp/namara03-blog/ 58
  59. 59. ..... 59
  60. 60. • • NG 60
  61. 61. ✓ ✓ ✓ - - - ✓“ ” ✓ 61
  62. 62. ✓ ✓ ✓ 62
  63. 63. ✓ ※ URL ✓ Ameba (´ ω `) 63
  64. 64. 64

×