Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Project 311 - 地域と時間軸による情報フィルタリング -

3,594 views

Published on

  • Be the first to comment

Project 311 - 地域と時間軸による情報フィルタリング -

  1. 1. 2012/10/28@東⽇日本⼤大震災ビッグデータワークショップ  Project  311 地域と時間軸による 情報フィルタリング 株式会社Preferred Infrastructure 岡野原  ⼤大輔    ⽥田中  英⾏行行 ⾇舛岡  英⼈人      秋⽥田  慶 能地  宏        ⼤大岩  秀和 秋葉葉  拓拓哉 •  他  協⼒力力いただいた社員・バイトの皆様 連絡先: 岡野原  hillbig@preferred.jp
  2. 2. 災害時に利利⽤用可能なサービスを提供するl  災害時には様々なメディアからの情報が錯綜した l  Twitterなどを介してリアルタイムかつ⾝身近な情報が多く発信され たが、必要な情報のみを集める⽅方法ができなかったl  実家がいわき市にある岡野原の個⼈人的な体験 l  TVやラジオ経由の情報は原発や県・市単位の情報のみ l  原発の情報は⼤大事だが今⽇日のご飯・移動⼿手段を困っている⼈人も多い l  ガソリンや⾷食料料はいつ/どこで配布するのか、避難できるのかl  各⼈人・各⽴立立場の⼈人にとって必要な情報が調べられるサービス l  キーワード検索索では不不⼗十分l  災害時だけではなく、平常時から利利⽤用可能なサービス l  ユーザーに慣れてもらう、サービスも常時改善される 2
  3. 3. 提案サービス l  時間/トピック/地域/KW毎に各メディア情報をフィルタリング l  個⼈人・組織が必要な情報を集められるようなサービスを作る l  twitter、新聞、TV、レスキューの情報を横断してフィルタリング l  テキスト情報から必要な情報は抽出トピック(避難・⽣生活イ 時間・トピック・地域ンフラなど) キーワードを指定して フィルタリング 時間軸 •  例 •  3/11  15:00  –  16:00 •  福島県いわき市平地区 •  生活インフラ 3 地域(全国都道府県市町村レベル)
  4. 4. システム概要図 ⽂文書分類器を震災関連Twitter NHK JCC (TV) 朝⽇日新聞 ハッシュタグを正解例例に して学習し、分類 震災に関係する情報のみフィルタリング 地域情報は地名や駅名、路路 線名、ランドマーク名から 地域情報の抽出 市町村レベルで推定 トピックは本⽂文から推定 要望トピックの抽出 「避難, インフラ, ⾼高齢者, 医療療  」など 21トピック 関連情報の抽出 URLや内容のクラスタリン 4 グにより、関連情報を抽出 情報フィルタリングエンジン + UI
  5. 5. サービスのデモ5
  6. 6. デモ予備⽤用スライド6
  7. 7. 全体図TV画⾯面の番組表をイメージ各フィルタリング条件は選べる 7
  8. 8. フィルタリング詳細結果東京都・帰宅宅困難・3/12 4:00〜~5:00 8
  9. 9. フィルタリング条件指定フィルタリング条件はキーワード、場所、トピック、メディアから設定可能 9
  10. 10. 結果例例:福島県いわき市・ガソリンスタンド・3/16 10
  11. 11. 結果例例:東京都渋⾕谷区・被災者⽀支援・3/12 4:00〜~6:00 11
  12. 12. 今後の予定l  デモサービスをベースに実⽤用化・提供を⽬目指す l  (再掲)災害時にいざ使おうとするとうまくいかない。 平常時からも使ってもらえるようなサービスを考える l  被災者や関係当局の話を聞き、何が必要であるかを絞るl  システム側の技術的課題 l  全メディア情報をリアルタイムに分析して安定して提供できる基盤 l  秒間1万tweet、秒間数百万〜~数千万の位置情報を処理理 l  サンプリング/サマリではなく、細かい粒粒度度のまま提供可能 l  名寄せ・地域情報の推定(⾔言及位置か、ユーザーの位置か) 12
  13. 13. その他 統計情報の考察13
  14. 14. 0" 500" 1000" 1500" 2000" 2500" 3000" 2011031109:00:00" 2011031111:00:00" 2011031113:00:00" 2011031115:00:00" 2011031117:00:00" 2011031119:00:00" 2011031121:00:00" 2011031123:00:00" 2011031201:00:00" 2011031203:00:00" 2011031205:00:00" 2011031207:00:00" 2011031209:00:00" 2011031211:00:00" 2011031213:00:00" 2011031215:00:00" 2011031217:00:00" 2011031219:00:00" 2011031221:00:00" 2011031223:00:00" 2011031301:00:00" 2011031303:00:00" 2011031305:00:00" 2011031307:00:00" 2011031309:00:00" 2011031311:00:00" 2011031313:00:00" 2011031315:00:00" 2011031317:00:00" 2011031319:00:00" 2011031321:00:00" 2011031323:00:00" 2011031401:00:00" 2011031403:00:00" 2011031405:00:00" 2011031407:00:00" 2011031409:00:00" 2011031411:00:00" 2011031413:00:00" 2011031415:00:00" 2011031417:00:00"14 2011031419:00:00" 2011031421:00:00" 2011031423:00:00" 都市圏に関しての⾔言及数 2011031501:00:00" 2011031503:00:00" 2011031505:00:00" 2011031507:00:00" 2011031509:00:00" 2011031511:00:00" 2011031513:00:00" (渋⾕谷区、新宿区、台東区) ! 2011031515:00:00" た3/11 15:00〜~25:00に集中     2011031517:00:00" 2011031519:00:00" 2011031521:00:00" 2011031523:00:00" 2011031601:00:00" 2011031603:00:00" 2011031605:00:00" 2011031607:00:00" 2011031609:00:00" 2011031611:00:00" 2011031613:00:00" 2011031615:00:00" 2011031617:00:00" 2011031619:00:00" 2011031621:00:00" 2011031623:00:00" 2011031701:00:00" 2011031703:00:00" 2011031705:00:00" 2011031707:00:00" 2011031709:00:00" 2011031711:00:00" 2011031713:00:00" 2011031715:00:00" 2011031717:00:00" 2011031719:00:00" 2011031721:00:00" 2011031723:00:00" 2011031801:00:00" 2011031803:00:00" 2011031805:00:00" 都市圏に関する⾔言及は、殆どの発⾔言が帰宅宅困難者が発⽣生し 2011031807:00:00"
  15. 15. 0" 500" 1000" 1500" 2000" 2500" 3000" 2011031109:00:00" 2011031111:00:00" 2011031113:00:00" 2011031115:00:00" 2011031117:00:00" 2011031119:00:00" 2011031121:00:00" 2011031123:00:00" 2011031201:00:00" 2011031203:00:00" 2011031205:00:00" 2011031207:00:00" 2011031209:00:00" 2011031211:00:00" 2011031213:00:00" 2011031215:00:00" 2011031217:00:00" 2011031219:00:00" 2011031221:00:00" 2011031223:00:00" 2011031301:00:00" 2011031303:00:00" 2011031305:00:00" 2011031307:00:00" 2011031309:00:00" 2011031311:00:00" 2011031313:00:00" 2011031315:00:00" 2011031317:00:00" 2011031319:00:00" 2011031321:00:00" 2011031323:00:00" 2011031401:00:00" 2011031403:00:00" 2011031405:00:00" 2011031407:00:00" 2011031409:00:00" 南相⾺馬市、相⾺馬市) 2011031411:00:00" 2011031413:00:00" 2011031415:00:00" 2011031417:00:00" 2011031419:00:00" 2011031421:00:00" 2011031423:00:00"15 2011031501:00:00" 2011031503:00:00" 2011031505:00:00" 2011031507:00:00" 2011031509:00:00" 2011031511:00:00" 2011031513:00:00" 2011031515:00:00" 2011031517:00:00" 2011031519:00:00" 2011031521:00:00" 2011031523:00:00" 2011031601:00:00" 2011031603:00:00" 2011031605:00:00" 2011031607:00:00" 2011031609:00:00" 2011031611:00:00" 2011031613:00:00" 2011031615:00:00" 2011031617:00:00" 2011031619:00:00" 2011031621:00:00" 津波の被害が⼤大きな地域についての⾔言及数 2011031623:00:00" 2011031701:00:00" 2011031703:00:00" (⽯石巻市、⼤大船渡市、気仙沼市、多賀城市、 2011031705:00:00" 2011031707:00:00" 2011031709:00:00" 2011031711:00:00" 2011031713:00:00" 2011031715:00:00" 2011031717:00:00" 2011031719:00:00" 2011031721:00:00" も継続して⾔言及は多くみられた 2011031723:00:00" 2011031801:00:00" 津波報道があった直後や、その後 津波の被害が⼤大きかった地域は、 2011031803:00:00" 2011031805:00:00" 2011031807:00:00"
  16. 16. 0" 500" 1000" 1500" 2000" 2500" 2011031109:00:00" 3000" 2011031111:00:00" 2011031113:00:00" 2011031115:00:00" 2011031117:00:00" 2011031119:00:00" 2011031121:00:00" 2011031123:00:00" 2011031201:00:00" 2011031203:00:00" 2011031205:00:00" 2011031207:00:00" 2011031209:00:00" 2011031211:00:00" 2011031213:00:00" 2011031215:00:00" 2011031217:00:00" 2011031219:00:00" 2011031221:00:00" 2011031223:00:00" 2011031301:00:00" 2011031303:00:00" 2011031305:00:00" 2011031307:00:00" 2011031309:00:00" 2011031311:00:00" 2011031313:00:00" 2011031315:00:00" 2011031317:00:00" 2011031319:00:00" 2011031321:00:00" 2011031323:00:00" 2011031401:00:00" 2011031403:00:00" 2011031405:00:00" 2011031407:00:00" 2011031409:00:00" 2011031411:00:00" 2011031413:00:00" 2011031415:00:00" 2011031417:00:00" 2011031419:00:00" 2011031421:00:00"16 2011031423:00:00" 2011031501:00:00" 2011031503:00:00" 2011031505:00:00" 2011031507:00:00" 2011031509:00:00" 2011031511:00:00" 2011031513:00:00" (いわき市、南相⾺馬市、相⾺馬市) 2011031515:00:00" 2011031517:00:00" 2011031519:00:00" 2011031521:00:00" 2011031523:00:00" 2011031601:00:00" 2011031603:00:00" 福島原発に近い地域についての⾔言及数 2011031605:00:00" 2011031607:00:00" 2011031609:00:00" 2011031611:00:00" 2011031613:00:00" 2011031615:00:00" 2011031617:00:00" 2011031619:00:00" 原発に近い地域の話題数は⽇日々⼤大きくなっていった 2011031621:00:00" 2011031623:00:00" 2011031701:00:00" 2011031703:00:00" た直後および、その後も継続して話題は多くあった 2011031705:00:00" 2011031707:00:00" 2011031709:00:00" 2011031711:00:00" 2011031713:00:00" 2011031715:00:00" 2011031717:00:00" 2011031719:00:00" 2011031721:00:00" 津波の被害が⼤大きかった地域については、津波報道があっ 2011031723:00:00" 2011031801:00:00" 2011031803:00:00" 2011031805:00:00" 2011031807:00:00"
  17. 17. 0" 5000" 10000" 15000" 20000" 25000" 30000" 35000" 40000" 45000" 50000" 2011(03(11(09:00:00" 2011(03(11(11:00:00" 2011(03(11(13:00:00" 2011(03(11(15:00:00" 2011(03(11(17:00:00" 2011(03(11(19:00:00" 2011(03(11(21:00:00" 2011(03(11(23:00:00" 2011(03(12(01:00:00" 2011(03(12(03:00:00" 2011(03(12(05:00:00" 2011(03(12(07:00:00" 2011(03(12(09:00:00" 2011(03(12(11:00:00" 2011(03(12(13:00:00" 2011(03(12(15:00:00" 2011(03(12(17:00:00" 2011(03(12(19:00:00" 2011(03(12(21:00:00" 2011(03(12(23:00:00" 2011(03(13(01:00:00" 2011(03(13(03:00:00" 津波 2011(03(13(05:00:00" 2011(03(13(07:00:00" 2011(03(13(09:00:00" 2011(03(13(11:00:00" 2011(03(13(13:00:00" 2011(03(13(15:00:00" 2011(03(13(17:00:00" 2011(03(13(19:00:00" 2011(03(13(21:00:00" が多くみられた 2011(03(13(23:00:00" トピック毎の⾔言及数 2011(03(14(01:00:00" 2011(03(14(03:00:00" 2011(03(14(05:00:00" 2011(03(14(07:00:00" 2011(03(14(09:00:00" 2011(03(14(11:00:00" 2011(03(14(13:00:00" 2011(03(14(15:00:00" 2011(03(14(17:00:00" 2011(03(14(19:00:00"17 2011(03(14(21:00:00" 2011(03(14(23:00:00" 2011(03(15(01:00:00" 2011(03(15(03:00:00" 2011(03(15(05:00:00" 2011(03(15(07:00:00" 2011(03(15(09:00:00" 2011(03(15(11:00:00" 2011(03(15(13:00:00" 2011(03(15(15:00:00" 2011(03(15(17:00:00" 2011(03(15(19:00:00" 2011(03(15(21:00:00" 2011(03(15(23:00:00" 2011(03(16(01:00:00" 初期は津波と⽣生命維持についての話題 2011(03(16(03:00:00" 2011(03(16(05:00:00" 2011(03(16(07:00:00" 2011(03(16(09:00:00" 2011(03(16(11:00:00" 2011(03(16(13:00:00" 2011(03(16(15:00:00" 2011(03(16(17:00:00" 2011(03(16(19:00:00" 2011(03(16(21:00:00" 2011(03(16(23:00:00" 2011(03(17(01:00:00" 2011(03(17(03:00:00" 2011(03(17(05:00:00" 2011(03(17(07:00:00" 2011(03(17(09:00:00" 2011(03(17(11:00:00" 2011(03(17(13:00:00" 2011(03(17(15:00:00" 2011(03(17(17:00:00" 3/12 以降は、⽣生命維持、放射能、⽣生活インフラの話題 2011(03(17(19:00:00" 2011(03(17(21:00:00" 2011(03(17(23:00:00" 2011(03(18(01:00:00" 2011(03(18(03:00:00" 2011(03(18(05:00:00" 2011(03(18(07:00:00"
  18. 18. 0" 5000" 10000" 15000" 20000" 25000" 30000" 35000" 40000" 45000" 2011(03(11(09:00:00" 50000" 2011(03(11(11:00:00" 2011(03(11(13:00:00" 2011(03(11(15:00:00" 2011(03(11(17:00:00" 2011(03(11(19:00:00" 2011(03(11(21:00:00" 2011(03(11(23:00:00" 2011(03(12(01:00:00" 2011(03(12(03:00:00" 2011(03(12(05:00:00" 2011(03(12(07:00:00" 2011(03(12(09:00:00" 2011(03(12(11:00:00" 2011(03(12(13:00:00" 2011(03(12(15:00:00" 2011(03(12(17:00:00" 2011(03(12(19:00:00" 2011(03(12(21:00:00" 2011(03(12(23:00:00" 2011(03(13(01:00:00" 2011(03(13(03:00:00" 2011(03(13(05:00:00" 2011(03(13(07:00:00" 2011(03(13(09:00:00" 2011(03(13(11:00:00" 2011(03(13(13:00:00" 2011(03(13(15:00:00" 2011(03(13(17:00:00" 2011(03(13(19:00:00" 2011(03(13(21:00:00" 2011(03(13(23:00:00" 2011(03(14(01:00:00" 2011(03(14(03:00:00" 2011(03(14(05:00:00" 2011(03(14(07:00:00" 2011(03(14(09:00:00" 2011(03(14(11:00:00" 2011(03(14(13:00:00" 2011(03(14(15:00:00" 2011(03(14(17:00:00" 2011(03(14(19:00:00" 全てのトピック毎の⾔言及数 2011(03(14(21:00:00"18 2011(03(14(23:00:00" 2011(03(15(01:00:00" 2011(03(15(03:00:00" 2011(03(15(05:00:00" 2011(03(15(07:00:00" 2011(03(15(09:00:00" 2011(03(15(11:00:00" 2011(03(15(13:00:00" 2011(03(15(15:00:00" 2011(03(15(17:00:00" 2011(03(15(19:00:00" 2011(03(15(21:00:00" 2011(03(15(23:00:00" 2011(03(16(01:00:00" 2011(03(16(03:00:00" 2011(03(16(05:00:00" 2011(03(16(07:00:00" 2011(03(16(09:00:00" 2011(03(16(11:00:00" 2011(03(16(13:00:00" 2011(03(16(15:00:00" 2011(03(16(17:00:00" 2011(03(16(19:00:00" 2011(03(16(21:00:00" 2011(03(16(23:00:00" 2011(03(17(01:00:00" 2011(03(17(03:00:00" 2011(03(17(05:00:00" 2011(03(17(07:00:00" 2011(03(17(09:00:00" インフラ/⽣生活・くらし/衛⽣生/被災者⽀支援/⾷食⽣生活/⾼高齢者/障害者 2011(03(17(11:00:00" 2011(03(17(13:00:00" 2011(03(17(15:00:00" 2011(03(17(17:00:00" 2011(03(17(19:00:00" 2011(03(17(21:00:00" 2011(03(17(23:00:00" 2011(03(18(01:00:00" 2011(03(18(03:00:00" 2011(03(18(05:00:00" 2011(03(18(07:00:00" プライバシー/乳幼児/医療療/安否確認/放射能/気象情報/津波/⽣生命維持/⽣生活

×