Geodätisches Institut1 Web Feature Service für DB4GeOKIT – Universität des Landes Baden-Württemberg und
nationales Forschu...
M. Sc. André Dittrich2
Tweet Frequency
M. Sc. André Dittrich3
M. Sc. André Dittrich4
M. Sc. André Dittrich5
M. Sc. André Dittrich6
M. Sc. André Dittrich7
M. Sc. André Dittrich8
Resources & Data
 Resources
 Twitter
 Streaming API → access to 1% of the Firehose
 Real-time →...
M. Sc. André Dittrich9
Resources & Data
 Resources
 Twitter
 Streaming API → access to 1% of the Firehose
 Real-time →...
M. Sc. André Dittrich10
Resources & Data
 Resources
 Data
 Tweet
M. Sc. André Dittrich11
Resources & Data
 Resources
 Data
 Tweet
 timestamp WHEN?
M. Sc. André Dittrich12
Resources & Data
 Resources
 Data
 Tweet
 timestamp
 GNSS coordinates
WHEN?
WHERE?
M. Sc. André Dittrich13
Resources & Data
 Resources
 Data
 Tweet
 timestamp
 GNSS coordinates
 message text
WHEN?
WH...
M. Sc. André Dittrich14
Resources & Data
 Resources
 Data
 Tweet
 geographical bounding box
Longitude [°] Latitude [°]...
M. Sc. André Dittrich15
Resources & Data
 Resources
 Data
 Tweet
 geographical bounding box
 reference data
 several...
M. Sc. André Dittrich16
Resources & Data
 Resources
 Data
 Tweet
 geographical bounding box
 reference data
 several...
M. Sc. André Dittrich17
Data Analysis
Number
of
tweets
Time of day [h]
M. Sc. André Dittrich18
Data Analysis
Number
of
tweets
Time of day [h]
M. Sc. André Dittrich19
Data Analysis
a0 a1 b1 a2 b2 a3 b3 a4 b4 w RMSE
Type 1 3463,6 928,1 -2062,3 998,1 -704,2 353,2 -20...
M. Sc. André Dittrich20
Event Data – New Year‘s Eve
Number
of
tweets
Time of day [h]
M. Sc. André Dittrich21
Keyword Data
shelter | winterstorm | weather AND sandy | subway AND flood | sandy AND victims | sn...
M. Sc. André Dittrich22
Keyword Data
shelter | winterstorm | weather AND sandy | subway AND flood | sandy AND victims | sn...
M. Sc. André Dittrich23
Outlook
 Collection of further data
→ more reliable reference model and robust statistics
 Grid-...
M. Sc. André Dittrich24
M. Sc. André Dittrich25
Most Stable Time Interval
M. Sc. André Dittrich26
Social Event
Number
of
tweets
Time of day [h]
M. Sc. André Dittrich27
Social Event – Superbowl 2013
Number
of
tweets
Time of day [h]
M. Sc. André Dittrich28
Social Event – Superbowl 2013
Number
of
tweets
Time of day [h]
M. Sc. André Dittrich29
Social Event – Superbowl 2013
Number
of
tweets
Time of day [h]
M. Sc. André Dittrich30
Social Event – Superbowl 2013
Number
of
tweets
Time of day [h]
M. Sc. André Dittrich31
Social Event – Superbowl 2013
Number
of
tweets
Time of day [h]
Named Entity References [%]
Beyoncé...
M. Sc. André Dittrich32
Social Event – Superbowl 2013
Number
of
tweets
Time of day [h]
Upcoming SlideShare
Loading in...5
×

ISCRAM 2013: A step towards real-time analysis of major disaster events based on tweets

122

Published on

Author: André Dittrich

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
122
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

ISCRAM 2013: A step towards real-time analysis of major disaster events based on tweets

  1. 1. Geodätisches Institut1 Web Feature Service für DB4GeOKIT – Universität des Landes Baden-Württemberg und nationales Forschungszentrum in der Helmholtz-Gemeinschaft Institute of Photogrammetry and Remote Sensing, Karlsruhe Institute of Technology (KIT) www.kit.edu A step towards real-time analysis of major disaster events based on tweets M.Sc. André Dittrich May 13, 2013
  2. 2. M. Sc. André Dittrich2 Tweet Frequency
  3. 3. M. Sc. André Dittrich3
  4. 4. M. Sc. André Dittrich4
  5. 5. M. Sc. André Dittrich5
  6. 6. M. Sc. André Dittrich6
  7. 7. M. Sc. André Dittrich7
  8. 8. M. Sc. André Dittrich8 Resources & Data  Resources  Twitter  Streaming API → access to 1% of the Firehose  Real-time → up to 60 tweets/sec
  9. 9. M. Sc. André Dittrich9 Resources & Data  Resources  Twitter  Streaming API → access to 1% of the Firehose  Real-time → up to 60 tweets/sec  MongoDB  document-oriented Database technology  (binary) JSON (JavaScript Object Model) → tweet ≡ JSON !  Spatial Indexing
  10. 10. M. Sc. André Dittrich10 Resources & Data  Resources  Data  Tweet
  11. 11. M. Sc. André Dittrich11 Resources & Data  Resources  Data  Tweet  timestamp WHEN?
  12. 12. M. Sc. André Dittrich12 Resources & Data  Resources  Data  Tweet  timestamp  GNSS coordinates WHEN? WHERE?
  13. 13. M. Sc. André Dittrich13 Resources & Data  Resources  Data  Tweet  timestamp  GNSS coordinates  message text WHEN? WHERE? WHAT?
  14. 14. M. Sc. André Dittrich14 Resources & Data  Resources  Data  Tweet  geographical bounding box Longitude [°] Latitude [°] Lower left -86 0 Upper right -67 53
  15. 15. M. Sc. André Dittrich15 Resources & Data  Resources  Data  Tweet  geographical bounding box  reference data  several 24 hour records  1 pm to 1 pm EST  approx. 6 GB each
  16. 16. M. Sc. André Dittrich16 Resources & Data  Resources  Data  Tweet  geographical bounding box  reference data  several 24 hour records  1 pm to 1 pm EST  approx. 6 GB each  Keyword filtered tweets related to winterstorm Sandy → October 29, 2012 – October 31, 2012 → December 29, 2012 – December 30, 2012
  17. 17. M. Sc. André Dittrich17 Data Analysis Number of tweets Time of day [h]
  18. 18. M. Sc. André Dittrich18 Data Analysis Number of tweets Time of day [h]
  19. 19. M. Sc. André Dittrich19 Data Analysis a0 a1 b1 a2 b2 a3 b3 a4 b4 w RMSE Type 1 3463,6 928,1 -2062,3 998,1 -704,2 353,2 -205,5 30,2 -78,2 0,27 151,1 Type 2 3602,9 781,1 -1887,9 1251,1 239,5 -3,7 0,7 178,2 92,5 0,26 92,8
  20. 20. M. Sc. André Dittrich20 Event Data – New Year‘s Eve Number of tweets Time of day [h]
  21. 21. M. Sc. André Dittrich21 Keyword Data shelter | winterstorm | weather AND sandy | subway AND flood | sandy AND victims | snowfall | power outages Reference day 12/29/2012 1 pm to 12/30/2012 1 pm
  22. 22. M. Sc. André Dittrich22 Keyword Data shelter | winterstorm | weather AND sandy | subway AND flood | sandy AND victims | snowfall | power outages Winterstorm “Sandy“ 10/29/2012 1 pm to 10/30/2012 1 pm Reference day 12/29/2012 1 pm to 12/30/2012 1 pm
  23. 23. M. Sc. André Dittrich23 Outlook  Collection of further data → more reliable reference model and robust statistics  Grid-based approach → faster and more accurate localization  Test with different NLP APIs → robust event classification  Exlpoitation of further resources → e.g. Ushahidi
  24. 24. M. Sc. André Dittrich24
  25. 25. M. Sc. André Dittrich25 Most Stable Time Interval
  26. 26. M. Sc. André Dittrich26 Social Event Number of tweets Time of day [h]
  27. 27. M. Sc. André Dittrich27 Social Event – Superbowl 2013 Number of tweets Time of day [h]
  28. 28. M. Sc. André Dittrich28 Social Event – Superbowl 2013 Number of tweets Time of day [h]
  29. 29. M. Sc. André Dittrich29 Social Event – Superbowl 2013 Number of tweets Time of day [h]
  30. 30. M. Sc. André Dittrich30 Social Event – Superbowl 2013 Number of tweets Time of day [h]
  31. 31. M. Sc. André Dittrich31 Social Event – Superbowl 2013 Number of tweets Time of day [h] Named Entity References [%] Beyoncé 27,51 Destiny‘s Child 10,26 show 4,08 halftime 3,06
  32. 32. M. Sc. André Dittrich32 Social Event – Superbowl 2013 Number of tweets Time of day [h]

×