TWIMPACT 2011 analyzes over 5 million tweets per day from over 35.8 million Twitter users, totaling over 11 GB of data daily. The document describes how TWIMPACT parses, extracts, analyzes, matches, and updates information from tweets such as user metadata, locations, languages, retweets, mentions, hashtags, and links to build indices and graphs identifying relations between users, retweets, mentions and other elements over time.

1. TWIMPACT 2011
Real-Time Twitter Analysis
Mikio L. Braun, Matthias L. Jugel, Klaus-Robert Müller
5M
11 GB / day
180,000
3000
50
1s 1 minute 1 hour 1 day
0.6 TB
35.8m users 1.3b tweets 3.3TB
102,000
each day
14,500 TWIMPACT analyses the data by
1. parsing each JSON message
2,500 2. extracting meta-data for users, tweets, location ...
3. analyzing the tweet text language
4. matching a retweet in previous tweets
5. extracting mentions users, hashtags and links
400 6. updating retweeted and mentioned user relations
5,400,000 880,000 140,000 7. updating trend counts for all artifacts
8. updating indices (full-text, users, all artifacts)
retweets page links media links 9. removing irrelevant data from memory
additional graphs and
indices identify relations every 8 hours
between users, retweets,
mentions, languages and
many other artifacts
15,000,000 500,000 1,000
user/rt relations user relations historic snapshots
retweet activity
iPad 2 Steve Jobs
3000 60k
iPad 2
retweets / week
2400 48k
1800 36k
Google Plus
1200 launched 24k
600 12k Steve Jobs Steve Jobs died
resigned
0 0
Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
top 20 impact most retweeted
15k
@wendys RT for a good cause. Each Retweet sends 50¢ to help kids in foster care. #TreatItFwd
37
39
31 31 epictweets_ 33 12k
38 4
32 37 46
26
35 44 30
28
29
55 9k
25 24 32 29 36
5
28 3 teenlov 29
34
efeel 26
6k
35 25 32 3
35 37 49
24 109 38 27 45
117 32 4
t7 36 33 45 30 3
27 26
or 42
feel 33
teenlife
84 38 24
m 106 sextrology 50 4
30
lde 3k
35 71 4
27
vo 31 radiogalaufm 31 30
23
d_
36 29 41
58 39
lor ohteenquotes
55 35 37
42 49
15k
37
lilduval
10 42 30
36 52 57 51
37
@mentionto #MentionTo your friend who's never be on time and lazy to do anything.
43 47 45 49 30
5
51
41
51 metrotv
52 35 45 45 39
meatschool
12k
94 31 55 44 41
31 4
52
43 53 revrunwisdom 47
44 50 47
42 49
3 54
41 53 113
9k
48 47 35
31 40 128 119 39
27
45
55 53 viatumblr30 79 retweetifs 90 40
49
28 59
6k
56 86
90
4
16 57 68 61
33 59
65 68 59 58 49
50
3k
77 64 55 61 57
56 46
61
44 72 zodiacfacts 82 56
50
15k
88 78 75 48
60 70 xstrology 78 91
93
68
ihatequotes
@justinbieber life has it's ups and downs but u guys r always there 4 me. i will make my mistakes
72 95 99
66
12k
62 83 67
67
55 49
but i promise 2 continue 2 grow with u and try 2 do rt
86 57
71
82 68 58 42 40
ugglytruth
9k
57
66 57 justinbieber 53
52 48 41
72 75 93
63 78 88 87
109 89 81 81
60
thenoteboook
35
144
158 164
146 147 138 138
6k
134 127
121 124
12
91
3k
damnitstrue
Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
data delivery
~ 1000 ms
TWIMPACT analysis
© 2011 TWIMPACT UG (haftungsbeschränkt) http://twimpact.com
in cooperation with Berlin University of Technology http://beta.twimpact.com/ely/ ~ 2 ms