This document describes a demo of a system called "Where is my tweet" that visualizes how tweets spread through re-tweets. It tracks re-tweets in real-time to show the spread of information over a graph. Some engineering challenges included sorting re-tweets that arrived out of order and collecting them at the driver node. The author is Henok Mengistu, a PhD student from Ethiopia currently studying evolutionary computation at the University of Wyoming, who developed this demo during a fellowship at Insight Data Engineering.

1. Where is my tweet?
Henok Mengistu
Insight Data Engineering Fellow
Silicon Valley, Summer 2016

2. Motivation

3. Motivation
But, this number doesn't show how the tweet spreads-out?

4. But, a re-tweet graph could show

5. A Demo
http://52.33.140.25/
http://www.whereismytweet.online/

6. Under the hood

7. Engineering Challenges
● Stitching the different components
● Re-tweets could arrive out of order
– Spark can't sort across a data stream
– The driver node should collect and sort re-tweets

8. ● I am Henok
– Originally, from Ethiopia
– Currently, a PhD student at the University of
Wyoming
● Working on Evolutionary Computation
● I was also working as a Teaching assistant
– I like soccer, but not skiing

9. Thank you!

10. Queries
● On the re-tweet graph
– who are my audiences?
● Geographically, social groups
– Betweenness centrality
● Who is relevant to spread out my tweet?
● Identify influential followers