Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Twitter Trend Analyzer


Published on

Twitter is one of the most popular social networks where users can interact with each other through messages and sharing their opinions by posting “tweets”. In 2016, Twitter has more than 319 million active users globally. In fact, on the day of 2016 Presidential Election, Twitter was the largest source of collecting data and breaking news. Thus, we have implemented a web-based application which collects real-time Twitter ’s feeds related to a specific key work in order to generate daily trend of users worldwide and geographical charts.

Published in: Software
  • Looking For A Job? Positions available now. FT or PT. $10-$30/hr. No exp required. ◆◆◆
    Are you sure you want to  Yes  No
    Your message goes here
  • Be the first to like this

Twitter Trend Analyzer

  1. 1. Team Project TwitterTrend Analyzer Group 20 Ikwhan Chang / QuanTrung Nguyen Prof. Hungwen Li 11-May, 2017 1 Final Presentation
  2. 2. INDEX • Overview • Twitter Developer API • Search API • Streaming API • Web Socket • Chart & Map • Heroku for the PaaS • Architecture • Data Flows • User Interface & Demo 2
  3. 3. Overview • Project Title • The trend analysis and predict engine for a specific keyword of Twitter by using cloud platform • Description • Twitter is one of popular social networking tools to share our think or news, and it will rapidly spread across the worlds. • We will make a web application to collect the Twitter's feeds related to the specific word, and then provide the user a daily trend by using a realtime linear chart and geographical chart • Team Members 3 Name Ikwhan Chang Role Frontend / API / Cloud / UX Name Quan Nguyen Trung Role Backend / Data Handling
  4. 4. Twitter Developer API • Register the application • To use the Twitter’s API, we need to register our application at • OAuth • Twitter data are collected by using Twitter APIs, which require OAuth to identify Twitter applications and users. • Allow users to access to a protected database. (e.g. twits, mentions..) • The user authentication will use a signed request to identify an application‘s identity along with the user’s access token. There are four secret keys 4 Consumer Key/Secret Access Token/Secret
  5. 5. Twitter Search API • It generates queries to collect data of recent and popular Tweets with certain criteria • We can also use a set of parameters to have a better control of the search results. • Result Type: indicates that the search results will be recent or/and popular Tweets • Geolocalization: restricts the location of Tweets • Language: restricts the languages of Tweets • Iterating in a result set: controls size of search results • When the user enters the keyword, the application will create an URL-encoded search query and will be sent to the server via the HTTP request. • After receiving the HTTP request, the server will pass keyword value to parameter q {q: keyword} to perform the search. • When the server receives the search result from Twitter, it will send the result back to client via HTTP response in form of JSON files. 5 Search API - backend Search - frontend
  6. 6. Twitter Streaming API • We used Streaming APIs to obtain high volume, real-time data from Twitter for our charts • Twitter provides several basic streaming types: • Public streams: the streaming data comes from the public data flowing through Twitter • User streams: the single-user streaming data comes from a single user’s view of Twitter • Site streams: this is the multi-user version of user streams • The streaming connection process will get the collected data, perform the tasks parsing, filtering and store the result into a data store. • Then the HTTP server will get the processed result to send back to the user by using Web Socket 6 Streaming API overview
  7. 7. Web Socket • WebSocket is a computer communications protocol, providing full- duplex communication channels over a single TCP connection. • WebSockets are based on http, but are completely different protocols than the http protocol. • Since WebSockets do not send header information except for the initial connection, they are much more cost effective in terms of network cost and can be implemented quickly and without waiting because of full- duplex communication. • Our application uses WebSockets to send the streamed Twits into web browser by using 7 Web Socket Flows
  8. 8. Chart and Map • HighCharts ( • For the real-time chart, we used the javascript library of HighCharts’s linear chart. • In order to draw the graph like above, you need to use jquery called Highcharts • Google Map API ( • We used the Google Map API in order to the geographical chart and the geocoding. • The geocoding means we can convert from actual user’s address to coordinates like latitude and longitude. • Since twitter API provide us just user’s location character, we need to convert from it to the actual geo coordinates in order to show into our geographic chart. 8
  9. 9. Heroku for PaaS • Heroku is a new way of deploying web applications, where developers are providing services based on the idea that they can concentrate on the code of the web application without losing time for tasks such as server configuration, deployment environment, and server expansion. • Developers are only deployed and restarted by writing source code, committing the code to the git repository for deployment, and pushing it to the remote Heroku repository. • If the success of your web application requires more servers, increasing the number of processors called Dyno will have the same effect as adding multiple servers. 9 Type of Cloud Computing Heroku Deployment Architecture
  10. 10. Architecture 10 Back-end Front-end Integrated Framework UI/CSS Framework Dependencies Management Javascript Framework Testing Task Management Test Runner Pre-processor Compressor UglifyJS, UglifyCSS Code Qualifier Documentation JSDoc3 Lazy Loader Integrated Framework Cloud Streaming Twitter Stream API
  11. 11. Data Flows 11 Frontend Backend OAuth Search Search /search?q=iphone
 &end_Date=20170327 Trend Chart Streaming Geographic Chart {twits:[{
 ‘twit’:’#iphone is gorgeous!!’
 ‘location’:’San Jose, CA’}, …..
 ]} {[{‘date’:’2017-03-26’,’expected’:45’}, {‘date’:’2017-03-27’,’expected’:45’}, …. ] Date Range http://localhost:8080 http://localhost:8080 Stream API {keyword:’iphone’} Key Exchange (Secret key, token)
  12. 12. User Interface & Demo Search Box Realtime Linear Chart Geographical Chart Actual Twit Data # of streamed Tweets
  13. 13. Thank You 13