Data Mining the Twitter API: 2012 ALAO Annual Conference
Upcoming SlideShare
Loading in...5
×
 

Like this? Share it with your network

Share

Data Mining the Twitter API: 2012 ALAO Annual Conference

on

  • 694 views

 

Statistics

Views

Total Views
694
Views on SlideShare
694
Embed Views
0

Actions

Likes
1
Downloads
2
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Data Mining the Twitter API: 2012 ALAO Annual Conference Presentation Transcript

  • 1. DATA MINING THE TWITTER API 2012 ALAO Annual ConferenceFriday, October 26, 12
  • 2. Photograph by Max Dannenbaum/Getty Images THE AGE OF BIG DATAFriday, October 26, 12
  • 3. “It’s a revolution... We’re just getting under way. But the march of quantification, made possible by enormous new sources of data, will sweep through academia, business and government. There is no area that is going to be untouched.” Gary King, Director Institute for Quantitative Social Science, Harvard UniversityFriday, October 26, 12
  • 4. Wordpress posts Industrial Equipment Household Appliances Weather Instagrams Electric Meters Tweets Water Meters Government Data Traffic Tumblr posts Search Traffic AutomobilesFriday, October 26, 12
  • 5. Why do we want these Tweets? Vertical scroll Discover & respond to user needs proactively Create social rapport with users Build social capital Add followers Gain unique insight into Zeitgeist of user base Capture as an additional data pointFriday, October 26, 12
  • 6. Friday, October 26, 12
  • 7. Open Source: take whatever you want, use however you want Proprietary: pay for each tool in the garage, use them as designed API: utilize the services of the garage, if you have authorization and ask the right way DATA ACCESS The Neighbor’s Garage AnalogyFriday, October 26, 12
  • 8. High-Level Overview Build URL request with keywords and other parameters Submit URL request Convert returned JSON data <?php ?> Insert non-duplicative data into MySQL table <?php mysql ?> Display data by pulling out of MySQL table <?php mysql html css ?>Friday, October 26, 12
  • 9. <?php echo <head>; echo <meta http-equiv="Content-Type" content="text/html; charset=UTF-8" />; echo <link rel="stylesheet" href="style.css" type="text/css" />; echo </head>; echo <body>; mysql_connect("localhost", "user", "pass") or die(mysql_error()); mysql_select_db("database") or die(mysql_error()); $tweet_archive = mysql_query("SELECT * FROM twindicators where loc NOT LIKE %Beach% ORDER BY id DESC"); echo <div class="content">; while ($row = mysql_fetch_array($tweet_archive)) { $decoded_text = urldecode($row["text"]); echo <p><span class="user"> . $row[user] . </span> | <span class="date"> . $row[date] . </span> <br /><br /> <span class="text"><a href="https://twitter.com/#!/ . $row[user] . /status/ . $row[twid] . "> . $decoded_text . echo <hr />; } echo </div>; echo </body>; ?> DISPLAY DATA BY PULLING OUT OF MYSQL TABLEFriday, October 26, 12
  • 10. 70 followers NOTABLE INTERACTIONSFriday, October 26, 12
  • 11. Future Developments Develop a deeper set of keywords Develop a richer interface for librarians Incorporate SMS notifications to subject specific librarians when relevent tweet is recorded Analyze data for user satisfaction / areas for improvementFriday, October 26, 12
  • 12. SHAMELESS PLUG Web Service APIs and Libraries. ALA EditionsFriday, October 26, 12
  • 13. Jason Paul Michel micheljp@muohio.edu @jpmichel Code: Query and store: https://gist.github.com/3846007 Display: https://gist.github.com/3846055 DETAILS & SUCHFriday, October 26, 12