0
DATA MINING THE TWITTER API                         2012 ALAO Annual ConferenceFriday, October 26, 12
Photograph by Max Dannenbaum/Getty Images                         THE AGE OF BIG DATAFriday, October 26, 12
“It’s a revolution... We’re just getting under way.                 But the march of quantification, made possible by      ...
Wordpress posts           Industrial Equipment                                                    Household Appliances    ...
Why do we want these Tweets?                                         Vertical scroll                         Discover & re...
Friday, October 26, 12
Open Source: take whatever you want, use however you want                             Proprietary: pay for each tool in th...
High-Level Overview       Build URL request with keywords and other parameters                                     Submit ...
<?php echo <head>; echo <meta http-equiv="Content-Type" content="text/html; charset=UTF-8" />; echo <link rel="stylesheet"...
70 followers                  NOTABLE INTERACTIONSFriday, October 26, 12
Future Developments                           Develop a deeper set of keywords                         Develop a richer in...
SHAMELESS PLUG                         Web Service APIs and Libraries. ALA EditionsFriday, October 26, 12
Jason Paul Michel                              micheljp@muohio.edu                              @jpmichel     Code:     Qu...
Upcoming SlideShare
Loading in...5
×

Data Mining the Twitter API: 2012 ALAO Annual Conference

460

Published on

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
460
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
6
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Transcript of "Data Mining the Twitter API: 2012 ALAO Annual Conference"

  1. 1. DATA MINING THE TWITTER API 2012 ALAO Annual ConferenceFriday, October 26, 12
  2. 2. Photograph by Max Dannenbaum/Getty Images THE AGE OF BIG DATAFriday, October 26, 12
  3. 3. “It’s a revolution... We’re just getting under way. But the march of quantification, made possible by enormous new sources of data, will sweep through academia, business and government. There is no area that is going to be untouched.” Gary King, Director Institute for Quantitative Social Science, Harvard UniversityFriday, October 26, 12
  4. 4. Wordpress posts Industrial Equipment Household Appliances Weather Instagrams Electric Meters Tweets Water Meters Government Data Traffic Tumblr posts Search Traffic AutomobilesFriday, October 26, 12
  5. 5. Why do we want these Tweets? Vertical scroll Discover & respond to user needs proactively Create social rapport with users Build social capital Add followers Gain unique insight into Zeitgeist of user base Capture as an additional data pointFriday, October 26, 12
  6. 6. Friday, October 26, 12
  7. 7. Open Source: take whatever you want, use however you want Proprietary: pay for each tool in the garage, use them as designed API: utilize the services of the garage, if you have authorization and ask the right way DATA ACCESS The Neighbor’s Garage AnalogyFriday, October 26, 12
  8. 8. High-Level Overview Build URL request with keywords and other parameters Submit URL request Convert returned JSON data <?php ?> Insert non-duplicative data into MySQL table <?php mysql ?> Display data by pulling out of MySQL table <?php mysql html css ?>Friday, October 26, 12
  9. 9. <?php echo <head>; echo <meta http-equiv="Content-Type" content="text/html; charset=UTF-8" />; echo <link rel="stylesheet" href="style.css" type="text/css" />; echo </head>; echo <body>; mysql_connect("localhost", "user", "pass") or die(mysql_error()); mysql_select_db("database") or die(mysql_error()); $tweet_archive = mysql_query("SELECT * FROM twindicators where loc NOT LIKE %Beach% ORDER BY id DESC"); echo <div class="content">; while ($row = mysql_fetch_array($tweet_archive)) { $decoded_text = urldecode($row["text"]); echo <p><span class="user"> . $row[user] . </span> | <span class="date"> . $row[date] . </span> <br /><br /> <span class="text"><a href="https://twitter.com/#!/ . $row[user] . /status/ . $row[twid] . "> . $decoded_text . echo <hr />; } echo </div>; echo </body>; ?> DISPLAY DATA BY PULLING OUT OF MYSQL TABLEFriday, October 26, 12
  10. 10. 70 followers NOTABLE INTERACTIONSFriday, October 26, 12
  11. 11. Future Developments Develop a deeper set of keywords Develop a richer interface for librarians Incorporate SMS notifications to subject specific librarians when relevent tweet is recorded Analyze data for user satisfaction / areas for improvementFriday, October 26, 12
  12. 12. SHAMELESS PLUG Web Service APIs and Libraries. ALA EditionsFriday, October 26, 12
  13. 13. Jason Paul Michel micheljp@muohio.edu @jpmichel Code: Query and store: https://gist.github.com/3846007 Display: https://gist.github.com/3846055 DETAILS & SUCHFriday, October 26, 12
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×