Making Sense of  Twitter Search Gene Golovchinsky / FXPAL Miles Efron / UIUC
100,000,000 people can’t be wrong
All the cool researchers are doing it
There is Science in everything
We can build something cool
Maybe we can build something useful!
How do we know we’ve succeeded?
Test collections (data sets) are one way to evaluate systems
The fire hose is not a test collection
Test collection to-do list <ul><li>Research questions </li></ul><ul><li>Data collection methodology </li></ul><ul><li>Metr...
What are we trying to study? The network?
Or the person?
We’re interested in interactive search
What do people look for on Twitter? <ul><li>Trending topics </li></ul><ul><li>Events </li></ul><ul><li>Specific tweets </l...
First Steps
First Steps
First Steps
Evaluation in Information Retrieval <ul><li>Need a collection </li></ul><ul><li>Need tasks </li></ul><ul><li>Need metrics ...
How do we sample the data? <ul><li>By time, by topic, randomly? … </li></ul>
How do we measure?
Credits <ul><li>Title slide </li></ul><ul><ul><li>http://www.flickr.com/photos/matthamm/3383916444/ Matt Hamm </li></ul></...
Upcoming SlideShare
Loading in …5
×

Making Sense Of Twitter Search - Ignite talk at CHI 2010 Microblogging workshop

1,407 views

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,407
On SlideShare
0
From Embeds
0
Number of Embeds
52
Actions
Shares
0
Downloads
13
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Making Sense Of Twitter Search - Ignite talk at CHI 2010 Microblogging workshop

  1. 1. Making Sense of Twitter Search Gene Golovchinsky / FXPAL Miles Efron / UIUC
  2. 2. 100,000,000 people can’t be wrong
  3. 3. All the cool researchers are doing it
  4. 4. There is Science in everything
  5. 5. We can build something cool
  6. 6. Maybe we can build something useful!
  7. 7. How do we know we’ve succeeded?
  8. 8. Test collections (data sets) are one way to evaluate systems
  9. 9. The fire hose is not a test collection
  10. 10. Test collection to-do list <ul><li>Research questions </li></ul><ul><li>Data collection methodology </li></ul><ul><li>Metrics </li></ul><ul><li>Data! </li></ul>
  11. 11. What are we trying to study? The network?
  12. 12. Or the person?
  13. 13. We’re interested in interactive search
  14. 14. What do people look for on Twitter? <ul><li>Trending topics </li></ul><ul><li>Events </li></ul><ul><li>Specific tweets </li></ul><ul><li>Catching up </li></ul><ul><li>Etc. </li></ul>
  15. 15. First Steps
  16. 16. First Steps
  17. 17. First Steps
  18. 18. Evaluation in Information Retrieval <ul><li>Need a collection </li></ul><ul><li>Need tasks </li></ul><ul><li>Need metrics </li></ul><ul><li>Ground Truth helps </li></ul>
  19. 19. How do we sample the data? <ul><li>By time, by topic, randomly? … </li></ul>
  20. 20. How do we measure?
  21. 21. Credits <ul><li>Title slide </li></ul><ul><ul><li>http://www.flickr.com/photos/matthamm/3383916444/ Matt Hamm </li></ul></ul><ul><ul><li>http://www.flickr.com/photos/nixart/370553161/ nixArt </li></ul></ul><ul><li>“ 10,000 people can’t be wrong” </li></ul><ul><ul><li>http://www.flickr.com/photos/luc/1824234195/ luc legay </li></ul></ul><ul><li>“ All the cool researchers are doing it” </li></ul><ul><ul><li>Gene Golovchinsky </li></ul></ul><ul><li>“ There is science in everything” </li></ul><ul><ul><li>Gene Golovchinsky </li></ul></ul><ul><li>“ We can build something cool” </li></ul><ul><ul><li>http://www.flickr.com/photos/donpezzano/3230179951/ urban don </li></ul></ul><ul><li>“ Maybe we can build something useful!” </li></ul><ul><ul><li>http://www.flickr.com/photos/herzogbr/2274372747/ herzogbr </li></ul></ul><ul><li>“ How do we know we’ve succeeded?” </li></ul><ul><ul><li>http://www.flickr.com/photos/14696088@N04/1606128341/ rstrawser </li></ul></ul><ul><li>“ Test collections (data sets) are one way to evaluate systems” </li></ul><ul><ul><li>http://www.flickr.com/photos/_after8_/4052028795/ Régis Gaidot </li></ul></ul><ul><li>“ The fire hose is not a test collection” </li></ul><ul><ul><li>http://www.flickr.com/photos/magh/2565471904/ Magh </li></ul></ul><ul><li>“ Test collection to-do list” </li></ul><ul><ul><li>http://www.flickr.com/photos/ario/3362388566/ ario_ </li></ul></ul><ul><li>“ What are we trying to study? The network?” </li></ul><ul><ul><li>http://www.flickr.com/photos/meg/3533025291 Meg Pickard </li></ul></ul><ul><li>“ Or the person?” </li></ul><ul><ul><li>Gene Golovchinsky </li></ul></ul><ul><li>We are interested in interactive search </li></ul><ul><ul><li>http://www.flickr.com/photos/dullhunk/3389581452/ dullhunk </li></ul></ul><ul><li>What do people look for on Twitter? </li></ul><ul><ul><li>http://www.flickr.com/photos/kevglobal/3170506186/ kevglobal </li></ul></ul><ul><li>First steps (3) </li></ul><ul><ul><li>Gene Golovchinsky </li></ul></ul><ul><li>Evaluation in Information Retrieval </li></ul><ul><ul><li>http://www.flickr.com/photos/ozyman/155517365/ Ozyman </li></ul></ul><ul><li>How do we sample the data? </li></ul><ul><ul><li>http://www.flickr.com/photos/red_devil/18540700/ SeenyaRita </li></ul></ul><ul><ul><li>http://www.flickr.com/photos/texasrobo/4185851361/ texasrobo </li></ul></ul><ul><li>How do we measure? </li></ul><ul><ul><li>http://www.flickr.com/photos/jurvetson/17945646/ jurvetson </li></ul></ul>

×