Effective Use of the Twitter Search API
by Eric Jensen on Apr 20, 2010
- 5,933 views
Chirp 2010 presentation on recent API changes, particularly ranking the top results beyond recency.
Chirp 2010 presentation on recent API changes, particularly ranking the top results beyond recency.
Accessibility
Categories
Tags
More...Upload Details
Uploaded via SlideShare as Apple Keynote
Usage Rights
© All Rights Reserved
Statistics
- Favorites
- 7
- Downloads
- 1
- Comments
- 1
- Embed Views
- Views on SlideShare
- 5,878
- Total Views
- 5,933
1–1 of 1 previous next
- start by giving some of our thinking about why we have a search api and what differentiates it from the other api’s twitter offers
- i’ll get into some technical implications of these differences with respect to polling on search versus tracking keywords on the streaming api
- next, i’ll talk briefly about how the search api has changed over time
- and then we’ll dig into the most recent change where we began ranking the top results beyond recency order. i’ll show you how i’ve modified one of our own search api clients to take advantage of that change
Obviously the “best” stuff for twitter has a lot to do with how recent it is, so our primary focus is on the “here and now”
- as ev told you yesterday we are doing more than 600M queries per day, seen up to 750M on a day recently
- while realtime is our main focus, our index does contain hundreds of millions of tweets and we’ve roughly doubled its size in the last six months.
- of course, the amount of tweets has grown even faster than we’ve increased that index size, so this only covers about a week of them right now, but that is something we’re currently working on expanding
---
make sure you explain this diagram by pointing at it (or at least describing it). It took me a minute to get the visual presentation
twitter search and the API have been around for about two years now, and we made a lot of changes early on like supporting location search, but after that we had to shift our focus to scaling the system to support the growth in tweets and queries. It’s really just in the last six months that we’ve made enough progress with scaling and grown the search team enough to be able to focus more on relevance and figuring out what that means for twitter search.
----
Under “many factors” you should note that it’s not always the popular users that show up here -- that seems to be an early misconception. Our algorithm looks to find things that are interesting from any user - things that “resonate,” to use a word that Dick talked about yesterday (good to tie it in to other things being said at Chirp).
Rather than “not final” (which seems to imply there is a “final” step when we won’t be improving this) I’d say something like “First step of a long road of relevance improvements” (implying that we’ve got lots of ideas and we’ll be delivering cool stuff for a long way.