This document discusses real-time web search and the challenges it presents. It defines real-time search as having a small delay between data creation and indexing, allowing search against current hot queries or in a small time window. However, real-time search faces issues around lack of quality due to spam and bias in sources like Twitter. Moving forward, real-time search needs to broaden coverage, provide topic-focused and informative results, and balance the needs for recency and quality while discovering information in real-time.

1. Real-Time Web SearchThe Road Ahead Sep. 2009 Jonghun Park jonghun@snu.ac.kr Seoul National Univ.

2. going real-time

3. what is real-time search? small delay between data creation & indexing microblog search search in a small time window search against current hot queries status search

4. controversial examples 1 year old photo just uploaded first report on Michael Jackson’s death real-time monitoring “IRS” query on Apr. 14th “At work...wish I was home..love my family”

5. real-time search, redefined RetrievingInformation with Time Value at Right Time sports game scores stock prices celebrity updates new products deals home pages wikipedia pages recipes old news articles regulations

6. opportunity “what’s going on right now?” $92B market

8. Atom

9. ping

10. SUP

11. API

12. information extraction

14. PubSubHubBub

15. tornado

16. comet

18. not so informative

19. lots of dittos and spams

20. danger of drowning

21. coverage of microblogs twitter: 23M+ monthly UV (compete.com) only 5% of twitter users accounts for 75% of all activity one quarter of all tweets are generated by bots twitter users are biased in terms of demographics

22. lack of quality quality assessment through identifying most popular, most authoritative, most linked-to, or most re-tweeted items such kind of filtering will require further processing that will decrease the freshness of information balancing the tension among recency, relevance, and quality is not an easy problem

23. what’s desired measuring the quality of streaming sources instead of posts broader coverage microblogs, blogs, public media, social media, and various casts beyond the simple buzz monitoring tool topic focused, informative search results faster information discovery balancing users' needs to see results in real-time with necessity to discover information from spam-free, quality sources

24. feedmil.com

25. feedmil approach popularity

26. key characteristics well known surprising

27. feedmil.jp

28. what’s next: from pull web to push web real-location real-event information filtering personalization intelligent stream discovery more breakthroughs in stream publishing & consumption

29. Thank You coming soon in oct. 2009