• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Inside Buzztter
 

Inside Buzztter

on

  • 4,710 views

 

Statistics

Views

Total Views
4,710
Views on SlideShare
2,739
Embed Views
1,971

Actions

Likes
1
Downloads
9
Comments
0

11 Embeds 1,971

http://d.hatena.ne.jp 1165
http://darashi.net 430
http://localhost 275
http://www.enishi-tech.com 67
http://coderwall.com 16
http://darashi.dev 12
http://0.0.0.0 2
http://webcache.googleusercontent.com 1
http://dara.shidara.net 1
http://0.0.0.0:4000 1
http://theoldreader.com 1
More...

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Inside Buzztter Inside Buzztter Presentation Transcript

    • RubyConf 2009 2009-11-19Inside buzztter設樂 洋爾 (Yoji Shidara)yoji.shidara@enishi-tech.com
    • My name isYoji SHIDARA.
    • Enishi Tech Inc.Small Company.Only 2 staffs.
    • Small Office.(CEO’s flat)
    • I’m from Sapporo! @darashi (me)Sapporo 1.4hrs 9.5hrsTokyo San Fransisco!
    • Sapporo is abeautiful provincialcity of Japan.
    • Delicious foods arewaiting for you!
    • Do you knowbuzztter.com?
    • RubyConf 2009 2009-11-19 LTOutside buzztter設樂 洋爾 (Yoji Shidara)yoji.shidara@enishi-tech.com
    • http://buzztter.com
    • http://buzztter.com buzz-phrases (auto update)Full-text Search Results (auto update)
    • Servers are in my room! next to my bed
    • We crawls:1,932,823 tweets/day (Japanese) 607,749 tweets/day (English) (We’re now focusing on Japanese users due to API limits) We have: 1,336,444 PVs / Month
    • Server 1: Phenom 9950 Memory 8GB SSD 80GB + HDD 80GBServer 2: PhenomII x4 955 Memory 8GB HDD 500GB
    • @buzztter
    • Bot for English wasbanned because it tweeted spam as hot :-<
    • Buzztter:
    • buzz-phrase detection +real time full text search
    • ... like official“trending topics”
    • buzztter releasedbefore the official one launched!
    • buzztter supports English and Japanese!
    • 1-2 minutes forbuzz analysis par a language.
    • HOT notification bot is available.
    • RubyConf 2009 2009-11-19 LTInside buzztter設樂 洋爾 (Yoji Shidara)yoji.shidara@enishi-tech.com
    • System Diagram:Rough Sketch Web Notification Frontend module crawler Fulltext Analyzer module Search module BuzzDAS: Buzz Data Analysis System
    • System Diagram: Crawler Typhoeus Twitter crawler EventMachine RabbitMQ MQ crawl crawl scheduling controller libtextcatUsers DB langugage language, guesserPostgreSQL post frequency
    • notifier pagecachecrawler bot varnish Twitter4R Web Frontend net/irc Rails MQ Web Service API Sinatra memcached groonga fulltext importer search analyzer engineBuzzDAS: Buzz Data Analysis System
    • analyzer tokenizer phrase extractor detects change of phrase occurrence Reference Recent Index Indexkeeps post in 24 hours keeps recent 1 hour
    • Try http://buzztter.com and giveme your feedback please!If you Interested in thesekeywords:groonga, AMQP, RabbitMQ, Typhoeus,EventMachine, PostgreSQL, libtextcat,Sinatra, Rails, Twitter4R, net/irc,memcached, PrefixSpan ,MeCab, TF-IDF, ... or our BuzzDAS Engine, please contact me! My name is Yoji Shidara.