YAPC::Asia 2010 Twitter解析サービス

Yusuke Wada
Yusuke WadaWeb Application Developer
YAPC::Asia 2010 Twitter解析サービス
• 
• 
• 
• 
• 
• 
• 
YAPC::Asia 2010 Twitter解析サービス
• 
     – 


• 
     – 


• 
     – 
• 
     – 
YAPC::Asia 2010 Twitter解析サービス
• 
• 
• 
• 
• 
• 
YAPC::Asia 2010 Twitter解析サービス
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
yusuke@dev:~/work/twib/Twib/trunk$ ls 
bot  cli  etc  migration  schema  web 
• 
• 




 • 
 • 
 • 
• 

Package Twib::CLI::Reader::Feed; 
use JSON::XS; 
use LWP::UserAgent; 

Package Twib::CLI::Reader::Stream; 
use AnyEvent::Twitter::Stream; 
• 

• 
• 
     – 
• 
     – 
• 
     – 
YAPC::Asia 2010 Twitter解析サービス
#API Reader 
my $client = Gearman::Client‐>new; 
$client‐>job_servers(qw|localhost:7003|); 
$client‐>dispatch_background( "fetch", $json, {} ); 



#Worker 
my $worker = Gearman::Worker‐>new; 
$worker‐>job_servers(qw|localhost:7003|); 
$worker‐>register_function( "fetch" => &fetch ); 
$worker‐>work while 1; 

sub fetch { 
    my $job      = shift; 
    my $args = $job‐>arg; 
    $fetcher‐>fetch( decode_json($args) ); 
} 
• 
     – 
     – 

• 
     – 
          • 

     – 
• 
     – 
–    – 
–    – 
–    – 
     – 



     – 
     – 
• 

• 

• 
• 
• 
     – 
• 
     – 
• 
• 
• 
• 
• 
• 

• 
     – 




• 
YAPC::Asia 2010 Twitter解析サービス
• 
• 
• 
     – 
     – 
• 
     – 
• 
     – 
• 
YAPC::Asia 2010 Twitter解析サービス
1 of 32

Recommended

Blog Hacks 2011 by
Blog Hacks 2011Blog Hacks 2011
Blog Hacks 2011Yusuke Wada
2.7K views43 slides
Twib in Yokoahma.pm 2010/3/5 by
Twib in Yokoahma.pm 2010/3/5Twib in Yokoahma.pm 2010/3/5
Twib in Yokoahma.pm 2010/3/5Yusuke Wada
1.7K views17 slides
エロサイト管理者の憂鬱3 - Hokkaiodo.pm#4 - by
エロサイト管理者の憂鬱3 - Hokkaiodo.pm#4 -エロサイト管理者の憂鬱3 - Hokkaiodo.pm#4 -
エロサイト管理者の憂鬱3 - Hokkaiodo.pm#4 -Yusuke Wada
3K views56 slides
Mojolicious by
MojoliciousMojolicious
MojoliciousMarcos Rebelo
5.4K views44 slides
RESTful web services by
RESTful web servicesRESTful web services
RESTful web servicesTudor Constantin
2K views13 slides
Mojo as a_client by
Mojo as a_clientMojo as a_client
Mojo as a_clientMarcus Ramberg
1.7K views52 slides

More Related Content

What's hot

Mojolicious - Perl Framework for the Real-Time Web (Lightning Talk) by
Mojolicious - Perl Framework for the Real-Time Web (Lightning Talk)Mojolicious - Perl Framework for the Real-Time Web (Lightning Talk)
Mojolicious - Perl Framework for the Real-Time Web (Lightning Talk)Dotan Dimet
1.4K views32 slides
Perl web frameworks by
Perl web frameworksPerl web frameworks
Perl web frameworksdiego_k
670 views103 slides
Webrtc mojo by
Webrtc mojoWebrtc mojo
Webrtc mojobpmedley
2K views10 slides
Mojolicious by
MojoliciousMojolicious
MojoliciousLenz Gschwendtner
963 views24 slides
PerlでWeb API入門 by
PerlでWeb API入門PerlでWeb API入門
PerlでWeb API入門Yusuke Wada
7K views23 slides
Perl5i by
Perl5iPerl5i
Perl5iMarcos Rebelo
510 views24 slides

What's hot(20)

Mojolicious - Perl Framework for the Real-Time Web (Lightning Talk) by Dotan Dimet
Mojolicious - Perl Framework for the Real-Time Web (Lightning Talk)Mojolicious - Perl Framework for the Real-Time Web (Lightning Talk)
Mojolicious - Perl Framework for the Real-Time Web (Lightning Talk)
Dotan Dimet1.4K views
Perl web frameworks by diego_k
Perl web frameworksPerl web frameworks
Perl web frameworks
diego_k670 views
Webrtc mojo by bpmedley
Webrtc mojoWebrtc mojo
Webrtc mojo
bpmedley2K views
PerlでWeb API入門 by Yusuke Wada
PerlでWeb API入門PerlでWeb API入門
PerlでWeb API入門
Yusuke Wada7K views
Web Apps in Perl - HTTP 101 by hendrikvb
Web Apps in Perl - HTTP 101Web Apps in Perl - HTTP 101
Web Apps in Perl - HTTP 101
hendrikvb2.9K views
Mojolicious - A new hope by Marcus Ramberg
Mojolicious - A new hopeMojolicious - A new hope
Mojolicious - A new hope
Marcus Ramberg12.1K views
Decoupling Objects With Standard Interfaces by Thomas Weinert
Decoupling Objects With Standard InterfacesDecoupling Objects With Standard Interfaces
Decoupling Objects With Standard Interfaces
Thomas Weinert995 views
Mojolicious, real-time web framework by taggg
Mojolicious, real-time web frameworkMojolicious, real-time web framework
Mojolicious, real-time web framework
taggg1.6K views
Absolute Beginners Guide to Puppet Through Types - PuppetConf 2014 by Puppet
Absolute Beginners Guide to Puppet Through Types - PuppetConf 2014Absolute Beginners Guide to Puppet Through Types - PuppetConf 2014
Absolute Beginners Guide to Puppet Through Types - PuppetConf 2014
Puppet2K views
Introduction to the Pods JSON API by podsframework
Introduction to the Pods JSON APIIntroduction to the Pods JSON API
Introduction to the Pods JSON API
podsframework6.7K views
Undercover Pods / WP Functions by podsframework
Undercover Pods / WP FunctionsUndercover Pods / WP Functions
Undercover Pods / WP Functions
podsframework2.1K views
DBIx::Skinnyと仲間たち by Ryo Miyake
DBIx::Skinnyと仲間たちDBIx::Skinnyと仲間たち
DBIx::Skinnyと仲間たち
Ryo Miyake1.9K views
TDC2015 Porto Alegre - Automate everything with Phing ! by Matheus Marabesi
TDC2015 Porto Alegre - Automate everything with Phing !TDC2015 Porto Alegre - Automate everything with Phing !
TDC2015 Porto Alegre - Automate everything with Phing !
Matheus Marabesi1K views

Viewers also liked

Wawasan bangi kajang 30 tahun akan datang by
Wawasan bangi kajang 30 tahun akan datangWawasan bangi kajang 30 tahun akan datang
Wawasan bangi kajang 30 tahun akan datangfatimatulzahra mohamad japar
494 views15 slides
Simon Property Group by
Simon Property GroupSimon Property Group
Simon Property GroupCurtis Garrett
204 views1 slide
Creative Compound Press Materials & Media Outreach Materials by
Creative Compound Press Materials & Media Outreach MaterialsCreative Compound Press Materials & Media Outreach Materials
Creative Compound Press Materials & Media Outreach MaterialsClaire Mirsky
507 views5 slides
CAREPNG 5-Yr StrtPln 2012-16 by
CAREPNG 5-Yr StrtPln 2012-16CAREPNG 5-Yr StrtPln 2012-16
CAREPNG 5-Yr StrtPln 2012-16Peter Raynes
396 views26 slides
Bangi kajang 30 tahun akan datang by
Bangi kajang 30 tahun akan datangBangi kajang 30 tahun akan datang
Bangi kajang 30 tahun akan datangIntan Fazira Erna
257 views12 slides
The master plan of scaling a web application by
The master plan ofscaling a web applicationThe master plan ofscaling a web application
The master plan of scaling a web applicationYusuke Wada
7K views65 slides

Viewers also liked(12)

Creative Compound Press Materials & Media Outreach Materials by Claire Mirsky
Creative Compound Press Materials & Media Outreach MaterialsCreative Compound Press Materials & Media Outreach Materials
Creative Compound Press Materials & Media Outreach Materials
Claire Mirsky507 views
CAREPNG 5-Yr StrtPln 2012-16 by Peter Raynes
CAREPNG 5-Yr StrtPln 2012-16CAREPNG 5-Yr StrtPln 2012-16
CAREPNG 5-Yr StrtPln 2012-16
Peter Raynes396 views
The master plan of scaling a web application by Yusuke Wada
The master plan ofscaling a web applicationThe master plan ofscaling a web application
The master plan of scaling a web application
Yusuke Wada7K views
Pra-Rancangan Pabrik Amonium Klorida dengan Proses Netralisasi Kapasitas 100.... by Pulung Sambadha
Pra-Rancangan Pabrik Amonium Klorida dengan Proses Netralisasi Kapasitas 100....Pra-Rancangan Pabrik Amonium Klorida dengan Proses Netralisasi Kapasitas 100....
Pra-Rancangan Pabrik Amonium Klorida dengan Proses Netralisasi Kapasitas 100....
Pulung Sambadha1.3K views
How can HubSpot help BabelQuest grow your business by Eric Murphy
How can HubSpot help BabelQuest grow your businessHow can HubSpot help BabelQuest grow your business
How can HubSpot help BabelQuest grow your business
Eric Murphy557 views
Adblock is a boycott: The failure of Big Data to see it coming. Version 2.0. ... by David Carroll
Adblock is a boycott: The failure of Big Data to see it coming. Version 2.0. ...Adblock is a boycott: The failure of Big Data to see it coming. Version 2.0. ...
Adblock is a boycott: The failure of Big Data to see it coming. Version 2.0. ...
David Carroll2K views
Calendari 2017 by LauraGR
Calendari 2017Calendari 2017
Calendari 2017
LauraGR3.1K views
Lmcp 1532 pembangunan bandar mapan by raqib17
Lmcp 1532 pembangunan bandar mapanLmcp 1532 pembangunan bandar mapan
Lmcp 1532 pembangunan bandar mapan
raqib1783 views

Similar to YAPC::Asia 2010 Twitter解析サービス

Snakes on a Treadmill by
Snakes on a TreadmillSnakes on a Treadmill
Snakes on a TreadmillChef Software, Inc.
993 views17 slides
Easy Cloud Native Transformation using HashiCorp Nomad by
Easy Cloud Native Transformation using HashiCorp NomadEasy Cloud Native Transformation using HashiCorp Nomad
Easy Cloud Native Transformation using HashiCorp NomadBram Vogelaar
165 views56 slides
PSGI and Plack from first principles by
PSGI and Plack from first principlesPSGI and Plack from first principles
PSGI and Plack from first principlesPerl Careers
2K views42 slides
AnyMQ, Hippie, and the real-time web by
AnyMQ, Hippie, and the real-time webAnyMQ, Hippie, and the real-time web
AnyMQ, Hippie, and the real-time webclkao
2.7K views41 slides
Dancing with websocket by
Dancing with websocketDancing with websocket
Dancing with websocketDamien Krotkine
3.8K views28 slides
Remedie: Building a desktop app with HTTP::Engine, SQLite and jQuery by
Remedie: Building a desktop app with HTTP::Engine, SQLite and jQueryRemedie: Building a desktop app with HTTP::Engine, SQLite and jQuery
Remedie: Building a desktop app with HTTP::Engine, SQLite and jQueryTatsuhiko Miyagawa
39.1K views131 slides

Similar to YAPC::Asia 2010 Twitter解析サービス(20)

Easy Cloud Native Transformation using HashiCorp Nomad by Bram Vogelaar
Easy Cloud Native Transformation using HashiCorp NomadEasy Cloud Native Transformation using HashiCorp Nomad
Easy Cloud Native Transformation using HashiCorp Nomad
Bram Vogelaar165 views
PSGI and Plack from first principles by Perl Careers
PSGI and Plack from first principlesPSGI and Plack from first principles
PSGI and Plack from first principles
Perl Careers2K views
AnyMQ, Hippie, and the real-time web by clkao
AnyMQ, Hippie, and the real-time webAnyMQ, Hippie, and the real-time web
AnyMQ, Hippie, and the real-time web
clkao2.7K views
Remedie: Building a desktop app with HTTP::Engine, SQLite and jQuery by Tatsuhiko Miyagawa
Remedie: Building a desktop app with HTTP::Engine, SQLite and jQueryRemedie: Building a desktop app with HTTP::Engine, SQLite and jQuery
Remedie: Building a desktop app with HTTP::Engine, SQLite and jQuery
Tatsuhiko Miyagawa39.1K views
Altitude SF 2017: Fastly GSLB: Scaling your microservice and multi-cloud envi... by Fastly
Altitude SF 2017: Fastly GSLB: Scaling your microservice and multi-cloud envi...Altitude SF 2017: Fastly GSLB: Scaling your microservice and multi-cloud envi...
Altitude SF 2017: Fastly GSLB: Scaling your microservice and multi-cloud envi...
Fastly1.1K views
How to build a High Performance PSGI/Plack Server by Masahiro Nagano
How to build a High Performance PSGI/Plack Server How to build a High Performance PSGI/Plack Server
How to build a High Performance PSGI/Plack Server
Masahiro Nagano18.6K views
The Peanut Butter Cup of Web-dev: Plack and single page web apps by John Anderson
The Peanut Butter Cup of Web-dev: Plack and single page web appsThe Peanut Butter Cup of Web-dev: Plack and single page web apps
The Peanut Butter Cup of Web-dev: Plack and single page web apps
John Anderson545 views
Automating Research Data with Globus Flows and Compute by Globus
Automating Research Data with Globus Flows and ComputeAutomating Research Data with Globus Flows and Compute
Automating Research Data with Globus Flows and Compute
Globus 9 views
OSMC 2011 | Case Study - Icinga at Hyves.nl by Jeffrey Lensen by NETWAYS
OSMC 2011 | Case Study - Icinga at Hyves.nl by Jeffrey LensenOSMC 2011 | Case Study - Icinga at Hyves.nl by Jeffrey Lensen
OSMC 2011 | Case Study - Icinga at Hyves.nl by Jeffrey Lensen
NETWAYS37 views
What we Learned Implementing Puppet at Backstop by Puppet
What we Learned Implementing Puppet at BackstopWhat we Learned Implementing Puppet at Backstop
What we Learned Implementing Puppet at Backstop
Puppet3.1K views
Everything ruby by ajeygore
Everything rubyEverything ruby
Everything ruby
ajeygore752 views

More from Yusuke Wada

僕がつくった 70個のうちの48個のWebサービス達 by
僕がつくった 70個のうちの48個のWebサービス達僕がつくった 70個のうちの48個のWebサービス達
僕がつくった 70個のうちの48個のWebサービス達Yusuke Wada
18.8K views121 slides
スッとGoを取り入れる by
スッとGoを取り入れるスッとGoを取り入れる
スッとGoを取り入れるYusuke Wada
23.5K views69 slides
東京脱出計画中 by
東京脱出計画中東京脱出計画中
東京脱出計画中Yusuke Wada
6K views36 slides
Extreme remote working by
Extreme remote workingExtreme remote working
Extreme remote workingYusuke Wada
6.4K views37 slides
Podcastを支える技術、エンジニアのためのWebメディア、そしてCPAN by
Podcastを支える技術、エンジニアのためのWebメディア、そしてCPANPodcastを支える技術、エンジニアのためのWebメディア、そしてCPAN
Podcastを支える技術、エンジニアのためのWebメディア、そしてCPANYusuke Wada
31.3K views105 slides
創造のプロセスを回せ!v0.01 by
創造のプロセスを回せ!v0.01創造のプロセスを回せ!v0.01
創造のプロセスを回せ!v0.01Yusuke Wada
5.8K views26 slides

More from Yusuke Wada(20)

僕がつくった 70個のうちの48個のWebサービス達 by Yusuke Wada
僕がつくった 70個のうちの48個のWebサービス達僕がつくった 70個のうちの48個のWebサービス達
僕がつくった 70個のうちの48個のWebサービス達
Yusuke Wada18.8K views
スッとGoを取り入れる by Yusuke Wada
スッとGoを取り入れるスッとGoを取り入れる
スッとGoを取り入れる
Yusuke Wada23.5K views
東京脱出計画中 by Yusuke Wada
東京脱出計画中東京脱出計画中
東京脱出計画中
Yusuke Wada6K views
Extreme remote working by Yusuke Wada
Extreme remote workingExtreme remote working
Extreme remote working
Yusuke Wada6.4K views
Podcastを支える技術、エンジニアのためのWebメディア、そしてCPAN by Yusuke Wada
Podcastを支える技術、エンジニアのためのWebメディア、そしてCPANPodcastを支える技術、エンジニアのためのWebメディア、そしてCPAN
Podcastを支える技術、エンジニアのためのWebメディア、そしてCPAN
Yusuke Wada31.3K views
創造のプロセスを回せ!v0.01 by Yusuke Wada
創造のプロセスを回せ!v0.01創造のプロセスを回せ!v0.01
創造のプロセスを回せ!v0.01
Yusuke Wada5.8K views
It's not only about "REMOTE" by Yusuke Wada
It's not only about "REMOTE"It's not only about "REMOTE"
It's not only about "REMOTE"
Yusuke Wada2.5K views
事故からはじまるスケールチャンス by Yusuke Wada
事故からはじまるスケールチャンス事故からはじまるスケールチャンス
事故からはじまるスケールチャンス
Yusuke Wada2.8K views
Google BigQueryを使ってみた! by Yusuke Wada
Google BigQueryを使ってみた!Google BigQueryを使ってみた!
Google BigQueryを使ってみた!
Yusuke Wada13.5K views
Webサービスのコンテンツパターン 或いはデータの活⽤ by Yusuke Wada
Webサービスのコンテンツパターン 或いはデータの活⽤Webサービスのコンテンツパターン 或いはデータの活⽤
Webサービスのコンテンツパターン 或いはデータの活⽤
Yusuke Wada7.4K views
とある Perl Monger の働き方 by Yusuke Wada
とある Perl Monger の働き方とある Perl Monger の働き方
とある Perl Monger の働き方
Yusuke Wada15.5K views
5 minutes - YAPC::Asia Tokyo 2014 by Yusuke Wada
5 minutes - YAPC::Asia Tokyo 20145 minutes - YAPC::Asia Tokyo 2014
5 minutes - YAPC::Asia Tokyo 2014
Yusuke Wada2.2K views
Podcastをカジュアルに 支える技術 by Yusuke Wada
Podcastをカジュアルに 支える技術Podcastをカジュアルに 支える技術
Podcastをカジュアルに 支える技術
Yusuke Wada3.4K views
そのWebサービスは本当に「あたりまえ」だったのか? by Yusuke Wada
そのWebサービスは本当に「あたりまえ」だったのか?そのWebサービスは本当に「あたりまえ」だったのか?
そのWebサービスは本当に「あたりまえ」だったのか?
Yusuke Wada3.3K views
Mojoliciousでつくる! Webアプリ入門 by Yusuke Wada
Mojoliciousでつくる! Webアプリ入門Mojoliciousでつくる! Webアプリ入門
Mojoliciousでつくる! Webアプリ入門
Yusuke Wada22.2K views
10 things to learn from Bokete by Yusuke Wada
10 things to learn from Bokete10 things to learn from Bokete
10 things to learn from Bokete
Yusuke Wada2.5K views
僕らの履歴書 by Yusuke Wada
僕らの履歴書僕らの履歴書
僕らの履歴書
Yusuke Wada4.8K views
僕らがWebサービスをつくる5つの理由 by Yusuke Wada
僕らがWebサービスをつくる5つの理由僕らがWebサービスをつくる5つの理由
僕らがWebサービスをつくる5つの理由
Yusuke Wada53.4K views
僕らがつくるための 「5W」について by Yusuke Wada
僕らがつくるための 「5W」について僕らがつくるための 「5W」について
僕らがつくるための 「5W」について
Yusuke Wada2.6K views
「Webサービスのつくり方」 のつくり方 by Yusuke Wada
「Webサービスのつくり方」 のつくり方「Webサービスのつくり方」 のつくり方
「Webサービスのつくり方」 のつくり方
Yusuke Wada8.2K views

YAPC::Asia 2010 Twitter解析サービス