Fluentd in #tkrk10

5,157 views

Published on

About Fluentd in TokyoRubyKaigi10

Published in: Technology
0 Comments
8 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
5,157
On SlideShare
0
From Embeds
0
Number of Embeds
1,603
Actions
Shares
0
Downloads
15
Comments
0
Likes
8
Embeds 0
No embeds

No notes for slide

Fluentd in #tkrk10

  1. 1. Fluentd: The ruby based middleware across the world TAGOMORI Satoshi (@tagomoris) 2013/01/14 TokyoRubyKaigi10 #tkrk1013年1月14日月曜日
  2. 2. TAGOMORI Satoshi (@tagomoris) NHN Japan Corp.13年1月14日月曜日
  3. 3. 13年1月14日月曜日
  4. 4. Fluentd "Fluentd" is a lightweight and flexible log collector. Fluentd receives logs as JSON streams, buffers them, and sends them to other systems like Amazon S3, MongoDB, Hadoop, or other Fluentds. http://fluentd.org13年1月14日月曜日
  5. 5. Fluentd easy to install/setup (from rubygems.org) plugins easy to install (from rubygems.org) easy to write (with ruby!) stability (no one crashes in this 1 year) throghput (17500 msgs/sec) td-agent (rpm/deb: ruby and fluentd and some plugins)13年1月14日月曜日
  6. 6. Fluentd plugins Input plugins Output plugins Buffer plugins Output plugins as filters filtering, transformation, conversion, aggregation, ... 89 plugins! (2013/01/12)13年1月14日月曜日
  7. 7. Semi-Realtime aggregation in Fluentd (with growthforecast) HTTP Response Status (2xx, 3xx, 4xx, 5xx) HTTP Response Times (Avg, [50,90,95,98,99]%tiles) Beside of transferring13年1月14日月曜日
  8. 8. Fluentd loggers Ruby, Perl, Python, Node.js, PHP Java, Scala, D Haskell, Erlang, Lua, R13年1月14日月曜日
  9. 9. Fluentd is used with HTTP Access logs, application logs, ... MongoDB, Cassandra, Redis, Couch, MySQL, PostgreSQL, .... AWS S3, Hadoop HDFS, TreasureData, ... Flume, Scribe, Kafka, ... Zabbix, GrowthForecast, Splunk, IRC, ...13年1月14日月曜日
  10. 10. Fluentd vs. rsync + batches rsyslog / syslog-ng flume / storm / kafka13年1月14日月曜日
  11. 11. Fluentd users13年1月14日月曜日
  12. 12. What Fluentd is What be wanted for long long time from any languages by platform engineers by application engineers by service maintainers13年1月14日月曜日
  13. 13. Fluentd users may be newbie rubyists (or not) wants to work with many rubyists! Thanks!13年1月14日月曜日

×