Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Fluentd in #tkrk10


Published on

About Fluentd in TokyoRubyKaigi10

Published in: Technology
  • Be the first to comment

Fluentd in #tkrk10

  1. 1. Fluentd: The ruby based middleware across the world TAGOMORI Satoshi (@tagomoris) 2013/01/14 TokyoRubyKaigi10 #tkrk1013年1月14日月曜日
  2. 2. TAGOMORI Satoshi (@tagomoris) NHN Japan Corp.13年1月14日月曜日
  3. 3. 13年1月14日月曜日
  4. 4. Fluentd "Fluentd" is a lightweight and flexible log collector. Fluentd receives logs as JSON streams, buffers them, and sends them to other systems like Amazon S3, MongoDB, Hadoop, or other Fluentds. http://fluentd.org13年1月14日月曜日
  5. 5. Fluentd easy to install/setup (from plugins easy to install (from easy to write (with ruby!) stability (no one crashes in this 1 year) throghput (17500 msgs/sec) td-agent (rpm/deb: ruby and fluentd and some plugins)13年1月14日月曜日
  6. 6. Fluentd plugins Input plugins Output plugins Buffer plugins Output plugins as filters filtering, transformation, conversion, aggregation, ... 89 plugins! (2013/01/12)13年1月14日月曜日
  7. 7. Semi-Realtime aggregation in Fluentd (with growthforecast) HTTP Response Status (2xx, 3xx, 4xx, 5xx) HTTP Response Times (Avg, [50,90,95,98,99]%tiles) Beside of transferring13年1月14日月曜日
  8. 8. Fluentd loggers Ruby, Perl, Python, Node.js, PHP Java, Scala, D Haskell, Erlang, Lua, R13年1月14日月曜日
  9. 9. Fluentd is used with HTTP Access logs, application logs, ... MongoDB, Cassandra, Redis, Couch, MySQL, PostgreSQL, .... AWS S3, Hadoop HDFS, TreasureData, ... Flume, Scribe, Kafka, ... Zabbix, GrowthForecast, Splunk, IRC, ...13年1月14日月曜日
  10. 10. Fluentd vs. rsync + batches rsyslog / syslog-ng flume / storm / kafka13年1月14日月曜日
  11. 11. Fluentd users13年1月14日月曜日
  12. 12. What Fluentd is What be wanted for long long time from any languages by platform engineers by application engineers by service maintainers13年1月14日月曜日
  13. 13. Fluentd users may be newbie rubyists (or not) wants to work with many rubyists! Thanks!13年1月14日月曜日