This document summarizes a technical talk given by Satoshi Tagomori of Treasure Data on March 11, 2015 about Fluentd and Treasure Data. It discusses Fluentd's open source data collection capabilities, planned improvements to Fluentd like new plugin APIs and sub-second time support, and how Treasure Data contributes to and helps maintain Fluentd and other open source projects.

1. Copyright ©2014 Treasure Data. All Rights Reserved.
Treasure Data and
Fluentd
Treasure Data Tech Talk
Satoshi Tagomori, Treasure Data
March 11, 2015

2. Copyright ©2014 Treasure Data. All Rights Reserved.
@tagomoris
Satoshi Tagomori
Treasure Data, Inc. ← new!
Backend team (& OSS)
2

3. Copyright ©2014 Treasure Data. All Rights Reserved.

4. Copyright ©2014 Treasure Data. All Rights Reserved.
Fluentd
4
• "an open source data collector for unified
logging layer"
• Releases
• v0.12.6
• v0.10.61
• td-agent 2.1.5
• Many 3rd party plugins

5. Copyright ©2014 Treasure Data. All Rights Reserved.
Plan for Fluentd v0.14
• New Plugin APIs
• PluginSupport mixin (timer, thread, child_process, socket, ...)
• Additional Buffer configuration params & APIs
• Plugin storage
• Compatibility layer for traditional plugins
• Sub-second Time
• SocketManager & graceful restart
5

6. Copyright ©2014 Treasure Data. All Rights Reserved. 6
v0.12 vs 0.14 w/ PluginSupport (in_status)
59 lines (v0.12.6)
25 lines (v0.14 API)

7. Copyright ©2014 Treasure Data. All Rights Reserved.
Treasure Data &

8. Copyright ©2014 Treasure Data. All Rights Reserved.
Treasure Data OSS Team
• Masahiro Nakagawa (@repeatedly)
• fluentd, td-agent
• Eduardo Silva
• fluent-bit, fluentd-forwarder
• Satoshi Tagomori (@tagomoris), part-time
• fluentd v0.14 APIs
• Many more to do!
8

9. Copyright ©2014 Treasure Data. All Rights Reserved.
We are hiring!
10/2/14
9