Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Fluent-bit

3,538 views

Published on

Fluentd Meetup 2015 夏 発表資料

Published in: Engineering

Fluent-bit

  1. 1. About Me > Eduardo Silva ● Github & Twitter: @edsiper ● Personal Blog : http://edsiper.linuxchile.cl > Treasure Data, Inc. ● Open Source Engineer Fluentd / FluentBit > Projects ● Monkey Server / monkey-project.com ● Duda I/O / duda.io
  2. 2. Logging
  3. 3. Logging Matters ● Applications status ● Debugging ● Record specific events ● General information about anomalies: errors ● Troubleshooting / Support ● Local or Remote (network) Pros
  4. 4. Logging and other use cases
  5. 5. Logging More use cases ● Internet of Things (IoT) ● Embedded Applications When resources are available, Logging can be done pretty straightforward with professional solutions such as Fluentd, but in more restrictive environments the scenario is quite different: The fun begins ;)
  6. 6. Internet of Things (IoT)
  7. 7. Internet of Things Facts ● IoT will grow to many billions of devices over the next decade. ● Now it's about device to device connectivity. ● Different frameworks and protocols are emerging. ● It needs Logging.
  8. 8. Internet of Things Frameworks In order to solve the device to device connectivity and proper messaging, multiple framework/stacks are emerging, all of them backed by different companies and vendors. The most remarkable at the moment are: Brillo, by Google Just announced, no logo..sorry!
  9. 9. Internet of Things Logging ● How do we approach data collection for IoT ? ● How can we improve our IoT based product if we have data from thousand of devices with multiple sensors (many inputs) ?
  10. 10. Fluentd for Embedded ?
  11. 11. Fluent Bit Objective ● Sensors ● Services ● Signals / Radios ● Operating System Info ● Automotive / Telematics Open Source data collection tool for Embedded Linux:
  12. 12. Fluent Bit Requirements ● Lightweight ● Written in C Language. ● Customizable, pluggable architecture. ● Integrate with Fluentd An Embedded environment requires special handling, specifically on performance and resources utilization, for hence it needs to be:
  13. 13. Fluent Bit Requirements ● Support custom Inputs ● Support custom Outputs ● Use Binary Serialization (MsgPack) ● Configurable (though file system files)
  14. 14. Features
  15. 15. Fluent Bit Features ● Collection & Distribution. ● Built-in system metrics. ● C API for Developers (WIP). ● Integration with third party services. ● Open Source / Apache License v2.0
  16. 16. Fluentd Integration
  17. 17. Fluent Bit Fluentd Integration
  18. 18. Direct Output
  19. 19. Fluent Bit Fluentd Integration
  20. 20. Examples
  21. 21. Fluent Bit Built-in Metrics: CPU usage
  22. 22. Fluent Bit Kernel Log Messages
  23. 23. Fluent Bit Configuration Example
  24. 24. Roadmap
  25. 25. Fluent Bit Roadmap ● Library mode. ● Support a stock of sensors (inputs). ● HTTP input. ● Release first stable version. ● Documentation.
  26. 26. Fluent Bit More information ● http://fluentbit.io (official web site) ● http://github.com/fluent/fluent-bit For more details about Fluent Bit please refer to the following links: Thanks! For more details about Fluent Bit please refer to the following links: Eduardo Silva, @edsiper eduardo@treasure-data.com

×