SlideShare a Scribd company logo
1 of 28
Download to read offline
Monitoring
your Logs
with Fluent
Toshaan
Bharvani -
VanTosh
bvba
Introduction
Components
Build
Automation
The End
Spoiler
Monitoring your Logs with Fluent
Fluentd with fluentbit
Open Source Monitoring Conference 2019
6 November 2019
Toshaan Bharvani - VanTosh bvba
<toshaan@vantosh.com>
Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 1 / 28
Monitoring
your Logs
with Fluent
Toshaan
Bharvani -
VanTosh
bvba
Introduction
Components
Build
Automation
The End
Spoiler
$ whoami
Toshaan Bharvani
• From Antwerp, Belgium
• Self-employed engineer/trainer (available for hire)
http://www.vantosh.com
• Involved with Enterprise Linux & RPM packaging : PEL,
CentOS, RHEL, IBM AIX, BSD, SLES, . . .
• Likes to keep everything secure : SELinux, WebSec, . . .
• Lives in a virtual container world : KVM, Podman,
PowerVM, z/VM, LXC, Xen, . . .
• Likes automation CfgMgmt / DevOps : Ansible, Foreman,
Puppet, . . .
• Involved with hardware, software and conferences
• Wants to take over the universe
• Twitter : @toshywoshy
• Blog : http://www.toshaan.com
• Social : @toshywoshy
Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 2 / 28
Monitoring
your Logs
with Fluent
Toshaan
Bharvani -
VanTosh
bvba
Introduction
Components
Build
Automation
The End
Spoiler
1
Introduction
Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 3 / 28
Monitoring
your Logs
with Fluent
Toshaan
Bharvani -
VanTosh
bvba
Introduction
Components
Build
Automation
The End
Spoiler
Monitoring
• Checks the current state of a subject
• Checks the current utilization of a subject
• Checks the current return of a subject
Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 4 / 28
Monitoring
your Logs
with Fluent
Toshaan
Bharvani -
VanTosh
bvba
Introduction
Components
Build
Automation
The End
Spoiler
Metrics
• Measures and keeps the history of the states of a subject
• Measures and keeps the history of the utilization of a
subject
• Measures and keeps the history of the return of a subject
Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 5 / 28
Monitoring
your Logs
with Fluent
Toshaan
Bharvani -
VanTosh
bvba
Introduction
Components
Build
Automation
The End
Spoiler
Logs
• Logs are the records of the events of the system
• Logs are the records of the messages of the system
• Logs are the records of the transactions of the system
Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 6 / 28
Monitoring
your Logs
with Fluent
Toshaan
Bharvani -
VanTosh
bvba
Introduction
Components
Build
Automation
The End
Spoiler
2
Components
Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 7 / 28
Monitoring
your Logs
with Fluent
Toshaan
Bharvani -
VanTosh
bvba
Introduction
Components
Build
Automation
The End
Spoiler
What is FluentD
• A unified logging layer in between
• Decouples backend from frontend
• Streaming data system
• JSON payload
• Many inputs and output plugins
• HA setup
• Reduces complexity
Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 8 / 28
Monitoring
your Logs
with Fluent
Toshaan
Bharvani -
VanTosh
bvba
Introduction
Components
Build
Automation
The End
Spoiler
FluentD M+N
Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 9 / 28
Monitoring
your Logs
with Fluent
Toshaan
Bharvani -
VanTosh
bvba
Introduction
Components
Build
Automation
The End
Spoiler
What is FluentBit
• Log processor & forwarder
• Light-weight daemon
• Written in C
• Many inputs and output plugins
• Collecting from different sources and sending to different
destinations
• TLS connections
• Reduces complexity
Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 10 / 28
Monitoring
your Logs
with Fluent
Toshaan
Bharvani -
VanTosh
bvba
Introduction
Components
Build
Automation
The End
Spoiler
Graphite - Carbon - Whisper
• Written in Python
• Graphite
• Django-based web application that renders graphs and
dashboards
• Carbon
• Metric processing daemons
• Whisper
• Time-series database library
Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 11 / 28
Monitoring
your Logs
with Fluent
Toshaan
Bharvani -
VanTosh
bvba
Introduction
Components
Build
Automation
The End
Spoiler
Grafana
• Written in Golang
• Dashboard tool
• Visualization
• Log viewing
• Metrics view
Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 12 / 28
Monitoring
your Logs
with Fluent
Toshaan
Bharvani -
VanTosh
bvba
Introduction
Components
Build
Automation
The End
Spoiler
Icinga
• Monitoring tool
• Alerting tool
• Notification tool
• Business Overview
Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 13 / 28
Monitoring
your Logs
with Fluent
Toshaan
Bharvani -
VanTosh
bvba
Introduction
Components
Build
Automation
The End
Spoiler
Setup
Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 14 / 28
Monitoring
your Logs
with Fluent
Toshaan
Bharvani -
VanTosh
bvba
Introduction
Components
Build
Automation
The End
Spoiler
Ansible
• Orchestration / CfgMgmt / Remote Execution Tool
• Python based uses SSH, WinRM, or API
• Server based, agentless1
• host information in flat files, CMDB, scripts, . . .
• executes the task on the host side
• Playbook : combination of tasks with meta information
• Roles : abstract playbook with tasks, variables and
handlers
• Templates : Jinja2
• works where Python works2
1
Abstraction of SSH / WinRM to connect with the node and in certain setup an agent might be
required, but by default it is not necessary
2
Ansible can actually run without Python on the remote host, however it is not fully supported
Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 15 / 28
Monitoring
your Logs
with Fluent
Toshaan
Bharvani -
VanTosh
bvba
Introduction
Components
Build
Automation
The End
Spoiler
3
Build
Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 16 / 28
Monitoring
your Logs
with Fluent
Toshaan
Bharvani -
VanTosh
bvba
Introduction
Components
Build
Automation
The End
Spoiler
FluentD Basic Setup
1 <source>
2 @type forward
3 port 24224
4 </ source>
5
6 <source>
7 @type http
8 port 9880
9 </ source>
10
11 <match myapp.access>
12 @type file
13 path /var/log/fluent/access
14 </ match>
Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 17 / 28
Monitoring
your Logs
with Fluent
Toshaan
Bharvani -
VanTosh
bvba
Introduction
Components
Build
Automation
The End
Spoiler
FluentD Application Setup
1 <source>
2 @type forward
3 </ source>
4
5 <source>
6 @type tail
7 @label @SYSTEM
8 </ source>
9
10 <filter access .**>
11 @type record_transformer
12 <record>
13 </ record>
14 </ filter>
15 <match **>
16 @type elasticsearch
17 </ match>
18
19 <label @SYSTEM>
20 <filter var.log.middleware .**>
21 @type grep
22 </ filter>
23 <match **>
24 @type s3
25 </ match>
26 </ label>
Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 18 / 28
Monitoring
your Logs
with Fluent
Toshaan
Bharvani -
VanTosh
bvba
Introduction
Components
Build
Automation
The End
Spoiler
FluentD Syslog
1 <source>
2 @type syslog
3 port 5140
4 bind 0.0.0.0
5 tag system
6 </ source>
7
8 <filter system .**>
9 @type grep
10 <regexp>
11 key ident
12 pattern /^ sudo$/
13 </ regexp>
14 <regexp>
15 key message
16 pattern /COMMAND/
17 </ regexp>
18 </ filter>
19
20 <filter system .**>
21 @type parser
22 key_name message
23 <parse>
24 @type regexp
25 expression /USER =(?< sudoer >[^ ]+) ; COMMAND =(?< command >.*)$/
26 </ parse>
27 </ filter>
Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 19 / 28
Monitoring
your Logs
with Fluent
Toshaan
Bharvani -
VanTosh
bvba
Introduction
Components
Build
Automation
The End
Spoiler
FluentD Syslog
1 <source>
2 type carbon
3 tag tcp.events
4 format /^(?< key >S+)s+(?< val >S+)s+(?< time >S+)$/
5 port 2003
6 time_format %s
7 bind 0.0.0.0
8 </ source>
Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 20 / 28
Monitoring
your Logs
with Fluent
Toshaan
Bharvani -
VanTosh
bvba
Introduction
Components
Build
Automation
The End
Spoiler
FluentBit
1 SERVICE]
2 Flush 5
3 Daemon Off
4 Log_Level info
5 Parsers_File parsers.conf
6 Plugins_File plugins.conf
7 HTTP_Server Off
8 HTTP_Listen 0.0.0.0
9 HTTP_Port 2020
10
11 [INPUT]
12 Name cpu
13 Tag cpu.local
14 Interval_Sec 1
15
16 [OUTPUT]
17 Name stdout
18 Match *
Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 21 / 28
Monitoring
your Logs
with Fluent
Toshaan
Bharvani -
VanTosh
bvba
Introduction
Components
Build
Automation
The End
Spoiler
Carbon
1 [default]
2 pattern = .*
3 retentions = 10s:1d,1m:7d,10m:70d ,30m:180d,1h:5y
Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 22 / 28
Monitoring
your Logs
with Fluent
Toshaan
Bharvani -
VanTosh
bvba
Introduction
Components
Build
Automation
The End
Spoiler
Carbon
1 search_index : /var/lib/graphite/index
2 finders:
3 - graphite_api .finders.whisper. WhisperFinder
4 functions:
5 - graphite_api .functions. SeriesFunctions
6 - graphite_api .functions. PieFunctions
7 whisper:
8 directories:
9 - /var/lib/graphite/whisper
10 time_zone: UTC
Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 23 / 28
Monitoring
your Logs
with Fluent
Toshaan
Bharvani -
VanTosh
bvba
Introduction
Components
Build
Automation
The End
Spoiler
4
Automation
Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 24 / 28
Monitoring
your Logs
with Fluent
Toshaan
Bharvani -
VanTosh
bvba
Introduction
Components
Build
Automation
The End
Spoiler
Ansible Extentions
• Install a new VM
1 ansible -playbook ~/. ansible/playbook/vm -install.yml -e ’host
=newvm0 ’
• Setup FluentD and configure plugins for Graphite Carbon
1 ansible -playbook ~/. ansible/playbook/fluentd.yml
• Setup FluentBit on a host and configure shipping to
FluentD
1 ansible -playbook ~/. ansible/playbook/fluentbit.yml -l
vmachine0
Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 25 / 28
Monitoring
your Logs
with Fluent
Toshaan
Bharvani -
VanTosh
bvba
Introduction
Components
Build
Automation
The End
Spoiler
Conclusion
We can build an integrated
open source monitoring and
logging solution.
Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 26 / 28
Monitoring
your Logs
with Fluent
Toshaan
Bharvani -
VanTosh
bvba
Introduction
Components
Build
Automation
The End
Spoiler
The End
Thank You for your attention
Toshaan Bharvani - VanTosh bvba <toshaan@vantosh.com>
http://www.vantosh.com/
Made with Beamer LATEX
a TEXbased Presentation program
Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 27 / 28
Monitoring
your Logs
with Fluent
Toshaan
Bharvani -
VanTosh
bvba
Introduction
Components
Build
Automation
The End
Spoiler
CfgMgmtCamp 2020
3 → 5 February 2020
https://cfgmgmtcamp.eu/
Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 28 / 28

More Related Content

What's hot

IXP Route Servers with RPKI and IXP Manager
IXP Route Servers with RPKI and IXP ManagerIXP Route Servers with RPKI and IXP Manager
IXP Route Servers with RPKI and IXP ManagerAPNIC
 
Multi-WAN on pfSense 2.3 - pfSense Hangout March 2016
Multi-WAN on pfSense 2.3 - pfSense Hangout March 2016Multi-WAN on pfSense 2.3 - pfSense Hangout March 2016
Multi-WAN on pfSense 2.3 - pfSense Hangout March 2016Netgate
 
OSMC 2009 | Monitoring and IPv6 by Benedikt Stockebrandt
OSMC 2009 |  Monitoring and IPv6 by Benedikt StockebrandtOSMC 2009 |  Monitoring and IPv6 by Benedikt Stockebrandt
OSMC 2009 | Monitoring and IPv6 by Benedikt StockebrandtNETWAYS
 
JS introduction
JS introductionJS introduction
JS introductionYi Tseng
 
N map presentation
N map presentationN map presentation
N map presentationulirraptor
 
Firewall Best Practices for VoIP on pfSense - pfSense Hangout October 2017
Firewall Best Practices for VoIP on pfSense - pfSense Hangout October 2017Firewall Best Practices for VoIP on pfSense - pfSense Hangout October 2017
Firewall Best Practices for VoIP on pfSense - pfSense Hangout October 2017Netgate
 
pfSense 2.2 Preview - pfSense Hangout November 2014
pfSense 2.2 Preview - pfSense Hangout November 2014pfSense 2.2 Preview - pfSense Hangout November 2014
pfSense 2.2 Preview - pfSense Hangout November 2014Netgate
 
Free OpManager training Part 2- Monitoring Server Performance
Free OpManager training Part 2- Monitoring Server PerformanceFree OpManager training Part 2- Monitoring Server Performance
Free OpManager training Part 2- Monitoring Server PerformanceManageEngine, Zoho Corporation
 
Free OpManager training Part3- Network performance monitoring
Free OpManager training Part3- Network performance monitoringFree OpManager training Part3- Network performance monitoring
Free OpManager training Part3- Network performance monitoringManageEngine, Zoho Corporation
 
2016 NCTU P4 Workshop
2016 NCTU P4 Workshop2016 NCTU P4 Workshop
2016 NCTU P4 WorkshopYi Tseng
 
Protecting the Privacy of the Network – Using P4 to Prototype and Extend Netw...
Protecting the Privacy of the Network – Using P4 to Prototype and Extend Netw...Protecting the Privacy of the Network – Using P4 to Prototype and Extend Netw...
Protecting the Privacy of the Network – Using P4 to Prototype and Extend Netw...Open-NFP
 
IPv6 Basics - pfSense Hangout July 2015
IPv6 Basics - pfSense Hangout July 2015IPv6 Basics - pfSense Hangout July 2015
IPv6 Basics - pfSense Hangout July 2015Netgate
 
Upgrading Your System: A Telco User Perspectiv
Upgrading Your System: A Telco User PerspectivUpgrading Your System: A Telco User Perspectiv
Upgrading Your System: A Telco User PerspectivOPNFV
 
Kernel bug hunting
Kernel bug huntingKernel bug hunting
Kernel bug huntingAndrea Righi
 
Free OpManager training Part1- Discovery and classification
Free OpManager training Part1- Discovery and classificationFree OpManager training Part1- Discovery and classification
Free OpManager training Part1- Discovery and classificationManageEngine, Zoho Corporation
 

What's hot (20)

IXP Route Servers with RPKI and IXP Manager
IXP Route Servers with RPKI and IXP ManagerIXP Route Servers with RPKI and IXP Manager
IXP Route Servers with RPKI and IXP Manager
 
Ft pv2(1)
Ft pv2(1)Ft pv2(1)
Ft pv2(1)
 
Multi-WAN on pfSense 2.3 - pfSense Hangout March 2016
Multi-WAN on pfSense 2.3 - pfSense Hangout March 2016Multi-WAN on pfSense 2.3 - pfSense Hangout March 2016
Multi-WAN on pfSense 2.3 - pfSense Hangout March 2016
 
OSMC 2009 | Monitoring and IPv6 by Benedikt Stockebrandt
OSMC 2009 |  Monitoring and IPv6 by Benedikt StockebrandtOSMC 2009 |  Monitoring and IPv6 by Benedikt Stockebrandt
OSMC 2009 | Monitoring and IPv6 by Benedikt Stockebrandt
 
What's New in HAProxy
What's New in HAProxyWhat's New in HAProxy
What's New in HAProxy
 
JS introduction
JS introductionJS introduction
JS introduction
 
66_pfSenseTutorial
66_pfSenseTutorial66_pfSenseTutorial
66_pfSenseTutorial
 
N map presentation
N map presentationN map presentation
N map presentation
 
Firewall Best Practices for VoIP on pfSense - pfSense Hangout October 2017
Firewall Best Practices for VoIP on pfSense - pfSense Hangout October 2017Firewall Best Practices for VoIP on pfSense - pfSense Hangout October 2017
Firewall Best Practices for VoIP on pfSense - pfSense Hangout October 2017
 
HTTP/2: What's new?
HTTP/2: What's new? HTTP/2: What's new?
HTTP/2: What's new?
 
pfSense 2.2 Preview - pfSense Hangout November 2014
pfSense 2.2 Preview - pfSense Hangout November 2014pfSense 2.2 Preview - pfSense Hangout November 2014
pfSense 2.2 Preview - pfSense Hangout November 2014
 
Free OpManager training Part 2- Monitoring Server Performance
Free OpManager training Part 2- Monitoring Server PerformanceFree OpManager training Part 2- Monitoring Server Performance
Free OpManager training Part 2- Monitoring Server Performance
 
TFTP
TFTPTFTP
TFTP
 
Free OpManager training Part3- Network performance monitoring
Free OpManager training Part3- Network performance monitoringFree OpManager training Part3- Network performance monitoring
Free OpManager training Part3- Network performance monitoring
 
2016 NCTU P4 Workshop
2016 NCTU P4 Workshop2016 NCTU P4 Workshop
2016 NCTU P4 Workshop
 
Protecting the Privacy of the Network – Using P4 to Prototype and Extend Netw...
Protecting the Privacy of the Network – Using P4 to Prototype and Extend Netw...Protecting the Privacy of the Network – Using P4 to Prototype and Extend Netw...
Protecting the Privacy of the Network – Using P4 to Prototype and Extend Netw...
 
IPv6 Basics - pfSense Hangout July 2015
IPv6 Basics - pfSense Hangout July 2015IPv6 Basics - pfSense Hangout July 2015
IPv6 Basics - pfSense Hangout July 2015
 
Upgrading Your System: A Telco User Perspectiv
Upgrading Your System: A Telco User PerspectivUpgrading Your System: A Telco User Perspectiv
Upgrading Your System: A Telco User Perspectiv
 
Kernel bug hunting
Kernel bug huntingKernel bug hunting
Kernel bug hunting
 
Free OpManager training Part1- Discovery and classification
Free OpManager training Part1- Discovery and classificationFree OpManager training Part1- Discovery and classification
Free OpManager training Part1- Discovery and classification
 

Similar to OSMC 2019 | Monitoring your Logs with Fluent by Toshaan Bharvani

OSMC 2021 | Monitoring Open Source Hardware
OSMC 2021 | Monitoring Open Source HardwareOSMC 2021 | Monitoring Open Source Hardware
OSMC 2021 | Monitoring Open Source HardwareNETWAYS
 
Fluentd Unified Logging Layer At Fossasia
Fluentd Unified Logging Layer At FossasiaFluentd Unified Logging Layer At Fossasia
Fluentd Unified Logging Layer At FossasiaN Masahiro
 
LWA 2015: The Apache Flink Platform for Parallel Batch and Stream Analysis
LWA 2015: The Apache Flink Platform for Parallel Batch and Stream AnalysisLWA 2015: The Apache Flink Platform for Parallel Batch and Stream Analysis
LWA 2015: The Apache Flink Platform for Parallel Batch and Stream AnalysisJonas Traub
 
Fluentd - RubyKansai 65
Fluentd - RubyKansai 65Fluentd - RubyKansai 65
Fluentd - RubyKansai 65N Masahiro
 
Fluentd at HKOScon
Fluentd at HKOSconFluentd at HKOScon
Fluentd at HKOSconN Masahiro
 
Monitoring in Big Data Platform - Albert Lewandowski, GetInData
Monitoring in Big Data Platform - Albert Lewandowski, GetInDataMonitoring in Big Data Platform - Albert Lewandowski, GetInData
Monitoring in Big Data Platform - Albert Lewandowski, GetInDataGetInData
 
Wso2 esb-maintenance-guide
Wso2 esb-maintenance-guideWso2 esb-maintenance-guide
Wso2 esb-maintenance-guideChanaka Fernando
 
Fluentd and Embulk Game Server 4
Fluentd and Embulk Game Server 4Fluentd and Embulk Game Server 4
Fluentd and Embulk Game Server 4N Masahiro
 
Apache Flink@ Strata & Hadoop World London
Apache Flink@ Strata & Hadoop World LondonApache Flink@ Strata & Hadoop World London
Apache Flink@ Strata & Hadoop World LondonStephan Ewen
 
MuleSoft Meetup Roma - Processi di Automazione su CloudHub
MuleSoft Meetup Roma - Processi di Automazione su CloudHubMuleSoft Meetup Roma - Processi di Automazione su CloudHub
MuleSoft Meetup Roma - Processi di Automazione su CloudHubAlfonso Martino
 
Free OpManager training Part 2 Monitoring Server Performance- season#3
Free OpManager training Part 2 Monitoring Server Performance- season#3Free OpManager training Part 2 Monitoring Server Performance- season#3
Free OpManager training Part 2 Monitoring Server Performance- season#3ManageEngine, Zoho Corporation
 
FBTFTP: an opensource framework to build dynamic tftp servers
FBTFTP: an opensource framework to build dynamic tftp serversFBTFTP: an opensource framework to build dynamic tftp servers
FBTFTP: an opensource framework to build dynamic tftp serversAngelo Failla
 
GOTO Night Amsterdam - Stream processing with Apache Flink
GOTO Night Amsterdam - Stream processing with Apache FlinkGOTO Night Amsterdam - Stream processing with Apache Flink
GOTO Night Amsterdam - Stream processing with Apache FlinkRobert Metzger
 
K. Tzoumas & S. Ewen – Flink Forward Keynote
K. Tzoumas & S. Ewen – Flink Forward KeynoteK. Tzoumas & S. Ewen – Flink Forward Keynote
K. Tzoumas & S. Ewen – Flink Forward KeynoteFlink Forward
 
QCon London - Stream Processing with Apache Flink
QCon London - Stream Processing with Apache FlinkQCon London - Stream Processing with Apache Flink
QCon London - Stream Processing with Apache FlinkRobert Metzger
 
Cloud lunch and learn real-time streaming in azure
Cloud lunch and learn real-time streaming in azureCloud lunch and learn real-time streaming in azure
Cloud lunch and learn real-time streaming in azureTimothy Spann
 
Fluentd Overview, Now and Then
Fluentd Overview, Now and ThenFluentd Overview, Now and Then
Fluentd Overview, Now and ThenSATOSHI TAGOMORI
 

Similar to OSMC 2019 | Monitoring your Logs with Fluent by Toshaan Bharvani (20)

OSMC 2021 | Monitoring Open Source Hardware
OSMC 2021 | Monitoring Open Source HardwareOSMC 2021 | Monitoring Open Source Hardware
OSMC 2021 | Monitoring Open Source Hardware
 
Fluentd Unified Logging Layer At Fossasia
Fluentd Unified Logging Layer At FossasiaFluentd Unified Logging Layer At Fossasia
Fluentd Unified Logging Layer At Fossasia
 
LWA 2015: The Apache Flink Platform for Parallel Batch and Stream Analysis
LWA 2015: The Apache Flink Platform for Parallel Batch and Stream AnalysisLWA 2015: The Apache Flink Platform for Parallel Batch and Stream Analysis
LWA 2015: The Apache Flink Platform for Parallel Batch and Stream Analysis
 
Fluentd - RubyKansai 65
Fluentd - RubyKansai 65Fluentd - RubyKansai 65
Fluentd - RubyKansai 65
 
Fluentd at HKOScon
Fluentd at HKOSconFluentd at HKOScon
Fluentd at HKOScon
 
Monitoring in Big Data Platform - Albert Lewandowski, GetInData
Monitoring in Big Data Platform - Albert Lewandowski, GetInDataMonitoring in Big Data Platform - Albert Lewandowski, GetInData
Monitoring in Big Data Platform - Albert Lewandowski, GetInData
 
File access auditing
File access auditingFile access auditing
File access auditing
 
Wso2 esb-maintenance-guide
Wso2 esb-maintenance-guideWso2 esb-maintenance-guide
Wso2 esb-maintenance-guide
 
Fluentd and Embulk Game Server 4
Fluentd and Embulk Game Server 4Fluentd and Embulk Game Server 4
Fluentd and Embulk Game Server 4
 
Apache Flink@ Strata & Hadoop World London
Apache Flink@ Strata & Hadoop World LondonApache Flink@ Strata & Hadoop World London
Apache Flink@ Strata & Hadoop World London
 
MuleSoft Meetup Roma - Processi di Automazione su CloudHub
MuleSoft Meetup Roma - Processi di Automazione su CloudHubMuleSoft Meetup Roma - Processi di Automazione su CloudHub
MuleSoft Meetup Roma - Processi di Automazione su CloudHub
 
Free OpManager training Part 2 Monitoring Server Performance- season#3
Free OpManager training Part 2 Monitoring Server Performance- season#3Free OpManager training Part 2 Monitoring Server Performance- season#3
Free OpManager training Part 2 Monitoring Server Performance- season#3
 
FBTFTP: an opensource framework to build dynamic tftp servers
FBTFTP: an opensource framework to build dynamic tftp serversFBTFTP: an opensource framework to build dynamic tftp servers
FBTFTP: an opensource framework to build dynamic tftp servers
 
Zentral macaduk conf 2016
Zentral macaduk conf 2016Zentral macaduk conf 2016
Zentral macaduk conf 2016
 
GOTO Night Amsterdam - Stream processing with Apache Flink
GOTO Night Amsterdam - Stream processing with Apache FlinkGOTO Night Amsterdam - Stream processing with Apache Flink
GOTO Night Amsterdam - Stream processing with Apache Flink
 
K. Tzoumas & S. Ewen – Flink Forward Keynote
K. Tzoumas & S. Ewen – Flink Forward KeynoteK. Tzoumas & S. Ewen – Flink Forward Keynote
K. Tzoumas & S. Ewen – Flink Forward Keynote
 
SCOM Tips and Tricks
SCOM Tips and TricksSCOM Tips and Tricks
SCOM Tips and Tricks
 
QCon London - Stream Processing with Apache Flink
QCon London - Stream Processing with Apache FlinkQCon London - Stream Processing with Apache Flink
QCon London - Stream Processing with Apache Flink
 
Cloud lunch and learn real-time streaming in azure
Cloud lunch and learn real-time streaming in azureCloud lunch and learn real-time streaming in azure
Cloud lunch and learn real-time streaming in azure
 
Fluentd Overview, Now and Then
Fluentd Overview, Now and ThenFluentd Overview, Now and Then
Fluentd Overview, Now and Then
 

Recently uploaded

What need to be mastered as AI-Powered Java Developers
What need to be mastered as AI-Powered Java DevelopersWhat need to be mastered as AI-Powered Java Developers
What need to be mastered as AI-Powered Java DevelopersEmilyJiang23
 
Entropy, Software Quality, and Innovation (presented at Princeton Plasma Phys...
Entropy, Software Quality, and Innovation (presented at Princeton Plasma Phys...Entropy, Software Quality, and Innovation (presented at Princeton Plasma Phys...
Entropy, Software Quality, and Innovation (presented at Princeton Plasma Phys...Andrea Goulet
 
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...Alluxio, Inc.
 
Workforce Efficiency with Employee Time Tracking Software.pdf
Workforce Efficiency with Employee Time Tracking Software.pdfWorkforce Efficiency with Employee Time Tracking Software.pdf
Workforce Efficiency with Employee Time Tracking Software.pdfDeskTrack
 
how-to-download-files-safely-from-the-internet.pdf
how-to-download-files-safely-from-the-internet.pdfhow-to-download-files-safely-from-the-internet.pdf
how-to-download-files-safely-from-the-internet.pdfMehmet Akar
 
KLARNA - Language Models and Knowledge Graphs: A Systems Approach
KLARNA -  Language Models and Knowledge Graphs: A Systems ApproachKLARNA -  Language Models and Knowledge Graphs: A Systems Approach
KLARNA - Language Models and Knowledge Graphs: A Systems ApproachNeo4j
 
A Guideline to Zendesk to Re:amaze Data Migration
A Guideline to Zendesk to Re:amaze Data MigrationA Guideline to Zendesk to Re:amaze Data Migration
A Guideline to Zendesk to Re:amaze Data MigrationHelp Desk Migration
 
Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...
Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...
Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...rajkumar669520
 
CompTIA Security+ (Study Notes) for cs.pdf
CompTIA Security+ (Study Notes) for cs.pdfCompTIA Security+ (Study Notes) for cs.pdf
CompTIA Security+ (Study Notes) for cs.pdfFurqanuddin10
 
How to install and activate eGrabber JobGrabber
How to install and activate eGrabber JobGrabberHow to install and activate eGrabber JobGrabber
How to install and activate eGrabber JobGrabbereGrabber
 
A Comprehensive Appium Guide for Hybrid App Automation Testing.pdf
A Comprehensive Appium Guide for Hybrid App Automation Testing.pdfA Comprehensive Appium Guide for Hybrid App Automation Testing.pdf
A Comprehensive Appium Guide for Hybrid App Automation Testing.pdfkalichargn70th171
 
Tree in the Forest - Managing Details in BDD Scenarios (live2test 2024)
Tree in the Forest - Managing Details in BDD Scenarios (live2test 2024)Tree in the Forest - Managing Details in BDD Scenarios (live2test 2024)
Tree in the Forest - Managing Details in BDD Scenarios (live2test 2024)Gáspár Nagy
 
Crafting the Perfect Measurement Sheet with PLM Integration
Crafting the Perfect Measurement Sheet with PLM IntegrationCrafting the Perfect Measurement Sheet with PLM Integration
Crafting the Perfect Measurement Sheet with PLM IntegrationWave PLM
 
JustNaik Solution Deck (stage bus sector)
JustNaik Solution Deck (stage bus sector)JustNaik Solution Deck (stage bus sector)
JustNaik Solution Deck (stage bus sector)Max Lee
 
OpenChain @ LF Japan Executive Briefing - May 2024
OpenChain @ LF Japan Executive Briefing - May 2024OpenChain @ LF Japan Executive Briefing - May 2024
OpenChain @ LF Japan Executive Briefing - May 2024Shane Coughlan
 
APVP,apvp apvp High quality supplier safe spot transport, 98% purity
APVP,apvp apvp High quality supplier safe spot transport, 98% purityAPVP,apvp apvp High quality supplier safe spot transport, 98% purity
APVP,apvp apvp High quality supplier safe spot transport, 98% purityamy56318795
 
A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1
A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1
A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1KnowledgeSeed
 

Recently uploaded (20)

What need to be mastered as AI-Powered Java Developers
What need to be mastered as AI-Powered Java DevelopersWhat need to be mastered as AI-Powered Java Developers
What need to be mastered as AI-Powered Java Developers
 
Entropy, Software Quality, and Innovation (presented at Princeton Plasma Phys...
Entropy, Software Quality, and Innovation (presented at Princeton Plasma Phys...Entropy, Software Quality, and Innovation (presented at Princeton Plasma Phys...
Entropy, Software Quality, and Innovation (presented at Princeton Plasma Phys...
 
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
 
Workforce Efficiency with Employee Time Tracking Software.pdf
Workforce Efficiency with Employee Time Tracking Software.pdfWorkforce Efficiency with Employee Time Tracking Software.pdf
Workforce Efficiency with Employee Time Tracking Software.pdf
 
how-to-download-files-safely-from-the-internet.pdf
how-to-download-files-safely-from-the-internet.pdfhow-to-download-files-safely-from-the-internet.pdf
how-to-download-files-safely-from-the-internet.pdf
 
AI Hackathon.pptx
AI                        Hackathon.pptxAI                        Hackathon.pptx
AI Hackathon.pptx
 
KLARNA - Language Models and Knowledge Graphs: A Systems Approach
KLARNA -  Language Models and Knowledge Graphs: A Systems ApproachKLARNA -  Language Models and Knowledge Graphs: A Systems Approach
KLARNA - Language Models and Knowledge Graphs: A Systems Approach
 
A Guideline to Zendesk to Re:amaze Data Migration
A Guideline to Zendesk to Re:amaze Data MigrationA Guideline to Zendesk to Re:amaze Data Migration
A Guideline to Zendesk to Re:amaze Data Migration
 
Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...
Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...
Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...
 
CompTIA Security+ (Study Notes) for cs.pdf
CompTIA Security+ (Study Notes) for cs.pdfCompTIA Security+ (Study Notes) for cs.pdf
CompTIA Security+ (Study Notes) for cs.pdf
 
How to install and activate eGrabber JobGrabber
How to install and activate eGrabber JobGrabberHow to install and activate eGrabber JobGrabber
How to install and activate eGrabber JobGrabber
 
A Comprehensive Appium Guide for Hybrid App Automation Testing.pdf
A Comprehensive Appium Guide for Hybrid App Automation Testing.pdfA Comprehensive Appium Guide for Hybrid App Automation Testing.pdf
A Comprehensive Appium Guide for Hybrid App Automation Testing.pdf
 
5 Reasons Driving Warehouse Management Systems Demand
5 Reasons Driving Warehouse Management Systems Demand5 Reasons Driving Warehouse Management Systems Demand
5 Reasons Driving Warehouse Management Systems Demand
 
Top Mobile App Development Companies 2024
Top Mobile App Development Companies 2024Top Mobile App Development Companies 2024
Top Mobile App Development Companies 2024
 
Tree in the Forest - Managing Details in BDD Scenarios (live2test 2024)
Tree in the Forest - Managing Details in BDD Scenarios (live2test 2024)Tree in the Forest - Managing Details in BDD Scenarios (live2test 2024)
Tree in the Forest - Managing Details in BDD Scenarios (live2test 2024)
 
Crafting the Perfect Measurement Sheet with PLM Integration
Crafting the Perfect Measurement Sheet with PLM IntegrationCrafting the Perfect Measurement Sheet with PLM Integration
Crafting the Perfect Measurement Sheet with PLM Integration
 
JustNaik Solution Deck (stage bus sector)
JustNaik Solution Deck (stage bus sector)JustNaik Solution Deck (stage bus sector)
JustNaik Solution Deck (stage bus sector)
 
OpenChain @ LF Japan Executive Briefing - May 2024
OpenChain @ LF Japan Executive Briefing - May 2024OpenChain @ LF Japan Executive Briefing - May 2024
OpenChain @ LF Japan Executive Briefing - May 2024
 
APVP,apvp apvp High quality supplier safe spot transport, 98% purity
APVP,apvp apvp High quality supplier safe spot transport, 98% purityAPVP,apvp apvp High quality supplier safe spot transport, 98% purity
APVP,apvp apvp High quality supplier safe spot transport, 98% purity
 
A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1
A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1
A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1
 

OSMC 2019 | Monitoring your Logs with Fluent by Toshaan Bharvani

  • 1. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba Introduction Components Build Automation The End Spoiler Monitoring your Logs with Fluent Fluentd with fluentbit Open Source Monitoring Conference 2019 6 November 2019 Toshaan Bharvani - VanTosh bvba <toshaan@vantosh.com> Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 1 / 28
  • 2. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba Introduction Components Build Automation The End Spoiler $ whoami Toshaan Bharvani • From Antwerp, Belgium • Self-employed engineer/trainer (available for hire) http://www.vantosh.com • Involved with Enterprise Linux & RPM packaging : PEL, CentOS, RHEL, IBM AIX, BSD, SLES, . . . • Likes to keep everything secure : SELinux, WebSec, . . . • Lives in a virtual container world : KVM, Podman, PowerVM, z/VM, LXC, Xen, . . . • Likes automation CfgMgmt / DevOps : Ansible, Foreman, Puppet, . . . • Involved with hardware, software and conferences • Wants to take over the universe • Twitter : @toshywoshy • Blog : http://www.toshaan.com • Social : @toshywoshy Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 2 / 28
  • 3. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba Introduction Components Build Automation The End Spoiler 1 Introduction Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 3 / 28
  • 4. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba Introduction Components Build Automation The End Spoiler Monitoring • Checks the current state of a subject • Checks the current utilization of a subject • Checks the current return of a subject Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 4 / 28
  • 5. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba Introduction Components Build Automation The End Spoiler Metrics • Measures and keeps the history of the states of a subject • Measures and keeps the history of the utilization of a subject • Measures and keeps the history of the return of a subject Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 5 / 28
  • 6. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba Introduction Components Build Automation The End Spoiler Logs • Logs are the records of the events of the system • Logs are the records of the messages of the system • Logs are the records of the transactions of the system Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 6 / 28
  • 7. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba Introduction Components Build Automation The End Spoiler 2 Components Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 7 / 28
  • 8. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba Introduction Components Build Automation The End Spoiler What is FluentD • A unified logging layer in between • Decouples backend from frontend • Streaming data system • JSON payload • Many inputs and output plugins • HA setup • Reduces complexity Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 8 / 28
  • 9. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba Introduction Components Build Automation The End Spoiler FluentD M+N Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 9 / 28
  • 10. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba Introduction Components Build Automation The End Spoiler What is FluentBit • Log processor & forwarder • Light-weight daemon • Written in C • Many inputs and output plugins • Collecting from different sources and sending to different destinations • TLS connections • Reduces complexity Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 10 / 28
  • 11. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba Introduction Components Build Automation The End Spoiler Graphite - Carbon - Whisper • Written in Python • Graphite • Django-based web application that renders graphs and dashboards • Carbon • Metric processing daemons • Whisper • Time-series database library Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 11 / 28
  • 12. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba Introduction Components Build Automation The End Spoiler Grafana • Written in Golang • Dashboard tool • Visualization • Log viewing • Metrics view Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 12 / 28
  • 13. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba Introduction Components Build Automation The End Spoiler Icinga • Monitoring tool • Alerting tool • Notification tool • Business Overview Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 13 / 28
  • 14. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba Introduction Components Build Automation The End Spoiler Setup Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 14 / 28
  • 15. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba Introduction Components Build Automation The End Spoiler Ansible • Orchestration / CfgMgmt / Remote Execution Tool • Python based uses SSH, WinRM, or API • Server based, agentless1 • host information in flat files, CMDB, scripts, . . . • executes the task on the host side • Playbook : combination of tasks with meta information • Roles : abstract playbook with tasks, variables and handlers • Templates : Jinja2 • works where Python works2 1 Abstraction of SSH / WinRM to connect with the node and in certain setup an agent might be required, but by default it is not necessary 2 Ansible can actually run without Python on the remote host, however it is not fully supported Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 15 / 28
  • 16. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba Introduction Components Build Automation The End Spoiler 3 Build Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 16 / 28
  • 17. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba Introduction Components Build Automation The End Spoiler FluentD Basic Setup 1 <source> 2 @type forward 3 port 24224 4 </ source> 5 6 <source> 7 @type http 8 port 9880 9 </ source> 10 11 <match myapp.access> 12 @type file 13 path /var/log/fluent/access 14 </ match> Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 17 / 28
  • 18. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba Introduction Components Build Automation The End Spoiler FluentD Application Setup 1 <source> 2 @type forward 3 </ source> 4 5 <source> 6 @type tail 7 @label @SYSTEM 8 </ source> 9 10 <filter access .**> 11 @type record_transformer 12 <record> 13 </ record> 14 </ filter> 15 <match **> 16 @type elasticsearch 17 </ match> 18 19 <label @SYSTEM> 20 <filter var.log.middleware .**> 21 @type grep 22 </ filter> 23 <match **> 24 @type s3 25 </ match> 26 </ label> Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 18 / 28
  • 19. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba Introduction Components Build Automation The End Spoiler FluentD Syslog 1 <source> 2 @type syslog 3 port 5140 4 bind 0.0.0.0 5 tag system 6 </ source> 7 8 <filter system .**> 9 @type grep 10 <regexp> 11 key ident 12 pattern /^ sudo$/ 13 </ regexp> 14 <regexp> 15 key message 16 pattern /COMMAND/ 17 </ regexp> 18 </ filter> 19 20 <filter system .**> 21 @type parser 22 key_name message 23 <parse> 24 @type regexp 25 expression /USER =(?< sudoer >[^ ]+) ; COMMAND =(?< command >.*)$/ 26 </ parse> 27 </ filter> Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 19 / 28
  • 20. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba Introduction Components Build Automation The End Spoiler FluentD Syslog 1 <source> 2 type carbon 3 tag tcp.events 4 format /^(?< key >S+)s+(?< val >S+)s+(?< time >S+)$/ 5 port 2003 6 time_format %s 7 bind 0.0.0.0 8 </ source> Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 20 / 28
  • 21. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba Introduction Components Build Automation The End Spoiler FluentBit 1 SERVICE] 2 Flush 5 3 Daemon Off 4 Log_Level info 5 Parsers_File parsers.conf 6 Plugins_File plugins.conf 7 HTTP_Server Off 8 HTTP_Listen 0.0.0.0 9 HTTP_Port 2020 10 11 [INPUT] 12 Name cpu 13 Tag cpu.local 14 Interval_Sec 1 15 16 [OUTPUT] 17 Name stdout 18 Match * Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 21 / 28
  • 22. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba Introduction Components Build Automation The End Spoiler Carbon 1 [default] 2 pattern = .* 3 retentions = 10s:1d,1m:7d,10m:70d ,30m:180d,1h:5y Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 22 / 28
  • 23. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba Introduction Components Build Automation The End Spoiler Carbon 1 search_index : /var/lib/graphite/index 2 finders: 3 - graphite_api .finders.whisper. WhisperFinder 4 functions: 5 - graphite_api .functions. SeriesFunctions 6 - graphite_api .functions. PieFunctions 7 whisper: 8 directories: 9 - /var/lib/graphite/whisper 10 time_zone: UTC Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 23 / 28
  • 24. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba Introduction Components Build Automation The End Spoiler 4 Automation Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 24 / 28
  • 25. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba Introduction Components Build Automation The End Spoiler Ansible Extentions • Install a new VM 1 ansible -playbook ~/. ansible/playbook/vm -install.yml -e ’host =newvm0 ’ • Setup FluentD and configure plugins for Graphite Carbon 1 ansible -playbook ~/. ansible/playbook/fluentd.yml • Setup FluentBit on a host and configure shipping to FluentD 1 ansible -playbook ~/. ansible/playbook/fluentbit.yml -l vmachine0 Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 25 / 28
  • 26. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba Introduction Components Build Automation The End Spoiler Conclusion We can build an integrated open source monitoring and logging solution. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 26 / 28
  • 27. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba Introduction Components Build Automation The End Spoiler The End Thank You for your attention Toshaan Bharvani - VanTosh bvba <toshaan@vantosh.com> http://www.vantosh.com/ Made with Beamer LATEX a TEXbased Presentation program Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 27 / 28
  • 28. Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba Introduction Components Build Automation The End Spoiler CfgMgmtCamp 2020 3 → 5 February 2020 https://cfgmgmtcamp.eu/ Monitoring your Logs with Fluent Toshaan Bharvani - VanTosh bvba () 28 / 28