社内勉強会の発表資料です。 Mar 13, 2019

1. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 1/31
Kubernetes Logging
Introduction
1 / 31

2. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 2/31
Kyohei Mizumoto(@kyohmizu)
C# Software Engineer
Interests
Docker/Kubernetes
Go
Security
whoami
2 / 31

3. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 3/31
Required
Kubernetesの概要程度の知識
Targets
Kubernetes Logging未経験者
3 / 31

4. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 4/31
Contents
1. Logging Overview
2. Fluentd
3. Get Started with GKE
4. Demo
5. Other Services
4 / 31

5. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 5/31
Logging Overview
5 / 31

6. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 6/316 / 31

7. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 7/31
Logging
標準出⼒と標準エラー出⼒にログを出⼒
"kubectl logs"コマンドで表⽰
安定保存のため、ログを集約して外部に転送
7 / 31

8. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 8/31
kubectl logs
$ kubectl logs kube-dns-[num] -c kubedns -n kube-system
8 / 31

9. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 9/31
Landscape
9 / 31

10. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 10/31
Fluentd
10 / 31

11. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 11/31
CNCFがホストするプロジェクト
DaemonSetを利⽤
標準出⼒ログを読み出して転送
Fluentd
11 / 31

12. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 12/31
Before Fluentd
12 / 31

13. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 13/31
After Fluentd
13 / 31

14. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 14/31
Architecture
Unified Logging with JSON
プロセス(収集、フィルタリング、出⼒)の統⼀
Pluggable Architecture
フレキシブルな⼊出⼒プラグイン
Minimum Resources Required
Built-in Reliability
バッファ、フェイルオーバーによるHA構成
14 / 31

15. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 15/31
Forward To
CloudWatch
Elasticsearch
Google Cloud Storage(GCS)
Graylog
Kafka
Kinesis
Amazon S3
Stackdriver
Syslog
etc...
15 / 31

16. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 16/31
Get Started
公式イメージ
16 / 31

17. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 17/31
Get Started with GKE
17 / 31

18. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 18/31
Get Started with GKE
GKEではリソース作成済み
$ kubectl get po -n kube-system | grep fluentd
// 結果は⼀部省略
fluentd-gcp-scaler-8b674f786-jc4wk 1/1 Running
fluentd-gcp-v3.2.0-4hqm6 2/2 Running
fluentd-gcp-v3.2.0-m5p49 2/2 Running
fluentd-gcp-v3.2.0-x6rlq 2/2 Running
18 / 31

19. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 19/31
Stackdriver
Real-time Log Management and Analysis
Seamlessly Resolve Issues
Scalable and Fully Managed
All Your Cloud Logs In One Place
Real Time Insights
19 / 31

20. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 20/31
Stackdriver Monitoring
20 / 31

21. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 21/31
Stackdriver Logs Viewer
21 / 31

22. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 22/31
Demo
22 / 31

23. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 23/31
Other Services
23 / 31

24. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 24/31
SaaS型の監視＆解析ツール
課⾦制
様々なサービスのメトリクスをシー
ムレスに集約
Datadog
24 / 31

25. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 25/31
Log Explorer
25 / 31

26. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 26/31
Log Management
Datadog Agent がログを収集
DaemonSet for Kubernetes
暗号化通信を使⽤してデータを送信
ログのFiltering、Monitoring、Alert機能
Custom Logs
26 / 31

27. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 27/31
Fluent Bit
シンプルかつ軽量なFluentd
既存のプラグインは使⽤不可
27 / 31

28. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 28/31
Books
28 / 31

29. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 29/31
Links
The Twelve-Factor App
https://12factor.net/
Fluentd
https://www.fluentd.org/
Fluent Bit
https://fluentbit.io/
Stackdriver Logging
https://cloud.google.com/logging/
Datadog
https://www.datadoghq.com/
29 / 31

30. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 30/31
Others
fluentd-gcp-scaler のコードについて調べたので、
Qiita記事を投稿しました。
https://qiita.com/kyohmizu/items/cbf9cca76a826d8eb130
30 / 31

31. 2019/3/28 Kubernetes Logging Introduction
127.0.0.1:5500/#4 31/31
Thank you!
31 / 31