The document outlines the CI/CD processes for GitLab and Bitbucket, providing step-by-step instructions for deploying applications to Google App Engine and Google Cloud Storage. It also discusses common issues faced during these processes, such as permissions and configuration settings. Additionally, it covers the use of Logstash with rsyslog and emphasizes the importance of permissions in accessing log files.

1. DevOps Taiwan Meetup #19 - 那些年
我們踩的 CI 坑
Len Chang, December 14 2018

2. Outline
● Me
● Issues Discussion
○ CI / CD of gitlab
○ CI / CD of bitbucket
○ logstash of Elastic
● Advertisement time !!

3. Me
Fear is a choice ~
https://www.linkedin.com/in/huailunchang/

4. Issues Discussion-CI / CD of gitlab

5. Q: How to deploy
gitLab-runner ?
Key word
● CI/CD of GitLab
● GitLab-runner

6. Q: How to deploy gitLab-runner ?
Step 1.
● open GitLab
Server and follow
the steps

7. Q: How to deploy gitLab-runner ?
Step 2.
● Set up gitlab-runner
● Set parameters

8. Q: How to deploy gitLab-runner ?
Step 3.
● Config setting

9. Q: How to deploy
gitLab-runner ?
Something you need to care about….
● permission is important !!!

10. Q: How to clean
gitLab-runner ?
Key word
● NULL

11. Q: How to clean gitLab-runner ?

12. Q: How to clean gitLab-runner ?
gitlab-runner verify --delete. It will delete runners that got removed from GitLab.
Reference

13. Q: How to clean
gitLab-runner ?
Something you need to care about….
● Still .. NULL

14. CI / CD of bitbucket

15. Q: How to deploy
app in Google App
Engine by Bitbucket
Pipelines ?
Key word
● Google App Engine
● Bitbucket Pipelines

16. Q: How to deploy app in Google App Engine by
Bitbucket Pipelines ?
Step 1.
● Apply GCP / Bitbucket account
● Make sure your app can run on local and
match Google App Engine Environment
Step 2.
● Get auth. key from GCP

17. Q: How to deploy app in Google App Engine by
Bitbucket Pipelines ?
Step 3.
● Bitbucket Setting
a. Enable your settings

18. Q: How to deploy app in Google App Engine by
Bitbucket Pipelines ?
Step 4.
● Bitbucket Setting
a. Set repository variables

19. Q: How to deploy app in Google App Engine by
Bitbucket Pipelines ?
Step 5.
● Bitbucket Setting
a. write pipelines.yaml

20. Q: How to deploy
app in Google App
Engine by Bitbucket
Pipelines ?
Something you need to care about….
● Limitations of Bitbucket Pipelines
○ Free 50 minutes
● Something will break down forever….

21. Q: How to deploy
web (Angular)
in Google Cloud
Storage by
Bitbucket Pipelines
?
Key word
● Google Cloud Storage
○ https://cloud.google.com/storage/
● Angular
○ https://angular.io/

22. Q: How to deploy web (Angular) in Google
Cloud Storage by Bitbucket Pipelines ?
Step 1.
● Apply GCP / Bitbucket account
● Make sure your angular app can run on local
Step 2.
● Get auth. key from GCP

23. Q: How to deploy web (Angular) in Google
Cloud Storage by Bitbucket Pipelines ?
Step 3.
● Let google know we own the domain
"test123.com" if it's not done before (do this
on Google Search Console)

24. Q: How to deploy web (Angular) in Google
Cloud Storage by Bitbucket Pipelines ?
Step 4.
● Create a new bucket named
"whatever.test123.com" and upload bundled
webapp
Step 5.
● Assign member named "allUsers" as the
"Storage Object Viewer" of the bucket

25. Q: How to deploy web (Angular) in Google
Cloud Storage by Bitbucket Pipelines ?
Step 6.
● Set index.html as main page and 404 page

26. Q: How to deploy web (Angular) in Google
Cloud Storage by Bitbucket Pipelines ?
Step 7.
● Bitbucket Setting
a. Enable your settings

27. Q: How to deploy web (Angular) in Google
Cloud Storage by Bitbucket Pipelines ?
Step 8.
● Bitbucket Setting
a. Set repository variables

28. Q: How to deploy app in Google App Engine by
Bitbucket Pipelines ?
Step 9.
● Bitbucket Setting
a. write pipelines.yaml

29. Q: How to deploy
app in Google App
Engine by Bitbucket
Pipelines ?
Something you need to care about….
● gsutil -m rm gs://aaa.test1234.com/**
○ You need to push data into bucket first otherwise
you will get exception

30. logstash of Elastic

31. How to use logstash
to read log files
created by rsyslog?
Key word
● logstash
● rsyslog

32. How to use logstash to read log files created by
rsyslog?
Q: logstash can’t read log files which “permission
deny…..”

33. How to use logstash to read log files created by
rsyslog?
Q: logstash can’t read log files which “permission
deny…..”
/etc/syslog.conf (default value)
● $FileCreateMode 0644
● $umask 0077
○ Update to $umask 0022

34. How to use logstash
to read log files
created by rsyslog?
Summary
● Permission is important….

35. logstash -
Persistent Queues
Key
- Queue

36. logstash - Persistent Queues
queue.type
● default: memory
● persisted
○ Info

37. logstash -
Persistent Queues
Summary
- set queue.type is “persisted”

38. Advertisement time !!
https://tw.yardian.com/
https://us.yardian.com/