CI/CD on Android project via Jenkins Pipeline

CI/CD on Android project via
Jenkins Pipeline
Veaceslav Gaidarji
Android Department Manager @ Ellation
1

About
Android department manager
Open-source and Jenkins enthusiast
Certified Jenkins Engineer
2

Agenda
VRV Android - project info
Jenkins old to new
Jenkins Shared Library
Testing Jenkins Pipeline code
What went wrong
Pros/Cons
3

Agenda
Jenkins old to new
What went wrong
Pros/Cons
4

Agenda
Jenkins old to new
What went wrong
Pros/Cons
5

Agenda
Jenkins old to new
What went wrong
Pros/Cons
6

Agenda
Jenkins old to new
What went wrong
Pros/Cons
7

Agenda
Jenkins old to new
What went wrong
Pros/Cons
8

VRV Android project info
Kotlin + Java
4 build types (debug/alpha/beta/release)
Unit tests + JaCoCo
Checkstyle + ktlint
Android Lint
Fabric.Beta
Gitflow
10

Kotlin + Java
Unit tests + JaCoCo
Checkstyle + ktlint
Android Lint
Fabric.Beta
Gitflow
11

Kotlin + Java
Unit tests + JaCoCo
Checkstyle + ktlint
Android Lint
Fabric.Beta
Gitflow
12

Kotlin + Java
Unit tests + JaCoCo
Checkstyle + ktlint
Android Lint
Fabric.Beta
Gitflow
13

Kotlin + Java
Unit tests + JaCoCo
Checkstyle + ktlint
Android Lint
Fabric.Beta
Gitflow
14

Kotlin + Java
Unit tests + JaCoCo
Checkstyle + ktlint
Android Lint
Fabric.Beta
Gitflow
15

Kotlin + Java
Unit tests + JaCoCo
Checkstyle + ktlint
Android Lint
Fabric.Beta
Gitflow
16

Jenkins old (VRV Android)
./gradlew check assembleAlpha crashlyticsUploadDistributionAlpha
20

Jenkins new (VRV Android)
Multibranch pipeline
Jenkinsfile
21

Jenkinsfile
22

Jenkinsfile
23

Jenkinsfile
#!groovy
def pipeline = new AndroidPipeline()
stage('build') {
pipeline.build()
}
stage('test') {
pipeline.test()
}
stage('distribute') {
pipeline.distribute()
}
stage('post build') {
pipeline.notify(...)
}
26

Default
(root)
+- src # Groovy source files
| +- org
| +- foo
| +- Bar.groovy # for org.foo.Bar class
+- vars
| +- foo.groovy # for global 'foo' variable
| +- foo.txt # help for 'foo' variable
+- resources # resource files (external libraries only)
| +- org
| +- foo
| +- bar.json # static helper data for org.foo.Bar
33

Ellation
(root)
+- src # Groovy source files
| +- AndroidPipeline.groovy # <------Android------>
+- vars # global scripts/variables
+- .jenkins
| +- Jenkinsfile # CI
+- test # unit tests
+- integrationTest # integration tests
+- scripts # helper classes
+- jenkinsfile # pipeline template files
34

AndroidPipeline.groovy
- 500 LOC
- ~40 methods
35

def build() {
step1()
step2()
step3()
}
def test() {
//
}
def distribute() {
//
}
def notify(…) {
//
}
36

def build() {
step1() // Step1Implementation.groovy
}
def test() {
//
}
def distribute() {
//
}
def notify(…) {
//
}
37

def build() {
cleanBuildFolder()
acceptAndroidLicenses()
initializeBuildConfig()
updateBuildNumber()
runCodeStyleChecks()
unitTests()
buildProject()
saveChangelogToFile()
}
38

def test() {
runLint()
scanForOpenTasks()
publishLintResults()
publishJunitResults()
publishJacocoCoverage()
publishCheckstyleResults()
publishHtmlReports()
publishApplicationInfo()
}
39

def distribute() {
archiveArtifactsTask()
uploadToFabric()
//uploadToPlayMarket()
}
40

def notify(String currentBuildResult) {
if (currentBuildResult == ‘SUCCESS’) {
publishGitTag()
addLinkToBuildToJiraTicket()
updateJiraTicketStatus()
} else {
notifyBuildFailedViaSlack()
}
notifyViaEmail()
cleanWs cleanWhenFailure: false
}
41

Testing Jenkins
Pipeline code
42

AndroidPipeline.groovy
- 500 LOC
- ~40 methods
- 4 methods covered
(unit/integration tests)
43

@Test
void incrementsBuildNumber() {
WorkflowRun build = r.assertBuildStatusSuccess(
createWorkflowJob(“projectUnderTest”,
"""
@Library(‘ellation@master’) _
import com.ellation.android.build.version.DiskNextBuildNumber
import com.ellation.android.build.version.DiskBuildNumberDataSource
node {
def nextBuildNumber = new DiskNextBuildNumber(
new DiskBuildNumberDataSource(env), “test-project”, “alpha”
)
nextBuildNumber.set(15)
int next = nextBuildNumber.next()
echo “Next build number is $next”
}
"""
).scheduleBuild2(0))
r.assertLogContains(“Next build number is 16”, build)
} 44

What went wrong
Update build number
Publish Git tag
Plots
Upload to Google Play
3rd-party libraries in pipeline code
Parallel builds on slaves
Slack notifications
46

What went wrong
Update build number
Publish Git Tag
Plots
Slack notifications
47

What went wrong
Update build number
Publish Git tag
Plots
Slack notifications
48

What went wrong
Update build number
Publish Git tag
Plots
Slack notifications
49

What went wrong
Update build number
Publish Git tag
Plots
Slack notifications
50

What went wrong
Update build number
Publish Git tag
Plots
Slack notifications
51

What went wrong
Update build number
Publish Git tag
Plots
Slack notifications
52

Update build number
Next Build Number plugin
- no pipeline support
- see JENKINS-33046
54

Update build number
Multibranch
Branch1: (1,2,3,)
Branch2: (1,2,3,)
Develop: (1,2,3,)
Requirement
Branch1: (1,2,3,)
Branch2: (4,5,6,)
Develop: (7,8,9,)
55

Update build number
android-build-numbers
/vrv-android
/alpha
/build-number.txt // with value 526
57

Publish Git tag
Git Publisher plugin
- no pipeline support
- see JENKINS-28335
- https://github.com/vgaidarji/test-jenkins-
sshagent
59

Plots
Plot plugin
- [JENKINS-35571] Make compatible with Pipeline
- see https://github.com/jenkinsci/plot-plugin/pull/32
61

Android application
- build number 1..10000
Android TV application
- build number 10000+
Upload failed: Devices with version 10002 of this app
would be downgraded to version 54 if they met the following criteria
63

64

package com.test
@Grapes([
@Grab(group = ‘com.squareup.okhttp3’, module = ‘okhttp’, version = ‘3.9.1’),
@Grab(group = ‘com.google.code.gson’, module = ‘gson’, version = ‘2.7’)
])
import com.google.gson.Gson
import okhttp3.HttpUrl
import okhttp3.OkHttpClient
import okhttp3.Request
class A {}
65

1 slave, 4 executors (8 GB RAM):
java.lang.IllegalStateException: failed to analyze:
java.lang.OutOfMemoryError: GC overhead limit exceeded
4 slaves, 4 executors (16 GB RAM each) = profit!!!
67

Pros
Single Jenkins master
Shared pipeline code
Code review of pipeline changes
Pipeline as a code
Tests
71

Pros
Pipeline as a code
Tests
72

Pros
Pipeline as a code
Tests
73

Pros
Pipeline as a code
Tests
74

Pros
Pipeline as a code
Tests
75

Cons
Learning curve
Debugging
76

Cons
Learning curve
Debugging
77

Cons
Learning curve
Debugging
78

Cons
Learning curve
Debugging
79

Cons
Learning curve
Debugging
80

Useful information
https://github.com/vgaidarji/ci-matters/jenkins/Jenkinsfile
82

Any
Questions?
Veaceslav Gaidarji
https://github.com/vgaidarji/
83

CI/CD on Android project via Jenkins Pipeline

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to CI/CD on Android project via Jenkins Pipeline

Similar to CI/CD on Android project via Jenkins Pipeline (20)

Recently uploaded

Recently uploaded (20)

CI/CD on Android project via Jenkins Pipeline

Editor's Notes