In the past year at SoundCloud, we've improved our CI from a single machine running our limited unit test suite to several machines running a linter, unit tests, acceptance tests and building several versions of our app including the AppStore version for every commit. This enabled us to move away from pull-requests and code reviews and use trunk based development and pairing, as well as scale the team from 3 to 7 developers. We've stopped relying on Xcode Schemes for builds, we're using instead command line tools and compile-time parameters to automatically build internal versions of our app and distribute it internally. In order to make our release process more reliable, the AppStore version of the app is created by re-signing an AdHoc build. This enables us to test the exact same binary that will be submitted to the AppStore. This talk will focus on 3 areas of our continuous integration: testing, building with user defined build settings and signing apps.

2. Continuous Integration at
SoundCloud
iOSDevUK september 2014
!
Vincent Garrigues
@garriguv

3. What is CI?

4. “Continuous integration (CI)
is the practice, in software
engineering, of merging all
developer working copies
with a shared mainline
several times a day.”
http://en.wikipedia.org/wiki/Continuous_integration

5. • trunk based development
• lots of testing
• CI pipeline

15. Why CI?

16. • move fast
• keep codebase healthy
• ship reliable apps

17. • move fast
• keep codebase healthy
• ship reliable apps

20. • started from scratch
• months in development
• millions of users

21. iOS Crash Complaints (avg per Week)
140
105
70
35
0
April May June July August
SoundCloud community team

23. How to get
started?

24. Start simple and
iterate

25. • run unit test suite
• α and β versions
• sign .app builds

27. Rake

28. require 'rake'
!
desc 'say Hello World!'
task :hello do
puts 'Hello World!'
end

29. require 'rake'
!
desc 'say Hello World!'
task :hello do
puts 'Hello World!'
end

30. require 'rake'
!
desc 'say Hello World!'
task :hello do
puts 'Hello World!'
end

31. require 'rake'
!
desc 'say Hello World!'
task :hello do
puts 'Hello World!'
end

32. Running the unit tests

33. use xcodebuild or xctool

34. xcodebuild
-workspace ci.xcworkspace
-scheme ci
-configuration Debug
-sdk iphonesimulator7.1
-destination "platform=iOS Simulator,name=iPhone Retina (4-inch)"
test

35. xcodebuild
-workspace ci.xcworkspace
-scheme ci
-configuration Debug
-sdk iphonesimulator7.1
-destination "platform=iOS Simulator,name=iPhone Retina (4-inch)"
test

36. xcodebuild
-workspace ci.xcworkspace
-scheme ci
-configuration Debug
-sdk iphonesimulator7.1
-destination "platform=iOS Simulator,name=iPhone Retina (4-inch)"
test

37. xcodebuild
-workspace ci.xcworkspace
-scheme ci
-configuration Debug
-sdk iphonesimulator7.1
-destination "platform=iOS Simulator,name=iPhone Retina (4-inch)"
test

38. xcodebuild
-workspace ci.xcworkspace
-scheme ci
-configuration Debug
-sdk iphonesimulator7.1
-destination "platform=iOS Simulator,name=iPhone Retina (4-inch)"
test

39. xcodebuild
-workspace ci.xcworkspace
-scheme ci
-configuration Debug
-sdk iphonesimulator7.1
-destination "platform=iOS Simulator,name=iPhone Retina (4-inch)"
clean

40. xcodebuild
-workspace ci.xcworkspace
-scheme ci
-configuration Debug
-sdk iphonesimulator7.1
-destination "platform=iOS Simulator,name=iPhone Retina (4-inch)"
build

41. rake tasks
• rake clean
• rake build
• rake test

42. α and β versions

44. User-defined build settings

50. Override user-defined
build settings when
running xcodebuild

51. xcodebuild
-workspace ci.xcworkspace
-scheme ci
-configuration Debug
-sdk iphonesimulator7.1
-destination "platform=iOS Simulator,name=iPhone Retina (4-inch)”
build

52. xcodebuild
(…)
VG_BUNDLE_ID=com.company.app-alpha
build

53. xcodebuild
(…)
VG_BUNDLE_ID=com.company.app-alpha
VG_DISPLAY_NAME=α
build

54. xcodebuild
(…)
VG_BUNDLE_ID=com.company.app-alpha
VG_DISPLAY_NAME=α
VG_CODE_SIGNING="'iPhone
Distribution: Vincent Garrigues'"
build

55. Where can we store
those settings?

56. We use a YAML file

57. defaults: &DEFAULTS
app: &APP_DEFAULTS
workspace: ci.xcworkspace
scheme: ci
configuration: Release
display_name: ci-test
bundle_identifier: com.company.ci-test
codesign: &CODESIGN_DEFAULTS
signing_identity: '"iPhone Distribution: Vincent Garrigues (X73EL3QFZB)"'
provisioning_profile: provisioning/app_store.mobileprovision

58. defaults: &DEFAULTS
app: &APP_DEFAULTS
workspace: ci.xcworkspace
scheme: ci
configuration: Release
display_name: ci-test
bundle_identifier: com.company.ci-test
codesign: &CODESIGN_DEFAULTS
signing_identity: '"iPhone Distribution: Vincent Garrigues (X73EL3QFZB)"'
provisioning_profile: provisioning/app_store.mobileprovision

59. defaults: &DEFAULTS
app: &APP_DEFAULTS
workspace: ci.xcworkspace
scheme: ci
configuration: Release
display_name: ci-test
bundle_identifier: com.company.ci-test
codesign: &CODESIGN_DEFAULTS
signing_identity: '"iPhone Distribution: Vincent Garrigues (X73EL3QFZB)"'
provisioning_profile: provisioning/app_store.mobileprovision

60. defaults: &DEFAULTS
app: &APP_DEFAULTS
workspace: ci.xcworkspace
scheme: ci
configuration: Release
display_name: ci-test
bundle_identifier: com.company.ci-test
codesign: &CODESIGN_DEFAULTS
signing_identity: '"iPhone Distribution: Vincent Garrigues (X73EL3QFZB)"'
provisioning_profile: provisioning/app_store.mobileprovision

61. defaults: &DEFAULTS
app: &APP_DEFAULTS
workspace: ci.xcworkspace
scheme: ci
configuration: Release
display_name: ci-test
bundle_identifier: com.company.ci-test
codesign: &CODESIGN_DEFAULTS
signing_identity: '"iPhone Distribution: Vincent Garrigues (X73EL3QFZB)"'
provisioning_profile: provisioning/app_store.mobileprovision

62. defaults: &DEFAULTS
app: &APP_DEFAULTS
workspace: ci.xcworkspace
scheme: ci
configuration: Release
display_name: ci-test
bundle_identifier: com.company.ci-test
codesign: &CODESIGN_DEFAULTS
signing_identity: '"iPhone Distribution: Vincent Garrigues (X73EL3QFZB)"'
provisioning_profile: provisioning/app_store.mobileprovision

63. defaults:
(..)
!
alpha:
<<: *DEFAULTS
app:
<<: *APP_DEFAULTS
display_name: α
bundle_identifier: com.company.ci-test-alpha
codesign:
<<: *CODESIGN_DEFAULTS
provisioning_profile: provisioning/alpha.mobileprovision

64. defaults:
(..)
!
alpha:
<<: *DEFAULTS
app:
<<: *APP_DEFAULTS
display_name: α
bundle_identifier: com.company.ci-test-alpha
codesign:
<<: *CODESIGN_DEFAULTS
provisioning_profile: provisioning/alpha.mobileprovision

65. defaults:
(..)
!
alpha:
<<: *DEFAULTS
app:
<<: *APP_DEFAULTS
display_name: α
bundle_identifier: com.company.ci-test-alpha
codesign:
<<: *CODESIGN_DEFAULTS
provisioning_profile: provisioning/alpha.mobileprovision

66. rake build BUILD_ENV=alpha
rake build BUILD_ENV=beta
rake build BUILD_ENV=adhoc
rake build BUILD_ENV=release

67. rake build BUILD_ENV=alpha
rake build BUILD_ENV=beta
rake build BUILD_ENV=adhoc
rake build BUILD_ENV=release

68. rake build BUILD_ENV=alpha
rake build BUILD_ENV=beta
rake build BUILD_ENV=adhoc
rake build BUILD_ENV=appstore

69. rake build creates a .app

70. We need a .ipa

71. xcrun

72. xcrun -v
-sdk iphoneos
PackageApplication
ci-test-alpha.app
-o ci-test-alpha.ipa
--sign "iPhone Distribution: Vincent Garrigues"
--embed provisioning/alpha.mobileprovision

73. xcrun -v
-sdk iphoneos
PackageApplication
ci-test-alpha.app
-o ci-test-alpha.ipa
--sign "iPhone Distribution: Vincent Garrigues"
--embed provisioning/alpha.mobileprovision

74. xcrun -v
-sdk iphoneos
PackageApplication
ci-test-alpha.app
-o ci-test-alpha.ipa
--sign "iPhone Distribution: Vincent Garrigues"
--embed provisioning/alpha.mobileprovision

75. xcrun -v
-sdk iphoneos
PackageApplication
ci-test-alpha.app
-o ci-test-alpha.ipa
--sign "iPhone Distribution: Vincent Garrigues"
--embed provisioning/alpha.mobileprovision

76. xcrun -v
-sdk iphoneos
PackageApplication
ci-test-alpha.app
-o ci-test-alpha.ipa
--sign "iPhone Distribution: Vincent Garrigues"
--embed provisioning/alpha.mobileprovision

77. xcrun -v
-sdk iphoneos
PackageApplication
ci-test-alpha.app
-o ci-test-alpha.ipa
--sign "iPhone Distribution: Vincent Garrigues"
--embed provisioning/alpha.mobileprovision

78. xcrun -v
-sdk iphoneos
PackageApplication
ci-test-alpha.app
-o ci-test-alpha.ipa
--sign "iPhone Distribution: Vincent Garrigues"
--embed provisioning/alpha.mobileprovision

79. xcrun -v
-sdk iphoneos
PackageApplication
ci-test-alpha.app
-o ci-test-alpha.ipa
--sign "iPhone Distribution: Vincent Garrigues"
--embed provisioning/alpha.mobileprovision

80. rake sign

81. • rake clean
• rake test
• rake build
• rake sign

82. How can we use
those rake tasks?

84. • rake build sign BUILD_ENV=alpha
• rake build sign BUILD_ENV=beta
• rake build sign BUILD_ENV=adhoc

85. • rake build sign BUILD_ENV=alpha
• rake build sign BUILD_ENV=beta
• rake build sign BUILD_ENV=adhoc

86. • rake build sign BUILD_ENV=alpha
• rake build sign BUILD_ENV=beta
• rake build sign BUILD_ENV=adhoc

87. • rake build sign BUILD_ENV=alpha
• rake build sign BUILD_ENV=beta
• rake build sign BUILD_ENV=adhoc
• rake build sign BUILD_ENV=appstore

88. Ad-Hoc and AppStore
builds have the same
bundle id

89. rake build BUILD_ENV=appstore
ci-test-appstore.app
ci-test-appstore.dSYM
ci-test-appstore.dSYM.zip

90. rake build BUILD_ENV=appstore
rake ipa BUILD_ENV=appstore
ci-test-appstore.app
ci-test-appstore.dSYM
ci-test-appstore.dSYM.zip
ci-test-appstore.ipa

91. rake build BUILD_ENV=appstore
rake ipa BUILD_ENV=appstore
rake ipa BUILD_ENV=adhoc
ci-test-appstore.app
ci-test-appstore.dSYM
ci-test-appstore.dSYM.zip
ci-test-appstore.ipa
ci-test-adhoc.ipa

92. rake build BUILD_ENV=appstore
rake ipa BUILD_ENV=appstore
rake ipa BUILD_ENV=adhoc
ci-test-appstore.app
ci-test-appstore.dSYM
ci-test-appstore.dSYM.zip
ci-test-appstore.ipa
ci-test-adhoc.ipa

93. rake build BUILD_ENV=appstore
rake ipa BUILD_ENV=appstore
rake ipa BUILD_ENV=adhoc
ci-test-appstore.app
ci-test-appstore.dSYM
ci-test-appstore.dSYM.zip
ci-test-appstore.ipa
ci-test-adhoc.ipa

94. The same binary,
signed twice

95. Sample project
!
github.com/garriguv/ci-test

97. • linter (Xcode project, data
model, acceptance tests,
ruby, ObjC)
• static analysis
• unit tests (ruby and ObjC)
• acceptance tests
• custom app icon
• deploy to HockeyApp
• …

100. Thank you!
http://github.com/garriguv/ci-talk !
!
Vincent Garrigues
@garriguv