Building High Quality Android Apps By using Jenkins and Automated Device Tests
Getting to know each other...Leif JanzikTeam-Lead Android Developmentadesso mobile solutions GmbHTwitter: @ElliotMonsterBlog: www.thoughtsonmobile.com
About adesso mobile solutions GmbH• adesso mobile solutions GmbH, Dortmund, 65 MA (Ende 2012)• Tochterunternehmen der adesso AG, Dortmund, ca. 1.100 MA (Ende 2012)• führender Anbieter in den Bereichen mobiles Internet, mobile Applikationen und Mobile Marketing• Portfolio: Beratung, Konzeption, Realisierung, Review, Test und Betrieb von Mobilisierungs-Projekten und App-Lösungen• Kunden: Über 200 realisierten Portalen und Applikationen für Kunden wie Daimler, PAYBACK, ERGO, süddeutsche.de, SportScheck, die Volksbanken Raffeisenbanken, Bundesagentur für Arbeit.
So you are an Android Developer and everything is f***ing awesome...http://www.flickr.com/photos/fullcodepress/
Everyone loves your Appshttp://www.flickr.com/photos/fullcodepress/
Your companies headquarterlooks like thesehttp://www.flickr.com/photos/fullcodepress/
Everything is perfect!http://www.flickr.com/photos/fullcodepress/
... and being a Android Developeris no fun no more.
Ok, maybe I exagerated a bit, BUT• Android Apps grow more and more complex• Customers expect a bugfree and undisturbed App experience• Tolerance even for minor bugs continues to shrink• Device fragmentation makes testing a sisysphean task
Some „everyday-problems“ we had to solve• Apps have to be build in many different Versions (e.g. Development/Staging-Enviroment) or different brandings• Developers are often disturbed, e.g. when a AdHoc for the customer is needed• Changes in App Components lead to new bugs, which were discovered later.
but testing your own app issoooooo boring! (so it might be skipped or not done thoroughly)
that‘s why we automated much ofour testing and our build process.
„Our“ solution• a clean and reliable development workflow• a toolchain which supports the developers and keeps disturbing work away• Continuous refactoring of the apps• Maven for lesser configuration for every developer and easier modularisation• Automated Device Tests• Continuous integration
What is Continuous Integration?• Automate everything• Build as often as possible • Build early, build often • e.g. on every commit • or nightly builds
Benefits of Continuous Integration• Fewer Errors • very important, not everybody installs every update, so bugs might never be fixed on a customers device• Fast Feedback• Tests everything on every (nightly) build• Much less manual testing • Cheaper • Happier developers• Regression-Tests without additional effort
3 Major Build ProfilesBuild after Commit Nightly Build Release or Promoted Build• Build and archive APK • Build Project • Build APK• Run Unit-Tests without • Run Unit-Tests• Run Sonar Code archiving/publishin • Run Calabash Tests Metrics g APK • Keep apk „forever“ • Run Unit-Tests • upload apk to webserver • Run Calabash Tests for enterprise delivery or to Google play
Why did we choose Jenkins• Quasi-Standart CI Server (together with hudson)• A lot of useful plugins • e.g. Maven Plugin, Checkstyle Plugin, Android Lint Plugin, Sonar Plugin• Well documented Plugin API for own plugins
Our Jenkins System Jenkins MasterJenkins Jenkins Jenkins JenkinsiOS Android Windows Mobile Web
why do we need automated ui-tests?• Not all parts are covered by classic Unit-Tests• Manual Integration Tests take a lot of time• Manual tests are very boring and developers tend to skip them• Device fragmentation grows every day ...
automated UI-Tests with Calabash• Cucumber based Testing Tool• Test-Specs are human readable, even for non-programmers• Both mayor platforms iOS & Android are supported with a identical Syntax• Runs in Simulator/Emulator and on Devices
ExampleFeature: Basic Mathematics As a user I‘ll be able to do basic mathematic operations Scenario: Summate 2 numbers Given I started the App When I press button „5“ And I press button „+“ And I press button „3“ And I press button „=“ Then label „result“ should be „8“ Scenario: Substract one number from another Given I started the App When I press button „9“ And I press button „-“ And I press button „4“ And I press button „=“ Then label „result“ should be „5“
• All Calabash-Tests run on real Devices, so the results are much more reliable