The document discusses various topics related to Android testing including: - Best practice is to create a separate test project rather than including tests in the main project. This keeps tests stripped out of the main code and easier/faster to run. - Tests can be run from Eclipse or from the command line with options to run all tests, a single test class/method, or filter by category. - The Android SDK tools, emulator/AVD, and tools like uiautomatorviewer and uiautomator are needed to perform UI tests. - Different types of tests include unit tests, integration tests to check components work together, acceptance tests for QA, and performance tests to check system behavior.

2. Agenda: -Intro
-Android Testing
-Creating a project
-JUnit Testing
-Mock Objects + UI Testing
-Integration and acceptance test
-Performance and system testing
-Advance assertions
-TDD
-Real App Dev
!

3. Agenda:
-Tools
-Continuous Integration
!

4. Ego slide Mobile Developer @ Sixt
M. Sc. UCM/RWTH
CS Teacher at Alcalá University
!
!
! +EnriqueLópezMañas
@eenriquelopez

5. Ego slide Mobile Developer @ Sixt
M.Sc. Politehnica Timisoara
!
!
! +ami.antoch

6. Keywords
Continuous Integration
TDD
JUnit / Unit Testing
Instrumentation
Behavior Driven Development
Performance Testing
Profiling

7. What you need • Java SE Version 1.6
• Android SDK Tools
• Eclipse IDE for Java Developers
• ADT
• (Android Bundle)

8. Testing • Develop
• Finding
• Correcting

9. Is about productivity! $59.5 billion annually
!
1/3 could be saved
!
(National Institute of Standards and
Technology (USA))

10. Why, what, how, when
During, before
!
Continuous Integration
!
Classes, methods, lines, basic
blocks..

11. Activity lifecycle

12. Activity lifecycle
Databases and filesystem operations

13. Activity lifecycle
Databases and filesystem operations
Physical characteristics of the device

14. Activity lifecycle
Databases and filesystem operations
Physical characteristics of the device
(AVD and Genymotion)

15. UnitTests Written by programmers for programmers
JUnit

16. Elements of a test The fixture
Method setUp()
Method tearDown()
Test preconditions (retrospection vs. annotations)

17. Assertions • assertEquals()
• assertFalse()
• assertNotNull()
• assertNotSame()
• assertNull()
• assertSame()
• assertTrue()
• fail()

18. Mock objects Mimic objects
• MockApplication
• MockContentProvider
• MockContentResolver
• MockContext
• MockCursor
• MockDialogInterface
• MockPackageManager
• MockResources

19. UI Tests Annotation @UIThreadTest
Class TouchUtils
• Click
• Drag
• LongClick
• Scroll
• Tap
• Touch

20. Environments Eclipse…
…but also IntelliJ!
…and Netbeans!

21. Instrumentation Foundation
Control application under test and permit
injection

22. Project Test MyProject
MyProjectTest

23. Testing Target Device
AVD Machines
GenyMotion

24. Summary

25. Android Testing
Best practice: test should live in a separate
correlated project
• Stripped (not included in main)
• Easier to run in Emulator
• Takes less time
• Encourages code reusability

26. Create project

27. AVD

28. Genymotion

29. DDMS

30. TestAnnotations
@SmallTest
@MediumTest
@LargeTest
@Smoke
@FlakyTest (tolerance=4)
@UIThreadTest
@Suppress

31. Running Test From Eclipse

33. Running Single Test

34. Running from the emulator

35. Running from the command line

36. Running from the command line
• All
• From an specific test case
• Specific test by name
• By category
• (create custom annotations)

37. Debug bugs

38. Summary • Created first Android project
• Followed best practice creating companion project
• Simple test class
• Eclipse
• Command line options

39. Mockup
• All Mock implementations
• All methods non functional
• Throw UnsupportedOperationExceiption

40. UI Testing • Android SDK Tools, 21+
• API 16+
• uiaumatorviewer
• uiautomator
Tools

41. Integration tests Individual components work jointly

42. Integration tests Individual components work jointly
Acceptance tests QA, Business language

43. Performance tests Performance behavior
System test • GUI Test
• Smoke Tests
• Performance
• Installation

44. Benchmarking • Traditional logging statement methods
• Creating Android performance tests
• Using profiling tools
• Microbenchmarks using Caliper

45. Benchmarking
/* (non-Javadoc)
* @see android.text.TextWatcher#onTextChanged(
* java.lang.CharSequence, int, int, int)
*/
public void onTextChanged(CharSequence s, int start,
int before, int count) {
if (!mDest.hasWindowFocus() || mDest.hasFocus() ||
s == null ) {
return; }
final String str = s.toString();
if ( "".equals(str) ) {
mDest.setText("");
return;
}
final long t0;
if ( BENCHMARK_TEMPERATURE_CONVERSION ) {
t0 = System.currentTimeMillis();
}
!

46. Benchmarking
try {
final double temp = Double.parseDouble(str);
final double result = (mOp == OP.C2F) ?
TemperatureConverter.celsiusToFarenheit(temp);
TemperatureConverter.fahrenheitToCelsius(temp);
final String resultString = String.format("%.2f", result);
mDest.setNumber(result);
mDest.setSelection(resultString.length());
} catch (NumberFormatException e) {
// WARNING
// this is generated while a number is entered,
// for example just a '-'
// so we don't want to show the error
} catch (Exception e) {
mSource.setError("ERROR: " + e.getLocalizedMessage());
}
if ( BENCHMARK_TEMPERATURE_CONVERSION ) {
long t = System.currentTimeMillis() - t0;
Log.i(TAG, "TemperatureConversion took " + t +
" ms to complete.");
}
}

47. Android performance tests
Classes hidden only for System
apps :(

48. Assertions in depth • assertEquals
• assertFalse
• assertNotNull
• assertNotSame
• assertNull
• assertSame
• assertTrue
• assertFail

49. Assertions in depth public void testNotImplementedYet() {
fail("Not implemented yet");
}

50. Assertions in depth public void testShouldThrowException() {
try {
MyFirstProjectActivity.methodThatShouldThrowException();
fail("Exception was not thrown");
} catch ( Exception ex ) {
// do nothing
}
}

51. Custom messages public void testMax() {
final int a = 1;
final int b = 2;
final int expected = b;
final int actual = Math.max(a, b);
assertEquals("Expection " + expected + " but was " + actual,
expected, actual);
}

52. Static imports public void testAlignment() {
final int margin = 0;
...
android.test.ViewAsserts.assertRightAligned(
mMessage, mCapitalize, margin);
!
}

53. Static imports
import static android.test.ViewAsserts.assertRightAligned;
public void testAlignment() {
final int margin = 0;
assertRightAligned(mMessage, mCapitalize, margin);
}

54. View assertions assertBaselineAligned

55. View assertions assertBaselineAligned
assertBotomAligned

56. View assertions assertBaselineAligned
assertBotomAligned
assertGroupContains

57. View assertions assertBaselineAligned
assertBotomAligned
assertGroupContains
assertGroupIntegrity

58. View assertions assertBaselineAligned
assertBotomAligned
assertGroupContains
assertGroupIntegrity
assertGroupNotContains

59. View assertions assertBaselineAligned
assertBotomAligned
assertGroupContains
assertGroupIntegrity
assertGroupNotContains
assertHasScreenCoordinates

60. View assertions assertBaselineAligned
assertBotomAligned
assertGroupContains
assertGroupIntegrity
assertGroupNotContains
assertHasScreenCoordinates
assertHorizontalCenterAligned

61. View assertions assertLeftAligned

62. View assertions assertLeftAligned
assertOffScreenAbove

63. View assertions assertLeftAligned
assertOffScreenAbove
assertOffScreenBelow

64. View assertions assertLeftAligned
assertOffScreenAbove
assertOffScreenBelow
assertOnScreen

65. View assertions assertLeftAligned
assertOffScreenAbove
assertOffScreenBelow
assertOnScreen
assertRightAligned

66. View assertions assertLeftAligned
assertOffScreenAbove
assertOffScreenBelow
assertOnScreen
assertRightAligned
assertTopAligned

67. View assertions assertLeftAligned
assertOffScreenAbove
assertOffScreenBelow
assertOnScreen
assertRightAligned
assertTopAligned
assertVerticalCenterAligned

68. Example
public void testUserInterfaceLayout() {
final int margin = 0;
final View origin = mActivity.getWindow().getDecorView();
assertOnScreen(origin, mMessage);
assertOnScreen(origin, mCapitalize);
assertRightAligned(mMessage, mCapitalize, margin);
}

69. Even more
assertions
assertAssignableFrom

70. Even more
assertions
assertAssignableFrom
assertContainsRegex

71. Even more
assertions
assertAssignableFrom
assertContainsRegex
assertContainsInAnyOrder

72. Even more
assertions
assertAssignableFrom
assertContainsRegex
assertContainsInAnyOrder
assertContainsInOrder

73. Even more
assertions
assertAssignableFrom
assertContainsRegex
assertContainsInAnyOrder
assertContainsInOrder
assertEmpty

74. Even more
assertions
assertAssignableFrom
assertContainsRegex
assertContainsInAnyOrder
assertContainsInOrder
assertEmpty
assertEquals

75. Even more
assertions
assertMatchesRegex

76. Even more
assertions
assertMatchesRegex
assertNotContainsRegex

77. Even more
assertions
assertMatchesRegex
assertNotContainsRegex
assertNotEmpty

78. Even more
assertions
assertMatchesRegex
assertNotContainsRegex
assertNotEmpty
assertNotMatchesRegex

79. Even more
assertions
assertMatchesRegex
assertNotContainsRegex
assertNotEmpty
assertNotMatchesRegex
checkEqualsAndHashCodeMethods

80. Example
@UiThreadTest
public void testNoErrorInCapitalization() {
final String msg = "this is a sample";
mMessage.setText(msg);
mCapitalize.performClick();
final String actual = mMessage.getText().toString();
final String notExpectedRegexp = “(?i:ERROR)";
assertNotContainsRegex("Capitalization found error:",
notExpectedRegexp, actual);
}

81. assertActivityRequiresPermission
public void testActivityPermission() {
final String PKG = "com.example.aatg.myfirstproject";
final String ACTIVITY = PKG + ".MyFirstProjectActivity";
final String PERMISSION = android.Manifest.permission.WRITE_EXTERNAL_STORAGE;
assertActivityRequiresPermission(PKG, ACTIVITY, PERMISSION);
}

82. assertReadingContentUriRequiresPermission
public void testReadingContacts() {
final Uri URI = ContactsContract.AUTHORITY_URI;
final String PERMISSION =
android.Manifest.permission.READ_CONTACTS;
assertReadingContentUriRequiresPermission(URI, PERMISSION);
}

83. assertWritingContentUriRequiresPermission
public void testWritingContacts() {
final Uri URI = ContactsContract.AUTHORITY_URI;
final String PERMISSION =
android.Manifest.permission.WRITE_CONTACTS;
assertWritingContentUriRequiresPermission(URI, PERMISSION);
}

84. ActivityMonitor
public void testFollowLink() {
final Instrumentation inst = getInstrumentation();
IntentFilter intentFilter = new IntentFilter(Intent.ACTION_VIEW);
intentFilter.addDataScheme("http");
intentFilter.addCategory(Intent.CATEGORY_BROWSABLE);
ActivityMonitor monitor = inst.addMonitor(intentFilter, null, false);
assertEquals(0, monitor.getHits());
TouchUtils.clickView(this, mLink);
monitor.waitForActivityWithTimeout(5000);
assertEquals(1, monitor.getHits());
inst.removeMonitor(monitor);
}

85. Example project

86. Summary
Used several types of assertion
Explained mock objects
Exemplified different tests

87. Test Driven Development

88. Test Driven Development

89. Test Driven Development • Difficult to divert code
• Focus
NO SILVER BULLET

90. Example project - temperature converter

91. Requirements:
• Application convert from Celsius to F.
• … and viceversa
• Two fields to input data
• When temperature is entered, other field updates
• Error displayed
• Some space reserved keyboard
• Entry fields start empty
• Digits right aligned
• Last entered values retained after onPause()

92. Concept design

93. Create projects

94. From requirement to tests

95. AVD and Emulator Options

96. Headless emulator
emulator -avd test -no-window -no-audio -no-boot-anim -port 5580 &

97. Monkeyrunner

98. Building with ant android update project —path .

99. Jenkins

100. Testing recipes

102. Thank you !
+ Enrique López Mañas
@eenriquelopez