•
•
•
11/10/2017 2© 2015, Perfecto Mobile Ltd. All Rights Reserved.
• Key features and opportunities for developers
and testers in iOS12
• Testing implications of iOS12 on new and
existing apps
• Appium vs. XCUITest
• Advanced testing methods using iOS12 and
Appium including Image Injection & Smart
Reporting
5/24/2018 4© 2018, Perfecto Mobile Ltd. All Rights Reserved.
• Performance improvements and overall quality and stability of the
platform
• System and utility enhancements – camera, Apple apps (photos,
camera, messages, facetime, grouped notifications, Siri
recommendations and more)
• Digital wellbeing via screen time and productivity monitoring, additional
battery information to the users
• Privacy and security – auto create stronger passwords, handling re-used
passwords and more
• Enhanced iPad gestures to reach the home screen and go to the control
center
• Update your device lab with both iOS12 platforms
and the new devices.
• Allocate schedule buffers for possible patch
releases that are expected in the upcoming few
weeks
• Run through a full app quality assessment from
both functional perspectives, as well as from
battery consumption and performance
perspective (digital wellbeing)
5/24/2018 6© 2018, Perfecto Mobile Ltd. All Rights Reserved.
How are you testing your app to make sure it supports new iOS devices?
• On real devices
• On emulators
• New iOS on older hardware
iOS Family iOS Version Smartphones Tablets Testing Priority
H, M, L
iOS 9.3.5
(EOL)
iPhone 4S iPad Mini Low (1)
analytics risk based
decision
iOS 10.3.3
(EOL)
iPhone 5C iPad 4th Gen Medium-High (2)
5-10% Market Share OS
iOS 11.4.1
(EOL)
iPhone 6.X, iPhone 7.X,
iPhone 8.X, iPhone X*
iPad Mini 2-iPad Mini 4
iPad Pro – 9.7’’, 10.5’’,
12.9’’
High (4-6 devices)
Pick based on
Chipset/Screen/Analytics
iOS 12.0 iPhone 6.X, iPhone 7.X,
iPhone 8.X, iPhone X*,
iPhone XS, iPhone XR,
iPhone XS Max
iPad Mini 2-iPad Mini 4
iPad Pro – 9.7’’, 10.5’’,
12.9’’
High (4-6 Devices)
Pick based on
Chipset/Screen/Analytics
* iPhone X will be discontinued by Apple
Appium vs. XCUITest
Criteria Appium XCUITests
Language Any swift/objective-C
By Open source Apple
App supported APK and IPA IPA
Code required No Yes
Testtype Black box White box
Speed 8t 2t
Setup Hard Medium
CI Medium Hard
Flakiness of test Very Low
Object Locators Xpath (external) Id
Used by QA iOS dev*
5/24/2018 10© 2018, Perfecto Mobile Ltd. All Rights Reserved.
• Interactive Testing
• Parallel Execution
• Image Injection
• Smart Reporting
5/24/2018 11© 2018, Perfecto Mobile Ltd. All Rights Reserved.
• Fast execution, make sure your script is ready
Back button appears and
pressed before the page is fully
loaded
5/24/2018 12© 2018, Perfecto Mobile Ltd. All Rights Reserved.
• Screen size and resolution differences between the devices are
important, use visual validation
5/24/2018 13© 2018, Perfecto Mobile Ltd. All Rights Reserved.
• Keyboard – override objects , can not reproduce on simulators
getDriver().findElement(By.xpath("//*[@label="Log in"]")).click();
Advanced Testing Methods Using iOS12 & Appium
Advanced Testing Methods Using iOS12 & Appium
Advanced Testing Methods Using iOS12 & Appium

Advanced Testing Methods Using iOS12 & Appium

  • 2.
    • • • 11/10/2017 2© 2015,Perfecto Mobile Ltd. All Rights Reserved.
  • 3.
    • Key featuresand opportunities for developers and testers in iOS12 • Testing implications of iOS12 on new and existing apps • Appium vs. XCUITest • Advanced testing methods using iOS12 and Appium including Image Injection & Smart Reporting
  • 4.
    5/24/2018 4© 2018,Perfecto Mobile Ltd. All Rights Reserved. • Performance improvements and overall quality and stability of the platform • System and utility enhancements – camera, Apple apps (photos, camera, messages, facetime, grouped notifications, Siri recommendations and more) • Digital wellbeing via screen time and productivity monitoring, additional battery information to the users • Privacy and security – auto create stronger passwords, handling re-used passwords and more • Enhanced iPad gestures to reach the home screen and go to the control center
  • 5.
    • Update yourdevice lab with both iOS12 platforms and the new devices. • Allocate schedule buffers for possible patch releases that are expected in the upcoming few weeks • Run through a full app quality assessment from both functional perspectives, as well as from battery consumption and performance perspective (digital wellbeing)
  • 6.
    5/24/2018 6© 2018,Perfecto Mobile Ltd. All Rights Reserved. How are you testing your app to make sure it supports new iOS devices? • On real devices • On emulators • New iOS on older hardware
  • 8.
    iOS Family iOSVersion Smartphones Tablets Testing Priority H, M, L iOS 9.3.5 (EOL) iPhone 4S iPad Mini Low (1) analytics risk based decision iOS 10.3.3 (EOL) iPhone 5C iPad 4th Gen Medium-High (2) 5-10% Market Share OS iOS 11.4.1 (EOL) iPhone 6.X, iPhone 7.X, iPhone 8.X, iPhone X* iPad Mini 2-iPad Mini 4 iPad Pro – 9.7’’, 10.5’’, 12.9’’ High (4-6 devices) Pick based on Chipset/Screen/Analytics iOS 12.0 iPhone 6.X, iPhone 7.X, iPhone 8.X, iPhone X*, iPhone XS, iPhone XR, iPhone XS Max iPad Mini 2-iPad Mini 4 iPad Pro – 9.7’’, 10.5’’, 12.9’’ High (4-6 Devices) Pick based on Chipset/Screen/Analytics * iPhone X will be discontinued by Apple
  • 9.
    Appium vs. XCUITest CriteriaAppium XCUITests Language Any swift/objective-C By Open source Apple App supported APK and IPA IPA Code required No Yes Testtype Black box White box Speed 8t 2t Setup Hard Medium CI Medium Hard Flakiness of test Very Low Object Locators Xpath (external) Id Used by QA iOS dev*
  • 10.
    5/24/2018 10© 2018,Perfecto Mobile Ltd. All Rights Reserved. • Interactive Testing • Parallel Execution • Image Injection • Smart Reporting
  • 11.
    5/24/2018 11© 2018,Perfecto Mobile Ltd. All Rights Reserved. • Fast execution, make sure your script is ready Back button appears and pressed before the page is fully loaded
  • 12.
    5/24/2018 12© 2018,Perfecto Mobile Ltd. All Rights Reserved. • Screen size and resolution differences between the devices are important, use visual validation
  • 13.
    5/24/2018 13© 2018,Perfecto Mobile Ltd. All Rights Reserved. • Keyboard – override objects , can not reproduce on simulators getDriver().findElement(By.xpath("//*[@label="Log in"]")).click();