Testing Applications with AWS Device Farm

1. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved Testing Applications with AWS Device Farm Asha Chakrabarty, Solutions Architect

2. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved Agenda • What is AWS Device Farm? • What problem are we solving? • AWS Device Farm Features & Functionality • Demo

3. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved Overview of AWS Device Farm Automated native, hybrid, and web app testing on real Android and iOS devices in the cloud

4. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved AWS Device Farm Automation Upload your Android, iOS, or Fire OS app, configure a test, and select devices. We simultaneously test your app across your selected devices in our data centers. In minutes, view detailed, actionable reports that pinpoint bugs, performance problems, and other issues. robotium YOUR APP + Test your app on real devices in the AWS cloud

5. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved AWS Device Farm Remote Access Choose a device from 100s of different makes and models. Select a device Analyze historical session data like logs, performance data, screenshots, and video. View historical sessions Swipe, gesture, and interact with the device through your web browser as if the device was in your hand. Install apps and change settings on the fly. Interact with the device

6. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved AWS Device Farm • Android and iOS • Scale: 100s of unique physical devices, many instances • Pay for what you use • Integration: Jenkins, Android Studio, SDKs, CLI • Reports: Results, screenshots, logs, performance • Flexibility: Support for many popular frameworks • Security: Full HW and SW isolation

8. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved Cost and complexity of effective testing is growing • Maintaining a lab with relevant devices is a challenge (make, model, carrier & OS) • Manual testing on each device isn’t practical • Building an automation platform and managing the test infrastructure is complex and expensive

10. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved When developing mobile apps today, you want to focus on ... The great stuff that makes your app unique Not… The heavy lifting needed to manage backend infrastructure AWS Mobile Services Eliminate the Heavy Lifting

12. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved AWS Device Farm Features • Massive fleet of real iOS, Android, and Fire OS devices in the cloud • Execute automated tests in popular automation frameworks – Appium, Calabash, Espresso, JUnit, XCTest, KIF, Robotium, UI Automation • Run built-in test suite, no scripting required • Execute tests in parallel - results available in minutes • Configurable test environments (language, location, device states, etc.) for simulating real-world scenarios • View test results – screen shots, device logs, and performance data • Execute tests as part of continuous integration or other workflows

13. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved Why AWS Device Farm? • Removes the complexity of managing an internal lab of devices • Gain access to devices with relevant OS versions • Enable distributed testing teams on one common platform • Get through test cycles in minutes vs. manual testing that takes hours or days • Increase test coverage by testing more frequently and on more devices with automation • Focus on delivering quality apps not test infrastructure

14. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved Flexible pricing $0.17/device minute or $250/unmetered device/month Start today with 250 minutes for free!

16. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved aws.amazon.com/activate Everything and Anything Startups Need to Get Started on AWS

Editor's Notes

AWS Device Farm enables companies to test their mobile apps on real iOS and Android devices in the AWS cloud. Devices are available, on-demand, to developers and testers that need access to devices for development, testing and re-producing customer issues. The Device Farm fleet not only includes most of the popular devices available in the market today but also maintains multiple OS versions for each device. Device Farm has two main capabilities: 1) Remote Access – Developers and testers can take full control of a real device in the AWS cloud to perform manual tests. They choose from 100s of devices. Simply upload the app to test or access the mobile application in a browser and interact with the device as if it were in their own hands. Device logs and a video of the device under test are created at the end of the session. 2) Test Automation – Execute test scripts in popular automation frameworks on 100s of real devices. Devices are available on-demand. Tests execute in parallel on selected devices. Testing can be integrated with development workflows using Jenkins plugin or APIs available in SDK/CLI. Test results include device screenshots, recorded video, device logs, performance data and step by step execution logs.
AWS Device Farm enables companies to test their mobile apps on real iOS and Android devices in the AWS cloud. Devices are available, on-demand, to developers and testers that need access to devices for development, testing and re-producing customer issues. The Device Farm fleet not only includes most of the popular devices available in the market today but also maintains multiple OS versions for each device. Device Farm has two main capabilities: 1) Remote Access – Developers and testers can take full control of a real device in the AWS cloud to perform manual tests. They choose from 100s of devices. Simply upload the app to test or access the mobile application in a browser and interact with the device as if it were in their own hands. Device logs and a video of the device under test are created at the end of the session. 2) Test Automation – Execute test scripts in popular automation frameworks on 100s of real devices. Devices are available on-demand. Tests execute in parallel on selected devices. Testing can be integrated with development workflows using Jenkins plugin or APIs available in SDK/CLI. Test results include device screenshots, recorded video, device logs, performance data and step by step execution logs.
Supports many devices: Gain instant access to the same devices, down to the OS version, that mobile users have in their hands today. Scale: 100s of unique device configurations with multiple copies of each device. Security: Secure Devices are dedicated during test session (single-tenant). Installed applications are removed at the end of the session. Devices are isolated with RF shielding. IP is safeguarded using AWS cloud best practices. Flexible: Supports multiple popular automation frameworks. Choose the best-fit framework for your project. Integrates with your workflow: Integrate testing into your build process with the Jenkins plugin or other workflows with Device Farm API available in AWS SDK/CLI. Actionable reports: Test results that include screenshots, video, device logs, and performance data help pinpoint bugs and performance issues. Lower TCO: Monthly subscriptions or pay-per-minute usage is significantly less expensive than purchasing 100s of devices and maintaining a highly-available on-premises device lab.
In today’s ecosystem its not as simple as just developing mobile apps for the web or for iOS or for Android or for Fire OS. You need to consider the platform and all of the myriad devices out there (tablets, phones, tvs), different form factors, different OS versions, different firmware, different modifications from different carriers. So while this is great from a consumer perspective as it drives choice and innovation, from a development perspective, the complexity is very large. Application issues are often device-specific. To ensure a good user experience, protect the brand and avoid negative reviews on the app stores, mobile project teams have to test on the same devices that their customers are using. The challenge is that there are 100s of devices with varying OS versions and hardware characteristics. Maintaining a test lab with all of these devices is a massive undertaking and extremely expensive. Device Farm solves this problem by providing instant access to 100s of real iOS and Android smartphones and tables in the AWS cloud. Mobile project teams no longer have to purchase 10s or 100s of devices and keep up with new models and OS versions that are constantly emerging in the market. Devices are available, for distributed teams that need access to devices for development, testing and re-producing customer issues.
The consumer is very fickle. App Quality is an increasingly important metric to look at. When you push apps to the app market, simply crashing on a device or having a problem is very likely to send customers looking to a competitive product.
AWS Device Farm supports developers and QA teams as they:  Develop their apps and test iterative changes  Test cumulative builds (e.g. nightly) as part of continuous integration  Verify functionality prior to release  Reproduce issues reported by end users

Testing Applications with AWS Device Farm

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (20)

Similar to Testing Applications with AWS Device Farm

Similar to Testing Applications with AWS Device Farm (20)

More from Amazon Web Services

More from Amazon Web Services (20)

Recently uploaded

Recently uploaded (14)

Testing Applications with AWS Device Farm

Editor's Notes