- The document discusses speeding up mobile development through continuous integration on real devices. It introduces Intuit's Virtual Device Lab (VDL), which allows running automated tests on real mobile devices through a browser.
- VDL addresses challenges developers face from the large number of device and OS combinations by running tests in parallel across many real devices. This reduces the development iteration cycle from days to minutes.
- The document highlights how VDL integrated with Intuit's test automation framework and tools like Cucumber and Calabash allows running tests remotely over WiFi. This provided significant time and cost savings compared to alternatives.
Velocity Conference: Increasing Speed To Market In Mobile Development Through...Intuit Inc.
In the past few years, Intuit has put an intense focus on ramping up its innovation engine. A big part of this effort is speeding up time-to-market for its hundreds of native mobile apps, while maintaining the highest quality standards. The apps need to work across an ever-increasing number of devices and versions of the operating system.
Once our engineers had access to all possible combinations of devices and operating systems, they needed to be able to kick off automated testing whenever they checked in code. We enable mobile continuous integration by integrating our virtual device lab with our test execution platform and Jenkins system. A notification system detects the arrival of a new build of our mobile products, which kicks off execution of automated tests based on a pre-configured test matrix.
The result is a 95% reduction in the time it takes to test our mobile apps.
Wipro & Experitest Co webinar: Enhance your Mobile App with Load Testing and Increased Productivity.
Wipro and Experitest on a live webinar on improving the performance of your mobile application while expanding productivity. The solutions we present will allow you to test faster, and more diligently than ever, combining load, performance, and functionality all at once.
The session covers:
- A case study involving Wipro and SeeTest working with a major American Bank
- Live demo to show SeeTest Automation integrate into HP LoadRunner
- How Wipro developed a mainframe component to perform backend validation
- Live demo of Wipro's SeeTest Framework, and how it improves productivity by 50%
Speakers:
Guy Arieli, CTO, Experitest
Sudheer Mohan, Director - Mobility Certification & Automation, Wipro
Experitest & Hexaware on a joint webinar on performance testing for mobile which highlights the need for a Performance Testing Strategy.
The session will show you how to get the most from your testing budget by using mobile testing tools that integrate functionality, performance, load, network virtualization and more in securing the quality of your mobile application.
The session will discuss:
- Today's approach towards performance testing of mobile apps
- Using cutting edge tools, solutions, and methodologies as part of your testing strategy
- A case study highlighting Hexaware’s experience in performance testing of a financial Mobile App
- Demonstration of Experitest’s SeeTest Network Virtualization solution
Speakers:
Guy Arieli, CTO, Experitest
Vinayak Gaur , Head of mobile testing practice, Hexaware Technologies
Building a useful set of devices for testing apps requires significant knowledge of the Android ecosystem. Once assembled, the device matrix provides broad, efficient coverage with minimal investment.
Velocity Conference: Increasing Speed To Market In Mobile Development Through...Intuit Inc.
In the past few years, Intuit has put an intense focus on ramping up its innovation engine. A big part of this effort is speeding up time-to-market for its hundreds of native mobile apps, while maintaining the highest quality standards. The apps need to work across an ever-increasing number of devices and versions of the operating system.
Once our engineers had access to all possible combinations of devices and operating systems, they needed to be able to kick off automated testing whenever they checked in code. We enable mobile continuous integration by integrating our virtual device lab with our test execution platform and Jenkins system. A notification system detects the arrival of a new build of our mobile products, which kicks off execution of automated tests based on a pre-configured test matrix.
The result is a 95% reduction in the time it takes to test our mobile apps.
Wipro & Experitest Co webinar: Enhance your Mobile App with Load Testing and Increased Productivity.
Wipro and Experitest on a live webinar on improving the performance of your mobile application while expanding productivity. The solutions we present will allow you to test faster, and more diligently than ever, combining load, performance, and functionality all at once.
The session covers:
- A case study involving Wipro and SeeTest working with a major American Bank
- Live demo to show SeeTest Automation integrate into HP LoadRunner
- How Wipro developed a mainframe component to perform backend validation
- Live demo of Wipro's SeeTest Framework, and how it improves productivity by 50%
Speakers:
Guy Arieli, CTO, Experitest
Sudheer Mohan, Director - Mobility Certification & Automation, Wipro
Experitest & Hexaware on a joint webinar on performance testing for mobile which highlights the need for a Performance Testing Strategy.
The session will show you how to get the most from your testing budget by using mobile testing tools that integrate functionality, performance, load, network virtualization and more in securing the quality of your mobile application.
The session will discuss:
- Today's approach towards performance testing of mobile apps
- Using cutting edge tools, solutions, and methodologies as part of your testing strategy
- A case study highlighting Hexaware’s experience in performance testing of a financial Mobile App
- Demonstration of Experitest’s SeeTest Network Virtualization solution
Speakers:
Guy Arieli, CTO, Experitest
Vinayak Gaur , Head of mobile testing practice, Hexaware Technologies
Building a useful set of devices for testing apps requires significant knowledge of the Android ecosystem. Once assembled, the device matrix provides broad, efficient coverage with minimal investment.
Watch a live presentation at http://offer.bitbar.com/learn-the-best-practices-of-mobile-game-testing
To get the best start for your mobile game - or just to improve the existing game's possibility to get in front of hundreds of millions of gamers - we'll be sharing our insights, best practices and lots of tips&tricks how to gain advantage in this race.
Stay tuned and join our upcoming webinars at http://bitbar.com/testing/webinars/
Different testing requirements that mobile applications have, challenges and solutions Challenges 1. Complex mobile testing matrix, Expensive test environment 2. Repetitive testing 3. Mobile testing for devices located at various locations Solutions: • Risk Based Testing approach • Using Mobile device emulators • Use of Automation tools • Leveraging external services
Mobile Application Testing Training PresentationMobiGnosis
Mobile Application Testing Training Presentation in Bangalore by experienced Professionals in Industry. Get a FREE Demo Now. Visit http://www.mobignosis.com/mobile-testing-training/
SwaamTech, is an independent QA and Software Testing company helping clients to bring quality in there products. Contact us for testing of your SmartPhone App testing: support@swaam.com
SauceCon 2017: Are Manual Testers Needed In Automated DevOps World?Sauce Labs
When Anurag joined Honeywell in 2014, it was an industrial company on a mission to transform itself into a Digital industrial company. Development was done in a traditional waterfall method, testing was only done manually, resulting in very few software releases with below average quality. He is helping transform the organization by driving (scaled) agile development, test automation and effective DevOps. The big question faced by the company now is how to best leverage the army of manual test resources in this automated DevOps world. In this talk, he will explain how he helped answer that question.
Top 10 Mobile Application Testing Tools | EdurekaEdureka!
YouTube Link: https://youtu.be/aCBQm5yLc9w
** Appium Certification Training: https://www.edureka.co/appium-training-mobile-automation-testing **
This edureka "Top 10 Mobile Application Testing Tools" PPT you will learn about the best testing tools being used in the mobile application industry. This PPT discusses tools that work on android, iOS or both.
Follow us to never miss an update in the future.
YouTube: https://www.youtube.com/user/edurekaIN
Instagram: https://www.instagram.com/edureka_learning/
Facebook: https://www.facebook.com/edurekaIN/
Twitter: https://twitter.com/edurekain
LinkedIn: https://www.linkedin.com/company/edureka
Castbox: https://castbox.fm/networks/505?country=in
Testing Techniques for Mobile ApplicationsIndicThreads
With the fantastic growth of mobile computing platforms such as the iPhone, Blackberry,Symbian, J2ME, Windows Mobile and Android environments, there has been a dramatic increase in the value of mobile applications for most companies.
However, one of the biggest challenges that one faces when developing a mobile application is how to test it. Testing Mobile applications is a very intricate and arduous undertaking. There are an enormous number of factors to consider for mobile computing which simply aren’t present for desktop or web development, including hardware/software platforms, installation the application, network type, network strength, memory & battery consumption, external interfacing through WAP and HTTP etc. Additionally, testing the application in simulator, using various debugging tools are some further adventures which the tester undergoes during testing cycles.
With a blend of these challenges as the core of the address, we would be presenting our experience from our product development cycles
Watch a live presentation at http://offer.bitbar.com/learn-the-best-practices-of-mobile-game-testing
To get the best start for your mobile game - or just to improve the existing game's possibility to get in front of hundreds of millions of gamers - we'll be sharing our insights, best practices and lots of tips&tricks how to gain advantage in this race.
Stay tuned and join our upcoming webinars at http://bitbar.com/testing/webinars/
Different testing requirements that mobile applications have, challenges and solutions Challenges 1. Complex mobile testing matrix, Expensive test environment 2. Repetitive testing 3. Mobile testing for devices located at various locations Solutions: • Risk Based Testing approach • Using Mobile device emulators • Use of Automation tools • Leveraging external services
Mobile Application Testing Training PresentationMobiGnosis
Mobile Application Testing Training Presentation in Bangalore by experienced Professionals in Industry. Get a FREE Demo Now. Visit http://www.mobignosis.com/mobile-testing-training/
SwaamTech, is an independent QA and Software Testing company helping clients to bring quality in there products. Contact us for testing of your SmartPhone App testing: support@swaam.com
SauceCon 2017: Are Manual Testers Needed In Automated DevOps World?Sauce Labs
When Anurag joined Honeywell in 2014, it was an industrial company on a mission to transform itself into a Digital industrial company. Development was done in a traditional waterfall method, testing was only done manually, resulting in very few software releases with below average quality. He is helping transform the organization by driving (scaled) agile development, test automation and effective DevOps. The big question faced by the company now is how to best leverage the army of manual test resources in this automated DevOps world. In this talk, he will explain how he helped answer that question.
Top 10 Mobile Application Testing Tools | EdurekaEdureka!
YouTube Link: https://youtu.be/aCBQm5yLc9w
** Appium Certification Training: https://www.edureka.co/appium-training-mobile-automation-testing **
This edureka "Top 10 Mobile Application Testing Tools" PPT you will learn about the best testing tools being used in the mobile application industry. This PPT discusses tools that work on android, iOS or both.
Follow us to never miss an update in the future.
YouTube: https://www.youtube.com/user/edurekaIN
Instagram: https://www.instagram.com/edureka_learning/
Facebook: https://www.facebook.com/edurekaIN/
Twitter: https://twitter.com/edurekain
LinkedIn: https://www.linkedin.com/company/edureka
Castbox: https://castbox.fm/networks/505?country=in
Testing Techniques for Mobile ApplicationsIndicThreads
With the fantastic growth of mobile computing platforms such as the iPhone, Blackberry,Symbian, J2ME, Windows Mobile and Android environments, there has been a dramatic increase in the value of mobile applications for most companies.
However, one of the biggest challenges that one faces when developing a mobile application is how to test it. Testing Mobile applications is a very intricate and arduous undertaking. There are an enormous number of factors to consider for mobile computing which simply aren’t present for desktop or web development, including hardware/software platforms, installation the application, network type, network strength, memory & battery consumption, external interfacing through WAP and HTTP etc. Additionally, testing the application in simulator, using various debugging tools are some further adventures which the tester undergoes during testing cycles.
With a blend of these challenges as the core of the address, we would be presenting our experience from our product development cycles
Speed and quality through Mobile Continuous Integration on Real Devices at Intuit. The presentation share about our key considerations for 3rd-party vs custom built solutions and how we created Virtual Device Lab and test automation framework to enable end-2-end Mobile continuous integration that reduce development iteration cycle from Days to Minutes
SeeTestAutomation - Mobile Test Automation Tool by ExperitestExperitest
Run the same test on different mobile devices and operating systems with a mobile test automation tool that allows test portability
• Perform mobile test automation using real devices and emulators
• Create a test on one device and run it on any other device model or operating system
• Increase coverage with full peripheral testing capabilities - GPS, Touch ID, camera and audio
• Start your mobile test automation quickly with a simple plug, record and play tool
• Enhance your mobile test automation by Integrating into all your major ALM environments
• Integrate with WebDriver (Selenium), HP UFT/QTP, JUnit, Microsoft Visual Studio and more
• Integrate with any continuous integration environment - HP Quality Center (ALM), Jenkins and more
Experitest-Infosys Co-Webinar on Mobile Continuous IntegrationExperitest
Experitest & Infosys held a co-webinar, discussing Continuous Integration & Mobile Performance Test Strategies, Tools and Certification services that can guarantee a quality app for the end user.
Covered in this webinar:
- Intro to Perfecto
- Intro to Appium
- How Perfecto Fits In
- Demos
- Q&A
By the end of this webinar, you'll be chomping at the bit for the next opportunity involving Appium!
Why Appium alone doesn't cut it for enterprises.
Covered in this webinar:
- Intro to Perfecto
- Intro to Appium
- How Perfecto Fits In
- Demos
- Q&A
By the end of this webinar, you'll be chomping at the bit for the next opportunity involving Appium!
Zen Test Labs Mobile Application TestingZen Test Labs
For more info visit: www.zentestlabs.com
www.blog.zentestlabs.com
--Mobile Application Testing
--Mobile Configuration Optimization
--Mobile Test Automation
--Mobile Performance Testing
Join Microsoft and Perfecto for a presentation on how to integrate continuous testing on real devices into your build and test process!
Advance your agile transformation initiative by including functional testing in your Continuous Integration process and run automated tests directly from Visual Studio.
ICTestAutomation suite- for Automated testing - Test automation regression testing - integration testing - software testing test tools - Formerly known as CitraTest FT 0 functional and performance testing of any application.
A Comprehensive Guide to Leveraging Device Farms for Maximum Testing Efficien...kalichargn70th171
In today's digital era, universal compatibility is crucial for web apps and applications. With many devices, browsers, and operating systems in play globally, ensuring seamless functionality becomes a complex challenge. While emulators and simulators offer partial solutions, real-world testing on diverse devices is irreplaceable.
Leveraging AI for Mobile App Testing on Real Devices | Applitools + KobitonApplitools
Explore how to use the cutting-edge integration of Visual AI from Applitools with Kobiton's real mobile device cloud to create a comprehensive solution for continuous UI testing. See more information and find the on-demand recording at applitools.com.
Similar to Droid con slides 2013 mobileci-v1.0 (20)
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfPaige Cruz
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
PHP Frameworks: I want to break free (IPC Berlin 2024)Ralf Eggert
In this presentation, we examine the challenges and limitations of relying too heavily on PHP frameworks in web development. We discuss the history of PHP and its frameworks to understand how this dependence has evolved. The focus will be on providing concrete tips and strategies to reduce reliance on these frameworks, based on real-world examples and practical considerations. The goal is to equip developers with the skills and knowledge to create more flexible and future-proof web applications. We'll explore the importance of maintaining autonomy in a rapidly changing tech landscape and how to make informed decisions in PHP development.
This talk is aimed at encouraging a more independent approach to using PHP frameworks, moving towards a more flexible and future-proof approach to PHP development.
A tale of scale & speed: How the US Navy is enabling software delivery from l...sonjaschweigert1
Rapid and secure feature delivery is a goal across every application team and every branch of the DoD. The Navy’s DevSecOps platform, Party Barge, has achieved:
- Reduction in onboarding time from 5 weeks to 1 day
- Improved developer experience and productivity through actionable findings and reduction of false positives
- Maintenance of superior security standards and inherent policy enforcement with Authorization to Operate (ATO)
Development teams can ship efficiently and ensure applications are cyber ready for Navy Authorizing Officials (AOs). In this webinar, Sigma Defense and Anchore will give attendees a look behind the scenes and demo secure pipeline automation and security artifacts that speed up application ATO and time to production.
We will cover:
- How to remove silos in DevSecOps
- How to build efficient development pipeline roles and component templates
- How to deliver security artifacts that matter for ATO’s (SBOMs, vulnerability reports, and policy evidence)
- How to streamline operations with automated policy checks on container images
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
Droid con slides 2013 mobileci-v1.0
1. Speed to Market in Mobile
Development
Finding the right solution with continuous
integration on real devices
2. Agenda
Mobile trends & developers’ challenges
Speed & quality through continuous integration
- Intuit Virtual Device Lab
- Intuit mobile test automation
Takeaways
3. Aggressive mobile momentum
Will surpass desktop
by 2014
Proliferation of platforms, OS
versions & device types
It should just work!
“2013 Internet Trends,” KPCB
4. •
Developer challenges
Immense configuration matrix
–
–
–
•
Application delivery through the markets
–
•
Network, different network bandwidth/latency, no-network
HTML5 offline app
Media challenges
–
–
•
App signing, provision (app & device), submission
Offline experience
–
–
•
OS platforms (Android, iOS, Windows, phone vs. tablet, …)
Inputs (touch/gesture, real buttons, voice, camera, GPS receiver)
Outputs (portrait/landscape, screen resolution, language)
Some codecs don’t work on a device
Streaming, sound
Security & privacy
5. Intuit mobile app portfolio today
22
Apple
15
Google
11
Amazon
3
SMS
491 mobile apps for financial institutions
0
5
10
15
20
490
6. Ramping up Intuit’s innovation engine
Pain: Takes days per build to test
combinations of device/OS configurations
physically & manually, one by one …
QA can’t keep up with the changes
Goal: Reduce development iteration cycle
from days to minutes on an ever-growing
number of devices
Strategy: Speed & quality through mobile
continuous integration
Platforms
Devices
X
• Apple
• Google
• Amazon
OS
versions
X
•
•
•
•
•
•
iPhone 4
iPhone 4S
iPhone 5
iPad 2
iPad 3
iPad Mini
Builds
X
•
•
•
•
•
iOS 5.0
iOS 5.1
iOS 6.0
iOS 6.1.x
iOS 7.0
Daily
builds
7. What is CI?
•
•
•
•
Continuous integration (CI)
Automate build, test & deployment process
Integrate & build early, often, daily, for every check-in
Best practice of Agile development
Jenkins is widely adopted, flexible & extensible
Benefits of CI in a mobile world
• Instant feedback on quality, functionality & system
impact
• Less complex, no integration hell
• Detect and address device configuration issues early
• Involve stakeholders early
• Ultimately achieve shippable release any time
8. Speed and quality
Developers/
IDE
Check in
Test results
through mobile CI
Process starts here
SCM: source
repository
Submit the app to
app store if passed
Analyze
test results
Key enablers:
Check-in
triggers
automated CI
• Mobile device lab
• Test automation
Automatic
test run
Run tests on real
devices in parallel
Jenkins
Trigger testing in
mobile device lab
Real
devices
Test processor
Install the test app to
real devices in parallel
9. rd-party
3
vendor solutions didn’t work for us
• Couldn’t handle E2E automation of testing pre-release apps
– Dependency on internal resources & infrastructure
• Vendor lock-in: customized CI & test automation solutions
– No flexibility to use our existing tools & frameworks
• Disadvantages of vendors’ shared devices
– Security concern on testing on shared devices
– No access to corporate network
– Cost-prohibitive to reserve devices
• Private cloud (on-site setup) with local devices not practical
– With sensitive customer data, we need private cloud
– Extensive use of devices for daily testing of hundreds of mobile apps is expensive
10. Why test on real devices?
Most mobile features can be tested on simulators,
but simulators have limitations:
• Device capabilities (GPS, camera, accelerometer,
gyros), form factors & pixel density
• Real-world experience over the real connection
(3G, 4G, crappy Wi-Fi, etc.)
• True performance, security tests
• Testing on non-default Web browsers (e.g.,
Opera Mini)
• Not all simulator/emulators have good quality
(don’t reflect real rendering/behavior, bugs)
• Testing SMS & app integration
12. Intuit Virtual Device Lab (VDL)
Gives access to real mobile devices using a browser
3-click access
User machine
Always on
Intranet
User machine
User machine
VDL
Manufacturers/
devices:
iPhone
iPad
Galaxy
Captivate
Droid
Milestone
Moto
Optimus
Globally available
Integrated with
dev infrastructure
Nexus
One
Desire
Incredible
13. VDL architecture – Android
Internet/intr
anet
Device
interaction app
Windows PC
Tomcat
USB connection
Image
transfer
Java image
transferring
application
Browser &
Java applet
Developer’s laptop
VDL
14. VDL architecture – iOS
Internet/intr
anet
Mac with Xcode
installed
VNC server
Tomcat
USB connection
Port
forwarding
Java VNC
client
Browser &
Java applet
Developer’s laptop
VDL
15. Open source tools & technologies used in VDL
Key capabilities
Android
Installing mobile applications into the adb install <APK file>
real device
iOS
Fruitstrap
https://github.com/ghughes/fruitstrap
Transferring device screen images,
controlling device
Screencast tool
Veency VNC app
http://code.google.com/p/androidscre
encast
Fetching device local files
adb pull <filename>
sftp command
(jailbroken devices only)
16. VDL key features & functionality today
Control the device through standard browser/RESTful
APIs
Change orientation to landscape or portrait
Copy local file to the device from your PC
Get file from the device onto your local PC
Execute an ADB command on the device
See current running logs in your browser
Download history logs to your local PC
17. Continuous integration – how it works
Trigger file launches test
Monito
r for
new
builds
Resource
manager
Test execution
engine
Product builds
Results
Select a device
VDL device
inventory
18. Mobile continuous integration
Leveraging the Virtual Device Lab for test automation on multiple, real devices simultaneously.
1 Select devices & tests
2 Tests run automatically across selected devices
with each build
Submit, build, test … in minutes vs. hours
3 See the results!
19. Next step: over-the-air replaces USB connection
VDL
Fast onboarding
App
installation
Scalable
Test
execution
Results
retrieval
Internet/intr
anet
Any device
21. Mobile test automation tools
iOS
Instrumentation-based
Android
MonkeyTalk
Frank
Calabash
(LessPainful)
TestDroid (BitBar)
UISpec
Robotium
UIAutomation
iOS SDK
Soasta
iOS Driver
Appium
Non-instrumentation
MOET
Sikuli
Cross-platform solution
Android SDK
MonkeyRunner
DA/PerfectoMob
ile
eggPlant
• Assessed as of 2012
22. Mobile test automation trends
• Abstraction with domain-specific language (DSL)
–
–
Common test script over different devices (e.g., Cucumber, MonkeyScript, MOET)
Support behavior-driven development (BDD)
• Client/server-based approach (remotely driven tests via HTTP)
• Instrumentation & non-instrumentation solutions complement
each other
• Mobile cloud testing environment
–
From hardware (cradle) to software approach to drive tests on
real devices
• Automated OTA app installation & tests
23. Intuit automation framework of
choice/recommendation
• Native apps:
– Cucumber + Calabash for BDD on iOS &
Android
• Mobile Web:
– Selenium/WebDriver
24. What is Cucumber?
It lets stakeholders (customers, QE or developers)
describe how software should behave in plain
text.
•
BDD: Written in business domain-specific language (DSL)
– Good abstraction over different device types
•
One format for multiple purposes
– UI feature specification
– Automated tests
•
Cucumber itself is NOT a test automation tool
– Add-on to any test automation framework
– Examples: Calabash, Sikuli & Frank mobile test
frameworks
25. What is Calabash?
• Open source cross-platform mobile test framework
– iOS + Android, simulator + real device, native + hybrid
• Supports Cucumber for BDD
• Application needs instrumentation that embeds a Calabash HTTP server
– Tests run from a remote client (in a Jenkins slave)
– Tests can be driven via Wi-Fi (no USB wire)
• Ruby clients in API level (Java clients in experiment)
• Works great in touch simulation & real device testing
26. Intuit shared test library – rapid test development
Common test library
High-level test domain-specific language
(Cucumber steps)
Mobile
front-end
Product tests
Teams focus on
creating
Native/hybrid test framework
Use shared test lib
Tests
Tests
Tests
Tests
Globalization test framework
(I18N/L10N)
Security test framework
Mobile
back-end
Performance/load test framework
Internal open source repository
Contribute
… and then contribute to
common test library
27. Stunning results: reduced iteration cycle from hours to minutes
From: manual
10
5
Code
build
Notify
email
Consolidate
report
* 50*5
= 250
Upload
report
30
Get
devices
10
= 6 hours
20
15
30
15
To: automated CI
Code
build
Trigger
Deploy on
devices
Execute tests in
parallel
Consolidated
report in archive
0
5
10
0
Tested on 5 devices
Release quality increased
= 15 mins
TIME SAVED: 95%
28. VDL cost saving over vendors’ private clouds (today)
Assumptions: 50 native apps &
Annual
cost ($)
daily check-in
3rd-party vendor 1
local device in cradle
3rd-party vendor 2
local device w/o cradle
(Software approach)
Savings
Savings
Intuit Virtual Device Lab
25
150
Private cloud setup behind corp firewall
# of devices
Note: As vendor pricing changes,
so do the savings
29. Key takeaways
Building custom solution vs.
rd-party
3
vendor solution
Understand your technical/platform/global spread
Many vendor solutions provide a larger set of devices/OS versions
in the global market
Quite a few offer mobile test services – might be tightly coupled with their
device access solution & automation framework
Connecting to your corporate network is a challenge – some provide private
cloud (on-site setup within your network) but it’s cost-prohibitive
Invest in automation and CI
Automate tests with robust automation framework
Enable rapid test development through shared test library
Adopt CI in mobile development for speed & quality
Need to scale to large # of mobile apps to support
Device access, app installation, tedious testingacross large configuration matrix – turnaround time isdays to weeks
Talk Points: For all these reasons, we built our own solution, mobile continuous integration with VDL.- Briefly talk about overall mobile CI to show the big picture first.