Your SlideShare is downloading. ×
Mobile Web Testing - Success Through Automation
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Saving this for later?

Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime - even offline.

Text the download link to your phone

Standard text messaging rates apply

Mobile Web Testing - Success Through Automation

2,592
views

Published on

Learn About: best practices to leverage test automation to overcome the challenges of testing Websites on mobile devices …

Learn About: best practices to leverage test automation to overcome the challenges of testing Websites on mobile devices

With the growing penetration of HTML5 , mobile web is being seen as the future of mobile applications. However, developing or expanding your mobile web solutions can be challenging due to rapid changes in technology; diversity of the device environment; variations in platforms, hardware, networks and form factors that can affect performance, compatibility and usability; attaining a secure mobile Web experience; and certifications and app store approvals.

In this live Webinar, Sivakumar Anna, InfoStretch Director of Enterprise Services, will present a comprehensive overview of the Web mobility landscape and testing systems, and best practices to leverage test automation to overcome the challenges of testing Websites on mobile devices. Siva’s presentation will include:

1. Diversity of the mobile device environment including mobile phones, smartphones and iPads, and how to identify your device list for target customer base.

2. Managing the challenges of hardware configurations, networks, carriers and platforms.

3. How to build a framework to conceptualize, automate and regress hundreds of test cases on mobile devices without requiring a significant investment in device acquisition.

4. Managing usability in the event of exceptions or interrupts, and how to handle unknowns for connected applications due to carrier restrictions.

5. Demonstration of a framework for automating mobile Web testing using commercial and/or open source tools.

Published in: Technology

0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
2,592
On Slideshare
0
From Embeds
0
Number of Embeds
4
Actions
Shares
0
Downloads
62
Comments
0
Likes
2
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide
  • Here is the agenda for today’s presentationTo start with I will give an overview of the mobile web – more from enterprise perspective. I will be talking about how enterprises are looking at the mobile channel, what are the possible strategic solutions available and briefly talk about WHY mobile web is the RIGHT way for enterprise companiesFollowing to that I will focus my discussion on mobile web testing – Here I will be talking about what should be the testing strategy and discuss on the benefits / limitation of those options. I will also share some the tools and technologies that would allow you to implement the automation strategy to achieve the maximum benefits.After that I will show a demo video of the sample implementation – where you can see the results and give you an idea of how this can be effectively implemented in your work environmentI will conclude the presentation with giving my thoughts on the enterprise mobile – where we are today, what are some of the hurdles and in future what kind of role the mobile will play in the enterprise sector
  • 92 Countries - Based on the recent Admob Metrics report, there were 92 countries with more than 10 million – that increment is from 27 countries in 2008.1.9 Billion – According to the global internet usage report, the total number of internet users today worldwide3.4 Billion – The number of the mobile phone subscribers today across the globe – that number to increase to 4.5 by the year 201231% - Out of 308 million US population, 31% of the users are using smartphones. As per the CTIA 2009 Annual report (http://www.ctia.org/media/industry_info/index.cfm/AID/10323), wireless penetration is at 91% in US alone5 Years – In the next 5 years, the mobile internet users will surpass the desktop internet users based on a report from Morgan stanely. (http://gigaom.com/2010/04/12/mary-meeker-mobile-internet-will-soon-overtake-fixed-internet)Though these numbers are very interesting …http://internetworldstats.com/stats.htm
  • What is more exciting is the fact that today 1/3 of the internet users globally access internet via the mobile devices. And this is expected to grow very rapidly in the next few years and more than half the users will be enjoying the internet using the handheld devices.
  • The other option is to write a mobile version of the appsThat means all you have to do is writing a new presentation layer with the already existing business implementation .. Avoid the cost overhead in building multiple version of the applications and maintenance and support of the same applications on various platformsImplementing the mobile web based solutions will also help in pushing the features more faster to the communities and quickly fix the production issues
  • The other option is to write a mobile version of the appsThat means all you have to do is writing a new presentation layer with the already existing business implementation .. Avoid the cost overhead in building multiple version of the applications and maintenance and support of the same applications on various platformsImplementing the mobile web based solutions will also help in pushing the features more faster to the communities and quickly fix the production issues
  • With knowing how valuable for the enterprises to have mobile web based solutions for the mobile strategy, lets look at the testing options we have for that kind of applications.
  • But before going into that, I want to highlight couple of points. What makes the mobile web different from a typical web based applicationPresentation Channel – Mobile Web is another presentation channel with lot of UI specific biz logic implemented from the ground up. It is not something like you tweak here and there on the existing web front end and make it available for mobile devices – you can do that but it is not going to be effective and user friendlyThough the UI representation is different, everything else from the middle tier to backend infrastructure is going to be the same – for which you might have already testing strategy available for most of the services. You already have resources, supporting tools and technologies, users with domain knowledge exist already which you should be able to re-use the maximum benefitWhat are the testing challenges, you have to make the testing strategy for mobile web fit into the existing strategy. You may not have liberty to pick and choose how you want to implement the testing strategy. You have to build your strategy surrounding to the existing ones.Generating device specific traffic – Because the mobile web is about serving the mobile customers, you should be able to test the mobile web by generating the traffic with various type of device profiles. Smartphones, non-smartphones, JavaScript enabled / disabled, with CSS properties, HTTP / HTTPs etcAnd most the challenging one is how to achieve an automation implementation by defining one scripts and running with all the necessary device variations
  • Another difference:Channel Integration- Because mobile web is another channel, most of the times, the transactions are inter related. Eg: if a mobile customer is doing an account transfer, the balance needs to be reflected / updated immediately on the online channel and send the customer an alert if the bill-payment is going to denied Also for some of the high-value transactions, still, the customer need to go and verify and authenticate to make the transactions completeAlerts and Notifications needs to be raised and delivered to across all the channels based on the exception conditions defined by the business rulesThe testing challenge here is to have a QA environment that would allow to access and exercise the transactions across multiple channels. To test the exception conditions, it is important that to have access to the backend systems to simulate conditions.
  • There are three different categories by which you can achieve your mobile test strategy ..First one is using simulators / emulators – This is most economical solution for having a test coverage across various device combinations and also it has other key benefits which I will talk in the next slidesThe focus of the testing will be more on validating the business functionalities and business rules.Secondly the remote testing capabilities of the devices. There are few of our partners providing this service by you can access the devices of your business need and test the various functionalities per your testing need.You will be focusing your testing on UI interface, device specific interfaces etc. The last one option you have for your mobile testing is actual physical devices .. You will still need to do it for a limited set of test cases.
  • This table shows the various type of testing and what is possible and what not for each of the testing approach ..As you can see, pretty much you can do all of your testing with simulators – what you cannot do with this approach are the Security Testing and Usability Testing and Synchronization testing (Battery low condition, Incoming Call, Alert from other apps, etc)Our focus will be on the first approach for our today’s presentation
  • At a high level, lets look at what is this approach means ..Simulators – This basically means that with the aid of the available software, you duplicate the mobile handset internet access. Emulators – This is a software / hardware based solution that will behave very similar to the mobile device. The emulators also will have some internal knowledge on how the system will behave, let say, when an incoming call comes, when you are editing a document on the deviceWith both the approach, the internet traffic is generated by modifying the HTTP headers with device specific profiles – The key header element that you have to know is the User Agent – this one is almost unique for each mobile deviceWhat are the examples:There are tools from each of the platform providers – like iPhone, Android, Blackberry, Windows Mobile etc – almost all they platforms provide the emulatorsThere are also Browser Plug-ins that will allow you to change the HTTP Header – this is what will be covering in our demo todayAnd also there is a nice product from Keynote called MITE - that allows you to define and run scripts across the mobile devices with in the MITE product
  • What is our testing boundary? Where do we test from? [click]You have basically several layers of back end appDatabase layer, app layer, Web Presentation layer [click] and it is accessed by online customers via internet using browsers[click]With the introduction of the mobile web, there will be another presentation layer catering to the mobile users [click]And our testing focus will be this ..
  • What are the benefitsROI is high – one reason being the investment itself very low - [click]You can do start doing your testing at the early stages of the dev cycle and also you can integrate with your build cycle. Because it is easier to recreate the setup, helpful to do analysis on issues, become easier [click]You can start doing performing your end-to-end cycle testing in an agile environment [click]You will be able to leverage the existing infrastructure – Lab, Tools and Technologies and Resources experienced on the domain, OTA testing is possible
  • Limited simulation capabilities for device specific features – like Camera, Voice InteractionYou will not be able to verify the carrier based restrictions (data usage, roaming usage, etc)Simulating the device specific conditions are another set of things that you will not be able to test it out like Power Switch off, Incoming Calls, Low Battery condition
  • Here is a look at the deployment architecture for test automation for mobile webYou have Automation lab – can be QTP, Selenium, SilkTest, Sahi etc [click]You have browsers of your choice – automation tool interacts with browser [click]Browsers in-turn send request to the AUT via web proxy ..The execution process looks something like this: [click]First, the automation tool setups the proxy with the necessary device header [click]Then Automation sends the test steps to browser [click] and web proxy intercepts the request and changes the header with the device profile [click]And AUT assumes that the request came of the specific device and sends the response accordingly . [click]
  • The other option is to write a mobile version of the appsThat means all you have to do is writing a new presentation layer with the already existing business implementation .. Avoid the cost overhead in building multiple version of the applications and maintenance and support of the same applications on various platformsImplementing the mobile web based solutions will also help in pushing the features more faster to the communities and quickly fix the production issues
  • Transcript

    • 1. InfoStretch Webinar
      Mobile Web Testing:
      Success Through Automation
      By: Sivakumar Anna
      Wed. June 29, 2011
      All trademarks are the property of their respective owners.©2004-2010 InfoStretch Corporation. All rights reserved.
    • 2. Agenda
      1. InfoStretch Overview
      2. Enterprise Mobile Web Landscape
      3. Enterprise Mobile Web Testing
      4. Mobile Web Automation Demo
      INFOSTRETCH CORP CONTACT INFORMATION
      (p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna
    • 3. 1
      About
      InfoStretch
      Elevating Confidence
      INFOSTRETCH CORPORATION
      (p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna
    • 4. InfoStretch Overview
      Organization
      People
      Infrastructure
      • Average 6 years experience
      • 5. 350+ Engineers/Consultants
      • 6. Industry Expertise in Finance, Retail, Mobile and Healthcare
      • 7. Strong Project Mgmt. team
      • 8. Extensive Platform Compatibility and Performance Test Labs
      • 9. 2000+ Mobile Handset Test Lab
      • 10. ISO 9000-2001 Certified
      • 11. High Availability and 24 hours secure offshore centers with
      • 12. ISO 27001 Audited
      • 13. HQ in Silicon Valley
      • 14. Offices in New York, Seattle
      • 15. 105+ Clients and 160+ Projects
      • 16. Well Established Recruitment,
      retention and training programs
      Market Mover for Software Testing
      Awarded Inc 500/5000 company of the year 2010
      Key Partners
      Recognitions
      Tot 20 QA Services Provider
      INFOSTRETCH CORPORATE
      (p) (408) 727-1100 | (w) ww.infostretch.com | (e) info@infostretch.com | Presenter: Rutesh Shah
      ©2004-2011 InfoStretch Corporation. All rights reserved.
    • 17. 2
      Enterprise
      Mobile Web
      INFOSTRETCH CORP CONTACT INFORMATION
      (p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna
    • 18. Global Mobile Data
      2
      Billion
      internet users worldwide
      40
      Percent
      Smartphone US Population
      4
      Years
      Mobile internet users will over take desktop internet users
      100+
      Countries
      With more than 10 millioninternet requests4
      50
      Percent
      120
      Billion
      Mobile Payment by 2014
      Mobile E-Commerce Market by 2015
      INFOSTRETCH CORPORATION
      (p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna
    • 19. Mobile Web Growth
      INFOSTRETCH CORPORATION
      (p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna
    • 20. Mobile In Enterprise
      • Financial Services
      • 21. Retail Services
      • 22. CRM Services
      INFOSTRETCH CORPORATION WEBINAR
      (p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna
    • 23. Enterprise Mobile Web
      • New presentation layer
      • 24. Utilize existing infrastructure
      • 25. Leverage Standards and Technologies
      INFOSTRETCH CORPORATION WEBINAR
      (p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna
    • 26. 3
      Enterprise
      Mobile Web
      Testing Models
      INFOSTRETCH CORPORATION WEBINAR
      (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
    • 27. The difference
      New Presentation Channel
      Fully working backend exists
      Testing Challenges
      Knowledgebase available
      Reduced Time to Market
      Generating device specific traffic
      Single set of scripts across multiple devices / platforms
      INFOSTRETCH CORPORATION WEBINAR
      (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
    • 28. The difference
      Channel Integration
      Information Sync across different channels
      Alerts and Notifications
      Testing Challenges
      Features dependent on multiple channels
      Co-ordination with other channels
      Setting up environment
      Validation on multiple systems
      INFOSTRETCH CORPORATION WEBINAR
      (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
    • 29. How to test?
      70%
      1. Simulators / Emulators
      20%
      2. On Real Devices using Remote Access Services
      10%
      3. On Real Devices
      INFOSTRETCH CORPORATION WEBINAR
      (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
    • 30. Mobile Web Test approach
      INFOSTRETCH CORPORATION WEBINAR
      (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
    • 31. What is Simulator testing?
      Simulators - Software that duplicates the mobile internet traffic
      Generate browser request by sending device specific HTTP Header details
      Vendors provide platform specific simulators / emulators
      Browser plug-ins available to generate the HTTP traffic
      INFOSTRETCH CORPORATION WEBINAR
      (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
    • 32. Conceptual diagram of enterprise architecture
      Mobile Web Presentation Layer
      Web Presentation Layer
      Web Presentation Layer
      Application Layer
      Database Layer
      INFOSTRETCH CORPORATION WEBINAR
      (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
    • 33. Benefits of Mobile Simulators Testing
      High Return on Investment
      Test at early stages of dev cycle
      Ability to do end-to-end automation
      Leverage existing infrastructure
      Over-the-air (OTA) is possible
      INFOSTRETCH CORPORATION WEBINAR
      (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
    • 34. Limitations of Mobile Simulators Testing
      Can’t do peripheral connectivity testing
      Not possible to perform any carrier imposed restrictions
      Cannot test the device interruptions
      INFOSTRETCH CORPORATION WEBINAR
      (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
    • 35. Mobile Website Samples - simulated
      Mcdonalds.com
      INFOSTRETCH CORPORATION WEBINAR
      (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
    • 36. Mobile Website Samples - simulated
      Cars.com
      INFOSTRETCH CORPORATION WEBINAR
      (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
    • 37. Automation Architecture (Deployment)
      Browser
      2
      Application Under Test
      5
      3
      4
      1. Update proxy with device configuration
      Web Proxy
      2. Automation tool invokes test step
      1
      3. Browser Intercepts HTTP Request
      4. Proxy Massages HTTP Request with Device Header Information
      Automation Lab
      5. AUT assumes the request came from Mobile Device
      INFOSTRETCH CORPORATION WEBINAR
      (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
    • 38. 4
      Mobile Web Automation
      Demo
      INFOSTRETCH CORPORATION WEBINAR
      (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
    • 39. Device Execution Summary Report
      INFOSTRETCH CORPORATION WEBINAR
      (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
    • 40. Device Execution Summary Report
      INFOSTRETCH CORPORATION WEBINAR
      (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
    • 41. Mobile Web Automation
      - Remote Devices
      INFOSTRETCH CORPORATION WEBINAR
      (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
    • 42. Perfecto Mobile and InfoStretch
      • Host Private Mobile Cloud for Enterprise Customers
      • 43. Provide Automation Implementation and Training
      • 44. Provide device inventory based on the customer need
      INFOSTRETCH CORPORATION WEBINAR
      (p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna
    • 45. Test Case Automation Architecture
      Browser Open
      Browser Go To
      Sign On
      Make Payment
      Confirm Payment
      Sign Off
      Text Verify
      QTP / Web IDE
      Make Payment Test case
      Sync Text
      Browser Open
      Image Select
      Schedule Payment
      Sync Text
      Quick Links
      Nick Name
      Text Select
      Send SMS
      Make Call
      ZIP ATM Search
      Sign On
      Make Payment
      Confirm Payment
      Perfecto Library
      Virtual Function Library
      iOS
      Android HTC Aria
      Android HTC Droid
      BB Torch
      LG CU620
      LG VX9000
      BB 8520
      Device Implementations for Sign On (10+)
      Devices
      Virtual Functions
      QTP Testcases
      Device Implementations
    • 46. Demo – Real Device using Perfecto Mobile
      INFOSTRETCH CORPORATION WEBINAR
      (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
    • 47. Any questions?
      INFOSTRETCH CORPORATION
      (p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna
    • 48. Website: www.infostretch.com
      Ahmedabad
      5th Floor , Regency Plaza, Anand Nagar,
      Ahmedabad-15, Gujarat, India
      91-79-40266266
      Mumbai
      Vashi InfoTech Park ,B103,Tower # 1, Vashi Rail Station, New Mumbai, Maharashtra, India
      91-22-6947900
      New York
      17 Tanglewood Rd,
      Scarsdale, NY 10583
      (703) 395-9791
      Seattle
      2550 3rd Ave, #712
      Seattle, WA 98121
      (206) 402-2426
      Headquarters
      2880 Lakeside Drive, #200
      Santa Clara, CA 95054
      (408) 727 1100
      Partners
      INFOSTRETCH CORPORATION
      (p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna