iOS Application Testing

20,448 views

Published on

Mobile Application Testing, iOS Application Testing,iPhone Application Testing,iPad Application Testing,iPod Application Testing,

Published in: Technology
4 Comments
22 Likes
Statistics
Notes
  • Hi
    I am working on iPhone. Please let me know only open source tools applicable for iOS.
    Saswat
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • You can also try a new Over the Air distribution of iOS apps called http://www.ios-apptesting.com - the benefits are: Use your own company’s email when you send new builds to your clients, Send your client instructions or information about the build you are sending, Installation stats, Add unlimited team users and restrict their access for specific apps, etc
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • nice one... similar article also posted on
    http://Qeworks.com

    http://qeworks.com/ios-mobile-application-testing/
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Another very good option for testing applications on iPhone (and many other mobile platforms) is http://www.perfectomobile.com which is a service that offers remote access to real devices. It has very nice automation capabilities and great coverage of handsets. You can try it for free.
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Views
Total views
20,448
On SlideShare
0
From Embeds
0
Number of Embeds
40
Actions
Shares
0
Downloads
0
Comments
4
Likes
22
Embeds 0
No embeds

No notes for slide

iOS Application Testing

  1. 1. iOS App Testing
  2. 2. What Are our Options? Before we decide how to present our product to iPhone OS users, we need to understand the range of options we have. Depending on the implementation details of our proposed product and its intended audience, some types of software may be better suited to our needs than others. This section divides software for iPhone OS–based devices into three broad categories, primarily based on implementation method. Roughly speaking, we can create: ■ An iPhone application, which is an application you develop using the iPhone SDK to run natively on iPhone OS–based devices. ■ Web-only content, including web applications, which are websites that behave like built-in iPhone applications. ■ A hybrid application, which is an iPhone application that provides access to web content primarily through a web-content viewing area, but includes some iPhone OS user interface elements.
  3. 3. App testing on a real device Vs a simulator There appears to be a few iPhone App simulators out there on the net claiming to offer solutions for beta testing an iPhone App. Well, although technically(and I use this term loosely) correct, the so called 'simulators' are nothing more than web browser screens made to be the same size an iPhone screen. This really cannot offer a real beta test of an application, can they? So what are the differences between testing on a simulator and a real device? The CPU type The screen (a real iphone has a touch-screen of course) Installing the App Memory usage Zooming functionality Network connectivity related issues Remember, customers that buy the App from the App store won't be running it on a simulator!
  4. 4. App Testing 1. Ensure the App will be tested on real devices (not simulators). 2. Check a range of devices is available, e.g. iPhone 3, iPhone 4, iPad and iPod Touch. 3. Make sure the testing will be carried out using the latest firmware available for that device. 4. Always ask an iPhone App Tester about Usability testing too. 5. Always ask for a test report.
  5. 5. High Level test scenarios for Iphone application  Handset application functionality : perform real iPhone based testing of the application, with various scenarios. Test team will test the application based on defined specifications  Device Certification : certify applications on actual device. Test team should test the performance of the application, resource usage, behavior and interactions  Performance and Scalability: Backend applications will need to manage the traffic of multiple mobile devices at the same time. This test will identify all the load issues and will help make system more scalable  Usability & Compatibility : verify the effectiveness of Usability of application onto various devices including interoperability with other applications running on the device. Certify the Application on Various mobile devices for the correct behavior and interactions
  6. 6.  UI Response Application : verify the response of each function and measure the performance of each response.  Settings response : verify all settings available for the application and test the functionality of each setting  Crash Points: identify all crash points, and will work with development team to resolve them Low Connectivity: test the behavior of iPhone App in Low connectivity mode and verify proper behavior  Response Memory Handling: measure the memory usage of the application and identify all memory leaks  Sleep Mode : test the application response in the sleep mode  Accelerometer: test to ensure that iPhone application properly responds to rotations  Battery Usage : measure the battery usage and will provide feedback on increasing battery life  Retrials in Case of network disconnect : test application behavior in case of network disconnect
  7. 7. Execution  Build Acceptance Testing -The first test iPhone App Testers team performs after every code drop. Verifying that the application build is stable to be tested.  High priority defect fixes – iPhone App Testers will verify after build acceptance suite execution is complete.  General test case execution shall be priority based, where high priority test cases are executed first, followed by medium and low priority test cases.  Regression Testing – iPhone App Testers will perform verification of application functionality to verify that new code did not break the existing functions and the system is not adversely affected by any code or configuration changes.  Ad-Hoc – iPhone App Testers will conduct Testing where random actions are executed in an attempt to break the system. Such executions include (but are not limited to) inputting invalid values, malicious input, and unnatural navigation.  iPhone Compatibility Testing- iPhone App Testers will test in the following OS/ Device combination: 2.0 2.2 2.2.1 3.X iPod Touch 1st gen X X iPod Touch 2nd gen X Edge X X 3G X X 3GS X
  8. 8. Test Method • iPhone App Testers team will manually test functionality based on the requirements in the test environment • iPhone App Testers team will analyze and record all test results • iPhone App Testers will use it’s own lab to conduct compatibility test • Defects found by iPhone App Testers during testing will be logged into the Bug Tracking Database • All fixed defects will be verified by iPhone App Testers
  9. 9. FoneMonkey: Iphone application functional test automation tool FoneMonkey is a functional testing tool for the iPhone providing for the interactive creation, editing and playback of automation scripts that exercise an application’s user interface. Using FoneMonkey, you can create suites of tests that automate performing user operation sequences and verifying results. FoneMonkey is designed to support developer as well as QA testing, and FoneMonkey tests can be easily incorporated into continuous integration environments. Features of FoneMonkeyTM  Free and open source automation tool for iphone mobile application.  This is World’s first iPhone functional testing tool  Ability to record, edit, and playback user interface tests and fully automate iPhone app testing  Designed to be used as a standalone, interactive recording and playback tool  Using FoneMonkey, you can create suites of tests that automate performing user operation sequences and verifying results  It is designed to support developer as well as QA testing, and FoneMonkey tests can be easily incorporated into continuous integration environments  It is designed to provide developers with a tool to decrease development time through reduced regression risk and address management’s concerns about unforeseen costs resulting from inefficient, manual testing.
  10. 10. Automated Software Testing for the User Interface eggPlant is a low-overhead, non-invasive black-box test and process automation tool. Since it does not reside on the system-under-test and is technology agnostic, it can test in many situations that other tools cannot. By using image capture and advanced search techniques, most ui changes are not a problem.
  11. 11. Other Tools  UIAutomation Instrument :http://developer.apple.com/technologies/iphone/whats- new.html#tools  UISpec is a Behavior Driven Development framework for the iPhone that provides a full automated testing solution that drives the actual iPhone UI. It is modeled after the very popular RSpec for Ruby : http://code.google.com/p/uispec/  Google Toolbox for Mac : http://code.google.com/p/google-toolbox-for-mac/ Cucumber for iphone :http://www.slideshare.net/undees/iphone-meets-cucumber OCUnit:http://mobileorchard.com/ocunit-integrated-unit-testing-in-xcode/
  12. 12. Source :  http://mobileappstesting.com/2010/02/24/346/  http://en.wordpress.com/tag/iphone-application-testing/  http://www.testplant.com/products/eggplant_functional_tester

×