0
Software testing with  Rational Teamtest Ashish Soni Lecturer, ITP [email_address]
Outline <ul><li>Miscellaneous testing facts </li></ul><ul><li>What is software testing? </li></ul><ul><li>Why do we test? ...
Interesting facts <ul><li>Recent studies show that :  </li></ul><ul><ul><li>C++ : 25% more defects than C </li></ul></ul><...
What is software testing? <ul><li>Finding out If something works or not </li></ul><ul><li>Determine if overall objectives ...
Software Testing <ul><li>Testing is the feedback  mechanism in the software development process. </li></ul><ul><li>It tell...
Why do we need to test? <ul><li>Real life examples: </li></ul><ul><ul><li>First US mission to Venus failed </li></ul></ul>...
Why testing? <ul><li>Software is never correct no matter what development technique is used </li></ul><ul><li>Any software...
Software quality <ul><li>Software quality can be measured across 4 dimensions </li></ul><ul><li>Reliability </li></ul><ul>...
Software development era <ul><li>Over the past decade software development has changed radically </li></ul><ul><li>Client ...
E-business <ul><li>The big change right now is E-business Which includes e-commerce and ERP </li></ul><ul><li>Business pro...
Release checklist <ul><li>Does the application operate without crashing, hanging or causing exceptions? </li></ul><ul><li>...
Methodologies of testing <ul><li>Glass box Testing </li></ul><ul><li>White box Testing </li></ul><ul><li>Structural Testin...
Methodologies <ul><li>Black box and functional testing </li></ul><ul><ul><li>Involves testing functionality of the applica...
Web application testing methodologies <ul><li>Performance  </li></ul><ul><li>Functional </li></ul><ul><li>reliability </li...
Rational Team test <ul><li>Suite of tools to automate the testing process </li></ul><ul><li>Provides tools for  </li></ul>...
Rational Team test <ul><li>Major tools in test suite: </li></ul><ul><ul><li>Rational Test Manager: Used to Manage all test...
Rational Team Test <ul><li>Rational Administrator: </li></ul><ul><ul><li>Used to create and manage rational projects </li>...
Rational Team Test <ul><li>Rational Quality Architect: </li></ul><ul><ul><li>Used to test middleware components built usin...
Rational Team Test <ul><li>Site Check </li></ul><ul><ul><li>Used to manage internet and intranet websites </li></ul></ul>
Installation and Setup guidelines <ul><li>Standard Install </li></ul><ul><li>Build and setup examples provided with team t...
Create Project
 
Project Artifacts
Create Test Data Store
Create Clearquest DB <ul><li>You can use any of the Database below </li></ul><ul><ul><li>Microsoft access </li></ul></ul><...
Contd..
Project status and details
Rational Test manager <ul><li>Once project has been created we are now ready to create test plans and test cases </li></ul...
Testing phases in RUP <ul><li>5 testing steps in RUP: </li></ul><ul><ul><li>Planning – involves Test Plans </li></ul></ul>...
Testing lifecycle
Test Manager
Create a Test Plan
Contd..
Create test case folder
Contd..
Configure Test case folder
Contd..
Create Test Case
Contd.
Contd..
Test cases <ul><li>For each Test case you can: </li></ul><ul><ul><li>Associate iteration </li></ul></ul><ul><ul><li>Associ...
Test Case properties
Execute tests <ul><li>You can execute test cases from Test Manager by selecting the “Run” option. </li></ul>
Contd.
Test manager <ul><li>Lots more you can do with Test Manager!! </li></ul><ul><li>Execute other Rational applications </li><...
Rational Robot <ul><li>Set of components for automating the testing of windows  client /server and internet applications <...
Rational Robot
Advanced Features <ul><li>Performance testing using “virtual test” agents deployed on several client machines </li></ul><u...
Rational Site Check <ul><li>Internet and intranet website testing </li></ul><ul><li>Checks for broken links, structure etc...
Demo
Contd..
Other Rational Tools <ul><li>Rational test Factory – used to automatically detect bugs  </li></ul><ul><li>Quality architec...
Current issues  <ul><li>In addition to reliability and functionality software has to be secure! </li></ul><ul><li>Various ...
Secure Programming Practices <ul><li>Building Secure software – Addison wesley </li></ul><ul><li>www.shmoo.com  – very goo...
Additional resources <ul><li>www.rational.com </li></ul><ul><li>Getting the most from your automated testing tool ( articl...
Did you know that: <ul><li>Software testing consultants cost! </li></ul><ul><ul><li>Junior level test engineer: $80 - $100...
Questions??
Upcoming SlideShare
Loading in...5
×

Software testing with Rational Teamtest

983

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
983
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
11
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "Software testing with Rational Teamtest"

  1. 1. Software testing with Rational Teamtest Ashish Soni Lecturer, ITP [email_address]
  2. 2. Outline <ul><li>Miscellaneous testing facts </li></ul><ul><li>What is software testing? </li></ul><ul><li>Why do we test? </li></ul><ul><li>What methods and tools are available to test applications </li></ul><ul><li>Demo </li></ul><ul><li>Future </li></ul><ul><li>Conclusion and questions </li></ul>
  3. 3. Interesting facts <ul><li>Recent studies show that : </li></ul><ul><ul><li>C++ : 25% more defects than C </li></ul></ul><ul><ul><li>A OO C++ defect takes 2-3 times as long to debug regardless of defect complexity </li></ul></ul><ul><ul><li>Inheritance engenders 6 times more defects </li></ul></ul><ul><ul><li>Java: multi-threading and inheritance: nearly impossible to write correctly and worse to test!! </li></ul></ul><ul><ul><li>No of lines of code in applications growing rapidly, e.g. Windows 3.1 – Windows XP </li></ul></ul>
  4. 4. What is software testing? <ul><li>Finding out If something works or not </li></ul><ul><li>Determine if overall objectives are being met </li></ul><ul><li>Testing involves operation of a system or application under controlled conditions and evaluating the results </li></ul>
  5. 5. Software Testing <ul><li>Testing is the feedback mechanism in the software development process. </li></ul><ul><li>It tells you where corrections need to be made to stay on course at any given iteration of a development effort. It also tells you the current quality of the system being developed </li></ul>
  6. 6. Why do we need to test? <ul><li>Real life examples: </li></ul><ul><ul><li>First US mission to Venus failed </li></ul></ul><ul><ul><ul><li>(Reason: missing comma in a FORTRAN do loop) </li></ul></ul></ul><ul><ul><li>Australia: Man jailed because of computer glitch. He was jailed for traffic fine although he had paid it 5 years ago </li></ul></ul><ul><ul><li>June 1996: Ariane-5 space rocket, self-destruction, $500 million. </li></ul></ul><ul><ul><li>(reason: reuse of software from Ariane-4 without recommended testing) </li></ul></ul>
  7. 7. Why testing? <ul><li>Software is never correct no matter what development technique is used </li></ul><ul><li>Any software must be verified </li></ul><ul><li>Important to control the quality of the product </li></ul><ul><li>Very expensive: </li></ul><ul><ul><li>In a lot of cases 50% of development costs </li></ul></ul>
  8. 8. Software quality <ul><li>Software quality can be measured across 4 dimensions </li></ul><ul><li>Reliability </li></ul><ul><li>Functionality </li></ul><ul><li>Application performance </li></ul><ul><li>System performance </li></ul>
  9. 9. Software development era <ul><li>Over the past decade software development has changed radically </li></ul><ul><li>Client server era – annual releases of new versions of products </li></ul><ul><li>We also knew how many users we had since all users were employees </li></ul><ul><li>If system went down it could be restored from backup or orders were taken manually </li></ul>
  10. 10. E-business <ul><li>The big change right now is E-business Which includes e-commerce and ERP </li></ul><ul><li>Business process automated using the web. </li></ul><ul><li>Users are customers and not Employees!! </li></ul><ul><li>We cant send a broadcast to users saying “don’t login for one hour until we reboot the system”  </li></ul><ul><li>Lost customers = Lost Revenue ~ bankruptcy </li></ul><ul><li>This makes testing very important. </li></ul>
  11. 11. Release checklist <ul><li>Does the application operate without crashing, hanging or causing exceptions? </li></ul><ul><li>Does it meet your business requirements? </li></ul><ul><li>Has it been tested thoroughly to meet the demands of your customers? </li></ul><ul><li>Can you track your progress against requirements, defects and other metrics? </li></ul><ul><li>Does everyone on the team have the same critical testing information? </li></ul>
  12. 12. Methodologies of testing <ul><li>Glass box Testing </li></ul><ul><li>White box Testing </li></ul><ul><li>Structural Testing </li></ul><ul><li>All three methodologies involve testing internal code structures, loops etc. </li></ul>
  13. 13. Methodologies <ul><li>Black box and functional testing </li></ul><ul><ul><li>Involves testing functionality of the application, interfaces etc. </li></ul></ul>
  14. 14. Web application testing methodologies <ul><li>Performance </li></ul><ul><li>Functional </li></ul><ul><li>reliability </li></ul>
  15. 15. Rational Team test <ul><li>Suite of tools to automate the testing process </li></ul><ul><li>Provides tools for </li></ul><ul><ul><li>Functional testing </li></ul></ul><ul><ul><li>Performance testing </li></ul></ul><ul><ul><li>Test case management </li></ul></ul><ul><ul><li>Defect Tracking and change requests </li></ul></ul>
  16. 16. Rational Team test <ul><li>Major tools in test suite: </li></ul><ul><ul><li>Rational Test Manager: Used to Manage all test activities: </li></ul></ul><ul><ul><ul><li>Planning </li></ul></ul></ul><ul><ul><ul><li>Design </li></ul></ul></ul><ul><ul><ul><li>Development </li></ul></ul></ul><ul><ul><ul><li>Execution </li></ul></ul></ul><ul><ul><ul><li>analysis </li></ul></ul></ul><ul><ul><li>Rational Robot: used to develop and execute functional tests for your windows and web applications </li></ul></ul>
  17. 17. Rational Team Test <ul><li>Rational Administrator: </li></ul><ul><ul><li>Used to create and manage rational projects </li></ul></ul><ul><li>Rational Clearquest: </li></ul><ul><ul><li>Used to track any kind of change activity associated with software development, these include enhancement requests, defect report etc. </li></ul></ul>
  18. 18. Rational Team Test <ul><li>Rational Quality Architect: </li></ul><ul><ul><li>Used to test middleware components built using EJB and com. </li></ul></ul><ul><ul><li>Virtual testing : scalability and workload , server response times </li></ul></ul><ul><ul><li>Functional and performance testing </li></ul></ul>
  19. 19. Rational Team Test <ul><li>Site Check </li></ul><ul><ul><li>Used to manage internet and intranet websites </li></ul></ul>
  20. 20. Installation and Setup guidelines <ul><li>Standard Install </li></ul><ul><li>Build and setup examples provided with team test </li></ul><ul><li>Create a Project in Rational Administrator and associate various artifacts with the project </li></ul>
  21. 21. Create Project
  22. 23. Project Artifacts
  23. 24. Create Test Data Store
  24. 25. Create Clearquest DB <ul><li>You can use any of the Database below </li></ul><ul><ul><li>Microsoft access </li></ul></ul><ul><ul><li>Microsoft SQL server </li></ul></ul><ul><ul><li>Oracle </li></ul></ul><ul><li>Choice of DB depends on number of users of application </li></ul><ul><li>Pre-requisite: the Database has to be created before it can be associated </li></ul>
  25. 26. Contd..
  26. 27. Project status and details
  27. 28. Rational Test manager <ul><li>Once project has been created we are now ready to create test plans and test cases </li></ul><ul><li>You can associate test plans and test cases with your requirements </li></ul>
  28. 29. Testing phases in RUP <ul><li>5 testing steps in RUP: </li></ul><ul><ul><li>Planning – involves Test Plans </li></ul></ul><ul><ul><li>Designing – involves Test cases </li></ul></ul><ul><ul><li>Implementing – involves scriptst </li></ul></ul><ul><ul><li>executing </li></ul></ul><ul><ul><li>evaluating </li></ul></ul>
  29. 30. Testing lifecycle
  30. 31. Test Manager
  31. 32. Create a Test Plan
  32. 33. Contd..
  33. 34. Create test case folder
  34. 35. Contd..
  35. 36. Configure Test case folder
  36. 37. Contd..
  37. 38. Create Test Case
  38. 39. Contd.
  39. 40. Contd..
  40. 41. Test cases <ul><li>For each Test case you can: </li></ul><ul><ul><li>Associate iteration </li></ul></ul><ul><ul><li>Associate configuration </li></ul></ul><ul><ul><li>Select manual or automated implementation </li></ul></ul><ul><ul><li>If automated then you can select appropriate test script </li></ul></ul><ul><ul><li>Specify pre and post conditions </li></ul></ul><ul><ul><li>Specify acceptance criteria </li></ul></ul>
  41. 42. Test Case properties
  42. 43. Execute tests <ul><li>You can execute test cases from Test Manager by selecting the “Run” option. </li></ul>
  43. 44. Contd.
  44. 45. Test manager <ul><li>Lots more you can do with Test Manager!! </li></ul><ul><li>Execute other Rational applications </li></ul><ul><li>Please read documentation on rational CD. </li></ul>
  45. 46. Rational Robot <ul><li>Set of components for automating the testing of windows client /server and internet applications </li></ul><ul><li>Can record and playback: </li></ul><ul><ul><li>GUI scripts: functional testing </li></ul></ul><ul><ul><li>VU scripts: performance testing </li></ul></ul><ul><li>Proprietary language used to write scripts </li></ul><ul><li>Can use java or visual basic to write custom scripts </li></ul>
  46. 47. Rational Robot
  47. 48. Advanced Features <ul><li>Performance testing using “virtual test” agents deployed on several client machines </li></ul><ul><li>Accepting test inputs from datapools : this requires knowledge of sqabasic language </li></ul><ul><li>Please refer to Rational documentation on CD for language details </li></ul>
  48. 49. Rational Site Check <ul><li>Internet and intranet website testing </li></ul><ul><li>Checks for broken links, structure etc </li></ul><ul><li>Can deploy website to target destination using Site check </li></ul>
  49. 50. Demo
  50. 51. Contd..
  51. 52. Other Rational Tools <ul><li>Rational test Factory – used to automatically detect bugs </li></ul><ul><li>Quality architect – EJB and COM testing </li></ul>
  52. 53. Current issues <ul><li>In addition to reliability and functionality software has to be secure! </li></ul><ul><li>Various hacks are made possible because of poor programming practices and inadequate testing (e.g buffer overflow) </li></ul><ul><li>Most hacked software : Microsoft IIS  </li></ul><ul><li>Shorter deadlines </li></ul><ul><li>Bug fixes open up new weaknesses in software </li></ul>
  53. 54. Secure Programming Practices <ul><li>Building Secure software – Addison wesley </li></ul><ul><li>www.shmoo.com – very good secure programming guidelines </li></ul>
  54. 55. Additional resources <ul><li>www.rational.com </li></ul><ul><li>Getting the most from your automated testing tool ( article rational edge magazine) </li></ul><ul><li>Automated Testing – silver bullet? ( article rational edge magazine) </li></ul>
  55. 56. Did you know that: <ul><li>Software testing consultants cost! </li></ul><ul><ul><li>Junior level test engineer: $80 - $100 (1-2 yrs of experience) </li></ul></ul><ul><ul><li>Medium level test engineer - $100 - $150/ hr </li></ul></ul><ul><ul><li>Senior level test engineer : $150- $300/hour </li></ul></ul><ul><li>If testing for security these figures go even higher </li></ul>
  56. 57. Questions??
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×