Addressing the Challenges of Testing SOA based Applications Neil Pandit  19 th  March 2008
Agenda <ul><li>What is SOA? </li></ul><ul><li>An Example SOA Implementation - On-Line Loan System </li></ul><ul><li>Busine...
What is SOA? <ul><li>SOA is an Architectural style </li></ul><ul><ul><li>Modular </li></ul></ul><ul><ul><li>Shareable </li...
An Example SOA Implementation – On-Line Loan System Customer User Business Process Customer  DB Web Services 3 rd  party C...
Business Risks and Benefits <ul><li>Risks  </li></ul><ul><ul><li>Increased costs </li></ul></ul><ul><ul><li>Early joiner –...
Main Challenges <ul><li>Scope and boundaries </li></ul><ul><li>Changes to composition of test team </li></ul><ul><li>Incre...
Addressing the Challenges - SOA Test Strategy <ul><li>Test Design should follow a Top down Approach  </li></ul><ul><li>Tes...
Test Organisation
Functional and Regression Testing <ul><li>Approach </li></ul><ul><ul><li>Need for more concentration on negative testing <...
Performance <ul><li>Approach </li></ul><ul><ul><li>Service must be fully performance tested </li></ul></ul><ul><ul><li>Vol...
Security <ul><li>Approach </li></ul><ul><ul><li>Testing at the service level and not at the final stage </li></ul></ul><ul...
Integration Testing <ul><li>Approach </li></ul><ul><ul><li>The need for an Integration Test Strategy </li></ul></ul><ul><u...
Interoperability <ul><li>Approach </li></ul><ul><ul><li>Services need to adhere to WS-I (Web Services Interoperability)  <...
Summary <ul><li>SOA is here to stay </li></ul><ul><li>Risks and Benefits must be understood </li></ul><ul><li>SOA will cha...
 
Upcoming SlideShare
Loading in …5
×

Addressing The Challenges Of Testing Soa Based Applications From AppLabs

1,760 views

Published on

Published in: Technology
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,760
On SlideShare
0
From Embeds
0
Number of Embeds
15
Actions
Shares
0
Downloads
180
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide
  • Addressing The Challenges Of Testing Soa Based Applications From AppLabs

    1. 2. Addressing the Challenges of Testing SOA based Applications Neil Pandit 19 th March 2008
    2. 3. Agenda <ul><li>What is SOA? </li></ul><ul><li>An Example SOA Implementation - On-Line Loan System </li></ul><ul><li>Business Risks and Benefits </li></ul><ul><li>Main Challenges </li></ul><ul><li>Addressing the Challenges - SOA Test Strategy </li></ul><ul><li>Test Organisation Changes </li></ul><ul><li>Approach by Testing Types and Relevant Tools </li></ul><ul><li>Summary </li></ul>
    3. 4. What is SOA? <ul><li>SOA is an Architectural style </li></ul><ul><ul><li>Modular </li></ul></ul><ul><ul><li>Shareable </li></ul></ul><ul><ul><li>Distributable </li></ul></ul><ul><ul><li>Defined interfaces </li></ul></ul><ul><li>It is about the design of the business </li></ul><ul><li>Focus on Business Processes / Business Driven </li></ul><ul><li>It is more than Web services! </li></ul>
    4. 5. An Example SOA Implementation – On-Line Loan System Customer User Business Process Customer DB Web Services 3 rd party Credit Check Financial Adviser Login Credit check loan quote Quotes Customer Validation loan quote Credit check Mainframe Legacy / 3 rd Party Internet Internet
    5. 6. Business Risks and Benefits <ul><li>Risks </li></ul><ul><ul><li>Increased costs </li></ul></ul><ul><ul><li>Early joiner – when there is little knowledge </li></ul></ul><ul><ul><li>No business commitment and resource available </li></ul></ul><ul><ul><li>No overall picture of business processes and ability to prioritise </li></ul></ul><ul><ul><li>Quality – single point of failure </li></ul></ul><ul><ul><li>The industry decides that the future isn’t SOA after all! </li></ul></ul><ul><li>Benefits </li></ul><ul><ul><li>Reuse of code </li></ul></ul><ul><ul><li>Reduced IT spend </li></ul></ul><ul><ul><li>Faster time to market </li></ul></ul>
    6. 7. Main Challenges <ul><li>Scope and boundaries </li></ul><ul><li>Changes to composition of test team </li></ul><ul><li>Increased knowledge required of testers </li></ul><ul><ul><li>Technical knowledge (WSDL) </li></ul></ul><ul><ul><li>Domain knowledge </li></ul></ul><ul><ul><li>Use of Tools </li></ul></ul><ul><li>Governance and the need for standards </li></ul><ul><li>Increased focus on negative and non-functional testing </li></ul>
    7. 8. Addressing the Challenges - SOA Test Strategy <ul><li>Test Design should follow a Top down Approach </li></ul><ul><li>Test Execution should follow a Bottom up Approach starting at the individual service level. </li></ul><ul><li>Current testing methodologies should be extended to support the use of services in an SOA solution. </li></ul>
    8. 9. Test Organisation
    9. 10. Functional and Regression Testing <ul><li>Approach </li></ul><ul><ul><li>Need for more concentration on negative testing </li></ul></ul><ul><ul><li>Impact on regression testing </li></ul></ul><ul><ul><li>Backward compatibility testing </li></ul></ul><ul><ul><li>Service quality becomes more important as reuse will require a level of quality to be achieved </li></ul></ul><ul><li>Tools </li></ul><ul><ul><li>Parasoft SOAtest </li></ul></ul><ul><ul><li>QTP </li></ul></ul><ul><ul><li>Green Hat GH Tester </li></ul></ul><ul><ul><li>Borland SilkPerformer SOA </li></ul></ul>
    10. 11. Performance <ul><li>Approach </li></ul><ul><ul><li>Service must be fully performance tested </li></ul></ul><ul><ul><li>Volume </li></ul></ul><ul><ul><li>Stress </li></ul></ul><ul><ul><li>Load </li></ul></ul><ul><ul><li>Targeted infrastructure tests </li></ul></ul><ul><li>Tools </li></ul><ul><ul><li>Loadrunner 9.1 </li></ul></ul><ul><ul><li>Parasoft SOAtest </li></ul></ul><ul><ul><li>Green Hat GH Tester </li></ul></ul><ul><ul><li>Borland SilkPerformer SOA </li></ul></ul>
    11. 12. Security <ul><li>Approach </li></ul><ul><ul><li>Testing at the service level and not at the final stage </li></ul></ul><ul><ul><li>Performing a security risk assessment </li></ul></ul><ul><ul><li>No assumptions about 3 rd party development </li></ul></ul><ul><ul><li>Penetration tests </li></ul></ul><ul><ul><li>Need to ensure data security is handled appropriately as per industry regulations </li></ul></ul><ul><ul><li>Testing of changes to Security Policies </li></ul></ul><ul><li>Tools </li></ul><ul><ul><li>Vordel Soapbox </li></ul></ul><ul><ul><li>Parasoft SOAtest </li></ul></ul><ul><ul><li>AppScan </li></ul></ul>
    12. 13. Integration Testing <ul><li>Approach </li></ul><ul><ul><li>The need for an Integration Test Strategy </li></ul></ul><ul><ul><li>Validate Functioning of Interfaces and Data Sharing between Services </li></ul></ul><ul><ul><li>Creation of WSDL Definitions and testing against these </li></ul></ul><ul><ul><li>Use of Regression Tests </li></ul></ul><ul><li>Tools </li></ul><ul><ul><li>Parasoft SOAtest </li></ul></ul><ul><ul><li>Green Hat GH Tester </li></ul></ul><ul><ul><li>Borland SilkPerformer SOA </li></ul></ul><ul><ul><li>QTP </li></ul></ul>
    13. 14. Interoperability <ul><li>Approach </li></ul><ul><ul><li>Services need to adhere to WS-I (Web Services Interoperability) </li></ul></ul><ul><ul><li>WS-I Basic Profile and Security Profile </li></ul></ul><ul><ul><li>WS-I site http://www.ws-i.org/ </li></ul></ul><ul><ul><li>Ensure that Governance supports adherence to standards </li></ul></ul><ul><li>Tools </li></ul><ul><ul><li>Parasoft SOAtest </li></ul></ul><ul><ul><li>Borland SilkPerformer SOA </li></ul></ul>
    14. 15. Summary <ul><li>SOA is here to stay </li></ul><ul><li>Risks and Benefits must be understood </li></ul><ul><li>SOA will change the organisational testing methodology </li></ul><ul><li>Testers’ skills will need to change </li></ul><ul><li>Change in testing approach - Non-Functional Testing, Interoperability </li></ul><ul><li>Increased development and use of tools </li></ul><ul><li>Questions? </li></ul><ul><ul><li>Email [email_address] </li></ul></ul>

    ×