Your SlideShare is downloading. ×
Mercury SOA Testing: Products Overview and Demo
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Introducing the official SlideShare app

Stunning, full-screen experience for iPhone and Android

Text the download link to your phone

Standard text messaging rates apply

Mercury SOA Testing: Products Overview and Demo

982
views

Published on


0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
982
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
31
Comments
0
Likes
2
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Mercury SOA Testing: Products Overview and Demo James Eich, Senior Systems Engineer
  • 2. Agenda Testing challenges with SOA Mercury SOA testing solution Functionality walkthrough Summary Confidential & Proprietary 2
  • 3. Mercury Addresses Key Challenges • Provide complete visibility for discovering and understanding services SOA • Ensure predictability and transparency between consumers and providers Governance • Control the lifecycle of services and effectively manage change • Validate functional quality SOA • Optimize performance and ensure services will scale in production Testing • Manage the complexity of testing multiple services and provide traceability and impact analysis • Increase visibility into service levels and business impact of outages SOA • Improve problem detection, notification and mean time to repair Management • Control the risk of changes in web services, SOA components and underlying infrastructure Confidential & Proprietary 3
  • 4. Increased Complexity Small Number of Services Increases the SOA Testing Complexity 1 6 2 7 1 6 1 6 Operation 1 6 2 7 Operation 2 7 1 6 Operation 6 1 6 2 7 3 8 Operation 1 6 3 8 2 7 Operation 8 2 7 1 6 4 9 3 8 6 Operation 8 2 7 Operation 3 8 1 6 3 8 5 10 4 9 1 6 4 9 Operation 4 Operation 1 6 3 8 2 7 2 7 4 2 7 3 8 5 4 69 Operation 8 10 2 7 4 9 3 8 3 8 4 9 5 10 Operation 4 9 5 10 2 1 6 3 8 5 10 4 9 1 6 5 10 1 6 2 3 8 5 10 Operation4 2 7 4 9 2 7 1 4 6 9 1 2 6 7 Service Operation Operation 3 8 4 5 9 10 5 10 2 5 7 10 3 8 Service Operation Operation 2 5 7 10 3 8 2 5 5 10 1 4 6 9 1 6 1 2 6 7 1 6 3 1 8 6 4 9 8 1 10 3 1 8 6 Service Operation 4 9 Operation Operation Operation 2 5 7 10 2 7 1 6 2 7 4 2 9 7 5 10 Operation 4 2 9 7 10 Operation 6 3 1 8 6 3 8 3 8 5 3 10 8 1 6 5 3 10 8 2 5 1 10 1 6 Operation 8 1 2 6 7 3 1 Operation 6 4 2 9 7 4 9 1 6 2 7 4 9 3 8 4 9 1 6 2 7 3 Operation 4 Operation 9 1 6 Operation 2 7 4 1 6 Operation 9 2 7 5 3 10 5 10 1 6 2 7 3 8 5 10 4 9 5 10 2 7 1 6 3 8 Operation 9 Operation 6 2 7 3 3 8 Operation 3 8 8 4 9 5 10 3 8 4 9 1 6 5 10 Operation 8 3 8 1 6 Operation 2 2 7 4 9 5 Operation 3 8 4 9 1 6 2 7 3 8 5 10 4 9 2 7 2 7 1 6 5 Operation 2 7 4 9 Operation 9 1 6 3 8 4 9 Operation 2 7 3 8 1 4 6 9 1 6 3 8 5 10 4 Operation 4 9 5 10 2 Operation 7 5 10 7 Operation 5 10 3 8 1 6 2 7 5 10 1 6 3 8 2 7 7 5 10 3 4 8 9 Service Operation Operation 5 3 8 4 5 9 5 10 6 Operation 8 4 9 2 7 4 5 9 2 3 1 5 7 8 6 10 3 8 4 5 9 10 2 7 4 9 3 8 2 5 10 10 7 1 4 1 6 9 10 10 1 6 4 5 10 3 8 10 4 2 9 4 9 1 2 6 7 3 8 5 10 4 9 Service Operation Operation 2 Operation 5 7 10 2 7 Operation 4 5 9 10 5 3 10 8 7 5 10 1 6 3 8 4 5 9 10 5 10 3 8 2 What will happen when changes are introduced? 3 3 1 8 6 1 6 1 1 10 4 2 9 Operation 4 9 4 9 1 6 2 7 1 4 6 9 2 7 Operation Operation 9 7 Service 5 10 Operation Operation 5 10 2 7 1 6 3 18 6 2 5 7 10 10 services x be the number of test10 test data points What will 10 web operations x permutations? 5 3 10 1 6 3 8 8 3 8 1 6 3 1 8 6 29 3 5 Operation 7 Operation 1 6 2 7 1 10 2 7 4 7 Operation 4 9 1 6 4 9 4 9 2 7 4 2 9 Operation 9 7 2 Operation 6 7 3 Operation 8 3 8 2 7 5 10 3 8 7 5 10 Operation 8 5 10 1 6 5 10 3 8 5 3 10 1 6 1 6 4 9 8 4 9 3 8 5 Operation 2 1 6 2 7 4 9 3 Operation 1 6 1 6 3 8 5 10 4 9 1 6 1 6 2 7 Operation 7 Operation 4 Operation 4 9 5 10 2 7 1 6 2 7 5 10 4 9 2 7 How will1,000 test permutations test? = the users know what to Operation 9 1 6 3 8 4 9 2 7 31 86 Operation 6 7 3 8 2 7 Operation 5 10 Operation 1 6 3 8 2 7 3 8 5 5 10 5 10 31 86 1 6 42 97 5 Operation 2 10 Operation 8 6 7 4 9 63 Operation 8 8 2 4 9 Operation 6 2 7 4 9 3 8 1 4 6 9 1 6 42 97 2 3 7 8 4 1 3 8 5 10 4 9 Operation 5 10 Operation 8 1 6 3 8 2 7 2 7 1 6 3 4 8 9 5 3 10 8 Operation 2 7 4 9 4 5 Service 10 Operation 4 7 2 7 5 10 4 9 5 10 5 3 10 8 5 10 4 9 3 8 Operation 10 Operation 4 9 5 10 31 8 6 3 8 2 7 4 9 4 9 2 5 10 1 6 3 1 3 8 5 10 4 9 5 10 5 10 1 4 6 9 2 2 7 Operation 21 4 6 9 1 6 42 9 7 5 10 1 3 6 8 5 10 1 6 Service Operation Operation 2 5 7 10 Operation 2 7 2 7 5 3 10 8 1 6 4 9 31 Service 8 6 Operation 3 8 3 Service Operation Operation Operation 5 10 1 6 2 7 2 5 7 10 2 7 4 1 10 10 3 1 8 6 3 8 4 9 2 3 8 Operation 42 9 6 7 64 9 Operation 9 9 1 4 2 10 9 7 4 9 5 10 7 1 6 3 8 3 1 8 6 4 9 5 3 10 8 Operation 5 10 1 6 5 Operation Operation 5 3 10 5 10 1 6 3 8 2 7 4 9 4 2 9 7 5 10 3 Operation 4 9 1 6 3 2 7 8 1 6 4 9 3 8 5 10 5 3 10 8 1 6 Operation 9 5 2 7 1 6 Operation 3 8 7 3 4 9 Operation 2 7 2 7 5 10 4 9 4 9 1 6 2 7 10 3 8 Operation 9 4 9 Operation 9 5 10 1 6 3 8 5 10 2 7 1 6 3 8 5 Operation 4 9 2 7 5 Operation 3 8 2 7 4 9 5 10 3 8 4 9 3 8 5 10 5 Operation 4 9 5 10 2 7 7 5 10 4 9 7 5 10 3 8 4 9 3 8 5 10 5 10 7 4 9 5 10 4 9 5 10 5 10 Confidential & Proprietary 4
  • 5. SOA Quality Challenges SOA Quality Management Huge amount of services and systems Test services stand-alone and as shared entities Initial and regression testing Structure of quality process Visibility into progress and quality status SOA Ecosystem Integration SOA Testing SOA governance systems – Service assets Holistic coverage of all service aspects – Change GUI-less testing – Policy management Complex service orchestrations SOA runtime and execution engines Multiple transports and protocols support – Toolkits – Application servers and ESBs Testing incomplete environments Diagnostics and monitors Constantly emerging technologies Confidential & Proprietary 5
  • 6. Mercury’s SOA Testing Solution SOA Quality Management Service Test Management module for QC System description (architecture, topology, business processes & data) SOA SOA aspects to test and methodology Requirements coverage and traceability SOA metadata Manage application change lifecycle management Integrate with Mercury Dashboard SOA Ecosystem Integration SOA Ecosystem Integration Mercury Service Test / LoadRunner SOA Testing Connectivity to UDDI v2-3 and Integration with Quality Center Systinet’s registries/repositories Multiple testing aspects in a single tool: Certification and connectivity with Runtime – Functional (positive and negative/boundary) leading Application Servers and ESBs information – Load and performance – Interoperability Mercury monitoring and diagnostics – Standards compliance – Security Mercury Business Availability Center support for SOA SOAP, JMS and many other protocols support True Java (Axis) and .NET toolkits usage Async testing and WS-Addressing support Client and server-side recording Service emulation Confidential & Proprietary 6
  • 7. Mercury’s Integrated SOA Testing Systinet SOA Governance 1 0 1 0 FINANCE APPLICATION 1 1 0 Web 0 1 Services Quality Center QuickTest Pro with 2 Test Management with 5 UI UI API Service Test Web Svcs Add-in Management Web Services LoadRunner Component LEGACY C/S ERP/CRM WEB ServiceTest Enterprise Services SOA Shared 4 Services SOA Abstraction Layer LoadRunner ServiceTest Web RMI API Legacy Web 3 API Services EIS Custom App API Mainframe Services Third Logic party LoadRunner Confidential & Proprietary 7
  • 8. Functionality Walkthrough
  • 9. Mercury Service Test™ (page I) Single tool for all SOA testing needs – Functional testing – Load testing Foundations – SOAP over HTTP and JMS transports – Extensive coverage - True Java (Axis) and .NET toolkit usage/support - Web, databases and legacy systems protocols - Microsoft, IBM, SAP, Oracle and other platforms certifications – Web service call configuration - Web services security (HTTPS, XML Digital Signature, XML-Encryption, X.509, Kerberos, SAML) - Attachments (MIME, DIME) – Request/response views Fully integrated with VUGen and Mercury LoadRunner® Confidential & Proprietary 9
  • 10. Service Test Foundations Confidential & Proprietary 10
  • 11. Service Test Foundations Confidential & Proprietary 11
  • 12. Mercury Service Test (page II) Services management Tests generation wizard – Positive testing – Boundary testing – Standards compliance testing – Interoperability testing – Security/penetration testing XML checkpoints Tests pass/fail reports XML parameterization Fully integrated with VUGen and Mercury LoadRunner Confidential & Proprietary 12
  • 13. Service Test Services Management Confidential & Proprietary 13
  • 14. Service Test Tests Generation Wizard Confidential & Proprietary 14
  • 15. Service Test XML Checkpoints Confidential & Proprietary 15
  • 16. Service Test Pass/Fail Reports Confidential & Proprietary 16
  • 17. Service Test XML Parameterization Confidential & Proprietary 17
  • 18. Mercury Service Test (page III) Integration with Mercury Quality Center – Script repository – Service sharing – Test execution – Test results viewing – Configurable runtime settings and data for each run Script conversion QuickTest Professional Mercury Service Test Fully integrated with VUGen and Mercury LoadRunner Confidential & Proprietary 18
  • 19. Service Test Service Test Quality Center Integration Confidential & Proprietary 19
  • 20. Mercury Service Test (page IV) Advanced standards compliance testing – Run WS-I compliance reports – Analysis of WSDLs, XMLs and SOAP messages General purpose asynchronous testing platform – WS-Addressing support Client and server-side recording Fully integrated with VUGen and Mercury LoadRunner Confidential & Proprietary 20
  • 21. Service Test Advanced Standards Compliance Testing Confidential & Proprietary 21
  • 22. Service Test Advanced Standards Compliance Testing Confidential & Proprietary 22
  • 23. Service Test Client and Server-Side Recording Confidential & Proprietary 23
  • 24. Service Test Client and Server-Side Recording Confidential & Proprietary 24
  • 25. Mercury Service Test (page V) Service emulation – Provides - Early time to test - QA incomplete environments - Isolate problems – Automatic creation and hosting of web service stubs - Based on WSDLs - Based on recorded web service traffic – Define default output and response times – Rule-based model to match service inputs outputs Fully integrated with VUGen and LoadRunner Confidential & Proprietary 25
  • 26. Service Test Service Emulation Confidential & Proprietary 26
  • 27. Service Test Service Emulation Confidential & Proprietary 27
  • 28. Service Test Service Emulation Confidential & Proprietary 28
  • 29. Mercury Service Test Management™ A complete SOA test management solution built on top of Mercury Quality Center’s proven foundations Mercury Quality Center™ Dashboard TestDirector Requirements Defect Optional Extensions Test Plan Test Lab Management Management SAP, SOA Functional Testing Business Process Testing QuickTest WinRunner Accelerators for SAP, Oracle, Security Professional Foundation Shared Data Repository Central Administration Workflows Open APIs Delivery Options Mercury Managed Services Combination In-house Deployment Confidential & Proprietary 29
  • 30. Service Test Management Foundations Confidential & Proprietary 30
  • 31. Mercury Service Test Management (page II) SOA environment visibility – Define services - Existing services import - Connectivity with UDDI and Systinet registries/repositories - Manual services definition – Service detail views - Ownerships - Description - Technical data including operations Fully integrated with Mercury Quality Center Confidential & Proprietary 31
  • 32. Service Test Management SOA Environment Visibility Confidential & Proprietary 32
  • 33. Service Test Management Define Services Confidential & Proprietary 33
  • 34. Service Test Management Service Detail Views Confidential & Proprietary 34
  • 35. Mercury Service Test Management (page III) Group services in various ways Link services and service groups – Requirements – Defects – Tests Fully integrated with Mercury Quality Center Confidential & Proprietary 35
  • 36. Service Test Management Group Services in Various Ways Confidential & Proprietary 36
  • 37. Service Test Management Link Services and Service Groups Confidential & Proprietary 37
  • 38. Mercury Service Test Management (page IV) Testing methodology environment requirements testing assets coverage Change impact testing – Automatic update for services change – Modification of requirements based on changes – Create updated test assets to validate services change Integration with Service Test Reports and dashboard integration Fully integrated with Quality Center Confidential & Proprietary 38
  • 39. Service Test Management Testing Methodology Confidential & Proprietary 39
  • 40. Service Test Management Change Impact Testing Confidential & Proprietary 40
  • 41. Mercury LoadRunner for SOA Testing
  • 42. Performance Testing Monitors (Lifecycle) SiteScope Web Service SiteScope SOA capabilities: Monitor State Values A) Web services monitor OK – Builds a synthetic web service from the actual WSDL file used by the web service unknown host name – The synthetic web service initiates an SOAP unable to reach server request and monitors the response unable to connect to – Supports web service providers that use server Basic, Digest and NTLM authentication – Measures availability, response time and timed out reading these states content match error document moved B) Web services infrastructure monitors unauthorized – App servers: WebLogic, WebSphere, Oracle – MOM: MQ Series forbidden – Enterprise apps: Siebel, SAP not found proxy authentication required server error not implemented server busy Confidential & Proprietary 42
  • 43. Web Services Diagnostics Dashboard Confidential & Proprietary 43
  • 44. Mercury QuickTest Professional for Web Services Testing
  • 45. Mercury QuickTest Professional Web Services Testing Combine UI and WS testing : – WS check point WSDL import XML checkpoint Web services over HTTP Confidential & Proprietary 45
  • 46. Summary 1. SOA quality is more than just testing the service ! 2. Mercury has the only comprehensive solution in the market that will: – Test the service with Mercury Service Test and LoadRunner – Manage SOA testing quality with Mercury Service Test Management – Integrate with the SOA ecosystem with Mercury SOA lifecycle 3. SOA testing solutions are based on the Mercury products leveraging existing assets and knowledge Confidential & Proprietary 46