Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Exactpro Test Tools EXTENT Feb 2011


Published on

EXTENT February 2011
Exactpro Systems LLC
Maxim Rudovsky

Published in: Technology
  • Login to see the comments

  • Be the first to like this

Exactpro Test Tools EXTENT Feb 2011

  1. 1. Exactpro Test Tools Maxim Rudovsky EXTENT February 2011
  2. 2. Contents <ul><li>This presentation provides information about Exactpro Systems Testing Tools: </li></ul><ul><li>High-level presentation of all testing tools </li></ul><ul><li>Sailfish </li></ul><ul><li>Load Injector </li></ul><ul><li>Certification Testing tool </li></ul>
  3. 3. 1. Testing Tools: High Level View Sailfish Load Injector Reconciliation Tool <ul><li>Multiprotocols and transports: </li></ul><ul><ul><li>FIX </li></ul></ul><ul><ul><li>NATIVE </li></ul></ul><ul><ul><li>MITCH </li></ul></ul><ul><ul><li>QH </li></ul></ul><ul><li>Multiprotocols and transports: </li></ul><ul><ul><li>FIX </li></ul></ul><ul><ul><li>NATIVE </li></ul></ul><ul><ul><li>MITCH </li></ul></ul><ul><ul><li>QH </li></ul></ul><ul><li>Multiprotocols: </li></ul><ul><ul><li>FIX </li></ul></ul><ul><ul><li>NATIVE </li></ul></ul><ul><ul><li>MITCH </li></ul></ul><ul><ul><li>FAST </li></ul></ul><ul><li>Multilayers: </li></ul><ul><ul><li>Session Layer </li></ul></ul><ul><ul><li>Application Layer </li></ul></ul><ul><ul><li>Dirty Level </li></ul></ul>Simulation of multiple client connections with a specified load shape for each connection or a group of connections Rich GUI for client activity tracking Multiuser access to a testing environment Throughput up to 80,000 msg per second Storing client activity to DB for further analysis and report generation Automative Matrix Language (AML) Multiplatform Real-time analysis of client interactions with Exchange gateways Test Report Generator Performance Reports Generator
  4. 4. 2. Sailfish Components and Concepts
  5. 5. 3. Sailfish Deployment
  6. 6. 4. Steps to Automate a Test Case <ul><li>Create and configure a particular service. Make sure it works properly. </li></ul><ul><li>Make sure there are all required actions for implementing a test case (send message, receive message, execute request, etc.) </li></ul><ul><li>Create a csv. matrix with a particular number of actions and specify required action parameters. </li></ul><ul><li>Execute a test case and check the generated report for faults and errors. </li></ul>
  7. 7. 7. Sailfish Configuration Service Page
  8. 8. 8. Sailfish Test Script Execution Page
  9. 9. 9. Sailfish Test Report
  10. 10. 5. Best Practice for Test Case Automation <ul><li>Like all programming languages, AML has a number of rules which allow avoiding several drawbacks and frustrations: </li></ul><ul><li>Create independent test cases; </li></ul><ul><li>Check a number of messages at the end of each test case to make sure there are no redundant messages received; </li></ul><ul><li>Check the order of received messages; </li></ul><ul><li>Specify enough pauses between test cases to make sure there are no redundant messages received after a test case has been completed. </li></ul>
  11. 11. 6. Sailfish Future Improvements <ul><li>Add ability for several users to run a test script simultaneously </li></ul><ul><li>Improve GUI of a test script and message pages </li></ul><ul><li>Add interactivity in a test script running phase </li></ul><ul><li>Separate WEB GUI from that part of the server </li></ul><ul><li>Improve test report generator </li></ul><ul><li>Improve the functionality to store messages to DB </li></ul>
  12. 12. 7. Load Injector Components & Configuration <ul><li>Configure a number of connections </li></ul><ul><li>Configure template messages </li></ul><ul><li>Configure Load Shape for each connection or a group of connections </li></ul><ul><li>Configure messages distribution for each connection or a group of connections </li></ul>
  13. 13. 8. Performance Calculator <ul><li>Multiprotocols </li></ul><ul><li>Processing large dump files (up to the size of HDD) </li></ul><ul><li>Easily configurable (adding new filters, new protocols, new metric calculation) </li></ul><ul><li>Report Generator using templates </li></ul>Protocols KPI Filters FIX Throughput Per Client Native Bandwidth Per Instrument MITCH Latency Per Order type Deviation Per Message Type Hardware KPI
  14. 14. 8. Performance Calculator (continued)
  15. 15. 9. Load Injector - Future Improvements <ul><li>Message distribution configuration for each load shape step </li></ul><ul><li>Template messages GUI editor </li></ul><ul><li>Add expressions to template messages </li></ul><ul><li>Add event-driven configuration </li></ul><ul><ul><ul><li>onConnect event </li></ul></ul></ul><ul><ul><ul><li>onDisconnect event </li></ul></ul></ul><ul><ul><ul><li>onTime event </li></ul></ul></ul>
  16. 16. <ul><li>Thank you. </li></ul>10. Questions & Answers