QualiSystems Proprietary & Confidential<br />1<br />Standards of Excellence<br />Test Automation<br />and <br />Network Re...
QualiSystems Proprietary & Confidential<br />2<br />Purpose<br />Discuss Resource Management<br />Over Test Automation<br ...
QualiSystems Proprietary & Confidential<br />3<br />Agenda<br />Background<br />Test Resources (definition and examples)<b...
QualiSystems Proprietary & Confidential<br />4<br />Background<br />QualiSystems provide an “end to end Test Automation pl...
QualiSystems Proprietary & Confidential<br />5<br />Background<br />Wide Variety of Customers<br />Chip & FlashManufacture...
QualiSystems Proprietary & Confidential<br />6<br />Background<br />We’ve found similar challenges throughout different te...
QualiSystems Proprietary & Confidential<br />7<br />Definitions: Resource Types<br />Physical Resources – Represents real ...
QualiSystems Proprietary & Confidential<br />8<br />Definitions: Resource Categories<br />Local Resources – Specific to a ...
QualiSystems Proprietary & Confidential<br />9<br />Test Scenario Example - Description<br />Device Under Test<br />Cisco ...
QualiSystems Proprietary & Confidential<br />10<br />Test Scenario Example – Required Topology<br />Device Under Test<br /...
QualiSystems Proprietary & Confidential<br />11<br />Test Scenario - Common Operation<br />Start<br /> Setup Topology<br /...
QualiSystems Proprietary & Confidential<br />12<br />Test Scenario - Common Operation<br />Start<br />Cabling the topology...
QualiSystems Proprietary & Confidential<br />13<br />Test Scenario - Common Operation<br />Start<br />Telnet, Router Appli...
QualiSystems Proprietary & Confidential<br />14<br />Test Scenario - Common Operation<br />Start<br />Traffic Control Soft...
QualiSystems Proprietary & Confidential<br />15<br />Test Scenario - Common Operation<br />Start<br />Traffic Control Soft...
QualiSystems Proprietary & Confidential<br />16<br />Test Scenario - Common Operation<br />Start<br />Vendor Software<br /...
QualiSystems Proprietary & Confidential<br />17<br />Test Scenario - Common Operation<br />Start<br />Log Files<br />Excel...
QualiSystems Proprietary & Confidential<br />18<br />Test Scenario – In Automation<br />Automated Test Script Starting<br ...
QualiSystems Proprietary & Confidential<br />19<br />Test Scenario – In Automation<br />Start<br /> Setup Topology<br /> C...
QualiSystems Proprietary & Confidential<br />20<br />Manual Cabling<br />
QualiSystems Proprietary & Confidential<br />21<br />Manual Cabling<br />Challenge<br />Change connections<br />Solution<b...
22<br />Growing into large scales<br />Challenge<br />Test Equipment Farms<br />Layer 1 Switch Clusters<br />Multiple labs...
QualiSystems Proprietary & Confidential<br />23<br />Sharing Resources in Team Development<br />Challenge<br />Conflicts o...
QualiSystems Proprietary & Confidential<br />24<br />Coordinated Execution<br />Resources<br />Challenge<br />Central laun...
QualiSystems Proprietary & Confidential<br />25<br />Abstract Topologies & Resources<br />Challenge<br />“I Need an Ixia x...
QualiSystems Proprietary & Confidential<br />26<br />Summary<br />Resources need to be well defined<br />Structure<br />Ca...
QualiSystems Proprietary & Confidential<br />27<br />Thank you<br />Visit our website:www.qualisystems.com<br />
Upcoming SlideShare
Loading in …5
×

Qa Test Automationand Network Resource Management

991 views

Published on

Qa Test Automationand Network Resource Management

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
991
On SlideShare
0
From Embeds
0
Number of Embeds
4
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Qa Test Automationand Network Resource Management

  1. 1. QualiSystems Proprietary & Confidential<br />1<br />Standards of Excellence<br />Test Automation<br />and <br />Network Resource Management<br />Eitan Lavie, Technology Director<br />January 12, 2010<br />
  2. 2. QualiSystems Proprietary & Confidential<br />2<br />Purpose<br />Discuss Resource Management<br />Over Test Automation<br />Growing Teams<br />Distributed Environments<br />
  3. 3. QualiSystems Proprietary & Confidential<br />3<br />Agenda<br />Background<br />Test Resources (definition and examples)<br />Challenge & Solution via Example<br />Test Scenario<br />Common Testing Operations<br />Manual cabling actions, increasing availability<br />Large Scale Labs<br />Team Development<br />Coordinating Automated Execution<br />Abstract Resources & Topologies<br />Summary<br />
  4. 4. QualiSystems Proprietary & Confidential<br />4<br />Background<br />QualiSystems provide an “end to end Test Automation platform”for Device, System and Embedded products.<br />
  5. 5. QualiSystems Proprietary & Confidential<br />5<br />Background<br />Wide Variety of Customers<br />Chip & FlashManufacturers<br />Network EquipmentManufacturers (NEMs)<br />Service Providers(SPs)<br />Aerospace<br />
  6. 6. QualiSystems Proprietary & Confidential<br />6<br />Background<br />We’ve found similar challenges throughout different testing environments as long as…<br />Test equipment cost is high<br />Test equipment can be shareable<br />Switching connections exists<br /> Multiple users<br /> Multiple execution stations<br />
  7. 7. QualiSystems Proprietary & Confidential<br />7<br />Definitions: Resource Types<br />Physical Resources – Represents real equipment<br />Traffic Generator ports<br />Device Under Test<br />Video Frame Grabber<br />Logical Resources – Represent managed functionality<br />Switch Node QoS<br />Software License<br />
  8. 8. QualiSystems Proprietary & Confidential<br />8<br />Definitions: Resource Categories<br />Local Resources – Specific to a single station<br />Oscilloscope<br />Installed Application<br />Flash Card Extender<br />Networked Resources – Available and shared between stations<br />Traffic Generators<br />Shared File System (Server)<br />Layer 1 Switch<br />
  9. 9. QualiSystems Proprietary & Confidential<br />9<br />Test Scenario Example - Description<br />Device Under Test<br />Cisco Router<br />Test case<br />Validate Traffic Loss under differentRouter Service configurations<br />Criteria<br />( Packets Sent – Packets Received ) < 1%<br />
  10. 10. QualiSystems Proprietary & Confidential<br />10<br />Test Scenario Example – Required Topology<br />Device Under Test<br />Cisco Router<br />Traffic Generators<br />IXIA, SPIRENT<br />
  11. 11. QualiSystems Proprietary & Confidential<br />11<br />Test Scenario - Common Operation<br />Start<br /> Setup Topology<br /> Configure DUT<br /> Configure Traffic<br />Run Traffic<br />Analyze Results<br />Store & Report Data<br />End<br />
  12. 12. QualiSystems Proprietary & Confidential<br />12<br />Test Scenario - Common Operation<br />Start<br />Cabling the topology<br /> Setup Topology<br /> Configure DUT<br /> Configure Traffic<br />Run Traffic<br />Analyze Results<br />Store & Report Data<br />End<br />
  13. 13. QualiSystems Proprietary & Confidential<br />13<br />Test Scenario - Common Operation<br />Start<br />Telnet, Router Application GUI<br /> Setup Topology<br /> Configure DUT<br /> Configure Traffic<br />Run Traffic<br />Analyze Results<br />Store & Report Data<br />End<br />
  14. 14. QualiSystems Proprietary & Confidential<br />14<br />Test Scenario - Common Operation<br />Start<br />Traffic Control Software<br />IxExplorer<br />TestCenter<br /> Setup Topology<br /> Configure DUT<br /> Configure Traffic<br />Run Traffic<br />Analyze Results<br />Store & Report Data<br />End<br />
  15. 15. QualiSystems Proprietary & Confidential<br />15<br />Test Scenario - Common Operation<br />Start<br />Traffic Control Software<br />IxExplorer<br />TestCenter<br /> Setup Topology<br /> Configure DUT<br /> Configure Traffic<br />Run Traffic<br />Analyze Results<br />Store & Report Data<br />End<br />
  16. 16. QualiSystems Proprietary & Confidential<br />16<br />Test Scenario - Common Operation<br />Start<br />Vendor Software<br />Excel<br />MATALAB<br />Scripts<br />Other<br /> Setup Topology<br /> Configure DUT<br /> Configure Traffic<br />Run Traffic<br />Analyze Results<br />Store & Report Data<br />End<br />
  17. 17. QualiSystems Proprietary & Confidential<br />17<br />Test Scenario - Common Operation<br />Start<br />Log Files<br />Excel Sheets<br />Word Documents<br />Database<br /> Setup Topology<br /> Configure DUT<br /> Configure Traffic<br />Run Traffic<br />Analyze Results<br />Store & Report Data<br />End<br />
  18. 18. QualiSystems Proprietary & Confidential<br />18<br />Test Scenario – In Automation<br />Automated Test Script Starting<br />-------------------------------------------<br />Start<br />Configure DUT Service…<br />Done<br />Configure IXIA Traffic…<br />Done<br /> Setup Topology<br />Configure SPIRENT Traffic…<br />Done<br /> Configure DUT<br />Start IXIA Traffic…<br />Done<br /> Configure Traffic<br />Start SPIRENT Traffic…<br />Done<br />Run Traffic<br />Calculate Traffic Loss…<br />IXIA Result = 112 packets<br />SPIRENT Result = 144 packets<br />Analyze Results<br />Check Against Criteria<br />112 < SPEC && 144 < SPEC<br />Store & Report Data<br />Save log file to path:<br />C:Automated TestsProject FolderTest_14_01_2010<br />Test Pass<br />End<br />
  19. 19. QualiSystems Proprietary & Confidential<br />19<br />Test Scenario – In Automation<br />Start<br /> Setup Topology<br /> Configure DUT<br /> Configure Traffic<br />Run Traffic<br />Analyze Results<br />Store & Report Data<br />End<br />
  20. 20. QualiSystems Proprietary & Confidential<br />20<br />Manual Cabling<br />
  21. 21. QualiSystems Proprietary & Confidential<br />21<br />Manual Cabling<br />Challenge<br />Change connections<br />Solution<br />Layer 1 Switch<br />Issues<br />Test Complexity<br />Lab keeps growing<br />
  22. 22. 22<br />Growing into large scales<br />Challenge<br />Test Equipment Farms<br />Layer 1 Switch Clusters<br />Multiple labs<br />Difficult control from test<br />Solution<br />Wrap into a Cloud<br />Path Calculations<br />Configuration<br />Additional<br />Service<br />Requirement & Solution<br />Test Unaware<br />QualiSystems Proprietary & Confidential<br />
  23. 23. QualiSystems Proprietary & Confidential<br />23<br />Sharing Resources in Team Development<br />Challenge<br />Conflicts over resources<br />High Level Allocation<br />Resource Tracking<br />Solution<br />Client-Server locking service<br />Scheduling service<br />Exposure & Integration with the Development Application<br />Additional<br />Reservation & Scheduling Conflicts<br />Rule Engine<br />
  24. 24. QualiSystems Proprietary & Confidential<br />24<br />Coordinated Execution<br />Resources<br />Challenge<br />Central launching<br />Unattended Control<br />Coordinating shared resources<br />Matching tests to stations<br />Solution<br />Remote Control<br />Central Application<br />Tests Resource requirements<br />Station must expose local resources<br />Additional<br />Coordination of multiple services<br />Central Execution<br />Resource Management<br />Scheduling Service<br />Dynamic Attribute Association<br />
  25. 25. QualiSystems Proprietary & Confidential<br />25<br />Abstract Topologies & Resources<br />Challenge<br />“I Need an Ixia xxx port, don’t care from which Chassis…”<br />Solution<br />Setup<br />Rules for interchangeability<br />Physical layout of all resources<br />Actions<br />Find all required resources<br />Calculate the paths<br />Reserve all, configure all<br />
  26. 26. QualiSystems Proprietary & Confidential<br />26<br />Summary<br />Resources need to be well defined<br />Structure<br />Capabilities<br />Rules<br />Dynamic<br />Multiple Applications need to join hands<br />Execution Management<br />Scheduling<br />Resource Management<br />Development<br />Execution Engine<br />Architecture must be scalable<br />
  27. 27. QualiSystems Proprietary & Confidential<br />27<br />Thank you<br />Visit our website:www.qualisystems.com<br />

×