Your SlideShare is downloading. ×
Qa   Test Automationand Network Resource Management
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Saving this for later?

Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime - even offline.

Text the download link to your phone

Standard text messaging rates apply

Qa Test Automationand Network Resource Management

574
views

Published on

Qa Test Automationand Network Resource Management

Qa Test Automationand Network Resource Management

Published in: Technology

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
574
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. QualiSystems Proprietary & Confidential
    1
    Standards of Excellence
    Test Automation
    and
    Network Resource Management
    Eitan Lavie, Technology Director
    January 12, 2010
  • 2. QualiSystems Proprietary & Confidential
    2
    Purpose
    Discuss Resource Management
    Over Test Automation
    Growing Teams
    Distributed Environments
  • 3. QualiSystems Proprietary & Confidential
    3
    Agenda
    Background
    Test Resources (definition and examples)
    Challenge & Solution via Example
    Test Scenario
    Common Testing Operations
    Manual cabling actions, increasing availability
    Large Scale Labs
    Team Development
    Coordinating Automated Execution
    Abstract Resources & Topologies
    Summary
  • 4. QualiSystems Proprietary & Confidential
    4
    Background
    QualiSystems provide an “end to end Test Automation platform”for Device, System and Embedded products.
  • 5. QualiSystems Proprietary & Confidential
    5
    Background
    Wide Variety of Customers
    Chip & FlashManufacturers
    Network EquipmentManufacturers (NEMs)
    Service Providers(SPs)
    Aerospace
  • 6. QualiSystems Proprietary & Confidential
    6
    Background
    We’ve found similar challenges throughout different testing environments as long as…
    Test equipment cost is high
    Test equipment can be shareable
    Switching connections exists
    Multiple users
    Multiple execution stations
  • 7. QualiSystems Proprietary & Confidential
    7
    Definitions: Resource Types
    Physical Resources – Represents real equipment
    Traffic Generator ports
    Device Under Test
    Video Frame Grabber
    Logical Resources – Represent managed functionality
    Switch Node QoS
    Software License
  • 8. QualiSystems Proprietary & Confidential
    8
    Definitions: Resource Categories
    Local Resources – Specific to a single station
    Oscilloscope
    Installed Application
    Flash Card Extender
    Networked Resources – Available and shared between stations
    Traffic Generators
    Shared File System (Server)
    Layer 1 Switch
  • 9. QualiSystems Proprietary & Confidential
    9
    Test Scenario Example - Description
    Device Under Test
    Cisco Router
    Test case
    Validate Traffic Loss under differentRouter Service configurations
    Criteria
    ( Packets Sent – Packets Received ) < 1%
  • 10. QualiSystems Proprietary & Confidential
    10
    Test Scenario Example – Required Topology
    Device Under Test
    Cisco Router
    Traffic Generators
    IXIA, SPIRENT
  • 11. QualiSystems Proprietary & Confidential
    11
    Test Scenario - Common Operation
    Start
    Setup Topology
    Configure DUT
    Configure Traffic
    Run Traffic
    Analyze Results
    Store & Report Data
    End
  • 12. QualiSystems Proprietary & Confidential
    12
    Test Scenario - Common Operation
    Start
    Cabling the topology
    Setup Topology
    Configure DUT
    Configure Traffic
    Run Traffic
    Analyze Results
    Store & Report Data
    End
  • 13. QualiSystems Proprietary & Confidential
    13
    Test Scenario - Common Operation
    Start
    Telnet, Router Application GUI
    Setup Topology
    Configure DUT
    Configure Traffic
    Run Traffic
    Analyze Results
    Store & Report Data
    End
  • 14. QualiSystems Proprietary & Confidential
    14
    Test Scenario - Common Operation
    Start
    Traffic Control Software
    IxExplorer
    TestCenter
    Setup Topology
    Configure DUT
    Configure Traffic
    Run Traffic
    Analyze Results
    Store & Report Data
    End
  • 15. QualiSystems Proprietary & Confidential
    15
    Test Scenario - Common Operation
    Start
    Traffic Control Software
    IxExplorer
    TestCenter
    Setup Topology
    Configure DUT
    Configure Traffic
    Run Traffic
    Analyze Results
    Store & Report Data
    End
  • 16. QualiSystems Proprietary & Confidential
    16
    Test Scenario - Common Operation
    Start
    Vendor Software
    Excel
    MATALAB
    Scripts
    Other
    Setup Topology
    Configure DUT
    Configure Traffic
    Run Traffic
    Analyze Results
    Store & Report Data
    End
  • 17. QualiSystems Proprietary & Confidential
    17
    Test Scenario - Common Operation
    Start
    Log Files
    Excel Sheets
    Word Documents
    Database
    Setup Topology
    Configure DUT
    Configure Traffic
    Run Traffic
    Analyze Results
    Store & Report Data
    End
  • 18. QualiSystems Proprietary & Confidential
    18
    Test Scenario – In Automation
    Automated Test Script Starting
    -------------------------------------------
    Start
    Configure DUT Service…
    Done
    Configure IXIA Traffic…
    Done
    Setup Topology
    Configure SPIRENT Traffic…
    Done
    Configure DUT
    Start IXIA Traffic…
    Done
    Configure Traffic
    Start SPIRENT Traffic…
    Done
    Run Traffic
    Calculate Traffic Loss…
    IXIA Result = 112 packets
    SPIRENT Result = 144 packets
    Analyze Results
    Check Against Criteria
    112 < SPEC && 144 < SPEC
    Store & Report Data
    Save log file to path:
    C:Automated TestsProject FolderTest_14_01_2010
    Test Pass
    End
  • 19. QualiSystems Proprietary & Confidential
    19
    Test Scenario – In Automation
    Start
    Setup Topology
    Configure DUT
    Configure Traffic
    Run Traffic
    Analyze Results
    Store & Report Data
    End
  • 20. QualiSystems Proprietary & Confidential
    20
    Manual Cabling
  • 21. QualiSystems Proprietary & Confidential
    21
    Manual Cabling
    Challenge
    Change connections
    Solution
    Layer 1 Switch
    Issues
    Test Complexity
    Lab keeps growing
  • 22. 22
    Growing into large scales
    Challenge
    Test Equipment Farms
    Layer 1 Switch Clusters
    Multiple labs
    Difficult control from test
    Solution
    Wrap into a Cloud
    Path Calculations
    Configuration
    Additional
    Service
    Requirement & Solution
    Test Unaware
    QualiSystems Proprietary & Confidential
  • 23. QualiSystems Proprietary & Confidential
    23
    Sharing Resources in Team Development
    Challenge
    Conflicts over resources
    High Level Allocation
    Resource Tracking
    Solution
    Client-Server locking service
    Scheduling service
    Exposure & Integration with the Development Application
    Additional
    Reservation & Scheduling Conflicts
    Rule Engine
  • 24. QualiSystems Proprietary & Confidential
    24
    Coordinated Execution
    Resources
    Challenge
    Central launching
    Unattended Control
    Coordinating shared resources
    Matching tests to stations
    Solution
    Remote Control
    Central Application
    Tests Resource requirements
    Station must expose local resources
    Additional
    Coordination of multiple services
    Central Execution
    Resource Management
    Scheduling Service
    Dynamic Attribute Association
  • 25. QualiSystems Proprietary & Confidential
    25
    Abstract Topologies & Resources
    Challenge
    “I Need an Ixia xxx port, don’t care from which Chassis…”
    Solution
    Setup
    Rules for interchangeability
    Physical layout of all resources
    Actions
    Find all required resources
    Calculate the paths
    Reserve all, configure all
  • 26. QualiSystems Proprietary & Confidential
    26
    Summary
    Resources need to be well defined
    Structure
    Capabilities
    Rules
    Dynamic
    Multiple Applications need to join hands
    Execution Management
    Scheduling
    Resource Management
    Development
    Execution Engine
    Architecture must be scalable
  • 27. QualiSystems Proprietary & Confidential
    27
    Thank you
    Visit our website:www.qualisystems.com