NTS Testing Labs
                               Network Switch Peripheral Test Lab
                             Compatibil...
Table of Contents


1.      Introduction ....................................................................................
National Technical Systems Network Switch Test Outline


1. Introduction
National Technical Systems (NTS) Testing Laborato...
National Technical Systems Network Switch Test Outline

3. Scope of Work

3.1 Overview
NTS typically conducts Network Swit...
National Technical Systems Network Switch Test Outline

3.2.2 Compatibility Testing
Compatibility testing involves the pro...
National Technical Systems Network Switch Test Outline

3.2.4.3 Accelerated Convergence Time
When designing a network that...
National Technical Systems Network Switch Test Outline

Ports need to be configured to auto negotiate speed and duplex sup...
National Technical Systems Network Switch Test Outline

A network switch product can provide a wide range of features. Som...
NATIONAL TECHNICAL SYSTEMS
National Technical Systems (NTS) is one of the largest consulting and certification laboratorie...
Upcoming SlideShare
Loading in...5
×

NTS Network Switch Compatibility / Functionality Test Outline

1,376

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
1,376
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
19
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "NTS Network Switch Compatibility / Functionality Test Outline"

  1. 1. NTS Testing Labs Network Switch Peripheral Test Lab Compatibility & Functionality Test Outline Revision 1.0 NATIONAL TECHNICAL SYSTEMS The NTS Mission: Assisting our Clients in Navigating a Short Course to Global Markets Written by: Tracking No. Rev. Max Macias, Project Manager TO201013 1.0 Approved by: Date FileName Osman Sakr 2/22/02 NTS Test Outline - Switch - TO201013.doc Quality Assurance Approval Date Derek Fakehany 2/22/02 Copyright © 2002, National Technical Systems, Inc. This document is provided to clients and potential clients of National Technical Systems (NTS) for informational purposes only. It may not be reproduced or stored, in whole or in part by any means, with out the express written permission of NTS. Document Tracking # TO201013 NTS Test Outline - Switch - TO201013.doc 1.0 ??? 02/02
  2. 2. Table of Contents 1. Introduction .........................................................................................................................................................1 2. Terminology.........................................................................................................................................................1 3. Scope of Work .....................................................................................................................................................2 3.1 Overview ...........................................................................................................................................................2 3.2 Test Procedures................................................................................................................................................2 3.2.1 Functionality Testing.....................................................................................................................................2 3.2.2 Compatibility Testing ....................................................................................................................................3 3.2.3 Stress/Stability Testing .................................................................................................................................3 3.2.4 Performance Testing ....................................................................................................................................3 3.2.4.1 Fast Ethernet Link Aggregation .........................................................................................................3 3.2.4.2 Gigabit Ethernet Uplink......................................................................................................................3 3.2.4.3 Accelerated Convergence Time ........................................................................................................4 3.2.4.4 VLAN Communication .......................................................................................................................4 3.2.4.5 Dynamic VLAN ..................................................................................................................................4 3.2.4.6 Port Auto Negotiation ........................................................................................................................4 4. Project Deliverables ............................................................................................................................................5 4.1 NTS Test Reports .............................................................................................................................................5 4.2 Test Matrix ........................................................................................................................................................5 4.3 Project Documentation Report ..........................................................................................................................5 4.4 Report Transmission .........................................................................................................................................5 4.5 Project Leadership ............................................................................................................................................5 5. Conclusion...........................................................................................................................................................5 i
  3. 3. National Technical Systems Network Switch Test Outline 1. Introduction National Technical Systems (NTS) Testing Laboratories currently conducts Network Switch Compatibility / Functionality Testing for a wide array of product manufacturers. Network Switch device testing will be conducted in four phases: Functionality, Compatibility, Stress/Stability, and Performance. Network Switch Compatibility / Functionality Testing fills the need for “real-world” environment testing. The following Test Outline will describe the methodologies and test procedures used in Network Switch Compatibility / Functionality Testing. 2. Terminology Various terms throughout this document may require clarification. Below are those terms and their definitions. The majority of these terms appear within double quotes (“”) when utilized in the text, drawing attention to the specific definitions below. 1. “Bridge” – A device that passes packets between multiple network segments using the same communications protocol. If a packet is destined for a user within the sender's own network segment, the bridge keeps the packet local. If the packet is bound for another segment, the bridge passes the packet onto the network backbone. 2. “Frame” – Logical grouping of information sent as a data link layer unit over a transmission medium. Often refers to the header and trailer, used for synchronization and error control, that surround the user data contained in the unit. The terms cell, datagram, message, packet, and segment are also used to describe logical information groupings at various layers of the OSI reference model and in various technology circles. 3. “Link Aggregation” – Allows for two (or more) physical links to function as a single logical link. 4. “Load Balancing” – In routing, the ability of a router to distribute traffic over all its network ports that are the same distance from the destination address. Good load-balancing algorithms use both line speed and reliability information. Load balancing increases the utilization of network segments, thus increasing effective network bandwidth. 5. “MAC” – Media Access Control. Lower of the two sublayers of the data link layer defined by the IEEE. The MAC sublayer handles access to shared media, such as whether token passing or contention will be used. 6. “MAC Address Learning” – Service that characterizes a learning bridge, in which the source MAC address of each received packet is stored so that future packets destined for that address can be forwarded only to the bridge interface on which that address is located. Packets destined for unrecognized addresses are forwarded out every bridge interface. This scheme helps minimize traffic on the attached LANs. MAC address learning is defined in the IEEE 802.1 standard. 7. “Switch” – Network device that filters, forwards, and floods frames based on the destination address of each frame. The switch operates at the data link layer of the OSI model. 8. “VLAN” – Virtual LAN (Local Area Network) 9. “Trunk” – Physical and logical connection between two switches across which network traffic travels. A backbone is composed of a number of trunks. 10. “VLAN Trunk” – VLAN Trunking used to configure and manage virtual LANs across a switch network. A trunk can carry multiple VLAN links from one switch to another. February 22, 2002 National Technical Systems TO201013-1.0 -1-
  4. 4. National Technical Systems Network Switch Test Outline 3. Scope of Work 3.1 Overview NTS typically conducts Network Switch Compatibility / Functionality Testing to verify that the product under test functions correctly without anomalies, difficulties or discrepancies. NTS will perform testing to exercise a network switch product to insure that it will interoperate properly based on industry standards. NTS will execute a quality assurance test plan consisting of four (4) test areas. The test areas include Functionality, Compatibility, Stress/Stability, and Performance. Switch product testing will be conducted to insure compliance to specification through functionality, compatibility, and performance testing of the device in a Network environment. Stress and stability testing will be performed to determine the overall performance. Interoperability testing will also be performed to verify that device under test will function properly with other Network devices from various vendors. If critical errors are encountered, then the product will fail its quality assurance test. If no critical errors were encountered, then the product will pass its quality assurance test. 3.2 Test Procedures Before NTS can begin testing, equipment must be setup and configured to perform testing with the product-under- test. Once the test environment is configured, NTS Testing Engineers will confirm that the test environment appears to be functioning as expected. The quality assurance testing consists of four (4) test areas. Below are those test areas and the test procedure outlines that coincide with each area. 3.2.1 Functionality Testing Most switch devices come with an initial boot-up configuration tool to configure the IP address, telnet, passwords, device name, and other device parameters. Following the initial setup some manufacturers provide a software interface that allows configuration in a GUI or HTML environment. There are many configurable parameters that exist on a switch. The following is a list of parameters that may be tested. Note that there may be more or less options depending on the model and design. DEVICE SETTINGS 1. Device name 2. IP Address 3. Telnet and configuration passwords PORT SETTINGS 1. Duplex mode. 2. Port speed (10/100)/ Autonegotiation 3. VLAN 4. VLAN Trunking 5. Dynamic VLAN 6. Link Aggregation 7. SPAN Tree 8. MAC Address filtering/security Functionality testing of the interface is performed by changing settings on the device and its ports. Once the setting has changed the function is checked to make sure that it is performing to specification (see sections 3.2.3 and 3.2.4 for performance testing). The configuration setting is then saved and the device is rebooted. After reboot the device is tested to ensure that it retained the configuration and functionality. February 22, 2002 National Technical Systems TO201013-1.0 -2-
  5. 5. National Technical Systems Network Switch Test Outline 3.2.2 Compatibility Testing Compatibility testing involves the proper installation/configuration of the device with various Network Interface Cards (NIC) and other manufacturers networking devices. A switch port is expected to be able to auto negotiate its duplex and speed setting with other devices it is connected to. Certain switches models can have trouble with the auto negotiation of certain other manufacturers NIC devices. Several computers will be loaded with various NIC devices from a wide variety of manufacturers. The switch device is expected to communicate and negotiate the proper speed with the NIC. In addition to this, the device will be connected to an environment with hubs, switches, and routers from other manufacturers. 3.2.3 Stress/Stability Testing Stress testing is done to ensure that the device can handle a variety of possible different environments. This device is expected to perform switch functionality between network servers, workstations, routers, and internet/intranet sites. It is expected to handle various protocols at differing rates of transfer. This is to be handled within the specifications of each protocol Attach a Smartbits device to several ports on the switch to simulate a large amount of traffic passing through the switch. This device can also vary frame sizes that will pass through the switch. Client machines can be attached to perform various file transfers or data intensive tasks with each other, or various websites/FTP/VPN sites. Each client can also use various protocols (i.e. TCP/IP, IPX/SPX, NetBEUI, DHCP, NAT, DNS, PPPoE client, PPTP, HTTP, FTP, SMTP, POP3, etc.) in order to fully stress the switch. A combination of the Smartbits device and client machines can simulate a minimum percentage utilization (say a constant 25% use of switch bandwidth) plus the repeated burst of frames you get in a typical network environment. 3.2.4 Performance Testing The performance testing described below involve one and two switch configurations. Testing involving two switches can be performed with two of the same switch or that of another brand. Performing with another brand also tests the switch’s interoperability and best simulates a real world environment. Note: Not all of the below listed features are supported by all switch devices. 3.2.4.1 Fast Ethernet Link Aggregation Link aggregation allows for two (or more) physical links to function as a single logical link. Each switch pair must communicate over an aggregated link consisting of two full-duplex, Fast Ethernet links. Link aggregation gives network managers a cost-effective way to leverage their existing network infrastructure to allow for fractional bandwidth between Fast Ethernet and Gigabit Ethernet. Two switches are to be configured for link aggregation across two Fast Ethernet full-duplex ports. We generate bidirectional traffic streams consisting of 1,518-byte packets at a load exceeding the bandwidth of a single port, and validated successful receipt of traffic greater than a single, full-duplex link could forward. A switch passes if its aggregated links successfully transmitted traffic greater than one full-duplex link. A switch would have failed if the aggregated links did not transmit traffic greater than a single full-duplex link. 3.2.4.2 Gigabit Ethernet Uplink A pair of switches must pass traffic across a single, full-duplex Gigabit Ethernet link between the devices. As workgroup switched networks converge with backbone campus networks, it is not uncommon to need this type of Gigabit link between switches from other vendors. Each switch is to be configured with a Gigabit Ethernet (1000Base-SX) link between them for Layer 2 forwarding. Data will be generated between two Fast Ethernet LANs across the Gigabit Ethernet uplink to confirm connectivity. The switch passes if it successfully links switches via a single Gigabit Ethernet uplink and passing a stream of 1,518-byte packets from one device to the next. February 22, 2002 National Technical Systems TO201013-1.0 -3-
  6. 6. National Technical Systems Network Switch Test Outline 3.2.4.3 Accelerated Convergence Time When designing a network that has built-in redundancy, you need to ensure that if a device fails, the redundant link can recover and reconverge using Bridge Protocol Data Units (BDPUs) within the specified time frame. When designing a network that has built-in redundancy, you need to ensure that if a device fails, the redundant link can recover and reconverge using BDPUs within the specified time frame. Each switch pair must demonstrate the ability to reconverge its spanning tree configuration and begin passing traffic less than 10 seconds (testing time can be altered) after a device failure using BPDU. A sequence of pings at one- second intervals that request and respond across the same path. Then powered off the switch on the path and monitor the number of sequential pings lost before the network reconverges, and the pings achieved success. The number of pings lost represents the time required for the network to reconverge using BPDUs. Switches that reconverge the network in less than XX seconds passes the test. A fail result would have registered when a reconvergence of the network took longer than XX seconds. 3.2.4.4 VLAN Communication Virtual LANs (VLANs) offer significant benefits in terms of efficient use of bandwidth, flexibility, performance, and security. VLAN technology functions by logically segmenting the network into different broadcast domains so that packets are only switched between ports that are designated for the same VLAN. VLANs prevent traffic, including broadcasts and multicasts, from being propagated to members of other VLANs. Thus, by containing traffic originating on a particular LAN only to other LANs within the same VLAN, switched virtual networks avoid wasting bandwidth. Configure a minimum of four ports on the switch to belong to one of two VLANs. Two in each VLAN. Attach a computer to each configured port. From a machine on VLAN 1 try to ping the other machine in VLAN 1. Repeat this for the computers in VLAN 2. Next, from VLAN 1 try to ping a device in VLAN 2. Next configure additional ports in the same VLAN and inject traffic into these ports using the SmartBits 2000 device. Repeat the ping attempts within and outside the VLAN. The device passes the test if packets do not cross over into the other VLAN. 3.2.4.5 Dynamic VLAN With dynamic VLAN you can assign switch ports to VLANs dynamically, based on the source Media Access Control (MAC) address of the device connected to the port. When you move a host from a port on one switch in the network to a port on another switch in the network, the switch dynamically assigns the new port to the proper VLAN for that host. When a switch server searches its database for a MAC address-to-VLAN mapping. A MAC is registered for a VLAN connection. If not it may disable the port or block packets from that Mac address. You can also make an explicit entry in the configuration table to deny access to specific MAC addresses for security reasons. Configure the MAC addresses of several devices to belong to two to three different VLANS. Plug in the devices and see that they can communicate with other devices in there respective VLANs. Once they have communicated, unplug the device and plug the device into another port on the switch. The port should dynamically configure itself to the correct VLAN. The device passes the test if the switch correctly identifies the MAC address and assigns the port to the proper VLAN identified in the configuration. 3.2.4.6 Port Auto Negotiation A pair of switches should properly negotiate the highest Ethernet speed (10/100) and appropriate duplex (half/full) settings common to both devices. Auto negotiation lets two devices decide their maximum speed and duplex without having a network manager hard-code each switch's adapters and ports. This is important because improper link speed creates a no-link situation and improper duplex settings can severely affect throughput. If one switch is configured for full duplex and another switch is configured for half duplex, the devices cannot transmit and receive data without errors. The advantage with auto negotiation is, if it works properly, it reduces the need for a network manager to negotiate link speed and duplex settings on each device in the network. February 22, 2002 National Technical Systems TO201013-1.0 -4-
  7. 7. National Technical Systems Network Switch Test Outline Ports need to be configured to auto negotiate speed and duplex support. The two switches will be connected via a crossover cable. If both reported configurations were identical, NTS will generated a stream of 1,518-byte frames for one minute at a rate appropriate for the reported configuration. Note: If the switches reported 10M bit/sec full duplex, engineers generated more than 10M bit/sec in each direction to confirm the speed setting. To pass this test, a switch has to indicate that it passed traffic at the highest possible link speed and duplex level 4. Project Deliverables NTS clients receive the following standard NTS project deliverables during or at the conclusion of tests performed by NTS. (Project specific deliverables may also apply depending upon the specific project type). 1. NTS Test Reports (daily / as generated) 2. Test Matrix and/or Test Status Report 3. Project Documentation Report The Test Matrix and NTS Test / Problem Reports are transmitted to client daily or as developed. The Project Documentation Report is delivered following the conclusion of testing. 4.1 NTS Test Reports During testing, NTS generates reporting to document all testing performed. NTS test reporting is designed to capture configuration information, general procedures, test measurements and other test results related to all tests performed. 4.2 Test Matrix The NTS Test Matrix provides a quick overview of the status of entire project. The Test Matrix is a master grid outlining individual tests or test milestone coverage on the project. The matrix provides a quick overview of tests performed to date, with columns specifying the product(s) tested, a pass/fail/warn status, the date performed, test engineer identification, and any related Test Report numbers. 4.3 Project Documentation Report NTS binds the final copy of the project test matrix along with all NTS test reports and delivers this to clients following the completion of testing. 4.4 Report Transmission NTS uses Internet e-mail as much as possible to transmit status reports, test reports, test matrices, documentation reports, etc. In some cases, materials may also be faxed or send via FedEx. If additional security is required, NTS will utilize encryption to prepare and send files in batches, using an agreed upon encryption mechanism (to be decided between NTS and a particular client prior to test execution). Catastrophic and critical problems are prioritized and reported upon as soon as possible. 4.5 Project Leadership A project leader is assigned to projects NTS performs for clients. The NTS project leader communicates with clients regarding test progress, status, and findings. The project leader’s primary responsibility is to insure that testing is being executed as agreed upon, to provide management and technical expertise, and to work with the Client to make any required changes. The project leaders are supervised by NTS’ Operations Manager. If major revisions to a test plan is required, or if a client is not satisfied with the testing process, the client is encouraged to contact the Lab Quality Manager immediately. It is NTS’ goal to provide testing that meets Client’s needs as accurately as possible. 5. Conclusion NTS Testing Laboratories has decades of experience and unsurpassed expertise in the area of compatibility and interoperability testing. Fewer product recalls, faster time to market, reduced technical support requirements and higher customer satisfaction are but a few of the many potential benefits of testing a product with NTS. February 22, 2002 National Technical Systems TO201013-1.0 -5-
  8. 8. National Technical Systems Network Switch Test Outline A network switch product can provide a wide range of features. Some of which are more basic, or far more complex than those described above. Variations in a test plan vary depending on the features of the product and the test needs of the client. Network switch compatibility and functionality testing fill the need for “real-world” environment testing. Testing the network switch under the test areas of Functionality, Compatibility, Stress/Stability, and Performance will assure that the client’s network switch will function in a “real world” environment. The benefactors of this type of compatibility and functionality testing are lower product recall rates, lower volume of customer support calls and higher consumer satisfaction. February 22, 2002 National Technical Systems TO201013-1.0 -6-
  9. 9. NATIONAL TECHNICAL SYSTEMS National Technical Systems (NTS) is one of the largest consulting and certification laboratories in the United States. NTS operates extensive test facilities, throughout the United States and Japan, covering operational environment, stress environment, compatibility, interoperability, broadband network testing, EMI/EMC, FCC, NEBS, USB, WHQL, Product Safety testing and ISO Audit/Certification (we certify the National Space Administration for ISO compliance). NTS is a Nationally Recognized Testing Laboratory (NRTL) - as certified by the United States Government. We are accredited to ISO 17025 by the American Association for Laboratory Accreditation. NTS holds many certifications from foreign governments as a Conformity Assessment Body (CAB). We are the only “one stop” certification and compliance facility offering a broad range of testing capabilities. These capabilities include significant financial resources, numerous certification programs and a high level of lab security. We support extensive test procedures, operating systems and hardware. We are fully equipped for broadband testing and offer such services as DOCSIS “third-party” pre-certification and DSLAM compatibility and functionality testing. A variety of PSTN and Internet access methods are available ranging in speed from dial-up to 1Gb/sec. Several independent T1 Internet access points and frame relay circuits are available. An OC-12 link permits access ranging from standard T1 to OC-12 (644 Mb/sec) in a variety of formats: ATM, Frame Relay, SuperTrunk, HiCap and various other architectures. Our particular testing laboratory is located in Culver City, California. This facility is centrally located and is just 15 minutes from Los Angeles International Airport. IT IS EASY TO START! Send us your “wish list” covering the areas that you would like addressed in your test, and we will design a test proposal specific to your needs that covers only what you want tested. To turn your request into a formal (no cost to you) proposal, we need the following: 1. Product description and or specification. 2. Target Market – What market your product will sell into. 3. Start and end date – When you need to start and end this test. 4. Company information – Name, contact, address, phone, fax and e-mail. 5. Any concerns about your product that you have or you know about. Let us know if you want a test proposal for your particular project. Typically, our Proposal Department can prepare one for you within five (5) working days, although more complex products may require additional time. The proposal will contain our test methodology, project schedule, defect classifications, regression information, and the project cost. This proposal should be considered a “working document” that you can change or modify to fit your exact test requirement and budget – Our goal is to work together so that you can achieve your objectives. CONTACT US National Technical Systems Computer Testing Division 5730 Buckingham Parkway Culver City, CA 90230 Telephone: (310) 641-7700 Fax: (310) 641-5827 Web: http://www.ntscorp.com/ E-mail: labsales@ntscorp.com

×