Over 4000 employees operating in 25 countries (Scale)
SEI CMM Level 5 certified process model (Quality)
8 of the world’s 10 most valuable companies are Lionbridge customers BusinessWeek Global 1000, July 2004
Services Designed around our Client’s Need Lionbridge A Trusted Partner Around the World Global Development & Testing Solutions Global Language & Content Solutions Interps Software Development Lifecycle Application Development Testing & Certification Maintenance & Support Full Content Lifecycle Localization/Translation Technical Publications eLearning Courseware
Off-shore platforms leverage more than staff in China, India, and Eastern Europe
Global footprint enables local interaction and facilitates worldwide release and support
Trusted, US-based public company protects against IP loss
Localization services spanning more than 80 languages
Proprietary web-architected TM and terminology solution accelerates production and improves consistency
Authoring and eLearning development services integrate seamlessly with localization to address global demand
VeriTest: Setting the Standard in Testing Since 1987
World’s largest independent testing company
Over 400 test architects, engineers, and analysts in 11 labs across US, Europe, Asia
Rapid expansion in VeriTest India
From PDAs and PCs to 32-way servers
Data center class storage lab
Exclusive provider and architect of industry- leading certification programs
Developer of PC Magazine benchmarks
Test and publish industry standard ISP benchmarks
Operate globally-networked onsite to offshore model
The Lionbridge Team Local Connections, Global Efficiency 4,000+ Worldwide Staff Experience and Efficiency
"The standard philosophy of 'test to destruction'... will probably give you an idea of roughly how many users your site can handle at once, but it won't always tell you why the site fails to function properly. And without knowing why, you're not likely to be able to do much about it..."
Conduct the right test to get the right results
Determines the response time and throughput during typical user load
Determines the peak user load
Determines the problems that occur during long-term user activity
Determines the performance and behavior of a specific component
Measures the performance of a system or component relative to a standard
Transaction Cost Analysis
Determines the system resources consumed by a single transaction
Performance Testing Roadmap Define Communicate Test Script Plan
Agree on goals of testing
Determine schedule constraints
Agree to promotion strategy
Outline resources available
Determine staffing plan
Engage test lab (if needed)
Verify basic functionality
Generate use cases
Capture user activity logging information
Analyze user activity profile
Model user activity
Choose the tool(s)
Identify re-usable script components
Assign resources needed for scripting, testing
Create test environment
Build script library
Analyze test results
Run possible iterations
Log non-performance failures
Provide feedback to stakeholders
Deliver action items
An overview of the performance testing process
After initiating the test, the load generator systems to begin accessing the system under test using the designed usage patterns.
Depending on whether the test is a global, local, or isolated configuration, the load generators may be located worldwide or completely contained within a test lab.
The one critical configuration requirement for the load-generating systems is that they have adequate network bandwidth throughput capability to access the system under test in a realistic manner without bandwidth constraints.
If bandwidth constraints become a problem, adding additional load generators to the pool of load generators will typically fix this problem.
If the test is global or local, the Internet will be an important factor in the configuration. For an isolated configuration, the Internet is not a factor.
An overview of the performance testing process
Once a performance test is initiated, it can run for several minutes to several days, depending on the test goal.
During the test time, the test tool monitors and collects performance data from all of the components within the system under test, such as the Web server, application server, or database server.
All of the monitor data along with the performance test data collected at the generating client end to determine the overall performance as well as the potential system bottlenecks.
In a typical performance test cycle, the performance bottlenecks are located, fixed, and iteratively retested to ensure that they are fixed as designed.
High Level Picture of the Process Overcome resource limitations • Replace testers with “Virtual Users” • Run many Virtual Users on few machines • Controller manages Virtual Users • Run repeatable tests with scripted actions • Get meaningful results with analysis tools System under Test Load Generation
You don’t have to go it alone Define Communicate Test Script Plan
Build and train internal resources
Utilize service offerings from test tool vendors
Rely on application provider
Engage with a consulting firm or SI
Partner with an independent testing company
Important considerations for choosing the resources
Testing skills and experience
Technology and/or application expertise
Frequency and scale of testing requirements
The vast number of performance testing tools can be overwhelming
Important considerations for choosing the right tool
Do you already own the license?
Do you have the internal resources to script and execute?
Will it meet the test objectives?
Is it compatible with your technology objectives?
Does it fit within your budget constraints?
Do you have the training and expertise to analyze the results?
Does it match the frequency of your testing needs?