For web applications you often need the ability to deploy new features continuously while making sure that all parts of your application still work correctly. Establishing an Continuous Integration process using an automated test suite can support you to meet those needs. This presentation tries to give an overview how this integration process can be established for Symfony2 applications and which types of tests apply.
The presentation was held on the Symfony User Group Berlin on 10 Okt. 2012
For web applications you often need the ability to deploy new features continuously while making sure that all parts of your application still work correctly. Establishing an Continuous Integration process using an automated test suite can support you to meet those needs. This presentation tries to give an overview how this integration process can be established for Symfony2 applications and which types of tests apply.
The presentation was held on the Symfony User Group Berlin on 10 Okt. 2012
Test Automation Best Practices (with SOA test approach)Leonard Fingerman
Today we hear a lot of buzz about the latest & greatest test automation tools like Selenium, Rational Functional Tester or HP LoadRunner but to make your test automation effort successful it might take more than just having the right tool. This presentation will try to uncover major pitfalls typically involved with test automation efforts. It will provide guidance on successful strategy as well as differences among third-generation frameworks like keyword-driven, data-driven and hybrid. It will also cover various aspects of SOA test automation
This presentation provides an overview of the features available in Inflectra RemoteLaunch. RemoteLaunch lets you integrate different commercial and open source testing tools with our SpiraTest test management system. RemoteLaunch lets you store and version all of your test scripts centrally, and then execute them on different machines in a global test lab. It has plugins for such popular tools as TestComplete, UFT, QTP, RFT, and Ranorex.
Back-end testing is an unfamiliar testing area to many testers, especially when the Back-end adopts web services technologies and has gigabytes of data need to be verified. The presentation will outlines numbers of testing activities that need to be done to deal with challenges.
Services/Domain Testing Introduction:
We have been providing automation test service for Back-end system which has web services, web application technologies and meta-data processing. The domain we has worked on is about Communication Media and Entertainment.
Challenges:
Complex business logic inside layer of data storage and processing to provide services. Different platforms under test.
Defragmented testing result so it is difficult to make decision.
Must align testing with development life cycle.
Solutions:
Apply automation testing to Continuous Integration.
Design automation test framework to deal with Shell, Web Service, Web Application, gigabytes of XML Data on Windows and Linux.
Select proper technology stack to centralize the testing result from both manual and automation teams.
Jenkins is continuous integration and continuous delivery application, as start point, run its job to build source code from development team. When unit testing for source code is passed, automated system test written by LISA is launched as flow controller for automation test framework.
The LISA’s core functionalities are to verify middleware layer, web services based on SOAP/RESTful and database. Extending LISA’ capabilities are also applied in practice to test different technologies under test such as web application by integrating with Selenium, Shell Script by JCraft and processing big data file by Xstream/JAXB.
Test Automation Best Practices (with SOA test approach)Leonard Fingerman
Today we hear a lot of buzz about the latest & greatest test automation tools like Selenium, Rational Functional Tester or HP LoadRunner but to make your test automation effort successful it might take more than just having the right tool. This presentation will try to uncover major pitfalls typically involved with test automation efforts. It will provide guidance on successful strategy as well as differences among third-generation frameworks like keyword-driven, data-driven and hybrid. It will also cover various aspects of SOA test automation
This presentation provides an overview of the features available in Inflectra RemoteLaunch. RemoteLaunch lets you integrate different commercial and open source testing tools with our SpiraTest test management system. RemoteLaunch lets you store and version all of your test scripts centrally, and then execute them on different machines in a global test lab. It has plugins for such popular tools as TestComplete, UFT, QTP, RFT, and Ranorex.
Back-end testing is an unfamiliar testing area to many testers, especially when the Back-end adopts web services technologies and has gigabytes of data need to be verified. The presentation will outlines numbers of testing activities that need to be done to deal with challenges.
Services/Domain Testing Introduction:
We have been providing automation test service for Back-end system which has web services, web application technologies and meta-data processing. The domain we has worked on is about Communication Media and Entertainment.
Challenges:
Complex business logic inside layer of data storage and processing to provide services. Different platforms under test.
Defragmented testing result so it is difficult to make decision.
Must align testing with development life cycle.
Solutions:
Apply automation testing to Continuous Integration.
Design automation test framework to deal with Shell, Web Service, Web Application, gigabytes of XML Data on Windows and Linux.
Select proper technology stack to centralize the testing result from both manual and automation teams.
Jenkins is continuous integration and continuous delivery application, as start point, run its job to build source code from development team. When unit testing for source code is passed, automated system test written by LISA is launched as flow controller for automation test framework.
The LISA’s core functionalities are to verify middleware layer, web services based on SOAP/RESTful and database. Extending LISA’ capabilities are also applied in practice to test different technologies under test such as web application by integrating with Selenium, Shell Script by JCraft and processing big data file by Xstream/JAXB.
Creating automation scripts using a generic framework is useful. The framework should have recovery scenarios and it should also perform a quick check after test execution using customized logs. The test execution summary must provide accurate information on test case execution. This article on IBM® Rational® Functional Tester elaborates this process.
Complete description of the parts of an adult bed bug's body. When sleeping in a new bed, check for signs of their feces: small, black or dark brown dots on sheets or the mattress.
Load Testing SAP Applications with IBM Rational Performance TesterBill Duncan
This technical solution briefly describes how the SAP CoE / Value Prototyping successfully leveraged IBM Rational Performance Tester 8.0 to test an ABAP Web Dynpro application before it went into production. The paper shows how IBM testing tools can be used to simulate user load on any SAP system and measure the system’s behavior under load. The solution described in this paper was used in an SAP internal project to measure a new SAP application before it was implemented internally.
Take a load off! Load testing your Oracle APEX or JDeveloper web applicationsSage Computing Services
Geeeez, after demanding you unit test, system test, black box test, white box test, test-test-test everything, your manager is now demanding you load test your brand spanking new Oracle web application. How on earth can you do this?
This technical presentation will explain the concepts behind preparing for load testing, the Http protocol's request/response model, and live demonstrations using Oracle's Http Analyzer and Apache's JMeter to stress test your Oracle web application.
The presentation is suitable for anybody, be it DBAs or developers, who are concerned about the performance of any web based application, possibly an Apex or JDeveloper or 3rd party web application. Knowledge of Apex or JDeveloper is not mandatory for this presentation and they will not be covered in any depth.
HIA 1015 Speed the Development of Robust Integrations with IBM Integration Bu...Karen Broughton-Mabbitt
Presented at InterConnect 2016 by Carsten Bornert and Emanuel Stanciu.
IBM Integration Bus (IIB) is IBM's strategic software integration product. Rational Integration Tester provides powerful capabilities to discover, simulate and test the solutions built on IBM Integration Bus. This session will demonstrate how integrations can be built on IBM Integration Bus and benefit from the simulation and discovery capabilities of Rational Integration Tester to accelerate and harden the integration.
About Basics of IBM Rational Performance Tester Tool.
It describes what is RPT? how to do a simple script in RPT.
And how to execute it?.
Its a brief idea about RPT
Track Keynote for the Quality Management Track at the IBM Rational Software Conference 2009
Quality driven software delivery is a team sport, and every member of that team shares responsibility for enterprise quality management. This track is dedicated to the IBM Rational tools and industry best practices that can help software development teams improve the functionality, performance, and availability of complex applications. Attendees gain in-depth guidance from experienced IBM experts and customers on topics ranging from deep code analysis to system test automation and management, all enabled by the tools and capabilities in the IBM(R) Rational quality management portfolio. Learn how to work with existing resources and how to overcome schedule constraints in order to increase productivity and value to the organization while enhancing project success. This track is for testers and others on the project team - analysts, architects, developers, and deployment managers - looking for valuable, actionable information that can be used to build quality into applications from the beginning.
Agile Open Source Performance Test Workshop for Developers, Testers, IT OpsClever Moe
Training For Selenium, soapUI, Sahi, TestMaker Performance Testing. Slide deck from the free Webinar titled "Technical Training On The Agile Open Source Way To Load Test, Scalability Test, and Stress Test." Learn the Agile Open Source Testing way to load and performance test your Web applications, Rich Internet Applications (RIA, using Ajax, Flex, Flash, Oracle Forms, Applets,) and SOAP and REST Web services. This free Webinar delivers a testing methodology, tools, and best/worst practices.
Combining Performance Testing And Modelling For Easy Jet.Com V 1.0dannyq
easyJet is Europe’s fourth largest airline and has seen growth in passenger numbers of 37% per annum over the last 10 years. It operates 175 aircraft over a pan-European network of 20 bases and 400 routes.
Capacitas is a UK-based technology consulting and training company focussed on ICT performance, capacity and cost.
Over 98% of easyJet’s revenue is earned through its e-commerce platform; meaning software reliability, performance and scalability are critical to successful business operation. easyJet is a recognised innovator in a highly competitive market and this necessitates frequent software releases using an agile development methodology. All of this must be achieved within the context of a low-cost business model.
In many organisations performance testing and performance modelling have long been used to reduce the risk of poor performance impacting business services, but often in isolation. This presentation describes how performance testing and modelling can be used in tandem to compensate for the weaknesses of each other, within the context of an agile development process. The presentation demonstrates how Capacitas and easyJet have integrated performance testing and modelling processes to provide cost-effective risk mitigation for the easyJet.com service.
How to Improve Performance Testing Using InfluxDB and Apache JMeterInfluxData
Apache JMeter is a useful way to run performance tests across different servers. In order to monitor these results, SAP chose to integrate JMeter with InfluxDB, their time series database, to collect and store the temporary transactions. They use Grafana to visualize real-time performance metrics. What happens if your database goes down – for any reason? It could be because of too many JMeter threads trying to access the database or because Grafana is trying to access too many cores of transactions during a performance test. Discover how SAP improves their performance monitoring team’s productivity.
In this webinar, Subhodeep Ganguly will cover:
SAP’s approach to recovering transactions due to database failure
How JMeter execution threads will store the data in a temporary flat/CSV file compatible with InfluxDB
Their ability to reduce recovery times and to improve automatic performance testing
Usage of influx-replay tool as a plugin or compact jar file during the execution of an end-to-end performance test
How CapitalOne Transformed DevTest or Continuous Delivery - AppSphere16AppDynamics
Making the leap to continuous delivery is precarious for any organization, but the concerns are greatly exacerbated when your organization services approximately 45 million bank accounts. Committed to maintaining flawless user experiences while accelerating release cadence, Capital One faced a daunting challenge as it transformed culture, processes, and technical infrastructure in its evolution to continuous delivery.
Join this session with Capital One's Michael Bonamassa and Parasoft's Wayne Airole and learn from their insights on what DevTest changes are critical for responding to extreme digital disruption.
Key takeaways:
o The changing responsibilities of DevTest in a "continuous everything" world
o What skill sets software testers need to ride the wave of digital transformation
o How service virtualization and continuous testing measure the risk of a release candidate
o How to evolve the culture and process to support continuous delivery
o What technical infrastructure is required for real-time test automation and continuous delivery maturation
For more information, go to: www.appdynamics.com
Agile Open Source Performance Testing Workshop for Business ManagersClever Moe
Use Selenium, soapUI, Sahi, TestMaker Performance Testing In Your Organization. These are slides from a free Webinar titled "The Agile Open Source Way To Load Test, Scalability Test, and Stress Test In Your Organization". Your organization may have adopted Agile Software Development Methodology and forgot about load and performance testing! Learn the Open Source Testing way to load and performance test your Web applications, Rich Internet Applications (RIA, using Ajax, Flex, Flash, Oracle Forms, Applets,) and SOAP and REST Web services. This free Webinar delivers a testing methodology, tools, and best/worst practices.
RABIT Rapid Automated Build Install Test Framework - is innovative product from Lemtom which combines Continuous Integration Features with ALM capabilities to drive effective release management in an IT enterprise . RABIT is THE comprehensive Continous Integration framework for Salesforce application development and BPM like Cordys
Visit : http://lemtom.com for more details
2. IBM Software Group | Rational software
Performance Tester Version 8.1 in Action
Performance Testing in an Agile Environment – Test early and often!
Rational Performance Tester for the Performance Test Specialist
Rational Performance Tester for the Performance Analyst
2
4. IBM Software Group | Rational software
Performance Requirements Workflow
RQM
Perf RQM
Req Req Test
Plan
Test
RQM
Schedule
Test Test
Case Execution
Perf
Perf Record
Req Perf
Perf
Req Req
Report
Report Req
Report
Report
4
5. IBM Software Group | Rational software
Agile Performance Testing with RQM/RPT
1. Define a Performance Requirement
2. Write the Test Case
3. Capture the Test
4. Set the Performance Metric
5. Run the Test
6. Analyze the Results
5
6. IBM Software Group | Rational software
Define a Performance Requirement
The user story says: “The website user shall be able to access and update the
user’s profile information.”
The performance requirement –
For user profile update operations,
90 percent of the responses must return
in less than 2 seconds
The expected peak workload –
During the busy hour along with other operations,
User profile updates may occur at 2,000 / min
6
7. IBM Software Group | Rational software
Rational Quality Manager
Enter the performance requirement in RQM
7
9. IBM Software Group | Rational software
Capture the Test and Set the Metric
Capture the user scenario
Add the 90th percentile < 2 seconds requirement for update response time
9
10. IBM Software Group | Rational software
Performance Testing in an Agile Environment
Write performance requirements in RQM
Attach a test case defining the workload and performance test
Capture an automated performance test for the feature to be tested
Add the performance requirements to the test
Run the test case which links to the automated performance test
Results of the performance test are automatically recorded in RQM
Repeat the performance test in every iteration’s regression suite
10
11. IBM Software Group | Rational software
Performance Requirements Reporting
Summary of Pass/Fail and Performance Margin
11
12. IBM Software Group | Rational software
Performance Requirements Summary
12
13. IBM Software Group | Rational software
Performance Requirement Margins
13
14. IBM Software Group | Rational software
Performance Requirement Details
14
15. IBM Software Group | Rational software
Performance Requirements in RPT
Define specific request, page, or transaction requirements in test
Define aggregate request, page, or transaction requirements in schedule
Define resource measurement requirements in schedule
Requirements can be on minimum, maximum, average, percentile or std deviation
Quality of the performance test results can also be checked
Verify quantity of good transactions or page hits is large enough
Verify tight enough set of samples – test against standard deviation
Verify small number of errors – test percentage of VPs passed
15
16. IBM Software Group | Rational software
RPT Schedule – Performance Requirement List
16
22. IBM Software Group | Rational software
Test Variables
Different from previous version
Different initialization methods
“Not initialized error” handling at
runtime
Do Nothing
Issue a Warning
Issue an Error
Exit Test
Visibility
All tests for this user
This test only
See variable usage through the
test;
See all assignments to the
variable;
22
23. IBM Software Group | Rational software
Test Variables (cont.)
Set/assignment operator
Set existing variable to
Literal, text value
A value from an Data
Source
Nothing – un-initialize
23
24. IBM Software Group | Rational software
HTTP selecting a random reference from list
24
25. IBM Software Group | Rational software
Test editor support for binary data
25
26. IBM Software Group | Rational software
Test editor support for data transforms
26
27. IBM Software Group | Rational software
Stop test & stop user from custom code
27
28. IBM Software Group | Rational software
Fast test launch
In some cases up to 5x improvement
Sub five second launch on T60
28
29. IBM Software Group | Rational software
HTTP run-time protocol views for any virtual user
29
31. IBM Software Group | Rational software
SmartLoad
Stage
Time period with specified number of users
Users
How many users should run at the same time during
the stage
It is not how many users to add or subtract
Stage Duration
How long the stage should last
It is not the time at which the stage should begin
It begins AFTER all users have been started for the
stage and AFTER any Settle Time
Change Rate
How quickly users should start
Default is to start all users as fast as possible
All / 1 Minute means users for the stage are added or
removed in a random uniform fashion over 1 minute
Settle Time
How long to delay before beginning Stage Duration
Affects when the time range for the stage is created
Allows the System Under Test to “settle” after the
disruption of changing the number of users running
31
36. IBM Software Group | Rational software
Additional Quality Management considerations
drive up costs of remediation
80% of development costs are spent
identifying and correcting defects!
Once released as
During the a product
QA/Testing phase $7600/defect
During the build $960/defect
During the phase
coding phase $240/defect
Traditional QA Testing
$80/defect
25 – 30 % delivery time in testing
Poor upstream quality yields rework
Source: 2008 GBS Industry standard study
Defect cost derived in assuming it takes 8 hrs to find, fix and repair a defect when found in code and unit test. Compressed schedules make it worse
Defect FFR cost for other phases calculated by using the multiplier on a blended rate of $80/hr.
36
37. IBM Software Group | Rational software
Quality Management Challenges & Importance to the Business
Business Transformation through Innovation creates tremendous pressure on IT
Drives to SOA and agile practices for speed to market
Must “Break the Iron Triangle” – traditional methods will not deliver
On time, with fixed budget and improved quality/performance
Quality & performance require continuous, iterative and integrated lifecycle processes
Scope
(features, functionality)
Quality &
Performance
Resources Schedule
(cost, budget) (time)
Quality-enabling activities must start here and involve IT Operations must be tied into the
the entire team lifecycle
Deployment
Analyst Architect Developer Tester Manager
Operations
37
38. IBM Software Group | Rational software
Quality paradigm is changing
Test – functional silo within Quality – A strategic IT
software development competency
Testing addressed by QA Quality considerations addressed
before deployment at all phases
Test as gatekeeper on final Agile iterations involve multiple
release decisions business & technical stakeholders
Distributed, single project Consolidation with internal center
orientation of excellence or outsourcing
Scope – fit for use, reduction Scope – Customer satisfaction and
of application level defects improved business performance
38
39. IBM Software Group | Rational software
IBM Rational raises the bar for Quality Management
Collaborative process, powered by automation to govern software delivery
Mitigate Business Risk Improve Operational Make Confident
Efficiency Decisions
Collaborate Automate Report
Collaborative, continuous, Automating labor-intensive Moment by moment
and comprehensive activities reduces time-to- understanding of software
information sharing reduces market and increases quality metrics for immediate
defects, improves handoff predictability and corrective action and
and increases consistency to improve release decisions addressing
customer satisfaction return on investment both business and IT needs
39
40. IBM Software Group | Rational software
Centralized test management hub allowing full lifecycle
support across all types of testing and platforms
IBM Collaborative Application Lifecycle Management
Rational Quality Manager
Quality Dashboard
Requirements Test Management and Execution Defect
Management Management
Create Build Manage Report
Plan Tests Test Lab Results
Open Platform
Best Practice Processes
JAZZ TEAM SERVER
SAP System z, i
Java Open Lifecycle Service Integrations
.NET
Functional Security and
Testing Performance Code Compliance
Web Service
Testing Quality Quality
homegrown
40