How Citrix validates end-to-end business processes with Worksoft automation software to save time and money – all while improving the quality of enterprise systems. Originally presented by Moazzam Naim at SAP TechEd && d-code 2014 Las Vegas.

1. © 2014 Worksoft, Inc. www.worksoft.com
How Citrix Manages Change in a Multi-App, Multi-Device, Hybrid Cloud World
MoazzamNaim, Citrix

2. 2
© 2014 Worksoft, Inc. www.worksoft.com
Citrix Systems, Inc. –Founded in 1989 in Fort Lauderdale, Florida
We make IT simpler, and people more productive
Enable people to work from any place
Provide services to around 330,000 organizations
Over 100 million global users
$2.9 billion annual revenue in 2013
About Citrix

3. 3
© 2014 Worksoft, Inc. www.worksoft.com
Global leader in mobile workspaces providing:
•Virtualization of servers, applications, data and desktops
•Mobility management
•Networking
Citrix Offerings

4. 4
© 2014 Worksoft, Inc. www.worksoft.com
Citrix Business Technology Solutions (BTS):
•The “IT application” team
•Develops solutions for Citrix departments according to their needs and demands
•BTS’s customers include:
Marketing
Sales & Channel Ops
Backoffice
Finance
•The BTS technology landscape includes a variety of systems:
Cloud based SaaS applications (SFDC, Marketo, Callidus…)
Data center hosted (SAP, MDM, BI systems)
Custom built web applications
•The BTS QA team is responsible for ensuring the quality of BTS solutions
Citrix Business Technology Solutions

5. 5
© 2014 Worksoft, Inc. www.worksoft.com
BTS Technology Landscape

6. 6
© 2014 Worksoft, Inc. www.worksoft.com
SAP Technology Landscape

7. 7
© 2014 Worksoft, Inc. www.worksoft.com
Implement operationally-effective and cost-efficient solutions
(one side effect is increasingly varied solution technologies)
Enable continuous alignment of IT solutions with business needs/demands
Implement enhancements with minimal costs
Reduce downtime / prevent production issues
Citrix Needs and Drivers

8. 8
© 2014 Worksoft, Inc. www.worksoft.com
Ensure quality of BTS solutions
•Capability to test End to End solution
E.g. Lead to cash E2E test scenarios requiring validations from multiple business processes
Reduce UAT burden on customers
Meet customer objectives
•Reduce “time-to-market” -Marketing, Sales & Channel operations teams
•Ensure “top quality solutions” -SCM, OTC and HR teams
•Lower the cost of quality
Meet quality standards across SDLC models
•Waterfall (achieve complete test coverage)
•Agile (support continuous integration)
Quality and Testing Needs

9. 9
© 2014 Worksoft, Inc. www.worksoft.com
Until 2 years ago testing was 100% manual
Due to project growth, testing scope is expanding exponentially
Handling expanded scope through manual testing is:
•Increasing the quality cost
•Increasing time to market
•Increasing UAT burden
•Reducing testing coverage
•Increasing quality risks
•Creating hurdles in implementing Agile
Reduced customer confidence in project teams’ capabilities
Quality and Testing Challenges

10. 10
© 2014 Worksoft, Inc. www.worksoft.com
Empowers us to achieve project quality objectives
Ability to validate business processes across our complex enterprise application landscape –SAP and non-SAP
Worksoft Certify test suite’s ability to bundle different automated test scripts in the same suite.
•E.g. End to End testing of SAMRI business processes
•End to End testing of Lead to Cash business processes
Extensive built-in library of SAP functions
Interfaces that support various technologies:
•SAP, Web, SOA, .Net, Java, Silverlight, VB, Office and many more
Why Worksoft Automated Business Process Validation?

11. 11
© 2014 Worksoft, Inc. www.worksoft.com
Data driven test automation and ability to connect to databases:
•Enables automated test data preparation for Certify automated regression test suites
•Enables automated data capture verification for executed transactions
Dynamic data correlation between multiple test scripts via Certify record sets:
•Certify record sets provide read as well as write capabilities into the data pool
•Dynamic input data is generated at run time without manual intervention from SMEs
•This capability enables our automated E2E test suites to leverage output data from preceding test script as the input data for following test scripts.
Why Worksoft Automated Business Process Validation?

12. 12
© 2014 Worksoft, Inc. www.worksoft.com
We hired our first Test Automation engineer about 2 years ago
Started with development of a test automation framework for business critical BTS solutions
Gathered feedback from customers as well as functional, technical and testing SMEs to identify top test scenarios for automation
Started with the creation of automated end to end “Smoke testing” suites for the most business critical processes:
•Defined test automation qualification criteria on following factors:
Business value of test scenarios
LOE for test automation
Frequency of test execution
Automation Approach

13. 13
© 2014 Worksoft, Inc. www.worksoft.com
Adopted data driven automated testing approach to:
•Enhance reusability of test suites across multiple test scenarios through data variations
•Remove dependency on SMEs for input test data
Adopted hybrid testing coverage engaging both automated and manual testing capabilities
Hybrid testing approach allowed expansion of test automation across the breadth of BTS landscape instead of digging deeper
Hybrid testing approach allowed us to automate more end to end test scenarios, as opposed to being limited to component level test automation
Automation Approach

14. 14
© 2014 Worksoft, Inc. www.worksoft.com
Positive ROI after 1styear:
•With just 2 test automation engineers, 10% of 2014 SAP Support pack testing was automated in the first year
Officially launched Test Automation team in May 2014
•Test automation team now consists of 7 team members
•Purchased 4 additional Certify licenses in 2014
•Funding approved to automate about 30% of BTS testing in 2015
Test automation is in full swing for:
•2015 SAP Support Pack (Planned to automate 30%)
•SAMRI regression testing (One of our top revenue generating apps -30% completed)
•Quarterly QA Refresh Validation (50% completed)
•Quarterly Sales Territory Realignment (50% completed)
Results –What Has Been Achieved

15. 15
© 2014 Worksoft, Inc. www.worksoft.com
•Through Worksoft Certify automated regression testing suite, we are able to:
Improve business confidence in BTS capabilities
Increase operational efficiency by:
•Expanding our testing coverage
•Reducing reliance on SMEs
•Allowing SMEs to utilize their time more effectively
Improve business agility by:
•Delivering solutions faster
•Reducing test execution time
Achieve cost savings by:
•Reducing UAT burden on business users
•Catching defects earlier
Mitigate technology risks & improve quality by:
•Expanding testing coverage
•Reducing production defects
Results –Business Benefits