This document discusses a case study of Clearstream's implementation of a collaborative approach to test automation. Key points include: Clearstream wanted to improve automation rates to meet business goals; a collaborative methodology was developed involving functional testers, technical teams, and tool vendors; Odin's Axe automation platform was selected and implemented on a project to automate testing of Clearstream's Xact web portal; the project achieved a 64.4% automation rate and identified lessons around defect management, naming conventions, and challenges automating new functionality.

1. Duncan Brigginshaw
Co-Founder and
Technical Director
Odin Technology Ltd
Realisation of a
Collaborative
Approach to Test
Automation

2. Realisation of a Collaborative Approach to Test
Automation
www.odintech.com
A case study in post-trade
settlement and reconciliation at Clearstream
Duncan Brigginshaw
Co-Founder and Technical Director, Odin

3. www.odintech.com
Agenda
• Introduction
• Background and Business drivers
• Defining a collaborative approach to functional test
automation
• ClearstreamXact Portal and 1CSR Project
• Lessons and Conclusions
Duncan Brigginshaw
Technical Director - Odin

4. www.odintech.com
Introduction
• Deutsche Börse AG
• Diversified exchange organisation with wide range of
products and services
– Listing and Trading, Clearing, Post-Trading, Market-
Data and Services
• International Central Securities depository (ICSD) -
Luxembourg
• Post-Trade Infrastructure and Securities service provider
• Central Securities Depository (CSD) – Frankfurt
• QA Software Vendor
• Providers of the Axe Enterprise Test Automation
Platform

5. www.odintech.com
Background and Business drivers
Duncan Brigginshaw
Technical Director - Odin
• Functional GUI Automation key to achieving business goals
• History:
• Isolated GUI Automation in Business Units
– Primarily HP Products
– Technical in Nature
• Centralised Automation framework developed in-house
– Expensive to build and maintain
– In-Flexible – Proprietary to HP
– Not-Business Oriented
• GUI Automation rates not inline with Business goals

6. A collaborative test automation approach
www.odintech.com

7. www.odintech.com
Stages
Duncan Brigginshaw
Technical Director - Odin
• High Level Vision – Define a Collaborative Automation Methodology
• “Involve Functional Analysts/Testers in Automation”
• Requirements
– Script-less business focussed automation architecture
– Execution Tool Independent (HP + Selenium)
– Future Proof
– Compatible with current HP ALM Infrastructure
• Process
– Initial Research and RFP
– Matrix Scoring on Requirements
– Shortlisted Vendor Proof of Concept
– Vendor Selection
– Rollout Methodology Defined with Vendor Support
– Initial project identified to prove and refine the approach

8. www.odintech.com
Teams and Geography
Business
Units
Technical
Test and
Tools
Tool
Vendors
Functional
Testers
(Offshore)
Application
Development
(Offshore)
Functional
Testers
(Nearshore)

9. www.odintech.com
• Functional Acceptance Criteria (FAC)
• Test Cases
• Test Design
• Technical Tool Support
• Supporting Tool Infrastructure
Skill sets and Asset Focus

10. www.odintech.com
Clear Matrix of Roles and Responsibilities

11. www.odintech.com
HP ALM Central to Test Asset Mgmt.
HP ALM
Business
Units
Technical
Test and
Tools
Functional
Testers
(Offshore)
Functional
Testers
(Nearshore)

12. Business
Units
www.odintech.com
Asset Creation
• Functional Acceptance Criteria (FAC) + Test Case / Condition Design
Excel Template
• Import Creates linked
Requirements and Tests in HP
ALM automatically
HP ALM
Import

13. Technical
Test and
Tools
www.odintech.com
Asset Creation
Technical Test Assets Creation
Axe Automation Platform
• Project Setup
• Supporting Custom Code
• Added to ALM Test Resources
HP ALMHP UFT

14. www.odintech.com
Asset Creation
Functional Test Design / Definition
Functional
Testers
(Offshore)
Functional
Testers
(Nearshore)
Axe Automation Platform
• Test Design Steps and Automation
Code generated automatically
HP ALM

15. www.odintech.com
Test Execution
• Automated Tests Scheduled and
Executed
HP ALM
• Results and Acceptance Criteria
Coverage Captured
HP UFT

16. The Initial Project:
ClearstreamXact
Web Portal
www.odintech.com

17. www.odintech.com
ClearstreamXact WebPortal
Duncan Brigginshaw
Technical Director - Odin
• ClearstreamXact
– Framework for access to Clearstream
ICSD and CSD Services
– Settlement, Cash Management, Asset
Servicing, Collateral Management,
Securities Lending, Fund Services
• Xact Automated access
• Xact Web Portal (GUI)
• Clearstream Settlement and
Reporting
– TARGET2 and Global Securities
– Instructions, Positions, Cash and
Securities

18. www.odintech.com
Project Snapshot
Total
75%
Manual
Automation
Functional Acceptance Criteria
Automated
Not
Automated
64.4%
of Target
(45% of Total)
U
Completed
35%
Not
Completed
ForecastTarget

19. www.odintech.com
Project Timeline & Progress
Completed
Not
Automated
Automated
64.4%
Month 1 Month 2 Month 3 Month 4 Month 5

20. www.odintech.com
Duncan Brigginshaw
Technical Director - Odin
• Application Build and Delivery
– Daily Updates
– Weekly Delivery
• Testing
– Subset of Tests Run Daily
– Full Regression Pack of Tests run Weekly
– 12hr Execution Across 12 Machines
Application Build and Test Regime

21. www.odintech.com
Lessons and Conclusions
Duncan Brigginshaw
Technical Director - Odin
• Lessons Learned - Refinements:
– Requirement for automated test failure triage process
– Defect management for automation (separate to development)
– Asset naming conventions needed early in the project
– New functionality found more challenging for automation than regression
• Collaboration was key in automation success
• Important to define clear roles and responsibilities
• Leveraging relevant skills and expertise in the appropriate Mix
• Collaborative methodology and selected tooling is proving successful
over manual testing and previous automation

22. Thank-you!
odintech.com
info@odintech.com