How FinancialForce Engineering uses eazyBI and Adaptavist Test Management as part of our core infrastructure, to provide management visibility and oversight across a global R&D organization, with over 20 scrum teams. - Paul Hardaker, Director of Development Operations, FinancialForce

1. Successful Lean Agile with eazyBI and
Adaptavist Test Management
Paul Hardaker
Director, DevOps & Best Practices
May 2018

2. Confidential | Restricted to FinancialForce 2
All non-public information in this presentation is FINANCIALFORCE CONFIDENTIAL. This presentation and related
discussions may refer to planned or proposed products, services, features or functions. Any unreleased products,
services, features or functions mentioned in this or other presentations, press releases or public statements are not
currently available and may not be delivered on time or at all. Customers who purchase our products or services
should base those purchase decisions on features and functions that are currently available. FinancialForce assumes
no obligation and does not intend to update any statements about future products, services, features or functions.
Disclaimer

3. 1,300 Solutions 735+
Services Automation, Subscription
& Usage Billing, Revenue
Recognition & Forecasting,
Financial Management
SF+FF 38% YoY Investors
Customers in 34+ countries
With users in 50+ countries
Employees across 7 offices
HQ in San Francisco, CA
UK & EMEA HQ, Harrogate
Subscription revenue growth#1 ERP on Salesforce
The largest native Salesforce
partner
Salesforce
TCV
Unit4
Advent International
About us
Confidential | Restricted to FinancialForce 3

4. Confidential | Restricted to FinancialForce 4
Our customers

5. Confidential | Restricted to FinancialForce 5
Visibility & Achieving Our Goals

6. Confidential | Restricted to FinancialForce 6
Customer Success
Continuous Build & Test
Internal Quality
Feature Delivery
Global Organisation
Successful Lean Agile at Scale
Lean Priorities
25 feature crews
UK
Spain
San Francisco
Jaipur, India

7. Confidential | Restricted to FinancialForce 7
All data in the following presentation is taken from an
Agile Project sandbox:
● Not indicative of real data or trends
● Data has been exaggerated for certain reports to show how trends
appear and can be managed
Safe Harbour

8. Confidential | Restricted to FinancialForce 8
Defects by Product & Severity
Customer Success - Summary
Defect Trend - Created &
Resolved
Datasource: JIRA

9. Confidential | Restricted to FinancialForce 9
Defects Created & Resolved
Customer Success - The Details
Datasource: JIRA

10. Confidential | Restricted to FinancialForce 10
Visibility into:
● Defect age
● Defect priority
Encourage:
● Zero defect backlog
● Fix defects you bring into
a sprint
● Drive behaviour towards
low defect age
Datasource: JIRA
Customer Success - Defect Age
Datasource: JIRA

11. Confidential | Restricted to FinancialForce 11
Visibility into:
● Queue size
● Cycle time
● Bottlenecks
Encourage:
● Small queues
● Low cycle time
Customer Success - CFDs
Datasource: JIRA

12. Confidential | Restricted to FinancialForce 12
Visibility into:
● Cross Product Integration
● Tier 1 and Tier 2 Builds
Encourage:
● Fix blockers immediately
● Constantly clean builds
Build and Test - Summary
Datasource: JIRA

13. Confidential | Restricted to FinancialForce 13
Visibility into:
● Detailed CI pipeline
stages
Build Time Improvement
● Where to target effort
Build & Test - Pareto Analysis
Datasource: SQL

14. Confidential | Restricted to FinancialForce 14
● Leading enterprise test management
solution, fully and seamlessly
integrated into JIRA
● Complete traceability across
requirements, test cases and
execution results
● Rich REST API for integration with CI
tooling
Test Management 4 JIRA

15. Confidential | Restricted to FinancialForce 15
Test case results over time
● Test flakiness
● Regressions
Test case performance
bottlenecks
● Improve CI feedback
times
Adaptavist Test Management

16. Confidential | Restricted to FinancialForce 16
Periodic scans of code base via
CI using CheckMarx.
Visibility into:
● High/Medium/Low priority
security vulnerabilities
Encourage:
● High priority triaged
immediately and kept at zero
Build and Test - Security Static Analysis
Datasource: REST API

17. Confidential | Restricted to FinancialForce 17
Story CFD
● Queues
● Bottlenecks
● Cycle time
Summary of in-flight epics for
current release cycle
Feature Delivery - Epic Status and Story CFDs
Datasource: JIRA

18. Confidential | Restricted to FinancialForce 18
Visibility into:
● In-progress story age
● Sprint overrun
Encourage:
● Lean flow - rapidly add
value to the product
Feature Delivery - Story Ageing
Datasource: JIRA

19. Confidential | Restricted to FinancialForce 19
● Use metrics to encourage desired
behaviour
● Metrics are complementary - one graph
rarely tells the whole story
● Review regularly - not just pretty
pictures!
● Hit your targets - high quality software,
regular feature delivery, on time
Key Takeaways

20. Thank you