RallyOn 2014 Europe - Agility measurement: in quest of gold standard
•Download as PPTX, PDF•
1 like•393 views
Every measurement should have something to rely upon, the reference, the gold standard. But what to compare to in Agile? We are sure, anyone who tried to "measure Agility" have asked himself this question. We would like to share our own quest of searching the answer during development of own internal corporate agility measurement approach. Challenges, pitfalls, solutions and results, and what is the most important – insights we’ve got along the way.
Recommended
Recommended
More Related Content
What's hot
Similar to RallyOn 2014 Europe - Agility measurement: in quest of gold standard
Similar to RallyOn 2014 Europe - Agility measurement: in quest of gold standard (20)
Recently uploaded
Recently uploaded (20)
RallyOn 2014 Europe - Agility measurement: in quest of gold standard
- 1. Agility Measurement: In Quest of Gold Standard Oleksandr Zhebryakov & Vadim Izdebskiy
- 2. 2 • Ciklum — Own Development Centers for client’s growth ○ 2500 IT Specialists ○ 200+ Clients • 80% of our customers use Agile * Context: Ciklum
- 3. 3 * Common questions we hear: • What other clients do to be successful? • Where am I, compared to other clients?
- 4. 4 • Nearshore team is getting up-to-speed • Onshore and Nearshore teams alignment • Periodically analyze improvement and compliance to Agile practices * Client needs • Adopt Agile • Periodically analyze improvement Already Agile1 Agile wannabees2
- 5. 5 * In search of an agility measurement system • Mike Cohn’s “Comparative Agility™”: • Online Survey • Compare yourself to other survey participants • Five-point Likert scale: • True • More true than false • Neither true nor false • More false than true • False • Seven dimensions: • Teamwork • Requirements • Planning • Technical practices • Quality • Culture • Knowledge creation
- 6. 6 Why? • Quality of data • Own set of questions • Flexibility of own platform * CAMS: Ciklum way
- 7. 7 • 15 pilot teams • Individual interviews * CAMS: Inception • People are subjective • Questions are interpreted in a different way How it was: Findings:
- 8. 8 * CAMS: Maturing • Face-to-face facilitated group workshops • “Planning poker”-like voting • 85 teams • Data slicing
- 9. 9 • Big effort * CAMS: Findings • High quality data • Small volume of data • Apples to apples comparison 5
- 10. 10 • Compliance to Agile practices • Comparison of 7 teams * CAMS: Results • QA integration in Agile teams • Define Site Manager’s role in Agile • Compliance of Malta teams to Agile practices • Plan for Ukrainian teams kick-off Payment system Media company Apps development company
- 11. 11
- 12. 12 * Process Compliance Approach • Agility compliance tool • Tool for assessment at team level • Root cause analysis Examples: CAMS or Comparative Agility™
- 13. 13 * Performance Measurement Approach • Tool for the delivery performance measurement • Good to identify symptoms Source: Rally Software Development Corp. Example: Rally Insights™
- 14. 14 • Effortless * Rally Insights™ • High data quality • Large volume of data • Apples to oranges comparison
- 15. Use during process assessment and solution mapping • How my teams compare to each other and to teams within other companies with regards to processes? • Are we improving our Agile process? • What is a root-cause of a particular symptom of bad delivery? * Two approaches: how and when? Regular usage • Do we meet goals for s/w delivery? • Are we improving our performance and quality? • How our delivery performance compares to others? Performance Measurement Process Compliance 15
- 16. FREE HUGS 16 * Thanks for your time!
Editor's Notes
- My name is Vadim [and Oleksandr], we are working in Ciklum, which is the mainly outsourcing company, but we represent Consulting department specialized in Agile Business Transformation at Scale. So we are Agile consultants. We will tell the story about how we help our mother company to develop Agility measurement approach. It was quite a challenge and we would like to share lessons we learned.
- Ciklum is Danish-owned Ukrainian-based outsourcing company which operates in Scandinavia, Western Europe, Israel, USA and of course in UK Unique Ciklum business model provides platform for transparent and direct collaboration between Clients’ onshore and offshore teams and management Of course, Agile methods were designed to work in such environment And naturally, 80% of our clients use Agile methods
- We have a lot of clients, and we practice Networking Events for them. They value them as the got answers to their main questions: … clients are different and they have a different needs, however Agile is always very hot topic at such events
- Because we are Agile consultants , all clients for us fall into two categories: those who already implemented Agile and those who know that it is successful and they want it … To help our clients to satisfy their needs, we started looking for a tool
- Question to the Audience: Who knows Mike Cohn? Who had experience with his Comparative Agility assessment? Example of statement: Most code is written using TDD People are not on more than two teams We found this idea brilliant, but we wanted to have our own implementation
- We didn’t like quality of data: anyone could put there “crap”, and we couldn’t control it We wanted to extend questions set with our own questions We wanted potential ability to add features if we need them We afraid that Comparative Agility will not develop further
- We’ve chosen 15 teams to apply survey to We wanted it to be objective, so we didn’t fill survey ourselves, instead we talked to the person from inside the team What we saw were: Wishful thinking Same situation is seen by people at different angles Misunderstandings and misinterpretations
- Question to the Audience: who played Planning Poker? We gave ability for clients to compare their teams against 85 other clients’ teams Client start asking: who do you compare me to? I want to compare against my competitors or just similar companies. (Digital Agencies are very different form product companies, etc.) Is it possible? Yes, we adjusted our SW with slicing functionality to compare via: Business type Industry Technologies Size
- But quantity of data immediately became not sufficient Ideal approach would satisfy all 4 of the parameters
- Our approach is not ideal but we could help our clients with different needs … Question to Audience: based on the cases you just have seen, what our approach missed? Let’s take a look to example with payment system deeper
- Our system shows standard deviation from average, both positive and negative, so you can tell if you are doing better or worse than average. Average is zero on this snapshot. This results of one of the 7 teams Other teams are very close Results are very good Question to the Audience: what about delivery? The answer: we don’t know!
- We finally understood that there are approaches to measure Process Compliance, like CAMS or Comparative Agility You can use them as an additional source of information for assessment at the team level Depending on the implementation you can use it as a tool for Root Couse Analysis. For example, in CAMS, we have facilitated team meetings, and this allows us to uncover real problems
- There are also approaches and tools to measure Performance They will allow you to see if your Agility provides you with real results You can think of the tool that shows you important KPIs or metrics of your team (TomTom case from yesterday), but real value you get when you can compare to others Good example is Rally Insights
- … We see huge demand on the market for Agile Measurement tool. We see that the best tool should able to compare your results with you industry peers, to show you where you are. So we are really looking forward to the new developments in this area. We hope, so are you.