How We Became World Leaders in Agile Data Warehousing - Teradata Partners - October 2013

3,099 views
3,074 views

Published on

Presentation at the Terdata Data Partners User Group conference in Dallas, TX on 24th October 2013.

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
3,099
On SlideShare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
36
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

How We Became World Leaders in Agile Data Warehousing - Teradata Partners - October 2013

  1. 1. How We Became World Leaders in Agile Data Warehousing Em Campbell-Pretty General Manger. Strategic Delivery (EDW) Business Intelligence CoE, Telstra @PrettyAgile
  2. 2. The Enterprise Data Warehouse 80 TB of business data 3 TB of new data per month 400 million records loaded daily 47 business systems feeding into the EDW 28 Teradata nodes 13 billion records extracted daily 350 SQL users 43 billion records in largest table 124 different client apps 4 tables with over 35 billion records 16K tables, 28K views and 2K macros 6.8 million queries daily 7K jobs running daily 21K processes
  3. 3. The Team
  4. 4. The Results        Average delivery cycle time down from 12 month to 3 months Frequency of delivery increased from quarterly to fortnightly Cost to deliver down 50% 95% decrease in product defects 100% projects delivered on time and on budget Happy project sponsors Happy teams
  5. 5. WHERE SHOULD YOU START?
  6. 6. START WHERE YOU ARE http://www.flickr.com/photos/joelogon/4613630072/
  7. 7. Read, Understand, Adapt & Apply
  8. 8. http://www.flickr.com/photos/duluoz_cats/5300924038/
  9. 9. Wide Pipes & Batch Patterns
  10. 10. Agile Pilot
  11. 11. 5 “Wagile” Teams
  12. 12. Image source: http://www.vectorloft.com/img/purple-person.jpg
  13. 13. www.scaledagileframework.com
  14. 14. Structuring the Agile Release Train Pipeline Services Deployment Services Development Services PRESENTATION TITLE | PRESENTER NAME | DATE | 17
  15. 15. Agile at the Program Level PRESENTATION TITLE | PRESENTER NAME | DATE | 18
  16. 16. MAKE THE INVISIBLE INVENTORY VISIBLE
  17. 17. Reduce Batch Size by Breaking Down the Work
  18. 18. Agile Feature Teams PRESENTATION TITLE | PRESENTER NAME | DATE | 21
  19. 19. Scrum Provides Cadence & Fast Feedback Image Siource: http://innolution.com/uploads/misc/Essential_Scrum_Chapter_2.pdf
  20. 20. Smaller, Multi-skilled Teams Counter Balance Variability Project Manger Technical Lead Test Lead Scrum Master Developer Developer Developer Developer Developer As is Project Manager As was Scrum Master Product Owner Business Analyst Change Lead Vender Project Manger Technical Lead Business Intelligence Logical Data Modeller On Site ETL On Site ETL Physical Data Modeller On Site ETL Off shore ETL Physical Data Modeller Off shore ETL Off shore ETL DBA Test Lead Test Analyst Enterprise Architect Data SME
  21. 21. Scale the Product Owner to Balance Centralised & Decentralised Control EPIC OWNER FEATURE OWNER PRODUCT OWNER
  22. 22. Extreme Programming Improves Quality Extreme programming improves quality
  23. 23. Limiting Work in Process (WIP) Improves Flow
  24. 24. The System Team PRESENTATION TITLE | PRESENTER NAME | DATE | 27
  25. 25. Build the Infrastructure to Enable Economically Viable Smaller Batches
  26. 26. The Agile Release Train PRESENTATION TITLE | PRESENTER NAME | DATE | 29
  27. 27. Cocktail Hour Proves a Daily Communication Cadence 9:00am 9:15am 930am 9:45am
  28. 28. Unity Day Leads to One Team Culture
  29. 29. A Little Taste of Our Culture http://www.prettyagile.com/2013/05/the-power-of-haka.html
  30. 30. The Software House of Lean Respect for People Product Development Flow Kaizen
  31. 31. The Principles of Product Development Flow 1. Take an economic view 2. Actively manage queues 3. Understand and exploit variability 4. Reduce batch sizes 5. Apply WIP constraints 6. Control flow under uncertainty: cadence and synchronization 7. Get feedback as fast as possible 8. Decentralize control
  32. 32. Respect for People: The Net Promoter System (NPS) Net Promoter Score Source: http://www.netpromotersystem.com/
  33. 33. Kaizen Mindset: Continuous Improvement and Learning Culture Source: https://dl.dropboxusercontent.com/u/1018963/Articles/SpotifyScaling.pdf
  34. 34. The Foundation is Servant Leadership
  35. 35. “This is probably the most well-scaled agile data warehousing group I’ve ever observed, and they are still getting better” Ken Collier Director of Agile Analytics at Thoughtworks & author of Agile Analytics Source: http://theagilist.com/2013/09/03/scaling-agile-data-warehousing/
  36. 36. WHERE SHOULD YOU START?
  37. 37. START WHERE YOU ARE http://www.flickr.com/photos/joelogon/4613630072/
  38. 38. "Adapt what is useful, reject what is useless, and add what is specifically your own." - BRUCE LEE
  39. 39. Want to Know More About the EDW Agile Release Train? Check out my blog: www.prettyagile.com • • • • • • • A Perspective on the Scaled Agile Framework What Happens to Project Managers When You Implement SAFe? The Power of Haka Book Clubs at Work – Are You Serious? Leading Through Vulnerability The "Bubble Up" Approach to Scaling Retrospectives Bookshelf
  40. 40. Email: Emily.Campbell-Pretty@team.tesltra.com Twitter: @ PrettyAgile PARTNERS Mobile App InfoHub Kiosks teradata-partners.com

×