Atlassian Summit 2015 Lean QA and Agile Testing presentation by Giancarlo Bisceglia and Maurizio Mancini

1. GIANCARLO BISCEGLIA • SENIOR QA MANAGER • @GIANCARLOBISC
How to Build in Quality
from Day 1 using
Lean QA and Agile Testing
MAURIZIO MANCINI • AGILE COACH/AGILE EVANGELIST/QA DIRECTOR • @QAANDPROCESSGUY

2. • Big cool statistic
• 2,56
9
• Add-Ons in Marketplace

3. Not Business as Usual

4. QA works closely with the Dev Teams to help
deliver a quality product to all end users.
James Whittaker

5. QA is there to enable developers to
build better software.
James Whittaker

8. Test in Quality

9. PO
DEV
BA
QA
DEVOPS
Build in Quality from the Start!

10. Quality is Free!

11. Valuable Features

13. Is this world possible?

15. We are…
Maurizio Mancini
• Senior QA Manager
• 15+ years of software engineering experience
Giancarlo Bisceglia
• Agile Coach, Agile Evangelist, and QA Director
• 25+ years of software engineering experience

16. Head of Product A
Product Owner
Scrum Master
Developers
QA
User Experience
DevOPS
Head of Product B
Product Owner
Scrum Master
Developers
QA
User Experience
DevOPS
Head of Product C
Product Owner
Scrum Master
Developers
QA
User Experience
DevOPS
QA
GUILD Lead
Lead
Lead

17. What this QA Guild was Testing

18. Tools We Used

20. Quality is a Team Sport

22. Agile Team Structure
and Quality Article
http://tinyurl.com/pe79dzj

23. Lean QA

24. The core idea is to maximize customer value
while minimizing waste. Simply, lean means
creating more value for customers with fewer
resources.
LEAN.ORG
“
”

25. The 3 M’s of Lean
OVERBURDEN
WASTE
UNEVENNESS
MUDA
MURI
MURA

26. WASTE

27. Sources of Waste in Testing
WASTE
Excessive
Documentation
Test
Everything
Find all
the Bugs
Complete
Regressions
Automate
Everything
End to End
Testing
Test
Everything
Find all
the Bugs

28. Risk Based Testing

29. System Risk Assessment
5 High
4
Test Scope
Items
Test Scope
Items
3 Moderate
2
Test Scope
Items
1 Low
1 2 3 4 5
Likelihood
Impact

30. Trying to Find all the Bugs

31. Cost of Finding and Fixing a Bug
LIVE
100
10
100
10
Bug 1 - Hard to Find
Bug 2 - Easier to Find
50 50
AfterBefore

32. Agile Testing

33. Is It?

34. Test Early
Test Often
PO
DEV
BA
QA
DEVOPS

35. Test the
Right Stuff
Use Optimal
Methods

36. How we Build in Quality

37. • Big cool statistic
• 2,56
9
• Add-Ons in Marketplace
Technical ?

38. • Big cool statistic
• 2,56
9
• Add-Ons in Marketplace
Does the scrum master stand alone ?

39. Process

40. Big Diff
Agile
Incremental & Iterative
Development

41. Let’s be
honest
Definition of Done:
Have a plan to tackle test automation
Test Automation:
Needs to be planned in a sprint
Manual Regressions:
Make sure everyone agrees

42. Development

43. Feature Dev Release Master
New Feature
Merge Dev Changes
Merge Feature to Dev
Ready for Release
Deploy to Production
Hot Fix
Feature Branching Strategy

44. Feature Dev Release Master Hot Fix
Deploy to Production
Urgent Bug Fix
Merge Fix to ReleaseMerge Fix to Dev
Hot Fix Branching Strategy

45. Leverage Continuous Integration
The Team

46. Testing

47. No limits

48. Breakdown the Test Effort
Unit and
Integration
Automated
Functional Tests
Manual (UI/UX) Performance BDD UAT
Tests
Owner Developers QA Engineers
QA Engineers
QA Analysts
Product Owner
QA Engineers Product Owner
QA Analysts
Type White Box Black Box Black Box Black Box Black Box
Complexity
Focus
Low Level
Correctness
Maintainable
Negative tests
TDD
Mid Level
Extreme cases
Negative tests
UI Regression
Failure tests
Mid Level
Positive tests
SIT
Exploratory
High Level
Scalability
Robustness
Reliability
High Level
Business Flows
BDD/ATDD
Environment CI driven automated deployments

49. Feature Dev Release Master Hot Fix
Testing We Use by Branch
Manual
Exploratory
Performance
(Optional)
Manual SIT
UAT
Unit
Automated
Functional
Manual
Exploratory
UAT UAT
Performance
Unit Unit
Automated
Functional
Automated
Functional
Automated
Functional
Automated
Functional

50. Traceability with Atlassian

51. Requirements are maintained in Confluence
Traceability starts with requirements in Confluence
and Epics linked in JIRA Software

52. Traceability Continues with links to User Stories in JIRA Software

53. All Sub-Tasks Tracked

54. JIRA Software is the Hub

55. JIRA Software sprint details

56. Commit and Code Review
Details

57. Communication Is Key

58. Notifications are Key

60. Test Results Directly in JIRA Software Test Case Details Too

61. Is it possible in
your world?

62. You will never convince people to work
towards this goal.
“
”

63. That will never happen here,
our culture is just not right.
“
”

64. We just don’t have the time to do it right…“ ”

65. Would you rather…

66. Do it right the first time
Hack it and get it out
Or

67. Work on delivering
valuable features to our
customers
Re-work
and fix bugs
Or

68. Spend precious
budget delivering
value to our company
Spend precious
budget on rework
Or

69. Be on a team that is
proud to stand behind
their software
Be on a team that is
ashamed of their
software
Or

70. Key Takeaways

71. Reduce Waste in Testing…

72. Continuous
Integration
is Essential

73. Test Automation
is Essential

74. Build in Quality
rather than
Test it in
PO
BA
QA

75. Full Traceability
with Atlassian
and TestRail
Test Results Directly in JIRA Software

76. Thank you!
GIANCARLO BISCEGLIA • SENIOR QA MANAGER • @GIANCARLOBISC
Agile Team Structure and Quality Article
http://tinyurl.com/pe79dzj
MAURIZIO MANCINI • AGILE COACH/AGILE EVANGELIST/QA DIRECTOR • @QAANDPROCESSGUY

77. Sources
https://notforprintmag.files.wordpress.com/2012/02/imagine2.jpg
https://upload.wikimedia.org/wikipedia/commons/6/6f/100_sculpture.jpg
http://www.flickr.com/photos/36495803@N05/8463683689 - Money
https://upload.wikimedia.org/wikipedia/commons/9/99/Flickr_-_Official_U.S._Navy_Imagery_-
_Commander_exchanges_thumbs_up_signals_after_pre-flight_checks..jpg
https://upload.wikimedia.org/wikipedia/commons/2/28/Duct-tape_Moving_Van.jpg
https://farm3.staticflickr.com/2348/2061072441_e3ca379d19_o_d.jpg - Burning Money
https://upload.wikimedia.org/wikipedia/commons/thumb/a/ad/Centreville_High_School_(Virginia)_1998_
%C2%B7_DD-SP-99-04111.JPEG/1280px-Centreville_High_School_(Virginia)_1998_%C2%B7_DD-SP-99-04111.JPEG
http://s3.amazonaws.com/media.wbur.org/wordpress/11/files/2014/09/0926_Sydney-Swans-
Richmond-624×367.jpg
http://www.cf-promotion.it/img/lomb2.jpg
http://www.debbiemyerscommunications.com/writing.jpg
http://www.sportevai.it/file/2014/12/F1.jpg
http://www.cyclebradford.org.uk/wp-content/uploads/2012/08/breeze-in-the-park.jpg

78. Sources
https://dgraphicstyle.files.wordpress.com/2013/04/el-arte-de-comprender.jpg
http://i.cbc.ca/1.3032607.1429034973!/cpImage/httpImage/image.jpg_gen/derivatives/16×9_620/top-
toys-20091116.jpg
http://www.wallpapersis.com/wallpapers/2014/10/ferrari-458-italia-car-485×728.jpg
https://s-media-cache-ak0.pinimg.com/236x/b1/1e/0a/b11e0ac8970fca0fccdac35d1f9e58a0.jpg
http://www.britsonpole.com/wp-content/uploads/2010/03/podium.jpg
http://10pix.ru/wp-content/uploads/2015/02/121.png
http://amonika.com/wp-content/uploads/2012/01/Definition-of-a-third-world-country-AMonika.com_.jpg
https://unbreakablepo.files.wordpress.com/2010/06/bulletproofpostpo.jpg
http://www.excella.com/wp-content/uploads/2012/11/123rf-RugbyScrum2.jpg
http://www.theplaidzebra.com/france-just-made-it-illegal-for-supermarkets-to-waste-food-punishable-by-75000-
or-jail/
http://www.looknreview.com/wp-content/uploads/2015/06/samsung-mobiles-8.jpg
http://www.geeky-gadgets.com/wp-content/uploads/2013/11/iphone-5s2.jpg
http://www.imore.com/sites/imore.com/files/styles/large/public/topic_images/2014/
topic_ipad_air_ipad_mini_0.png?itok=053pCsJ2
http://comp-neo.ru/images/stories/webdesign.jpg