This document discusses Tuleap's strategy for finding and reducing bugs before releasing software. It focuses on releasing early and often through dogfooding on tuleap.net and my.enalean.com, leveraging development builds, and implementing extensive testing and code reviews. Every commit undergoes unit, integration, and end-to-end testing and code reviews through Gerrit. Tuleap also dogfoods its own releases through "La Valid" each month to further identify bugs. This process has helped reduce the number of bugs reported by customers over the past 12 months.

1. #TuleapCon2017 @TuleapOpenALM
What do we do to find bugs before you ?
Tuleap Enterprise Quality Assurance
Manuel VACELET
Enalean CTO

2. #TuleapCon2017 @TuleapOpenALM
Challenge : How to produce software without (too much) bugs
●
Tuleap is growing at a rapid pace
●
Deal with complexity (tracker flexibility, diverse environments, performances at scale)
●
Trade-off: how much do are we willing to invest to release without bugs ?

3. #TuleapCon2017 @TuleapOpenALM
Strategy
●
Release early, release often
●
Dog fooding (tuleap.net & my.enalean.com)
●
Leverage on dev build, backport on Tuleap Enterprise
●
(a lot) of tests
●
(a lot) of code reviewed

4. #TuleapCon2017 @TuleapOpenALM
Release early, release often
●
1 release every 4 weeks
●
Less code, less bugs
●
We cannot break everything at once
●
Reduced test & impact surface

5. #TuleapCon2017 @TuleapOpenALM
Dog fooding
●
Everyday we get a fresh Tuleap on tuleap.net and my.enalean.com
●
Very efficient to spot bugs on services that we are heavily using (UI, Trackers, Git, etc)
●
Less efficient for things we don’t use at all

6. #TuleapCon2017 @TuleapOpenALM
Tuleap ‘master’ channel vs. Tuleap Enterprise
●
Get the fixes, let “others” get the bugs
●
Chat
●
Public “request” tracker
●
Tuleap-devel mailing-list

7. #TuleapCon2017 @TuleapOpenALM
Tuleap Enterprise Software Engineering FTW
●
Gerrit workflow
●
Each and every commit is peer reviewed (code) and functionally tested
●
Each and every commit get merged in ‘master’ ASAP (early integration)
●
Each and every commit get verified against :
- 5800 unit tests (php 5.3 & php 5.6)
- 380 Karma tests (angular apps)
- 263 REST integration tests (php 5.3 / apache & php 5.6 / nginx)
- 12 SOAP integration tests
- 6 end to end tests (selenium)
- 1 build and run (packaging & install)

8. #TuleapCon2017 @TuleapOpenALM
Double dog fooding with TTL
●
Every 4 weeks, on Wednesday “La Valid”

9. #TuleapCon2017 @TuleapOpenALM
On the last 12 months
●
684 requests were reported on Tuleap “Request” tracker
●
180 were reported by at least 1 customer
●
22 were regressions

10. #TuleapCon2017 @TuleapOpenALM
So, enjoy your reliable and secured Tuleap Enterprise platform!