Accelerate is becoming a standard to drive DevOps implementation on the four key metrics. We used the model to improve our pipelines over various increments, aligned with the DevOps principles. We act on various domains from methodology, organization, architecture to remove limiting factors along our software pipeline. Multiple teams are now delivering multiple times per day with stability, a game-changer compared to our previous performance across teams. This talk shares the journey we have been taking, lessons learned and takeaways to apply in your context.

1. 1
Accelerate with QE - qeunit.com
This Is How We Accelerate
With Quality Engineering
Antoine CRASKE
@ a c r a s k e _
l i n k e d i n . c o m / a c r a s k e
q e u n i t . c o m
x

2. 2
Who am I
Antoine CRASKE
#digital
#architecture
#transformation
#qualityengineering
#qe
#testautomation
@acraske
Linkedin/acraske
qeunit.com
La Redoute
Director of Technology Transformation
Director of Architecture & Technology
Senior Director of Engineering
Senior Engineering Manager
Previous positions of Program Manager, Project Manager, Software Engineer
Entrepreneurship
Co-founder, atale.io
Co-founder, Cerberus Testing
Communities
QE Unit, founder of the Quality Engineering community
TICE.Leiria, Meetup founder & organizer
Ministry of Testing Leiria, Meetup founder & organizer
Apache Kafka User Group Portugal, Meetup founder & organizer
Archilocus, architecture community co-founder & co-organizer
Research
AI in software engineering pipeline, process mining, value-stream

3. 3
Accelerate with QE - qeunit.com
La Redoute ?

4. Accelerate with QE - qeunit.com 4
Preferred
Family & Lifestyle
Platform

5. 5
TITRE DE LA PRESENTATION
Accelerate with QE - qeunit.com

6. 6
Accelerate with QE - qeunit.com

7. 7
Accelerate with QE - qeunit.com

8. Accelerate with QE - qeunit.com 8

9. 9
Accelerate with QE - qeunit.com

10. TITRE DE LA PRESENTATION 10

11. 11
Accelerate with QE - qeunit.com
1b€ annual sales
European Market
73% Internal Design
99% Notoriety
in France
Top 10 Visited
in France
7m unique visitor/m
96+% Sales
on Digital Channel
50%+ mobile
Most Automated
Warehouse Europe
50+ Stores & Corners
Galeries Lafayette
Shareholder at 100%
Key Figures

12. 12
Accelerate with QE - qeunit.com
Accelerate?

13. Accelerate with QE - qeunit.com 13
La Redoute created the Distance Selling Concept from France
Key Driver
VAD
Market
Share
ASAP
France
Big Selling
Machine
International
Startups Mode

14. 14
Accelerate with QE - qeunit.com
Quarterly Release
“Fine, we have a 6
months catalog”
< 99% Availability
“Maintenance Friday to
Monday”
Accelerate?

15. 15
Accelerate with QE - qeunit.com
< 2000
VAD
2000
Web

16. 16
Accelerate with QE - qeunit.com
Web apparition, as a necessary change for growth opportunities
Websites
Launch
.fr
New York
Offices
Redcats
Platform
.com(s)
Group Platform
Startup
Platform

17. 17
TITRE DE LA PRESENTATION
Lucrative
&
Comfortable
years passed …

18. Accelerate with QE - qeunit.com 18
First Warning Signs and the need to adapt
France
1 year IT
Project to
deliver 24
hours delivery
First
Investment
in Web Testing
ESB for
emerging
Distributed
Architecture
Internation
al
Decreasing
margins,
competition, 3-
12 months
releases
Harmonisation
to same web
platform
Continuous
Integration
with migration
to Portugal IT
System

19. Accelerate with QE - qeunit.com 19
First Value of an emerging DevOps
Back-office CI
• Deploy : 3 months > 3 weeks
• Lead-Time : Yearly > Month(s)
• MTTA/R : Month to Days
System & Org Design
• Limit WIP with Kanban
• Operations control, own
24/7
• New Teams : Integration,
Test, ESB, Monitoring
Web Testing
Automation
• Deploy : 3 months > 2 weeks
• Lead-Time : 6 > 2-3 Months
• MTTA/R : Weeks to Day(s)

20. 20
Accelerate with QE - qeunit.com
< 2000
VAD
2000
Web
2013-2017
e-commerce
La Redoute exits PPR
4 years to transform

21. 21
Accelerate with QE - qeunit.com
An acceleration ambition to reach Elite for 80% of the perimeter

22. Accelerate with QE - qeunit.com 22
Transformation Imperatives
E-commerce
player
60% to >90%
online
X10 faster
collection
cycle-time
2 => 20
catalogs/year
Operational
Excellence
1.5 day to 2
hours order
processing
Develop and
scale new
business
models
Home, MKP,
ideas

23. Accelerate with QE - qeunit.com 23
Transformation Imperatives
E-commerce
player
60% to >90%
online
X10 faster
collection
cycle-time
2 => 20
catalogs/year
Operational
Excellence
1.5 day to 2
hours order
processing
Develop and
scale new
business
models
Home, MKP,
ideas
Accelerate
Web Delivery
& Performance
Architecture to
be faster and
more flexible
Architecture to
be faster and
more flexible
Architecture to
be faster and
more flexible

24. 24
Accelerate with QE - qeunit.com
< 2000
VAD
2000
Web
2013-2017
e-commerce
La Redoute exits PPR
4 years to transform
Web Delivery
Web Performance

25. Accelerate Web Delivery & Performance
Accelerate with QE - qeunit.com 25
.fr .intl
m.laredoute.xy
laredoute.xy
laredoute.xy
Initial State Migration Optimisation
Mobile-1st 100% responsive
Double specs & coding Single implementation
Platform Choice

26. Our Web Delivery was slow down mainly on the Testing Phase
Accelerate with QE - qeunit.com 26
Req. Design Code QA UAT Deploy Run
2 weeks 2 weeks
2 weeks 2 weeks
2 weeks 2 weeks 3 months

27. Our Web Delivery was slow down mainly on the Testing Phase
Accelerate with QE - qeunit.com 27
Req. Design Code QA UAT Deploy Run
Slow UAT
Manual Test
Changes accumulation
Branches
Merges
Technical Test
Big & Risky releases
Other accidental complexity
Inconsistent environment
Highly complex codebase
Indirect bugs
…

28. Our Web Delivery was slow down mainly on the Testing Phase
Accelerate with QE - qeunit.com 28
Smaller & Faster Releases
Req. Design Code QA UAT Deploy Run
Slow UAT
Manual Test
Changes accumulation
Branches
Merges
Technical Test
Big & Risky releases
Functional Test Automation
Trunk-Based Development
Features Flags, A/B Testing
Incremental Features & Specs
Other accidental complexity
Inconsistent environment
Highly complex codebase
Indirect bugs
…

29. The delivery process was changed to delivery every day incremental
value
Accelerate with QE - qeunit.com 29
Req. Design Code QA UAT Deploy Run
Functional Test Automation
Trunk-Based Development
Features Flags, A/B Testing
Incremental Features & Specs
Shift-left

30. The delivery process was changed to delivery every day incremental
value
Accelerate with QE - qeunit.com 30
Req. Design Code QA UAT Deploy Run
Scope until 11 am
UAT in 2 hours
Daily Deploy
Functional Test Automation
Trunk-Based Development
Features Flags, A/B Testing
Incremental Features & Specs
Shift-left

31. The delivery process was changed to delivery every day incremental
value
Accelerate with QE - qeunit.com 31
Req. Design Code QA UAT Deploy Run
Scope until 11 am
UAT in 2 hours
Daily Deploy
UX Monitoring
A/B Testing
Features Flag
Hotfix – plan B
Functional Test Automation
Trunk-Based Development
Features Flags, A/B Testing
Incremental Features & Specs
Functional Test Automation Functional Test Automation
Shift-left

32. The delivery process was changed to delivery every day incremental
value
Accelerate with QE - qeunit.com 32
Req. Design Code QA UAT Deploy Run
Scope until 11 am
UAT in 2 hours
Daily Deploy
UX Monitoring
A/B Testing
Features Flag
Hotfix – plan B
Functional Test Automation
Trunk-Based Development
Features Flags, A/B Testing
Incremental Features & Specs
Functional Test Automation Functional Test Automation
Shift-left
96% successful
production deploy
on business days

33. Our Test Strategy relies on End-to-End Functional Testing as a priority
33
Functional Testing
• End-to-End
• Component
Integration Testing
Unit
Testing
La Redoute Test Pyramid
Manual
Books
Accelerate with QE - qeunit.com

34. Functional testing also in Production
TITRE DE LA PRESENTATION 34

35. Accelerate Web Delivery & Performance
Accelerate with QE - qeunit.com 35
.fr .intl
m.laredoute.xy
laredoute.xy
laredoute.xy
Initial State Migration Optimisation
Mobile-1st 100% responsive
Ideas every 3-6 months
Releases every 2-4 weeks
2 weeks QA
Double specs & coding
Ideas every week/month
Releases every day
2 hours QA
Single implementation
Ideas every 1-3 months
Releases every 1-2 week
1-2 weeks QA

36. 36
Accelerate with QE - qeunit.com
< 2000
VAD
2000
Web
2013-2017
e-commerce
La Redoute exits PPR
4 years to transform
Web Delivery
Web Performance

37. Performance focus, metrics, observability, for everyone including
Business
Accelerate with QE - qeunit.com 37

38. 38

39. Performance – France/European scope
Accelerate with QE - qeunit.com 39

40. 40
Accelerate with QE - qeunit.com
< 2000
VAD
2000
Web
2013-2017
e-commerce
2017-2021
Omnichannel
GL Ownership 51%
Stores acceleration
Organization
Culture
Technology

41. 41
Accelerate with QE - qeunit.com
An acceleration ambition to reach Elite for 80% of the perimeter

42. 42
A first step was to concentrate teams and clarify major interactions
Accelerate with QE - qeunit.com
Web
Study
Web
Dev
Back
Study
Back
Portugal
ESB France
Back Spain
Back Poland
Ops
Arch
Ops PT
DBA Web
Initial diluted organisation
Take ownership
and concentrate

43. 43
A first step was to concentrate teams and clarify major interactions
Accelerate with QE - qeunit.com
Web
Study
Web
Dev
Back
Study
Back
Portugal
ESB France
Back Spain
Back Poland
Ops
Arch
Ops PT
DBA Web
Cross-Functional
Teams
Take ownership
and concentrate
Web
Study/UX
Web
Dev
Web
Ops
Client
Finance
Marketing
Publication
Product
Logistic
Ops
Arch
Ops
Delivery - Portugal
Initial diluted organisation To a first aligned model

44. 44
A first step was to concentrate teams and clarify major interactions
Accelerate with QE - qeunit.com
Web
Study
Web
Dev
Back
Study
Back
Portugal
ESB France
Back Spain
Back Poland
Ops
Arch
Ops PT
DBA Web
Cross-Functional
Teams
Take ownership
and concentrate
Web
Study/UX
Web
Dev
Web
Ops
Client
Finance
Marketing
Publication
Product
Logistic
Ops
Arch
Ops
Delivery - Portugal
Initial diluted organisation To a first aligned model
Study Dev
Study Dev
Study Dev
Study Dev
Study Dev
Study Dev

45. 45
More Agile and DevOps models emerged
Client
Finance
Marketing
Publication
Product
Logistic
Platform Team
Post-Checkout
Search & Product
Order Experience & Account
HD
N1/2
Apps
Supervision
Observability
Quality
MW
Web Platform &
Performance
DBA Infra Secu
AS400
MF
Front
Back
Platform
Stream aligned Platform Team Subsystem Enabling
SDM DevOps

46. 46
Accelerate with QE - qeunit.com
< 2000
VAD
2000
Web
2013-2017
e-commerce
2017-2021
Omnichannel
GL Ownership 51%
Stores acceleration
Organisation
Culture
Technology

47. 47
Move to the same floor and organisational flow
Floor 1 - Dev
Floor 0 - Ops
Floor 1 – Dev & Ops
Stream aligned
Stream aligned
Stream aligned
Stream aligned
Stream aligned
Platform
DBA
HD
AS400/MF
Supervision
Observability
Quality / Web
Infra
Office layout
Accelerate with QE - qeunit.com
Secu
Flow of Work

48. 48
Internal Communities for sharing, best-practices in network
Tech Talks
Dev Community
Quality Hub
Observability Group
Event-driven Microservices, Kafka & K8S
Ivory Towers Architects
Accelerate with QE - qeunit.com
Dev environment
Infra libraries
Metrics guidelines

49. 49
Investment in a common culture & rituals

50. 50
Accelerate with QE - qeunit.com
< 2000
VAD
2000
Web
2013-2017
e-commerce
2017-2021
Omnichannel
GL Ownership 51%
Stores acceleration
Organisation
Culture
Technology

51. 51
Gradual Adoption of Cloud-Native Platform
51
Mainframe
Customers
Events
Marketplace
Offers
PIM
OMS
TMS
WMS
Promotions Payment
CRM
DFO
ESB Platform
Web Platform
La Redoute Platform
CI/CD
On-Premise
Capacity to parallelize development
Time-Coupling & Low Scalability
Lack Self-Service / Waiting Time
Lacking UX/Back/Data Transversal

52. 52
Gradual Adoption of Cloud-Native Platform
52
Mainframe
Customers
Events
Marketplace
Offers
PIM
OMS
TMS
WMS
Promotions Payment
CRM
DFO
ESB Platform
Web Platform
La Redoute Platform
CI/CD
On-Premise
Capacity to parallelize development
Time-Coupling & Low Scalability
Lack Self-Service / Waiting Time
Lacking UX/Back/Data Transversal
Streaming
Event-Driven
Microservices
Self-Service DevEx
Cloud : SaaS & PaaS

53. 53
Gradual Adoption of Cloud-Native Platform
53
Mainframe
Customers
Events
Marketplace
Offers
PIM
OMS
TMS
WMS
Promotions Payment
CRM
DFO
ESB Platform
Web Platform
La Redoute Platform
CI/CD
On-Premise
CI/CD
Cloud-Native

54. 54
Gradual Adoption of Cloud-Native Platform
54
Mainframe
Customers
Events
Marketplace
Offers
PIM
OMS
TMS
WMS
Promotions Payment
CRM
DFO
ESB Platform
Web Platform
La Redoute Platform
CI/CD
On-Premise
CI/CD
Cloud-Native
Web to Cloud
Back MS
Data MS
Replatform
Mainframe

55. 55
Gradual Adoption of Cloud-Native Platform
55
Mainframe
Customers
Events
Marketplace
Offers
PIM
OMS
TMS
WMS
Promotions Payment
CRM
DFO
ESB Platform
Web Platform
La Redoute Platform
CI/CD
On-Premise
CI/CD
Cloud-Native
Micro-Front-End
Web to Cloud
Back MS
Data MS
Replatform
Mainframe
…
Promotions

56. 56

57. Accelerate with QE - qeunit.com 57

58. 58

59. 59
From 20-40 to 40-60 deploys a day
59
• Distributed architecture
• CI/CD acceleration
• Quality Gates
• Production-ready standard
• Training & DevOps sharing
• Quality Gates enrichment
• Specs to design flow
• Self-service DevEx
• CD full autonomy

60. 60
Accelerate with QE - qeunit.com
An acceleration ambition to reach Elite for 80% of the perimeter

61. 61
Accelerate with QE - qeunit.com
Lessons Learned

62. •
62
Accelerate with QE - qeunit.com
Lessons Learned
Methods
Focus on end-to-end flow
Implement to stay & scale

63. •
63
Accelerate with QE - qeunit.com
Lessons Learned
Methods
Focus on end-to-end flow
Architecture
Implement to stay & scale
Transformation driver
Incremental changes with other areas, no silver bullet

64. •
64
Accelerate with QE - qeunit.com
Lessons Learned
Methods
Focus on end-to-end flow
Architecture
Management
Implement to stay & scale
Transformation driver
Incremental changes with other areas, no silver bullet
Vision, alignment, drive
Limiting Factors, Limit WIP, Governance

65. •
65
Accelerate with QE - qeunit.com
Lessons Learned
Methods
Organization
Focus on end-to-end flow
Architecture
Management
Implement to stay & scale
Transformation driver
Incremental changes with other areas, no silver bullet
Vision, alignment, drive
Limiting Factors, Limit WIP, Governance
Choices of investment, stability
Interactions > Organisation, Principles > Rules

66. •
66
Accelerate with QE - qeunit.com
Lessons Learned
Methods
Organization
Focus on end-to-end flow
Skills
Architecture
Management
Implement to stay & scale
Transformation driver
Incremental changes with other areas, no silver bullet
Vision, alignment, drive
Limiting Factors, Limit WIP, Governance
Choices of investment, stability
Interactions > Organisation, Principles > Rules
Start early, get expertise
Foster continuous learning environment

67. 67
Accelerate with QE - qeunit.com
That’s about Quality Engineering

68. 68
Accelerate with QE - qeunit.com
Quality Engineering, the paradigm for Quality at Speed software

69. 69
Accelerate with QE - qeunit.com
The need to act on the entire software licycle

70. 70
Accelerate with QE - qeunit.com
Quality Engineering, at the cornerstore of the software industry

71. 71
Accelerate with QE - qeunit.com
The Quality Engineering implementation is incremental

72. 72
Accelerate with QE - qeunit.com
Applying Quality Engineering for the domain of Methods

73. 73
Accelerate with QE - qeunit.com
Relevant Quality Engineering Pointeurs
qeunit.com/book
(en & fr)
qeunit.com/follow qeunit.com/slack

74. 74
Accelerate with QE - qeunit.com
Thank you
Antoine CRASKE
@ a c r a s k e _
l i n k e d i n . c o m / a c r a s k e
q e u n i t . c o m