Do you find constantly rebuilding things that don’t need rebuilding? If yes, this talk is for you. The way your codebase is structured impacts what you need to rebuild after each commit, therefore, the codebase needs to be re-architectured with the build pipeline in mind. Sometimes you’ll have many responsibilities packed in one module, so you rebuild all of them every time you change one. Or maybe you have a multi-tiered application and adding a feature implies modifying (and rebuilding) all tiers, with cascading effects. In this talk we’ll go over scenarios like this and others, showing how the code can be rewritten in a way that minimises unnecessary rebuilds. In the end, you’ll be equipped with a number of techniques that will help you manage your build pipeline.

1. Breaking Down Your Build:
Architectural Patterns for A More
Efficient Pipeline
FromFragileToAgile.com & Equal Experts
@AbrahamMarin

2. About me

5. Making Software. Better.
Simple solutions to big business problems.
Equal Experts is a network of talented, experienced, software
consultants, specialising in agile delivery.

6. What’s in a Build?

7. Complexity
vs.
Simplicity

9. "Perfection Is Achieved Not When
There Is Nothing More to Add,
But When There Is Nothing Left to
Take Away”
Antoine de Saint-Exupéry | The Little Prince

10. The fastest build
is the one you don’t need to run

12. Break down a monolith

13. Break down a monolith

14. Break down a monolith
APP
BACKEND
SUPER
APP
DATA
MODEL
APP
BACKEND
SUPER
APP
SUPER
APP
DATA
MODEL
APP
BACKEND
GUI

15. Build up your microservices

16. Build up your microservices

17. Build up your microservices

18. Build up your microservices

19. Build up your microservices

20. Build up your microservices

21. Build up your microservices

22. How to build a
CI/CD system like this
https://skillsmatter.com/skillscasts/6371-scalable-continuous-deployment-with-maven
View my talk

23. Good Refactoring Skills Needed

25. Safety First

28. Restructuring Patterns

29. Restructuring Patterns
● Decoupling API from implementation
● Horizontal vs. vertical slices
● Library as a service
● Reduce fan-out
● Configuration as a service

30. Restructuring Patterns
● Decoupling API from implementation
● Horizontal vs. vertical slices
● Library as a service
● Reduce fan-out
● Configuration as a service

31. Decoupling API from implementation

32. Decoupling API from implementation
WEB
INTERFACE
LIBRARY

33. Decoupling API from implementation
Goal
WEB
INTERFACE
LIBRARY
IMPL
ASSEMBLY
LIBRARY
API

34. Decoupling API from implementation
WEB
INTERFACE
LIBRARY

35. Decoupling API from implementation
ASSEMBLY
WEB
INTERFACE
LIBRARY

36. Integration Test
Deploy
Smoke Test
ASSEMBLY
Decoupling API from implementation
WEB
INTERFACE
LIBRARY
Compile
Unit Test
Contract Test

37. Decoupling API from implementation
LIBRARY
API
LIBRARY
IMPL
ASSEMBLY
WEB
INTERFACE

38. Decoupling API from implementation
DI for IMPL
Use explicit wiring
LIBRARY
API
LIBRARY
IMPL
ASSEMBLY
WEB
INTERFACE

39. Decoupling API from implementation
WEB
INTERFACE
LIBRARY
IMPL
No conflict in run time
thanks to explicit wiring
ASSEMBLY
LIBRARY
API
LIBRARY
IMPL

40. Decoupling API from implementation
WEB
INTERFACE
LIBRARY
IMPL
ASSEMBLY
LIBRARY
API
LIBRARY
IMPL

41. Decoupling API from implementation
WEB
INTERFACE
LIBRARY
IMPL
ASSEMBLY
LIBRARY
API

42. Restructuring Patterns
● Decoupling API from implementation
● Horizontal vs. vertical slices
● Library as a service
● Reduce fan-out
● Configuration as a service

43. Horizontal vs. vertical slices

44. Horizontal vs. vertical slices
Persistence
Validation
Logic
Front-End
Web Service

45. Horizontal vs. vertical slices
Persistence
Validation Front-end
ACCOUNT
COMMS
PAYMENT
ACCOUNT
COMMS
PAYMENT
ACCOUNT
COMMS
PAYMENT
Web
Service

46. Horizontal vs. vertical slices
End Goal
COMMS
PERSISTENCE
VALIDATION
FRONT-END
PAYMENT
PERSISTENCE
VALIDATION
FRONT-END
ACCOUNT
PERSISTENCE
VALIDATION
FRONT-END
Web
Service

47. Horizontal vs. vertical slices
Persistence
Validation Front-end
ACCOUNT
COMMS
PAYMENT
ACCOUNT
COMMS
PAYMENT
ACCOUNT
COMMS
PAYMENT
Web
Service

48. Horizontal vs. vertical slices
PAYMENT
PERSISTENCE
VALIDATION
FRONT-END
Persistence Validation Front-end
ACCOUNT
COMMS
PAYMENT
ACCOUNT
COMMS
PAYMENT
ACCOUNT
COMMS
PAYMENT
Web
Service

49. Horizontal vs. vertical slices
PAYMENT
PERSISTENCE
VALIDATION
FRONT-END
Persistence Validation Front-end
ACCOUNT
COMMS
PAYMENT
ACCOUNT
COMMS
PAYMENT
ACCOUNT
COMMS
PAYMENT
Web
Service

50. Horizontal vs. vertical slices
PAYMENT
PERSISTENCE
VALIDATION
FRONT-END
Persistence Validation Front-end
ACCOUNT
COMMS
ACCOUNT
COMMS
ACCOUNT
COMMS
Web
Service

51. Horizontal vs. vertical slices
COMMS
PERSISTENCE
VALIDATION
FRONT-END
PAYMENT
PERSISTENCE
VALIDATION
FRONT-END
Persistence Validation Front-end
ACCOUNT
COMMS
ACCOUNT
COMMS
ACCOUNT
COMMS
Web
Service

52. Horizontal vs. vertical slices
COMMS
PERSISTENCE
VALIDATION
FRONT-END
PAYMENT
PERSISTENCE
VALIDATION
FRONT-END
Persistence Validation Front-end
ACCOUNT
COMMS
ACCOUNT
COMMS
ACCOUNT
COMMS
Web
Service

53. Horizontal vs. vertical slices
COMMS
PERSISTENCE
VALIDATION
FRONT-END
PAYMENT
PERSISTENCE
VALIDATION
FRONT-END
Persistence Validation Front-end
ACCOUNT ACCOUNT ACCOUNT
Web
Service

54. Horizontal vs. vertical slices
ACCOUNTCOMMS
PERSISTENCE
VALIDATION
FRONT-END
PAYMENT
PERSISTENCE
VALIDATION
FRONT-END
Persistence Validation Front-end
ACCOUNT ACCOUNT ACCOUNT
Web
Service
PERSISTENCE
VALIDATION
FRONT-END

55. Horizontal vs. vertical slices
ACCOUNTCOMMS
PERSISTENCE
VALIDATION
FRONT-END
PAYMENT
PERSISTENCE
VALIDATION
FRONT-END
Persistence Validation Front-end
ACCOUNT ACCOUNT ACCOUNT
Web
Service
PERSISTENCE
VALIDATION
FRONT-END

56. Horizontal vs. vertical slices
COMMS
PERSISTENCE
VALIDATION
FRONT-END
PAYMENT
PERSISTENCE
VALIDATION
FRONT-END
ACCOUNT
PERSISTENCE
VALIDATION
FRONT-END
Web
Service

57. Restructuring Patterns
● Decoupling API from implementation
● Horizontal vs. vertical slices
● Library as a service
● Reduce fan-out
● Configuration as a service

58. Library as a service

59. Library as a service
Library SERVICE B
SERVICE C
SERVICE A

60. Library as a service
Goal
SERVICE B
SERVICE C
SERVICE A IT A
IT B
IT C
Library
Service

61. Library as a service
Library SERVICE B
SERVICE C
SERVICE A

62. Library as a service
Library SERVICE B
SERVICE C
SERVICE A IT A
IT B
IT C

63. Library as a service
Library
SERVICE B
SERVICE C
SERVICE A IT A
IT B
IT C
Library
Service

64. Library as a service
Library
SERVICE B
SERVICE C
SERVICE A IT A
IT B
IT C
Library
Service

65. Library as a service
Library
SERVICE B
SERVICE C
SERVICE A IT A
IT B
IT C
Library
Service

66. Library as a service
Library
SERVICE B
SERVICE C
SERVICE A IT A
IT B
IT C
Library
Service

67. Library as a service
SERVICE B
SERVICE C
SERVICE A IT A
IT B
IT C
Library
Service

68. Restructuring Patterns
● Decoupling API from implementation
● Horizontal vs. vertical slices
● Library as a service
● Reduce fan-out
● Configuration as a service

69. Reduce fan-out

70. Reduce fan-out
B
H
C
D
E
F
G
A

71. Reduce fan-out
B
H
C
D
E
F
G
A
A1
A2
A3

72. Reduce fan-out
Goal
B
H
C
D
E
F
G
A2
A3
A1

73. Reduce fan-out
B
H
C
D
E
F
G
A
A1
A2
A3

74. Reduce fan-out
B
H
C
D
E
F
G
A1
A2
A3
A1

75. Reduce fan-out
B
H
C
D
E
F
G
A1
A2
A3
A1

76. Reduce fan-out
B
H
C
D
E
F
G
A2
A3
A1

77. Reduce fan-out
B
H
C
D
E
F
G
A2
A3
A1
A3

78. Reduce fan-out
B
H
C
D
E
F
G
A2
A3
A1
A3

79. Reduce fan-out
B
H
C
D
E
F
G
A2
A3
A1

80. Reduce fan-out
B
H
C
D
E
F
G
A2
A3
A1

81. Restructuring Patterns
● Decoupling API from implementation
● Horizontal vs. vertical slices
● Library as a service
● Reduce fan-out
● Configuration as a service

82. Configuration as a service

83. Configuration as a service
Configuration

84. Configuration as a service
Configuration
● Feature Flag
● Throttling Variable
● A/B Testing
● URLs to other systems
● …
● (for each environment!)

85. Configuration as a service
Configuration
● Feature Flag
● Throttling Variable
● A/B Testing
● URLs to other systems
● …
● (for each environment!)
Service Rebuild
● Compile
● Test Internal Logic
● Contract Tests
● Full Integration Tests
● Deploy
● Smoke Tests

86. Configuration as a service
Config items
Soft : can check in runtime (eg. feature flag)
Hard : need to check in startup (eg. DB connection)

87. Configuration as a service
Service

88. Configuration as a service
Goal
Service
Smoke Tests
Soft
Config
Service
Hard
Config
Deploy

89. Configuration as a service
Service

90. Configuration as a service
Service
Config
Everything
Else
Deploy
Smoke
Tests

91. Configuration as a service
Service
Config
Smoke
Tests

92. Configuration as a service
Service
Config Smoke Tests

93. Configuration as a service
Service
Soft
Config
Smoke Tests
Hard
Config

94. Configuration as a service
Service
Soft
Config
Smoke Tests
Hard
Config
Soft
Config
Service

95. Configuration as a service
Service
Soft
Config
Smoke Tests
Hard
Config
Soft
Config
Service

96. Configuration as a service
Service
Smoke Tests
Hard
Config
Soft
Config
Service

97. Configuration as a service
Service
Smoke Tests
Soft
Config
Service
Hard
Config
Everything
Else
Deploy

98. Configuration as a service
Service
Smoke Tests
Soft
Config
Service
Hard
Config
Deploy

99. Restructuring Patterns
● Decoupling API from implementation
● Horizontal vs. vertical slices
● Library as a service
● Reduce fan-out
● Configuration as a service

100. But… Should I Do It?

101. But… Should I Do It?
https://youtu.be/8JxoKJng_eQ
Check out my
video on YouTube

102. Recapping…
Don’t run things faster, run fewer things
Seek simplicity
Restructure as needed

104. Thank You!
FromFragileToAgile.com
@AbrahamMarin

105. Thank You
Twitter
@EqualExperts
LinkedIn
linkedin.com/company/equal-experts
UNITED KINGDOM
+44 203 603 7830
helloUK@equalexperts.com
Equal Experts UK Ltd
30 Brock Street
London NW1 3FG
INDIA
+91 20 6607 7763
helloIndia@equalexperts.com
Equal Experts India Private Ltd
Office No. 4-C
Cerebrum IT Park No. B3
Kumar City, Kalyani Nagar
Pune, 411006
Web
www.equalexperts.com
CANADA
+1 403 775 4861
helloCanada@equalexperts.com
Equal Experts Devices Inc
205 - 279 Midpark way S.E.
T2X 1M2
Calgary, Alberta
PORTUGAL
+351 211 378 414
helloPortugal@equalexperts.com
Equal Experts Portugal
Avenida Dom João II, Nº35
Edificio Infante 11ºA
1990-083 Parque das Nações
Lisboa – Portugal
& Equal Experts
USA
+1 866-943-9737
helloUSA@equalexperts.com
Equal Experts Inc
1460 Broadway
New York
NY 10036