The document discusses hybrid cloud workloads and OpenStack development. It describes how an abstraction layer allows traditional applications to run on infrastructure as a service, and how tools like Gerrit, Zuul, Jenkins, and Nodepool are used to implement a scalable continuous integration system across multiple public clouds for OpenStack development. This allows proposed changes to be tested across different cloud providers and configurations.

1. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Hybrid Cloud Workloads
Monty Taylor
Twitter: @e_monty
Email: monty.taylor@hp.com

2. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.2

3. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Abstraction Layer
→ Force multiplier
→ Infrastructure as a Service
→ Run Traditional Applications

4. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
ECOSYSTEM
CUMULATIVE
CONTRIBUTORS
AVERAGE MONTHLY
CONTRIBUTORS
PATCHES
MERGED
2130 466 17,209
355Companies
16,266
MEMBERSHIP

5. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Gerrit
→ Traditional 'Enterprise' Java Application
→ Nova VM, Cinder Volume, Trove Database
→ First year – MySQL in VM, Data in VM

6. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.6

7. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Fun Numbers
→ 1 week == 250-500 changes merged
→ 1 week == 1400-3000 change revisions (including updates to existing changes)
→ 10,000 new changes proposed every 42 days

8. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.8
Unit Tests
What Happens When You Submit Code
Proposed
Change
Pep8
Unit TestsUnit Tests
Devstack /
Tempest
~180 Guests
Devstack /
Grenade
Devstack /
Tempest

9. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.9
1 Proposed Change generates …
→ 5 – 10 devstack clouds
→ ~10K integration tests
→ ~1000 2nd Level Guests
→ ~1 GB of Log Data (uncompressed)

10. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
nodepool
→ Keeps a pool of ready to go build slaves
→ Spans clouds
→ Anticipates future need based on watching job queue

11. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.11

12. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.12
zuul

13. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.13

14. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Jenkins + gearman == Scale-out
→ Traditional 'Enterprise' Java Application
→ gearman-plugin: turn Jenkins Master into gearman worker
→ nodepool adds slaves across masters
→ zuul triggers jobs across masters
→ Roughly 100 slaves per Jenkins master

15. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Multi Cloud
→ Redundant Array of Interoperable Clouds
→ Biodiversity

16. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.16

17. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Same API – Different Semantics
→ Stability vs. Speed
→ Operational Features (port 25 throttling)
→ kvm vs. xen vs. … bare metal?

18. One size does not fit all
The Cloud should give more
flexibility not less

19. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.19

20. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.20
gerrit
HP
zuul
jenkins01
jenkins02
jenkins03
jenkins04
Rackspace
TripleO HP
nodepool
Monolithic Scalable Elastic
TripleO
RedHat

21. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.21
Your Applications