Container Management in ManageIQ: One Year in Review by Federico Simoncelli at ManageIQ Design Summit 2016 Demo video: https://youtu.be/wCCANYPbZ8Y

1. Container Management in ManageIQ
One Year in Review
Federico Simoncelli - Red Hat
May 2016

3. Agenda
Container Management 1-Year History
New Features Introduced in Darga

4. Container Management - What is it?
Brand new Provider introduced in early 2015
Collect, Visualize and Manage Container Clusters
Kubernetes
OpenShift

5. Container Management History and Features
Feb 6 2015 Kubernetes Provider backend
Nodes, Services, Container Groups (Pods) and Containers
Labels and Selectors
Ruby GEM for interacting with Kubernetes API (beta)
Kubeclient
Heavily involved with the Kubernetes community
Tens of Pull Requests for improving integration (>800 lines of code)
Feb 2015 May 2015Sep 2015May 2015 Jan 2016
Botvinnik Capablanca
Timeline

6. Container Management History and Features
Mar 4 2015 Event Catcher
Heavily involved with the Kubernetes community
Pull Requests focused on improving Events (>500 lines of code)
Feb 2015 May 2015Sep 2015May 2015 Jan 2016
Botvinnik Capablanca
Timeline

7. Mar 11 2015 UI for Containers
Container Management History and Features
Feb 2015 May 2015Sep 2015May 2015 Jan 2016
Botvinnik Capablanca
Timeline

8. Container Management History and Features
May 11 2015 Support for creating Reports
For Containers, Pods and Nodes
May 16 2015 OpenShift Provider
Ruby GEM for interacting with OpenShift API
OpenShift-Client Mostly based on Kubeclient
Feb 2015 May 2015Sep 2015May 2015 Jan 2016
Botvinnik Capablanca
Timeline

9. Container Management History and Features
Jun 4 2015 Timeline UI
Providers, Projects, Pods, Containers, Nodes
Feb 2015 May 2015Sep 2015May 2015 Jan 2016
Botvinnik Capablanca
Timeline

10. Container Management History and Features
Jun 2015 Metrics collection based on InfluxDB
Collaboration with the InfluxDB Ruby Gem
Jun 23 2015 Out-Of-The-Box Reports
Nodes By Capacity, CPU and Memory Usage
Recently Discovered Pods and Status
Feb 2015 May 2015Sep 2015May 2015 Jan 2016
Botvinnik Capablanca
Timeline

11. Container Management History and Features
Jun 11 2015 Images and Registries
Feb 2015 May 2015Sep 2015May 2015 Jan 2016
Botvinnik Capablanca
Timeline

12. Container Management History and Features
Jul 30 2015 Tagging Support
Jul 2015 Provider Cross-Linking support
For OpenStack, RHEV and VMware
Feb 2015 May 2015Sep 2015May 2015 Jan 2016
Botvinnik Capablanca
Timeline
Service Pods Container Image
NodesCluster
InstanceRegion
Host
Storage Network

13. Container Management History and Features
Feb 2015 May 2015Sep 2015May 2015 Jan 2016
Botvinnik Capablanca
Timeline

14. Container Management History and Features
Aug 3 2015 Kubernetes API v1
Aug 14 2015 Move to Pluggable Provider (!)
Wide effort across all the Providers
Aug 18 2015 Enable Containers support by default (!)
Sep 1 2015 Topology Widget
In collaboration with Cockpit
Feb 2015 May 2015Sep 2015May 2015 Jan 2016
Botvinnik Capablanca
Timeline

15. Sep 1 2015 Topology Widget
Container Management History and Features
Feb 2015 May 2015Sep 2015May 2015 Jan 2016
Botvinnik Capablanca
Timeline

16. Container Management History and Features
Sep 17 2015 SmartState Analysis support
Initial work and releases of image-inspector
Daemon written in GO delivered as container image
Extracts other container images and exposes the content using WebDAV
Collaboration with the GO library for WebDAV
golang.org/x/net/webdav
Feb 2015 May 2015Sep 2015May 2015 Jan 2016
Botvinnik Capablanca
Timeline

17. Container Management History and Features
Sep 17 2015 SmartState Analysis support
Feb 2015 May 2015Sep 2015May 2015 Jan 2016
Botvinnik Capablanca
Timeline

18. Container Management History and Features
Sep 17 2015 SmartState Analysis support
Feb 2015 May 2015Sep 2015May 2015 Jan 2016
Botvinnik Capablanca
Timeline

19. Container Management History and Features
Oct 29 2015 Dashboard for Containers
Feb 2015 May 2015Sep 2015May 2015 Jan 2016
Botvinnik Capablanca
Timeline

20. Container Management History and Features
Nov 6 2015 Metrics collection based on Hawkular
“Realtime” for Container, Pods and Nodes
CPU Cores and Memory, Network only for Nodes
Feb 2015 May 2015Sep 2015May 2015 Jan 2016
Botvinnik Capablanca
Timeline

21. Container Management History and Features
Nov 15 2015 Pods Metrics Rollups to Multiple Parents
Pods Metrics Rollups to Provider, Projects, Services and Replicators
Feb 2015 May 2015Sep 2015May 2015 Jan 2016
Botvinnik Capablanca
Timeline

22. Container Management History and Features
Dec 10 2015 Single Container Provider Dashboard
Feb 2015 May 2015Sep 2015May 2015 Jan 2016
Botvinnik Capablanca
Timeline

23. Container Management History and Features
Dec 10 2015 Single Container Provider Dashboard
Feb 2015 May 2015Sep 2015May 2015 Jan 2016
Botvinnik Capablanca
Timeline

24. Container Management History and Features
Dec-Jan 2015 Dashboard Node Utilization Charts
Feb 2015 May 2015Sep 2015May 2015 Jan 2016
Botvinnik Capablanca
Timeline

25. Timeline
Container Management History and Features
Dec-Jan 2015 Dashboard Network Trends
Feb 2015 May 2015Sep 2015May 2015 Jan 2016
Botvinnik Capablanca

26. Darga
2016 February - June

27. Darga - Container Management Overview
Darga Planning: 18 - 22 January 2016
Research Phase (~3 weeks)
Development start: February 15 (Sprint 37)
DB Schema Freeze: April 20 (Sprint 39)
6 Core Contributors (+2 new Engineers since February)
Current Status (End of Sprint 41)
15 Weeks of Development (5 Sprints)
Timeline
Feb 2015 May 2015Sep 2015May 2015 Jan 2016
Botvinnik Capablanca

28. Darga - Container Management Overview
Main features introduced:
Chargeback for Containers
OpenSCAP Integration
Cloud Providers Cross-Linking
OpenShift Deployment (ongoing)
Additional Enhancements:
Multi-Endpoints for Hawkular Metrics
Add support for Pods Network Metrics
Dashboard Pods and New Images trends

29. Darga - Containers Chargeback
Chargeback totals per Project (Namespace)
CPU Cores, Memory and Network (when available) usage
Support for multiple Providers in the same Report
Support for archived (deleted) entities (Pods and Projects)

30. Darga - OpenSCAP Integration

31. Darga - Multi-Endpoints

32. Darga - Dashboard Pods and New Images trends

33. OpenShift Deployment (ongoing)
Deploy OpenShift
on existing machines (VMs / bare-metal)
on VMs/Instances provisioned by ManageIQ
Leverage and improve openshift-ansible
Backward-compatible “Inventory” (oo-install)
Support different topologies of deployment
Single/Multi-Master (internal / external etcd)
Infrastructure Nodes
Router, Registry and Metrics Support

34. Ideas For The Future
OpenShift Templates LifeCycle Management
Parity of Features for the Kubernetes Provider (e.g. Metrics)
Extend Chargeback with different rates based on Projects annotation
Manage Maintenance Mode for the Nodes
Cross-Linking of Storage and Network

35. Get to Know Container Management
Alon Goldboim (alongoldboim)
Ari Zellner (zeari)
Barak Azulay (bazulay)
Beni Paskin-Cherniavsky (cben)
Daniel Korn (dkorn)
Erez Freiberger (enoodle)
Federico Simoncelli (simon3z)
Mooli Tayer (moolitayer)
Yaacov Zamir (yaacov)

36. Keep in Touch with the Container Management
Discussion: http://talk.manageiq.org/
Repository: https://github.com/ManageIQ/manageiq
Use Tag:
Messaging: https://gitter.im/ManageIQ/manageiq/containers
providers/containers

37. Thank You!

38. Extra Slides and Notes
(Not to be presented)

39. Ongoing - OpenShift Deployment

40. Container Management History and Features
Oct 16 2015 Resources and Quota

41. Container Management - Darga Features
Mar 11 2016 Builds Entity
May 6 2016 Persistent Volumes and Claims Entities
Apr 4 2016 OpenSCAP Integration
Apr 13 2016 Chargeback Support
Apr 18 2016 Pods Network Metrics support
Apr 19 2016 Dashboard Pods and New Images trends
May 18 2016 Provider Multi-Endpoint support

42. Dashboard evolution story
https://github.com/ManageIQ/manageiq/pull/5938
https://github.com/ManageIQ/manageiq/pull/6036
Disconnect entities
Add ManageIQ Freeze dates etc. Darga release etc.