TACO (SKT All Container OpenStack) Introduction : OpenStack Airship, OpenStack-Helm, Kolla based Solution

1. TACO
(SKT All Container OpenStack)
: OpeStack as Cloud Native Platform
Jaesuk Ahn, Ph.D.
Virtualization SW Lab
SW R&D Center, SK Telecom

2. OpenStack Introduction

3. OpenStack
OpenStack provides one cloud computing platform to
orchestrate bare metal, containers, and virtual machines,
allowing users to control all the available infrastructure
resources via API.

4. OpenStack History
2010.07
Austin Release
Nova (NASA) &
Swift (Rackspace)
2018.11
Rocky Release
+39 Projects
Bexar - Cactus - Diablo - Essex - Folsom - Grizzly - Havana - Icehouse -
Juno - Kilo - Liberty - Mitaka - Newton - Ocata - Pike - Queens

5. OpenStack Deployment

6. OpenStack Logical Architecture

7. OpenStack Pros and Cons
Pros
Standard API
• NFV is a great example
Plugin-based Integration Engine
• Capable of Integrating with
Various Vendor Solutions
(storage, network, etc)
Flexibility everywhere
Community
Cons
Deployment (Complexity)
Lifecycle Management
• Upgrade / Rollback
Configuration Tuning (Too Many
Options)
Operational Expertise

8. From Community to Production

9. Cloud Native & MSA
: Fault Tolerance & Scalable System

10. Cloud Native Computing Foundation
Cloud native computing uses an open source software stack to deploy
applications as micro services, packaging each part into its own
container, and dynamically orchestrating those containers to optimize
resource utilization.
Container orchestration Monitoring Tracing Logging Remote procedure call
Container runtime Container runtime Networking API Service mesh Distributed tracing
Security Software updates Storage Service bus Service meshService discovery

11. Kubernetes
Kubernetes is an open-source system for automating deployment,
scaling, and management of containerized applications.

12. Kubernetes Characteristics
• Automatic binpacking
• Self-healing
• Horizontal scaling
• Service discovery and Load balancing
• Automated rollouts and rollbacks
• Secrets and configuration management
• Storage orchestration
• Batch execution

13. Let’s get back to OpenStack

14. OpenStack Architecture ~ MSA
Loosely Coupled
Service Architecture
API everywhere
Integration Flexibility
with Plug-ins

15. TACO (SKT All Container OpenStack)
: OpenStack + Cloud Native Computing

16. SKT Pain-Points
(Even when working with Vendors)
• Even Update (patch) is challenging
• Upgrade - gosh, what I can say.
• Deployment issue - snow-flake env. vs. cattle
• Not single huge scale OpenStack, but many small/medium OpenStacks
• Lack of flexible configuration management capability in “standardized
manner”
• Very difficult to integrate with our own stuffs (Ceph, SDN Controller,
Datacenter Operation Platform, etc)

17. Container
Orchestration
(Kubernetes)
Kubernetes App
Lifecycle Mgmt.
(Helm)
CI/CD Pipeline
(Jenkins,
Cookiemonster)
OpenStack-Helm
(OpenStack
Lifecycle Mgmt.)
Software Defined
Storage
(Ceph)
Chart Orchestration
(Airship-Armada)
Resiliency
k8s native
Resiliency
Upgrade/Rollbacks
Kubernetes + Release
Management
Speed
Fast
Deployment
Overhead
Packaging/conf.
mgmt
Key Technologies
w/
AT&T
w/
AT&T

18. TACO (SKT All Container OpenStack)
Underlying Platform (Kubernetes)
OpenStack Control Planes
(Containerized OpenStack)
OpenStack APIs
Container Orchestration
(Kubernetes, OpenStack-Helm, Armada)
CI/CD & Testing
(Jenkins, Rally/Tempest, Cookiemonster)
OpenStack Containerization
(Docker, Kolla)
Docker Docker Docker Docker Docker
● OpenStack Solution developed/engineered by SK Telecom, leveraging Container (Docker),
Container Orchestration (Kubernetes), Automated Package Management (OpenStack-Helm)
● Continuous Integration / Deployment System & Operation Tools
● Cloud Native Way of managing Lifecycle of OpenStack, easy update/upgrade & rollback,
self-healing, flexible configuration management, etc.

19. Upstream First Policy
upstream
Deployment
Operation
Production Tuning
Feedbacks
Develop Consume
Blueprints
Spec
Code
Test
OpenStack-Helm
Airship - Armada
● Upstream First: Contributing every source code to Upstream, Directly working on Upstream.
● Benefits: Zero Silo Code, Strong ecosystem (Your code are used everywhere), Efficient
Development Effort (Loosely Coupled Co-Development with Various Community Partners)

20. TACO Architecture

21. TACO CI/CD - Status
현재 TACO는 Continuous Delivery 단계에 해당하며 Continuous Deployment 로 진화하는 중임.
Currently TACO is at Continuous Delivery stage,
soon evolving to Continuous Deployment

22. CI Pipeline Flow
Armada로 대체
Armada-manifests
Integration
/
장애 테스트Resiliency
Test

23. Example: CI Pipeline Flow
- Integration Test (Tempest)

24. • Do Full Deployment
• Randomly kill OpenStack Services by Cookiemonster
• Run Rally Test while Cookiemonster is randomly killing Services
• Verify OpenStack is working properly
Example: CI Pipeline Flow
- Resiliency Testing with Cookiemonster

25. Cookiemonster
K8sNode
K8sNode
Cookiemonster
Worker pod
Cookiemonster
pod
Cookiemonster
Worker pod
pod
pod pod
podpod
K8sNode
pod
pod pod
podpod
Cookiemonster
Worker pod
pod
pod pod
podpod
REST API
Cookiemonster Architecture
• Resiliency Testing Tool for Kubernetes Deployment, developed by SKT
• Apache 2.0 License, full integrated in TACO CI Pipeline
• Project Code: https://github.com/sktelecom-oslab/cookiemonster

26. Deployment (Airship - Armada)

27. Production Effort (Green-Field)
Type/Workload Managed Resource
ML Infrastructure (GPU) Container
Telco (VIM) VM
IT (SKT Private Cloud) VM
Big Data Platform VM & Container
VDI (Virtual Desktop) VM & Container

28. Comparison Table
Comparison TACO Vendor
Automated Installation 5 4
Flexibility (Architecture/Configuration) 5 1
OpenStack Upgrade 5 2
OpenStack Resiliency 5 3
OpenStack Feature Support 5 4
Operational Features 4 3
Tech Support (Quality) 4 2

29. Pilot Project
OpenStack
Control Plane
Containerization
2016 Q3
Upstream Engagement
• OpenStack-Helm
• Helm, Kubernetes
TACO V1.0
Release
Project Launch
OpenStack-Helm
Based
Development
CI/CD Pipeline
. Containerization
. Unit/Feature Test
. HA-Enabled
. Resiliency Test
Production-Ready
OpenStack
. Self-Testing
. Full-
Containerization
. Operation Tool
Production
Deployment
. Cloud PC
. Private Cloud
. GPU Cluster
. Big Data
& Telco Network
(VIM)
2017 Q1
2017 Q3
2017 Q4
TACO V2.0
Release
2018 ~
TACO V3.0 & 4.0
Upstream Engagement
- Airship Project
TACO History & Roadmap

30. • Tech Blog: https://sktelecom-oslab.github.io/Virtualization-Software-Lab/
• TACO All-In-One: https://github.com/sktelecom-oslab/taco-scripts
• Cookie Monster: https://github.com/sktelecom-oslab/cookiemonster
• Airship: http://www.airshipit.org/
• https://sktelecom-oslab.github.io/Virtualization-Software-Lab/AirshipIntro/
Links