SlideShare a Scribd company logo
1 of 29
Download to read offline
StarlingX Project Onboarding
SHUQUAN HUANG, 99CLOUD, STARLINGX TSC MEMBER
Let Me Introduce StarlingX
• New, top-level OpenStack Foundation pilot project
• Software stack providing high performance, low latency,
and high availability for Edge Cloud applications
• Growing community.
Project Overview
~100MS
~10-40MS
< 1-2MS< 5MS
A.Latency
B.Bandwidth
C.Security
D.Connectivity
“WHERE” MATTERS
What Is Driving Edge Computing?
Source: Cloud Edge Computing: Beyond the Data Center
https://www.openstack.org/edge-computing/cloud-edge-computing-beyond-the-data-center?lang=en_US
What Problems Is StarlingX Solving?
1. Distributed infrastructure demands a different architecture
2. The maturity and robustness of Cloud is required everywhere
3. Managing a massively distributed compute environment is hard
Massive data growth
Network needs to be smarter
Goals of the StarlingX Project
Re-Configure Proven Cloud Technologies for Edge Compute
• Orchestrate system-wide for bare metal, VMs and Container workloads
• Deploy and manage Edge clouds, share configurations
• Simplify deployment to geographically dispersed, remote Edge regions
*Other names and brands may be claimed as the
property of others
Video
Healthcare
Manufacturing
Transportation
Smart cities
Retail
Energy
Drones
StarlingX Technology
StarlingX provides a
deployment-ready, scalable,
highly reliable Edge
infrastructure software platform
Services from the StarlingX
virtualization platform focus on
• Easy deployment
• Low touch manageability
• Rapid response to events
• Fast recovery
Think control at the Edge, control
between IoT and Cloud, control
over your virtual machines.
StarlingX - Edge Virtualization Platform
*Other names and brands may be claimed as the
property of others
Kubernetes Components
Kubelet
etcd
kube-
scheduler
kube-dns
calico armada
Docker
kube-
apiserver
kube-
controller-
manager kube-proxy
tiller
helm
kube-
dashboard
docker
registry
STARLINGX
Scalability from Small to Large
• Single Server
• Runs all functions
• Dual Server
• Redundant design
• Multiple Server
• Fully resilient and
geographically
distributable
Worker / Compute
VM Container ContainerVM VM Container ContainerVM
VM Container ContainerVM
VM Container ContainerVM
VM Container ContainerVM
Worker / Compute
Worker / Compute
Worker / Compute
Master / Control Master / Control
Master / Control
Master / Control
Master / Control
Worker / Compute
Scaling from the Core to the Edge
• Geographically distributed
multi-region deployment,
• Central Region providing
Orchestration and
Synchronization Services,
• Geographically distributed
Edge Regions of various
sizes
Central
Region / Cloud
Edge
Region / Subcloud
Edge
Region / Subcloud
Edge
Region / Subcloud
Edge
Region / Subcloud
Configuration Management
• Manages installation
• Auto-discover new nodes
• Manage installation parameters (i.e. console,
root disks)
• Bulk provisioning of nodes through XML file
• Nodal Configuration
• Node role, role profiles
• Core, memory (including huge page)
assignments
• Network Interfaces and storage assignments
• Inventory Discovery
• CPU/cores, SMT, processors, memory, huge
pages
• Storage, ports
• GPUs, storage, Crypto/compression H/W
System Configuration and Setup
SQL DB
Hardware
Resources
MANIFESTS
Puppet
Resources
Puppet
Resources
Hardware
Resources
REST API
System Inventory
(Agents)
System Inventory
(Conductor)
CLI Horizon Wizard Automation
Host Management
• Full life-cycle management of the host
• Detects and automatically handles host
failures and initiates recovery
• Monitoring and alarms for
• Cluster connectivity, critical process failures
• Resource utilization thresholds, interface states
• H/W fault / sensors, host watchdog
• Activity progress reporting
• Interfaces with board management (BMC)
• For out of band reset
• Power-on/off
• H/W sensor monitoring
• Manage the host via REST API
Infrastructure
Orchestration
Configuration
Management
Host
Management
Service
Management
Request
H/W Inventory
Manage Monitor
Processes
Manage Monitor
Hosts
Manage Monitor
VMs
Vendor Neutral Host Management
Software Management
• Automated deploy of software updates
for security and/or new functionality
• Integrated end-to-end rolling upgrade
solution
• Automated, low number of steps
• No additional hardware required for upgrade
• Rolling upgrade across nodes
• In-service and reboot required patches
supported
• Reboot required for kernel replacement etc.
• VM live migration is used for patches that
require reboot
• Manages upgrades of all software
• Host OS changes
• New / upgraded StarlingX service software
• New / upgraded Kubernetes software
• New / upgraded OpenStack software
Software Upgrades and Patching
Hitless
Migration
Control
Control
Storage
Storage
Compute
VM VM VM
...
Compute
VM VM VM
SOURCE CLOUD ON RELEASE N
Control
Control
Storage
Storage
Compute
VM VM VM
Compute
VM VM VM
...
SOURCE CLOUD ON RELEASE N+1
Worker / Compute
Master / Control
Worker / Compute
Master / Control
Master / Control
Master / Control
Worker / Compute
Worker / Compute
Distributed Cloud
• Based on OpenStack Regions,
• Central SystemController Region:
- Hosting Shared Services and
- System-wide Infrastructure Orchestration functions:
§ Deployment and Management of Subclouds,
§ Configuration portal for shared configuration across all
Subclouds,
• Users, Projects, Images, etc. .
§ Fault aggregation,
§ Patching orchestration.
• Remote Edge / Subcloud Regions:
- Geographically dispersed,
- Connected via L3 network,
- Running reduced Control Plane.
• Inter-Region Communications strictly REST APIs / L3.
Edge / Subcloud
Region
SystemController
Region
Edge / Subcloud
Region
Edge / Subcloud
Region
Layer 3 Network
Community and Contributing
Principles
• The StarlingX project follows the “four opens,”
• Open Collaboration
• Open Design
• Open Development
• Open Source
• Technical decisions are made by technical contributors and
a representative Technical Steering Committee.
• The community is committed to diversity, openness,
encouraging new contributors and leaders to rise up.
Sub-project Structure
• Main sub-projects
• New functionality and services
• Supporting sub-projects
• Supporting services, test and infrastructure
• Sub-project team structure
• 1 Team Lead
• 1 Project Lead
• Core Reviewers
• Contributors
Technical Steering Committee
StarlingX Main Sub-projects
Config Fault
HA GUI
Metal NFV
Update Distributed Cloud
StarlingX Supporting Sub-projects
Docs Build
Distro: OpenStack Distro: non-OpenStack
Test Security
Containers Networking
Releases MultiOS
Python 2 —> 3
Devstack Zuul enablement
Governance Roles
• Contributor
• Someone who made a contribution in the past 12 months
• Code, test or documentation
• Serving in a leadership role
• Can run and vote for elected positions
• Core Reviewer
• Active contributors to a sub-project, appointed by fellow core reviewers
• Responsible for reviewing changes and specifications
• Can merge code and documentation changes
Governance Roles
• Technical Lead
• Per sub-project
• Core Reviewer with additional duties
• Helps guiding the technical direction of a sub-project
• Project Lead
• Sub-project level coordination work
• Tracks and communicates progress and priorities
• Sub-project ambassador
Governance Bodies
• Technical Steering Committee (TSC)
• Responsible for overall project architectural decisions
• Managing the sub-project life-cycle
• Making final decisions if sub-project Core Reviewers, Technical Leads or Project
Leads disagree
• It is comprised of 9 people. The first TSC members are Brent Rowsell (Wind
River), Ian Jolliffe (Wind River), Dean Troyer (Intel), Saul Wold (Intel), Curtis
Collicutt (Interdynamics), Ada Cunha (Ericsson), Shuquan Huang (99Cloud) and
Miguel Lavalle (Verizon/OATH)
•First TSC Election
•First TSC election on the week of June 10th
•5 TSC seats are up for election
•Process is following the OpenStack TC election
Community and Collaboration
•Community metrics since the project creation
• Contributors from more than 10 organizations
• Near 3000 commits from 126 authors
• Collaboration with OpenStack projects
• Active collaboration on edge related bug fixes
and feature enhancements for core services
• Work in the Stein cycle in projects such as
Nova, Neutron and Horizon
• Packet.com
• Infrastructure donor to provide hardware in real
edge datacenters
• PoC, testing and hands-on workshop activities
are in progress
• Cross-community collaboration
• Akraino, OPNFV, EdgeX Foundry
Contributions
• Code and formal documentation are available through git / gerrit
• git.starlingx.io
• Informal documentation is also on our wiki:
• https://wiki.openstack.org/wiki/StarlingX
• Bugs are tracked in Launchpad
• https://bugs.launchpad.net/starlingx
• New ideas are introduced in the specs repository
• https://git.openstack.org/cgit/openstack/stx-specs/
• Design and implementation work is tracked in StoryBoard
• https://storyboard.openstack.org/#!/project_group/86
Community
• You do not need to be an Individual Member of the
OpenStack Foundation in order to contribute, but if you
want to vote in the annual OpenStack Foundation Board of
Directors election, you may join: openstack.org/join
• If you are contributing on behalf of an employer, they will
need to sign a corporate contributor license agreement,
which now covers all projects hosted by the OpenStack
Foundation (same model such as Apache and CNCF)
Communication
• #starlingx@Freenode
• Mailing Lists:
• lists.starlingx.io
• Email:
• http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
• Weekly meetings:
• Zoom calls
• https://wiki.openstack.org/wiki/Starlingx/Meetings
Get your hands dirty
What you can learn from this summit?
• Summit Sessions/Forum/Demos:
• Precision Time Protocol (PTP) on StarlingX, Mon 3:50-4:30 Room Level
505/506
• Edge Computing Group’s MVP Architecture - StarlingX making it real!,
Tue 9:50-10:30 Room Level 505/506
• Getting a new Open Source Project off the ground – the StarlingX story,
Tue 9:00-9:40 Room Level 505/506
• StarlingX for OpenStack Operators, Wed 9:00-9:40 Ballroom Level 4A
• StarlingX: Hardened Managed Kubernetes Platform for the Edge, Wed
10:50-11:40 Room Level 403/404
• StarlingX - Project Onboarding, Wed 11:40-12:00 Room Level 406
• StarlingX hands-on workshop, Wed 1:40-5:50 Ballroom Level 4E/F
• IoT use case in StarlingX, Intel Booth
Thank You!
Q&A

More Related Content

What's hot

What's hot (20)

OpenContrail Silicon Valley Meetup Aug 25 2015
OpenContrail Silicon Valley Meetup Aug 25 2015OpenContrail Silicon Valley Meetup Aug 25 2015
OpenContrail Silicon Valley Meetup Aug 25 2015
 
[OpenStack Day in Korea 2015] Keynote 2 - Leveraging OpenStack to Realize the...
[OpenStack Day in Korea 2015] Keynote 2 - Leveraging OpenStack to Realize the...[OpenStack Day in Korea 2015] Keynote 2 - Leveraging OpenStack to Realize the...
[OpenStack Day in Korea 2015] Keynote 2 - Leveraging OpenStack to Realize the...
 
OpenContrail Overview
OpenContrail OverviewOpenContrail Overview
OpenContrail Overview
 
Cloud Networking is not Virtual Networking - London VMUG 20130425
Cloud Networking is not Virtual Networking - London VMUG 20130425Cloud Networking is not Virtual Networking - London VMUG 20130425
Cloud Networking is not Virtual Networking - London VMUG 20130425
 
Superfluidity, Infrastructure for mixed workloads in Mobile Edge Computing - ...
Superfluidity, Infrastructure for mixed workloads in Mobile Edge Computing - ...Superfluidity, Infrastructure for mixed workloads in Mobile Edge Computing - ...
Superfluidity, Infrastructure for mixed workloads in Mobile Edge Computing - ...
 
Delivering Composable NFV Services for Business, Residential and Mobile Edge
Delivering Composable NFV Services for Business, Residential and Mobile EdgeDelivering Composable NFV Services for Business, Residential and Mobile Edge
Delivering Composable NFV Services for Business, Residential and Mobile Edge
 
KubeCon China June 2019 - Survey of Kubernetes related solutions for IoT and ...
KubeCon China June 2019 - Survey of Kubernetes related solutions for IoT and ...KubeCon China June 2019 - Survey of Kubernetes related solutions for IoT and ...
KubeCon China June 2019 - Survey of Kubernetes related solutions for IoT and ...
 
Harnessing the virtual realm for successful real world artificial intelligence
Harnessing the virtual realm for successful real world artificial intelligenceHarnessing the virtual realm for successful real world artificial intelligence
Harnessing the virtual realm for successful real world artificial intelligence
 
SDN Scale-out Testing at OpenStack Innovation Center (OSIC)
SDN Scale-out Testing at OpenStack Innovation Center (OSIC)SDN Scale-out Testing at OpenStack Innovation Center (OSIC)
SDN Scale-out Testing at OpenStack Innovation Center (OSIC)
 
Contrail Launch: Capitalize on SDN and Cloud. Now.
Contrail Launch: Capitalize on SDN and Cloud. Now.Contrail Launch: Capitalize on SDN and Cloud. Now.
Contrail Launch: Capitalize on SDN and Cloud. Now.
 
Cloud, SDN, NFV
Cloud, SDN, NFVCloud, SDN, NFV
Cloud, SDN, NFV
 
OpenStack Scale-out Networking Architecture
OpenStack Scale-out Networking ArchitectureOpenStack Scale-out Networking Architecture
OpenStack Scale-out Networking Architecture
 
OpenStack Summit Austin 2016 v1.3
OpenStack Summit Austin 2016 v1.3 OpenStack Summit Austin 2016 v1.3
OpenStack Summit Austin 2016 v1.3
 
OpenStack As A Strategy For Future Growth at Cisco
OpenStack As A Strategy For Future Growth at CiscoOpenStack As A Strategy For Future Growth at Cisco
OpenStack As A Strategy For Future Growth at Cisco
 
Kubernetes20151017a
Kubernetes20151017aKubernetes20151017a
Kubernetes20151017a
 
Docker:- Application Delivery Platform Towards Edge Computing
Docker:- Application Delivery Platform Towards Edge ComputingDocker:- Application Delivery Platform Towards Edge Computing
Docker:- Application Delivery Platform Towards Edge Computing
 
OpenStack and NetApp - Chen Reuven - OpenStack Day Israel 2017
OpenStack and NetApp - Chen Reuven - OpenStack Day Israel 2017OpenStack and NetApp - Chen Reuven - OpenStack Day Israel 2017
OpenStack and NetApp - Chen Reuven - OpenStack Day Israel 2017
 
7 - Introduction to OpenStack & SDN by Ady Saputra
7 - Introduction to OpenStack & SDN by Ady Saputra7 - Introduction to OpenStack & SDN by Ady Saputra
7 - Introduction to OpenStack & SDN by Ady Saputra
 
Rightscale Webinar: Designing Private & Hybrid Clouds (Hosted by Citrix)
Rightscale Webinar: Designing Private & Hybrid Clouds (Hosted by Citrix)Rightscale Webinar: Designing Private & Hybrid Clouds (Hosted by Citrix)
Rightscale Webinar: Designing Private & Hybrid Clouds (Hosted by Citrix)
 
Optimising nfv service chains on open stack using docker
Optimising nfv service chains on open stack using dockerOptimising nfv service chains on open stack using docker
Optimising nfv service chains on open stack using docker
 

Similar to StarlingX - Project Onboarding

Stay productive while slicing up the monolith
Stay productive while slicing up the monolith Stay productive while slicing up the monolith
Stay productive while slicing up the monolith
Markus Eisele
 

Similar to StarlingX - Project Onboarding (20)

StarlingX - A Platform for the Distributed Edge | Ildiko Vancsa
StarlingX - A Platform for the Distributed Edge | Ildiko VancsaStarlingX - A Platform for the Distributed Edge | Ildiko Vancsa
StarlingX - A Platform for the Distributed Edge | Ildiko Vancsa
 
An Evaluation of OpenStack Deployment Frameworks
An Evaluation of OpenStack Deployment FrameworksAn Evaluation of OpenStack Deployment Frameworks
An Evaluation of OpenStack Deployment Frameworks
 
Kubernetes – An open platform for container orchestration
Kubernetes – An open platform for container orchestrationKubernetes – An open platform for container orchestration
Kubernetes – An open platform for container orchestration
 
Deep Dive: OpenStack Summit (Red Hat Summit 2014)
Deep Dive: OpenStack Summit (Red Hat Summit 2014)Deep Dive: OpenStack Summit (Red Hat Summit 2014)
Deep Dive: OpenStack Summit (Red Hat Summit 2014)
 
What is the OpenStack Platform? By Peter Dens - Kangaroot
What is the OpenStack Platform? By Peter Dens - KangarootWhat is the OpenStack Platform? By Peter Dens - Kangaroot
What is the OpenStack Platform? By Peter Dens - Kangaroot
 
Unlock Your Cloud Potential with Mirantis OpenStack & Cumulus Linux
Unlock Your Cloud Potential with Mirantis OpenStack & Cumulus LinuxUnlock Your Cloud Potential with Mirantis OpenStack & Cumulus Linux
Unlock Your Cloud Potential with Mirantis OpenStack & Cumulus Linux
 
Mirantis OpenStack and Cumulus Linux Webinar
Mirantis OpenStack and Cumulus Linux WebinarMirantis OpenStack and Cumulus Linux Webinar
Mirantis OpenStack and Cumulus Linux Webinar
 
Stay productive while slicing up the monolith
Stay productive while slicing up the monolith Stay productive while slicing up the monolith
Stay productive while slicing up the monolith
 
HPC and cloud distributed computing, as a journey
HPC and cloud distributed computing, as a journeyHPC and cloud distributed computing, as a journey
HPC and cloud distributed computing, as a journey
 
Why OpenStack on UCS? An Introduction to Red Hat and Cisco OpenStack Solution
Why OpenStack on UCS? An Introduction to Red Hat and Cisco OpenStack SolutionWhy OpenStack on UCS? An Introduction to Red Hat and Cisco OpenStack Solution
Why OpenStack on UCS? An Introduction to Red Hat and Cisco OpenStack Solution
 
DPDK Architecture Musings - Andy Harvey
DPDK Architecture Musings - Andy HarveyDPDK Architecture Musings - Andy Harvey
DPDK Architecture Musings - Andy Harvey
 
Cloud Architect Alliance #15: Openstack
Cloud Architect Alliance #15: OpenstackCloud Architect Alliance #15: Openstack
Cloud Architect Alliance #15: Openstack
 
How to Build a Compute Cluster
How to Build a Compute ClusterHow to Build a Compute Cluster
How to Build a Compute Cluster
 
Sanger, upcoming Openstack for Bio-informaticians
Sanger, upcoming Openstack for Bio-informaticiansSanger, upcoming Openstack for Bio-informaticians
Sanger, upcoming Openstack for Bio-informaticians
 
Flexible compute
Flexible computeFlexible compute
Flexible compute
 
Stay productive_while_slicing_up_the_monolith
Stay productive_while_slicing_up_the_monolithStay productive_while_slicing_up_the_monolith
Stay productive_while_slicing_up_the_monolith
 
Cloud Foundry and OpenStack – Marriage Made in Heaven !
Cloud Foundry and OpenStack – Marriage Made in Heaven !Cloud Foundry and OpenStack – Marriage Made in Heaven !
Cloud Foundry and OpenStack – Marriage Made in Heaven !
 
Kubernetes Infra 2.0
Kubernetes Infra 2.0Kubernetes Infra 2.0
Kubernetes Infra 2.0
 
Cloud orchestration major tools comparision
Cloud orchestration major tools comparisionCloud orchestration major tools comparision
Cloud orchestration major tools comparision
 
OpenStack Enabling DevOps
OpenStack Enabling DevOpsOpenStack Enabling DevOps
OpenStack Enabling DevOps
 

More from Shuquan Huang

More from Shuquan Huang (9)

No measurement no improvement how to define metrics for cicd optimization
No measurement no improvement how to define metrics for cicd optimizationNo measurement no improvement how to define metrics for cicd optimization
No measurement no improvement how to define metrics for cicd optimization
 
Edge optimized architecture for fabric defect detection in real-time
Edge optimized architecture for fabric defect detection in real-timeEdge optimized architecture for fabric defect detection in real-time
Edge optimized architecture for fabric defect detection in real-time
 
KEYNOTE: Edge optimized architecture for fabric defect detection in real-time
KEYNOTE: Edge optimized architecture for fabric defect detection in real-timeKEYNOTE: Edge optimized architecture for fabric defect detection in real-time
KEYNOTE: Edge optimized architecture for fabric defect detection in real-time
 
Optimized HPC/AI cloud with OpenStack acceleration service and composable har...
Optimized HPC/AI cloud with OpenStack acceleration service and composable har...Optimized HPC/AI cloud with OpenStack acceleration service and composable har...
Optimized HPC/AI cloud with OpenStack acceleration service and composable har...
 
OpenStack at SJTU: Predictive Data Mining in Clinical Medicine with Dynamical...
OpenStack at SJTU: Predictive Data Mining in Clinical Medicine with Dynamical...OpenStack at SJTU: Predictive Data Mining in Clinical Medicine with Dynamical...
OpenStack at SJTU: Predictive Data Mining in Clinical Medicine with Dynamical...
 
Composable infrastructure try valence
Composable infrastructure try valenceComposable infrastructure try valence
Composable infrastructure try valence
 
Compose hardware resources on the fly with openstack valence
Compose hardware resources on the fly with openstack valenceCompose hardware resources on the fly with openstack valence
Compose hardware resources on the fly with openstack valence
 
Build bare metal kubernetes cluster for hpc on open stack in translational me...
Build bare metal kubernetes cluster for hpc on open stack in translational me...Build bare metal kubernetes cluster for hpc on open stack in translational me...
Build bare metal kubernetes cluster for hpc on open stack in translational me...
 
Beware the pitfalls when migrating to hybrid cloud with openstack
Beware the pitfalls when migrating to hybrid cloud with openstackBeware the pitfalls when migrating to hybrid cloud with openstack
Beware the pitfalls when migrating to hybrid cloud with openstack
 

Recently uploaded

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Recently uploaded (20)

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
Simplifying Mobile A11y Presentation.pptx
Simplifying Mobile A11y Presentation.pptxSimplifying Mobile A11y Presentation.pptx
Simplifying Mobile A11y Presentation.pptx
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Decarbonising Commercial Real Estate: The Role of Operational Performance
Decarbonising Commercial Real Estate: The Role of Operational PerformanceDecarbonising Commercial Real Estate: The Role of Operational Performance
Decarbonising Commercial Real Estate: The Role of Operational Performance
 

StarlingX - Project Onboarding

  • 1. StarlingX Project Onboarding SHUQUAN HUANG, 99CLOUD, STARLINGX TSC MEMBER
  • 2. Let Me Introduce StarlingX • New, top-level OpenStack Foundation pilot project • Software stack providing high performance, low latency, and high availability for Edge Cloud applications • Growing community.
  • 3.
  • 5. ~100MS ~10-40MS < 1-2MS< 5MS A.Latency B.Bandwidth C.Security D.Connectivity “WHERE” MATTERS What Is Driving Edge Computing? Source: Cloud Edge Computing: Beyond the Data Center https://www.openstack.org/edge-computing/cloud-edge-computing-beyond-the-data-center?lang=en_US
  • 6. What Problems Is StarlingX Solving? 1. Distributed infrastructure demands a different architecture 2. The maturity and robustness of Cloud is required everywhere 3. Managing a massively distributed compute environment is hard Massive data growth Network needs to be smarter
  • 7. Goals of the StarlingX Project Re-Configure Proven Cloud Technologies for Edge Compute • Orchestrate system-wide for bare metal, VMs and Container workloads • Deploy and manage Edge clouds, share configurations • Simplify deployment to geographically dispersed, remote Edge regions *Other names and brands may be claimed as the property of others Video Healthcare Manufacturing Transportation Smart cities Retail Energy Drones
  • 9. StarlingX provides a deployment-ready, scalable, highly reliable Edge infrastructure software platform Services from the StarlingX virtualization platform focus on • Easy deployment • Low touch manageability • Rapid response to events • Fast recovery Think control at the Edge, control between IoT and Cloud, control over your virtual machines. StarlingX - Edge Virtualization Platform *Other names and brands may be claimed as the property of others Kubernetes Components Kubelet etcd kube- scheduler kube-dns calico armada Docker kube- apiserver kube- controller- manager kube-proxy tiller helm kube- dashboard docker registry
  • 11. Scalability from Small to Large • Single Server • Runs all functions • Dual Server • Redundant design • Multiple Server • Fully resilient and geographically distributable Worker / Compute VM Container ContainerVM VM Container ContainerVM VM Container ContainerVM VM Container ContainerVM VM Container ContainerVM Worker / Compute Worker / Compute Worker / Compute Master / Control Master / Control Master / Control Master / Control Master / Control Worker / Compute
  • 12. Scaling from the Core to the Edge • Geographically distributed multi-region deployment, • Central Region providing Orchestration and Synchronization Services, • Geographically distributed Edge Regions of various sizes Central Region / Cloud Edge Region / Subcloud Edge Region / Subcloud Edge Region / Subcloud Edge Region / Subcloud
  • 13. Configuration Management • Manages installation • Auto-discover new nodes • Manage installation parameters (i.e. console, root disks) • Bulk provisioning of nodes through XML file • Nodal Configuration • Node role, role profiles • Core, memory (including huge page) assignments • Network Interfaces and storage assignments • Inventory Discovery • CPU/cores, SMT, processors, memory, huge pages • Storage, ports • GPUs, storage, Crypto/compression H/W System Configuration and Setup SQL DB Hardware Resources MANIFESTS Puppet Resources Puppet Resources Hardware Resources REST API System Inventory (Agents) System Inventory (Conductor) CLI Horizon Wizard Automation
  • 14. Host Management • Full life-cycle management of the host • Detects and automatically handles host failures and initiates recovery • Monitoring and alarms for • Cluster connectivity, critical process failures • Resource utilization thresholds, interface states • H/W fault / sensors, host watchdog • Activity progress reporting • Interfaces with board management (BMC) • For out of band reset • Power-on/off • H/W sensor monitoring • Manage the host via REST API Infrastructure Orchestration Configuration Management Host Management Service Management Request H/W Inventory Manage Monitor Processes Manage Monitor Hosts Manage Monitor VMs Vendor Neutral Host Management
  • 15. Software Management • Automated deploy of software updates for security and/or new functionality • Integrated end-to-end rolling upgrade solution • Automated, low number of steps • No additional hardware required for upgrade • Rolling upgrade across nodes • In-service and reboot required patches supported • Reboot required for kernel replacement etc. • VM live migration is used for patches that require reboot • Manages upgrades of all software • Host OS changes • New / upgraded StarlingX service software • New / upgraded Kubernetes software • New / upgraded OpenStack software Software Upgrades and Patching Hitless Migration Control Control Storage Storage Compute VM VM VM ... Compute VM VM VM SOURCE CLOUD ON RELEASE N Control Control Storage Storage Compute VM VM VM Compute VM VM VM ... SOURCE CLOUD ON RELEASE N+1 Worker / Compute Master / Control Worker / Compute Master / Control Master / Control Master / Control Worker / Compute Worker / Compute
  • 16. Distributed Cloud • Based on OpenStack Regions, • Central SystemController Region: - Hosting Shared Services and - System-wide Infrastructure Orchestration functions: § Deployment and Management of Subclouds, § Configuration portal for shared configuration across all Subclouds, • Users, Projects, Images, etc. . § Fault aggregation, § Patching orchestration. • Remote Edge / Subcloud Regions: - Geographically dispersed, - Connected via L3 network, - Running reduced Control Plane. • Inter-Region Communications strictly REST APIs / L3. Edge / Subcloud Region SystemController Region Edge / Subcloud Region Edge / Subcloud Region Layer 3 Network
  • 18. Principles • The StarlingX project follows the “four opens,” • Open Collaboration • Open Design • Open Development • Open Source • Technical decisions are made by technical contributors and a representative Technical Steering Committee. • The community is committed to diversity, openness, encouraging new contributors and leaders to rise up.
  • 19. Sub-project Structure • Main sub-projects • New functionality and services • Supporting sub-projects • Supporting services, test and infrastructure • Sub-project team structure • 1 Team Lead • 1 Project Lead • Core Reviewers • Contributors Technical Steering Committee StarlingX Main Sub-projects Config Fault HA GUI Metal NFV Update Distributed Cloud StarlingX Supporting Sub-projects Docs Build Distro: OpenStack Distro: non-OpenStack Test Security Containers Networking Releases MultiOS Python 2 —> 3 Devstack Zuul enablement
  • 20. Governance Roles • Contributor • Someone who made a contribution in the past 12 months • Code, test or documentation • Serving in a leadership role • Can run and vote for elected positions • Core Reviewer • Active contributors to a sub-project, appointed by fellow core reviewers • Responsible for reviewing changes and specifications • Can merge code and documentation changes
  • 21. Governance Roles • Technical Lead • Per sub-project • Core Reviewer with additional duties • Helps guiding the technical direction of a sub-project • Project Lead • Sub-project level coordination work • Tracks and communicates progress and priorities • Sub-project ambassador
  • 22. Governance Bodies • Technical Steering Committee (TSC) • Responsible for overall project architectural decisions • Managing the sub-project life-cycle • Making final decisions if sub-project Core Reviewers, Technical Leads or Project Leads disagree • It is comprised of 9 people. The first TSC members are Brent Rowsell (Wind River), Ian Jolliffe (Wind River), Dean Troyer (Intel), Saul Wold (Intel), Curtis Collicutt (Interdynamics), Ada Cunha (Ericsson), Shuquan Huang (99Cloud) and Miguel Lavalle (Verizon/OATH) •First TSC Election •First TSC election on the week of June 10th •5 TSC seats are up for election •Process is following the OpenStack TC election
  • 23. Community and Collaboration •Community metrics since the project creation • Contributors from more than 10 organizations • Near 3000 commits from 126 authors • Collaboration with OpenStack projects • Active collaboration on edge related bug fixes and feature enhancements for core services • Work in the Stein cycle in projects such as Nova, Neutron and Horizon • Packet.com • Infrastructure donor to provide hardware in real edge datacenters • PoC, testing and hands-on workshop activities are in progress • Cross-community collaboration • Akraino, OPNFV, EdgeX Foundry
  • 24. Contributions • Code and formal documentation are available through git / gerrit • git.starlingx.io • Informal documentation is also on our wiki: • https://wiki.openstack.org/wiki/StarlingX • Bugs are tracked in Launchpad • https://bugs.launchpad.net/starlingx • New ideas are introduced in the specs repository • https://git.openstack.org/cgit/openstack/stx-specs/ • Design and implementation work is tracked in StoryBoard • https://storyboard.openstack.org/#!/project_group/86
  • 25. Community • You do not need to be an Individual Member of the OpenStack Foundation in order to contribute, but if you want to vote in the annual OpenStack Foundation Board of Directors election, you may join: openstack.org/join • If you are contributing on behalf of an employer, they will need to sign a corporate contributor license agreement, which now covers all projects hosted by the OpenStack Foundation (same model such as Apache and CNCF)
  • 26. Communication • #starlingx@Freenode • Mailing Lists: • lists.starlingx.io • Email: • http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss • Weekly meetings: • Zoom calls • https://wiki.openstack.org/wiki/Starlingx/Meetings
  • 27. Get your hands dirty
  • 28. What you can learn from this summit? • Summit Sessions/Forum/Demos: • Precision Time Protocol (PTP) on StarlingX, Mon 3:50-4:30 Room Level 505/506 • Edge Computing Group’s MVP Architecture - StarlingX making it real!, Tue 9:50-10:30 Room Level 505/506 • Getting a new Open Source Project off the ground – the StarlingX story, Tue 9:00-9:40 Room Level 505/506 • StarlingX for OpenStack Operators, Wed 9:00-9:40 Ballroom Level 4A • StarlingX: Hardened Managed Kubernetes Platform for the Edge, Wed 10:50-11:40 Room Level 403/404 • StarlingX - Project Onboarding, Wed 11:40-12:00 Room Level 406 • StarlingX hands-on workshop, Wed 1:40-5:50 Ballroom Level 4E/F • IoT use case in StarlingX, Intel Booth