SlideShare a Scribd company logo
1 of 21
Download to read offline
Kurt Garloff
SCS: Building Open Source
Cloud & Container Infrastructure
kurt@garloff.de
@garloff:matrix.org
2
3
Why I started w/ Open Source
●
IT influences our lives & opportunities
– Industry, Private life, Society & Government
●
Want control in the hands of many / the civil
society
– Four freedoms (run, study&change, distribute,
distribute changes)
●
Collaborative approach results in better
software
4
Linux & OSS everywhere
●
Linux on Smartphones, TVs, Routers,
… and the vast majority of servers
●
Hard to develop software today without
using OSS
– workflows
– libraries / components
– tools
5
Everything great?
●
OSS software used to build proprietary software & platforms
– Permissive licenses allow for it
●
Power of large platforms
– Proprietary Integration, Documentation, Configuration, Operation
make it non-replicable
– Network / platform effects favor winner-takes-it-all markets
●
OSS defection
– Mongo, Elastic, Hashicorp, … no longer using OSI compliant
licenses
– Why not copyleft?
●
Open-washing
– Open core, Closed dev process, Single-vendor, ...
6
Open Source is not enough?
●
Avoid other IP rights (patents) to take away freedoms
– Some licenses partially address this (Apache, GPL3)
●
CRA may put too high burden on OSS companies?
●
Large projects are difficult to fork
– Much prefer the ability to contribute and influence
– Four Opens help: Open Community, Open Dev Process,
Open Design, Fully Open Source
– Operating Complex Systems can be hard: Open
Operations
7
2020s Openness question
●
How to avoid losing control in face of big (proprietary)
platforms dominating IT? Digital Sovereignty?
●
It’s no longer individual OSS projects alone that
determine the success
– Because of integration, … that can be huge
●
Need to build well-integrated platforms out of many
OSS solutions
●
Need to play the platform game – providing some
standardization to achieve scale effects
8
Want Infra platform sovereignty
1) Legal compliance (GDPR)
2) Choice
Real choice requires low switching cost
Insourcing option
3) Ability to shape technology
4) Gain skills and transparency
9
SCS vision
One platform
–
standardized,
built and
operated by
many.
10
SCS – network for a virtual hyperscaler
Operated by one company in many regions
no in-sourcing option (except AzureStack)
very limited „sovereign“ (trustee) offers
Technology controlled by one entity
One set of centrally controlled standards
and implementations
One set of User Identities
Some Open Source
Some transparency into Operations
Hyperscaler
Operated by many companies
in-sourcing realistic
trusted local operators or self-operation
Technology controlled by the SCS community
Automatically testable and certifiable standards
create interoperability - Federated user
management (OIDC)
100% Open Source, Open Dev, Design,
Community (4 Opens)
Open Operations
Joint knowledge building (tooling, practices, culture)
High level of transparency
Virtual Hyperscaler
11
Sovereign Cloud Stack Deliverables
The three pillars
2
Modular Open Source
Reference Implementation
1
Certifiable
Standards
3
Operational
Knowledge
12
Open Ops: You’re not alone in Ops
Share knowledge
e.g. monitoring setup and config
Share status
e.g. health & performance monitoring
Share challenges
e.g. fraud detection
Public Root Cause Analysis
e.g. outages
SCS resources:
Blog
OperationalDocs
Operator Lean Coffee
Open Ops Meetup
Tools:
e.g. Health-mon dashboard
Next: RCA templates
Link collection
14
Sovereignty Taxonomy
US Hyper
Scaler
Trustee EU Hyper
Scaler
Proprietary
private
SCS
public
SCS
private
GDPR - + ++ + +[2] ++
Choice
- switching - - - o +[4] +[4]
- insourcing - (o)[1] - - +[3] + +
Tech shaping - - - - + ++
Skills & Transp - - - o +[5] ++[5]
[1] Options like AzureStack improve this
[2] Ecosystem ensures local providers can succeed
[3] Depends on whether others do the same
[4] SCS providers share meaningful standards
Implementation & Operations made easier by SCS
[5] Open Operations
15
●
Grant from BMWK (German Ministry for Economic Affairs
and Climate Change)
●
Project team @ OSB Alliance e.V. (non-profit)
●
Paid development (public tenders)
●
Community with >40 active members, collaboration with
upstream & with Gaia-X
●
Lots of publications, event presentations, ...
●
6 public clouds (betacloud, pluscloud open, wavestack, regio,
aov, artcodix), private implementations TLRZ (B1), DAX, …
●
Integration partners (OSISM, B1, stackXperts, dNation,
syself, …) can provide skilled support
●
5 releases of our reference implementation (2/a)
●
Certification program in rollout
Putting SCS into reality
16
Operators and Integrators
SCS Project @ OSBA
Governance
Coordination
Certification
Validation
Upstream
Commu-
nities
SCS
Commu-
nity
Paid SCS
develop-
ment
CNCF LF OIF Canonical
CNCF LF OIF Canonical RedHat …
Support
Partners
Implemen-
tation
Partners
Training
Partners
SCS
CSPs
SCS in
Industry
SCS in
Public
Sector
SCS in
Research
DevOps
Teams
Value-Add
Services
End
Users
Gaia-X
BSI
ISO
GDPR
Gaia-X
Data
Hubs
Gaia-X
Federation
Services
(Infra)
Operators
Servi-
ces
SaaS/PaaS
ISVs
Development
Community
Found/Orgs
Standards/
Rules
17
Transparency …
IaaS SCS-compatible
18
… and health-status
openstack-health-monitor
19
SCS Architecture (Software)
What’s in it (currently)?
Open Source
Four Opens
Open
Operations
IAM
Ops
IaaS
KaaS
PaaS FS
SCS Platform Services (PaaS) are Work-in-Progress
Hardware and Federation Services not part of SCS software
KaaS = Kubernetes as a Service
20
Upcoming: SCS R5 (2023-09-20)
●
IaaS layer
– OpenStack 2023.1 (Antelope), ceph Quincy, OVN 23.06
– Preferring diskless flavors (see blog article)
– Official IPv6 support
– OpenStack Resource Manager (clean up orphaned/broken resrc)
– Improved metering (Tech Preview)
●
Kubernetes layer
– K8s v1.25 – v1.27 (v1.28 as Tech Preview)
– cluster-api-1.5, cluster-api-openstack-0.7
– Default to cilium CNI, optional gateway API (Tech Preview)
– Full (optional) Harbor integration (roll out and use)
– Robustness and security features (IP range filtering, resource limits, etcd backup, private CA
support...)
●
Vastly reworked documentation
●
Extend zuul CI to k8s testing
●
Improve federation (proxy domain in keycloak)
21
References
●
Homepage: https://scs.community/
Docs: https://docs.scs.community/
●
Code: https://github.com/SovereignCloudStack/
●
OpenOps: https://openoperations.org/
●
OIF talks: https://www.youtube.com/watch?v=i2hQQFJi3Yo
https://www.youtube.com/watch?v=oGuUty7ufN8
●
Cloud report article:
https://the-report.cloud/why-digital-sovereignty-is-more-than-mer
e-legal-compliance
●
DuD article (DE)
22
Advance Open Source!
●
Join community https://scs.community/contribute/
●
Contribute to SCS / upstream (LF, OIF, CNCF, ...)
– Code, Docs, Issues, Standards, ...
●
Apply (we’re hiring!) or offer for our tenders
●
Fight for sovereignty beyond legal compliance:
Real choice, shaping, transparency&skills
●
Implement SCS standards in your infra
●
Implement SCS ref. impl. (as private or public
cloud)
●
Offer services
●
Questions?

More Related Content

Similar to stackconf 2023 | SCS: Buildig Open Source Cloud and Container Infrastructure by Kurt Garloff

Data Con LA 2022-Open Source or Open Core in Your Data Layer? What Needs to B...
Data Con LA 2022-Open Source or Open Core in Your Data Layer? What Needs to B...Data Con LA 2022-Open Source or Open Core in Your Data Layer? What Needs to B...
Data Con LA 2022-Open Source or Open Core in Your Data Layer? What Needs to B...Data Con LA
 
CNCF Introduction - Feb 2018
CNCF Introduction - Feb 2018CNCF Introduction - Feb 2018
CNCF Introduction - Feb 2018Krishna-Kumar
 
What HPC can learn from DevOps?
What HPC can learn from DevOps?What HPC can learn from DevOps?
What HPC can learn from DevOps?Walid Shaari
 
Red hat's updates on the cloud & infrastructure strategy
Red hat's updates on the cloud & infrastructure strategyRed hat's updates on the cloud & infrastructure strategy
Red hat's updates on the cloud & infrastructure strategyOrgad Kimchi
 
Deploying and Managing Artificial Intelligence Services using the Open Data H...
Deploying and Managing Artificial Intelligence Services using the Open Data H...Deploying and Managing Artificial Intelligence Services using the Open Data H...
Deploying and Managing Artificial Intelligence Services using the Open Data H...Orgad Kimchi
 
Canonical Ubuntu OpenStack Overview Presentation
Canonical Ubuntu OpenStack Overview PresentationCanonical Ubuntu OpenStack Overview Presentation
Canonical Ubuntu OpenStack Overview PresentationThe World Bank
 
KB Seminars: Working with Technology - Platforms; 10/13
KB Seminars: Working with Technology - Platforms; 10/13KB Seminars: Working with Technology - Platforms; 10/13
KB Seminars: Working with Technology - Platforms; 10/13MDIF
 
Open Stack Cloud Services
Open Stack Cloud ServicesOpen Stack Cloud Services
Open Stack Cloud ServicesSaurabh Gupta
 
IPMI is dead, Long live Redfish
IPMI is dead, Long live RedfishIPMI is dead, Long live Redfish
IPMI is dead, Long live RedfishBruno Cornec
 
DevOps Digital Transformation: A real life use case enabled by Alien4Cloud
DevOps Digital Transformation: A real life use case enabled by Alien4CloudDevOps Digital Transformation: A real life use case enabled by Alien4Cloud
DevOps Digital Transformation: A real life use case enabled by Alien4CloudCloudify Community
 
OpenSolaris Introduction
OpenSolaris IntroductionOpenSolaris Introduction
OpenSolaris Introductionsatyajit_t
 
Unix linux talk_by_pk_mishra_v1.8
Unix linux talk_by_pk_mishra_v1.8Unix linux talk_by_pk_mishra_v1.8
Unix linux talk_by_pk_mishra_v1.8PK Mishra
 
Open Stack Cloud Services
Open Stack Cloud ServicesOpen Stack Cloud Services
Open Stack Cloud ServicesSaurabh Gupta
 
Introducción a Microservicios, SUSE CaaS Platform y Kubernetes
Introducción a Microservicios, SUSE CaaS Platform y KubernetesIntroducción a Microservicios, SUSE CaaS Platform y Kubernetes
Introducción a Microservicios, SUSE CaaS Platform y KubernetesSUSE España
 
OpenHPC: A Comprehensive System Software Stack
OpenHPC: A Comprehensive System Software StackOpenHPC: A Comprehensive System Software Stack
OpenHPC: A Comprehensive System Software Stackinside-BigData.com
 
InfoSec 2011: Crash Course Open Source Cloud Computing
InfoSec 2011: Crash Course Open Source Cloud ComputingInfoSec 2011: Crash Course Open Source Cloud Computing
InfoSec 2011: Crash Course Open Source Cloud ComputingMark Hinkle
 
The Next Generation Datacenter
The Next Generation DatacenterThe Next Generation Datacenter
The Next Generation DatacenterRed Hat Events
 
Docker meetup - PaaS interoperability
Docker meetup - PaaS interoperabilityDocker meetup - PaaS interoperability
Docker meetup - PaaS interoperabilityLudovic Piot
 

Similar to stackconf 2023 | SCS: Buildig Open Source Cloud and Container Infrastructure by Kurt Garloff (20)

Data Con LA 2022-Open Source or Open Core in Your Data Layer? What Needs to B...
Data Con LA 2022-Open Source or Open Core in Your Data Layer? What Needs to B...Data Con LA 2022-Open Source or Open Core in Your Data Layer? What Needs to B...
Data Con LA 2022-Open Source or Open Core in Your Data Layer? What Needs to B...
 
CNCF Introduction - Feb 2018
CNCF Introduction - Feb 2018CNCF Introduction - Feb 2018
CNCF Introduction - Feb 2018
 
What HPC can learn from DevOps?
What HPC can learn from DevOps?What HPC can learn from DevOps?
What HPC can learn from DevOps?
 
Red hat's updates on the cloud & infrastructure strategy
Red hat's updates on the cloud & infrastructure strategyRed hat's updates on the cloud & infrastructure strategy
Red hat's updates on the cloud & infrastructure strategy
 
Deploying and Managing Artificial Intelligence Services using the Open Data H...
Deploying and Managing Artificial Intelligence Services using the Open Data H...Deploying and Managing Artificial Intelligence Services using the Open Data H...
Deploying and Managing Artificial Intelligence Services using the Open Data H...
 
Canonical Ubuntu OpenStack Overview Presentation
Canonical Ubuntu OpenStack Overview PresentationCanonical Ubuntu OpenStack Overview Presentation
Canonical Ubuntu OpenStack Overview Presentation
 
KB Seminars: Working with Technology - Platforms; 10/13
KB Seminars: Working with Technology - Platforms; 10/13KB Seminars: Working with Technology - Platforms; 10/13
KB Seminars: Working with Technology - Platforms; 10/13
 
Open Stack Cloud Services
Open Stack Cloud ServicesOpen Stack Cloud Services
Open Stack Cloud Services
 
IPMI is dead, Long live Redfish
IPMI is dead, Long live RedfishIPMI is dead, Long live Redfish
IPMI is dead, Long live Redfish
 
DevOps Digital Transformation: A real life use case enabled by Alien4Cloud
DevOps Digital Transformation: A real life use case enabled by Alien4CloudDevOps Digital Transformation: A real life use case enabled by Alien4Cloud
DevOps Digital Transformation: A real life use case enabled by Alien4Cloud
 
OpenSolaris Introduction
OpenSolaris IntroductionOpenSolaris Introduction
OpenSolaris Introduction
 
Unix linux talk_by_pk_mishra_v1.8
Unix linux talk_by_pk_mishra_v1.8Unix linux talk_by_pk_mishra_v1.8
Unix linux talk_by_pk_mishra_v1.8
 
Open Stack Cloud Services
Open Stack Cloud ServicesOpen Stack Cloud Services
Open Stack Cloud Services
 
Introducción a Microservicios, SUSE CaaS Platform y Kubernetes
Introducción a Microservicios, SUSE CaaS Platform y KubernetesIntroducción a Microservicios, SUSE CaaS Platform y Kubernetes
Introducción a Microservicios, SUSE CaaS Platform y Kubernetes
 
OpenHPC: A Comprehensive System Software Stack
OpenHPC: A Comprehensive System Software StackOpenHPC: A Comprehensive System Software Stack
OpenHPC: A Comprehensive System Software Stack
 
InfoSec 2011: Crash Course Open Source Cloud Computing
InfoSec 2011: Crash Course Open Source Cloud ComputingInfoSec 2011: Crash Course Open Source Cloud Computing
InfoSec 2011: Crash Course Open Source Cloud Computing
 
Introduction to OpenDaylight
Introduction to OpenDaylightIntroduction to OpenDaylight
Introduction to OpenDaylight
 
Meetup srilanka
Meetup srilankaMeetup srilanka
Meetup srilanka
 
The Next Generation Datacenter
The Next Generation DatacenterThe Next Generation Datacenter
The Next Generation Datacenter
 
Docker meetup - PaaS interoperability
Docker meetup - PaaS interoperabilityDocker meetup - PaaS interoperability
Docker meetup - PaaS interoperability
 

Recently uploaded

Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024The Digital Insurer
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Wonjun Hwang
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
costume and set research powerpoint presentation
costume and set research powerpoint presentationcostume and set research powerpoint presentation
costume and set research powerpoint presentationphoebematthew05
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 

Recently uploaded (20)

Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
costume and set research powerpoint presentation
costume and set research powerpoint presentationcostume and set research powerpoint presentation
costume and set research powerpoint presentation
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 

stackconf 2023 | SCS: Buildig Open Source Cloud and Container Infrastructure by Kurt Garloff

  • 1. Kurt Garloff SCS: Building Open Source Cloud & Container Infrastructure kurt@garloff.de @garloff:matrix.org
  • 2. 2
  • 3. 3 Why I started w/ Open Source ● IT influences our lives & opportunities – Industry, Private life, Society & Government ● Want control in the hands of many / the civil society – Four freedoms (run, study&change, distribute, distribute changes) ● Collaborative approach results in better software
  • 4. 4 Linux & OSS everywhere ● Linux on Smartphones, TVs, Routers, … and the vast majority of servers ● Hard to develop software today without using OSS – workflows – libraries / components – tools
  • 5. 5 Everything great? ● OSS software used to build proprietary software & platforms – Permissive licenses allow for it ● Power of large platforms – Proprietary Integration, Documentation, Configuration, Operation make it non-replicable – Network / platform effects favor winner-takes-it-all markets ● OSS defection – Mongo, Elastic, Hashicorp, … no longer using OSI compliant licenses – Why not copyleft? ● Open-washing – Open core, Closed dev process, Single-vendor, ...
  • 6. 6 Open Source is not enough? ● Avoid other IP rights (patents) to take away freedoms – Some licenses partially address this (Apache, GPL3) ● CRA may put too high burden on OSS companies? ● Large projects are difficult to fork – Much prefer the ability to contribute and influence – Four Opens help: Open Community, Open Dev Process, Open Design, Fully Open Source – Operating Complex Systems can be hard: Open Operations
  • 7. 7 2020s Openness question ● How to avoid losing control in face of big (proprietary) platforms dominating IT? Digital Sovereignty? ● It’s no longer individual OSS projects alone that determine the success – Because of integration, … that can be huge ● Need to build well-integrated platforms out of many OSS solutions ● Need to play the platform game – providing some standardization to achieve scale effects
  • 8. 8 Want Infra platform sovereignty 1) Legal compliance (GDPR) 2) Choice Real choice requires low switching cost Insourcing option 3) Ability to shape technology 4) Gain skills and transparency
  • 10. 10 SCS – network for a virtual hyperscaler Operated by one company in many regions no in-sourcing option (except AzureStack) very limited „sovereign“ (trustee) offers Technology controlled by one entity One set of centrally controlled standards and implementations One set of User Identities Some Open Source Some transparency into Operations Hyperscaler Operated by many companies in-sourcing realistic trusted local operators or self-operation Technology controlled by the SCS community Automatically testable and certifiable standards create interoperability - Federated user management (OIDC) 100% Open Source, Open Dev, Design, Community (4 Opens) Open Operations Joint knowledge building (tooling, practices, culture) High level of transparency Virtual Hyperscaler
  • 11. 11 Sovereign Cloud Stack Deliverables The three pillars 2 Modular Open Source Reference Implementation 1 Certifiable Standards 3 Operational Knowledge
  • 12. 12 Open Ops: You’re not alone in Ops Share knowledge e.g. monitoring setup and config Share status e.g. health & performance monitoring Share challenges e.g. fraud detection Public Root Cause Analysis e.g. outages SCS resources: Blog OperationalDocs Operator Lean Coffee Open Ops Meetup Tools: e.g. Health-mon dashboard Next: RCA templates Link collection
  • 13. 14 Sovereignty Taxonomy US Hyper Scaler Trustee EU Hyper Scaler Proprietary private SCS public SCS private GDPR - + ++ + +[2] ++ Choice - switching - - - o +[4] +[4] - insourcing - (o)[1] - - +[3] + + Tech shaping - - - - + ++ Skills & Transp - - - o +[5] ++[5] [1] Options like AzureStack improve this [2] Ecosystem ensures local providers can succeed [3] Depends on whether others do the same [4] SCS providers share meaningful standards Implementation & Operations made easier by SCS [5] Open Operations
  • 14. 15 ● Grant from BMWK (German Ministry for Economic Affairs and Climate Change) ● Project team @ OSB Alliance e.V. (non-profit) ● Paid development (public tenders) ● Community with >40 active members, collaboration with upstream & with Gaia-X ● Lots of publications, event presentations, ... ● 6 public clouds (betacloud, pluscloud open, wavestack, regio, aov, artcodix), private implementations TLRZ (B1), DAX, … ● Integration partners (OSISM, B1, stackXperts, dNation, syself, …) can provide skilled support ● 5 releases of our reference implementation (2/a) ● Certification program in rollout Putting SCS into reality
  • 15. 16 Operators and Integrators SCS Project @ OSBA Governance Coordination Certification Validation Upstream Commu- nities SCS Commu- nity Paid SCS develop- ment CNCF LF OIF Canonical CNCF LF OIF Canonical RedHat … Support Partners Implemen- tation Partners Training Partners SCS CSPs SCS in Industry SCS in Public Sector SCS in Research DevOps Teams Value-Add Services End Users Gaia-X BSI ISO GDPR Gaia-X Data Hubs Gaia-X Federation Services (Infra) Operators Servi- ces SaaS/PaaS ISVs Development Community Found/Orgs Standards/ Rules
  • 18. 19 SCS Architecture (Software) What’s in it (currently)? Open Source Four Opens Open Operations IAM Ops IaaS KaaS PaaS FS SCS Platform Services (PaaS) are Work-in-Progress Hardware and Federation Services not part of SCS software KaaS = Kubernetes as a Service
  • 19. 20 Upcoming: SCS R5 (2023-09-20) ● IaaS layer – OpenStack 2023.1 (Antelope), ceph Quincy, OVN 23.06 – Preferring diskless flavors (see blog article) – Official IPv6 support – OpenStack Resource Manager (clean up orphaned/broken resrc) – Improved metering (Tech Preview) ● Kubernetes layer – K8s v1.25 – v1.27 (v1.28 as Tech Preview) – cluster-api-1.5, cluster-api-openstack-0.7 – Default to cilium CNI, optional gateway API (Tech Preview) – Full (optional) Harbor integration (roll out and use) – Robustness and security features (IP range filtering, resource limits, etcd backup, private CA support...) ● Vastly reworked documentation ● Extend zuul CI to k8s testing ● Improve federation (proxy domain in keycloak)
  • 20. 21 References ● Homepage: https://scs.community/ Docs: https://docs.scs.community/ ● Code: https://github.com/SovereignCloudStack/ ● OpenOps: https://openoperations.org/ ● OIF talks: https://www.youtube.com/watch?v=i2hQQFJi3Yo https://www.youtube.com/watch?v=oGuUty7ufN8 ● Cloud report article: https://the-report.cloud/why-digital-sovereignty-is-more-than-mer e-legal-compliance ● DuD article (DE)
  • 21. 22 Advance Open Source! ● Join community https://scs.community/contribute/ ● Contribute to SCS / upstream (LF, OIF, CNCF, ...) – Code, Docs, Issues, Standards, ... ● Apply (we’re hiring!) or offer for our tenders ● Fight for sovereignty beyond legal compliance: Real choice, shaping, transparency&skills ● Implement SCS standards in your infra ● Implement SCS ref. impl. (as private or public cloud) ● Offer services ● Questions?