Linux is everywhere. Open Source has won! It has not. While Open Source components are all over the place, the big IT players use them to build platforms that are not fully open but designed to lock their users in. The question to ask these days is not: “Are you building on top of open source?”, because everyone is. The question should be: “Do you allow others to rebuild your whole platform?” and “Do you allow others to contribute to it and shape its future?” Sounds utopian? Sovereign Cloud Stack (SCS) tries to do exactly this: Build a network of operators to define common standards together, implement them in a complete, openly developed and fully open source manner and then even collaborate on operating it well — which can be harder than building it. The speaker will discuss the vision behind the the SCS project, how it has build the community and the technology stack, what it has achieved so far and where it will go next.
Linuxcon 2011 Crash Course in Open Source Cloud ComputingMark Hinkle
Presentation on the tools needed to deploy and manage IaaS or compute clouds using free and open source software.
Changelog:
Added Open Source PaaS
Automated Toolchains Diagram
Open Cloud Initiative (OCI)
Additional Resources
Overview and introductory remarks for the OGF sessions held May 21-22, 2015 co-located with the European Grid Initiative 2015 conference that took place the week of May 18-22, 2015 in Lisbon, Portugal. For details, see https://www.ogf.org/ogf/doku.php/events/ogf-44
The importance of building up open technology’s model citizen: a user storyAngel Diaz
Come join Angel Diaz (Vice President of Cloud Architecture & Technology at IBM) and his guest Semyon Gambrian (Director of Cloud Services Group at Kaiser Permanente) for a forwarding-looking presentation on Cloud Foundry in the context of its initial and more recent achievements, including a story of one team's use of Cloud Foundry in its evolving, industry-specific cloud integration strategy.
https://cfsummit2016.sched.org/speaker/aldiaz
Linuxcon 2011 Crash Course in Open Source Cloud ComputingMark Hinkle
Presentation on the tools needed to deploy and manage IaaS or compute clouds using free and open source software.
Changelog:
Added Open Source PaaS
Automated Toolchains Diagram
Open Cloud Initiative (OCI)
Additional Resources
Overview and introductory remarks for the OGF sessions held May 21-22, 2015 co-located with the European Grid Initiative 2015 conference that took place the week of May 18-22, 2015 in Lisbon, Portugal. For details, see https://www.ogf.org/ogf/doku.php/events/ogf-44
The importance of building up open technology’s model citizen: a user storyAngel Diaz
Come join Angel Diaz (Vice President of Cloud Architecture & Technology at IBM) and his guest Semyon Gambrian (Director of Cloud Services Group at Kaiser Permanente) for a forwarding-looking presentation on Cloud Foundry in the context of its initial and more recent achievements, including a story of one team's use of Cloud Foundry in its evolving, industry-specific cloud integration strategy.
https://cfsummit2016.sched.org/speaker/aldiaz
Data Con LA 2022-Open Source or Open Core in Your Data Layer? What Needs to B...Data Con LA
Anil Inamdar, VP & Head of Data Solutions, Instaclustr
Most organizations considering open source and open core cloud technologies as part of their all-important data stack understand they need to rigorously evaluate the software's licensing terms and gauge the long-term health of its community and ecosystem. What still happens less frequently ' but is just as crucial to these risk assessments ' is developing a thorough understanding of the business models governing the commercial organizations attached to each data-layer technology being considered. You must discern the underlying motivations of the vendors or technology providers you depend on to deliver or support open source data-layer software (as well as those vendors with strong influence over its development and maintenance). By acutely understanding these incentives, you can identify if, where, and how they may map to possible risks to your enterprise's adoption and ongoing open source implementation. Don't limit the assessment to licenses and community health -- although both are still very key variables.
This session will discuss specifics on what you need to look for and consider when vetting open source data technologies in the cloud as offered by:
-- Businesses using OSS as the foundation of their own intellectual property
-- Businesses that maintain total control offer the OSS they offer
-- Major cloud providers
CNCF general introduction to beginners at openstack meetup Pune & Bangalore February 2018. Covers broadly the activities and structure of the Cloud Native Computing Foundation.
http://walidshaari.blogspot.com/2016/12/devops-and-traditional-hpc.html
Cloud, Web, Big Data operations and DevOps mindsets are changing the Internet, IT and Enterprise services and applications scene rapidly. What can HPC community learn from these technologies, processes, and culture? From the IT unicorns "Google, Facebook, Twitter, Linkedin, and Etsy" that are in the lead? What could be applied to tackle HPC operations challenges? The problem of efficiency, better use of resources? A use case of automation and version control system in HPC enterprise data centre, as well a proposal for utilising containers and new schedulers to drive better utilizations and diversify the data centre workloads, not just HPC but big data, interactive, batch, short and long-lived scientific jobs.
Redfish is an IPMI replacement standardized by the DMTF. It provides a RESTful API for server out of band management and a lightweight data model specification that is scalable, discoverable and extensible. (Cf: http://www.dmtf.org/standards/redfish). This presentation will start by detailing its role and the features it provides with examples. It will demonstrate the benefits it provides to system administrator by providing a standardized open interface for multiple servers, and also storage systems.
We will then cover various tools such as the DMTF ones and the python-redfish library (Cf: https://github.com/openstack/python-redfish) offering Redfish abstractions.
Satyajit Tripathi has presented and evangelized OpenSolaris and Its Advanced Technologies at MSC OS Conference 2009 at KL Malaysia. He is also blogging on http://blogs.sun.com/stripathi.
Introduction to evolution of UNIX To Linux To Cloud. Essential facts a student should know in order to be a decent developer on these platforms. Organized as a talk to students who are studying with major in Computer Science or IT.
"OpenHPC is a collaborative, community effort that initiated from a desire to aggregate a number of common ingredients required to deploy and manage High Performance Computing (HPC) Linux clusters including provisioning tools, resource management, I/O clients, development tools, and a variety of scientific libraries. Packages provided by OpenHPC have been pre-built with HPC integration in mind with a goal to provide re-usable building blocks for the HPC community. Over time, the community also plans to identify and develop abstraction interfaces between key components to further enhance modularity and interchangeability. The community includes representation from a variety of sources including software vendors, equipment manufacturers, research institutions, supercomputing sites, and others."
Watch the video: http://wp.me/p3RLHQ-gKz
Learn more: http://openhpc.community/
Sign up for our insideHPC Newsletter: http://insidehpc.com/newsletter
Inder Gopal
VP System Technology
IBM
ONS2015: http://bit.ly/ons2015sd
ONS Inspire! Webinars: http://bit.ly/oiw-sd
Watch the talk (video) on ONS Content Archives: http://bit.ly/ons-archives-sd
Have you ever wondered how search works while visiting an e-commerce site, internal website, or searching through other types of online resources? Look no further than this informative session on the ways that taxonomies help end-users navigate the internet! Hear from taxonomists and other information professionals who have first-hand experience creating and working with taxonomies that aid in navigation, search, and discovery across a range of disciplines.
More Related Content
Similar to stackconf 2023 | SCS: Buildig Open Source Cloud and Container Infrastructure by Kurt Garloff.pdf
Data Con LA 2022-Open Source or Open Core in Your Data Layer? What Needs to B...Data Con LA
Anil Inamdar, VP & Head of Data Solutions, Instaclustr
Most organizations considering open source and open core cloud technologies as part of their all-important data stack understand they need to rigorously evaluate the software's licensing terms and gauge the long-term health of its community and ecosystem. What still happens less frequently ' but is just as crucial to these risk assessments ' is developing a thorough understanding of the business models governing the commercial organizations attached to each data-layer technology being considered. You must discern the underlying motivations of the vendors or technology providers you depend on to deliver or support open source data-layer software (as well as those vendors with strong influence over its development and maintenance). By acutely understanding these incentives, you can identify if, where, and how they may map to possible risks to your enterprise's adoption and ongoing open source implementation. Don't limit the assessment to licenses and community health -- although both are still very key variables.
This session will discuss specifics on what you need to look for and consider when vetting open source data technologies in the cloud as offered by:
-- Businesses using OSS as the foundation of their own intellectual property
-- Businesses that maintain total control offer the OSS they offer
-- Major cloud providers
CNCF general introduction to beginners at openstack meetup Pune & Bangalore February 2018. Covers broadly the activities and structure of the Cloud Native Computing Foundation.
http://walidshaari.blogspot.com/2016/12/devops-and-traditional-hpc.html
Cloud, Web, Big Data operations and DevOps mindsets are changing the Internet, IT and Enterprise services and applications scene rapidly. What can HPC community learn from these technologies, processes, and culture? From the IT unicorns "Google, Facebook, Twitter, Linkedin, and Etsy" that are in the lead? What could be applied to tackle HPC operations challenges? The problem of efficiency, better use of resources? A use case of automation and version control system in HPC enterprise data centre, as well a proposal for utilising containers and new schedulers to drive better utilizations and diversify the data centre workloads, not just HPC but big data, interactive, batch, short and long-lived scientific jobs.
Redfish is an IPMI replacement standardized by the DMTF. It provides a RESTful API for server out of band management and a lightweight data model specification that is scalable, discoverable and extensible. (Cf: http://www.dmtf.org/standards/redfish). This presentation will start by detailing its role and the features it provides with examples. It will demonstrate the benefits it provides to system administrator by providing a standardized open interface for multiple servers, and also storage systems.
We will then cover various tools such as the DMTF ones and the python-redfish library (Cf: https://github.com/openstack/python-redfish) offering Redfish abstractions.
Satyajit Tripathi has presented and evangelized OpenSolaris and Its Advanced Technologies at MSC OS Conference 2009 at KL Malaysia. He is also blogging on http://blogs.sun.com/stripathi.
Introduction to evolution of UNIX To Linux To Cloud. Essential facts a student should know in order to be a decent developer on these platforms. Organized as a talk to students who are studying with major in Computer Science or IT.
"OpenHPC is a collaborative, community effort that initiated from a desire to aggregate a number of common ingredients required to deploy and manage High Performance Computing (HPC) Linux clusters including provisioning tools, resource management, I/O clients, development tools, and a variety of scientific libraries. Packages provided by OpenHPC have been pre-built with HPC integration in mind with a goal to provide re-usable building blocks for the HPC community. Over time, the community also plans to identify and develop abstraction interfaces between key components to further enhance modularity and interchangeability. The community includes representation from a variety of sources including software vendors, equipment manufacturers, research institutions, supercomputing sites, and others."
Watch the video: http://wp.me/p3RLHQ-gKz
Learn more: http://openhpc.community/
Sign up for our insideHPC Newsletter: http://insidehpc.com/newsletter
Inder Gopal
VP System Technology
IBM
ONS2015: http://bit.ly/ons2015sd
ONS Inspire! Webinars: http://bit.ly/oiw-sd
Watch the talk (video) on ONS Content Archives: http://bit.ly/ons-archives-sd
Have you ever wondered how search works while visiting an e-commerce site, internal website, or searching through other types of online resources? Look no further than this informative session on the ways that taxonomies help end-users navigate the internet! Hear from taxonomists and other information professionals who have first-hand experience creating and working with taxonomies that aid in navigation, search, and discovery across a range of disciplines.
Acorn Recovery: Restore IT infra within minutesIP ServerOne
Introducing Acorn Recovery as a Service, a simple, fast, and secure managed disaster recovery (DRaaS) by IP ServerOne. A DR solution that helps restore your IT infra within minutes.
This presentation, created by Syed Faiz ul Hassan, explores the profound influence of media on public perception and behavior. It delves into the evolution of media from oral traditions to modern digital and social media platforms. Key topics include the role of media in information propagation, socialization, crisis awareness, globalization, and education. The presentation also examines media influence through agenda setting, propaganda, and manipulative techniques used by advertisers and marketers. Furthermore, it highlights the impact of surveillance enabled by media technologies on personal behavior and preferences. Through this comprehensive overview, the presentation aims to shed light on how media shapes collective consciousness and public opinion.
This presentation by Morris Kleiner (University of Minnesota), was made during the discussion “Competition and Regulation in Professions and Occupations” held at the Working Party No. 2 on Competition and Regulation on 10 June 2024. More papers and presentations on the topic can be found out at oe.cd/crps.
This presentation was uploaded with the author’s consent.
0x01 - Newton's Third Law: Static vs. Dynamic AbusersOWASP Beja
f you offer a service on the web, odds are that someone will abuse it. Be it an API, a SaaS, a PaaS, or even a static website, someone somewhere will try to figure out a way to use it to their own needs. In this talk we'll compare measures that are effective against static attackers and how to battle a dynamic attacker who adapts to your counter-measures.
About the Speaker
===============
Diogo Sousa, Engineering Manager @ Canonical
An opinionated individual with an interest in cryptography and its intersection with secure software development.
Sharpen existing tools or get a new toolbox? Contemporary cluster initiatives...Orkestra
UIIN Conference, Madrid, 27-29 May 2024
James Wilson, Orkestra and Deusto Business School
Emily Wise, Lund University
Madeline Smith, The Glasgow School of Art
3. 3
Why I started w/ Open Source
●
IT influences our lives & opportunities
– Industry, Private life, Society & Government
●
Want control in the hands of many / the civil
society
– Four freedoms (run, study&change, distribute,
distribute changes)
●
Collaborative approach results in better
software
4. 4
Linux & OSS everywhere
●
Linux on Smartphones, TVs, Routers,
… and the vast majority of servers
●
Hard to develop software today without
using OSS
– workflows
– libraries / components
– tools
5. 5
Everything great?
●
OSS software used to build proprietary software & platforms
– Permissive licenses allow for it
●
Power of large platforms
– Proprietary Integration, Documentation, Configuration, Operation
make it non-replicable
– Network / platform effects favor winner-takes-it-all markets
●
OSS defection
– Mongo, Elastic, Hashicorp, … no longer using OSI compliant
licenses
– Why not copyleft?
●
Open-washing
– Open core, Closed dev process, Single-vendor, ...
6. 6
Open Source is not enough?
●
Avoid other IP rights (patents) to take away freedoms
– Some licenses partially address this (Apache, GPL3)
●
CRA may put too high burden on OSS companies?
●
Large projects are difficult to fork
– Much prefer the ability to contribute and influence
– Four Opens help: Open Community, Open Dev Process,
Open Design, Fully Open Source
– Operating Complex Systems can be hard: Open
Operations
7. 7
2020s Openness question
●
How to avoid losing control in face of big (proprietary)
platforms dominating IT? Digital Sovereignty?
●
It’s no longer individual OSS projects alone that
determine the success
– Because of integration, … that can be huge
●
Need to build well-integrated platforms out of many
OSS solutions
●
Need to play the platform game – providing some
standardization to achieve scale effects
8. 8
Want Infra platform sovereignty
1) Legal compliance (GDPR)
2) Choice
Real choice requires low switching cost
Insourcing option
3) Ability to shape technology
4) Gain skills and transparency
10. 10
SCS – network for a virtual hyperscaler
Operated by one company in many regions
no in-sourcing option (except AzureStack)
very limited „sovereign“ (trustee) offers
Technology controlled by one entity
One set of centrally controlled standards
and implementations
One set of User Identities
Some Open Source
Some transparency into Operations
Hyperscaler
Operated by many companies
in-sourcing realistic
trusted local operators or self-operation
Technology controlled by the SCS community
Automatically testable and certifiable standards
create interoperability - Federated user
management (OIDC)
100% Open Source, Open Dev, Design,
Community (4 Opens)
Open Operations
Joint knowledge building (tooling, practices, culture)
High level of transparency
Virtual Hyperscaler
11. 11
Sovereign Cloud Stack Deliverables
The three pillars
2
Modular Open Source
Reference Implementation
1
Certifiable
Standards
3
Operational
Knowledge
12. 12
Open Ops: You’re not alone in Ops
Share knowledge
e.g. monitoring setup and config
Share status
e.g. health & performance monitoring
Share challenges
e.g. fraud detection
Public Root Cause Analysis
e.g. outages
SCS resources:
Blog
OperationalDocs
Operator Lean Coffee
Open Ops Meetup
Tools:
e.g. Health-mon dashboard
Next: RCA templates
Link collection
13. 14
Sovereignty Taxonomy
US Hyper
Scaler
Trustee EU Hyper
Scaler
Proprietary
private
SCS
public
SCS
private
GDPR - + ++ + +[2] ++
Choice
- switching - - - o +[4] +[4]
- insourcing - (o)[1] - - +[3] + +
Tech shaping - - - - + ++
Skills & Transp - - - o +[5] ++[5]
[1] Options like AzureStack improve this
[2] Ecosystem ensures local providers can succeed
[3] Depends on whether others do the same
[4] SCS providers share meaningful standards
Implementation & Operations made easier by SCS
[5] Open Operations
14. 15
●
Grant from BMWK (German Ministry for Economic Affairs
and Climate Change)
●
Project team @ OSB Alliance e.V. (non-profit)
●
Paid development (public tenders)
●
Community with >40 active members, collaboration with
upstream & with Gaia-X
●
Lots of publications, event presentations, ...
●
6 public clouds (betacloud, pluscloud open, wavestack, regio,
aov, artcodix), private implementations TLRZ (B1), DAX, …
●
Integration partners (OSISM, B1, stackXperts, dNation,
syself, …) can provide skilled support
●
5 releases of our reference implementation (2/a)
●
Certification program in rollout
Putting SCS into reality
15. 16
Operators and Integrators
SCS Project @ OSBA
Governance
Coordination
Certification
Validation
Upstream
Commu-
nities
SCS
Commu-
nity
Paid SCS
develop-
ment
CNCF LF OIF Canonical
CNCF LF OIF Canonical RedHat …
Support
Partners
Implemen-
tation
Partners
Training
Partners
SCS
CSPs
SCS in
Industry
SCS in
Public
Sector
SCS in
Research
DevOps
Teams
Value-Add
Services
End
Users
Gaia-X
BSI
ISO
GDPR
Gaia-X
Data
Hubs
Gaia-X
Federation
Services
(Infra)
Operators
Servi-
ces
SaaS/PaaS
ISVs
Development
Community
Found/Orgs
Standards/
Rules
18. 19
SCS Architecture (Software)
What’s in it (currently)?
Open Source
Four Opens
Open
Operations
IAM
Ops
IaaS
KaaS
PaaS FS
SCS Platform Services (PaaS) are Work-in-Progress
Hardware and Federation Services not part of SCS software
KaaS = Kubernetes as a Service
19. 20
Upcoming: SCS R5 (2023-09-20)
●
IaaS layer
– OpenStack 2023.1 (Antelope), ceph Quincy, OVN 23.06
– Preferring diskless flavors (see blog article)
– Official IPv6 support
– OpenStack Resource Manager (clean up orphaned/broken resrc)
– Improved metering (Tech Preview)
●
Kubernetes layer
– K8s v1.25 – v1.27 (v1.28 as Tech Preview)
– cluster-api-1.5, cluster-api-openstack-0.7
– Default to cilium CNI, optional gateway API (Tech Preview)
– Full (optional) Harbor integration (roll out and use)
– Robustness and security features (IP range filtering, resource limits, etcd backup, private CA
support...)
●
Vastly reworked documentation
●
Extend zuul CI to k8s testing
●
Improve federation (proxy domain in keycloak)