Linux tag 2013 Data Center Automation with YADT

Schlomo Schapiro
Schlomo SchapiroAgile IT & Open Source Enthusiast at Zalando SE
Data Center Automation
with YADT
Berlin | 23.05.2013 | Schlomo Schapiro
Systems Architect, Open Source Evangelist
License: http://creativecommons.org/licenses/by-nc-nd/3.0/
Slide 2 | Data Center Automation with YADT | Schlomo Schapiro
www.ImmobilienScout24.de
>2 billion PI per month
2 data center with ~1400 VM
total of ~600 employees
 ~30 crossfunctional IT teams
 ~160 in IT
15 years in business
part of Deutsche Telekom
Slide 3 | Data Center Automation with YADT | Schlomo Schapiro
Slide 4 | Data Center Automation with YADT | Schlomo Schapiro
Systems Management with YADT
Slide 5 | Data Center Automation with YADT | Schlomo Schapiro
The Big Picture – Continuous Delivery Platform
Business
Decision
To Go
Live
All Humans
are on the
Same Side
Build
Config
Deploy
Test
Systems-
Management
Automation
Scale Out
Data Centers
Slide 6 | Data Center Automation with YADT | Schlomo Schapiro
1st task: Reduce Systemic Complexity
File Management
Systems Management
Slide 7 | Data Center Automation with YADT | Schlomo Schapiro
File Management with RPM & YUM
Slide 8 | Data Center Automation with YADT | Schlomo Schapiro
File Management with RPM & YUM
Libraries
Applications
Configuration
Operating System
100 %
Slide 9 | Data Center Automation with YADT | Schlomo Schapiro
File Management with RPM & YUM
PROD
DEV
Infrastructure
Build
Application
Build
Configuration
Build
QA
YUM
Repos
Slide 10 | Data Center Automation with YADT | Schlomo Schapiro
File Management with RPM & YUM
Interface
PROD
DEV
Infrastructure
Build
Application
Build
Configuration
Build
QA
YUM
Repos
Slide 11 | Data Center Automation with YADT | Schlomo Schapiro
PROD
DEV
Infrastructure
Build
Application
Build
QA
YUM
Repos
Configuration Build – Pre-built Config Content
Configuration
Build
Slide 12 | Data Center Automation with YADT | Schlomo Schapiro
Configuration Build – Pre-built Config Content
SVN
commit
config file
build
config RPM
RPMs
with
static
content
YUM
Repo
Slide 13 | Data Center Automation with YADT | Schlomo Schapiro
Templating
Variables
Overlaying
Configuration Build – Pre-built Config Content
SVN
commit
config file
build
config RPM
RPMs
with
static
content
YUM
Repo
Slide 14 | Data Center Automation with YADT | Schlomo Schapiro
we use
1 RPM
per host
Templating
Variables
Overlaying
Configuration Build – Pre-built Config Content
SVN
commit
config file
build
config RPM
RPMs
with
static
content
YUM
Repo
Slide 15 | Data Center Automation with YADT | Schlomo Schapiro
Shared
responsability
Ops, Dev, QA ...
we use
1 RPM
per host
Templating
Variables
Overlaying
Configuration Build – Pre-built Config Content
SVN
commit
config file
build
config RPM
RPMs
with
static
content
YUM
Repo
Slide 16 | Data Center Automation with YADT | Schlomo Schapiro
Application Build – Continuous Release Delivery
PROD
DEV
Infrastructure
Build
QA
YUM
Repos
Configuration
Build
Application
Build
Slide 17 | Data Center Automation with YADT | Schlomo Schapiro
Application Build – Package Promotion Pipeline
YUM
Repo
Tested
Repo
YUM
Repo
Released
Repo
YUM
Repo
Comitted
Repo
DEV Pre-PROD PROD
Slide 18 | Data Center Automation with YADT | Schlomo Schapiro
Application Build – Package Promotion Pipeline
YUM
Repo
Tested
Repo
YUM
Repo
Released
Repo
YUM
Repo
Comitted
Repo
DEV Pre-PROD PROD
CI
Deploy
&
Test
Auto-
promote
release if
tests OK
Deploy
&
Test
Business
decision
to Go Live
with
tested
versions
Deploy
&
Test
Slide 19 | Data Center Automation with YADT | Schlomo Schapiro
File Management through many YUM repositories
PROD
DEV
Infrastructure
Build
Application
Build
Configuration
Build
QA
YUM
Repo
YUM
RepoYUM
RepoYUM
Repo
Slide 20 | Data Center Automation with YADT | Schlomo Schapiro
Systems Management with YADT
Slide 21 | Data Center Automation with YADT | Schlomo Schapiro
YADT – Unified Dependency Tree
Web Server
HTTPD
Tomcat
App Server
Load Balancer
Slide 22 | Data Center Automation with YADT | Schlomo Schapiro
HTTPD
Tomcat
web-
app
httpd
config
tomcat
YADT – Unified Dependency Tree
init
script
init
script
Slide 23 | Data Center Automation with YADT | Schlomo Schapiro
YADT – Large Scale System Management
Web Server
HTTPD
Tomcat
web-
app
httpd
config
tomcat
App Server
Java App
app
config
Slide 24 | Data Center Automation with YADT | Schlomo Schapiro
YADT – Large Scale System Management
LB: www.immobilienscout24.de
Web Server
HTTPD
Tomcat
web-
app
httpd
config
tomcat
App Server
Java App
app
config
Web Server
HTTPD
Tomcat
web-
app
httpd
config
tomcat
App Server
Java App
app
config
Slide 25 | Data Center Automation with YADT | Schlomo Schapiro
YADT – Large Scale System Management
LB: www.immobilienscout24.de
Web Server
HTTPD
Tomcat
web-
app
httpd
config
tomcat
App Server
Java App
app
config
Web Server
HTTPD
Tomcat
web-
app
httpd
config
tomcat
App Server
Java App
app
config
1st
chunk
Slide 26 | Data Center Automation with YADT | Schlomo Schapiro
YADT – Large Scale System Management
LB: www.immobilienscout24.de
Web Server
HTTPD
Tomcat
web-
app
httpd
config
tomcat
App Server
Java App
app
config
Web Server
HTTPD
Tomcat
web-
app
httpd
config
tomcat
App Server
Java App
app
config
1st
chunk
2nd
chunk
Slide 27 | Data Center Automation with YADT | Schlomo Schapiro
Systems Management with YADT
Reduce Systemic Complexity
Keep It Simple
Slide 28 | Data Center Automation with YADT | Schlomo Schapiro
Automation is our Continuous Delivery Platform
Business
Decision
To Go
Live
All Humans
are on the
Same Side
Build
Config
Deploy
Test
Systems-
Management
Automation
Scale Out
Data Centers
Slide 29 | Data Center Automation with YADT | Schlomo Schapiro
DevOps
We build it together
as one team.
We understand
it completely.
And it is fully automated.
Slide 30 | Data Center Automation with YADT | Schlomo Schapiro
www.yadt-project.org
Stand 7.1C145
Slide 31 | Data Center Automation with YADT | Schlomo Schapiro
go.schapiro.org/slides
Slide 32 | Data Center Automation with YADT | Schlomo Schapiro
Kontakt:
Immobilien Scout GmbH
Andreasstraße 10
10243 Berlin
Fon: +49 30 243 01-1229
Email: schlomo.schapiro@immobilienscout24.de
URL: www.immobilienscout24.de
Thank you very much!
Please contact me for further
questions and discussions.
All images are either public domain, used in appropriate
context or taken from openclipart.org
1 of 32

Recommended

How to Make a Quicktime Screen Recording by
How to Make a Quicktime Screen Recording How to Make a Quicktime Screen Recording
How to Make a Quicktime Screen Recording MrsBrownMEH
289 views22 slides
UI5 with Akamai - Introduction to the Content Delivery Network by
UI5 with Akamai - Introduction to the Content Delivery NetworkUI5 with Akamai - Introduction to the Content Delivery Network
UI5 with Akamai - Introduction to the Content Delivery NetworkGokul Anand E, PMP®
1.2K views22 slides
Viele Server - Wenig Arbeit: Betriebsautomation bei ImmobilienScout24 by
Viele Server - Wenig Arbeit: Betriebsautomation bei ImmobilienScout24Viele Server - Wenig Arbeit: Betriebsautomation bei ImmobilienScout24
Viele Server - Wenig Arbeit: Betriebsautomation bei ImmobilienScout24Schlomo Schapiro
4.1K views48 slides
EuroPython 2014 Devops Risk Mitigation by
EuroPython 2014 Devops Risk MitigationEuroPython 2014 Devops Risk Mitigation
EuroPython 2014 Devops Risk MitigationSchlomo Schapiro
3.4K views21 slides
DevOps, Agile and Open Source at ImmobilienScout24 by
DevOps, Agile and Open Source at ImmobilienScout24DevOps, Agile and Open Source at ImmobilienScout24
DevOps, Agile and Open Source at ImmobilienScout24Schlomo Schapiro
2.4K views14 slides
PyCon 2013 Test Driven Infrastructure by
PyCon 2013 Test Driven InfrastructurePyCon 2013 Test Driven Infrastructure
PyCon 2013 Test Driven InfrastructureSchlomo Schapiro
1.2K views7 slides

More Related Content

Similar to Linux tag 2013 Data Center Automation with YADT

OSDC 2014 Test Driven Infrastructure by
OSDC 2014 Test Driven InfrastructureOSDC 2014 Test Driven Infrastructure
OSDC 2014 Test Driven InfrastructureSchlomo Schapiro
1.7K views26 slides
OSDC 2014: Schlomo Schapiro - Test Driven Infrastructure by
OSDC 2014: Schlomo Schapiro -  Test Driven InfrastructureOSDC 2014: Schlomo Schapiro -  Test Driven Infrastructure
OSDC 2014: Schlomo Schapiro - Test Driven InfrastructureNETWAYS
443 views26 slides
Software Defined WebSphere Messaging Infrastructure with Puppet by
Software Defined WebSphere Messaging Infrastructure with PuppetSoftware Defined WebSphere Messaging Infrastructure with Puppet
Software Defined WebSphere Messaging Infrastructure with PuppetRahul Gupta
2.2K views39 slides
How to Become a Winner in the JVM Performance-Tuning Battle by
How to Become a Winner in the JVM Performance-Tuning BattleHow to Become a Winner in the JVM Performance-Tuning Battle
How to Become a Winner in the JVM Performance-Tuning BattleCapgemini
3.8K views43 slides
Agentless System Crawler - InterConnect 2016 by
Agentless System Crawler - InterConnect 2016Agentless System Crawler - InterConnect 2016
Agentless System Crawler - InterConnect 2016Canturk Isci
1K views24 slides
PTV Group_impact_camunda_bpm_20140122 by
PTV Group_impact_camunda_bpm_20140122PTV Group_impact_camunda_bpm_20140122
PTV Group_impact_camunda_bpm_20140122camunda services GmbH
2.3K views21 slides

Similar to Linux tag 2013 Data Center Automation with YADT(20)

OSDC 2014 Test Driven Infrastructure by Schlomo Schapiro
OSDC 2014 Test Driven InfrastructureOSDC 2014 Test Driven Infrastructure
OSDC 2014 Test Driven Infrastructure
Schlomo Schapiro1.7K views
OSDC 2014: Schlomo Schapiro - Test Driven Infrastructure by NETWAYS
OSDC 2014: Schlomo Schapiro -  Test Driven InfrastructureOSDC 2014: Schlomo Schapiro -  Test Driven Infrastructure
OSDC 2014: Schlomo Schapiro - Test Driven Infrastructure
NETWAYS443 views
Software Defined WebSphere Messaging Infrastructure with Puppet by Rahul Gupta
Software Defined WebSphere Messaging Infrastructure with PuppetSoftware Defined WebSphere Messaging Infrastructure with Puppet
Software Defined WebSphere Messaging Infrastructure with Puppet
Rahul Gupta2.2K views
How to Become a Winner in the JVM Performance-Tuning Battle by Capgemini
How to Become a Winner in the JVM Performance-Tuning BattleHow to Become a Winner in the JVM Performance-Tuning Battle
How to Become a Winner in the JVM Performance-Tuning Battle
Capgemini3.8K views
Agentless System Crawler - InterConnect 2016 by Canturk Isci
Agentless System Crawler - InterConnect 2016Agentless System Crawler - InterConnect 2016
Agentless System Crawler - InterConnect 2016
Canturk Isci1K views
IBM API Management BPM Systems Engage by Sebastian Osterc
IBM API Management BPM Systems EngageIBM API Management BPM Systems Engage
IBM API Management BPM Systems Engage
Sebastian Osterc383 views
Bp307 Practical Solutions for Connections Administrators, tips and scrips for... by Sharon James
Bp307 Practical Solutions for Connections Administrators, tips and scrips for...Bp307 Practical Solutions for Connections Administrators, tips and scrips for...
Bp307 Practical Solutions for Connections Administrators, tips and scrips for...
Sharon James1.1K views
IBM Systems Technical Symposium Melbourne, 2015 by Filipe Miranda
IBM Systems Technical Symposium Melbourne, 2015IBM Systems Technical Symposium Melbourne, 2015
IBM Systems Technical Symposium Melbourne, 2015
Filipe Miranda537 views
Octobus technical university def by Daniela Zuppini
Octobus technical university   defOctobus technical university   def
Octobus technical university def
Daniela Zuppini286 views
Implementing Large Scale Digital Asset Repositories with Adobe Experience Man... by devang-dsshah
Implementing Large Scale Digital Asset Repositories with Adobe Experience Man...Implementing Large Scale Digital Asset Repositories with Adobe Experience Man...
Implementing Large Scale Digital Asset Repositories with Adobe Experience Man...
devang-dsshah6.6K views
Building Advanced Serverless Workflows with AWS Step Functions | AWS Floor28 by Amazon Web Services
Building Advanced Serverless Workflows with AWS Step Functions | AWS Floor28Building Advanced Serverless Workflows with AWS Step Functions | AWS Floor28
Building Advanced Serverless Workflows with AWS Step Functions | AWS Floor28
Amazon Web Services1.8K views
Eric Sorenson Keynote by Puppet
Eric Sorenson KeynoteEric Sorenson Keynote
Eric Sorenson Keynote
Puppet169 views
Scaling digital asset repositories with aem dam and s7 by Devang Shah by AEM HUB
Scaling digital asset repositories with aem dam and s7 by Devang ShahScaling digital asset repositories with aem dam and s7 by Devang Shah
Scaling digital asset repositories with aem dam and s7 by Devang Shah
AEM HUB5.7K views
Red5 Open Source Flash Server by Sunil Swain
Red5 Open Source Flash ServerRed5 Open Source Flash Server
Red5 Open Source Flash Server
Sunil Swain2.7K views
Introduction to Puppet Enterprise 2016.2 by Puppet
Introduction to Puppet Enterprise 2016.2Introduction to Puppet Enterprise 2016.2
Introduction to Puppet Enterprise 2016.2
Puppet473 views

More from Schlomo Schapiro

The Role of GitOps in IT-Strategy v2 - July 2022 - Schlomo Schapiro by
The Role of GitOps in IT-Strategy v2 - July 2022 - Schlomo SchapiroThe Role of GitOps in IT-Strategy v2 - July 2022 - Schlomo Schapiro
The Role of GitOps in IT-Strategy v2 - July 2022 - Schlomo SchapiroSchlomo Schapiro
21 views27 slides
The GitOps Journey - Schlomo Schapiro - Berlin DevOps Meetup 2021-11 by
The GitOps Journey - Schlomo Schapiro - Berlin DevOps Meetup 2021-11The GitOps Journey - Schlomo Schapiro - Berlin DevOps Meetup 2021-11
The GitOps Journey - Schlomo Schapiro - Berlin DevOps Meetup 2021-11Schlomo Schapiro
386 views12 slides
The Role of GitOps in IT-Strategy - November 2021 - Schlomo Schapiro - Contin... by
The Role of GitOps in IT-Strategy - November 2021 - Schlomo Schapiro - Contin...The Role of GitOps in IT-Strategy - November 2021 - Schlomo Schapiro - Contin...
The Role of GitOps in IT-Strategy - November 2021 - Schlomo Schapiro - Contin...Schlomo Schapiro
412 views47 slides
Schlomo Schapiro - Why I like to use the proprietary Cloud services without f... by
Schlomo Schapiro - Why I like to use the proprietary Cloud services without f...Schlomo Schapiro - Why I like to use the proprietary Cloud services without f...
Schlomo Schapiro - Why I like to use the proprietary Cloud services without f...Schlomo Schapiro
115 views8 slides
The Role of GitOps in IT Strategy - June 2021 - Schlomo Schapiro by
The Role of GitOps in IT Strategy - June 2021 - Schlomo SchapiroThe Role of GitOps in IT Strategy - June 2021 - Schlomo Schapiro
The Role of GitOps in IT Strategy - June 2021 - Schlomo SchapiroSchlomo Schapiro
1.6K views39 slides
The GitOps Journey - GitOpsCon EU 2021 - Schlomo Schapiro by
The GitOps Journey - GitOpsCon EU 2021 - Schlomo SchapiroThe GitOps Journey - GitOpsCon EU 2021 - Schlomo Schapiro
The GitOps Journey - GitOpsCon EU 2021 - Schlomo SchapiroSchlomo Schapiro
421 views9 slides

More from Schlomo Schapiro(20)

The Role of GitOps in IT-Strategy v2 - July 2022 - Schlomo Schapiro by Schlomo Schapiro
The Role of GitOps in IT-Strategy v2 - July 2022 - Schlomo SchapiroThe Role of GitOps in IT-Strategy v2 - July 2022 - Schlomo Schapiro
The Role of GitOps in IT-Strategy v2 - July 2022 - Schlomo Schapiro
Schlomo Schapiro21 views
The GitOps Journey - Schlomo Schapiro - Berlin DevOps Meetup 2021-11 by Schlomo Schapiro
The GitOps Journey - Schlomo Schapiro - Berlin DevOps Meetup 2021-11The GitOps Journey - Schlomo Schapiro - Berlin DevOps Meetup 2021-11
The GitOps Journey - Schlomo Schapiro - Berlin DevOps Meetup 2021-11
Schlomo Schapiro386 views
The Role of GitOps in IT-Strategy - November 2021 - Schlomo Schapiro - Contin... by Schlomo Schapiro
The Role of GitOps in IT-Strategy - November 2021 - Schlomo Schapiro - Contin...The Role of GitOps in IT-Strategy - November 2021 - Schlomo Schapiro - Contin...
The Role of GitOps in IT-Strategy - November 2021 - Schlomo Schapiro - Contin...
Schlomo Schapiro412 views
Schlomo Schapiro - Why I like to use the proprietary Cloud services without f... by Schlomo Schapiro
Schlomo Schapiro - Why I like to use the proprietary Cloud services without f...Schlomo Schapiro - Why I like to use the proprietary Cloud services without f...
Schlomo Schapiro - Why I like to use the proprietary Cloud services without f...
Schlomo Schapiro115 views
The Role of GitOps in IT Strategy - June 2021 - Schlomo Schapiro by Schlomo Schapiro
The Role of GitOps in IT Strategy - June 2021 - Schlomo SchapiroThe Role of GitOps in IT Strategy - June 2021 - Schlomo Schapiro
The Role of GitOps in IT Strategy - June 2021 - Schlomo Schapiro
Schlomo Schapiro1.6K views
The GitOps Journey - GitOpsCon EU 2021 - Schlomo Schapiro by Schlomo Schapiro
The GitOps Journey - GitOpsCon EU 2021 - Schlomo SchapiroThe GitOps Journey - GitOpsCon EU 2021 - Schlomo Schapiro
The GitOps Journey - GitOpsCon EU 2021 - Schlomo Schapiro
Schlomo Schapiro421 views
Want Digitalisation, have Cloud - DevSecOps Days 2021 - Schlomo Schapiro by Schlomo Schapiro
Want Digitalisation, have Cloud - DevSecOps Days 2021 - Schlomo SchapiroWant Digitalisation, have Cloud - DevSecOps Days 2021 - Schlomo Schapiro
Want Digitalisation, have Cloud - DevSecOps Days 2021 - Schlomo Schapiro
Schlomo Schapiro354 views
Automated Governance - Continous Lifecycle 2019 - Schlomo Schapiro by Schlomo Schapiro
Automated Governance - Continous Lifecycle 2019 - Schlomo SchapiroAutomated Governance - Continous Lifecycle 2019 - Schlomo Schapiro
Automated Governance - Continous Lifecycle 2019 - Schlomo Schapiro
Schlomo Schapiro2.5K views
Compliant by Default - Digitaler Wandel - 14.08.2019 - Schlomo Schapiro by Schlomo Schapiro
Compliant by Default - Digitaler Wandel - 14.08.2019 - Schlomo SchapiroCompliant by Default - Digitaler Wandel - 14.08.2019 - Schlomo Schapiro
Compliant by Default - Digitaler Wandel - 14.08.2019 - Schlomo Schapiro
Schlomo Schapiro442 views
DevOps ist normal - DevOps Essentials 2019 - Schlomo Schapiro by Schlomo Schapiro
DevOps ist normal - DevOps Essentials 2019 - Schlomo SchapiroDevOps ist normal - DevOps Essentials 2019 - Schlomo Schapiro
DevOps ist normal - DevOps Essentials 2019 - Schlomo Schapiro
Schlomo Schapiro960 views
The Devops Driving School - DevOps Gathering 2019 - Schlomo Schapiro by Schlomo Schapiro
The Devops Driving School - DevOps Gathering 2019 - Schlomo SchapiroThe Devops Driving School - DevOps Gathering 2019 - Schlomo Schapiro
The Devops Driving School - DevOps Gathering 2019 - Schlomo Schapiro
Schlomo Schapiro717 views
Open Source Contribution Policy at DB Systel - Schlomo Schapiro - AK Open Sou... by Schlomo Schapiro
Open Source Contribution Policy at DB Systel - Schlomo Schapiro - AK Open Sou...Open Source Contribution Policy at DB Systel - Schlomo Schapiro - AK Open Sou...
Open Source Contribution Policy at DB Systel - Schlomo Schapiro - AK Open Sou...
Schlomo Schapiro439 views
Compliant by Default - Continuous Delivery at DB Systel - 16.10.2018 - Schlom... by Schlomo Schapiro
Compliant by Default - Continuous Delivery at DB Systel - 16.10.2018 - Schlom...Compliant by Default - Continuous Delivery at DB Systel - 16.10.2018 - Schlom...
Compliant by Default - Continuous Delivery at DB Systel - 16.10.2018 - Schlom...
Schlomo Schapiro1.3K views
DevOps + Continuous Delivery + Cloud: The Three Drivers of Enterprise Agility... by Schlomo Schapiro
DevOps + Continuous Delivery + Cloud: The Three Drivers of Enterprise Agility...DevOps + Continuous Delivery + Cloud: The Three Drivers of Enterprise Agility...
DevOps + Continuous Delivery + Cloud: The Three Drivers of Enterprise Agility...
Schlomo Schapiro1.2K views
Kubernetes - Shifting the mindset from servers to containers - microxchg 201... by Schlomo Schapiro
Kubernetes  - Shifting the mindset from servers to containers - microxchg 201...Kubernetes  - Shifting the mindset from servers to containers - microxchg 201...
Kubernetes - Shifting the mindset from servers to containers - microxchg 201...
Schlomo Schapiro5.1K views
Root for all - measuring DevOps adoption - microxchg 2018 - Schlomo Schapiro by Schlomo Schapiro
Root for all - measuring DevOps adoption - microxchg 2018 - Schlomo SchapiroRoot for all - measuring DevOps adoption - microxchg 2018 - Schlomo Schapiro
Root for all - measuring DevOps adoption - microxchg 2018 - Schlomo Schapiro
Schlomo Schapiro2.7K views
GUUG FFG 2017 - DevOps for Everybody - A Workplace Strategy for the Digital Age by Schlomo Schapiro
GUUG FFG 2017 - DevOps for Everybody - A Workplace Strategy for the Digital AgeGUUG FFG 2017 - DevOps for Everybody - A Workplace Strategy for the Digital Age
GUUG FFG 2017 - DevOps for Everybody - A Workplace Strategy for the Digital Age
Schlomo Schapiro1.8K views
GUUG FFG 2017 - DevOps for Everybody - How the entire company can benefit fro... by Schlomo Schapiro
GUUG FFG 2017 - DevOps for Everybody - How the entire company can benefit fro...GUUG FFG 2017 - DevOps for Everybody - How the entire company can benefit fro...
GUUG FFG 2017 - DevOps for Everybody - How the entire company can benefit fro...
Schlomo Schapiro1.7K views
SE 2015 DevOps Risk Mitigation - Test Driven Infrastructure by Schlomo Schapiro
SE 2015 DevOps Risk Mitigation - Test Driven InfrastructureSE 2015 DevOps Risk Mitigation - Test Driven Infrastructure
SE 2015 DevOps Risk Mitigation - Test Driven Infrastructure
Schlomo Schapiro2.7K views

Recently uploaded

Serverless computing with Google Cloud (2023-24) by
Serverless computing with Google Cloud (2023-24)Serverless computing with Google Cloud (2023-24)
Serverless computing with Google Cloud (2023-24)wesley chun
11 views33 slides
Democratising digital commerce in India-Report by
Democratising digital commerce in India-ReportDemocratising digital commerce in India-Report
Democratising digital commerce in India-ReportKapil Khandelwal (KK)
15 views161 slides
HTTP headers that make your website go faster - devs.gent November 2023 by
HTTP headers that make your website go faster - devs.gent November 2023HTTP headers that make your website go faster - devs.gent November 2023
HTTP headers that make your website go faster - devs.gent November 2023Thijs Feryn
22 views151 slides
Uni Systems for Power Platform.pptx by
Uni Systems for Power Platform.pptxUni Systems for Power Platform.pptx
Uni Systems for Power Platform.pptxUni Systems S.M.S.A.
56 views21 slides
Business Analyst Series 2023 - Week 3 Session 5 by
Business Analyst Series 2023 -  Week 3 Session 5Business Analyst Series 2023 -  Week 3 Session 5
Business Analyst Series 2023 - Week 3 Session 5DianaGray10
248 views20 slides
MVP and prioritization.pdf by
MVP and prioritization.pdfMVP and prioritization.pdf
MVP and prioritization.pdfrahuldharwal141
31 views8 slides

Recently uploaded(20)

Serverless computing with Google Cloud (2023-24) by wesley chun
Serverless computing with Google Cloud (2023-24)Serverless computing with Google Cloud (2023-24)
Serverless computing with Google Cloud (2023-24)
wesley chun11 views
HTTP headers that make your website go faster - devs.gent November 2023 by Thijs Feryn
HTTP headers that make your website go faster - devs.gent November 2023HTTP headers that make your website go faster - devs.gent November 2023
HTTP headers that make your website go faster - devs.gent November 2023
Thijs Feryn22 views
Business Analyst Series 2023 - Week 3 Session 5 by DianaGray10
Business Analyst Series 2023 -  Week 3 Session 5Business Analyst Series 2023 -  Week 3 Session 5
Business Analyst Series 2023 - Week 3 Session 5
DianaGray10248 views
Future of AR - Facebook Presentation by ssuserb54b561
Future of AR - Facebook PresentationFuture of AR - Facebook Presentation
Future of AR - Facebook Presentation
ssuserb54b56114 views
Data Integrity for Banking and Financial Services by Precisely
Data Integrity for Banking and Financial ServicesData Integrity for Banking and Financial Services
Data Integrity for Banking and Financial Services
Precisely21 views
TouchLog: Finger Micro Gesture Recognition Using Photo-Reflective Sensors by sugiuralab
TouchLog: Finger Micro Gesture Recognition  Using Photo-Reflective SensorsTouchLog: Finger Micro Gesture Recognition  Using Photo-Reflective Sensors
TouchLog: Finger Micro Gesture Recognition Using Photo-Reflective Sensors
sugiuralab19 views
PharoJS - Zürich Smalltalk Group Meetup November 2023 by Noury Bouraqadi
PharoJS - Zürich Smalltalk Group Meetup November 2023PharoJS - Zürich Smalltalk Group Meetup November 2023
PharoJS - Zürich Smalltalk Group Meetup November 2023
Noury Bouraqadi127 views
Igniting Next Level Productivity with AI-Infused Data Integration Workflows by Safe Software
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Safe Software263 views
Case Study Copenhagen Energy and Business Central.pdf by Aitana
Case Study Copenhagen Energy and Business Central.pdfCase Study Copenhagen Energy and Business Central.pdf
Case Study Copenhagen Energy and Business Central.pdf
Aitana16 views

Linux tag 2013 Data Center Automation with YADT

  • 1. Data Center Automation with YADT Berlin | 23.05.2013 | Schlomo Schapiro Systems Architect, Open Source Evangelist License: http://creativecommons.org/licenses/by-nc-nd/3.0/
  • 2. Slide 2 | Data Center Automation with YADT | Schlomo Schapiro www.ImmobilienScout24.de >2 billion PI per month 2 data center with ~1400 VM total of ~600 employees  ~30 crossfunctional IT teams  ~160 in IT 15 years in business part of Deutsche Telekom
  • 3. Slide 3 | Data Center Automation with YADT | Schlomo Schapiro
  • 4. Slide 4 | Data Center Automation with YADT | Schlomo Schapiro Systems Management with YADT
  • 5. Slide 5 | Data Center Automation with YADT | Schlomo Schapiro The Big Picture – Continuous Delivery Platform Business Decision To Go Live All Humans are on the Same Side Build Config Deploy Test Systems- Management Automation Scale Out Data Centers
  • 6. Slide 6 | Data Center Automation with YADT | Schlomo Schapiro 1st task: Reduce Systemic Complexity File Management Systems Management
  • 7. Slide 7 | Data Center Automation with YADT | Schlomo Schapiro File Management with RPM & YUM
  • 8. Slide 8 | Data Center Automation with YADT | Schlomo Schapiro File Management with RPM & YUM Libraries Applications Configuration Operating System 100 %
  • 9. Slide 9 | Data Center Automation with YADT | Schlomo Schapiro File Management with RPM & YUM PROD DEV Infrastructure Build Application Build Configuration Build QA YUM Repos
  • 10. Slide 10 | Data Center Automation with YADT | Schlomo Schapiro File Management with RPM & YUM Interface PROD DEV Infrastructure Build Application Build Configuration Build QA YUM Repos
  • 11. Slide 11 | Data Center Automation with YADT | Schlomo Schapiro PROD DEV Infrastructure Build Application Build QA YUM Repos Configuration Build – Pre-built Config Content Configuration Build
  • 12. Slide 12 | Data Center Automation with YADT | Schlomo Schapiro Configuration Build – Pre-built Config Content SVN commit config file build config RPM RPMs with static content YUM Repo
  • 13. Slide 13 | Data Center Automation with YADT | Schlomo Schapiro Templating Variables Overlaying Configuration Build – Pre-built Config Content SVN commit config file build config RPM RPMs with static content YUM Repo
  • 14. Slide 14 | Data Center Automation with YADT | Schlomo Schapiro we use 1 RPM per host Templating Variables Overlaying Configuration Build – Pre-built Config Content SVN commit config file build config RPM RPMs with static content YUM Repo
  • 15. Slide 15 | Data Center Automation with YADT | Schlomo Schapiro Shared responsability Ops, Dev, QA ... we use 1 RPM per host Templating Variables Overlaying Configuration Build – Pre-built Config Content SVN commit config file build config RPM RPMs with static content YUM Repo
  • 16. Slide 16 | Data Center Automation with YADT | Schlomo Schapiro Application Build – Continuous Release Delivery PROD DEV Infrastructure Build QA YUM Repos Configuration Build Application Build
  • 17. Slide 17 | Data Center Automation with YADT | Schlomo Schapiro Application Build – Package Promotion Pipeline YUM Repo Tested Repo YUM Repo Released Repo YUM Repo Comitted Repo DEV Pre-PROD PROD
  • 18. Slide 18 | Data Center Automation with YADT | Schlomo Schapiro Application Build – Package Promotion Pipeline YUM Repo Tested Repo YUM Repo Released Repo YUM Repo Comitted Repo DEV Pre-PROD PROD CI Deploy & Test Auto- promote release if tests OK Deploy & Test Business decision to Go Live with tested versions Deploy & Test
  • 19. Slide 19 | Data Center Automation with YADT | Schlomo Schapiro File Management through many YUM repositories PROD DEV Infrastructure Build Application Build Configuration Build QA YUM Repo YUM RepoYUM RepoYUM Repo
  • 20. Slide 20 | Data Center Automation with YADT | Schlomo Schapiro Systems Management with YADT
  • 21. Slide 21 | Data Center Automation with YADT | Schlomo Schapiro YADT – Unified Dependency Tree Web Server HTTPD Tomcat App Server Load Balancer
  • 22. Slide 22 | Data Center Automation with YADT | Schlomo Schapiro HTTPD Tomcat web- app httpd config tomcat YADT – Unified Dependency Tree init script init script
  • 23. Slide 23 | Data Center Automation with YADT | Schlomo Schapiro YADT – Large Scale System Management Web Server HTTPD Tomcat web- app httpd config tomcat App Server Java App app config
  • 24. Slide 24 | Data Center Automation with YADT | Schlomo Schapiro YADT – Large Scale System Management LB: www.immobilienscout24.de Web Server HTTPD Tomcat web- app httpd config tomcat App Server Java App app config Web Server HTTPD Tomcat web- app httpd config tomcat App Server Java App app config
  • 25. Slide 25 | Data Center Automation with YADT | Schlomo Schapiro YADT – Large Scale System Management LB: www.immobilienscout24.de Web Server HTTPD Tomcat web- app httpd config tomcat App Server Java App app config Web Server HTTPD Tomcat web- app httpd config tomcat App Server Java App app config 1st chunk
  • 26. Slide 26 | Data Center Automation with YADT | Schlomo Schapiro YADT – Large Scale System Management LB: www.immobilienscout24.de Web Server HTTPD Tomcat web- app httpd config tomcat App Server Java App app config Web Server HTTPD Tomcat web- app httpd config tomcat App Server Java App app config 1st chunk 2nd chunk
  • 27. Slide 27 | Data Center Automation with YADT | Schlomo Schapiro Systems Management with YADT Reduce Systemic Complexity Keep It Simple
  • 28. Slide 28 | Data Center Automation with YADT | Schlomo Schapiro Automation is our Continuous Delivery Platform Business Decision To Go Live All Humans are on the Same Side Build Config Deploy Test Systems- Management Automation Scale Out Data Centers
  • 29. Slide 29 | Data Center Automation with YADT | Schlomo Schapiro DevOps We build it together as one team. We understand it completely. And it is fully automated.
  • 30. Slide 30 | Data Center Automation with YADT | Schlomo Schapiro www.yadt-project.org Stand 7.1C145
  • 31. Slide 31 | Data Center Automation with YADT | Schlomo Schapiro go.schapiro.org/slides
  • 32. Slide 32 | Data Center Automation with YADT | Schlomo Schapiro Kontakt: Immobilien Scout GmbH Andreasstraße 10 10243 Berlin Fon: +49 30 243 01-1229 Email: schlomo.schapiro@immobilienscout24.de URL: www.immobilienscout24.de Thank you very much! Please contact me for further questions and discussions. All images are either public domain, used in appropriate context or taken from openclipart.org