SlideShare a Scribd company logo
1 of 16
GSRF Reference Configurations 
Management 
Status Presentation – October 
2013 
M. Pecchioli, H. Dreihahn, T. 
Carvalho, HSO-GI 
J.C. Berton, HSO-G 
G. Di Girolamo, HSO-GD
Terminology (1/2) 
– Ground Segment: the ‘control ground segment’ i.e. all ground systems 
under ESOC control that support the execution of spacecraft operations 
– Unit: the smallest element of the ground segment that can be independently 
installed and configured (e.g. S2K, DARC, NIS) 
– Subsystem: a coherent set of units running in the same environment and 
serving a well defined operational purpose (e.g. the MCS, the FDS, the G/S) 
– Configuration: the set of items defining the behaviour of a given item (unit, 
interface or subsystem) at run-time, in addition to the system installation 
– Configuration Item: any item (e.g. a file) contributing to the configuration 
– Version: the unique identifier of a specific release of a given configuration 
item (e.g. a unit, a subsystem, a document, a configuration) 
– Installation: the specific instance of a specific release of a given 
unit/subsystem, customised according to a specified configuration
Terminology (2/2) 
– Integration: the process of assembling various units and subsystems 
together and exercising the interfaces between them 
– Test Assembly: the definition of the various units or subsystems required to 
perform a specified set of validation operations 
– Configuration control: the process of defining, documenting and managing 
all changes of configuration items 
– Reference Configuration: a named set of configuration items determining 
the configuration of a unit, subsystem or test assembly 
– Reference Installation: the installation of a specified set of units which 
exercises a given Reference configuration 
– Configuration Baseline: a specific version of a Reference configuration 
which is proven to work in a relevant Reference installation and documented 
for future re-use
Background 
– Infrastructure systems are not validated in sufficiently representative 
configurations 
– Many problems with infrastructure systems are first detected by missions 
when exercising them in realistic operational environments 
– Problems reported by missions cannot be easily reproduced and trouble-shooted 
in infrastructure systems 
– In the GSRF, there is no coordination among the configurations adopted by 
various units/subsystems 
– The deployment of Test Assemblies in realistic configurations currently implies 
a significant effort 
– Lack of centralised configuration control of infrastructure (but also of mission) 
installations
The idea of Reference Configurations 
Source 
Installation 
Destination 
Installation 
Capture Deploy 
Configuration 
Control
Objectives of Reference Configurations 
– Introduce control in the management of configuration items for Reference 
Installations (in the GSRF) 
– Enable distribution/re-use of proven Configuration Baselines in multiple 
Reference Installations 
– Simplify the deployment of Test Assemblies involving multiple units or even 
multiple subsystems 
– Enable the adoption of mission configurations in infrastructure installations 
– Rationalise/harmonise the procedures to maintain Configuration control 
across domains/subsystems 
– Provide the missions with the capability to capture and trace the configuration 
of all Ground Segment units in a centralised repository
Reference Configurations management 
– Tool suite enabling centralised management of configuration items (based on Mercurial) 
– Generic scripts to capture/deploy Configuration Items driven by unit-specific XML based 
descriptors (defining the name and location of the configuration files): 
• Organised in blocks for installation/configuration/operational files 
• Name of a specific script to be executed 
• List of items to be captured/deploy (with wildcards) 
• List of items to be ignored 
• List of folders to be created 
– Support of automated push (distribution) of applicable Configurations to registered 
machines (one dedicated account/installation per machine) 
– Capability to automatically adapt to the target installation environment 
– Harmonised approach among units e.g. distinction between Installation, Configuration 
and Operational items 
– Minimal set of actions to capture/deploy unit configurations
Reference Configurations management 
Centralised 
Repository 
Local File System 
Assemblies 
Reference Configurations 
Unit Configurations C_TMTCS C_GSTVi 
<<Deployment 
TMTCS Descriptor>> 
Configuration File 
ST_TMTC 
ST_TMTC_GAIA 
Unit Configuration 
(at the example of TMTCS) 
TMTCS 
Configuration File 
<<Deployment 
Descriptor>> 
TMTCS 
Configuration File 
Generic Reference Configuration I/F 
capture_configuration script 
Unit Specific Configuration I/F 
deploy_configuration script
Implementation Workflow 
Central 
CCM 
S2K 
NIS 
GSTVi 
… 
ccm.capture 
S2K 
NIS 
GSTVi 
… 
ccm.deploy 
Scripts repo 
ccm Config repos 
ccm 
ccm 
ccm 
Capture executed from 
local ccm account. 
Ops account are only 
read, no trace of ccm 
access 
Capture executed from 
local deploy account.
Implementation Architecture 
git 
Capture/deploy 
wrapper * 
ccm.capture 
ccm.deploy 
* for automatic update of ccm 
scripts and descriptor files 
s2k.capture 
s2k.deploy 
nis.capture 
nis.deploy 
Descriptor file 
repoApi xmlParseApi … 
Descriptor file 
mercurial
Repository Organisation 
RTE_repo 
– One repository per Reference 
Configuration 
– Stored with original paths 
S2K 
NIS 
GSTVi 
DARC 
… 
GAI_repo 
… 
… 
RTE_repo/ 
admin 
NIS/… 
DARC/…
Repository Management 
– Tags are for incremental changes 
– Branches for parallel snapshots of 
not related views 
reference 
periodic 
week1 week2 week3 
working 
myTest MarkTest optiTest 
merge 
…
Capture/Deploy Scripts 
Capture 
ccm.capture 
-R <reference config> 
-T <type> 
-t <tag> 
-a <account> 
[-b <branch>] 
Deploy 
GAI_repo 
reference 
periodic 
1.0 
week1 week2 
working 
myTest MarkTest 
ccm.Deploy 
-R <reference config> 
-T <type>
Test Assemblies Infrastructure
Test Assemblies Missions
Next steps 
– Implementation: 
– Migrate from Mercurial to Git 
– Finalise the definition of Capture/Deploy for all MICONYS units (DARC, EDDS, 
MATIS, SMF) 
– Enable ‘sharing’ of Reference Configurations with GIMUS teams 
– Support the capability to Capture/Deploy the Configuration Items for multiple 
units (e.g. all units involved in the “End-to-end TM/TC data flow” Test 
Assembly) 
– Utilisation: 
– Create Reference Configurations based on selected missions and deploy them 
on a MICONYS 6.1 Reference Installations (on-going for Gaia) 
– Consolidate end-to-end process to transfer mission configurations into pure 
MICONYS installations 
– Ensure consistent use of the centralised repository for GI Reference 
Installations 
– Expand use to mission installations

More Related Content

What's hot

Oracle Flashback Query 3
Oracle Flashback Query 3Oracle Flashback Query 3
Oracle Flashback Query 3grogers1124
 
B35 all you wanna know about rman by francisco alvarez
B35 all you wanna know about rman by francisco alvarezB35 all you wanna know about rman by francisco alvarez
B35 all you wanna know about rman by francisco alvarezInsight Technology, Inc.
 
Asm disk group migration from
Asm disk group migration from Asm disk group migration from
Asm disk group migration from Anar Godjaev
 
Linux Performance Tunning Kernel
Linux Performance Tunning KernelLinux Performance Tunning Kernel
Linux Performance Tunning KernelShay Cohen
 
Step by Step Restore rman to different host
Step by Step Restore rman to different hostStep by Step Restore rman to different host
Step by Step Restore rman to different hostOsama Mustafa
 
[Altibase] 13 backup and recovery
[Altibase] 13 backup and recovery[Altibase] 13 backup and recovery
[Altibase] 13 backup and recoveryaltistory
 
Keith Fiske - When PostgreSQL Can't, You Can @ Postgres Open
Keith Fiske - When PostgreSQL Can't, You Can @ Postgres OpenKeith Fiske - When PostgreSQL Can't, You Can @ Postgres Open
Keith Fiske - When PostgreSQL Can't, You Can @ Postgres OpenPostgresOpen
 
Les 02 Config Rec
Les 02 Config RecLes 02 Config Rec
Les 02 Config Recvivaankumar
 
Less02 Installation
Less02 InstallationLess02 Installation
Less02 Installationvivaankumar
 

What's hot (20)

Oracle Flashback Query 3
Oracle Flashback Query 3Oracle Flashback Query 3
Oracle Flashback Query 3
 
Xpp c user_rec
Xpp c user_recXpp c user_rec
Xpp c user_rec
 
B35 all you wanna know about rman by francisco alvarez
B35 all you wanna know about rman by francisco alvarezB35 all you wanna know about rman by francisco alvarez
B35 all you wanna know about rman by francisco alvarez
 
Xpp b tspitr
Xpp b tspitrXpp b tspitr
Xpp b tspitr
 
Asm disk group migration from
Asm disk group migration from Asm disk group migration from
Asm disk group migration from
 
Linux Performance Tunning Kernel
Linux Performance Tunning KernelLinux Performance Tunning Kernel
Linux Performance Tunning Kernel
 
Les 11 fl2
Les 11 fl2Les 11 fl2
Les 11 fl2
 
Step by Step Restore rman to different host
Step by Step Restore rman to different hostStep by Step Restore rman to different host
Step by Step Restore rman to different host
 
Les 12 fl_db
Les 12 fl_dbLes 12 fl_db
Les 12 fl_db
 
Les 20 dup_db
Les 20 dup_dbLes 20 dup_db
Les 20 dup_db
 
Les 18 space
Les 18 spaceLes 18 space
Les 18 space
 
[Altibase] 13 backup and recovery
[Altibase] 13 backup and recovery[Altibase] 13 backup and recovery
[Altibase] 13 backup and recovery
 
Les 00 intro
Les 00 introLes 00 intro
Les 00 intro
 
Keith Fiske - When PostgreSQL Can't, You Can @ Postgres Open
Keith Fiske - When PostgreSQL Can't, You Can @ Postgres OpenKeith Fiske - When PostgreSQL Can't, You Can @ Postgres Open
Keith Fiske - When PostgreSQL Can't, You Can @ Postgres Open
 
Les 16 resource
Les 16 resourceLes 16 resource
Les 16 resource
 
Les 02 Config Rec
Les 02 Config RecLes 02 Config Rec
Les 02 Config Rec
 
Less02 Installation
Less02 InstallationLess02 Installation
Less02 Installation
 
Les 04 config_bu
Les 04 config_buLes 04 config_bu
Les 04 config_bu
 
Les 19 space_db
Les 19 space_dbLes 19 space_db
Les 19 space_db
 
Les 08 tune_rman
Les 08 tune_rmanLes 08 tune_rman
Les 08 tune_rman
 

Similar to 2013 10 gsrf - reference configurations management - draft (1)

Extend Eclipse p2 framework capabilities: Add your custom installation steps
Extend Eclipse p2 framework capabilities: Add your custom installation stepsExtend Eclipse p2 framework capabilities: Add your custom installation steps
Extend Eclipse p2 framework capabilities: Add your custom installation stepsDragos_Mihailescu
 
p2, modular provisioning for OSGi
p2, modular provisioning for OSGip2, modular provisioning for OSGi
p2, modular provisioning for OSGiPascal Rapicault
 
Managing Your Runtime With P2
Managing Your Runtime With P2Managing Your Runtime With P2
Managing Your Runtime With P2Pascal Rapicault
 
Drupal & Drink Montpellier "CMI feedback"
Drupal & Drink Montpellier "CMI feedback"Drupal & Drink Montpellier "CMI feedback"
Drupal & Drink Montpellier "CMI feedback"Alexandre Todorov
 
Rails application refactoring steps
Rails application refactoring stepsRails application refactoring steps
Rails application refactoring stepsMasud Rana
 
IBM Tivoli Monitoring (ITM) Centralized Configuration Facility
IBM Tivoli Monitoring (ITM) Centralized Configuration FacilityIBM Tivoli Monitoring (ITM) Centralized Configuration Facility
IBM Tivoli Monitoring (ITM) Centralized Configuration FacilityBlue Medora
 
[Capella Days 2020] Specification and Architecture of a System Factory for Sp...
[Capella Days 2020] Specification and Architecture of a System Factory for Sp...[Capella Days 2020] Specification and Architecture of a System Factory for Sp...
[Capella Days 2020] Specification and Architecture of a System Factory for Sp...Obeo
 
[2017/2018] AADL - Architecture Analysis and Design Language
[2017/2018] AADL - Architecture Analysis and Design Language[2017/2018] AADL - Architecture Analysis and Design Language
[2017/2018] AADL - Architecture Analysis and Design LanguageIvano Malavolta
 
Oracle rac 10g best practices
Oracle rac 10g best practicesOracle rac 10g best practices
Oracle rac 10g best practicesHaseeb Alam
 
Apache Ambari BOF - Blueprints + Azure - Hadoop Summit 2013
Apache Ambari BOF - Blueprints + Azure - Hadoop Summit 2013Apache Ambari BOF - Blueprints + Azure - Hadoop Summit 2013
Apache Ambari BOF - Blueprints + Azure - Hadoop Summit 2013Hortonworks
 
TechNet Live spor 1 sesjon 2 - sc-forefront 2
TechNet Live spor 1   sesjon 2 - sc-forefront 2TechNet Live spor 1   sesjon 2 - sc-forefront 2
TechNet Live spor 1 sesjon 2 - sc-forefront 2Anders Borchsenius
 
Core stack orchestration simplified
Core stack   orchestration simplifiedCore stack   orchestration simplified
Core stack orchestration simplifiedCoreStack
 
SHARE Seattle 2015 Taming the Beast – Best Practices for zFS with CICS
SHARE Seattle 2015 Taming the Beast – Best Practices for zFS with CICSSHARE Seattle 2015 Taming the Beast – Best Practices for zFS with CICS
SHARE Seattle 2015 Taming the Beast – Best Practices for zFS with CICSnick_garrod
 
Continuous Delivery with Sitecore
Continuous Delivery with SitecoreContinuous Delivery with Sitecore
Continuous Delivery with SitecoreCode Computerlove
 
C# and Borland StarTeam Connectivity
C# and Borland StarTeam ConnectivityC# and Borland StarTeam Connectivity
C# and Borland StarTeam ConnectivityShreesha Rao
 

Similar to 2013 10 gsrf - reference configurations management - draft (1) (20)

Kash Kubernetified
Kash KubernetifiedKash Kubernetified
Kash Kubernetified
 
Extend Eclipse p2 framework capabilities: Add your custom installation steps
Extend Eclipse p2 framework capabilities: Add your custom installation stepsExtend Eclipse p2 framework capabilities: Add your custom installation steps
Extend Eclipse p2 framework capabilities: Add your custom installation steps
 
p2, modular provisioning for OSGi
p2, modular provisioning for OSGip2, modular provisioning for OSGi
p2, modular provisioning for OSGi
 
Smpe
SmpeSmpe
Smpe
 
Managing Your Runtime With P2
Managing Your Runtime With P2Managing Your Runtime With P2
Managing Your Runtime With P2
 
CMI feedback.dnd
CMI feedback.dndCMI feedback.dnd
CMI feedback.dnd
 
Drupal & Drink Montpellier "CMI feedback"
Drupal & Drink Montpellier "CMI feedback"Drupal & Drink Montpellier "CMI feedback"
Drupal & Drink Montpellier "CMI feedback"
 
Rails application refactoring steps
Rails application refactoring stepsRails application refactoring steps
Rails application refactoring steps
 
Introduction to Git
Introduction to GitIntroduction to Git
Introduction to Git
 
IBM Tivoli Monitoring (ITM) Centralized Configuration Facility
IBM Tivoli Monitoring (ITM) Centralized Configuration FacilityIBM Tivoli Monitoring (ITM) Centralized Configuration Facility
IBM Tivoli Monitoring (ITM) Centralized Configuration Facility
 
[Capella Days 2020] Specification and Architecture of a System Factory for Sp...
[Capella Days 2020] Specification and Architecture of a System Factory for Sp...[Capella Days 2020] Specification and Architecture of a System Factory for Sp...
[Capella Days 2020] Specification and Architecture of a System Factory for Sp...
 
[2017/2018] AADL - Architecture Analysis and Design Language
[2017/2018] AADL - Architecture Analysis and Design Language[2017/2018] AADL - Architecture Analysis and Design Language
[2017/2018] AADL - Architecture Analysis and Design Language
 
OMG D&C Tutorial
OMG D&C TutorialOMG D&C Tutorial
OMG D&C Tutorial
 
Oracle rac 10g best practices
Oracle rac 10g best practicesOracle rac 10g best practices
Oracle rac 10g best practices
 
Apache Ambari BOF - Blueprints + Azure - Hadoop Summit 2013
Apache Ambari BOF - Blueprints + Azure - Hadoop Summit 2013Apache Ambari BOF - Blueprints + Azure - Hadoop Summit 2013
Apache Ambari BOF - Blueprints + Azure - Hadoop Summit 2013
 
TechNet Live spor 1 sesjon 2 - sc-forefront 2
TechNet Live spor 1   sesjon 2 - sc-forefront 2TechNet Live spor 1   sesjon 2 - sc-forefront 2
TechNet Live spor 1 sesjon 2 - sc-forefront 2
 
Core stack orchestration simplified
Core stack   orchestration simplifiedCore stack   orchestration simplified
Core stack orchestration simplified
 
SHARE Seattle 2015 Taming the Beast – Best Practices for zFS with CICS
SHARE Seattle 2015 Taming the Beast – Best Practices for zFS with CICSSHARE Seattle 2015 Taming the Beast – Best Practices for zFS with CICS
SHARE Seattle 2015 Taming the Beast – Best Practices for zFS with CICS
 
Continuous Delivery with Sitecore
Continuous Delivery with SitecoreContinuous Delivery with Sitecore
Continuous Delivery with Sitecore
 
C# and Borland StarTeam Connectivity
C# and Borland StarTeam ConnectivityC# and Borland StarTeam Connectivity
C# and Borland StarTeam Connectivity
 

2013 10 gsrf - reference configurations management - draft (1)

  • 1. GSRF Reference Configurations Management Status Presentation – October 2013 M. Pecchioli, H. Dreihahn, T. Carvalho, HSO-GI J.C. Berton, HSO-G G. Di Girolamo, HSO-GD
  • 2. Terminology (1/2) – Ground Segment: the ‘control ground segment’ i.e. all ground systems under ESOC control that support the execution of spacecraft operations – Unit: the smallest element of the ground segment that can be independently installed and configured (e.g. S2K, DARC, NIS) – Subsystem: a coherent set of units running in the same environment and serving a well defined operational purpose (e.g. the MCS, the FDS, the G/S) – Configuration: the set of items defining the behaviour of a given item (unit, interface or subsystem) at run-time, in addition to the system installation – Configuration Item: any item (e.g. a file) contributing to the configuration – Version: the unique identifier of a specific release of a given configuration item (e.g. a unit, a subsystem, a document, a configuration) – Installation: the specific instance of a specific release of a given unit/subsystem, customised according to a specified configuration
  • 3. Terminology (2/2) – Integration: the process of assembling various units and subsystems together and exercising the interfaces between them – Test Assembly: the definition of the various units or subsystems required to perform a specified set of validation operations – Configuration control: the process of defining, documenting and managing all changes of configuration items – Reference Configuration: a named set of configuration items determining the configuration of a unit, subsystem or test assembly – Reference Installation: the installation of a specified set of units which exercises a given Reference configuration – Configuration Baseline: a specific version of a Reference configuration which is proven to work in a relevant Reference installation and documented for future re-use
  • 4. Background – Infrastructure systems are not validated in sufficiently representative configurations – Many problems with infrastructure systems are first detected by missions when exercising them in realistic operational environments – Problems reported by missions cannot be easily reproduced and trouble-shooted in infrastructure systems – In the GSRF, there is no coordination among the configurations adopted by various units/subsystems – The deployment of Test Assemblies in realistic configurations currently implies a significant effort – Lack of centralised configuration control of infrastructure (but also of mission) installations
  • 5. The idea of Reference Configurations Source Installation Destination Installation Capture Deploy Configuration Control
  • 6. Objectives of Reference Configurations – Introduce control in the management of configuration items for Reference Installations (in the GSRF) – Enable distribution/re-use of proven Configuration Baselines in multiple Reference Installations – Simplify the deployment of Test Assemblies involving multiple units or even multiple subsystems – Enable the adoption of mission configurations in infrastructure installations – Rationalise/harmonise the procedures to maintain Configuration control across domains/subsystems – Provide the missions with the capability to capture and trace the configuration of all Ground Segment units in a centralised repository
  • 7. Reference Configurations management – Tool suite enabling centralised management of configuration items (based on Mercurial) – Generic scripts to capture/deploy Configuration Items driven by unit-specific XML based descriptors (defining the name and location of the configuration files): • Organised in blocks for installation/configuration/operational files • Name of a specific script to be executed • List of items to be captured/deploy (with wildcards) • List of items to be ignored • List of folders to be created – Support of automated push (distribution) of applicable Configurations to registered machines (one dedicated account/installation per machine) – Capability to automatically adapt to the target installation environment – Harmonised approach among units e.g. distinction between Installation, Configuration and Operational items – Minimal set of actions to capture/deploy unit configurations
  • 8. Reference Configurations management Centralised Repository Local File System Assemblies Reference Configurations Unit Configurations C_TMTCS C_GSTVi <<Deployment TMTCS Descriptor>> Configuration File ST_TMTC ST_TMTC_GAIA Unit Configuration (at the example of TMTCS) TMTCS Configuration File <<Deployment Descriptor>> TMTCS Configuration File Generic Reference Configuration I/F capture_configuration script Unit Specific Configuration I/F deploy_configuration script
  • 9. Implementation Workflow Central CCM S2K NIS GSTVi … ccm.capture S2K NIS GSTVi … ccm.deploy Scripts repo ccm Config repos ccm ccm ccm Capture executed from local ccm account. Ops account are only read, no trace of ccm access Capture executed from local deploy account.
  • 10. Implementation Architecture git Capture/deploy wrapper * ccm.capture ccm.deploy * for automatic update of ccm scripts and descriptor files s2k.capture s2k.deploy nis.capture nis.deploy Descriptor file repoApi xmlParseApi … Descriptor file mercurial
  • 11. Repository Organisation RTE_repo – One repository per Reference Configuration – Stored with original paths S2K NIS GSTVi DARC … GAI_repo … … RTE_repo/ admin NIS/… DARC/…
  • 12. Repository Management – Tags are for incremental changes – Branches for parallel snapshots of not related views reference periodic week1 week2 week3 working myTest MarkTest optiTest merge …
  • 13. Capture/Deploy Scripts Capture ccm.capture -R <reference config> -T <type> -t <tag> -a <account> [-b <branch>] Deploy GAI_repo reference periodic 1.0 week1 week2 working myTest MarkTest ccm.Deploy -R <reference config> -T <type>
  • 16. Next steps – Implementation: – Migrate from Mercurial to Git – Finalise the definition of Capture/Deploy for all MICONYS units (DARC, EDDS, MATIS, SMF) – Enable ‘sharing’ of Reference Configurations with GIMUS teams – Support the capability to Capture/Deploy the Configuration Items for multiple units (e.g. all units involved in the “End-to-end TM/TC data flow” Test Assembly) – Utilisation: – Create Reference Configurations based on selected missions and deploy them on a MICONYS 6.1 Reference Installations (on-going for Gaia) – Consolidate end-to-end process to transfer mission configurations into pure MICONYS installations – Ensure consistent use of the centralised repository for GI Reference Installations – Expand use to mission installations