IBM's SmartCloud Orchestrator provides end-to-end automation of cloud service delivery through workload orchestration, resource orchestration, and service orchestration. It integrates with existing data center tools and processes using open standards. The Orchestrator includes content types like software bundles, virtual images, and patterns to automate multi-tier application deployments. It also allows custom orchestration operations through actions, user interfaces, and service offerings.

1. © 2013 IBM Corporation
IBM SmartCloud Orchestrator
Architected for Extensibility

2. © 2013 IBM Corporation
Need for End to end Orchestration
End to End Automation
Automate everything to deliver a production
environment: multi node applications,
storage, network, change and configuration,
…
Standardization
Deliver “services”: repeatable and controlled
processes, auditable, simplified self service
consumption,
An Open and Flexible Platform
Integrate with existing data center, processes and tools.
Provide choices to customers that want to avoid a
technology lock in - based on Open Standards
Provisioning is not enough. Customers need end to end automation to accelerate
delivery of IT services, while reducing costs

3. © 2013 IBM Corporation3 IBM Confidential
Why do we need an Orchestrator ?
1. Customers are looking for end to end automation of cloud service delivery to achieve greater
returns
2. Provisioning play a key role, but is just one of many steps that must be automated
3. Each customer has unique requirements to integrate with existing data center processes and
tools.
VM Provisioning
Real customer
example

4. © 2013 IBM Corporation
Orchestration
Engine
Network
Domain
Storage
Domain
IT
ManagementMonitoring
Domain
Data
Availability
Domain
Compute
Domain
Monitoring
IT Asset
Management
Service
Desk
Storage
Domain
Change
Management
Provision PatternProvision Pattern
OrchestrateOrchestrate
Network
Domain
Workload Orchestration
Workload aware placement,
optimization and operation
Resource Orchestration
Onboard, provision, manage
CPU, Storage and Network
Service Orchestration
Manage the lifecycle of business
applications
DBAppWeb
Managing workloads in a Cloud Enabled Data Center
requires orchestration

5. © 2013 IBM Corporation
5
What is SmartCloud Orchestration …
An open and scalable
cloud platform
An easy to use orchestrator for
cloud service automation
A ready to use
automation library
A marketplace for content
sharing and re-use

6. © 2013 IBM Corporation
6
High level architecture
SCOrchestrator
Automation Engine
BPM Process Server
Automation Engine
BPM Process Server
Modeling and
Admin
Modeling and
Admin
Image
Library
Image
Library
VMWare vCenterVMWare vCenter
ICCT
Image
Creation
ICCT
Image
Creation
Self ServiceSelf Service
Automation
Modeling UI
IBM Business Process
Manager (BPM)
Automation
Modeling UI
IBM Business Process
Manager (BPM)
IBM Tivoli
Monitoring
(ITM)
IBM Tivoli
Monitoring
(ITM)
KVMKVM
Content packagesContent packages
Composite Patterns ManagementComposite Patterns Management
APIAPISmartCloud
Cost
Management
(SCCM)
SmartCloud
Cost
Management
(SCCM)
Cloud
User
Offering CatalogOffering Catalog
APIAPI
Service
Desk
Service
Desk
Account
ing
Account
ing
Cost
Mgmt
Cost
Mgmt
Network
FW/LB
Network
FW/LB
Storage
File-based
Storage
File-based
Hypervisor Management
OpenStack Gateway
Hypervisor Management
OpenStack Gateway
Amazon EC2Amazon EC2
Hybrid ExtensionHybrid Extension OpenStackOpenStack
…
*) supported in following releases

7. © 2013 IBM Corporation
7
Zoom in the provisioning engine
Virtual
Applications
Virtual
Applications
Hypervisors & IAAS Management SHIMHypervisors & IAAS Management SHIM
REST APIsREST APIs
Self Service and Admin UISelf Service and Admin UI
OpenStack ShimOpenStack Shim
DeploymentDeployment
Virtual
Systems
Virtual
Systems
IAAS Gateway
VMVM
KVMvCenter
OpenStack1
...
VMVM
KVMvCenter
OpenStackN
Virtual Image
Library
SCE SCE

8. © 2013 IBM Corporation
8
SCOrchestrator – Content Types
 Software Bundle
– A software bundle contains and describes the software available for use within a virtual
image. It includes information about how to install and configure the software,
prerequisites of the software, and parameters available for customizing.
A software bundle is used during image creation with Image Construction and
Composition Tool (ICCT, Part of SCP/SCO)
 Virtual Image
– A Virtual image contains the base operating system and the optional activation code
which configures a virtual server which is based on such virtual image.
In addition it may also contain one or more software components.
 Pattern (vSys & addOns)
– A pattern is a collection of multiple images, each with optional software components.
Patterns are a logical representation of a recurring topology for a given set of
deployment requirements such as e.g. a multi-tiered web application comprising of
HTTP Server, App Server and DB Server.
In this example, each tier would be represented by its own virtual image, which includes
configuration scripts to configure the multi-tier application accordingly
 Resource type operations (implemented as BPM workflows)
 Patterns (vApp & TOSCA)
– Patterns to compose workload aware topologies
 Orchestration
– Content for orchestration can be complete ready to use offerings implemented as
workflow processes including the corresponding user interface
– … and/or a collection of building blocks to ease the creation of orchestration.
These building blocks can be activity implementations, user interfaces, UI widget, …
Service Orchestration
Manage the lifecycle of
business applications
Workload Orchestration
Workload aware placement,
optimization and operation
Resource Orchestration
Onboard, provision, manage CPU,
Storage and Network

9. © 2013 IBM Corporation
Multiple pattern types to enable open ecosystem
Virtual Application
Patterns
• Highly automated deployments
using expert patterns
• Business policy driven elasticity
• Built for the cloud environment
• Leverages elastic workload
management services
Virtual System
Patterns
• Automated deployment of
middleware topologies
• Traditional administration and
management model
• Application and infrastruture
driven elasticity
Virtual Appliances
• Standard software installation and
configuration on OS
• Images created through
extend/capture
• Traditional administration and
management model
• Infrastructure driven elasticity
Virtual Appliance
Metadata
Software
application
Operating
system
Virtual Appliance
Virtual Appliance
Metadata
Application
Server
Operating
system
Virtual Appliance
Metadata
Application
Server
Operating
system
Virtual Appliance
Metadata
HTTP
Server
Operating
system
Virtual Application Patterns
Virtual System PatternsVirtual Appliances
Software
application

10. © 2013 IBM Corporation
10
Custom Orchestration Operations
 SCO allows definition of custom operations for various orchestration granularities
– Event triggered Actions
… used to extend the basic pattern engine capabilities
… plug into existing programming flows at predefined plugpoints/events
… with defined semantics and data model
e.g. Approval (‘pre’), Open firewall port (‘post’), …
– User triggered Actions
… used to extend the basic manageability actions of service instances
… provide addtl mgmt capabilities for all or specific patterns
e.g. Backup, Install SW, Open problem, …
– Service Operations
… implementation of service catalog offerings
… used for end user customized operations,
e.g. deploy pattern, create filesystem, …
… used for administrative actions such as datacenter configuration
e.g. Register StorageHost, User onboarding, …
A
B
A
B
C
X

11. © 2013 IBM Corporation
11
SCO
Custom BPM processes
Pattern engine base processing
Event triggered actions for typical pattern deployment
Resolve
Model
Define
Placement
Copy
images
Configure
hypervisor
Start VM
Execute
Config
Scripts
Notify
user
Pre-provision
Event
Pre-VM-start
Event
Post-provison
Post-provision-failed
Event
Trigger one or
multiple custom
processes on
certain events

12. © 2013 IBM Corporation
12
Orchestration Registry

13. © 2013 IBM Corporation
13
SCO Self-Service Catalog

14. © 2013 IBM Corporation
14
Configuration of Orchestration Actions
BPM process
which implements the
orchestration logic
BPM process
which implements the
end user interface

15. © 2013 IBM Corporation
15
Configuration of Self Service Offerings
BPM process
which implements the
orchestration logic
BPM process
which implements the
end user interface
Settings to define
the visualization
of the offering in the
service catalog
1
2
3
1
2
3

16. © 2013 IBM Corporation
16
Approval / Human Tasks

17. © 2013 IBM Corporation
Library of virtual
templates, sw packages,
script, add on ( disks,
network cards, etc)
Graphical editor for
composing and
configuring workloads
Creation of patterns
Reuse chef recipes
from community

18. © 2013 IBM Corporation
Connecting images in a pattern: example

19. © 2013 IBM Corporation19
Scenario 1 – Speed up business application deployment
End User : (1) Access the SCO self service catalog to deploy a new Media Wiki application.
Service Designer: (2) Modify the Media Wiki service via the pattern editor.
(3) Publish the new service in the catalog

20. © 2013 IBM Corporation20
Scenario 2 – End to end automation
Service Designer: (1) Access the cloud market place and download a storage automation package.
(2) Create a new MediaWiki offering which also performs automated storage and network configuration.
(3) Publish the new offering in the catalog.
End User : (4) Access the catalogue and requests new “Media Wiki”

21. © 2013 IBM Corporation
21
Cloud Marketplace
 Enable customers to rapidly discover and
implement cloud solutions
 Enable business partners and ISVs to
create value by adding content to IBM
cloud solutions
 Enable IBM services and development to
rapidly deliver & iterate on capabilities in
response to changing customer
requirements and integration needs
 Enable collaboration within the
ecosystem to accelerate customer value
creation
Establish cloud platform agility and value by rapidly delivering content
(organic & partner ecosystem) using the AppStore model

22. © 2013 IBM Corporation
22
Managing the infrastructure
Cloud
group1
IWDOpenStack
.
.
.
Region 1
Compute
node1
Compute
nodeX
Availability
zone1
...
Compute
node1
Compute
nodeK
Availability
zoneZ
......
Region n
Compute
node1'
Compute
nodeX'
Availability
zone1'
...
Compute
node1'
Compute
nodeK'
Availability
zoneZ'
......
Cloud
groupZ
Cloud
group1'
Cloud
groupZ'

A cloud group
represents a pair
[Region, availability
zone] in OpenStack

For each cloud
group a single
hypervisor is assigned
despite the number of
compute nodes in the
availability zone

23. © 2013 IBM Corporation
23
Managing the infrastructure
IWDOpenStack
.
.
.
Region 1
Compute
node1
Compute
nodeX
Availability
zone1
...
Compute
node1
Compute
nodeK
Availability
zoneZ
......
Region n
Compute
node1'
Compute
nodeX'
Availability
zone1'
...
Compute
node1'
Compute
nodeK'
Availability
zoneZ'
......
Network1 IP group1
Network2 IP group2
Networkn IP groupn

For each network in each region a pair
[network, IP group] is created in IWD

Each network in a region is attached to all
hypervisors in IWD related to that region

24. © 2013 IBM Corporation
In the beginning, there was the perfect image…
1
Then users starting making changes and “snapshots”…
…and what they put in the images is unknown…
2
Then they get copied to multiple locations…
…and some change again…
3
Then you need to apply a critical security patch…how? … where?
4
What’s the problem with Virtualization and Standardization?
Managing images

25. © 2013 IBM Corporation
25
Capturing Images is easy

There are many tool that simplify the process

All you need is enough space the store them
However managing images is hard:

Standardization

Search

Version control

Drift Detection

Vulnerability

Image building
Virtual Image Library and Image Construction and Composition
Tool help you addressing these issues!

26. © 2013 IBM Corporation
What's new in Virtual Image Library
• OpenStack support
– Ability to federate OpenStack regions
– Ability to use OpenStack Keystone as custom user registry
– In addition, VIL 2.2 exposes OpenStack Glance-compliant REST APIs
• Federating operational repositories across WAN to support geographically
distributed data centers
– New Proxy components to decentralize analytics and check-in/out capabilities over
distributed sites
– New analytics engine providing better performances when introspecting image contents
– New Reference Repository based on a peer-to-peer network of nodes that build a shared
repository
– Firewall-friendly solution to traverse segregated networks
• Improved control over indexing functions
– Canceling queued indexing tasks
– Handling of user-initiated actions at higher priority than the automatically triggered tasks
• Handling OVA images and related metadata

27. © 2013 IBM Corporation
27
What's new in ICCT
• New Cloud Provider for OpenStack
– Possibility to interact directly with an OpenStack instance
– Possibility to interact with the IaaS GW component and the VIL image service exposed
through that component

28. © 2013 IBM Corporation
• Learn more about the IBM SmartCloud Orchestrator
• Join the open development community to get access to
SmartCloud Orchestrator
• http://ibm.co/CPandO
• Watch the video for a quick overview of SmartCloud
Orchestrator http://bit.ly/YKe9gf
• Learn more about the benefits of cloud orchestration IDC
Technology Spotlight on IBM SmartCloud Orchestrator
http://ibm.co/105MtJO
• Join the IBM SmartCloud Community
References