AAI-1445 Managing Dynamic Workloads with WebSphere ND and in the Cloud

© 2015 IBM Corporation
Session 1445A
Managing Dynamic
Workloads with
WebSphere ND
and in the Cloud
Ian Robinson
DE, WebSphere Chief Architect
ian_robinson@uk.ibm.com
Christopher Vignola
WebSphere System Management Architect
cvignola@us.ibm.com

Agenda
• Dynamic workloads - what and why
• WebSphere – how it supports them
• Why this matters
2

Dynamic Workloads
• Natural consequence of competitive forces
• Cloud as industry response
• Software managed platforms
4

Why this matters to you
• Servers commonly 50% over-provisioned
• Represents huge cost in under-utilized capacity
• Bad habits die hard – even in Cloud
• WebSphere Application Server can help
5

WAS Supports Dynamic Workloads
• Traditional Workloads
• New Workloads
• Traditional Management
• Scalable Management
• Off-premise Cloud
6

Traditional Workloads
• ND Full Profile
• Cell configuration
• Make dynamic through Intelligent Management functions
• Dynamic clusters
• Dynamic routing

Dynamic Clusters
• Application demand-driven capacity
• Policy-driven
• Optional elasticity mode
9

Dynamic Routing
• Web routing tier
• Automatic discovery of dynamic capacity
• On Demand Router
• Java Proxy
• IHS w/WAS Plugin (dynamic mode)
• Datapower
10

Dynamic Cluster/Routing - Topologies (Cell)
11
nodeAgent
AppServers
AppServers
AppServers
application
resources
management infrastructure
(IM Connector)
machine boundary
nodeAgent AppServers
AppServers
AppServers
FullProfile
Workload
Router
ODR, IHS or
DataPower
dmgr
workload
workload

JMX
Client
HTTP Server
On Demand
Router
WAS Full Profile
Server X
Apps
Apps
WAS Full Profile
Server Y
Apps
Apps
Messaging Cluster
WAS ND Application Cluster
WAS Full Profile
Cluster Member
Apps
Apps
WAS Full Profile
Cluster Member
Apps
Apps
Intelligent Management Agents
High Availability Manager
Node Agent Node Agent
Browser
Client
Deployment
Manager
Admin App
…
Catalog
Server
WXS
Caching
Tier
Grid
Container
Grid
Container
Grid
Container
Grid
Container
Grid
Container
Grid
Container
WebSphere
plugin
Intel Mgmt for Web Servers1
1
2
WAS ND
Administrative Cell
Routing
information
2 WebSphere eXtreme Scale
3 Dynamic Clustering
3
host 2host 1
Topological View
©
2014
12

New Workloads
Traditional Management

WAS ND Cells – 2 Options
• Cross-deploy apps to from Liberty to Full Profile
• One-way programming model fidelity
• 100% operational consistency
• Manage Liberty profiles as integral part of ND Cell
• Built on Intelligent Management Middleware Server support
– Available v8.5.5.1
• Basic console/scripting access to Liberty
– config access (i.e. server.xml)
– lifecycle (start/stop/status)
– log access (messages.log, etc)
• Optional dynamic clusters for Liberty
• This is “Liberty Assisted Lifecycle” support
©
2014
14

WAS ND Liberty Assisted Lifecycle
• Liberty in the
ND cell gives
operations
similar to WAS
full profile.
• Perfect way to integrate
operational practice
across both profiles types.
dmgr
nodes
ND Cell
DB
HTTP
proxy
node
agent
app
server
app
server
node
agent
app
server
app
server
liberty
liberty
We like reusing
our existing
operational
infrastructure
I like the lightweight
development
experience
©
2014
15

JMX
Client
HTTP Server
On Demand
Router
WAS Full Profile
Server X
Apps
Apps
WAS Full Profile
Server Y
Apps
Apps
Messaging Cluster
WAS Full Profile
Cluster Member
Apps
Apps
WAS Full Profile
Cluster Member
Apps
Apps
Browser
Client
Deployment
Manager
Admin App
…
Catalog
Server
WXS
Caching
Tier
Grid
Container
Grid
Container
Grid
Container
Grid
Container
Grid
Container
Grid
Container
WebSphere
plugin
1
2
WAS ND
Administrative Cell
Routing
information
4
Dynamic Clustering
Cell-based Liberty Dynamic Clustering
Assisted lifecycle dynamic cluster4
host 2host 1
F
e
a
t
u
r
e
M
a
n
a
g
e
r
H
T
T
P
T
r
a
n
s
p
o
r
t
A
p
p
l
i
c
a
t
i
o
n
M
a
n
a
g
e
r
s
e
r
v
l
e
t
-
3
.
0
j
s
p
-
2
.
2
a
p
p
s
e
c
u
r
i
t
y
-
1
.
0
r
e
s
t
c
o
n
n
e
c
t
o
r
-
1
.
0
j
p
a
-
2
.
0
Apps
Liberty Profile
Server 1
F
e
a
t
u
r
e
M
a
n
a
g
e
r
H
T
T
P
T
r
a
n
s
p
o
r
t
A
p
p
l
i
c
a
t
i
o
n
M
a
n
a
g
e
r
s
e
r
v
l
e
t
-
3
.
0
j
s
p
-
2
.
2
a
p
p
s
e
c
u
r
i
t
y
-
1
.
0
r
e
s
t
c
o
n
n
e
c
t
o
r
-
1
.
0
j
p
a
-
2
.
0
Apps
Liberty Profile
Server 2
Apps Apps
Topological View
©
2014
16
3
3

But alternatively…
dmgr
nodes
ND Cell
DB
HTTP
proxy
node
agent
app
server
app
server
node
agent
app
server
app
server
liberty
liberty
This is good
but…
I like the lightweight
development
experience
Actually, we’d like a
lightweight and
massively scalable
cluster…

Principles of Liberty Collective
• Standards-based admin API
• Built on JMX (MBeans).
• Works with common tools (Jconsole, Jython, etc).
• Loosely-coupled
• Exploits Liberty composable server model.
• App servers can easily and quickly be moved in and out of collective.
• Large-scale testing of 10,000 server collective
• Distributed Cache Model
• Admin server (controller) is config/state cache.
• Doubles as bi-directional JMX proxy.
• Distributed Configuration
• App Server owns its own config.
• App Servers cache sparse config and state in controller.
• Scalable, Resilient Admin Domain
• Highly Available admin server (replica model)
• Agentless
©
2014
19

WAS ND Liberty Collective
• Massive scalability
• Easy/Flexible configuration
• Scalable/HA ops/monitoring
liberty liberty liberty
cluster
members
liberty
controllers
HTTP
Proxy
Liberty
Admin Center
Like this…
©
2014
20

server.xml
<featureManager>
<feature>collectiveController-1.0</feature>
</featureManager>
server.xml
<featureManager>
<feature>collectiveMember-1.0</feature>
[ <feature>clusterMember-1.0</feature> ]
</featureManager>
Liberty Controller
WLP
Liberty Collective
WLP WLP
WLP WLP
Liberty Collective
1. wlp/bin/server create {controller}
2. wlp/bin/collective create {controller} ...
3. wlp/bin/server start {controller}
1. wlp/bin/server create {member}
2. wlp/bin/collective join {member} …
repeat
Liberty Collective: Lightweight Management At Scale
WLP=WebSphere Liberty Profile
21

server.xml
<featureManager>
<feature>collectiveMember-1.0</feature>
<feature>clusterMember-1.0</feature>
</featureManager>
<clusterMember name=“MyAppCluster1”/>
Liberty Controller
WLP
Liberty Clusters
WLP
WLP WLP
Liberty Collective
WLP
Name the
cluster:
Add cluster
feature:
Liberty Collective: Lightweight Management At Scale
22

Liberty Controller
WLP
Liberty Clusters
WLP
WLP WLP
Liberty Collective
WebSphere Developer Tools
FileTransfer
MBean
explode
archive
Liberty Server
Package
Example: Centralized Member Creation
Admin Center
or scripting
©
2014
23

JMX
Client
HTTP Server
WAS Full Profile
Server X
Apps
Apps
WAS Full Profile
Server Y
Apps
Apps
Messaging Cluster
WAS Full Profile
Cluster Member
Apps
Apps
WAS Full Profile
Cluster Member
Apps
Apps
Browser
Client
Deployment
Manager
Admin App
…
Catalog
Server
WXS
Caching
Tier
Grid
Container
Grid
Container
Grid
Container
Grid
Container
Grid
Container
Grid
Container
WebSphere
plugin
1
2
WAS ND
Administrative Cell
Routing
information
3 Lightweight Server Collective
host 3
F
e
a
t
u
r
e
M
a
n
a
g
e
r
H
T
T
P
T
r
a
n
s
p
o
r
t
A
p
p
l
i
c
a
t
i
o
n
M
a
n
a
g
e
r
s
e
r
v
l
e
t
-
3
.
0
j
s
p
-
2
.
2
a
p
p
s
e
c
u
r
i
t
y
-
1
.
0
r
e
s
t
c
o
n
n
e
c
t
o
r
-
1
.
0
j
p
a
-
2
.
0
Apps
Liberty Profile
Server 3
Apps
host 2host 1
F
e
a
t
u
r
e
M
a
n
a
g
e
r
H
T
T
P
T
r
a
n
s
p
o
r
t
A
p
p
l
i
c
a
t
i
o
n
M
a
n
a
g
e
r
s
e
r
v
l
e
t
-
3
.
0
j
s
p
-
2
.
2
a
p
p
s
e
c
u
r
i
t
y
-
1
.
0
r
e
s
t
c
o
n
n
e
c
t
o
r
-
1
.
0
j
p
a
-
2
.
0
Apps
Liberty Profile
Server 1
F
e
a
t
u
r
e
M
a
n
a
g
e
r
H
T
T
P
T
r
a
n
s
p
o
r
t
A
p
p
l
i
c
a
t
i
o
n
M
a
n
a
g
e
r
s
e
r
v
l
e
t
-
3
.
0
j
s
p
-
2
.
2
a
p
p
s
e
c
u
r
i
t
y
-
1
.
0
r
e
s
t
c
o
n
n
e
c
t
o
r
-
1
.
0
j
p
a
-
2
.
0
Apps
Liberty Profile
Server 2
Apps Apps
F
e
a
t
u
r
e
M
a
n
a
g
e
r
H
T
T
P
T
r
a
n
s
p
o
r
t
A
p
p
l
i
c
a
t
i
o
n
M
a
n
a
g
e
r
s
e
r
v
l
e
t
-
3
.
0
j
s
p
-
2
.
2
a
p
p
s
e
c
u
r
i
t
y
-
1
.
0
r
e
s
t
c
o
n
n
e
c
t
o
r
-
1
.
0
j
p
a
-
2
.
0
Liberty Profile
Server 4
Apps
Apps
Management and Monitoring (JMX)
Liberty
Collective
Feat
ure
Man
ager
HTT
P
Tran
sport
Appli
catio
n
Man
ager
servl
et-
3.0
jsp-
2.2
apps
ecuri
ty-
1.0
restc
onne
ctor-
1.0
jpa-
2.0
Liberty Collective
Controller
3
Liberty Administrative Center
4
Topological View
©
2014
24
4

From Static to Dynamic Load Balancing -
Intelligent Management
• Integrated from WebSphere Virtual Enterprise in WAS ND 8.5.0
cell-based admin
• Available for Liberty Collectives as of 4Q 2014.
• Demand-driven, policy-controlled, auto-scaling of system
resources to increase/decrease Liberty-hosted application
capacity.
• Dynamic Routing with enhanced WebServer plugin for WAS
(“Intelligent Management for Web Servers”).
©
2014
26

AutoScaling and Dynamic Routing
• Policy bound to app clusters
• Automatic start/stop of JVMs to
scale up/down capacity.
• Dynamic routing
cluster
members
liberty
controllers
IHS
<scalingPolicy name=”policy1” min=”3”>
<metric name=”heap” max=”80”/>
<bind clusters=”cluster1”/>
</scalingPolicy>
Administratively
defined policy dynamic
start/stop
©
2014
27

JMX
Client
HTTP Server
WAS Full Profile
Server X
Apps
Apps
WAS Full Profile
Server Y
Apps
Apps
Messaging Cluster
WAS Full Profile
Cluster Member
Apps
Apps
WAS Full Profile
Cluster Member
Apps
Apps
Browser
Client
Deployment
Manager
Admin App
…
Catalog
Server
WXS
Caching
Tier
Grid
Container
Grid
Container
Grid
Container
Grid
Container
Grid
Container
Grid
Container
WebSphere
plugin
1
WAS ND
Administrative Cell
Routing
information
2 Lightweight Server Collective
3 Liberty AutoScaling
4 Liberty DynamicRouting
host 3
F
e
a
t
u
r
e
M
a
n
a
g
e
r
H
T
T
P
T
r
a
n
s
p
o
r
t
A
p
p
l
i
c
a
t
i
o
n
M
a
n
a
g
e
r
s
e
r
v
l
e
t
-
3
.
0
j
s
p
-
2
.
2
a
p
p
s
e
c
u
r
i
t
y
-
1
.
0
r
e
s
t
c
o
n
n
e
c
t
o
r
-
1
.
0
j
p
a
-
2
.
0
Apps
Liberty Profile
Server 3
Apps
host 2host 1
F
e
a
t
u
r
e
M
a
n
a
g
e
r
H
T
T
P
T
r
a
n
s
p
o
r
t
A
p
p
l
i
c
a
t
i
o
n
M
a
n
a
g
e
r
s
e
r
v
l
e
t
-
3
.
0
j
s
p
-
2
.
2
a
p
p
s
e
c
u
r
i
t
y
-
1
.
0
r
e
s
t
c
o
n
n
e
c
t
o
r
-
1
.
0
j
p
a
-
2
.
0
Apps
Liberty Profile
Server 1
Apps
F
e
a
t
u
r
e
M
a
n
a
g
e
r
H
T
T
P
T
r
a
n
s
p
o
r
t
A
p
p
l
i
c
a
t
i
o
n
M
a
n
a
g
e
r
s
e
r
v
l
e
t
-
3
.
0
j
s
p
-
2
.
2
a
p
p
s
e
c
u
r
i
t
y
-
1
.
0
r
e
s
t
c
o
n
n
e
c
t
o
r
-
1
.
0
j
p
a
-
2
.
0
Apps
Liberty Profile
Server 2
Apps
F
e
a
t
u
r
e
M
a
n
a
g
e
r
H
T
T
P
T
r
a
n
s
p
o
r
t
A
p
p
l
i
c
a
t
i
o
n
M
a
n
a
g
e
r
s
e
r
v
l
e
t
-
3
.
0
j
s
p
-
2
.
2
a
p
p
s
e
c
u
r
i
t
y
-
1
.
0
r
e
s
t
c
o
n
n
e
c
t
o
r
-
1
.
0
j
p
a
-
2
.
0
Liberty Profile
Server 4
Apps
Apps
Management and Monitoring (JMX)
Liberty
Collective
Feat
ure
Man
ager
HTT
P
Tran
sport
Appli
catio
n
Man
ager
servl
et-
3.0
jsp-
2.2
apps
ecuri
ty-
1.0
restc
onne
ctor-
1.0
jpa-
2.0
Liberty Collective
Controller
2
ScalingPolicies
3
Routing
information
4
scalingMember-1.0
smartRouting-1.0
scalingController-1.0
Topological View
©
2014
28

IBM Bluemix
• Off premise application cloud.
• Choice of application types: Java, Node, .py, …
• WAS Apps: Born in the cloud vs migration.
• Over-provisioning may still happen.
30

Portable Auto-scaling
• Auto-scaling Java (Liberty) apps + scaling policy portable
between
• Liberty Collective
• IBM Bluemix
31
On-premise Off-premise
Scaling
Policy

Auto-scaling on Bluemix
• Deploy (push) app to Bluemix
• Bind auto-scaling add-on from catalog to your app
• Choose default or custom policy
32

IBM Softlayer
• Off premise infrastructure cloud.
• Bring your own application/container.
• Strong fidelity with WAS deployments.
• Over-provisioning may still happen.
33

Auto-Scaling on Softlayer
• Virtual HW only
• Designed for Softlayer Load Balancers
• Define auto scale group/region
• Define policy
34

Conclusion
• Internet of things driving up dynamic workloads.
• Over-provisioning is a reality and cost problem.
• Auto-scalable applications is a key mitigation.
• WebSphere supports dynamic workloads with auto-scaling
choices: ND, Bluemix, Softlayer
• Important strategy for you to manage cost.
36

Other Sessions
• AAI-2822 - Liberty Elastic Clusters and Centralized
Administration Using Scripting and Admin Center Lab
• AAI-3218 - Production Deployment Best Practices for the IBM
WebSphere Liberty Profile
• AAI-3281 - Smarter Production with WebSphere Application
Server ND Intelligent Management
• AAI-2694 – Deploying Applications to the WebSphere Liberty
Profile in IBM Bluemix PaaS
37

Selected References
• Top 9 rules for cloud applications
http://www.ibm.com/developerworks/websphere/techjournal/140
4_brown/1404_brown.html
• Introducing the Liberty Collective
http://www.ibm.com/developerworks/websphere/techjournal/130
9_vignola/1309_vignola.html
• Scaling Applications in IBM Bluemix
http://www.ibm.com/developerworks/cloud/library/cl-bluemix-
autoscale/
• Introduction to Softlayer Auto Scale
http://knowledgelayer.softlayer.com/learning/introduction-
softlayer-auto-scale
38

Notices and Disclaimers
Copyright © 2015 by International Business Machines Corporation (IBM). No part of this document may be reproduced or
transmitted in any form without written permission from IBM.
U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with
IBM.
Information in these presentations (including information relating to products that have not yet been announced by IBM) has been
reviewed for accuracy as of the date of initial publication and could include unintentional technical or typographical errors. IBM
shall have no responsibility to update this information. THIS DOCUMENT IS DISTRIBUTED "AS IS" WITHOUT ANY WARRANTY,
EITHER EXPRESS OR IMPLIED. IN NO EVENT SHALL IBM BE LIABLE FOR ANY DAMAGE ARISING FROM THE USE OF
THIS INFORMATION, INCLUDING BUT NOT LIMITED TO, LOSS OF DATA, BUSINESS INTERRUPTION, LOSS OF PROFIT
OR LOSS OF OPPORTUNITY. IBM products and services are warranted according to the terms and conditions of the
agreements under which they are provided.
Any statements regarding IBM's future direction, intent or product plans are subject to change or withdrawal without
notice.
Performance data contained herein was generally obtained in a controlled, isolated environments. Customer examples are
presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual
performance, cost, savings or other results in other operating environments may vary.
References in this document to IBM products, programs, or services does not imply that IBM intends to make such products,
programs or services available in all countries in which IBM operates or does business.
Workshops, sessions and associated materials may have been prepared by independent session speakers, and do not
necessarily reflect the views of IBM. All materials and discussions are provided for informational purposes only, and are neither
intended to, nor shall constitute legal or other guidance or advice to any individual participant or their specific situation.
It is the customer’s responsibility to insure its own compliance with legal requirements and to obtain advice of competent legal
counsel as to the identification and interpretation of any relevant laws and regulatory requirements that may affect the customer’s
business and any actions the customer may need to take to comply with such laws. IBM does not provide legal advice or
represent or warrant that its services or products will ensure that the customer is in compliance with any law.

Notices and Disclaimers (con’t)
Information concerning non-IBM products was obtained from the suppliers of those products, their published
announcements or other publicly available sources. IBM has not tested those products in connection with this
publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM
products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.
IBM does not warrant the quality of any third-party products, or the ability of any such third-party products to
interoperate with IBM’s products. IBM EXPRESSLY DISCLAIMS ALL WARRANTIES, EXPRESSED OR IMPLIED,
INCLUDING BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A
PARTICULAR PURPOSE.
The provision of the information contained herein is not intended to, and does not, grant any right or license under any
IBM patents, copyrights, trademarks or other intellectual property right.
• IBM, the IBM logo, ibm.com, Bluemix, Blueworks Live, CICS, Clearcase, DOORS®, Enterprise Document
Management System™, Global Business Services ®, Global Technology Services ®, Information on Demand,
ILOG, Maximo®, MQIntegrator®, MQSeries®, Netcool®, OMEGAMON, OpenPower, PureAnalytics™,
PureApplication®, pureCluster™, PureCoverage®, PureData®, PureExperience®, PureFlex®, pureQuery®,
pureScale®, PureSystems®, QRadar®, Rational®, Rhapsody®, SoDA, SPSS, StoredIQ, Tivoli®, Trusteer®,
urban{code}®, Watson, WebSphere®, Worklight®, X-Force® and System z® Z/OS, are trademarks of
International Business Machines Corporation, registered in many jurisdictions worldwide. Other product and
service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on
the Web at "Copyright and trademark information" at: www.ibm.com/legal/copytrade.shtml.

Thank You
Your Feedback is
Important!
Access the InterConnect 2015
Conference CONNECT Attendee
Portal to complete your session
surveys from your smartphone,
laptop or conference kiosk.
Session 1145A

AAI-1445 Managing Dynamic Workloads with WebSphere ND and in the Cloud

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to AAI-1445 Managing Dynamic Workloads with WebSphere ND and in the Cloud

Similar to AAI-1445 Managing Dynamic Workloads with WebSphere ND and in the Cloud (20)

More from WASdev Community

More from WASdev Community (8)

Recently uploaded

Recently uploaded (20)

AAI-1445 Managing Dynamic Workloads with WebSphere ND and in the Cloud