Consideration for Building a Private Cloud

April 2013
Considerations
for
Building

a
Private
Cloud
Folsom
Update

Ryan
Richard,
RHCA
OpenStack
Architect
-‐
Private
Cloud
ryan.richard@rackspace.com
@rackninja
Monday, April 15, 13

RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Why
Folsom?

What
is
a
Private
Cloud?
Elastic
or
Traditional
Virtualization
(hint:
Pick
One!)
Multi-‐tenant
(Multi-‐Application)
Size
Private
API
endpoints
Limited
inbound
connectivity
Customized
for
speciﬁc
workloads

Build
with
the
End
in
Mind

#
of
instances
on
this
physical
host?
Flavor: m1.tiny
Ram: 512MiB
vCPU: 1
Disk: 0 (size of image)
Total instances:
?
48
vCPU Ram Disk

Build
with
the
End
in
Mind

#
of
instances
on
this
physical
host?
Flavor: m1.medium
Ram: 4096MiB
vCPU: 2
Disk: 10GiB + 40GiB
Total instances:
24
vCPU Ram Disk

Build
with
the
End
in
Mind

#
of
instances
on
this
physical
host?
Flavor: ram heavy
Ram: 64GiB
vCPU: 8
Disk: 100GiB
Total instances:
2
vCPU Ram Disk

Capacity
Thoughts
Don’t allow disk size of 0
Public Cloud: Limit flavors to image size
Private Cloud: Can add flavors for specific
application profiles
Network Utilization

Capacity
Thoughts
I can always add more machines....
But you can’t change or modify the ﬁxed
network once instances are running

Capacity
Thoughts
(resource
/
resource
in
smallest
ﬂavor)
=
maximum
#
of

instances
per
machine
Fixed
Network
-‐
Double
or
quadruple
number
of
expected

instances
I can always add more machines....
But you can’t change or modify the ﬁxed
network once instances are running

Build
with
the
End
in
Mind
2
networks
(3
w/
ﬂoating
IPs)
1)
Host
Network
2)
Fixed
Network
3)
Floating
network
nova-network

Build
with
the
End
in
Mind
2
networks
(3
w/
ﬂoating
IPs)
1)
Host
Network
2)
Fixed
Network
3)
Floating
network
Easy
to
add
physical
nodes
and/or

networks
nova-network

Build
with
the
End
in
Mind
2
networks
(3
w/
ﬂoating
IPs)
1)
Host
Network
2)
Fixed
Network
3)
Floating
network
Easy
to
add
physical
nodes
and/or

networks
Don’t
try
to
change
the
ﬁxed

network
once
in
production
nova-network

Build
with
the
End
in
Mind
2
networks
(3
w/
floating
IPs)
1)
Host
Network
2)
Fixed
Network
3)
Floating
network
Easy
to
add
physical
nodes
and/or

networks
Don’t
try
to
change
the
fixed

network
once
in
production
Easy
to
add
additional
floating

networks
nova-network

Images
and
Storage
Images
Building images talk tomorrow @1:50 in room C123
Format: raw qcow2 vdi ...
Container: bare ami bundle ...
Cloud tech: cloud-init none
Partitioning: ﬁxed dynamic
Drivers: virtio vhost_net xen ...

Images
and
Storage
Glance
File
backed
(local)

Alternatives:
Swift,
CloudFiles,
NFS
(locally
mounted)
Snapshots?
qcow2
format:
“snapshot_image_format=qcow2“

Images
and
Storage
Glance
Performance
Network
Throughput:
1Gbps
=
125MBps
(expect
~112MB/s)
RAID
5
-‐
large
sequential
read/writes
Disk
Bandwidth
>
IOPS
Improve
cache
-‐
Reduce
#
of
images


Images
and
Storage
Glance
Performance
Network
Throughput:
1Gbps
=
125MBps
(expect
~112MB/s)
RAID
5
-‐
large
sequential
read/writes
Disk
Bandwidth
>
IOPS
Improve
cache
-‐
Reduce
#
of
images

Image
Size Not
Cached Cached
1.4GB 20secs 1sec
16.4GB 2min
21secs 1sec

Images
and
Storage
Glance
Performance
Network
Throughput:
1Gbps
=
125MBps
(expect
~112MB/s)
RAID
5
-‐
large
sequential
read/writes
Disk
Bandwidth
>
IOPS
Improve
cache
-‐
Reduce
#
of
images

Image
Size Not
Cached Cached
1.4GB 20secs 1sec
16.4GB 2min
21secs 1sec
*times
from
“creating

image”
to

“qemu-‐img

create”

Images
and
Storage
Storage
4
focus
points:
Glance,
Compute
(local),
Cinder,
Swift
Glance
-‐
Space,
Sequential
read/write
Compute
-‐
random
IO
Cinder
-‐
Performance,
Density
Swift
-‐
JBOD,
density

Architecture
Examples
and
Thoughts
1
-‐
20
physical
servers
Single
controller
Single
API

Single
network
(1Gbps
or
2Gbps)

Architecture
Examples
and
Thoughts
20-‐100
servers
HA
controllers
and
load
balanced

APIs
Swift/CloudFiles
for
Glance
Availability
Zones
Consider
“frontend”
and
“backend”

networks
Compute
Node
metrics
-‐
Dedicated

Machine(s)

Performance
Considerations
and
Bottlenecks
IO
Random
IO
Reduce
IO
per
instance
Block
Storage!
Review
Hypervisor
best
practices


Performance
Considerations
and
Bottlenecks
IO
Random
IO
Reduce
IO
per
instance
Block
Storage!
Review
Hypervisor
best
practices

0" 200" 400" 600" 800" 1000" 1200" 1400" 1600"
compute/host"
compute/host"(no"ht)"
compute/host"(deadline)"
Rs/speed/test13"(deadline"cache=none)"
Rs/speed/test13"(cfq,"cache=none,"no"ht)"
Rs/speed/test12"(cfq"cache=none)"
Rs/speed/test12"(noop"cache=none)"
rs/speed/test13"(cfq,"cache=writeback)"
Rs/speed/test13"(noop,"cache=writeback)"
rs/speed/test12"(cfq,"host"deadline,"cache=none)"
Async&Random&IO&
randW"(direct)"
randR"(direct)"
randW"
randR"
0"
2000"
4000"
6000"
8000"
10000"
12000"
14000"
randR" randW" randR"
(direct)"
randW"
(direct)"
seqR" seqW" seqR"
(direct)"
seqw"
(direct)"
Host&vs.&Instance&
compute/host"
Rs/speed/test12"(cfq"cache=none)"

Lessons
Learned
Lessons
learned
Floating
IPs
MUST
be
associated
with
the
“public_interface”
Each
piece
of
OpenStack
has
its
own
architecture
Folsom
is
stable

Migration
(live,
block)
works
but
scenarios
exist
where
it

doesn’t
OpenStack
is
still
changing
often,
keep
up
to
date
with

current
state
of
the
projects
Don’t
do
Heterogeneous
Nodes

Operational
Updates
nova
hypervisor*
calls
Image
types
in
Glance
policy.json
Coming
in
Grizzly:
Cells

Quantum

Better
LDAP/AD
support

But....
But
this
is
a
design
summit
also
Open
to
discussions/thoughts/
questions

RACKSPACE® HOSTING | 5000 WALZEM ROAD | SAN ANTONIO, TX 78218
US SALES: 1-800-961-2888 | US SUPPORT: 1-800-961-4454 | WWW.RACKSPACE.COM
RACKSPACE® HOSTING | © RACKSPACE US, INC. | RACKSPACE® AND FANATICAL SUPPORT® ARE SERVICE MARKS OF RACKSPACE US, INC. REGISTERED IN THE UNITED STATES AND OTHER COUNTRIES. | WWW.RACKSPACE.COM
Rackspace
is
hiring
www.rackertalent.com

Consideration for Building a Private Cloud

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (15)

Similar to Consideration for Building a Private Cloud

Similar to Consideration for Building a Private Cloud (20)

More from OpenStack Foundation

More from OpenStack Foundation (20)

Recently uploaded

Recently uploaded (20)

Consideration for Building a Private Cloud