The document discusses tools and techniques for optimizing performance of OpenStack private clouds. It describes the need for better operations tools to manage instances and hosts. It also provides recommendations for disk input/output tuning in OpenStack components like Glance and Swift to improve performance. Specific tuning options discussed include adjusting the Glance chunk size and enabling caching in Glance for faster image retrieval.
How Big Data platform scaled from zero to billions of data within 6 months at ISCPIF (CNRS).
This talk contains our use of Elasticsearch, MongoDB, Redis, RabbitMQ and scalable/high available Web services built over Big Data architecture.
This presentation was presented at Université Paris-Sud, LAL, Bâtiment 200 organized by ARGOS. https://indico.mathrice.fr/event/2/overview
ISCPIF: http://iscpif.fr
Big Data at ISCPIF: http://bigdata.iscpif.fr
Climate at ISCPIF: http://climate.iscpif.fr
Playground for climate: http://climate.iscpif.fr/playground
Tweetoscope: http://tweetoscope.iscpif.fr
Slides of our talk at adaptTo 2016, Chetan Mehrotra and myself (https://adapt.to/2016/en/schedule/let_s-run-the-whole-web-on-apache-sling-and-oak-.html).
The code is at https://github.com/bdelacretaz/sling-adaptto-2016 and uses Docker to build a dynamic cluster of Apache Sling instances.
OCF.tw's talk about "Introduction to spark"Giivee The
在 OCF and OSSF 的邀請下分享一下 Spark
If you have any interest about 財團法人開放文化基金會(OCF) or 自由軟體鑄造場(OSSF)
Please check http://ocf.tw/ or http://www.openfoundry.org/
另外感謝 CLBC 的場地
如果你想到在一個良好的工作環境下工作
歡迎跟 CLBC 接洽 http://clbc.tw/
Ceph Object Storage Reference Architecture Performance and Sizing GuideKaran Singh
Together with my colleagues at Red Hat Storage Team, i am very proud to have worked on this reference architecture for Ceph Object Storage.
If you are building Ceph object storage at scale, this document is for you.
How Big Data platform scaled from zero to billions of data within 6 months at ISCPIF (CNRS).
This talk contains our use of Elasticsearch, MongoDB, Redis, RabbitMQ and scalable/high available Web services built over Big Data architecture.
This presentation was presented at Université Paris-Sud, LAL, Bâtiment 200 organized by ARGOS. https://indico.mathrice.fr/event/2/overview
ISCPIF: http://iscpif.fr
Big Data at ISCPIF: http://bigdata.iscpif.fr
Climate at ISCPIF: http://climate.iscpif.fr
Playground for climate: http://climate.iscpif.fr/playground
Tweetoscope: http://tweetoscope.iscpif.fr
Slides of our talk at adaptTo 2016, Chetan Mehrotra and myself (https://adapt.to/2016/en/schedule/let_s-run-the-whole-web-on-apache-sling-and-oak-.html).
The code is at https://github.com/bdelacretaz/sling-adaptto-2016 and uses Docker to build a dynamic cluster of Apache Sling instances.
OCF.tw's talk about "Introduction to spark"Giivee The
在 OCF and OSSF 的邀請下分享一下 Spark
If you have any interest about 財團法人開放文化基金會(OCF) or 自由軟體鑄造場(OSSF)
Please check http://ocf.tw/ or http://www.openfoundry.org/
另外感謝 CLBC 的場地
如果你想到在一個良好的工作環境下工作
歡迎跟 CLBC 接洽 http://clbc.tw/
Ceph Object Storage Reference Architecture Performance and Sizing GuideKaran Singh
Together with my colleagues at Red Hat Storage Team, i am very proud to have worked on this reference architecture for Ceph Object Storage.
If you are building Ceph object storage at scale, this document is for you.
Austin OpenStack Meetup December 2012 presentation. The first part of the session was Chef for OpenStack, the second was Q&A about AT&T's OpenStack private cloud deployments to multiple data centers.
OpenStack community is growing at a very fast pace. The panel will give an overview of this growth, with some metrics and charts. The session will be the venue to discuss and decide how to:
create local OpenStack ambassadors to help promote the project worldwide
give recognition to all the people helping in the success of Openstack
share best practices for establishing user groups for OpenStack.
The panel will be open to comments and questions from the attendees.
How enterprise IT needs to deliver networking with High Availability, Scalability & Interoperability across complex multi site environments; seamlessly with existing heterogeneous infrastructure & vendors.
Oh, and interconnect OpenStack private clouds with external public clouds too.
Austin OpenStack Meetup December 2012 presentation. The first part of the session was Chef for OpenStack, the second was Q&A about AT&T's OpenStack private cloud deployments to multiple data centers.
OpenStack community is growing at a very fast pace. The panel will give an overview of this growth, with some metrics and charts. The session will be the venue to discuss and decide how to:
create local OpenStack ambassadors to help promote the project worldwide
give recognition to all the people helping in the success of Openstack
share best practices for establishing user groups for OpenStack.
The panel will be open to comments and questions from the attendees.
How enterprise IT needs to deliver networking with High Availability, Scalability & Interoperability across complex multi site environments; seamlessly with existing heterogeneous infrastructure & vendors.
Oh, and interconnect OpenStack private clouds with external public clouds too.
As the world of system and application deployment continues to change, the sys admin and security community needs to change with it. With agile development, continuous deployment, the pace of change in IT has only increased. Add in Dev/Ops and the traditional sys admin and security processes just don’t work. How can you rapidly deliver servers and applications while making sure they are built reliably and securely. Rackspace has been developing a tool to help them design, deploy and security assess complex configurations for customers called Checkmate. This talk will cover the concepts behind and the architecture of Checkmate and how it helps minimize the time to deploy systems and verify they have been created to spec and in a secure state. A discussion of how Checkmate has inspired the concept of Test Driven Security based on the Test Driven Development model familiar to the development world.
Stefan Didak's presentation about APC, memcached, varnish, and other tools for speeding up your WordPress site (as long as you're in charge of your own server). From the October 2013 East Bay WordPress Meetup.
DevOpsDays Amsterdam - Monitoring at Service Provider ScaleChris Jackson
At Rackspace, we're implementing DevOps principles to enable scale and faster flow of business value, for us that means customer satisfaction. There's lots of work for us to do to complete our implementation, but this talk shows a little about our belief system for DevOps and how we're trying to change monitoring into a source of customer delight.
In this webinar, we will review all important information for sponsors packages, add-ons, venue details, and how to become a sponsor.
Webinar recording: https://youtu.be/kUjMTNoX6yM
A few quick points for those who may be attending an OpenStack Summit for the first time. We are excited to see you in Barcelona, Spain October 25-28, 2016.
An overview of the 1H2016 OpenStack Marketing Plan shared with the marketing community during our regular calls. Learn more at https://wiki.openstack.org/wiki/Governance/Foundation/Marketing#Open_Marketing_Meetings_2016
The Foundation marketing team put together a high level overview of 2H 2015 plans in order to get input from the marketing community and provide more information on how marketers can take advantage of the work, as well as get involved and contribute.
This is a content overview of the important information and details for sponsors of the upcoming OpenStack Summit in Tokyo, Japan taking place October 27 - 30.
You can watch a recording of the webinar here: https://openstack.webex.com/openstack/ldr.php?RCID=d48605b7ca9fdccd990ab20eb9334be8
OpenStack celebrates its fifth birthday, July 19, 2015, and this presentation provides an update on the community momentum, as well as what's next. #openstack5bday
At OpenStack Day CEE 2015, we discuss the latest user survey results, some real-world OpenStack case studies and how new users and cloud operators can get involved with the community.
1. Operating
your
OpenStack
Private
Cloud
Ryan
Richard
OpenStack
Engineer
ryan.richard@rackspace.com
@rackninja
October 12, 2012
Thursday, October 18, 12
2. Monitoring
and
Reporting
Where
we
were
-‐
April
2012
Basic
CDM
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Thursday, October 18, 12
3. Monitoring
and
Reporting
Where
we
were
-‐
April
2012
Basic
CDM
Now
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Thursday, October 18, 12
4. Monitoring
and
Reporting
Where
we
were
-‐
April
2012
Basic
CDM
Now
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Thursday, October 18, 12
5. Tools
There
is
no
good
way
to
get
the
following
info:
I
need
a
list
of
instances
on
a
host
and
their
IPs
I
need
to
gracefully
start/stop
all
instances
on
a
host
Some
tools
needs
hostname,
some
need
id
(decimal
or
hex),
some
need
uuid
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Thursday, October 18, 12
6. Tools
There
is
no
good
way
to
get
the
following
info:
I
need
a
list
of
instances
on
a
host
and
their
IPs
I
need
to
gracefully
start/stop
all
instances
on
a
host
Some
tools
needs
hostname,
some
need
id
(decimal
or
hex),
some
need
uuid
SELECT
instances.id,instances.hostname,instances.project_id,fixed_ips.address
as fixed_address,floating_ips.address as floating_address FROM instances
LEFT JOIN fixed_ips ON instances.id=fixed_ips.instance_id LEFT JOIN
floating_ips ON floating_ips.fixed_ip_id=fixed_ips.id WHERE
instances.deleted="NULL" AND instances.host="<hostname of physical
machine>" ORDER BY instances.id;
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Thursday, October 18, 12
7. Tools
WE
NEED
BETTER
OPS
TOOLS!
RACKSPACE® HOSTING | WWW.RACKSPACE.COM 4
Thursday, October 18, 12
8. Tools
WE
NEED
BETTER
OPS
TOOLS!
Pulsar
https://github.com/
rsoprivatecloud/pulsar
“nova
swiss
army
knife”
requires
direct
nova
database
access
RACKSPACE® HOSTING | WWW.RACKSPACE.COM 4
Thursday, October 18, 12
9. Tools
WE
NEED
BETTER
OPS
TOOLS!
Pulsar
https://github.com/
rsoprivatecloud/pulsar
“nova
swiss
army
knife”
requires
direct
nova
database
access
RACKSPACE® HOSTING | WWW.RACKSPACE.COM 4
Thursday, October 18, 12
10. Tools
Holland
(opensource
database
backup
framework)
Written
by
Rackspace
DBAs
http://wiki.hollandbackup.org/
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Thursday, October 18, 12
13. Tools
dsh
dsh -Mcg compute uname-a
bashfoo
for
i
in
`knife
node
list
|
grep
cpu`;
do
knife
node
run_list
add
$i
"role[single-‐compute]";
done
for
k
in
`seq
1
20`;
do
for
i
in
{compute,network};
do
nova-‐manage
service
disable
computevm0$k
nova-‐$i;
done;
done
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Thursday, October 18, 12
14. Performance
and
Scale
Considerations
Disk
IO
For
high
performance
use
remote
block
storage
For
“local”
disk
IO,
raw
image
type
is
only
slightly
faster
than
qcow2
IO
will
degrade
while
Glance
copies
images
between
machines
scheduler=cfq,
KVM
cache=none
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Thursday, October 18, 12
15. Performance
and
Scale
Considerations
Disk
IO Async&Random&IO&
rs/speed/test12"(cfq,"host"deadline,"cache=none)"
Rs/speed/test13"(noop,"cache=writeback)"
For
high
performance
use
rs/speed/test13"(cfq,"cache=writeback)"
remote
block
storage Rs/speed/test12"(noop"cache=none)"
randW"(direct)"
Rs/speed/test12"(cfq"cache=none)"
randR"(direct)"
For
“local”
disk
IO,
raw
randW"
Rs/speed/test13"(cfq,"cache=none,"no"ht)"
randR"
image
type
is
only
slightly
Rs/speed/test13"(deadline"cache=none)"
faster
than
qcow2 compute/host"(deadline)"
compute/host"(no"ht)"
compute/host"
IO
will
degrade
while
Glance
0" 200" 400" 600" 800" 1000" 1200" 1400" 1600"
Host&vs.&Instance&
copies
images
between
14000"
machines 12000"
10000"
scheduler=cfq,
KVM
8000"
cache=none
compute/host"
6000" Rs/speed/test12"(cfq"cache=none)"
4000"
2000"
0"
randR" randW" randR" randW" seqR" seqW"RACKSPACE® HOSTING
seqR" seqw" | WWW.RACKSPACE.COM
(direct)" (direct)" (direct)" (direct)"
Thursday, October 18, 12
20. Performance
and
Scale
Considerations
Swift
disk
usage
with
different
chunk
sizes
5
zones
-‐
4
x
1TB
disks
per
zone
20TB
raw
-‐
6.67TB
usable RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Thursday, October 18, 12
21. Performance
and
Scale
Considerations
Swift
disk
usage
with
different
chunk
sizes
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Thursday, October 18, 12
22. Performance
and
Scale
Considerations
Glance
chunk
size
Too
high
and
swift
can
become
unbalanced
What
are
the
downsides
to
being
too
low?
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Thursday, October 18, 12
23. Performance
and
Scale
Considerations
Glance
Disk
Tuning
(swift)
read
ahead
on
your
block
device(s)
-‐
no
noticeable
gain
deadline
scheduler
-‐
no
noticeable
gain
Best
thing
for
glance
performance
-‐
Caching
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Thursday, October 18, 12
24. Performance
and
Scale
Considerations
Glance
Disk
Tuning
(swift)
read
ahead
on
your
block
device(s)
-‐
no
noticeable
gain
deadline
scheduler
-‐
no
noticeable
gain
Best
thing
for
glance
performance
-‐
Caching
Image
Size Not
Cached Cached
1.4GB 20secs 1sec
16.4GB 2min
21secs 1sec
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Thursday, October 18, 12
25. Performance
and
Scale
Considerations
Glance
Disk
Tuning
(swift)
read
ahead
on
your
block
device(s)
-‐
no
noticeable
gain
deadline
scheduler
-‐
no
noticeable
gain
Best
thing
for
glance
performance
-‐
Caching
Image
Size Not
Cached Cached *times
from
“creating
image”
to
“qemu-‐img
1.4GB 20secs 1sec create”
16.4GB 2min
21secs 1sec
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Thursday, October 18, 12
26. Performance
and
Scale
Considerations
Scheduler
What
we
use
by
default:
scheduler
tasks
are
not
processed
in
parallel
Adding
additional
schedulers
helps
provide
HA
but
they
don’t
speed
up
overall
times
to
complete
requests
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Thursday, October 18, 12
27. Automated
Config
Management
Chef:
http://github.com/rcbops/chef-‐cookbooks
time
to
stand
up
controller
-‐
less
than
20
minutes
compute
node
-‐
less
than
2
min
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Thursday, October 18, 12
28. Day
to
Day
tasks
Dealing
with
new
issues
resize
-‐
all
nova-‐compute
processes
need
to
be
able
to
log
into
all
other
compute
nodes
via
ssh
keys
Hardware
failures
We’re
still
managing
infrastructure,
failures
happen
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Thursday, October 18, 12
29. Lessons
Learned
We
need
better
Operations
tools!
Network
Design
can
be
confusing
for
people
used
to
“the
old
way”
OpenStack
is
still
relatively
new,
help
your
organization
understand
it.
It’s
easy
to
forget
we’re
working
with
Linux
machines
It’s
not
you,
it’s
a
bug
:)
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Thursday, October 18, 12
30. But....
But
this
is
a
design
summit
also
Open
to
discussions/thoughts/questions
RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Thursday, October 18, 12