Apache CloudStack is an open-source cloud computing platform that provides infrastructure as a service. It started as commercial software but was released as open source in 2010. It was accepted as an incubating project at the Apache Software Foundation in 2012. CloudStack provides a turn-key stack for running public, private or hybrid clouds across various hypervisors. It has a highly scalable architecture and supports features like networking, storage and high availability.
Based on the IoT innovation analysis and insights for the future IoT innovation/business directions, the IoT products/services innovation and patent portfolios development strategy can be developed by exploiting the system evolution principle (e.g. TRIZ) for each subsystem and the system as a whole and scenario planning methodology.
Existing patents can be exploited for the development of the disruptive IoT products/services using the “Blue Ocean Patent Strategy.” The basic principle in the Blue Ocean Patent Strategy is to exploit patents to achieve the value innovation by using the patented technologies to create new values, and thus, to provide new products/services. The exploitation of existing patented technologies not only allows the low cost IoT product/service development but also provides the protection against competitors’ infringement. Existing patents can also be exploited for the development of a new IoT startup.
Based on the IoT innovation analysis and insights for the future IoT innovation/business directions, the IoT products/services innovation and patent portfolios development strategy can be developed by exploiting the system evolution principle (e.g. TRIZ) for each subsystem and the system as a whole and scenario planning methodology.
Existing patents can be exploited for the development of the disruptive IoT products/services using the “Blue Ocean Patent Strategy.” The basic principle in the Blue Ocean Patent Strategy is to exploit patents to achieve the value innovation by using the patented technologies to create new values, and thus, to provide new products/services. The exploitation of existing patented technologies not only allows the low cost IoT product/service development but also provides the protection against competitors’ infringement. Existing patents can also be exploited for the development of a new IoT startup.
Recently Cisco and Ericsson announced a strategic partnership to create the networks of the future. Their partnership will lead to the synergy in developing innovative networks for connecting billions of the internet of things (IoT) devices considering their complementary efforts in the IoT innovation activities. Because patents can provide insights regarding the state of the art and technical details of innovation in a company, one can have insights regarding the future Cisco + Ericsson IoT networks based on each company’s patents for the IoT networks.
FinTech (Financial Technology) refers to exploiting technologies (e.g. mobile devices, internet/web technologies) for providing innovative financial services. Some examples of FinTech are money transfer/digital currency, payments/billing system and P2P lending/cloud funding system. The technology/service developments of FinTech can be protected by either software patents or business method patents. Following patents illustrate some examples of the technology/service developments of FinTech. The internet connected IoT devices combined with FinTech can provide diverse value added financial services. Some examples are secured smart transactions, smart POS systems and personalized banking service. Following patents illustrate some examples of the technology/service developments of IoT/FinTech.
Big data analytics is becoming important to process unimaginably large amounts of information and data in many applications. The typical big data analytics is Hadoop, an open-source software framework that supports data-intensive distributed applications, and the running of applications on large clusters of commodity hardware. Hadoop, that is based on the architectural framework MapReduce, collects both structured data and unstructured data, processes the collected data set in a distributed network cluster in parallel, and extracts valuable information from the processed data set within a short time. Followings illustrate some examples of patents that provide current status of the big data analytics applications.
A quick intro to DevCloud the CloudStack sandbox, and how to use CloudMonkey to manage your cloud.
DevCloud is a virtualbox image that contains the CloudStack source code and that is setup to run the storage infrastructure needed by CloudStack plus the networking setup to build the guest network of the VMs. Tiny Linux instances can be started within the Devcloud VM making use of nested virtualization.
This is a perfect setup to discover cloudstack, give demos and test new codes. It is used to test new releases and verify basic functionality. You can run DevCloud on your laptop and then use the command line interface CloudMonkey to make API calls to your DevCloud instance.
This is the perfect complement to the talk on CloudMonkey and shows the basic functionality of a cloud. Instance creation, snapshots, networking, network offering and AWS EC2 compatibility.
My talk from BACD http://buildacloud.org workshop in Ghent, Belgium
All videos can be viewed at: http://www.youtube.com/playlist?list=PLb899uhkHRoZZefRW5XmCb8QBcRO7o74E
This is an introductory talk for the workshop, it introduces CloudStack and the community at the Apache Software Foundation, it presents the basic layers of the Cloud IaaS, PaaS, and SaaS and shows how the CloudStack ecosystem addresses all layers. It presents the basic features of cloudstack, networking with a focus on SDN (Software Defined Networking) , storage with a focus on large scale object store (Ceph), a use case with Spotify, a PaaS with Karafe and fuse Fabric, the API using deltacloud which provides the CIMI standard interface and an application integration using the CloudStack API with Activeeon.
This is the perfect complement to the videos on youtube and serves as a introduction to CloudStack.
Enhanced introduction to CloudStack for the Geneva Java User Group. Includes Apache processes, DevCloud use cases, opportunities for Java developers and 4.0 release testing procedure.
Recently Cisco and Ericsson announced a strategic partnership to create the networks of the future. Their partnership will lead to the synergy in developing innovative networks for connecting billions of the internet of things (IoT) devices considering their complementary efforts in the IoT innovation activities. Because patents can provide insights regarding the state of the art and technical details of innovation in a company, one can have insights regarding the future Cisco + Ericsson IoT networks based on each company’s patents for the IoT networks.
FinTech (Financial Technology) refers to exploiting technologies (e.g. mobile devices, internet/web technologies) for providing innovative financial services. Some examples of FinTech are money transfer/digital currency, payments/billing system and P2P lending/cloud funding system. The technology/service developments of FinTech can be protected by either software patents or business method patents. Following patents illustrate some examples of the technology/service developments of FinTech. The internet connected IoT devices combined with FinTech can provide diverse value added financial services. Some examples are secured smart transactions, smart POS systems and personalized banking service. Following patents illustrate some examples of the technology/service developments of IoT/FinTech.
Big data analytics is becoming important to process unimaginably large amounts of information and data in many applications. The typical big data analytics is Hadoop, an open-source software framework that supports data-intensive distributed applications, and the running of applications on large clusters of commodity hardware. Hadoop, that is based on the architectural framework MapReduce, collects both structured data and unstructured data, processes the collected data set in a distributed network cluster in parallel, and extracts valuable information from the processed data set within a short time. Followings illustrate some examples of patents that provide current status of the big data analytics applications.
A quick intro to DevCloud the CloudStack sandbox, and how to use CloudMonkey to manage your cloud.
DevCloud is a virtualbox image that contains the CloudStack source code and that is setup to run the storage infrastructure needed by CloudStack plus the networking setup to build the guest network of the VMs. Tiny Linux instances can be started within the Devcloud VM making use of nested virtualization.
This is a perfect setup to discover cloudstack, give demos and test new codes. It is used to test new releases and verify basic functionality. You can run DevCloud on your laptop and then use the command line interface CloudMonkey to make API calls to your DevCloud instance.
This is the perfect complement to the talk on CloudMonkey and shows the basic functionality of a cloud. Instance creation, snapshots, networking, network offering and AWS EC2 compatibility.
My talk from BACD http://buildacloud.org workshop in Ghent, Belgium
All videos can be viewed at: http://www.youtube.com/playlist?list=PLb899uhkHRoZZefRW5XmCb8QBcRO7o74E
This is an introductory talk for the workshop, it introduces CloudStack and the community at the Apache Software Foundation, it presents the basic layers of the Cloud IaaS, PaaS, and SaaS and shows how the CloudStack ecosystem addresses all layers. It presents the basic features of cloudstack, networking with a focus on SDN (Software Defined Networking) , storage with a focus on large scale object store (Ceph), a use case with Spotify, a PaaS with Karafe and fuse Fabric, the API using deltacloud which provides the CIMI standard interface and an application integration using the CloudStack API with Activeeon.
This is the perfect complement to the videos on youtube and serves as a introduction to CloudStack.
Enhanced introduction to CloudStack for the Geneva Java User Group. Includes Apache processes, DevCloud use cases, opportunities for Java developers and 4.0 release testing procedure.
Deploying Apache CloudStack from API to UIJoe Brockmeier
For most organizations with a large computing footprint, it's not a matter of if you'll need a private cloud - it's when, and what kind. One of the most mature and widely deployed options is Apache CloudStack, a robust, turnkey cloud that includes everything you need to set up a private, public, or hybrid cloud. We'll cover Apache CloudStack from API to UI, and a little of everything in between.
PPTV is using CloudStack 3.0.2 in its production environment. Currently there are more than 150 hosts, and migrate their apps to cloud everyday (10 host per day). At the end of 2013, there will be more than 1000 hosts in a CloudStack environment.
"In the beginning there was RPM, and it was good." Certainly, Linux packaging has solved many of the problems involved in shipping software, from creation to consumption and maintenance. As software development and deployment have evolved, however, new pain points have cropped up that have not been solved by traditional packaging tools.
Are containers the answer? They may be able to solve many of the current problems, but they also introduce a new set of issues and ignore important lessons from the evolution of distribution-level packaging.
In the beginning there was RPM (and Debian packages) and it was good. Certainly, Linux packaging has solved many problems and pain points for system admins and developers over the years -- but as software development and deployment have evolved, new pain points have cropped up that have not been solved by traditional packaging.
In this talk, Joe Brockmeier will run through some of the problems that admins and developers have run into, and some of the solutions that organizations should be looking at to solve their issues with developing and deploying software. This includes Software Collections, Docker containers, OStree and rpm-ostree, Platform-as-a-Service, and more.
1. Apache CloudStack:
From API to UI
Joe Brockmeier
PPMC Member Apache CloudStack
(Incubating)
jzb@apache.org
Twitter: @jzb | Freenode: jzb
2. What is Apache CloudStack?
• Open
Source
(Apache-‐Licensed)
IaaS
• Community
of
Users
and
Providers
• Wri?en
in
Java*
• Provides
a
Turn-‐Key
“Stack”
for
Running
Public,
Private,
or
Hybrid
Clouds
• Hypervisor
AgnosMc*
• Time-‐Based
Releases
3. In the beginning…
• Started
as
VMOps
Cloud
Stack
(2008)
• Became
Cloud.com
in
2010
• Released
CloudStack
under
GPLv3
–
but
Open
Core
(May
2010)
• Acquired
by
Citrix
(July
2011)
• EnMrely
Open
Source
(August
2011)
4. Going to Apache
• Relicensed
Proposed
to
Apache
(April
3,
2012)
• Accepted
as
an
IncubaMng
Project
(April
16,
2012)
• First
Major
Release,
4.0.0-‐incubaMng
(November
6,
2012)
• First
Minor
Release,
4.0.1-‐incubaMng
(February
12,
2013)
5. Why Apache?
• Known
and
Proven
Governance
Model
• AcMve
Mentoring
of
New
Projects
• 100%
Community-‐Driven
• More
than
3,000
Developers
• Many
Successful
Projects:
Apache
HTTPD,
Tomcat,
Hadoop,
Cassandra,
Lucene,
etc.
6. Apache Process
• 100%
Community-‐Driven
• “If
It
Didn’t
Happen
on
the
Mailing
List…”
• Clear
Governance
(PPMC,
Commi?er,
Contributor,
etc.)
• Community
Over
Code
• Rigorous
A?enMon
to
Licenses
• Can
Seem
BureaucraMc
10. Hypervisor Support
• KVM
• XenServer
• Xen
Cloud
Plaiorm
• VMware
via
vCenter
• Bare
Metal
via
IPMI
11. CloudStack Terminology
• Zone:
Availability
zone,
aka
Regions.
Could
be
worldwide.
Different
data
centers
• Pods:
Racks
or
aisles
in
a
data
center
• Clusters:
Group
of
machines
with
a
common
type
of
Hypervisor
• Host:
A
Single
server
• Primary
Storage:
Shared
storage
across
a
cluster
• Secondary
Storage:
Shared
storage
in
a
single
Zone
12. CloudStack Architecture
Internet
Ø Hypervisor
is
the
basic
unit
of
CloudStack
Management
scale.
Server
Zone
1
Ø Cluster
consists
of
one
ore
more
hosts
of
same
hypervisor
L3 core
Ø All
hosts
in
cluster
have
access
to
shared
(primary)
storage
Pod
1
Access Layer Pod
N
Secondary
Ø Pod
is
one
or
more
clusters,
….
Storage
usually
with
L2
switches.
Cluster
N
Ø Availability
Zone
has
one
or
more
pods,
has
access
to
….
secondary
storage.
Ø One
or
more
zones
represent
Cluster
1
cloud
Host 1
Primary
Storage
Host 2
13. CloudStack Storage
• Primary
Storage:
– Anything
that
can
be
mounted
on
the
node
of
a
cluster.
– Cluster
LVM…iSCSI…
– Holds
disk
images
of
running
VMs
– Support
for
CEPH
with
KVM
hypervisors
• Secondary
Storage:
– Available
across
the
zone
– Holds
snapshots
and
templates
(image
repo)
– Can
use
OpenStack
swim
or
any
object
store
(Gluster
FS…)
– New
support
for
Caringo
• Can
use
NFS
for
both
to
start
• Storage
abstracMon
refactoring
underway
in
4.1.0
and
4.2.0
14. Networking
• Extremely
flexible
to:
– Provide
isolaMon
with
VLANs
– Provide
isolaMon
at
L3
with
shared
L2
(scalability)
– Support
hardware
devices
that
exposes
API
– Deployed
on
exisMng
networking
infrastructure
– Support
new
networking
paradigm
(SDN)
• Support
for
Nicira
Virtual
P
• Extensive
use
of
Open
VSwitch
15. Management Server
• UI/API
bits
are
stateless
(state
is
stored
in
a
MySQL
database)
• All
UI
funcMonality
is
available
as
an
API
call
• Resiul
API
– UnauthenMcated
API
on
8096
for
localhost
(disabled
by
default)
– AuthenMcated
on
port
8080
– Responses
in
XML
or
JSON
16. Highly Scalable
• Up
to
10K
resources
managed
per
management
server
node
• Internal
tesMng
w/somware
simulators
shows
up
to
30K
physical
resources
and
30K
VMs
managed
by
4
management
server
nodes.
• Real
producMon
deployments
of
tens
of
thousands
of
resources
•
See
Alex
Huang’s
presentaMon:
h?p://is.gd/alexh_scale
17. CloudStack Allocation
• How
are
VMs
placed,
storage
allocated,
etc.?
• CloudStack
has
several
defaults
– First
fit
– Fill
first
– Disperse
• Don’t
like
those?
Create
your
own!
• Allows
over-‐provsioning
• OS
Preference
18. High Availability
• RFMTTR
–
“really
fast
mean
Mme
to
recovery.”
• CloudStack
is
not
(alone)
a
magical
HA
soluMon.
• Watches
HA-‐enabled
VMs
to
ensure
they’re
up,
and
that
the
hypervisor
it’s
on
is
up.
Will
restart
on
another
if
the
hypervisor
goes
down.
• Redundant
router.
19. Load Balancing
• Uses
HA
Proxy
• CloudStack
supports
load-‐balancing
for
distribuMng
traffic
to
its
instances
• Choose
between
round-‐robin,
source,
or
least
connecMons
• Choose
sMckiness
policy
(source,
lbcookie,
appcookie)
20. Snapshots
• CloudStack
allows
you
to
take
snapshots
manually
or
set
up
recurring
snapshots.
• Snapshots
can
be
managed
automagically
(keep
N
number)
and
manually
(delete
snapshot
manually).
• Can
be
turned
into
templates
or
volumes
to
be
used
by
other
instances.
22. CloudStack Networking Types
• CloudStack
offers
Basic
and
Advanced
Networking
– Basic:
Easy,
can
only
be
one
physical
network
• Every
host,
system
VM,
and
guest
instance
has
a
unique
IP
– Advanced:
Allows
mulMple
physical
networks
• Each
account
has
a
public
IP,
assigned
to
virtual
router,
guest
IP
range
(e.g.
10.0.1.10/24),
and
VLAN
ID
for
the
isolated
guest
network
• Guests
communicate
via
their
own
dedicated
VLAN
23. CloudStack Networks
• Management
Network:
Used
by
hypervisors
and
management
server
to
communicate
• Private
Network:
Default
network
for
system
VMs
(virtual
router,
secondary
storage
VM,
console
proxy
VM)
• Public
Network:
Public-‐facing
(e.g.
the
Internet)
• Guest
Network:
Network
VMs
are
provisioned
on
• Link-‐local
Network:
Network
used
for
communicaMon
between
hypervisor
and
system
VMs.
(RFC
3927)
24. Security Groups
• TradiMonal
isolaMon
has
been
via
VLAN
• VLANs
provide
isolaMon,
but
at
the
cost
of
scaling
– Standard
limit
is
4,096
VLANs
– Hardware
that
supports
upper
limit
is
expensive
– What
happens
with
4,097?
• Amazon
and
others
use
Layer
3
isolaMon
(Security
Groups)
25. Security Groups
• Assumes
a
quasi-‐trusted
Layer
2
network
• Filtering/isolaMon
happens
at
the
bridge
level
(think
ebtables)
• Deny
by
default
26. Accounts, Domains, and
Projects
• CloudStack
has
a
top-‐level
domain
called
ROOT
• You
can
create
sub-‐domains
• You
can
create
3
types
of
accounts,
admins,
domain-‐admins,
or
users
• Projects
can
be
used
to
hold
resources
for
Mme-‐
limited
projects
• Supports
LDAP
integraMon
• CloudStack’s
account
system
is
very
simple
–
don’t
make
it
more
complicated!
27. Usage Accounting
• Provides
stats
that
can
be
used
for
billing
(but
is
not
a
billing
soluMon)
• Usage
stats
show:
VM
count,
CPU
usage,
disk
allocaMon
and
use,
network
usage
over
Mme.
• IntegraMon
howtos
for
imporMng
to
Excel,
Ubersmith,
Amysta,
and
Cloud
Portal.
28. APIs
• Root
Admin,
Domain
Admin,
User
• Set
of
methods
available
over
HTTP(S)
• AuthenMcated
on
8080
w/Keys
• UnauthenMcated
on
8096
(off
by
default)
• Python
+
Ruby
clients
available
29.
30. AWS EC2 and S3 Compatibility
• Includes
an
EC2/S3
compaMbility
layer
• See:
– h?p://wiki.cloudstack.org/display/RelOps/
EC2+API+support+in+CloudStack
– h?p://www.slideshare.net/sebasMengoasguen/
cloudstack-‐ec2-‐configuraMon
• Euca
Tools,
Boto,
etc.
should
work
with
CloudStack
31. CloudMonkey
• New
ASF
CloudStack
CLI
• Python
code,
built
using
Marvin
• h?ps://cwiki.apache.org/CLOUDSTACK/
cloudstack-‐cloudmonkey-‐cli.html
• Available
from
CloudStack
source
or
pypi:
– h?p://pypi.python.org/pypi/cloudmonkey/
32. Use Cases
• Private
Cloud
• Dual-‐Workload
Private
Cloud
• Public
Cloud
(ISP/Providers)
• Hybrid
Cloud
• Small
to
Very,
Very
Large
33. Zynga
• Online
Games
• Hybrid
Cloud
(Move
workloads
between
“zCloud”
and
public
cloud)
80/20
split
• North
of
30K
Nodes
34. Datapipe
• Public
Cloud
• Geo-‐distributed:
– U.S.
(NJ
San
Jose,
CA)
– Hong
Kong
– Shanghai
– London
– Iceland
(w/in
90
days)
• Smaller
(
100
Hosts)
but
massively
distributed
• See:
h?p://is.gd/datapipe_cs
35. ISWest
• Hosted
IaaS
Clouds
(Private
Environment)
from
Dedicated
Servers
• Most
Customers
are
Small
(
15
VMs)
• Mix
of
Hypervisors
• FuncMoning
Cloud
in
“a
li?le
over
a
month.”
37. DevCloud
• DevCloud
is
a
VirtualBox
image
w/nested
virt.
• Grab
the
DevCloud
image
from:
h?p://wiki.cloudstack.org/display/COMM/DevCloud
• Log
in
via
the
GUI:
h?p://localhost:8080/client
• SSH
to
DevCloud:
ssh -p 2222 root@localhost
Username:
admin
Password:
password
• DevCloud
KVM
–
effort
to
run
DevCloud
on
a
KVM
host
38. CloudStack Runbook
• Minimal
install
(1
server)
• Wri?en
by
David
Nalley
w/fixes
from
the
community
• h?p://people.apache.org/~ke4qqq/runbook/
• Focuses
on
CentOS
w/KVM
–
other
runbooks
in
process
for
Ubuntu
w/Xen
or
KVM.
39. Direction
• Currently
on
a
Four-‐Month
Release
Cycle
• 4.1.0
Expected
Early
April,
4.2.0
in
August
• 4.0.2
“Any
Day
Now”
• Releases
Supported
UnMl
Next
Major
Feature
Release
(e.g.,
4.0.0,
4.0.x
unMl
4.1.0)
• Last
Major
Release
Will
Receive
Support
for
12
Months
(hasn’t
happened
yet)
40. Expected in 4.1.0
• AutoScale:
Work
with
loadbalancers
(like
NetScaler)
to
scale
up/down
resources.
• Resize
Volumes
for
Instances
• OpenVSwitch
Support
for
KVM
• API
Request
Thro?ling
• AWS-‐like
Regions
• Persistent
Networks
without
Running
Instances
41. Get Involved
• Main
Site:
CloudStack.org
• IRC:
#cloudstack
and
#cloudstack-‐dev
• Follow
@cloudstack
on
Twi?er
• Lots
of
Presos:
h?p://slideshare.net/cloudstack
• Mailing
Lists:
h?p://cloudstack.org/discuss/mailing-‐
lists.html