Use cases for cloud messaging

8,983 views

Published on

RabbitMQ is a complete and highly reliable enterprise messaging system based on the emerging AMQP standard. It is licensed under the open source Mozilla Public License and has a platform-neutral distribution, plus platform-specific packages and bundles for easy installation.

In this talk, Alexis talks on use cases for cloud messaging.What is messaging and why it is useful for cloud computing? This talk will answer these questions by way of illustrating use cases from RabbitMQ customers.

Published in: Technology
2 Comments
20 Likes
Statistics
Notes
No Downloads
Views
Total views
8,983
On SlideShare
0
From Embeds
0
Number of Embeds
2,446
Actions
Shares
0
Downloads
281
Comments
2
Likes
20
Embeds 0
No embeds

No notes for slide

Use cases for cloud messaging

  1. 1. RabbitMQ
at
Skills
Ma-er
Cloud
Exchange Cloud
Messaging
Use
Cases April
2010 Alexis
Richardson VMware
Inc. copyright (c) VMware Inc. Friday, 23 April 2010
  2. 2. Thank you! RabbitMQ
is
a
messaging
server
that
just
works Im in yr serverz, queueing yr messagez Photo credit: http://flickr.com/photos/53366513@N00/67046506/ copyright (c) VMware Inc. Friday, 23 April 2010
  3. 3. We
es7mate
300‐500
or
more
in
produc7on,
>20K
in
dev copyright (c) VMware Inc. Friday, 23 April 2010
  4. 4. Using
RabbitMQ
is
easy RabbitMQ
integrated
with
more
 Rabbit
distributed
by
most
Linux
type
plaForms than
100
developer
plaForms RabbitMQ.NET
and
MicrosoO
IVA
partnership We
offer
packages
for
many
other
OS
plaForms copyright (c) VMware Inc. Friday, 23 April 2010
  5. 5. Using
RabbitMQ
is
easy RabbitMQ
integrated
with
more
 Rabbit
distributed
by
most
Linux
type
plaForms than
100
developer
plaForms RabbitMQ.NET
and
MicrosoO
IVA
partnership We
offer
packages
for
many
other
OS
plaForms Cloud
messaging
is
the
future 45 5 Friday, 23 April 2010
  6. 6. Cloud
has
re‐energised
IT copyright (c) VMware Inc. Friday, 23 April 2010
  7. 7. Cloud
maIers
because
we
operate
at
real
7me
on
a
global
scale Mobile, video, presence, live streams - anywhere, anytime How to deliver this without lock-in to any one platform or location? Massive amounts of data everywhere and changing all the time Security, privacy, consistency of customer experience eg latency, relevance Cloud Messaging matters! copyright (c) VMware Inc. Friday, 23 April 2010
  8. 8. http://railsdog.com/blog/2009/12/generating-pdfs-on-ec2-with-ruby/ copyright (c) VMware Inc. Friday, 23 April 2010
  9. 9. http://railsdog.com/blog/2009/12/generating-pdfs-on-ec2-with-ruby/ 9 Friday, 23 April 2010
  10. 10. Cloud
+
Queues
makes
it
easy
to
manage
an
ARMY
of
worker
bots
 copyright (c) VMware Inc. Friday, 23 April 2010
  11. 11. We
also
care
about
SCALE
... copyright (c) VMware Inc. Friday, 23 April 2010
  12. 12. We
also
care
about
SCALE
...
when
we
cannot
predict
demand copyright (c) VMware Inc. Friday, 23 April 2010
  13. 13. Cloud
applica7ons
are
component
based
and
need
intra‐app
messaging
to
scale See more here: http://aws.typepad.com/aws/2008/12/running-everything-on-aws-soocialcom.html copyright (c) VMware Inc. Friday, 23 April 2010
  14. 14. Inter‐cloud
applica7ons
use
inter‐applica7on
messaging
to
route
and
deliver
data
 West
 NE
Europe Europe data
centre data
centre Southern
 Europe data
centre ! copyright (c) VMware Inc. Friday, 23 April 2010
  15. 15. Inter‐cloud
“secure
network
overlay”
‐
uses
RabbitMQ
under
the
covers See http://www.cohesiveft.com/vpncubed/ copyright (c) VMware Inc. Friday, 23 April 2010
  16. 16. PUBSUB
at
massive
scale:
“TwiIer
for
Data
in
the
Cloud” Service.DomainName Region Virtual IP Cloud IPs DMAC See: http://www.oceanobservatories.org/spaces/display/CIDev/Home Friday, 23 April 2010
  17. 17. Pubsub?

wZ? copyright (c) VMware Inc. Friday, 23 April 2010
  18. 18. At scale, coping with changing data can be a problem copyright (c) VMware Inc. Friday, 23 April 2010
  19. 19. Social
applica7ons
store
data 19 copyright (c) VMware Inc. Friday, 23 April 2010
  20. 20. Social
applica7ons
store
data And thereʼs terabytes of it 20 copyright (c) VMware Inc. Friday, 23 April 2010
  21. 21. Social
applica7ons
store
data And thereʼs terabytes of it And itʼs in the cloud 21 copyright (c) VMware Inc. Friday, 23 April 2010
  22. 22. Tell me when THIS changes copyright (c) VMware Inc. Friday, 23 April 2010
  23. 23. Pubsub
wins
because
Polling
Sucks
...
“Are
we
there
yet?”,
“Are
we
there
yet?”,
.. Pubsubhubbub provides web pubsub Pubsub Hubs are Cloud Messaging Technology Check out RabbitHub on github for more info/code Check out the Google teamʼs video at http://www.youtube.com/watch?v=B5kHx0rGkec copyright (c) VMware Inc. Friday, 23 April 2010
  24. 24. Monitoring
done
wrong copyright (c) VMware Inc. Friday, 23 April 2010
  25. 25. Monitoring
done
right copyright (c) VMware Inc. Friday, 23 April 2010
  26. 26. Monitoring
done
right See: Ben Hyde’s post at http://enthusiasm.cozy.org/archives/2009/02/listening-to-the-system copyright (c) VMware Inc. Friday, 23 April 2010
  27. 27. Monitoring
done
right 27 copyright (c) VMware Inc. Friday, 23 April 2010
  28. 28. Monitoring
done
right Lots more event processing goodness here: http://blog.cloudeventprocessing.com/ 28 copyright (c) VMware Inc. Friday, 23 April 2010
  29. 29. Pubsub
gets
you
Monitoring
‐
and
if
you
add
Queues
you
get
Logging 29 copyright (c) VMware Inc. Friday, 23 April 2010
  30. 30. Recording
informa7on
is
of
fundamental
human
value copyright (c) VMware Inc. Friday, 23 April 2010
  31. 31. So
what
is
messaging? messaging
is
‘data
in
moSon’
and
it
is
really
important and
‘the
move
to
cloud
compuSng’
will
put
messaging
everywhere Messages Pubsub Queues Log Storage copyright (c) VMware Inc. Friday, 23 April 2010
  32. 32. There
are
LOTS
of
cloud
messaging
technologies! Email, Chat, Comet, BOSH, .. SMS, Twitter, .. SMTP, HTTP, XMPP, AMQP Messages Trading, Cash transfer Routing, transforming, alerting AMQP, HTTP PSHB, XMPP Pubsub eg SNS, ESBs and Esper CEP Buffering, caching, filtering AMQP, (XMPP) Queues eg SQS, Redis Archiving + search AMQP, NoSQL, SQL Log Storage eg Riak, Cassandra copyright (c) VMware Inc. Friday, 23 April 2010
  33. 33. Thank you! ...
and
RabbitMQ’s
goal
is
to
make
all
of
this
really
simple Email, Chat, Comet, BOSH, .. SMS, Twitter, .. SMTP, HTTP, XMPP, AMQP Messages Trading, Cash transfer Routing, transforming, alerting AMQP, HTTP PSHB, XMPP Pubsub eg SNS, ESBs and Esper CEP Buffering, caching, filtering AMQP, (XMPP) Queues eg SQS, Redis Im in yr serverz, AMQP, NoSQL, SQL Log Storage Archiving + search eg Riak, Cassandra queueing yr messagez Photo credit: http://flickr.com/photos/53366513@N00/67046506/ copyright (c) VMware Inc. Friday, 23 April 2010
  34. 34. RabbitMQ
 Towards
a
PLATFORM
for
Cloud
Messaging copyright (c) VMware Inc. Friday, 23 April 2010
  35. 35. If
cloud
requires
a
Cloud
OS,
then
is
messaging
the
Cloud
Bus? copyright (c) VMware Inc. Friday, 23 April 2010
  36. 36. For
Infra,
yes.

Many
clouds,
eg
NASA
Nebula,
have
a
RabbitMQ
cloud
bus: Use
cases:
Inter‐VM
chaIer And
lots
of
Management:
 Request
capacity Start
100
VMs.

Shut
them
down. “I
am
overloaded” “Find
me
‐
who
am
I?” “Move
me”
 “Back
me
up” Scale
back
capacity copyright (c) VMware Inc. Friday, 23 April 2010
  37. 37. That’s
great
but
we
also
need
a
PLATFORM
if
we
are
to
deploy
and
run
apps SaaS cloud applications PaaS eg RabbitMQ on Heroku IaaS eg Rabbit at NASA copyright (c) VMware Inc. Friday, 23 April 2010
  38. 38. PlaZorm
as
a
service
example:
Heroku! SaaS cloud applications PaaS eg RabbitMQ on Heroku IaaS eg Rabbit at NASA copyright (c) VMware Inc. Friday, 23 April 2010
  39. 39. Conceptually:
a
plaZorm
represents
freedom
from
complexity App App App IaaS infra is hidden Scalable
cloud
bus
‐
run
as
many
as
you
like (Rabbit
is
open
source
and
can
run
on
any
 cloud
as
its
‘central
nervous
system’) copyright (c) VMware Inc. Friday, 23 April 2010
  40. 40. Pubsub
is
made
simple
‐
like
apps
twee7ng
at
each
other! App App App “hey” “hey” “hey” copyright (c) VMware Inc. Friday, 23 April 2010
  41. 41. Queues
are
easy
too App App App “hey” “hey” copyright (c) VMware Inc. Friday, 23 April 2010
  42. 42. Queues
are
easy
too App App App App “hey” copyright (c) VMware Inc. Friday, 23 April 2010
  43. 43. By
being
100%
open
‐
we
can
also
do
intercloud
just
as
simply! Intra-App Intra-Cloud Inter-Cloud Rabbit Cloud Rabbit Cloud Rabbit Cross-cloud PaaS Service Service Services Rabbit inside the RabbitMQ as infra: Federated IaaS Cloud VM “Cloud Bus” RabbitMQ copyright (c) VMware Inc. Friday, 23 April 2010
  44. 44. To
bridge
private
and
public
clouds,
open
source
and
open
standards
are
best SAY NO TO CLOUD LOCK IN 44 copyright (c) VMware Inc. (CC) Giara @flickr.com Friday, 23 April 2010
  45. 45. Summary
‐
clouds
break
the
link
between
applica7on
and
loca7on Can’t predict where apps and VMs are running Can’t predict scale Design for DATA IN MOTION In motion VMs need PUBSUB and ROUTING like with cell phones VMs suspended or offline need QUEUES Messaging lets you ‘dial up’ VMs and broadcast changes safely copyright (c) VMware Inc. Friday, 23 April 2010
  46. 46. Solu7on
‐
RabbitMQ
is
the
open
cloud
messaging
plaZorm Fantastic community support for messaging intra app Language neutral open protocols for messaging inter app Federation - bridge private and public ‘intercloud’ Cloud Bus for IaaS Messaging PaaS copyright (c) VMware Inc. Friday, 23 April 2010
  47. 47. Solu7on
‐
RabbitMQ
as
an
open
cloud
messaging
plaZorm We’ll manage messaging for you Scalable, easy to use Completely portable - no lock in Pre-provisoned - zero install, pay as you go, self-service Latency is low: Application logic and data are CO-LOCATED WIN copyright (c) VMware Inc. Friday, 23 April 2010
  48. 48. Rich
Wolski,
CTO
and
Founder,
Eucalyptus “pre-y
much
everything
you
own
is
going
to
be
trying
to
send
you
data” Stefan
Norberg,
Chief
Architect,
Unibet “If
you
remove
the
need
to
invest
in
infrastructure,
the
need
to
train
people
 on
the
operaSonal
aspects
and
then
get
excellent
scalability
and
low
latency
 guaranteed
by
contract,
I’d
buy
it
in
a
second.
Who
will
provide
me
with
the
 Real
Time
Web
as
a
service?” copyright (c) VMware Inc. Friday, 23 April 2010
  49. 49. Thank‐you Email:
alexis@rabbitmq.com Get
started:
h-p://www.rabbitmq.com/how.html copyright (c) VMware Inc. Friday, 23 April 2010

×