Messaging patterns in the cloud

itcampro@ itcamp13# Premium conference on Microsoft technologies
Messaging Patterns in the
Cloud
Radu Vunvulea
iQuest Group
@RaduVunvulea
http://vunvulearadu.blogspot.com

Private &
Public CloudHuge thanks to our sponsors!

Private &
Public Cloud
• World of Messages
• On-Premise and Cloud solutions
• Messaging Patterns
• Costs, Benefits and Limitations
Agenda

WORLD OF MESSAGES

Private &
Public CloudWorld of Messages

Private &
Public CloudWorld of Messages
Message
Message
Message

Private &
Public CloudEnterprise Service Bus

Private &
Interaction and communication between
software applications

Private &
Topic
Subscriptions

ON-PREMISE AND CLOUD
SOLUTIONS

Private &
Public Cloud
• Pro
– Open Source
– Flexible
– Good price
– Transactional queue read/write
– Flexible load distribution
• Cons
– No queue management
– Document not up to date
– Only one queue technology supported (MSMQ)
NService Bus

Private &
Public Cloud
• Pro
– Free for commercial use
– Supports MSMQ and RabittMQ
– Open Source
– Good administration console
• Cons
– No commercial support
– Not as fast as NServiceBus
MassTransit

Private &
Public Cloud
• Pro
– Scalable
– Lots of features
– Good administration console
– Support
– Cross platform and multiple environments
• Cons
– Is not free
– Latency
Azure Service Bus

MESSAGING PATTERNS

Private &
Public CloudMessage Filter

Private &
Public CloudMessage Filter
Topic
Subscriptions

Private &
Public Cloud
• Custom rules based on message attributes
• Add attributes to message
Message Filter
BrokeredMessage msg = new BrokeredMessage(messageContent);
msg.Properties["colorCode"] = 1;
• Create subscription with custom rule
RuleDescription rule = new RuleDescription()
{
// 1 - green, 2 - orange
Filter = new SqlFilter("colorCode = 1");
}
namespaceManager.CreateSubscription(
"itcamp", "greensubscription", rule);

Private &
Public CloudMessage Splitter

Private &
Public CloudMessage Splitter
Topic
Subscriptions

Private &
Public Cloud
• Group messages based on session
Message Splitter
MessageSession msgSession =
msgReceiver.AcceptMessageSession();
BrokeredMessage message;
while ((message = msgSession.Receive()) != null)
{
// Process message
}
msgSession.Complete()
BrokeredMessage message = new BrokereMessage(content);
message.SessionId = "sessionId";
• Consume messages based on session id

Private &
Public CloudMessage Aggregator

Private &
Public CloudMessage Aggregator
Topic
Subscriptions

Private &
Public Cloud
• Group messages based on session
Message Aggregator
message.SessionId = "sessionId";
• Use correlation id and filters
BrokereMessage message = new BrokereMessage(content);
message.CorrelationId = “CJ"
topic.Send(message);
namespaceManager.CreateSubscription(
“itcamp”,
“iquestsubscriptioncar”,
new CorrelationFilterExpression(“CJ"));

Private &
Public CloudMessage Resequencer

Private &
Topic
Subscriptions
1
2
3
4
1
2
3
4
1234

Private &
Topic
Subscriptions
1
2
3
4
1
2
3
4
3412

Private &
Public Cloud
• Session, message index and message count
Message Resequencer
• Mark message as dead letter when in
incorrect order
• Iterate dead letter queue to access a
message with a lower index
message.Properties["index"] = 2;
message.Properties["count"] = 10
message.SessionId = “CJ-15-IQU";

Private &
MessageSession messageSession =
queueClient.AcceptMessageSession();
int currentIndex = 1;
while(true)
{
BrokeredMessage message = messageSession.Receive();
if(int.Parse(message.Properties[“index”]) != currentIndex)
{
message.DeadLetter();
continue;
}
…
message.Complete();
if(int.Parse(messsage[“count”]) == currentIndex)
{
break;
}
currentIndex++;
}

Private &
Public CloudMessage Recipient
Topic
Subscriptions

Private &
Public Cloud
• Use a property to specific the list of groups
Message Recipient
• Define custom filters using LIKE operator
BrokeredMessage message = new BrokeredMessage(content);
message.Properties[“groups”] = “orange magenta”;
SqlFilter filter = new SqlFilter(
“groups LIKE „%orange%‟”);
topic.AddSubscription(“subscription3”, filter);
• OR different properties for each group type
“EXISTS orange”);

Private &
Public Cloud
• Use a property to specific the list of groups
Message Recipient
• Define custom filters using LIKE operator
BrokeredMessage message = new BrokeredMessage(content);
message.Properties[“groups”] = “orange magenta”;
“groups LIKE „%orange%‟”);
• OR different properties for each group type
• Use only one property and a prime number
for each group

Private &
Public CloudContent-Based Router
Topic
Subscriptions

Private &
Public CloudScatter-Gather
Topic
Subscriptions
Queue

Private &
Public CloudDynamic Router
Topic
Subscriptions

Private &
Public Cloud
• [key, values] properties
• Store properties
• Decorate properties
Dynamic Router

COSTS, BENEFITS AND
LIMITATIONS

Private &
Public Cloud
• What are the costs of processing:
– 24kB message size
– 10M messages
– 1 Topic
- 8 hours
Costs

Private &
Public Cloud
• 10$ Sending
• 27.46$ Bandwidth (sending)
Costs

Private &
Public Cloud
• 10$ Sending
• 10 $ Receiving
• 0 $ Bandwidth (receiving)
Costs

Private &
Public Cloud
• 10$ Sending
• 10 $ Receiving
• 47.46$ Costs related to Service Bus
Costs

Private &
Public Cloud
• 10$ Sending
• 10 $ Receiving
• 47.46$ Costs related to Service Bus
• 8.64$ 4 Medium Worker Roles used to
consume messages
• 56.1$ Total cost
Costs

Private &
Public Cloud
• Cheap
• 99.9% Uptime
• Extremely scalable and flexible
• No message is lost
• Filters and actions support
• REST API
• Death-letter and transaction support
• Same API for on-premise and cloud
Benefits

Private &
Public Cloud
• Not for real-time application
• When processing more than 1M messages
on the same topic in a 30 minutes time
interval latency increases
• You need to pay for each send/receive
command
• Batch maximum size – 100 messages
Limitations

Q & A

THANK YOU

Messaging patterns in the cloud

Recommended

Recommended

More Related Content

Similar to Messaging patterns in the cloud

Similar to Messaging patterns in the cloud (20)

Recently uploaded

Recently uploaded (20)

Messaging patterns in the cloud