Integrating Systems in the Cloud using Message Queuing
•
0 likes•1,440 views
Integrating Systems in the Cloud using Message Queuing Slides for talk given at EuroCloud Ireland 2010.
Recommended
Recommended
More Related Content
Viewers also liked
Viewers also liked (15)
Recently uploaded
Recently uploaded (20)
Integrating Systems in the Cloud using Message Queuing
- 1. Integrating Systems in the Cloud raphael.cohn@stormmq.com 1
- 2. The Integration Tag Soup WS –File Transfer !"#$%&'(#)#*#+%+ Message Queuing SOAP EMail SMTP FTP RSYNC NTFS !','- !).$%&'/$.0%&1$%+ 234%5)6!%$7%$ SOA Message Orientated Middleware JMS MQ MQSeries AMQP Amazon SQS Tibco StormMQ RabbitMQ HTTP TCP/IP DCE / RPC CORBA DCOM REST RMI XML-RPC .NET Remoting Remote Procedure Call 2
- 3. The Integration Tag Soup WS –File Transfer !"#$%&'(#)#*#+%+ Message QueuingSOAP EMail SMTP FTP RSYNC NTFS !','- !).$%&'/$.0%&1$%+ 234%5)6!%$7%$ SOA Message Orientated Middleware JMS MQ MQSeries AMQP Amazon SQS Tibco StormMQ RabbitMQ HTTP TCP/IP DCE / RPC CORBA DCOM REST RMI XML-RPC .NET Remoting Remote Procedure Call 2
- 4. Under Examination, though File Transfer !"#$%&'(#)#*#+%+ Remote Procedure Call Don’tWork in the Cloud 3
- 5. Under Examination, though Deployment Intimate System Knowledge Configuration Admin File Transfer !"#$%&'(#)#*#+%+ Remote Procedure Call Don’tWork in the Cloud Scaling 3
- 6. Ideal: Message Queuing Systems are “loosely-coupled” Message Queuing Systems don’t know each other 4
- 7. Why Use it: Loose Coupling Billing Catalogue Shipping S-a-a-S Inventory How do we connect them, without one outage or system change taking everything down like a pack of cards? 5
- 8. Why Use it: Loose Coupling Billing Catalogue Shipping S-a-a-S Inventory How do we connect them, without one outage or system change taking everything down like a pack of cards? Message Queuing lets Systems and Components exchange data, events, commands and actions with one another with no explicit knowledge or need for them to be online 5
- 9. It should be ideal for the cloud 6
- 10. It should be ideal for the cloud 6
- 11. ! ! ! Until today, messaging is … (ZeroMQ) (SQS uses HTTP) (MSMQ uses COM) (memcached) (Java JMS uses Source) (MQSeries / WebsphereMQ) (Talarian, Rendezvous, etc) Platform Restricted BespokeProprietary 7
- 12. ! ! ! Until today, messaging is … (ZeroMQ) (SQS uses HTTP) (MSMQ uses COM) (memcached) (Java JMS uses Source) (MQSeries / WebsphereMQ) (Talarian, Rendezvous, etc) 7
- 13. However, there’s a solution 8
- 14. A-MQPAdvanced Message Queue Protocol However, there’s a solution 8
- 15. AMQP is Open and Neutral A common wire-level binary format and protocol An explicit definition of a server (aka broker)’s semantics Open Means Interoperable “AMQP will be to Messaging what HTTP was to theWeb” 9
- 16. That is good … “And it works perfectly in the cloud” MRG Clients run on any Platform Vendors are Interoperable 10
- 17. That is good … “And it works perfectly in the cloud” MRG Clients run on any Platform Vendors are Interoperable 64K 10
- 18. From Anywhere to Anywhere 11
- 19. From Anywhere to Anywhere 11
- 20. From Anywhere to Anywhere 11
- 21. From Anywhere to Anywhere 11
- 22. From Anywhere to Anywhere 11
- 24. Instant Cloud Architecture Cloud Service Managed Service On-Site Service No-Lock™ Option Locate-It™ Option Real SLA 12
- 25. Instant Cloud Architecture Self-Configure: REST API Cloud Service Managed Service On-Site Service No-Lock™ Option Locate-It™ Option Real SLA Any Programming Language Secure by Default Isolated Environments 12
- 26. Store and Forward Billing “Could you send me a duplicate of my bill please” REST 14
- 27. Store and Forward Billing “Could you send me a duplicate of my bill please” REST ! 14
- 28. Store and Forward Billing “Could you send me a duplicate of my bill please” REST StormMQ Messaging Billing ! 14
- 29. Store and Forward Billing “Could you send me a duplicate of my bill please” REST StormMQ Messaging Billing ! ! 14
- 30. Store and Forward Billing “Could you send me a duplicate of my bill please” REST StormMQ Messaging Billing ! 14
- 31. Fire and Forget Shipping “Too many orders.The website is running like a dog.” SQL Push SQL Pull 15
- 32. Fire and Forget Shipping “Too many orders.The website is running like a dog.” SQL Push SQL Pull StormMQ Messaging Shipping 15
- 33. One-To-Many “There’s a new widget in the Catalogue: Tell all the systems.” Catalogue Shipping S-a-a-S Inventory File Transfer ETL 16
- 34. One-To-Many “There’s a new widget in the Catalogue: Tell all the systems.” Catalogue Shipping S-a-a-S Inventory StormMQ Messaging 16
- 35. Publish-Subscribe (“Topics”) “Shipments Sent, Delivered and Returned” Shipping S-a-a-S Inventory Billing AnySent Sent or Returned 17
- 36. StormMQ Messaging Publish-Subscribe (“Topics”) “Shipments Sent, Delivered and Returned” Shipping S-a-a-S Inventory Billing AnySent Sent or Returned 17
- 37. Round-Robin Billing “How do we easily scale a massive batch job like Billing?” EMail BillGenerate 18
- 38. StormMQ Messaging Round-Robin Billing “How do we easily scale a massive batch job like Billing?” EMail BillGenerate 18
- 39. Integrating Systems in the Cloud raphael.cohn@stormmq.com 19
- 40. A History of Messaging Manual Telegraphy Machine Assisted Telegraphy 1920s1911 - 192019th Century 1900s Telegrams sent using “Store and Forward” 1900 1930s 22
- 41. A History of Messaging Electronic Telegraphy 1950s1940s1950s1940s Electronic Telegram Machines, eg Plan 55-A 1948 IBM M ne Assisted Telegraphy 1920s1920 1930s 22
- 42. A History of Messaging Telcos UseElectronic Telegraphy 1950s1940s 1960s IBM System/360 with BTAM & QTAM Message Switching 1964 First Electronic Mail Solutions 1965 Banking Users 1970s IBM TCAM which is the first true solution Retired 1990! 1971 22
- 43. A History of Messaging l Financial Trading UsersBanking Users FMCG & Utilities 1980s 1990s Growth of SMTP Origins of Tibco in Stock Price Messaging 1980s IBM Launch MQSeries (now WebsphereMQ) 1992 1970s IBM TCAM which is the first true solution Retired 1990! 1971 22
- 44. A History of Messaging l FMCG & Utilities 1990s MQSeries phereMQ) 92 Corporates Large Websites YOU Noughties Today Sun Release Java JMS, Reinvigorating Enterprise Messaging 2001 AMQP Working Group Formed by Investment Banks 2006 Cloud Enables and Drives StormMQ Adoption 2009 22
- 45. Jargon Buster: Messaging EMail (SMTP, POP3, IMAP) VoIP (VoiceMail, XMPP) Texting (SMS) Instant Messaging (ICQ, MSN, Jabber) Twitter Enterprise Service Bus (ESB) Dynamic OO Languages (eg Ruby) Message Queuing (MQ) Message Queuing (MQ) What do we mean by Messaging? 23
- 46. Essential Terms Message Queue What’s a Message? Envelope Payload Header 24