Downloaded 18 times
![#JSS2014
•Receive from partitions via consumer groups
•Client-sidecursorsallowingtofreelyprocessandrepeatedlyreprocesstheavailableretainedeventstreambasedonoffsetsortimestamps.
•Using.NETAPIorusinggenericAMQP1.0client(e.g.ApacheProton-C/J)
ID, Time, [Data]
ID, Time, [Data]
ID, Time, [Data]
Time
Id
Event HubConsumers](https://image.slidesharecdn.com/slideguss2014-eventshub-v01-141203092249-conversion-gate02/85/Futur-de-l-integration-BizTalk-Server-26-320.jpg)
Uploaded byMichel HUBERT
Futur de l'intégration - BizTalk Server
This document summarizes a presentation on the future of integration technologies. It discusses how integration has evolved from point-to-point connections to enterprise service buses. It then focuses on integration solutions oriented toward cloud computing and events/IoT. For cloud solutions, it describes how BizTalk Server can be used with Azure services. For events/IoT, it explains how Azure Event Hubs, Service Bus and Stream Analytics can be used to collect, process and analyze streaming data sources. The presentation includes a demo of using these technologies for real-time e-commerce click stream analysis.
More Related Content
Similar to Futur de l'intégration - BizTalk Server
Futur de l'intégration - BizTalk Server
- 1. #JSS2014 Les journées SQL Server 2014 Un événement organisé par GUSS
- 2. #JSS2014 Les journées SQL Server 2014 Un événement organisé par GUSS Session «Le futur de l’intégration» Michel Hubert –MVP Azure Radoine Douhou
- 3. #JSS2014 •Etat deslieux. •Futur de l’intégration. •Solutions d’intégration orientées Cloud. •Solutions d’intégration orientées Events & IoT. •Démo. Agenda
- 4. #JSS2014 Evolution ofIntegrationOnce upon a Time Point to point (“Spaghetti”) Integration broker (EAI/B2B) Enterprise Service Bus HR CRM E-commerce ERP Business partner HR CRM E-commerce ERP Business partner HR CRM E-commerce ERP
- 5. #JSS2014 BizTalk Server Partners Evolution of IntegrationMicrosoft BizTalk Server
- 6. #JSS2014 BizTalk Server ESB toolkit e-Commerce Suppliers EDI EDIFACT / AS2 WS RESTFul Marketplace warehouse Magasins SI Back Office Orchestration B2B BI SSIS SSRS SSAS Microsoft BizTalk ServerCommon scenario
- 7. #JSS2014 FUTURDE L’INTEGRATION Nouveaux usages
- 8. #JSS2014 Point topoint (“Spaghetti”) Integration broker (EAI/B2B) Enterprise Service Bus What’s next? ? HR CRM E-commerce ERP Business partner HR CRM E-commerce ERP Business partner HR CRM E-commerce ERP Future of IntegrationWhat’s next ?
- 9. #JSS2014 Future ofIntegration Mobiles Events Messaging EAI/ESB Business Process Automation Telemetry Analytics BizTalk Server BizTalk Services Service Bus Queuing Events Hub Stream Analytics Hybrid Connection B2B Future of IntegrationIntegration = Cloud + Mobile + IoT IoT SaaS
- 10. #JSS2014 SOLUTIONS D’INTEGRATIONORIENTEESCLOUD BizTalk Server / BizTalk Services
- 11. #JSS2014 Upgrade toBizTalk Server 2013 R2 with confidence Accelerate vertical solutions with standards and platform support Extend existing solutions to Azure Service Bus Adapters RESTFul/JsonAdapter BizTalk Server 2013 R2Cloud Ready
- 12. #JSS2014 BizTalk Server Microsoft Azure Partners BizTalk Services Service Bus Future of IntegrationFederated Enterprise Service Bus
- 13. #JSS2014 Upgrade toBizTalk Server 2013 R2 with confidence Accelerate vertical solutions with standards and platform support Extend existing solutions to Azure Develop and test integration solutions in the cloud without re- writes Clear up on-premises infrastructure capacity and provision in minutes instead of weeks Service Bus Adapters RESTFul/JsonAdapter BizTalk Server 2013 Virtual Machines BizTalk Server 2013 R2Cloud Ready
- 14. #JSS2014 App ownerDatacenter admin Customer data center Microsoft Azure data center LOB app Active Directory BizTalk LOB app SQL Agility for app owners Control for IT pros BizTalk Server 2013 R2 Develop in Azure
- 15. #JSS2014 Upgrade toBizTalk Server 2013 R2 with confidence Accelerate vertical solutions with standards and platform support Extend existing solutions to Azure Develop and test integration solutions in the cloud without re- writes Clear up on-premises infrastructure capacity and provision in minutes instead of weeks Enable hybrid extension of current on-premises BizTalk Server deployments with Azure BizTalk Services Power new cloud-hosted business- to-business, Internet of Things, and EDI capabilities Service Bus Adapters RESTFul/JsonAdapter BizTalk Server 2013 Virtual Machines Microsoft Azure BizTalk Services BizTalk Server 2013 R2Cloud Ready
- 16. #JSS2014 Microsoft AzureBizTalk Services (MABS)
- 17. #JSS2014 Equivalent toBizTalk ESB itinerary Transforms Enrich Validation XML and xsd schema MABSBridge principle
- 18. #JSS2014 Hybrid Connections Web Sites Mobile Services Corporate network Microsoft SQL Server Hybrid Connection Other published resources Hybrid Connection Manager
- 19. #JSS2014 Use Cases Microsoft Azure On-premises AS2 SFTP HTTP ? ! Home office Branch office Regional office
- 20. #JSS2014 SOLUTIONS D’INTEGRATIONORIENTEESEVENTS/ IOT Service Bus, Event Hub, Stream Analytics
- 21. #JSS2014 Azure ServiceBus Relay Queue Topic Notification Hub Event Hub NATandFirewallTraversalServiceRequest/ResponseServicesUnbufferedwithTCPThrottling Many publishers and many consumers to communicate over a FIFO like channel. (Competing consumers and Queue-based Load leveling scenarios) Pub / Sub communication channel. Each Consumer subscribes to a copy of message High-scale notification distribution Most mobile push notification services Millionsof notification targets Azure Service BusCloud Messaging Broker
- 22. #JSS2014 Service BusEvents Hub Event Producers Azure Event Hub > 1M Producers> 1GB/sec Aggregate Throughput Up to 32 partitions via portal, more on request Partitions Direct PartitionKey Hash Throughput Units: •1 ≤ TUs ≤ Partition Count •TU: 1 MB/s writes, 2 MB/s reads Consumer Group(s) Receivers AMQP 1.0 Credit-based flow control Client-side cursors Offset by Id or Timestamp
- 23. #JSS2014 Event Producers > 1M Producers> 1GB/sec Aggregate Throughput Direct PartitionKey Hash •Consistent security model with Service Bus, extended by publisher policies •Publisher protocols : –HTTPS : Short lived, low throughput : –AMQP : Long lived, High throughput : •Publish modes : –Directelyto a PartitionId. –Automatic hash-based distribution by PartitionKeyor Publisher Identity •Stream or batch Event HubProducers
- 24. #JSS2014 •1Partition:orderedsequenceofeventsthatisheld.Apartitioncanbethoughtofasa“commitlog.” •Segmentationof the event stream for scale-out : –Parallelism on both Publishing and Polling sides. •Default 16, minimum 8, self-service maximum 32 : –1024 partitions via Azure Support. Azure Event Hub Partitions Event HubPartition principle
- 25. #JSS2014 •view(state,position,oroffset)ofanentireEventHub •Publish/subscribemechanismofEventHubsisenabledthroughconsumergroups. •Enablemultipleconsumingapplicationstoeachhaveaseparateviewoftheeventstream,andtoreadthestreamindependentlyatitsownpaceandwithitsownoffsets Consumer Group(s) Event HubConsumer Group
- 26. #JSS2014 •Receive frompartitions via consumer groups •Client-sidecursorsallowingtofreelyprocessandrepeatedlyreprocesstheavailableretainedeventstreambasedonoffsetsortimestamps. •Using.NETAPIorusinggenericAMQP1.0client(e.g.ApacheProton-C/J) ID, Time, [Data] ID, Time, [Data] ID, Time, [Data] Time Id Event HubConsumers
- 27. #JSS2014 Stream Analytics Data Source Collect Process Consume Deliver Event Inputs -Event Hub -Azure Blob Transform -Temporal joins -Filter -Aggregates -Projections -Windows -Etc. Enrich Correlate Outputs -SQL Azure -Azure Blobs -Event Hub ☁ BI Dashboards Predictive Analytics Azure Storage •Temporal Semantics •Guaranteed delivery •Guaranteed up time Azure Stream Analytics Reference Data -Azure Blob
- 28. #JSS2014 •Easily filter,project, aggregate, join streams, add static data with streaming data, detect patterns or lack of patterns with a few lines of SQL •Development and debugging experience through Azure Portal •Built-in monitoring trough Azure Portal •No hardware acquisition andmaintenance •Up and running in a few clicks (and within minutes) => Bypasses deployment expertise •Elasticity of Azure for scaleup or scale down •Distributed, scale-out architecture •Integrated with highly- scalable publish- subscriber Events Hub. •Transform, augment, correlate, temporal operations. •Detectpatterns andanomalies in streaming data •Correlate streaming with reference data Stream AnalyticsValue added
- 29. #JSS2014 CLICK STREAMANALYSIS
- 30. #JSS2014 Demo architecture e-Commerce web site Log file Events Producer ETW Azure Event Hub Stream Analytics Tumbling window Collect Transform SQL Azure Deliver Power View Real Time analysis AMQP Client
- 31. #JSS2014 Merci ànos sponsors
- 32. #JSS2014 #JSS2014 Lesévaluations des sessions, c’est important !! …Et en plus on peut gagner des cadeaux
- 33.
- 34.