Latest Updates to Azure Integration Services
•Download as PPTX, PDF•
0 likes•75 views
The document summarizes several updates to Azure services announced at Ignite in November 2021, including: 1) Logic Apps updates like performance improvements, deployment slots, and additional connectors in preview or general availability. 2) API Management updates like GraphQL and Event Grid integration in general availability and WebSocket API support. 3) Event Hubs updates such as the general availability of the Premium tier and Schema Registry, as well as messaging tier comparisons. 4) Service Bus updates including large message support of up to 100MB in general availability and messaging unit configuration.
More Related Content
What's hot
What's hot (20)
Similar to Latest Updates to Azure Integration Services
Similar to Latest Updates to Azure Integration Services (20)
More from Daniel Toomey
More from Daniel Toomey (20)
Recently uploaded
Recently uploaded (20)
Latest Updates to Azure Integration Services
- 1. Azure Integration Updates Ignite – Nov 2021 Dan Toomey
- 2. • Gartner – Magic Quadrant (2016-2021) • Forrester – Wave (2021) AIS is a leader in EiPaaS
- 3. Logic Apps
- 4. SQL Storage Provider • Public preview • Portable storage for Arc Logic Apps! What’s new in Logic Apps
- 5. Designer Enhancements • Canvas & line rendering improvements • Performance boosts What’s new in Logic Apps
- 6. Replication Tasks • Public preview • Replication templates to & from SB and EH to ensure business continuity • Replicates actual messages/events What’s new in Logic Apps
- 7. • Consumption to Standard upgrade tool • Runtime performance improvements • AAD-auth for request trigger • Deployment slots • API Management integration • GitHub Action & Azure DevOps Tasks • Workflow/connection CLI What’s coming
- 9. Additional Connectors in LA Standard • SFTP • Cosmos DB • Service Bus • Flatfile Encode/Decode What’s new in Connectors
- 10. Managed Identity • MSI for multi-auth connectors, e.g. SQL and Azure Blob (LA Consumption) • MSI for Azure connectors (LA Standard) • Option: System vs. User Assigned What’s new in Connectors
- 11. • AAD/MSI for Service Bus/Event Hub connectors • MSI support for User Identity (Standard) • XSLT 2.0/3.0 private preview • SWIFT private preview • ODBC connector • More SQL actions Coming soon!
- 12. API Management
- 13. Web Sockets now GA • Can manage, protect, observe & expose WebSocket APIs • Can secure WebSocket APIs via control policies What’s new in API Management
- 14. GraphQL Public Preview • Add and secure a GraphQL service as APIs via Azure portal • Explore the schema and run test queries against the GraphQL APIs in the Azure and developer portals What’s new in API Management
- 15. Event Grid Integration GA • Subscribe to APIM events • Ex: User added to APIM Update a database Create a billing account Send an email notification What’s new in API Management
- 16. Events Hubs
- 17. Event Hubs Premium is GA • Premium tier provides better performance & predictable latency over Standard • Reserved compute, memory & storage resources • Billed by Processing Units (PUs) which can be dynamic • More cost effective for mid-range (<120MB/sec) throughput reqs compared to Event Hubs Dedicated • Event Hubs Capture included at no extra cost What’s new in Events Hubs
- 18. Event Hubs Tier Comparison Feature Basic Standard Premium Dedicated Tenancy Multi-tenant Multi-tenant Multi-tenant with resource isolation Exclusive single tenant Private link N/A Yes Yes Yes Customer-managed key (Bring your own key) N/A N/A Yes Yes Capture N/A Priced separately Included Included Dynamic Partition scale out N/A N/A Yes Yes Ingress events Pay per million events Pay per million events Included Included
- 19. Event Hubs Pricing (Australia East) Basic Standard Premium *** Dedicated * Throughput unit (1 Mb/s ingress, 2 Mb/s egress) $14.59/month $29.18/month $1,449.05/month billed per Premium Unit (PU) $8,240.08/month billed per Capacity Unit (CU) Ingress events $0.038 per million events $0.038 per million events Included Included Capture Not available $97.25/month Included Included Apache Kafka Not available Available Available Available Schema Registry Not available Available Available Available Max Retention Period 1 day 7 days 90 days 90 days Storage Retention 84 GB 84 GB 1 TB per PU 10 TB per CU Extended retention ** Not available Not available $0.20/GB/month (1 TB included per PU $0.20/GB/month (10 TB included *Price for Event Hubs Dedicated is $8,340.079 per month per Capacity Unit. To understand how much a CU can achieve, please refer to our benchmark results. Usage will be charged in one-hour increments with a minimum charge for four hours of usage. For more info on this offering, please read Event Hubs Dedicated overview. For additional questions, please contact Quota Increase Support or please contact the event hubs team. **Message retention above the included storage quotas will result in overage charges. ***Price for Event Hubs Premium is $1.9850 per hour per Premium Unit. Usage will be charged in one-hour increments. Monthly price estimates are based on 730 hours of usage.
- 20. Configuring Processing Units (PUs)
- 21. Azure Schema Registry is GA • Central repo for schema docs • Validation of event stream data • Schemas available to consumers • Reduces per-event data overage • Facilitates schema evolution • Open standards & interoperability
- 22. Information flow
- 23. Service Bus
- 24. Large message support is GA • Configurable range from 1MB to 100MB across all entities • Service Bus enforces the limits you set • Requires Premium tier, but no extra cost • Removes need for claim check pattern in these cases: What’s new in Azure Service Bus
- 25. Configuring Message Size What’s new in Azure Service Bus
- 26. Configuring Message Size What’s new in Azure Service Bus
- 27. Messaging Units (MU) • Higher MUs = Larger buffer sizes • Auto-scaling is supported • Greater efficiency with topics vs. queues, as transfer to log only occurs once What’s new in Azure Service Bus MU Allocation Entity Type Throughput Total Throughput 8+ Single Queue 50MB / sec 50MB / sec 8+ Topic w/5 subs 22MB / sec (per sub) 110MB / sec
- 28. Caveats • Premium only feature • Only supports AMQP protocol (not SBMP) • Max size enforced only for write, not receive • Large messages reduce throughput and increase latency What’s new in Azure Service Bus
- 29. References Azure Book of News https://news.microsoft.com/ignite-november-2021-book-of-news/ Enterprise Integration: Success Stories & Best Practices https://myignite.microsoft.com/sessions/94dac4c6-9cf2-4426-b22e-0304e4aefbf1 Azure Logic Apps Announcement – Fall 2021 Release https:/aka.ms/logic/release/fall2021 General availability: Native support for WebSocket APIs https://azure.microsoft.com/en-us/updates/general-availability-native-support-for-websocket- apis/ Azure Service Bus Premium: Large Message Support Generally Available https://techcommunity.microsoft.com/t5/messaging-on-azure-blog/azure-service-bus-premium- large-message-support-generally/ba-p/2900186 Overview of Event Hubs Premium https://docs.microsoft.com/en-us/azure/event-hubs/event-hubs-premium-overview
- 30. Thank you!!
Editor's Notes
- The lines rendered on the canvas is more intuitive to help you better understand the flow, especially for composite actions such as Condition and Switch.
- Automation Tasks provides all Azure customers an easy way to automate their daily tasks, with just a few clicks, you can create tasks that automatically turns on and off the virtual machine on a schedule, purge old blobs in the storage account, or get a monthly usage report sent via email. In this release, the Logic Apps team have partnered with the Azure messaging team on building the experience for easy event replication. As a customer, you can choose from out-of-box templates to replicate the actual messages and events (rather than just metadata) between and across Service Bus queue, Service Bus topic, and Event Hub. Stateless workflows in Logic Apps standard are used to power this experience behind the scene, so you know the replication is highly performant. Learn more
- Managed identity provides an identity for applications to use when connecting to resources that support Azure Active Directory authentication. In the Fall 2021 release, we added managed identity support for multi-auth capable Azure connectors such as SQL and Azure Blob in Logic Apps Consumption, as well as managed identity support for all Azure connectors in Logic Apps Standard. System or User Assigned
- Can subscribe to APIM events in EG. For example, you can build an application that updates a database, creates a billing account, and sends an email notification each time a user is added to your API Management instance.
- In comparison to Dedicated offering, Event Hubs Premium provides isolation inside a very large multi-tenant environment that can shift resources quickly, it can scale far more elastically and quicker and PUs can be dynamically adjusted. Processing Units vs Capacity Units (Dedicated) Introduces a new, two-tier, native-code log engine that provides far more predictable and much lower send and passthrough latencies than the prior generation, without any durability compromises.
- For structured data that you produce or consume through Event Hubs, you can use schema-driven formats such as Avro and manage those schemas using Azure Schema Registry, irrespective of the event streaming protocol (AMQP, Kafka etc.) that you use to stream data. Schema Evolution Azure Schema Registry supports schema evolution by introducing compatibility modes feature at the schema group level. Compatibility modes allow producers and consumers to evolve independently. Based on the compatibility mode defined in the schema group, only certain operations are allowed when modifying and creating new schema versions. Azure Schema Registry currently supports Backward, Forward, and No compatibility modes. Open Standards and Interoperability there has so far been no open and vendor-neutral standard for a lightweight interface optimized for this use-case. Microsoft has submitted the interface of the Azure Schema Registry to the Cloud Native Foundation's "Cloud Events" project in June 2020.
- The information flow starts from the producer where the Kafka producer serializes the event data using the schema document. The producer then prepends the schema ID to the serialized event payload. Once the consumer receives the event, it can resolve the corresponding schema from the schema registry and deserialize the event payload.
- Configuration limit protects from larger than expected messages JMS 2.0 compliance: JMS message broker migration to ASB now unblocked.
- The feature is a new, per-entity message size limit configuration setting that can range from 1MByte to 100 MByte and defaults to 1 MByte.
- The feature is a new, per-entity message size limit configuration setting that can range from 1MByte to 100 MByte and defaults to 1 MByte.
- When using pub/sub distribution with Service Bus topics, large messages do not have the same adverse performance impact as with brokers that maintain distinct queues per subscription, because the underlying log for message contents is shared amongst all subscriptions, meaning the transfer into the log only occurs once.
- Configuration limit protects from larger than expected messages JMS 2.0 compliance: JMS message broker migration to ASB now unblocked.