Azure Logic Apps & AI - Building Integration & AI Solutions
•Download as PPTX, PDF•
0 likes•6 views
Presentation delivered at the Brisbane Data & AI Bootcamp on Saturday, 18 May 2024. Covers Workflow Assistant and new Azure OpenAI and AI Search connectors.
Recommended
More Related Content
Similar to Azure Logic Apps & AI - Building Integration & AI Solutions
Similar to Azure Logic Apps & AI - Building Integration & AI Solutions (20)
More from Daniel Toomey
More from Daniel Toomey (20)
Recently uploaded
Recently uploaded (20)
Azure Logic Apps & AI - Building Integration & AI Solutions
- 1. Logic Apps and AI Dan Toomey @daniel2me
- 2. THANK YOU TO OUR SPONSORS BRISBANE DATA ANALYTICS & AI BOOTCAMP
- 3. Who am I? • Senior Integration Specialist, Deloitte • Microsoft Azure MVP • MCSE, MCT, MCPD, MCTS BizTalk & Azure • Pluralsight Author • www.mindovermessaging.com • @daniel2me
- 4. Agenda •What are Logic Apps? •How does AI help to build Logic Apps •How do Logic Apps help to build AI solutions?
- 5. What are Logic Apps?
- 6. Azure Integration Services (AIS) These are the core integration services in Azure. Extract, Load, Transform data with Data Factory Create, access control, usage analysis, and management of APIs thanks to API Management Serverless compute execution with Functions Microservice and API orchestration with Logic Apps Event Grid for raising and delivering events Enterprise messaging with Service Bus
- 7. What are Logic Apps? Azure Logic App is an Azure service that simplifies how you build automated scalable workflows that integrate apps and data across cloud services and on- premises systems.
- 8. Logic Apps >1000 Connectors!! Azure Connectors Azure AD Azure API Management Azure App Services Azure Application Insights Azure Automation Azure Blob Storage Azure Container Instance Azure Data Lake Azure Data Factory Azure Event Grid Azure File Storage Azure Functions Azure Kusto Azure Logic Apps Azure ML Azure Resource Manager Azure Security Center Azure SQL Data Warehouse Azure Storage Queues Azure Table Storage Computer Vision API Common Data Service Content Moderator Cosmos DB Custom Vision Event Hubs Face API LUIS QnA Maker Service Bus SQL Server Text Analytics Video Indexer Other Microsoft Connectors Bing Maps Bing Search Dynamics 365 Dynamics 365 for Financials Dynamics Nav Microsoft Forms Microsoft Kaizala Microsoft StaffHub Microsoft Teams Microsoft To-Do Microsoft Translator MSN Weather Office 365 Excel Office 365 Groups Office 365 Outlook Office 365 Video OneDrive OneDrive for Business OneNote Outlook Customer Manager Outlook Tasks Outlook.com Project Online Power BI SharePoint Skype for Business VSTS Yammer 3rd-Party SaaS Connectors 10to8 Adobe Creative Cloud Apache Impala Appfigures Asana Aweber Basecamp3 Benchmark Email Bitbucket Bitly Blogger Box Buffer Calendly Campfire Capsule CRM Chatter Cognito Forms D&B Optimizer Derdack Signl4 DocFusion Docparser DocuSign Dropbox Easy Redmine Elastic Forms Enadoc Eventbrite Facebook FlowForma FreshBooks Freshdesk Freshservice GitHub Gmail Google Calendar Google Drive Google Sheets Google Tasks GoToMeeting GoToTraining GoToWebinar Harvest HelloSign HipChat iAuditor Infobip Infusionsoft Inoreader insightly Instagram Instapaper Intercom Jira JotForm Kintone LeanKit LiveChat Lithium MailChimp Mandrill Marketing Content Hub Metatask Muhimbi PDF MySQL Nexmo Oracle Database Pager Duty Parserr Paylocity Pinterest Pipedrive Pitney Bowes Data Validation Pivotal Tracker Planner Plivo Plumsail Documents Plumsail Forms Plumsail SP PostgreSQL Redmine Salesforce SendGrid ServiceNow Slack Smartsheet SparkPost Stripe SurveyMonkey Tago Teamwork Projects Teradata Todoist Toodledo Trello Twilio Twitter Typeform UserVoice Vimeo WebMerge WordPress Workday HCM Workday Finance Wunderlist YouTube Zendesk Zoho Protocol Connectors FTP HTTP / HTTP with Swagger HTTP with Azure AD RSS SFTP SMTP SOAP-to-REST SOAP pass-through Webhook Hybrid & Enterprise Connectors BizTalk DB2 File System Informix MQ MySQL Oracle DB PostgreSQL REST SAP SharePoint SOAP SQL Server Teradata XML, Text, EDI, and AS2 Connectors AS2 EDIFACT Flat File Liquid Templates X12 XML Validation and Transform https://docs.microsoft.com/en-us/connectors/connector-reference/connector-reference-logicapps-connectors
- 10. Logic Apps Workflows • Graphically Designed & Monitored • Workflow & Orchestration engine • Triggers: Connectors and Recurrent • Actions: Connector & Workflow • JSON Code Behind (Workflow Definition Language)
- 11. Logic Apps Workflows (Flow Control) • Conditions & Switch Statements • Action Run-After (Status) • For-Each & Do-Until Loops • Fan-out & Fan-in (parallel branches and loops) • Retries (Fixed & Exponential) • Scopes • Exception Handling • Correlation & Sequential Convoys
- 13. Task Resiliency Transient failures invoke retry- policies (DNS issues, throttles, or 5xx responses) If the task doesn’t respond, workflow orchestrator will assign a new task (at least once guarantee)
- 14. Workflow Definition Language Functions Collection contains, length, empty, intersection, union, first, last, take, skip, join String concat, substring, replace, guid, toLower, toUpper, indexof, lastindexof, startswith, endswith, split Logical equals, less, lessOrEquals, greater, greaterOrEquals, and, or, not, if Conversion int, string {}, json, float, bool, base64, base64ToString, binary, dataUriToString, dataUri, uriComponent, triggerFormDataValue, formDataValue, xml, array, etc. Manipulati on coalesce, addProperty, setProperty, removeProperty, xpath Math add, sub, mul, div, mod, min, max, range, rand Date utcnow, addseconds, addminutes, addhours, adddays, formatDateTime, startOfDay, dayOfYear, etc. https://docs.microsoft.com/en-us/azure/logic-apps/logic-apps-workflow-definition- language
- 15. Logic Apps Standard • Stateless & Stateful flows • Functions Runtime • Runs in containers • Visual Studio designer • Local debugging
- 16. Using AI to build Logic Apps
- 17. Workflow Assistant • Chat-based “Copilot” type interface • Powered by Azure OpenAI and ChatGPT • Context-aware
- 18. Demo
- 19. Workflow Assistant Limitations • Only available in the Azure Portal • Only in Standard Logic Apps • Closing the chat loses conversation history
- 20. Using Logic Apps to build AI
- 21. RAG : Retrieval-Augmented Generation Source: https://aws.amazon.com/what-is/retrieval-augmented-generation/
- 22. ChatGPT + Enterprise Data w/Azure OpenAI & AI Search • Free sample that you can clone, build & deploy • Includes sample data https://github.com/Azure-Samples/azure-search-openai-demo
- 23. Azure OpenAI and AI Search Connectors Currently in preview mode:
- 24. Create a Chat with Your Data (Logic App Project) • Sample workflows and tokenization function • Wraps the other sample project https://github.com/Azure/logicapps/tree/master/ai-sample
- 26. Ingestion Workflow Data acquisition Data tokenization Embedding generation Document indexing
- 28. flow Chat Workflow Prompt capture Model training Query generation Embedding conversion Vector search operation Prompt creation Chat completion
- 30. Summary • AI can be helpful for integration solutions • AI helps to build applications with Logic Apps • Logic Apps helps to build AI applications Logic Apps
- 31. Resources • Public preview announcement: https://aka.ms/LogicAppsCopilot • Official documentation on Workflow Assistant: https://learn.microsoft.com/en-us/azure/logic- apps/workflow-assistant-standard • Using Logic Apps to build intelligent OpenAI applications: https://techcommunity.microsoft.com/t5/azure- integration-services-blog/use-logic-apps-to-build- intelligent-openai-applications/ba-p/4014121 • Azure OpenAI: https://learn.microsoft.com/en-us/azure/ai- services/openai/overview
- 32. Resources • Learn How to Build AI Applications with Logic Apps: https://www.youtube.com/watch?v=tiU5yCvMW9o
- 34. SPECIAL DISCOUNT LEVEL UP YOUR DATA WORKSHOPS & CONFERENCE Workshop AND Conference: SAVE $200 Workshop OR Conference: SAVE $100 DISCOUNT CODE: BRISBANEBOOTCAMP www.LevelUpYourData.com CODE VALID UNTIL MAY 31, 2024
- 36. Thank you!! Keep in touch! @daniel2me /in/danieltoomey mindovermessaging.com
Editor's Notes
- APIM – API management, governance, security, discoverability, etc Functions / Event Grid – Event driven computing Logic Apps – workflow & connectivity Service Bus – Enterprise messaging Data Factory – ETL (Extract, Transform, Load)
- Fast integrations using a visual designer and workflow creation with triggers and actions Connect applications, data, and services Connect and orchestrate Azure Functions
- Logic Apps have literally hundreds of integrations and support for custom integrations as well. You are able to integrate with Azure resources, database servers, SharePoint installations, Office 365, Dynamics, or third party resources like gmail, Twilio for text messaging or Slack for real-time communication. In fact, there an internal joke saying that when you present a talk about iPaaS, the only slide that will NEVER be up to date is the connector slide… because there is always new ones. Even more, today you can create custom connector. SO for example you could create a connector for your application and distribute it via the Azure Marketplace.
- Logic apps are great at connecting resources across the cloud, but they are also capable of integrating with on-premises resources with the on-premises data gateway. That means you can, for example, kick off a workflow in the cloud that results in the execution of a store procedure on your SQL database tucked away in your corporate data center.
- Optimises the output of LLMs References an authoritative knowledge base outside of the LLM training data source Helps to generate a higher quality response Saves expense of expanding/updating the LLM model
- Ingestion Workflow: Data Acquisition: Retrieve data from any third-party storage system. Data Tokenization: In this scenario, tokenizing a PDF document. Embeddings Generation: Utilize Azure OpenAI to create embeddings. Document Indexing: Index the document using AI Search.
- Ingestion Workflow: Data Acquisition: Retrieve data from any third-party storage system. Data Tokenization: In this scenario, tokenizing a PDF document. Embeddings Generation: Utilize Azure OpenAI to create embeddings. Document Indexing: Index the document using AI Search.
- Ingestion Workflow: Data Acquisition: Retrieve data from any third-party storage system. Data Tokenization: In this scenario, tokenizing a PDF document. Embeddings Generation: Utilize Azure OpenAI to create embeddings. Document Indexing: Index the document using AI Search. Chat Workflow: Prompt capture: Capturing JSON via HTTP request trigger Model training: Adapting to sample responses (modeled on GitHub example) Query generation: Crafting search queries for vector database Embedding conversion: Transforming queries into vector embeddings Vector search operation: Executing searches in the preferred database Prompt creation and chat completion: Use straightforward JavaScript to build prompts and connect with the chat completion API, guaranteeing reliable responses in chat conversations.
- Chat Workflow: Prompt capture: Capturing JSON via HTTP request trigger Model training: Adapting to sample responses (modeled on GitHub example) Query generation: Crafting search queries for vector database Embedding conversion: Transforming queries into vector embeddings Vector search operation: Executing searches in the preferred database Prompt creation and chat completion: Use straightforward JavaScript to build prompts and connect with the chat completion API, guaranteeing reliable responses in chat conversations.