Downloaded 11 times
Uploaded byKellton Tech Solutions Ltd
Boomi Molecule Migration to the Cloud: Top 5 Strategies Revealed
The document discusses strategies for migrating Boomi molecules to the cloud, detailing five different cloud migration approaches, their advantages and disadvantages. It emphasizes overcoming operational challenges with Boomi molecules and the benefits of using Dell Boomi's managed cloud services. The content also highlights key features of the Boomi unified enterprise platform and its various integration capabilities.
More Related Content
![[Slides] Digital Transformation, with Brian Solis](https://cdn.slidesharecdn.com/ss_thumbnails/slidesdigitaltransformationbriansolis-140429142804-phpapp01-thumbnail.jpg?width=640&height=640&fit=bounds)
Similar to Boomi Molecule Migration to the Cloud: Top 5 Strategies Revealed
More from Kellton Tech Solutions Ltd
Boomi Molecule Migration to the Cloud: Top 5 Strategies Revealed
- 1. Simple ways to MigrateBoomi Molecule to Cloud5
- 2. KELLTON TECH, APIONEER OF DIGITAL TRANSFORMATION Foundation 1997 Footprint USA, UK, Ireland, Asia Pacific Clients Startups to Fortune 500 Core Strength People and Technology ISO 9001:2015 & CMMi Level 5 Ownership Public Limited BSE, NSE: KELLTOTEC Team 1500+ Employees United States | United Kingdom | Ireland | Asia Pacific
- 3. Speakers Siva Chavali Sr. Architect& Manager Digital Integration (Integration, API & IoT) Kellton Tech Solutions Brian Kelly Global Systems Integrator (GSI) Technology Evangelist Dell Technologies, Boomi
- 4. Digital Transformation of Business andIT Analytics and Decisions Process Integration Data Fabric and Cloud Enablement Business - IT Strategy & Planning Software R & D Design & Analysis Enterprise Reference Architecture Digital Maturity Roadmaps Governance Real-time Streaming Analytics Business Dashboards & Process Monitoring Predictive Analytics Business Process Discovery Pattern Detection Process Orchestration Case Management Rules Management Process Automation and RPA Task and Workflow Management API Portals and Gateways Cloud and SaaS Integration API Life-cycle Management Application and B2B Integration IoT and Mobile Integration No-SQL and Continuous Query Messaging In-Memory Data Management (IMDG) Kellton Tech’s - Digital Integration – Service Portfolio
- 5. Agenda • Boomi UnifiedEnterprise Platform Introduction. • Boomi Molecule Architecture. • The Dilemma around - • Operational Stability, Performance, Scalability and Business Agility. • Implementation Pitfalls. • Drivers for Cloud Migration. • Boomi Crowdsourcing Functionality. • 5 ways to migrate Molecule to Cloud and their pros & cons. • Boomi Managed Cloud Services (MCS). • Molecule Migration to AWS, Azure or GCP. • What’s new in Boomi? Operational Challenges with Boomi Molecules Boomi Molecule Cloud Migration
- 6. Data Journey: BoomiUnified Enterprise Platform Master Data Hub Synchronize and enrich trusted data Integration Connect applications and data Flow Build customer journeys B2B/EDI Management Manage your trading partner network API Management Design, secure and scale APIs Data Catalog and Preparation Transform known and unknown data
- 7.
- 8. Boomi Connectors: Boomi iPaaS- Connectors • Application Connectors • Technology Connectors • Event Driven Connectors • Custom Connectors
- 9. Boomi iPaaS –Supported Connectors Refer to https://boomi.com/platform/integration/applications/ for more information.
- 10. Boomi Functionality 10 Boomi AtomSphere Boomi Atom •The Boomi AtomSphere platform is Home to Boomi Applications. • IDE for the Integration processes and flows. • Control and Monitoring platform. • Cloud native Runtime Engine. • Lightweight. • Executes the processes as they are fetched from AtomSphere. Reverse Invoke
- 11. Boomi Molecule Architecture •The Boomi Molecule is single-tenant • Multiple Atoms are clustered • Load balancing • High Availability • Scalability • Shared Storage is the central component for clustering Molecule Clustering
- 12. Boomi is Scalableand Reliable 12 Molecule Head Node NFS Server Molecule Installation Directory Molecule Child Node 1 Molecule Child Node 2 Vertically increase the Size of each Molecule node (OR) Horizontally Increase the Molecule nodes for scalability and performance.
- 13. Boomi is Scalableand Reliable
- 14. Boomi Molecule OperationalChallenges • Several customers use Linux OS for Molecule, over 1000 customers use Windows OS and a few uses MAC • Atom installations on all the OS are seamless • Stability with Windows Molecules is unpredictable • Difficult to identify and troubleshoot. • Rigid Integration Architecture ! * https://help.boomi.com/bundle/integration/page/r-atm-Molecule_system_requirements.html
- 15. Boomi is Scalableand Reliable 15 Molecule Head Node NFS Server Molecule Installation Directory Molecule Child Node 1 Molecule Child Node 2 Molecule Child Node N NFS Server Molecule Installation Directory
- 16. Boomi Molecule OperationalChallenges, Contd. Potential reasons for some of these issues can be attributed to – • Disk latency/contention on the shared storage server • Bulky processes such as Virus scans • Problem gets worse with large file and large volume file processing • Network latencies between Nodes and NFS
- 17. Balancing Operational Stability,Performance, Scaling & Agility Dilemma of the Architect! • Can’t increase number of nodes in the Molecule • Can’t vertically scale infrastructure forever • Can’t horizontally scale • Can’t scale elastically What shall we do? CostAgilityPerformance Operational Stability Scalability Whack a Mole
- 18. • Drivers forCloud Migration. • Boomi Crowdsourcing Functionality. • 5 ways to migrate Molecule to Cloud and their pros & cons. • Boomi Managed Cloud Services (MCS). • Molecule Migration to AWS, Azure or GCP. • What’s new in Boomi? Boomi Molecule Cloud Migration PART - 2
- 19. Drivers for BoomiCloud Migration Hands-Off with Managed Cloud Services from Boomi. Stay upgraded on the latest and Greatest features of the platform. Boomi Assure – Regression Testing Digital Transformation ‘SaaS’ifying and ‘PaaS’ifying applications Break the Dilemma! Get it all Operational stability, Agility, Performance, Cost and elastic scalability. Empowers Citizen integrator development. Leverage Boomi’s unique Crowdsourcing features like Boomi Suggest, Boomi Resolve, Integration Packs, Process Libraries, and Predictive Assistance, etc. Boomi iPaaS
- 20. How to migrate BoomiPlatform to Cloud?
- 21. 5 Cloud MigrationStrategies • Migrate to Boomi Public Atom Cloud • Hybrid Integration Platform • Migrate to your own Private Cloud • Migrate to AWS Private Atom Cloud – Boomi MCS • Containerize the Boomi Molecule and Deploy on any cloud
- 22. 5 Cloud MigrationStrategies, contd. 1. Migrate to Boomi Public Atom Cloud • Boomi Public Atom Cloud, a multi-tenant. • Well suited for who don’t have on-premises enterprise applications footprint and • For those enterprises, the integrations are intended only among Cloud applications. Salesforce Other SaaS applications Dell Boomi Atmosphere Platform Boomi Atom Cloud Trading Partners NetSuite . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Corporate Firewall DMZ NO ON-PREMISES FOOTPRINT IoT Devices
- 23. 5 Cloud MigrationStrategies, contd. Advantages Caution Zero-Footprint strategy. 1 GB of volume / month at no charge 99.99% availability. Cannot access on-premise enterprise applications Elastic Scalability Limited (50) simultaneous process executions Shared Infrastructure Governance limits and fixed resource allocations which impact scalability. Support for high-transaction-volume integrations No custom configurations for the environment Built-in disk space monitoring features No control on the environment Seamless Forked execution of processes Easy migration of existing integrations 1. Migrate to Boomi Public Atom Cloud, contd.
- 24. 5 Cloud MigrationStrategies, contd. 2. Adopt and Migrate to a Hybrid Integration Architecture • Use Hybrid Integration Architecture with cloud and on-premise footprint. • Reverse Invoke from local atom to cloud (no need to open firewall ports) • Well Suited for brand new implementations. • Success depends on the quality Integration architecture and strategy. Salesforce Other SaaS applications Dell Boomi Atmosphere Platform Boomi Atom Cloud Trading Partners NetSuite SAP DB Other Enterprise Applications Disk File System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Corporate Firewall DMZ256-bit encryption (metadata only) Local Atom / Cloud gateway
- 25. 5 Cloud MigrationStrategies, contd. 2. Adopt and Migrate to a Hybrid Integration Architecture, contd. Advantages Caution Typical industry reference architecture for Hybrid Integration with footprint in cloud and on-premise applications. Potential rework if not strategized or architected properly originally. Solves the technical and functional limitations of public cloud. Architectural complexities about how much capacity to maintain on-premise and for each integration. Elastic scalability Different set of Operational challenges regarding upgrades monitoring controls etc. Citizen Integrator development No control on the cloud environment
- 26. 5 Cloud MigrationStrategies, contd. 3. Migrate to Customer’s Private Cloud. • This option is same as that of the Lift and Shift approach. • E.g., Refer to AWS provides quick reference template for all the required components* of Boomi Molecule Installation. • Refer to https://aws- quickstart.s3.amazonaws.com/quickstart- boomi-molecule/doc/boomi-molecule-on- the-aws-cloud.pdf • From a cost optimization and Load balancer perspective, this can be refined further using latest solutions available.
- 27. 5 Cloud MigrationStrategies, contd. 3. Migrate to Customer’s Private Cloud contd. Advantages Caution Quick and easy to install with Complete control Customer must manage Application and cloud Infrastructure and the cost efficiency strategies. Easy to migrate existing integrations to cloud Similar Scalability concerns like on-premise environment. Cloud infrastructure is generally more efficient than on-prem. As the number of nodes increase under the molecule, other unforeseen operational complexities may show up. Serves as the opportunity to migrate from Windows OS to Linux. Linus OS is relatively more stable than Windows. Horizontal scalability only and vertical scalability is not possible, and horizontal scalability might need additional Boomi licenses. Improved monitoring
- 28. 5 Cloud MigrationStrategies, contd. Containerize the on-premise Boomi platform and deploy on to private cloud environment and leverage Kubernetes container orchestration for handling elastic scalability needs. 4. Containerize the on-premise Boomi platform / Future – Emerging approach
- 29. 5 Cloud MigrationStrategies Advantages Caution Both hardware and software can be scaled on-demand automatically. Both Application and Infrastructure maintenance are under the organization’s scope. Unlimited scalability with complete control within the hands of the organization. Increased Complexity and need for strong technical competence. Quick start template available for Boomi Kubernetes Molecule on AWS Stay watchful on the licenses with horizontal scalability This is yet an evolving solution with limited support. Without robust CI-CD implementation controls in place, containerization of applications and replication can cost huge for regression testing of applications. 4. Containerize the on-premise Boomi platform / Future – Emerging approach, Contd.
- 30. 5 Cloud MigrationStrategies, contd. 5. Adopt and Migrate to Boomi’s Managed Private Atom cloud Note: Compare the cost of managed private atom cloud against, the current cost of AWS + direct and indirect costs for in-house maintenance of AWS infrastructure + software and the technical expertise needed. Salesforce Other SaaS applications Dell Boomi Atmosphere Platform Trading Partners NetSuite SAP DB Other Enterprise Applications Disk File System Corporate Firewall Private Atom Cloud Managed services VPN Amazon Direct Connect
- 31. 5 Cloud MigrationStrategies, contd. 5. Adopt and Migrate to Boomi’s Managed Private Atom cloud Advantages Disadvantages Zero-Footprint strategy. Subscription Cost could be higher*. Unlimited scalability to meet higher API volumes, larger ETL workloads and more simultaneous executions. Limited control over the environment and need to work with Dell Boomi MCS (managed cloud services) support team to handle special requests. Get rid off operational challenges & maintenance costs Eliminate the need for strong technical competence and/or the investment in monitoring tools, administration and performance management. Note: Compare the cost of managed private atom cloud against, the current cost of cloud + direct and indirect costs for in-house maintenance of cloud infrastructure + software and the technical expertise needed.
- 32. • Drivers forCloud Migration. • Boomi Crowdsourcing Functionality. • 5 ways to migrate Molecule to Cloud and their pros & cons. • Boomi Managed Cloud Services (MCS). • Molecule Migration to AWS, Azure or GCP. • What’s new in Boomi? Boomi Molecule Cloud Migration PART - 2 Welcome Brian Kelly from Boomi to the talk
- 33. NO Data PaaS NO Data PaaS 33 EXTERNAL FIREWALL Multi CloudArchitectures ON-PREMISESCLOUDAPPLICATIONS INTER CLOUD INTRA CLOUDON-PREMISE TO ON-PREMISE HYBRID NO Data PaaS NO Data PaaS
- 34. Cloud Deployment Typesfor any Use Case
- 35. Dell Boomi ManagedServices Offerings Managed Cloud Service Premium service where Boomi provisions, monitors, manages & tunes a dedicated virtual private cloud on behalf of a customer. VPCs can either be hosted on Amazon’s AWS or Microsoft Azure Process Monitoring & Management Premium service where Boomi proactively monitors, resolves errors & manages integration processes in production on customer’s behalf Service applies to EDI (aka EDIaaS), as well as non EDI customers and applies to cloud as well as on-premise hosted customers.
- 36. MCS Value Add& Capabilities Disaster Recovery (for Prod)High Availability Extensible ArchitectureFlexible Release Scheduling Scalability Managed Cloud Consultation and 24/7 Support Security Automation & Infrastructure As Code Self Service Monitoring & Analytics Connect To Anywhere
- 37. Design Architect cloud tobest fit the unique requirements – single or multi-tenant Delivery From procurement to installation – hardware, software, VPN/Peering Maintenance Ongoing monitoring and fine tuning for optimal performance MCS Engagement Phases
- 38. Boomi: Out ofthis World • In case youmissed it…
- 39. GO DIGITAL WITHKELLTON TECH 3 Contact Us brad.williams@kelltontech.com ask@kelltontech.com Siva – 513.365.2034 Brad – 732.639.5795 www.kelltontech.com
Editor's Notes
- #5 Here is a little introduction slide talking about our abilities working on the Digital Transformation enablers of the businesses starting with the EAI and B2B Integrations, API Strategy and End to End API life cycle management solutions and Internet of Things and the Process Improvement, Automation, Data and Analytics and Cloud Enablement. We are veterans in the Integration space and pioneers in the IoT implementations, with a lot of enterprise scope implementations. “We are small enough to care for your custom needs and big enough to handle engagements and being your strategy partners”
- #7 Boomi’s unified enterprise application platform is a true multi-purpose PaaS, starting with integration capabilities to Master Data Management and Flow development. Boomi’s journey started with B2B/EDI Integration applications and expanded its wings to Integration platform as a service (iPaaS) that is intelligent, flexible, and scalable integration platform that accelerates your business by making information, interactions and innovations flow faster. It supports all application integration processes - between cloud platforms, software-as-a-service applications, and on-premise systems. If someone is looking for modernizing B2B environment or the EDI processes, then I would recommend to have Boomi on top of your list for evaluation. API Management Boomi API Management provides a unified full life cycle API Management platform that can manage the end-to-end life cycle of the APIs. Boomi Flow Flow provides a low-code development platform to create customer journeys and automate workflows — from simple to sophisticated. Master Data Hub: Boomi Master Data Hub is a Master data management tool that can help to maintain data integrity, enables you to keep the data clean, accurate, and consistent. At the core of the Boomi platform are self-service data catalog, discovery and preparation tools to empower business users. With automation and intelligence, Boomi predicts the context of the data for business users to understand where the data resides and ingest into visualization and analytics.
- #8 Industry Credibility based on the Market Research companies like Gartner and Forrester.
- #9 Boomi Connectors: Boomi Integration connectors are the main component that facilitate integration and contain all the information that is needed to connect to a data source or application. Connectors enable you to easily connect and integrate third-party applications, such as Salesforce to NetSuite, to send and receive data between them. Application Connectors – Application connectors provide connectivity to specific software applications such as Netsuite, Salesforce, SAP, or Amazon. Technology Connectors – Technology connectors provide connectivity to and from web applications, on-premise applications, and common data repositories using various protocols (including HTTP, FTP, JMS, DB, FTP, AS2 etc.) using a standard data transport method or generic data driver. Custom Connectors – Ability to create custom connectors for systems which doesn’t have connectors available. E.g., Create a custom connector for Stripe. Event Driven Connectors –Enables Event Driven architecture-based integration solutions for various events generated from Devices, Cloud or On-premise systems. Boomi’s license is dependent on number of connectors and free of number of cores, transaction volume usage etc.
- #12 The Boomi Molecule is a single-tenant, clustered Atom that allows for multiple Atom processes to run concurrently. Meant for Clustering of the Atoms - Load balancing the transactions. High availability for business continuity. Scalability through Multi-threading and simultaneous processing. Increased performance. One node elected as head node for administrative functions such as, that retrieves messages from Atomsphere platform, load balances the transactions among available nodes, maintains and reports health to AtomSphere etc. Shared Storage Requirements: All nodes that are part of it must be using the same installation directory. File system must be of same OS as that of individual nodes. E.g., An NFS file system with NFS locking enabled (NLM support) or A Windows network share or drive Why Shared Storage? Clustering of the independent runtimes (Atoms) need a mechanism to work in conjunction with each other for - Context sharing. Resources sharing. Stage the temporary working data documents from all the cluster nodes*.
- #14 https://community.boomi.com/s/article/Boomi-Batch-Integration-Vertical-Scalability-Benchmark-with-Increased-Heap-Memory https://community.boomi.com/s/article/Boomi-Batch-Integration-Horizontal-Scalability-with-Increased-Molecule-Nodes https://community.boomi.com/s/article/Low-Latency-Integration-Horizontal-Scalability-Benchmark-with-Increased-Molecule-Nodes
- #15 According to our information, several customers are using Dell Boomi Atom/Molecule runtimes installed on-premises and even considerable number of customers are running their molecule nodes on the Windows Operating System. Caution: Our observation is that this combination can be a suspect!! On-premises installation can make your integration architecture rigid from scalability, time-to-market perspective, and - The Molecule installation on Windows OS can contribute to unexpected operational challenges* that may be difficult to identify and troubleshoot. Wondering why would something like “java.lang.NoClassDefFoundError: org/codehaus/groovy/control/Phases” or “WRITE_FAILURE” or “UNKNOWN_ERROR” or similar errors occur frequently? Why are my Molecule nodes getting restarted automatically? Molecule nodes are logging huge data, which is difficult to download or analyze! Molecule went offline (is red in the platform), but nodes are still running on the server or Molecule nodes frequently going down. Do you or Did you spend longer times in SWAT meetings among various teams like Integration, Network, Open Systems, DB etc., for troubleshooting?
- #17 Potential reasons for some of these issues can be attributed to - Disk latency/contention on the shared storage server. Bulky processes such as, Virus scans or scheduled system backup processes or automated vulnerability patching on the server could be resource consuming on the shared storage server. This problem could be more severe with large file and large volume file processing. Molecule architecture has heavy I/O processing needs to read/write the working data files to storage and If Shared storage is used for this purpose, that’s a red flag! Race around for resources from other applications sharing the same infrastructure as that of Shared storage.
- #18 If you Increase the number of Atoms or nodes of the Molecule, then it will be compromise on operational stability. If you over provision hardware, then it will be compromise on the cost. If you choose to build side-by-side stack of infrastructure, it will be a compromise on the Agility. If you address operational stability, it will be a compromise on elastic scalability.
- #20 Predictive Assistance: Patented Innovation for Customer Success Predictive Assistance is Boomi’s patented innovation where it integrates near-real-time customer usage metrics, such as amount of data flowing through integrations and active updates to integrations, with Dell Boomi’s customer relationship management (CRM) system. The Dell Boomi Client Services team proactively reaches out to customers whose usage metrics indicate that an engagement can increase their success and optimize their use of the Boomi integration platform.
- #23 , hosted and managed cloud offering from Dell Boomi. Please find more details on Boomi Atom Cloud documentation.
- #24 Zero-Footprint strategy. Caution: 1 GB of volume / month at no charge, additional charges will apply if you exceed this limit*. 99.99% availability. Cannot access on-premise enterprise applications Both hardware and software can be elastically scaled on-demand automatically by managed services along with support for load balancing and failover support Each account is limited to running 50 simultaneous process executions. Multi-tenant model reduces the infrastructure costs incurred by Daylight, since the cost is shared with other customers of Boomi. Governance limits and fixed resource allocations which impact scalability. Support for high-volume transaction integrations Runtime configuration options such as scripts, encodings, libraries, cannot be customized by tenants/users. Built-in disk space monitoring features Managed services control the forked execution of processes for Performance improvement Easy migration of existing integrations into Public Cloud environment
- #25 Most popular among others
- #26 Existing Integrations should be redesigned and redeveloped to fit the Hybrid integration model, where on-premise applications connecting integrations are to be developed and deployed on local Boomi installation and Internet application connections to be developed and deployed on Public cloud atom. (It helps immensely to develop decision trees in advance in alignment with organizational strategies and security policies, cloud or on-premise gravity) Solves the technical and functional limitations of public cloud can be handled in the on-premise installation and leverage Boomi public atom cloud for connectivity with B2B partners, SaaS applications and for elastic scalability. Both hardware and software can be elastically scaled on-demand automatically by managed services along with support for load balancing and failover support Different set of Operational challenges such as, upgrades for Cloud and on-premise should be synchronized, requirements for separate monitoring controls on cloud and local installations and logs aggregation for capturing metrics etc.
- #27 Brian Kelly would provide further details on AWS – Boomi technology partnership and how they help customers.
- #28 both infrastructure and applications using AWS’ CloudWatch service to aggregate logs and create insightful dashboards for visualization, detect anomalies using AWS’ Machine Learning capabilities.
- #29 Boomi Kubernetes Molecule on AWS uses Amazon Elastic Kubernetes Service (Amazon EKS) to help add or remove nodes as dictated by resource demands. This allows the Molecule to elastically add nodes to meet high-volume demands and remove those nodes when they are no longer required to support operational efficiency and cost-savings efforts. Both application and Infrastructure maintenance and managing cost efficient strategies are still under the scope of the Customer. Increased Complexity and need for strong technical competence. Managing component licenses during the replication of containers is still under the scope of Daylight. Dell Boomi support for Kubernetes or other container orchestration tools is limited. Without strong CI-CD implementation controls in place, containerization of applications and replication can cost huge for regression testing of applications.
- #30 Boomi Kubernetes Molecule on AWS uses Amazon Elastic Kubernetes Service (Amazon EKS) to help add or remove nodes as dictated by resource demands. This allows the Molecule to elastically add nodes to meet high-volume demands and remove those nodes when they are no longer required to support operational efficiency and cost-savings efforts. Both application and Infrastructure maintenance and managing cost efficient strategies are still under the scope of the Customer. Increased Complexity and need for strong technical competence. Managing component licenses during the replication of containers is still under the scope of Daylight. Dell Boomi support for Kubernetes or other container orchestration tools is limited. Without strong CI-CD implementation controls in place, containerization of applications and replication can cost huge for regression testing of applications.
- #34 Add AIP slides in the appendix for more details
- #36 https://community.boomi.com/s/article/Boomi-Batch-Integration-Vertical-Scalability-Benchmark-with-Increased-Heap-Memory https://community.boomi.com/s/article/Boomi-Batch-Integration-Horizontal-Scalability-with-Increased-Molecule-Nodes https://community.boomi.com/s/article/Low-Latency-Integration-Horizontal-Scalability-Benchmark-with-Increased-Molecule-Nodes
- #37 https://community.boomi.com/s/article/Boomi-Batch-Integration-Vertical-Scalability-Benchmark-with-Increased-Heap-Memory https://community.boomi.com/s/article/Boomi-Batch-Integration-Horizontal-Scalability-with-Increased-Molecule-Nodes https://community.boomi.com/s/article/Low-Latency-Integration-Horizontal-Scalability-Benchmark-with-Increased-Molecule-Nodes