Boomi Molecule Migration to the cloud is a new imperative for enterprises, looking to put scalability at the top of their business agenda. Read our PPT to take stock of the top 5 Boomi Molecule migration strategies that you must know to achieve value faster.
2. KELLTON TECH, A PIONEER OF DIGITAL TRANSFORMATION
Foundation
1997
Footprint
USA, UK, Ireland,
Asia Pacific
Clients
Startups to Fortune 500
Core Strength
People and Technology
ISO 9001:2015 &
CMMi Level 5
Ownership
Public Limited
BSE, NSE: KELLTOTEC
Team
1500+ Employees
United States | United Kingdom | Ireland | Asia Pacific
3. Speakers
Siva Chavali
Sr. Architect & Manager
Digital Integration (Integration, API & IoT)
Kellton Tech Solutions
Brian Kelly
Global Systems Integrator (GSI) Technology Evangelist
Dell Technologies, Boomi
4. Digital
Transformation of
Business and IT
Analytics and
Decisions
Process
Integration
Data Fabric
and Cloud
Enablement
Business - IT Strategy &
Planning
Software R & D
Design & Analysis
Enterprise Reference
Architecture
Digital Maturity
Roadmaps
Governance
Real-time Streaming
Analytics
Business Dashboards
& Process Monitoring
Predictive Analytics
Business Process
Discovery
Pattern Detection
Process Orchestration
Case Management
Rules Management
Process Automation
and RPA
Task and Workflow
Management
API Portals and
Gateways
Cloud and SaaS
Integration
API Life-cycle
Management
Application and B2B
Integration
IoT and Mobile
Integration
No-SQL and Continuous
Query
Messaging
In-Memory Data
Management (IMDG)
Kellton Tech’s - Digital Integration – Service Portfolio
5. Agenda
• Boomi Unified Enterprise Platform
Introduction.
• Boomi Molecule Architecture.
• The Dilemma around -
• Operational Stability,
Performance, Scalability and
Business Agility.
• Implementation Pitfalls.
• Drivers for Cloud Migration.
• Boomi Crowdsourcing Functionality.
• 5 ways to migrate Molecule to Cloud
and their pros & cons.
• Boomi Managed Cloud Services
(MCS).
• Molecule Migration to AWS, Azure or
GCP.
• What’s new in Boomi?
Operational Challenges with
Boomi Molecules
Boomi Molecule
Cloud Migration
6. Data Journey: Boomi Unified Enterprise Platform
Master Data Hub
Synchronize and enrich trusted data
Integration
Connect applications and data
Flow
Build customer journeys
B2B/EDI Management
Manage your trading partner network
API Management
Design, secure and scale APIs
Data Catalog and Preparation
Transform known and unknown data
9. Boomi iPaaS – Supported Connectors
Refer to https://boomi.com/platform/integration/applications/ for more information.
10. Boomi Functionality
10
Boomi
AtomSphere Boomi
Atom
• The Boomi AtomSphere platform is
Home to Boomi Applications.
• IDE for the Integration processes
and flows.
• Control and Monitoring platform.
• Cloud native Runtime Engine.
• Lightweight.
• Executes the processes as they are
fetched from AtomSphere.
Reverse Invoke
11. Boomi Molecule Architecture
• The Boomi Molecule is single-tenant
• Multiple Atoms are clustered
• Load balancing
• High Availability
• Scalability
• Shared Storage is the central component for
clustering
Molecule
Clustering
12. Boomi is Scalable and Reliable
12
Molecule
Head Node
NFS Server
Molecule
Installation
Directory
Molecule
Child Node 1
Molecule
Child Node 2
Vertically increase the Size of each Molecule node (OR)
Horizontally Increase the Molecule nodes for
scalability and performance.
14. Boomi Molecule Operational Challenges
• Several customers use Linux OS for Molecule, over
1000 customers use Windows OS and a few uses
MAC
• Atom installations on all the OS are seamless
• Stability with Windows Molecules is unpredictable
• Difficult to identify and troubleshoot.
• Rigid Integration Architecture
!
* https://help.boomi.com/bundle/integration/page/r-atm-Molecule_system_requirements.html
15. Boomi is Scalable and Reliable
15
Molecule
Head Node
NFS Server
Molecule
Installation
Directory
Molecule
Child Node 1
Molecule
Child Node 2
Molecule
Child Node N
NFS Server
Molecule
Installation
Directory
16. Boomi Molecule Operational Challenges, Contd.
Potential reasons for some of these issues
can be attributed to –
• Disk latency/contention on the shared
storage server
• Bulky processes such as Virus scans
• Problem gets worse with large file and large
volume file processing
• Network latencies between Nodes and NFS
17. Balancing Operational Stability, Performance, Scaling & Agility
Dilemma of the Architect!
• Can’t increase number of nodes in the Molecule
• Can’t vertically scale infrastructure forever
• Can’t horizontally scale
• Can’t scale elastically
What shall we do?
CostAgilityPerformance
Operational
Stability
Scalability
Whack a Mole
18. • Drivers for Cloud Migration.
• Boomi Crowdsourcing
Functionality.
• 5 ways to migrate Molecule to
Cloud and their pros & cons.
• Boomi Managed Cloud Services
(MCS).
• Molecule Migration to AWS, Azure
or GCP.
• What’s new in Boomi?
Boomi Molecule Cloud Migration
PART - 2
19. Drivers for Boomi Cloud Migration
Hands-Off with Managed Cloud
Services from Boomi.
Stay upgraded on the latest and
Greatest features of the platform.
Boomi Assure – Regression Testing
Digital Transformation
‘SaaS’ifying and ‘PaaS’ifying applications
Break the Dilemma! Get it all
Operational stability, Agility,
Performance, Cost and
elastic scalability.
Empowers Citizen
integrator development.
Leverage Boomi’s unique Crowdsourcing features like Boomi Suggest,
Boomi Resolve, Integration Packs, Process Libraries,
and Predictive Assistance, etc.
Boomi iPaaS
21. 5 Cloud Migration Strategies
• Migrate to Boomi Public Atom Cloud
• Hybrid Integration Platform
• Migrate to your own Private Cloud
• Migrate to AWS Private Atom Cloud – Boomi MCS
• Containerize the Boomi Molecule and Deploy on any cloud
22. 5 Cloud Migration Strategies, contd.
1. Migrate to Boomi Public Atom Cloud
• Boomi Public Atom Cloud, a multi-tenant.
• Well suited for who don’t have on-premises
enterprise applications footprint and
• For those enterprises, the integrations are
intended only among Cloud applications.
Salesforce
Other SaaS
applications
Dell Boomi
Atmosphere Platform
Boomi
Atom Cloud
Trading
Partners
NetSuite
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Corporate Firewall
DMZ
NO ON-PREMISES FOOTPRINT
IoT Devices
23. 5 Cloud Migration Strategies, contd.
Advantages Caution
Zero-Footprint strategy. 1 GB of volume / month at no charge
99.99% availability. Cannot access on-premise enterprise applications
Elastic Scalability Limited (50) simultaneous process executions
Shared Infrastructure Governance limits and fixed resource allocations which
impact scalability.
Support for high-transaction-volume integrations No custom configurations for the environment
Built-in disk space monitoring features No control on the environment
Seamless Forked execution of processes
Easy migration of existing integrations
1. Migrate to Boomi Public Atom Cloud, contd.
24. 5 Cloud Migration Strategies, contd.
2. Adopt and Migrate to a Hybrid
Integration Architecture
• Use Hybrid Integration Architecture with cloud
and on-premise footprint.
• Reverse Invoke from local atom to cloud (no
need to open firewall ports)
• Well Suited for brand new implementations.
• Success depends on the quality Integration
architecture and strategy.
Salesforce
Other SaaS
applications
Dell Boomi
Atmosphere Platform
Boomi
Atom Cloud
Trading
Partners
NetSuite
SAP DB
Other Enterprise
Applications
Disk File
System
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Corporate Firewall
DMZ256-bit encryption
(metadata only)
Local Atom /
Cloud gateway
25. 5 Cloud Migration Strategies, contd.
2. Adopt and Migrate to a Hybrid Integration Architecture, contd.
Advantages Caution
Typical industry reference architecture for Hybrid Integration with
footprint in cloud and on-premise applications.
Potential rework if not strategized or architected
properly originally.
Solves the technical and functional limitations of public cloud. Architectural complexities about how much capacity to
maintain on-premise and for each integration.
Elastic scalability Different set of Operational challenges regarding
upgrades monitoring controls etc.
Citizen Integrator development No control on the cloud environment
26. 5 Cloud Migration Strategies, contd.
3. Migrate to Customer’s Private Cloud.
• This option is same as that of the Lift and
Shift approach.
• E.g., Refer to AWS provides quick reference
template for all the required components* of
Boomi Molecule Installation.
• Refer to https://aws-
quickstart.s3.amazonaws.com/quickstart-
boomi-molecule/doc/boomi-molecule-on-
the-aws-cloud.pdf
• From a cost optimization and Load balancer perspective, this can be refined further
using latest solutions available.
27. 5 Cloud Migration Strategies, contd.
3. Migrate to Customer’s Private Cloud contd.
Advantages Caution
Quick and easy to install with Complete control Customer must manage Application and cloud Infrastructure and
the cost efficiency strategies.
Easy to migrate existing integrations to cloud Similar Scalability concerns like on-premise environment.
Cloud infrastructure is generally more efficient than on-prem. As the number of nodes increase under the molecule, other
unforeseen operational complexities may show up.
Serves as the opportunity to migrate from Windows OS to Linux.
Linus OS is relatively more stable than Windows.
Horizontal scalability only and vertical scalability is not possible, and
horizontal scalability might need additional Boomi licenses.
Improved monitoring
28. 5 Cloud Migration Strategies, contd.
Containerize the on-premise Boomi
platform and deploy on to private cloud
environment and leverage Kubernetes
container orchestration for handling elastic
scalability needs.
4. Containerize the on-premise Boomi
platform / Future – Emerging approach
29. 5 Cloud Migration Strategies
Advantages Caution
Both hardware and software can be scaled on-demand
automatically.
Both Application and Infrastructure maintenance are
under the organization’s scope.
Unlimited scalability with complete control within the hands of the
organization.
Increased Complexity and need for strong technical
competence.
Quick start template available for Boomi Kubernetes Molecule on AWS Stay watchful on the licenses with horizontal scalability
This is yet an evolving solution with limited support.
Without robust CI-CD implementation controls in
place, containerization of applications and replication
can cost huge for regression testing of applications.
4. Containerize the on-premise Boomi platform / Future – Emerging approach, Contd.
30. 5 Cloud Migration Strategies, contd.
5. Adopt and Migrate to Boomi’s Managed Private Atom cloud
Note: Compare the cost of managed private atom cloud against, the current cost of AWS +
direct and indirect costs for in-house maintenance of AWS infrastructure + software and the technical expertise needed.
Salesforce
Other SaaS
applications
Dell Boomi
Atmosphere Platform
Trading
Partners
NetSuite
SAP DB Other Enterprise
Applications Disk File System
Corporate Firewall
Private Atom
Cloud Managed services
VPN
Amazon Direct
Connect
31. 5 Cloud Migration Strategies, contd.
5. Adopt and Migrate to Boomi’s Managed Private Atom cloud
Advantages Disadvantages
Zero-Footprint strategy. Subscription Cost could be higher*.
Unlimited scalability to meet higher API volumes, larger ETL workloads and
more simultaneous executions.
Limited control over the environment and need to work with
Dell Boomi MCS (managed cloud services) support team to
handle special requests.
Get rid off operational challenges & maintenance costs
Eliminate the need for strong technical competence and/or the investment
in monitoring tools, administration and performance management.
Note: Compare the cost of managed private atom cloud against, the current cost of cloud + direct and indirect costs
for in-house maintenance of cloud infrastructure + software and the technical expertise needed.
32. • Drivers for Cloud Migration.
• Boomi Crowdsourcing
Functionality.
• 5 ways to migrate Molecule to
Cloud and their pros & cons.
• Boomi Managed Cloud Services
(MCS).
• Molecule Migration to AWS, Azure
or GCP.
• What’s new in Boomi?
Boomi Molecule Cloud Migration
PART - 2
Welcome Brian Kelly from Boomi to the talk
35. Dell Boomi Managed Services Offerings
Managed Cloud Service
Premium service where Boomi provisions, monitors, manages & tunes a
dedicated virtual private cloud on behalf of a customer.
VPCs can either be hosted on Amazon’s AWS or Microsoft Azure
Process Monitoring & Management
Premium service where Boomi proactively monitors, resolves errors &
manages integration processes in production on customer’s behalf
Service applies to EDI (aka EDIaaS), as well as non EDI customers
and applies to cloud as well as on-premise hosted customers.
36. MCS Value Add & Capabilities
Disaster Recovery (for
Prod)High Availability
Extensible ArchitectureFlexible Release
Scheduling
Scalability
Managed Cloud
Consultation and 24/7
Support
Security Automation &
Infrastructure As Code
Self Service
Monitoring &
Analytics
Connect To Anywhere
37. Design
Architect cloud to best
fit the unique
requirements – single
or multi-tenant
Delivery
From procurement to
installation – hardware,
software, VPN/Peering
Maintenance
Ongoing monitoring
and fine tuning for
optimal performance
MCS Engagement Phases
39. GO DIGITAL WITH KELLTON TECH
3
Contact Us
brad.williams@kelltontech.com
ask@kelltontech.com
Siva – 513.365.2034
Brad – 732.639.5795
www.kelltontech.com
Editor's Notes
Here is a little introduction slide talking about our abilities working on the Digital Transformation enablers of the businesses starting with the EAI and B2B Integrations, API Strategy and End to End API life cycle management solutions and Internet of Things and the Process Improvement, Automation, Data and Analytics and Cloud Enablement. We are veterans in the Integration space and pioneers in the IoT implementations, with a lot of enterprise scope implementations.
“We are small enough to care for your custom needs and big enough to handle engagements and being your strategy partners”
Boomi’s unified enterprise application platform is a true multi-purpose PaaS, starting with integration capabilities to Master Data Management and Flow development.
Boomi’s journey started with B2B/EDI Integration applications and expanded its wings to Integration platform as a service (iPaaS) that is intelligent, flexible, and scalable integration platform that accelerates your business by making information, interactions and innovations flow faster. It supports all application integration processes - between cloud platforms, software-as-a-service applications, and on-premise systems. If someone is looking for modernizing B2B environment or the EDI processes, then I would recommend to have Boomi on top of your list for evaluation.
API Management
Boomi API Management provides a unified full life cycle API Management platform that can manage the end-to-end life cycle of the APIs.
Boomi Flow
Flow provides a low-code development platform to create customer journeys and automate workflows — from simple to sophisticated.
Master Data Hub: Boomi Master Data Hub is a Master data management tool that can help to maintain data integrity, enables you to keep the data clean, accurate, and consistent.
At the core of the Boomi platform are self-service data catalog, discovery and preparation tools to empower business users. With automation and intelligence, Boomi predicts the context of the data for business users to understand where the data resides and ingest into visualization and analytics.
Industry Credibility based on the Market Research companies like Gartner and Forrester.
Boomi Connectors:
Boomi Integration connectors are the main component that facilitate integration and contain all the information that is needed to connect to a data source or application. Connectors enable you to easily connect and integrate third-party applications, such as Salesforce to NetSuite, to send and receive data between them.
Application Connectors – Application connectors provide connectivity to specific software applications such as Netsuite, Salesforce, SAP, or Amazon.
Technology Connectors – Technology connectors provide connectivity to and from web applications, on-premise applications, and common data repositories using various protocols (including HTTP, FTP, JMS, DB, FTP, AS2 etc.) using a standard data transport method or generic data driver.
Custom Connectors – Ability to create custom connectors for systems which doesn’t have connectors available. E.g., Create a custom connector for Stripe.
Event Driven Connectors –Enables Event Driven architecture-based integration solutions for various events generated from Devices, Cloud or On-premise systems.
Boomi’s license is dependent on number of connectors and free of number of cores, transaction volume usage etc.
The Boomi Molecule is a single-tenant, clustered Atom that allows for multiple Atom processes to run concurrently.
Meant for Clustering of the Atoms -
Load balancing the transactions.
High availability for business continuity.
Scalability through Multi-threading and simultaneous processing.
Increased performance.
One node elected as head node for administrative functions such as, that retrieves messages from Atomsphere platform, load balances the transactions among available nodes, maintains and reports health to AtomSphere etc.
Shared Storage Requirements:
All nodes that are part of it must be using the same installation directory.
File system must be of same OS as that of individual nodes.
E.g., An NFS file system with NFS locking enabled (NLM support) or A Windows network share or drive
Why Shared Storage?
Clustering of the independent runtimes (Atoms) need a mechanism to work in conjunction with each other for -
Context sharing.
Resources sharing.
Stage the temporary working data documents from all the cluster nodes*.
According to our information, several customers are using Dell Boomi Atom/Molecule runtimes installed on-premises and even considerable number of customers are running their molecule nodes on the Windows Operating System.
Caution: Our observation is that this combination can be a suspect!!
On-premises installation can make your integration architecture rigid from scalability, time-to-market perspective, and -
The Molecule installation on Windows OS can contribute to unexpected operational challenges* that may be difficult to identify and troubleshoot.
Wondering why would something like “java.lang.NoClassDefFoundError: org/codehaus/groovy/control/Phases” or “WRITE_FAILURE” or “UNKNOWN_ERROR” or similar errors occur frequently?
Why are my Molecule nodes getting restarted automatically?
Molecule nodes are logging huge data, which is difficult to download or analyze!
Molecule went offline (is red in the platform), but nodes are still running on the server or Molecule nodes frequently going down.
Do you or Did you spend longer times in SWAT meetings among various teams like Integration, Network, Open Systems, DB etc., for troubleshooting?
Potential reasons for some of these issues can be attributed to -
Disk latency/contention on the shared storage server.
Bulky processes such as, Virus scans or scheduled system backup processes or automated vulnerability patching on the server could be resource consuming on the shared storage server.
This problem could be more severe with large file and large volume file processing.
Molecule architecture has heavy I/O processing needs to read/write the working data files to storage and If Shared storage is used for this purpose, that’s a red flag!
Race around for resources from other applications sharing the same infrastructure as that of Shared storage.
If you Increase the number of Atoms or nodes of the Molecule, then it will be compromise on operational stability.
If you over provision hardware, then it will be compromise on the cost.
If you choose to build side-by-side stack of infrastructure, it will be a compromise on the Agility.
If you address operational stability, it will be a compromise on elastic scalability.
Predictive Assistance: Patented Innovation for Customer SuccessPredictive Assistance is Boomi’s patented innovation where it integrates near-real-time customer usage metrics, such as amount of data flowing through integrations and active updates to integrations, with Dell Boomi’s customer relationship management (CRM) system. The Dell Boomi Client Services team proactively reaches out to customers whose usage metrics indicate that an engagement can increase their success and optimize their use of the Boomi integration platform.
, hosted and managed cloud offering from Dell Boomi. Please find more details on Boomi Atom Cloud documentation.
Zero-Footprint strategy.
Caution: 1 GB of volume / month at no charge, additional charges will apply if you exceed this limit*.
99.99% availability.
Cannot access on-premise enterprise applications
Both hardware and software can be elastically scaled on-demand automatically by managed services along with support for load balancing and failover support
Each account is limited to running 50 simultaneous process executions.
Multi-tenant model reduces the infrastructure costs incurred by Daylight, since the cost is shared with other customers of Boomi.
Governance limits and fixed resource allocations which impact scalability.
Support for high-volume transaction integrations
Runtime configuration options such as scripts, encodings, libraries, cannot be customized by tenants/users.
Built-in disk space monitoring features
Managed services control the forked execution of processes for Performance improvement
Easy migration of existing integrations into Public Cloud environment
Most popular among others
Existing Integrations should be redesigned and redeveloped to fit the Hybrid integration model, where on-premise applications connecting integrations are to be developed and deployed on local Boomi installation and Internet application connections to be developed and deployed on Public cloud atom. (It helps immensely to develop decision trees in advance in alignment with organizational strategies and security policies, cloud or on-premise gravity)
Solves the technical and functional limitations of public cloud can be handled in the on-premise installation and leverage Boomi public atom cloud for connectivity with B2B partners, SaaS applications and for elastic scalability.
Both hardware and software can be elastically scaled on-demand automatically by managed services along with support for load balancing and failover support
Different set of Operational challenges such as, upgrades for Cloud and on-premise should be synchronized, requirements for separate monitoring controls on cloud and local installations and logs aggregation for capturing metrics etc.
Brian Kelly would provide further details on AWS – Boomi technology partnership and how they help customers.
both infrastructure and applications using AWS’ CloudWatch service to aggregate logs and create insightful dashboards for visualization, detect anomalies using AWS’ Machine Learning capabilities.
Boomi Kubernetes Molecule on AWS uses Amazon Elastic Kubernetes Service (Amazon EKS) to help add or remove nodes as dictated by resource demands. This allows the Molecule to elastically add nodes to meet high-volume demands and remove those nodes when they are no longer required to support operational efficiency and cost-savings efforts.
Both application and Infrastructure maintenance and managing cost efficient strategies are still under the scope of the Customer.
Increased Complexity and need for strong technical competence.
Managing component licenses during the replication of containers is still under the scope of Daylight.
Dell Boomi support for Kubernetes or other container orchestration tools is limited.
Without strong CI-CD implementation controls in place, containerization of applications and replication can cost huge for regression testing of applications.
Boomi Kubernetes Molecule on AWS uses Amazon Elastic Kubernetes Service (Amazon EKS) to help add or remove nodes as dictated by resource demands. This allows the Molecule to elastically add nodes to meet high-volume demands and remove those nodes when they are no longer required to support operational efficiency and cost-savings efforts.
Both application and Infrastructure maintenance and managing cost efficient strategies are still under the scope of the Customer.
Increased Complexity and need for strong technical competence.
Managing component licenses during the replication of containers is still under the scope of Daylight.
Dell Boomi support for Kubernetes or other container orchestration tools is limited.
Without strong CI-CD implementation controls in place, containerization of applications and replication can cost huge for regression testing of applications.