This session will give a quick overview of Enterprise Integration starting with a brief history of integration, different integration styles, introduction to API led connectivity and MuleSoft Anypoint Platform demonstration. This session will be useful for anyone aspiring to be a software engineer who want to step into the world of Integration and for any Integration Specialist who want to learn about API led connectivity and MuleSoft Anypoint Platform Capabilities.
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
#1 Calicut MuleSoft Meetup - Introduction to Enterprise Integration and MuleSoft
1. 19th June 2021
Calicut MuleSoft Meetup Group
Introduction to Enterprise Integration and MuleSoft
2. Organizers
Fathima Farzana John Mathew Philip
NJC Labs
NJC Labs
MuleSoft / Integration Developer MuleSoft / Integration
Developer
2
3. 3
● Introductions
● Understanding System Integration
● Challenges in Integration
● History and Various approaches in Integration
● Modern Approach with API Led Connectivity
● Introduction to Anypoint Platform
● Opportunities in Anypoint Platform
Agenda
5. Speakers
○ Senior MuleSoft Instructor
○ Senior Integration Architect
○ 20+ yrs of experience in IT
○ MuleSoft Certified Architect
○ MuleSoft Senior Instructor APAC
5
Sivadas K Ramdas
6. What is System Integration for Beginners
Understanding System Integration
7. 7
What is integration?
● Moving Data from Point A to Point B
Messaging Patterns
» Integration Styles
» File Transfer
https://www.enterpriseintegrationpatterns.com/patterns/messaging/FileTransferIntegration.html
8. Thats Easy Right ?
● Moving Data Physically from Point A to Point B
● Common use case Backup & Data Migration
Floppy Disks DVD Pendrive Portable Hard Disks Magnetic Tapes
1.44 MB 4.7 GB 8 GB to 64 GB+ 16 TB HDD 15 TB TO Petabytes ( Library )
9. Much Easier ?
● With Cloud Storage Systems Petabytes of Storage
10. When Data is Really Large ?
Let’s do the Math?
100 PB = 10,48,57,600 GB
Network Speed 10 GB / second
Approximate Time to Transmit the Data from Point A to Point B on a 10 GB Per
Second Network ? 3 Months
10,48,57,600 GB / = 10,485,760 Seconds
/ 86400
= 121.362 Days
10 GB / Sec
Consider Reliability, Security
11. What about a Data center ?
● When the Data is Really Large.
AWS Snowball AWS Snowmobile
80 Terabytes 100 Petabyte
12. 12
The File Based Integration
● Oldest of the Integration Styles, Still Relevant
○ Commonly used in Data Migration
○ Energy Efficient when Its just Storing Data for Long Duration of Time
○ Backup & Restore data
○ ETL ( Extract, Transform, Load )
○ Logs, Analytics, Machine Learning, Big Data
● Drawbacks
○ Searching a Record in a thousands of files is like, Searching a Needle in Haystack
○ Reliability
○ Performance
○ Limitations with concurrent access to files for Read / Write Operations
○ Dependency on Hardware and complexities of big-endian (BE) or little-endian (LE)
○ Cost
○ File Size
13. Is really good but we need Translators !
● File formats, Hardware Dependencies, Software Dependencies, Incompatible Standards
● Realtime data requirements
● https://en.wikipedia.org/wiki/List_of_file_formats
13
Messaging Patterns
» Messaging Systems
» Message Translator
14. But Files Needed to be Shared!
● Remote Terminals / Mainframes
14
17. Little User Friendly, Shared, Distributed?
Copies of Same Application, Accessing Same Database
Different Applications, Accessing Same Database
17
Messaging Patterns
» Integration Styles
» Shared Database
18. We need more Control on Data
Rise of ERP Systems
Stored Procedures
18
Messaging Patterns
» Integration Styles
» Shared Database
19. Internet, WWW and Web Applications
● Access Information from Anywhere
● JSP, ASP, PHP, Perl
19
Messaging Patterns
» Integration Styles
» Shared Database
20. Rise of Cloud & Containerization
● Let's put it all in the Cloud
● Scalability
● Availability
● Cost
20
22. 22
● Different Systems
● Different Architectural Styles
● Different Data Formats
● Different Interfaces
But
● Data Need to be Consistent
● Data Need to be Synchronised
● Data Needs to be Available
● Data Needs to be Accessible
Now
● Information needs to be inferred from Data (Machine Learning)
Its Complex
23. 23
● 65 Patterns
Connecting Systems Integration Patterns
https://www.enterpriseintegrationpatterns.com/patterns/messaging/
25. 25
Point to Point
● Hard to Maintain
● Tight Coupling
● Breaks with Even
Small Changes
26. 26
SOA - Service Oriented Architecture
https://www.cio.com/article/2434865/top-10-reasons-why-people-are-making-soa-fail.html
Software provides or enables or support a Service
27. 27
Microservices
Break it down to Smaller Services
● Governance
● Visibility
● Dependencies
https://www.youtube.com/watch?v=CZ3wIuvmHeM
Mastering Chaos - A Netflix Guide to Microservices
30. 30
API Led Connectivity
● A Simple Combination of API’s in Layers
● An Architectural Style,
○ API’s First
● System Layer API’s Abstract Backend Systems
● Process Layer API’s Orchestrate Business Logic
● Experience Layer API’s Exposes Service
● Easy to Govern, Maintain and Scale
● Easy to build with Anypoint Platform & Toolings
34. 34
Free Self Paced Training Resources for Getting You Started.
● https://training.mulesoft.com/course-catalog?results=true&courseFormat=Self-paced
Instructor Led Training Programs
● https://training.mulesoft.com/course-catalog?results=true&courseFormat=Instructor-led
Learn & Get Certified
36. Who is the Founder of MuleSoft ?
A - David Duffield
B - Parker Harris
C - Ross Mason
D - Tim Berglund
36
37. Which of the following is not the default port of a Database?
A - 3306 - MySQL
B - 1423 - Microsoft SQL
C - 5432 - PostgreSQL
D - 27017 -MongoDB
37
38. Maximum no of records that can be upserted in a go using SFDC UPSERT connector?
A - 200
B - 350
C - 400
D - 300
38
39. 39
● Share:
○ Tweet using the hashtag #MuleSoftMeetups and #CalicutMuleSoftMeetups
○ Invite your network to join: https://meetups.mulesoft.com/calicut/
● Feedback:
○ Fill out the survey feedback and suggest topics for upcoming events
○ Contact MuleSoft at meetups@mulesoft.com for ways to improve the program
What’s next?