[NYC] MuleSoft Meetup Group
MuleSoft Batch Processing
10th April, 2021
2
Host
Neeraj Kumar
ERP Development and
Integration Architect
Casper, NYC
About the speaker:
⮚ Working as ERP and Integration Architect @Casper, NYC.
⮚ 13.5+ Years of Experience in Oracle ERP and Integrations.
⮚ Managed multiple End to End Integration projects with ERP.
⮚ Certified MuleSoft Developer.
Safe Harbor Statement
• Both the speaker and host are organizing this meet up in individual capacity only.
We are not representing our companies here.
• This presentation is strictly for learning purpose only. Organizer/Presenter do not
hold any responsibility that same solution will work for your business
requirements also.
• This presentation is not meant for any promotional activities.
4
Speakers
Chetan Joshi
Lead Engineer
Apisero Inc
About the speaker:
⮚ Working as Lead Engineer at Apisero Inc.
⮚ Indore- India MuleSoft Meetup Leader.
⮚ Certified MuleSoft Integration Architect
Mule 4
Batch Processing
6
● Jobs that can run without end user interaction, or can be scheduled to run as resources permit
● Is a method of running high-volume, repetitive data jobs. The batch method allows users to process data when computing
resources are available, and with little or no user interaction.
● Is the processing of transaction in a group or batch. No user interaction is required once batch processing is underway.
What is Batch Processing?
7
● Synchronizing data sets between business applications, such as syncing contacts between NetSuite and Salesforce.
● Extracting, transforming and loading (ETL) information into a target system, such as uploading data from a flat file (CSV) to
Hadoop.
● Handling large quantities of incoming data from an API into a legacy system.
Why/When Batch Processing?
8
Components provided by Mule:
Batch Processing in Mule 4
9
Batch Processing in Mule 4
10
● Load and Dispatch.
● Process.
● On Complete
Batch Processing Phases
11
● Implicit (Behind the Scenes)
● Creates Batch Job Instance (can access through vars.batchJobInstanceId )
● Creates a persistent queue (prefix BSQ)
Load and Dispatch Phase
12
● Batch Step
● Async
● After processing a record in a step it moves back to Queue and state(stage) us updated.
● May create more internal queues ( when using Aggregator)
Process Phase
13
Process Phase
14
● States
On Complete Phase
15
DEMO
Get ready to WIN a Special Gift from MuleSoft Community
Quiz Time
Question 1
Which of the following scheduling strategies NOT supported by batch processing?
A. Ordered Sequential
B. Shortest Job Next
C. Round Robin
D. All of the above are supported.
17
Question 2
Which of the following takes the precedence in Batch Step?
A. Accept Expression
B. Accept Policy
18
Question 3
What type of queues are created by batch job ?
A. Transient
B. Persistent
19
20
Share:
○ Tweet your pictures using the hashtag #NYCMuleSoftMeetup
○ Invite your network to join: https://meetups.mulesoft.com/new-york-city/
Feedback:
○ Fill out the survey feedback and suggest topics for upcoming events
○ Contact MuleSoft at meetups@mulesoft.com for ways to improve the program
○ Reach out to Neeraj Kumar (Host) to suggest topics for next Meetup
What’s next?
21
Topic: Deep Dive on Continuous Integration and Continuous Delivery ( CI / CD )
Date: Saturday, May 1st 2021, 11AM EDT
Speaker: Naimish Kakkad and Akshay Gupta
https://meetups.mulesoft.com/events/details/mulesoft-new-york-city-presents-deep-dive-on-continuous-integrationci-and-continuous-
deliverycd/
Topic: AWS S3 Integration with MuleSoft
Date: Saturday, May 15th 2021, 11AM EDT
Speaker: Tirthankar Kundu
https://meetups.mulesoft.com/events/details/mulesoft-new-york-city-presents-integrating-mulesoft-with-aws-s3-buckets/
Upcoming Meetups
Thank you

Batch Processing with Mule 4

  • 1.
    [NYC] MuleSoft MeetupGroup MuleSoft Batch Processing 10th April, 2021
  • 2.
    2 Host Neeraj Kumar ERP Developmentand Integration Architect Casper, NYC About the speaker: ⮚ Working as ERP and Integration Architect @Casper, NYC. ⮚ 13.5+ Years of Experience in Oracle ERP and Integrations. ⮚ Managed multiple End to End Integration projects with ERP. ⮚ Certified MuleSoft Developer.
  • 3.
    Safe Harbor Statement •Both the speaker and host are organizing this meet up in individual capacity only. We are not representing our companies here. • This presentation is strictly for learning purpose only. Organizer/Presenter do not hold any responsibility that same solution will work for your business requirements also. • This presentation is not meant for any promotional activities.
  • 4.
    4 Speakers Chetan Joshi Lead Engineer ApiseroInc About the speaker: ⮚ Working as Lead Engineer at Apisero Inc. ⮚ Indore- India MuleSoft Meetup Leader. ⮚ Certified MuleSoft Integration Architect
  • 5.
  • 6.
    6 ● Jobs thatcan run without end user interaction, or can be scheduled to run as resources permit ● Is a method of running high-volume, repetitive data jobs. The batch method allows users to process data when computing resources are available, and with little or no user interaction. ● Is the processing of transaction in a group or batch. No user interaction is required once batch processing is underway. What is Batch Processing?
  • 7.
    7 ● Synchronizing datasets between business applications, such as syncing contacts between NetSuite and Salesforce. ● Extracting, transforming and loading (ETL) information into a target system, such as uploading data from a flat file (CSV) to Hadoop. ● Handling large quantities of incoming data from an API into a legacy system. Why/When Batch Processing?
  • 8.
    8 Components provided byMule: Batch Processing in Mule 4
  • 9.
  • 10.
    10 ● Load andDispatch. ● Process. ● On Complete Batch Processing Phases
  • 11.
    11 ● Implicit (Behindthe Scenes) ● Creates Batch Job Instance (can access through vars.batchJobInstanceId ) ● Creates a persistent queue (prefix BSQ) Load and Dispatch Phase
  • 12.
    12 ● Batch Step ●Async ● After processing a record in a step it moves back to Queue and state(stage) us updated. ● May create more internal queues ( when using Aggregator) Process Phase
  • 13.
  • 14.
  • 15.
  • 16.
    Get ready toWIN a Special Gift from MuleSoft Community Quiz Time
  • 17.
    Question 1 Which ofthe following scheduling strategies NOT supported by batch processing? A. Ordered Sequential B. Shortest Job Next C. Round Robin D. All of the above are supported. 17
  • 18.
    Question 2 Which ofthe following takes the precedence in Batch Step? A. Accept Expression B. Accept Policy 18
  • 19.
    Question 3 What typeof queues are created by batch job ? A. Transient B. Persistent 19
  • 20.
    20 Share: ○ Tweet yourpictures using the hashtag #NYCMuleSoftMeetup ○ Invite your network to join: https://meetups.mulesoft.com/new-york-city/ Feedback: ○ Fill out the survey feedback and suggest topics for upcoming events ○ Contact MuleSoft at meetups@mulesoft.com for ways to improve the program ○ Reach out to Neeraj Kumar (Host) to suggest topics for next Meetup What’s next?
  • 21.
    21 Topic: Deep Diveon Continuous Integration and Continuous Delivery ( CI / CD ) Date: Saturday, May 1st 2021, 11AM EDT Speaker: Naimish Kakkad and Akshay Gupta https://meetups.mulesoft.com/events/details/mulesoft-new-york-city-presents-deep-dive-on-continuous-integrationci-and-continuous- deliverycd/ Topic: AWS S3 Integration with MuleSoft Date: Saturday, May 15th 2021, 11AM EDT Speaker: Tirthankar Kundu https://meetups.mulesoft.com/events/details/mulesoft-new-york-city-presents-integrating-mulesoft-with-aws-s3-buckets/ Upcoming Meetups
  • 22.