SlideShare a Scribd company logo
1 of 11
Batch Processing
Mule possesses the ability to process messages in batches. Within
an application, you can initiate a batch job which is a block of code
that splits messages into individual records, performs actions upon
each record, then reports on the results and potentially pushes the
processed output to other systems or queues. This functionality is
particularly useful when working with streaming input or when
engineering "near real-time" data integration between SaaS
applications.
• For example, batch processing is particularly useful
when working with the following scenarios:
• integrating data sets, small or large, streaming or not,
to parallel process records
• synchronizing data sets between business applications,
such as syncing contacts between Netsuite and
Salesforce, effecting "near real-time"data integration
• extracting, transforming and loading (ETL) information
into a target system, such as uploading data from a flat
file (CSV) to Hadoop
• handling large quantities of incoming data from an API
into a legacy system
• A batch job is a top-level element in Mule
which exists outside all Mule flows. Batch jobs
split large messages into records which Mule
processes asynchronously in a batch job; just
as flows process messages, batch jobs process
records.
• A batch job contains one or more batch steps which, in
turn, contain any number of message processors that
act upon records as they move through the batch job.
During batch processing, you can use record-level
variables (recordVars) and MEL expressions to enrich,
route or otherwise act upon records.
• The heart of Mule’s batch processing functionality lies
within the batch job. In an application, the batch job
element exists outside the context of any regular Mule
flow. It is a block of code which contains one or
more batch steps which, as the label implies, process
items step-by-step in a sequential order.
Create a project bacth_processing
Drag the batch into palette
Drag DB component and specify
connectivity
XML Here
output
Batch Job vs. Batch Job Instance
•
• Though defined in context above, it’s worth elaborating upon the
terms batch job and batch job instance as they relate to each other.
• A batch job is the top-level element in an application in which Mule
processes a message payload as a batch of records. The term batch
job is inclusive of all four phases of processing: Input, Load and
Dispatch, Process, and On Complete.
• A batch job instance is an occurrence in a Mule application
resulting from the execution of a batch job in a Mule flow; Mule
creates the batch job instance in the Load and Dispatch, and
persists eternally.

More Related Content

What's hot

Mule message structure
Mule message structureMule message structure
Mule message structureSrilatha Kante
 
Developing Oracle Connector Using Mule
Developing Oracle Connector Using MuleDeveloping Oracle Connector Using Mule
Developing Oracle Connector Using Muleirfan1008
 
Mule anypoint connector dev kit
Mule  anypoint connector dev kitMule  anypoint connector dev kit
Mule anypoint connector dev kitD.Rajesh Kumar
 
Oracle connector
Oracle connectorOracle connector
Oracle connectorMohammed246
 
Logging best practice in mule using logger component
Logging best practice in mule using logger componentLogging best practice in mule using logger component
Logging best practice in mule using logger componentGovind Mulinti
 
How to – wrap soap web service around a database
How to – wrap soap web service around a databaseHow to – wrap soap web service around a database
How to – wrap soap web service around a databaseSon Nguyen
 
(ATS6-APP05) Deploying Contur ELN to large organizations
(ATS6-APP05) Deploying Contur ELN to large organizations(ATS6-APP05) Deploying Contur ELN to large organizations
(ATS6-APP05) Deploying Contur ELN to large organizationsBIOVIA
 
Deploying mule applications
Deploying mule applicationsDeploying mule applications
Deploying mule applicationsBhargav Ranjit
 
Custom connector development using mule DevKit
Custom connector development using mule DevKitCustom connector development using mule DevKit
Custom connector development using mule DevKitRamakrishna Narkedamilli
 
Mule database-connectors
Mule database-connectorsMule database-connectors
Mule database-connectorsPhaniu
 
Features of Mule SAP Connector
Features of Mule SAP ConnectorFeatures of Mule SAP Connector
Features of Mule SAP ConnectorSanjeet Pandey
 
Anypoint connector Roadmap
Anypoint connector RoadmapAnypoint connector Roadmap
Anypoint connector Roadmapdanishsm84
 
(ATS6-DEV05) Building Interactive Web Applications with the Reporting Collection
(ATS6-DEV05) Building Interactive Web Applications with the Reporting Collection(ATS6-DEV05) Building Interactive Web Applications with the Reporting Collection
(ATS6-DEV05) Building Interactive Web Applications with the Reporting CollectionBIOVIA
 
Java Basics
Java BasicsJava Basics
Java BasicsKhan625
 
MuleEsb Complete integration and middleware solution
MuleEsb Complete integration and middleware solutionMuleEsb Complete integration and middleware solution
MuleEsb Complete integration and middleware solutionRajkattamuri
 

What's hot (19)

Mule oracle connectors
Mule oracle connectorsMule oracle connectors
Mule oracle connectors
 
Mule message structure
Mule message structureMule message structure
Mule message structure
 
Developing Oracle Connector Using Mule
Developing Oracle Connector Using MuleDeveloping Oracle Connector Using Mule
Developing Oracle Connector Using Mule
 
Mule anypoint connector dev kit
Mule  anypoint connector dev kitMule  anypoint connector dev kit
Mule anypoint connector dev kit
 
Oracle connector
Oracle connectorOracle connector
Oracle connector
 
Logging best practice in mule using logger component
Logging best practice in mule using logger componentLogging best practice in mule using logger component
Logging best practice in mule using logger component
 
Mule connectors
Mule  connectorsMule  connectors
Mule connectors
 
How to – wrap soap web service around a database
How to – wrap soap web service around a databaseHow to – wrap soap web service around a database
How to – wrap soap web service around a database
 
(ATS6-APP05) Deploying Contur ELN to large organizations
(ATS6-APP05) Deploying Contur ELN to large organizations(ATS6-APP05) Deploying Contur ELN to large organizations
(ATS6-APP05) Deploying Contur ELN to large organizations
 
Deploying mule applications
Deploying mule applicationsDeploying mule applications
Deploying mule applications
 
Custom connector development using mule DevKit
Custom connector development using mule DevKitCustom connector development using mule DevKit
Custom connector development using mule DevKit
 
Mule database-connectors
Mule database-connectorsMule database-connectors
Mule database-connectors
 
Features of Mule SAP Connector
Features of Mule SAP ConnectorFeatures of Mule SAP Connector
Features of Mule SAP Connector
 
Anypoint connector Roadmap
Anypoint connector RoadmapAnypoint connector Roadmap
Anypoint connector Roadmap
 
Anypoint connector basics
Anypoint connector basicsAnypoint connector basics
Anypoint connector basics
 
(ATS6-DEV05) Building Interactive Web Applications with the Reporting Collection
(ATS6-DEV05) Building Interactive Web Applications with the Reporting Collection(ATS6-DEV05) Building Interactive Web Applications with the Reporting Collection
(ATS6-DEV05) Building Interactive Web Applications with the Reporting Collection
 
Mule groovy
Mule groovyMule groovy
Mule groovy
 
Java Basics
Java BasicsJava Basics
Java Basics
 
MuleEsb Complete integration and middleware solution
MuleEsb Complete integration and middleware solutionMuleEsb Complete integration and middleware solution
MuleEsb Complete integration and middleware solution
 

Similar to Mulesoft anypoint batch processing

Batch processing
Batch processingBatch processing
Batch processingHarish43
 
Batch processing
Batch processingBatch processing
Batch processingHarish43
 
Batch processing
Batch processingBatch processing
Batch processingbapiraju
 
Mule chapter2
Mule chapter2Mule chapter2
Mule chapter2mha4
 
Mule concepts
Mule conceptsMule concepts
Mule conceptsThang Loi
 
Mule concepts
Mule conceptsMule concepts
Mule conceptsSindhu VL
 
Anypoint Batch Processing and Polling Scope With Mulesoft
Anypoint Batch Processing and Polling Scope With MulesoftAnypoint Batch Processing and Polling Scope With Mulesoft
Anypoint Batch Processing and Polling Scope With MulesoftJitendra Bafna
 
Batch job processing
Batch job processingBatch job processing
Batch job processingSon Nguyen
 
Runing batch job in mule
Runing batch job in muleRuning batch job in mule
Runing batch job in muleSon Nguyen
 
Mule batch processing
Mule batch processingMule batch processing
Mule batch processingAnand kalla
 
Mule batch processing
Mule batch processingMule batch processing
Mule batch processingPhaniu
 

Similar to Mulesoft anypoint batch processing (20)

Mule batch processing
Mule batch processingMule batch processing
Mule batch processing
 
Batch processing
Batch processingBatch processing
Batch processing
 
Batch processing
Batch processingBatch processing
Batch processing
 
Batch processing
Batch processingBatch processing
Batch processing
 
Mule chapter2
Mule chapter2Mule chapter2
Mule chapter2
 
Mule concepts
Mule conceptsMule concepts
Mule concepts
 
Mule concepts
Mule conceptsMule concepts
Mule concepts
 
Anypoint Batch Processing and Polling Scope With Mulesoft
Anypoint Batch Processing and Polling Scope With MulesoftAnypoint Batch Processing and Polling Scope With Mulesoft
Anypoint Batch Processing and Polling Scope With Mulesoft
 
Mule fundamentals
Mule fundamentalsMule fundamentals
Mule fundamentals
 
Groovy example
Groovy exampleGroovy example
Groovy example
 
Database example
Database exampleDatabase example
Database example
 
Mule batch job
Mule batch jobMule batch job
Mule batch job
 
Mule batch
Mule batchMule batch
Mule batch
 
Batch job processing
Batch job processingBatch job processing
Batch job processing
 
Runing batch job in mule
Runing batch job in muleRuning batch job in mule
Runing batch job in mule
 
Srilekha mule esb
Srilekha mule esbSrilekha mule esb
Srilekha mule esb
 
Data Base Connector
Data Base Connector Data Base Connector
Data Base Connector
 
Mule batch processing
Mule batch processingMule batch processing
Mule batch processing
 
Mule batch processing
Mule batch processingMule batch processing
Mule batch processing
 
Mule esb batch
Mule esb  batchMule esb  batch
Mule esb batch
 

More from akshay yeluru

Basics of Mulesoft Anypoint connector
Basics of Mulesoft Anypoint connectorBasics of Mulesoft Anypoint connector
Basics of Mulesoft Anypoint connectorakshay yeluru
 
Transformers in Mulesoft Anypoint
Transformers in Mulesoft AnypointTransformers in Mulesoft Anypoint
Transformers in Mulesoft Anypointakshay yeluru
 
MQ CONNECTOR IN ANYPOINT STUDIO
MQ CONNECTOR IN ANYPOINT STUDIOMQ CONNECTOR IN ANYPOINT STUDIO
MQ CONNECTOR IN ANYPOINT STUDIOakshay yeluru
 
Mulesoft Cloudhub connector
Mulesoft Cloudhub connectorMulesoft Cloudhub connector
Mulesoft Cloudhub connectorakshay yeluru
 
Mulesoft Munit Testing
Mulesoft Munit TestingMulesoft Munit Testing
Mulesoft Munit Testingakshay yeluru
 
Introduction to mule application
Introduction to mule applicationIntroduction to mule application
Introduction to mule applicationakshay yeluru
 
RAML BASED REST API with Mulesoft anypoint
RAML BASED REST API with Mulesoft anypointRAML BASED REST API with Mulesoft anypoint
RAML BASED REST API with Mulesoft anypointakshay yeluru
 
Mulesoft Aggregator and Spiltter
Mulesoft Aggregator and SpiltterMulesoft Aggregator and Spiltter
Mulesoft Aggregator and Spiltterakshay yeluru
 
Security in mulesoft
Security in mulesoftSecurity in mulesoft
Security in mulesoftakshay yeluru
 
Howtouseforeachcomponent
HowtouseforeachcomponentHowtouseforeachcomponent
Howtouseforeachcomponentakshay yeluru
 
Mulesoftchampionsprogram
MulesoftchampionsprogramMulesoftchampionsprogram
Mulesoftchampionsprogramakshay yeluru
 
Mulesoftmelbasics 150904031330-lva1-app6891
Mulesoftmelbasics 150904031330-lva1-app6891Mulesoftmelbasics 150904031330-lva1-app6891
Mulesoftmelbasics 150904031330-lva1-app6891akshay yeluru
 

More from akshay yeluru (15)

Mulesoft Filters
Mulesoft FiltersMulesoft Filters
Mulesoft Filters
 
Basics of Mulesoft Anypoint connector
Basics of Mulesoft Anypoint connectorBasics of Mulesoft Anypoint connector
Basics of Mulesoft Anypoint connector
 
Transformers in Mulesoft Anypoint
Transformers in Mulesoft AnypointTransformers in Mulesoft Anypoint
Transformers in Mulesoft Anypoint
 
MQ CONNECTOR IN ANYPOINT STUDIO
MQ CONNECTOR IN ANYPOINT STUDIOMQ CONNECTOR IN ANYPOINT STUDIO
MQ CONNECTOR IN ANYPOINT STUDIO
 
Mulesoft Cloudhub connector
Mulesoft Cloudhub connectorMulesoft Cloudhub connector
Mulesoft Cloudhub connector
 
Mulesoft Munit Testing
Mulesoft Munit TestingMulesoft Munit Testing
Mulesoft Munit Testing
 
Mulesfot scopes
Mulesfot scopesMulesfot scopes
Mulesfot scopes
 
Introduction to mule application
Introduction to mule applicationIntroduction to mule application
Introduction to mule application
 
RAML BASED REST API with Mulesoft anypoint
RAML BASED REST API with Mulesoft anypointRAML BASED REST API with Mulesoft anypoint
RAML BASED REST API with Mulesoft anypoint
 
Mulesoft Aggregator and Spiltter
Mulesoft Aggregator and SpiltterMulesoft Aggregator and Spiltter
Mulesoft Aggregator and Spiltter
 
Security in mulesoft
Security in mulesoftSecurity in mulesoft
Security in mulesoft
 
Mulesoft Raml APIs
Mulesoft Raml APIsMulesoft Raml APIs
Mulesoft Raml APIs
 
Howtouseforeachcomponent
HowtouseforeachcomponentHowtouseforeachcomponent
Howtouseforeachcomponent
 
Mulesoftchampionsprogram
MulesoftchampionsprogramMulesoftchampionsprogram
Mulesoftchampionsprogram
 
Mulesoftmelbasics 150904031330-lva1-app6891
Mulesoftmelbasics 150904031330-lva1-app6891Mulesoftmelbasics 150904031330-lva1-app6891
Mulesoftmelbasics 150904031330-lva1-app6891
 

Recently uploaded

Professional Resume Template for Software Developers
Professional Resume Template for Software DevelopersProfessional Resume Template for Software Developers
Professional Resume Template for Software DevelopersVinodh Ram
 
React Server Component in Next.js by Hanief Utama
React Server Component in Next.js by Hanief UtamaReact Server Component in Next.js by Hanief Utama
React Server Component in Next.js by Hanief UtamaHanief Utama
 
Call Us🔝>༒+91-9711147426⇛Call In girls karol bagh (Delhi)
Call Us🔝>༒+91-9711147426⇛Call In girls karol bagh (Delhi)Call Us🔝>༒+91-9711147426⇛Call In girls karol bagh (Delhi)
Call Us🔝>༒+91-9711147426⇛Call In girls karol bagh (Delhi)jennyeacort
 
Recruitment Management Software Benefits (Infographic)
Recruitment Management Software Benefits (Infographic)Recruitment Management Software Benefits (Infographic)
Recruitment Management Software Benefits (Infographic)Hr365.us smith
 
Folding Cheat Sheet #4 - fourth in a series
Folding Cheat Sheet #4 - fourth in a seriesFolding Cheat Sheet #4 - fourth in a series
Folding Cheat Sheet #4 - fourth in a seriesPhilip Schwarz
 
Software Project Health Check: Best Practices and Techniques for Your Product...
Software Project Health Check: Best Practices and Techniques for Your Product...Software Project Health Check: Best Practices and Techniques for Your Product...
Software Project Health Check: Best Practices and Techniques for Your Product...Velvetech LLC
 
What is Fashion PLM and Why Do You Need It
What is Fashion PLM and Why Do You Need ItWhat is Fashion PLM and Why Do You Need It
What is Fashion PLM and Why Do You Need ItWave PLM
 
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...Christina Lin
 
Der Spagat zwischen BIAS und FAIRNESS (2024)
Der Spagat zwischen BIAS und FAIRNESS (2024)Der Spagat zwischen BIAS und FAIRNESS (2024)
Der Spagat zwischen BIAS und FAIRNESS (2024)OPEN KNOWLEDGE GmbH
 
英国UN学位证,北安普顿大学毕业证书1:1制作
英国UN学位证,北安普顿大学毕业证书1:1制作英国UN学位证,北安普顿大学毕业证书1:1制作
英国UN学位证,北安普顿大学毕业证书1:1制作qr0udbr0
 
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideBuilding Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideChristina Lin
 
Automate your Kamailio Test Calls - Kamailio World 2024
Automate your Kamailio Test Calls - Kamailio World 2024Automate your Kamailio Test Calls - Kamailio World 2024
Automate your Kamailio Test Calls - Kamailio World 2024Andreas Granig
 
chapter--4-software-project-planning.ppt
chapter--4-software-project-planning.pptchapter--4-software-project-planning.ppt
chapter--4-software-project-planning.pptkotipi9215
 
What are the key points to focus on before starting to learn ETL Development....
What are the key points to focus on before starting to learn ETL Development....What are the key points to focus on before starting to learn ETL Development....
What are the key points to focus on before starting to learn ETL Development....kzayra69
 
Asset Management Software - Infographic
Asset Management Software - InfographicAsset Management Software - Infographic
Asset Management Software - InfographicHr365.us smith
 
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样umasea
 
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASEBATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASEOrtus Solutions, Corp
 
Unveiling the Future: Sylius 2.0 New Features
Unveiling the Future: Sylius 2.0 New FeaturesUnveiling the Future: Sylius 2.0 New Features
Unveiling the Future: Sylius 2.0 New FeaturesŁukasz Chruściel
 
Implementing Zero Trust strategy with Azure
Implementing Zero Trust strategy with AzureImplementing Zero Trust strategy with Azure
Implementing Zero Trust strategy with AzureDinusha Kumarasiri
 

Recently uploaded (20)

Professional Resume Template for Software Developers
Professional Resume Template for Software DevelopersProfessional Resume Template for Software Developers
Professional Resume Template for Software Developers
 
React Server Component in Next.js by Hanief Utama
React Server Component in Next.js by Hanief UtamaReact Server Component in Next.js by Hanief Utama
React Server Component in Next.js by Hanief Utama
 
Call Us🔝>༒+91-9711147426⇛Call In girls karol bagh (Delhi)
Call Us🔝>༒+91-9711147426⇛Call In girls karol bagh (Delhi)Call Us🔝>༒+91-9711147426⇛Call In girls karol bagh (Delhi)
Call Us🔝>༒+91-9711147426⇛Call In girls karol bagh (Delhi)
 
Recruitment Management Software Benefits (Infographic)
Recruitment Management Software Benefits (Infographic)Recruitment Management Software Benefits (Infographic)
Recruitment Management Software Benefits (Infographic)
 
Folding Cheat Sheet #4 - fourth in a series
Folding Cheat Sheet #4 - fourth in a seriesFolding Cheat Sheet #4 - fourth in a series
Folding Cheat Sheet #4 - fourth in a series
 
Software Project Health Check: Best Practices and Techniques for Your Product...
Software Project Health Check: Best Practices and Techniques for Your Product...Software Project Health Check: Best Practices and Techniques for Your Product...
Software Project Health Check: Best Practices and Techniques for Your Product...
 
What is Fashion PLM and Why Do You Need It
What is Fashion PLM and Why Do You Need ItWhat is Fashion PLM and Why Do You Need It
What is Fashion PLM and Why Do You Need It
 
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
 
Der Spagat zwischen BIAS und FAIRNESS (2024)
Der Spagat zwischen BIAS und FAIRNESS (2024)Der Spagat zwischen BIAS und FAIRNESS (2024)
Der Spagat zwischen BIAS und FAIRNESS (2024)
 
英国UN学位证,北安普顿大学毕业证书1:1制作
英国UN学位证,北安普顿大学毕业证书1:1制作英国UN学位证,北安普顿大学毕业证书1:1制作
英国UN学位证,北安普顿大学毕业证书1:1制作
 
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideBuilding Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
 
Automate your Kamailio Test Calls - Kamailio World 2024
Automate your Kamailio Test Calls - Kamailio World 2024Automate your Kamailio Test Calls - Kamailio World 2024
Automate your Kamailio Test Calls - Kamailio World 2024
 
Hot Sexy call girls in Patel Nagar🔝 9953056974 🔝 escort Service
Hot Sexy call girls in Patel Nagar🔝 9953056974 🔝 escort ServiceHot Sexy call girls in Patel Nagar🔝 9953056974 🔝 escort Service
Hot Sexy call girls in Patel Nagar🔝 9953056974 🔝 escort Service
 
chapter--4-software-project-planning.ppt
chapter--4-software-project-planning.pptchapter--4-software-project-planning.ppt
chapter--4-software-project-planning.ppt
 
What are the key points to focus on before starting to learn ETL Development....
What are the key points to focus on before starting to learn ETL Development....What are the key points to focus on before starting to learn ETL Development....
What are the key points to focus on before starting to learn ETL Development....
 
Asset Management Software - Infographic
Asset Management Software - InfographicAsset Management Software - Infographic
Asset Management Software - Infographic
 
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
 
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASEBATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
 
Unveiling the Future: Sylius 2.0 New Features
Unveiling the Future: Sylius 2.0 New FeaturesUnveiling the Future: Sylius 2.0 New Features
Unveiling the Future: Sylius 2.0 New Features
 
Implementing Zero Trust strategy with Azure
Implementing Zero Trust strategy with AzureImplementing Zero Trust strategy with Azure
Implementing Zero Trust strategy with Azure
 

Mulesoft anypoint batch processing

  • 1. Batch Processing Mule possesses the ability to process messages in batches. Within an application, you can initiate a batch job which is a block of code that splits messages into individual records, performs actions upon each record, then reports on the results and potentially pushes the processed output to other systems or queues. This functionality is particularly useful when working with streaming input or when engineering "near real-time" data integration between SaaS applications.
  • 2. • For example, batch processing is particularly useful when working with the following scenarios: • integrating data sets, small or large, streaming or not, to parallel process records • synchronizing data sets between business applications, such as syncing contacts between Netsuite and Salesforce, effecting "near real-time"data integration • extracting, transforming and loading (ETL) information into a target system, such as uploading data from a flat file (CSV) to Hadoop • handling large quantities of incoming data from an API into a legacy system
  • 3. • A batch job is a top-level element in Mule which exists outside all Mule flows. Batch jobs split large messages into records which Mule processes asynchronously in a batch job; just as flows process messages, batch jobs process records.
  • 4. • A batch job contains one or more batch steps which, in turn, contain any number of message processors that act upon records as they move through the batch job. During batch processing, you can use record-level variables (recordVars) and MEL expressions to enrich, route or otherwise act upon records. • The heart of Mule’s batch processing functionality lies within the batch job. In an application, the batch job element exists outside the context of any regular Mule flow. It is a block of code which contains one or more batch steps which, as the label implies, process items step-by-step in a sequential order.
  • 5. Create a project bacth_processing
  • 6. Drag the batch into palette
  • 7. Drag DB component and specify connectivity
  • 8.
  • 11. Batch Job vs. Batch Job Instance • • Though defined in context above, it’s worth elaborating upon the terms batch job and batch job instance as they relate to each other. • A batch job is the top-level element in an application in which Mule processes a message payload as a batch of records. The term batch job is inclusive of all four phases of processing: Input, Load and Dispatch, Process, and On Complete. • A batch job instance is an occurrence in a Mule application resulting from the execution of a batch job in a Mule flow; Mule creates the batch job instance in the Load and Dispatch, and persists eternally.