CLOUD NATIVE
BATCH PROCESSING
MICHAEL MINELLA
Lead – Spring Batch &
Spring Cloud Task
JSR-352 - Expert Group Member
Author – Pro Spring Batch
Speaker - JavaOne Rockstar
Podcast - OffHeap Curmudgeon
Twitter - @michaelminella or
@OffHeap
SLIDES AND CODE
WILL BE ON GITHUB SOON
LAY OF THE LAND
SPRING FRAMEWORK
SPRING BATCH
SPRING CLOUD
SPRING CLOUD TASK
SPRING CLOUD DATA FLOW
BATCH PROCESSIN
IS STILL RELEVANT
MODERN PATTERNS AND TOOLS
MAKE BATCH A POWERHOUSE
Import Process
Amazon S3
SPRING BATCH
PROVIDES BASIC
BATCH FUNCTIONALITY
SPRING BATCH 3.0.7
SPRING BATCH 4.0
First major version since 2014
SPRING BOOT
SPRING FRAMEWORK 5
ADDING BUILDERS FOR
CONFIGURATION EASE
Import Process
Amazon S3
SPRING BATCH 4.0
loadS3JDBC Job
FlatFileItemReader
EnrichmentItemProcessor
JdbcBatchItemWriter
REST Service
SHOW ME THE
CODE!
CIRCUIT
BREAKER
SHOW ME THE
CODE!
How do we configure the app?
HOW DO WE CONFIGURE
OUR APP?
CODE AND CONFIG
SEPARATION
MULTIPLE
APPROACHES
SPRING CLOUD CONFIG SER
SPRING CLOUD EUREKA SE
Import Process
Amazon S3
Spring Cloud
Config
Spring Cloud
Eureka REST Service
SHOW ME THE
CODE!
HOW DO WE
SCALE THE APP?
SCALING SPRING BATCH
1PARALLEL
STEPS
2MULTITHREADED
STEPS
3PARTITIONING
4REMOTE
CHUNKING
WE’LL USE
PARTITIONING
PARTITIONING VIA
SPRING CLOUD
TASK
masterAmazon S3
worker worker
SHOW ME THE
CODE!
HOW DO WE
ORCHESTRATE
SPRING CLOUD DATA FLOW
CLOUD NATIVE ORCHESTRATION
TOOL FOR MICROSERVICES
LAUNCH VIA REST,
STREAMS, OR ON DEMAND
SHOW ME THE
CODE!
CLOUD NATIVE WITH SPRING
ALLOW YOU TO TAKE
BATCH PROCESSES
A N D D E P L O Y
THEM TO THE CLOUD
Cloud Native Batch Processing

Cloud Native Batch Processing

Editor's Notes

  • #6 Please ask questions when you have them
  • #13 Today we’re going to look at the most exciting area of IT
  • #14 Batch processing
  • #15 While batch processing may be old
  • #16 All joking aside, new paradigms still need batch processing: Orchestration of workloads ETL Data Science IOT
  • #20 Spring Batch is 9 years old A bedrock technology in modern enterprises in every vertical
  • #23 Heartbleed and the iWatch were both new. First major release since Boot.
  • #26 Upgrade all dependencies
  • #30 New features provide added robustness
  • #36 How do we configure our app?