Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Upcoming SlideShare
What to Upload to SlideShare
Next
Download to read offline and view in fullscreen.

Share

Walking Through Spring Cloud Data Flow

Download to read offline

SpringOne 2020
Walking Through Spring Cloud Data Flow

Glenn Renfro, Software Developer at VMware
Ilayaperumal Gopinathan, Staff Software Engineer at VMware

Related Books

Free with a 30 day trial from Scribd

See all

Related Audiobooks

Free with a 30 day trial from Scribd

See all

Walking Through Spring Cloud Data Flow

  1. 1. Walking Through Spring Cloud Data Flow September 2–3, 2020 springone.io
  2. 2. Safe Harbor Statement The following is intended to outline the general direction of VMware's offerings. It is intended for information purposes only and may not be incorporated into any contract. Any information regarding pre-release of VMware offerings, future updates or other planned modifications is subject to ongoing evaluation by VMware and is subject to change. This information is provided without warranty or any kind, express or implied, and is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions regarding VMware's offerings. These purchasing decisions should only be based on features currently available. The development, release, and timing of any features or functionality described for VMware's offerings in this presentation remain at the sole discretion of Pivotal. Pivotal has no obligation to update forward looking information in this presentation. 2
  3. 3. 3 Glenn Renfro Twitter: @cppwfs Github: github.com/cppwfs Ilayaperumal Gopinathan Twitter: @ilayaperumalg Github: github.com/ilayaperumalg
  4. 4. Data In the Enterprise
  5. 5. ?
  6. 6. 8
  7. 7. Application Development Spring Cloud Stream Event-driven, long-lived streaming apps Spring Cloud Task Ephemeral, batch apps Continuous Integration Kubernetes / Cloud Foundry Message Broker / / / / / Application Deployment Streaming applications Task (batch) applications Monitor Performance Track Lifecycle Deploy Streams Orchestration using Spring Cloud Data Flow Launch Jobs
  8. 8. Demo Time!
  9. 9. 1 2 Sample Demo Data { "sku":"102452676", "amount":"19.99", "quantity":"1", "mode":"debit", "clicks":"10" } 6
  10. 10. Demo!
  11. 11. What’s New! Single Step Batch Job Auto Configuration
  12. 12. @EnableBatchProcessing @EnableTask @Configuration public class MyBatchConfiguration { … @Bean public Job myBatchJob(Step step) { return jobBuilderFactory.get(this.properties.getJobName()). … } … @Bean public ItemReader<Map<Object, Object>> itemReader() { return new JdbcCurserItemReaderBuilder(). … } @Bean public ItemWriter<Map<Object,Object>> itemWriter(DataSource dataSource) { return new JdbcBatchItemWriterBuilder<Map<Object, Object>>(). … }
  13. 13. What’s New! Single Step Batch Job Auto Configuration spring.batch.job.jobName=job spring.batch.job.stepName=step1 spring.batch.job.chunkSize=5 spring.batch.job.jdbccursorreader.name=fooReader spring.batch.job.jdbccursorreader.sql=select item_name from item_sample spring.batch.job.jdbcwriter.name=jdbcWriter spring.batch.job.jdbcwriter.sql=INSERT INTO item (item_name) VALUES (:ITEM_NAME) <dependency> <groupId>org.springframework.cloud</groupId> <artifactId>spring-cloud-starter-single-step-batch-job</artifactId> </dependency>
  14. 14. What’s new! Spring Cloud Data Flow OSS • 2.6.1 RELEASE ● Task Improvements ● OOTB Functional applications ● Wavefront monitoring support ● Multi platform scheduling support ● Bitnami helm charts for SCDF
  15. 15. Commercial Offering Spring Cloud Data Flow For Kubernetes • Built on top of SCDF OSS • SCDF Pro Server and Pro Dashboard UI • Packaging • Certified Container Images • Image Relocation • Provisioning of SCDF components • Multi IO Stream DSL and Editor
  16. 16. What’s Up Next! Spring Cloud Data Flow OSS • 2.7.0 in the works ○ Dashboard redesign using Clarity ○ Observability support ○ Single Step Batch Job support
  17. 17. What’s Up Next! Spring Cloud Data Flow for Kubernetes (SCDF4K8s) • Container Registry Integration • Single Step Batch Job Auto Config • Multi IO support enhancements
  18. 18. Want to learn more? #springone@s1p SCDF microsite SCDF for Kubernetes
  19. 19. Stay Connected. https://springone.io/2020/sessions/iot-scale-event-stream-processing-for- predictive-maintenance-at-penske #springone@s1p IoT Scale Event-Stream Processing for Predictive Maintenance at Penske
  • BenLindner1

    Apr. 24, 2021
  • elnemesisdivina

    Apr. 8, 2021

SpringOne 2020 Walking Through Spring Cloud Data Flow Glenn Renfro, Software Developer at VMware Ilayaperumal Gopinathan, Staff Software Engineer at VMware

Views

Total views

345

On Slideshare

0

From embeds

0

Number of embeds

10

Actions

Downloads

22

Shares

0

Comments

0

Likes

2

×