Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Apache Flink - A Stream Processing Engine

107 views

Published on

Quick Introduction to Flink as a distributed stream processing engine.

Published in: Software
  • Be the first to comment

  • Be the first to like this

Apache Flink - A Stream Processing Engine

  1. 1. 1 Aljoscha Krettek @aljoscha December 8, 2016 Google Singapore Apache Flink™ A Stream Processing Engine
  2. 2. 2 Original creators of Apache Flink® Providers of the dA Platform, a supported Flink distribution
  3. 3. What is Apache Flink? 3 Distributed Deployment Stateful Stream Processing DataStream API, Windows Table API Building Block Core API Declarative DSL Basis
  4. 4. Stream Processing 4 Data Stream Data Stream Your code
  5. 5. Stateful Stream Processing 5 State Data Stream Data Stream Your code
  6. 6. Stateful Steam Processing 6 Source Filter / Transform State read/write Sink
  7. 7. Stateful Steam Processing 7 Scalable embedded state Access at memory speed & scales with parallel operators
  8. 8. Stateful Steam Processing 8 Re-load state Reset positions in input streams Rolling back computation Re-processing
  9. 9. Stateful Steam Processing 9 Restore to different programs Bugfixes, Upgrades, A/B testing, etc
  10. 10. Beam/Flink Interactions 10 Dataflow/ MillWheel influenced runs on
  11. 11. Code Example! 11 Based on http://data-artisans.com/robust-stream-processing-flink-walkthrough/
  12. 12. 1 Thank you! @aljoscha @ApacheFlink @dataArtisans http://flink.apache.org
  13. 13. Appendix 13
  14. 14. We are hiring! data-artisans.com/careers
  15. 15. 15 Flink Forward 2017 San Francisco Berlin • April 10-11, 2017 • The first Flink Forward event outside of Berlin • Register at sf.flink-forward.org/ • September 11-13 • Over 350 attendees at the last event • Registration opening soon!

×