This document provides an overview of Apache Flink, a stream processing framework. It begins by discussing how streaming has evolved from batch frameworks like Hadoop. It then covers key aspects of Flink like its API, compatibility with other frameworks like Storm and Dataflow, windowing and triggers, examples, and features. Finally it lists some companies that use Flink like Huawei, Ericsson, and Capital One.

1. FLINK
Alexey Diomin, diominay@gmail.com

3. What next?
 Hadoop

4. What next?
 Hadoop

5. What next?
 Hadoop
 Hive/Pig

6. What next?
 Hadoop
 Hive/Pig

7. What next?
 Hadoop
 Hive/Pig
 Impala

8. What next?
 Hadoop
 Hive/Pig
 Impala
 Spark

9. What next?
 Hadoop
 Hive/Pig
 Impala
 Spark
 Druid

10. From Batch to Stream
 Hadoop
 Hive/Pig
 Impala
 Spark
 Druid

11. Flink

12. Flink

13. Flink WebUI

14. Flink

15. Flink

16. Compatibility

17. Compatibility
 Hadoop

18. Compatibility
 Hadoop
 Cascalog

19. Compatibility
 Hadoop
 Cascalog
 Storm

20. Storm (Compatibility)
 TopologyBuilder replaced by
FlinkTopologyBuilder
 StormSubmitter replaced by FlinkSubmitter
 NimbusClient and Client replaced by
FlinkClient
 LocalCluster replaced by FlinkLocalCluster

21. Compatibility
 Hadoop
 Cascalog
 Storm
 Dataflow

22. Dataflow

23. Triggers & Windowing
 Trigger policy
 When to trigger the computation on current window
 Eviction policy
 When data points should leave the window
 Defines window width/size
 E.g., count-based policy
 evict when #elements > n
 start a new window every n-th element
 Built-in: Count, Time, Delta policies

24. Example

25. Example

26. Flink Streaming
http://data-artisans.com/high-throughput-low-latency-and-exactly-once-stream-processing-with-apache-flink/

27. Matrix

28. API

29. API
 Java/Scala

30. API
 Java/Scala
 Python

31. API
 Java/Scala
 Python
 Java 8

32. API example (Java)

33. API example (Java 8)

34. API example (scala)

35. Flink Key Features
 Memory Management
 Topology Builder
 Native Stream Processing

36. Users
 Huawei
 Ericsson
 Capital One
 Bouygues Telecom
 Otto Group

37. Q&A