The May community update from the Flink Meetup in Berlin.

1. Berlin Apache Flink Meetup #7
Community Update
May 2015
Robert Metzger
Committer and PMC Member
rmetzger@apache.org
@rmetzger_

2. Apache Flink is an open source platform for
scalable batch and stream data processing.
Apache Flink is …
flink.apache.org 1
• The core of Flink is a distributed
streaming dataflow engine.
• Executing dataflows in
parallel on clusters
• Providing a reliable
foundation for various
workloads
• DataSet and DataStream
programming abstractions are
the foundation for user programs
and higher layers

3. One engine for many use cases
flink.apache.org 2
Real time streaming
topologies
Machine Learning at scale
Graph Analysis
Long batch
pipelines

4. What happened?
• Zeppelin on Flink pull request at Zeppelin
project opened
• Community agreed on a list of issues to fix
for 0.9 (its coming closer)
• Static Code Analysis pull request opened
• Gelly roadmap + upcoming blog post
• Gelly Scala API is in progress …
• Stockholm and Bay Area Meetup groups
started
flink.apache.org 3

5. Frontpage redesign
flink.apache.org 4

6. Flink + Zeppelin
flink.apache.org 5

7. Now in master (0.9-SNAPSHOT)
flink.apache.org 6
• Reworked streaming fault tolerance with
KafkaSources (allowing exactly-once-
processing in Flink). New state backend
(file system)
• Pipelines in Flink ML (similar to scikit-
learn) + a lot of activity in ML
• Batch / Streaming mode switch
• Stability improvements

8. Articles and Meetups
• Juggling with Bits and Bytes [1]
• Apache Flink@ Strata & Hadoop World London (Slides) [2]
• Real-time stream processing: The next step for Apache Flink [3]
flink.apache.org 7
Meetup in BudapestMeetup in Stockholm
[1] http://flink.apache.org/news/2015/05/11/Juggling-with-Bits-and-Bytes.html
[2] http://www.slideshare.net/stephanewen1/apache-flink-strata-hadoop-world-london
[3] http://data-artisans.com/stream-processing-with-flink.html also posted on:
http://blog.confluent.io/2015/05/06/real-time-stream-processing-the-next-step-for-apache-flink/

9. GitHub stats
flink.apache.org 8
+134 +108
In 3 months:

10. We are going to offer a second
Flink Workshop in Berlin
flink.apache.org 9

11. Flink Forward registration & call for
abstracts is open now
flink.apache.org 10
• 12/13 October 2015
• Kulturbrauerei Berlin
• With Flink Workshops / Trainings!