Download to read offline
Uploaded byRobert Metzger
Apache Flink First Half of 2015 Community Update
Flink has graduated from an Apache incubator project to a top-level project, attracting many new contributors. Recent releases have added features like a Table API, Gelly graph processing, and integrations with SAMOA machine learning and Google Dataflow. The talk outlines Flink's history and recent developments from 2014 to mid-2015, including three students working on Flink over the summer, and announces the first Flink Forward conference in October 2015.
More Related Content
Similar to Apache Flink First Half of 2015 Community Update
![Coded Agents – with UiPath SDK + LangGraph [Virtual Hands-on Workshop]](https://cdn.slidesharecdn.com/ss_thumbnails/codedagentsdeck-251215155422-5497c599-thumbnail.jpg?width=640&height=640&fit=bounds)
Apache Flink First Half of 2015 Community Update
- 1. Bay Area ApacheFlink Meetup #1 Community Update June 2015 Robert Metzger Committer and PMC Member rmetzger@apache.org @rmetzger_
- 2. Flink’s Recent History April2014 April 2015Dec 2014 Top Level Project Graduation 0.70.60.5 0.90.9-m1 This talk
- 3. December 2014 Graduation asTop Level Project 2flink.apache.org Official Press release: https://blogs.apache.org/foundation/entry/the_apa che_software_foundation_announces69 • Officially acknowledged as a healthy, vibrant and growing open-source community, following the Apache Way. • Attracted many new contributors and committers during incubation • More than 75+ contributors
- 4. January 2015 Release 0.8.0 •Lots of stability improvements • Scala Streaming API • Improved streaming windowing semantics • Kryo as the new fallback serializer • Extended FileSystem support (Hadoop compat) flink.apache.org 3
- 5. February 2015 • TableAPI added • Gelly – Graph API added • flink-hcatalog added • Apache Flink + Apache SAMOA (incubating) integration Machine Learning on streams flink.apache.org 4
- 6. March 2015 • Flinkrunner for Google DataFlow API available • First code of Flink ML added flink.apache.org 5
- 7. New Wiki pageswith system internals • Data Exchange between tasks • Type Extraction and Serialization • Memory Management in (Batch API) • Akka and Actors flink.apache.org 6
- 8. April 2015 • Flink0.9-milestone1 has been released • Storm compatibility layer pull request • Interactive Scala Shell added • Experimental Python API added flink.apache.org 7
- 9. flink.apache.org 8 Apache Flinkgot 3 Google Summer of Code students accepted: • Distributed Pattern Matching for Apache Flink • Exact and Approximate Statistics for Data Streams and Windows in Flink • Apache Flink: Asynchronous Iterations and Updates
- 10. May 2015 • GellyScala API started (Community contrib) • Stockholm and Bay Area Meetup groups started flink.apache.org 9 Meetup in BudapestMeetup in Stockholm
- 11.
- 12. June 2015 • Zeppelin+ Flink Integration merged • Static Code Analysis added • VOTE for Flink 0.9.0 started Biggest release so far • Chicago Meetup group started flink.apache.org 11
- 13. Flink + Zeppelinintegration flink.apache.org 12
- 14. Flink 0.9.0 Highlights •APIs on top: – Flink Machine Learning Library – Gelly Graph Processing API – Table API (SQL-style operations) • Internals – Enhanced YARN (single jobs, container restart) – Flink On Apache Tez – Akka for process communication – secure HDFS / YARN support • Streaming Fault-Tolerance • Reworked intermediate results representation flink.apache.org 13
- 15. Ways to getin touch with the Community • Mailing lists – news@flink.apache.org (announcements only, low traffic) – user@flink.apache.org (user support, medium traffic) – dev@flink.apache.org (internal discussions, high traffic) • Twitter (@ApacheFlink) • flink.apache.org/blog • Local Meetup groups: http://apache- flink.meetup.com/ flink.apache.org 14
- 16.
- 17. Flink Forward registration& call for abstracts is open now flink.apache.org 16 • 12/13 October 2015 • Kulturbrauerei Berlin • With Flink Workshops / Trainings!