These slides contain the opening remarks and talk #2 from the first Seattle Apache Flink meetup which had the following talks.
Date: Jan 17th, 2018, Wednesday
Location: Bellevue, WA
OPENING REMARKS (~5min)
TALK #1 (~45min)
Haitao Wang, Senior Staff Engineer at Alibaba, will give a presentation on large-scale streaming processing with Flink and Flink SQL at Alibaba and several internal use cases.
TALK #2 (~30min)
Bowen Li will talk about details of future meetup planning and logistics. He will also present how OfferUp, the largest mobile marketplace in the U.S., does large-scale stream processing with Flink to better serve local buyers and sellers, and what they have contributed to Flink's DataStream APIs, state backends, metrics system, and connectors.
See separately uploaded Slideshare: https://www.slideshare.net/dataArtisans/201801-seattle-apache-flink-meetup-at-offerup-opening-remarks-and-talk-2
We may also talk about what's new in Flink 1.4 and how users can leverage these new features, and what Flink 1.5 would look like and what's users vision on Flink.
SPONSOR: OfferUp
Attendees included: Alibaba Group, OfferUp, Uber, Amazon Web Services, Google, Microsoft, Zions Bank, Gridpoint, Dell/EMC, NeoPrime, Nordstrom, Snowflake, Tableau, Oracle, Expedia, Grab, Snapchat, and many others.
2. About me
• 2017.3 – present Alibaba Compute Platform
• 2012 – 2017.3 Microsoft China
• Spark as a Service, with a focus on streaming
• Skype for Business data
• 2000 – 2012 Microsoft US
• SQL Server engine
• Speech API & Speech Server
2
22. Examples of recent Blink runtime optimizations
• Credit-based network stack
• Dynamic load balancing
• Improved check-pointing for large scale jobs
• Some of these work has been contributed to Flink and will be released
in flink-1.5
23. Some New Flink Features
• Incremental Checkpoints
• Fine grained recovery
Flink 1.3
• Queryable states improvements
• Table API & SQL enhancements
Flink 1.4
• FLIP-6
• Network stack improvements
• State replication
• Eager State Declaration
• State evolution
Flink 1.5+