Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

What's New in Spring for Apache Kafka 2.0

499 views

Published on

SpringOne Platform 2017
Gary Russell, Pivotal

Discussion of important new features in this Spring abstraction over the Apache Kafka Java client. The project is gaining popularity in the Spring community and provides a fast on-ramp to using Apache Kafka in a Spring application. This update has improved threading and a new Consumer-aware listener.

Published in: Technology
  • Be the first to comment

What's New in Spring for Apache Kafka 2.0

  1. 1. What’s New in Spring for Apache Kafka By Gary Russell @gprussell 1
  2. 2. Unless otherwise indicated, these slides are © 2013 -2017 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by -nc/3.0/ Compatibility Matrix (project page) 2
  3. 3. Unless otherwise indicated, these slides are © 2013 -2017 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by -nc/3.0/ 3
  4. 4. Unless otherwise indicated, these slides are © 2013 -2017 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by -nc/3.0/ 4
  5. 5. Unless otherwise indicated, these slides are © 2013 -2017 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by -nc/3.0/ KIP-62 == Freedom!! 5 KIP-62 (https://cwiki.apache.org/confluence/display/KAFKA/KIP- 62%3A+Allow+consumer+to+send+heartbeats+from+a+background+thread) • removed the danger of an unexpected rebalance due to a slow listener • (poll() not called often enough) • allowed threading model to be rewritten in 2.0 • before 2.0 - 2 threads - consumer + listener • pause/resume for slow listeners • 2.0 - 1 thread (consumer) - client takes care of heartbeats • Back-ported to 1.3 when we decided to create a 1.x version to support 0.11.x.x (driven by the implementation of the kafka11 binder for Spring Cloud Stream)
  6. 6. Learn More. Stay Connected. 6 #springone@s1p Feedback!!!

×