What’s New in Spring for Apache
Kafka
By Gary Russell
@gprussell
1
Unless otherwise indicated, these slides are © 2013 -2017 Pivotal Software, Inc. and licensed under a Creative Commons
Attribution-NonCommercial license: http://creativecommons.org/licenses/by -nc/3.0/
Compatibility Matrix (project page)
2
Unless otherwise indicated, these slides are © 2013 -2017 Pivotal Software, Inc. and licensed under a Creative Commons
Attribution-NonCommercial license: http://creativecommons.org/licenses/by -nc/3.0/ 3
Unless otherwise indicated, these slides are © 2013 -2017 Pivotal Software, Inc. and licensed under a Creative Commons
Attribution-NonCommercial license: http://creativecommons.org/licenses/by -nc/3.0/ 4
Unless otherwise indicated, these slides are © 2013 -2017 Pivotal Software, Inc. and licensed under a Creative Commons
Attribution-NonCommercial license: http://creativecommons.org/licenses/by -nc/3.0/
KIP-62 == Freedom!!
5
KIP-62 (https://cwiki.apache.org/confluence/display/KAFKA/KIP-
62%3A+Allow+consumer+to+send+heartbeats+from+a+background+thread)
• removed the danger of an unexpected rebalance due to a slow listener
• (poll() not called often enough)
• allowed threading model to be rewritten in 2.0
• before 2.0 - 2 threads - consumer + listener
• pause/resume for slow listeners
• 2.0 - 1 thread (consumer) - client takes care of heartbeats
• Back-ported to 1.3 when we decided to create a 1.x version to support
0.11.x.x (driven by the implementation of the kafka11 binder for Spring Cloud
Stream)
Learn More. Stay Connected.
6
#springone@s1p
Feedback!!!

What's New in Spring for Apache Kafka 2.0

  • 1.
    What’s New inSpring for Apache Kafka By Gary Russell @gprussell 1
  • 2.
    Unless otherwise indicated,these slides are © 2013 -2017 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by -nc/3.0/ Compatibility Matrix (project page) 2
  • 3.
    Unless otherwise indicated,these slides are © 2013 -2017 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by -nc/3.0/ 3
  • 4.
    Unless otherwise indicated,these slides are © 2013 -2017 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by -nc/3.0/ 4
  • 5.
    Unless otherwise indicated,these slides are © 2013 -2017 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by -nc/3.0/ KIP-62 == Freedom!! 5 KIP-62 (https://cwiki.apache.org/confluence/display/KAFKA/KIP- 62%3A+Allow+consumer+to+send+heartbeats+from+a+background+thread) • removed the danger of an unexpected rebalance due to a slow listener • (poll() not called often enough) • allowed threading model to be rewritten in 2.0 • before 2.0 - 2 threads - consumer + listener • pause/resume for slow listeners • 2.0 - 1 thread (consumer) - client takes care of heartbeats • Back-ported to 1.3 when we decided to create a 1.x version to support 0.11.x.x (driven by the implementation of the kafka11 binder for Spring Cloud Stream)
  • 6.
    Learn More. StayConnected. 6 #springone@s1p Feedback!!!