Apache Kafka

1,892 views

Published on

Apache Kafka

Published in: Technology
1 Comment
2 Likes
Statistics
Notes
  • Hi Diego, can you explain what you mean regarding persistence
    in slide 8. My understanding in JMS (somewhat familiar with HornetQ) is that the messages are sent into a queue address in a hornetQ server from where they are consumed by readers. When the reader acks the processing the messages are removed from the address. Before that the messages in the address is persisted to disk. That's why I do not understand your 'no persistence' comment here.
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Views
Total views
1,892
On SlideShare
0
From Embeds
0
Number of Embeds
17
Actions
Shares
0
Downloads
81
Comments
1
Likes
2
Embeds 0
No embeds

No notes for slide

Apache Kafka

  1. 1. Apache Kafka A high-throughput distributed messaging system.@diego_pachecoSoftware Architect | Agile Coach
  2. 2. Apache KafkaA high-throughput distributed messaging system.
  3. 3. Apache KafkaA high-throughput distributed messaging system. No JMS Stuff  
  4. 4. Apache Kafka A high-throughput distributed messaging system.Activity Stream Processing /Offline log processing +Real-time Pub/Sub Messaging
  5. 5. Apache KafkaA high-throughput distributed messaging system. Uses Apache Zookerper
  6. 6. Apache KafkaA high-throughput distributed messaging system. “Distributed Publish-Subiscribe messaging system, Hight Troughtput, Persistent, Partitioning Messages, Parallel data lod into Hadoop.”
  7. 7. Apache Kafka A high-throughput distributed messaging system.Pure offline logprocessing are:Real-time,High Performance,Hight Troughtput Lightweight business logic(and not lots) to deliver that.
  8. 8. Apache Kafka A high-throughput distributed messaging system.Pure Messasingissues(ActiveMQ/RabbitMQ):NO API for Batching,Transactional,No persistence means, multipleconsumers are limited by arch.
  9. 9. Apache KafkaA high-throughput distributed messaging system. Kafka bridges the gap beetween both issues!
  10. 10. Apache KafkaA high-throughput distributed messaging system. Producer Test
  11. 11. Apache KafkaA high-throughput distributed messaging system. Consumer Test
  12. 12. Apache Kafka A high-throughput distributed messaging system.Supports *Activity Stream Processing*, like: Facebook/Scribe and Apache Flume.*Activity Stream Processing* => Collecting, Aggregating, largesammout on data, very present on social business. Later you often dooffline analysys with hadoop. A.K.A Offline log Aggregation.
  13. 13. Apache KafkaA high-throughput distributed messaging system.
  14. 14. Apache KafkaA high-throughput distributed messaging system.
  15. 15. Apache KafkaA high-throughput distributed messaging system.
  16. 16. Apache Kafka A high-throughput distributed messaging system. Thank You !@diego_pachecoSoftware Architect | Agile Coach

×