Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
KafkaA little introduction
Pub-Sub Messaging System
Distributed
Performance
Disk/Memory Performance                     1000M                       100M                        10M                   ...
Disk/Memory Performance                     1000M                       100M                        10M                   ...
Disk/Memory Performance                     1000M                       100M                        10M                   ...
Disk/Memory Performance                     1000M                       100M                        10M                   ...
Persistent
Length    Magic Value Checksum   Payload4 bytes     1 byte     4 bytes   n bytes
TokenOffset: 0             InputBroker: kafka.localTopic: Testing                                       MR Job            ...
TokenOffset: 0             InputBroker: kafka.localTopic: Testing                                       MR Job            ...
Useful Things• http://incubator.apache.org/kafka/• https://github.com/pingles/clj-kafka
Kafka - A little introduction
Kafka - A little introduction
Kafka - A little introduction
Kafka - A little introduction
Kafka - A little introduction
Kafka - A little introduction
Kafka - A little introduction
Kafka - A little introduction
Kafka - A little introduction
Kafka - A little introduction
Kafka - A little introduction
Kafka - A little introduction
Kafka - A little introduction
You’ve finished this document.
Upcoming SlideShare
Users as Data
Next
Upcoming SlideShare
Users as Data
Next

Share

Kafka - A little introduction

A brief run through of Kafka and some of it's interesting characteristics that make it a great messaging system for collecting and aggregating data.

Related Books

Free with a 30 day trial from Scribd

See all

Related Audiobooks

Free with a 30 day trial from Scribd

See all

Kafka - A little introduction

  1. 1. KafkaA little introduction
  2. 2. Pub-Sub Messaging System
  3. 3. Distributed
  4. 4. Performance
  5. 5. Disk/Memory Performance 1000M 100M 10M 1MRead values/second 100,000 10,000 1,000 100 10 1 Disk SSD Memory Random access Sequential Access Source: http://queue.acm.org/detail.cfm?id=1563874
  6. 6. Disk/Memory Performance 1000M 100M 10M 1MRead values/second 100,000 10,000 1,000 100 10 1 Disk SSD Memory Random access Sequential Access Source: http://queue.acm.org/detail.cfm?id=1563874
  7. 7. Disk/Memory Performance 1000M 100M 10M 1MRead values/second 100,000 10,000 1,000 100 10 1 Disk SSD Memory Random access Sequential Access Source: http://queue.acm.org/detail.cfm?id=1563874
  8. 8. Disk/Memory Performance 1000M 100M 10M 1MRead values/second 100,000 Sequential disk read 10,000 faster than random 1,000 100 memory read 10 1 Disk SSD Memory Random access Sequential Access Source: http://queue.acm.org/detail.cfm?id=1563874
  9. 9. Persistent
  10. 10. Length Magic Value Checksum Payload4 bytes 1 byte 4 bytes n bytes
  11. 11. TokenOffset: 0 InputBroker: kafka.localTopic: Testing MR Job Output Output Offset: 130098 Broker: kafka.local Topic: Testing Sequence File
  12. 12. TokenOffset: 0 InputBroker: kafka.localTopic: Testing MR Job Output Output Offset: 130098 Broker: kafka.local Topic: Testing Sequence File
  13. 13. Useful Things• http://incubator.apache.org/kafka/• https://github.com/pingles/clj-kafka
  • nemoyn

    Apr. 27, 2015
  • fmjsjx

    Jan. 7, 2014
  • seralf

    Jul. 17, 2013
  • CraigHsieh1

    Apr. 16, 2013
  • ryudaewan

    Dec. 9, 2012
  • fharenheit

    Dec. 8, 2012

A brief run through of Kafka and some of it's interesting characteristics that make it a great messaging system for collecting and aggregating data.

Views

Total views

3,389

On Slideshare

0

From embeds

0

Number of embeds

296

Actions

Downloads

0

Shares

0

Comments

0

Likes

6

×