• Like
Tweeting hadoop
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

Tweeting hadoop

  • 522 views
Published

introduce hadoop

introduce hadoop

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
522
On SlideShare
0
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
6
Comments
0
Likes
1

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Tweeting Hadoop Twitter: @zizon
  • 2.
      • HDFS
      • Map Reduce
      • etc...
  • 3.
      • Disk
  • 4.
      • Replication
  • 5.
      • But fail overs ...
      • NOT automatically
      • NOT physical isolated
  • 6.
      • NFS like
    It DOSE solve part of it , but not all such as load balance and etc.
  • 7.
      • HDFS
  • 8.
      • Internals
      • C reate
      • R ead
      • U pdate
      • D elete
  • 9.
      • Create
  • 10.
      • Create
        • FSNamesystem
            • Inode(IndoeFile,InodeDcitionary, 额头 )
            • BlockInfo
  • 11.
      • Read
      • Update(Append actually)
  • 12.
      • Delet
    lazy operation
  • 13.
      • Configuration?
      • dfs.block.size
      • io.file.buffer.size
      • dfs.datanode.transferTo.allowed
      • dfs.write.packet.size
      • dfs.datanode.numblocks
  • 14.
      • Map Reduce
  • 15.
      • Configuration
      • mapred.jobtracker.taskScheduler
      • mapred.tasktracker.map.tasks.maximum
      • mapred.tasktracker.reduce.tasks.maximum
      • mapred.job.split.file
      • mapred.jobtracker.maxtasks.per.job
      • mapred.max.split.size
      • mapred.child.java.opts
      • mapreduce.partitioner.class
      • mapred.reduce.parallel.copies
      • mapred.job.reuse.jvm.num.tasks