© MapR Technologies
®
© MapR Technologies, confidential
®
© MapR Technologies
®
© MapR Technologies
®
© MapR Technologies
®
© MapR Technologies
! 
! 
! 
! 
! 
®
© MapR Technologies
JVM
Data'Node
JVM
RegionServer
JVM
Name'Node
JVM
ZooKeeper
JVM
ZooKeeper
JVM
ZooKeeper
JVM
HBaseMast...
®
© MapR Technologies
JVM
Data'Node
JVM
RegionServer
JVM
Data'Node
JVM
RegionServer
JVM
Data'Node
JVM
RegionServer
JVM
Dat...
®
© MapR Technologies
®
© MapR Technologies
®
© MapR Technologies
! 
! 
! 
! 
! 
®
© MapR Technologies
File'File'
JVM
File'File'File'
File'File'File'
®
© MapR Technologies
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
®
© MapR Technologies
®
© MapR Technologies
0'
2000'
4000'
6000'
8000'
10000'
12000'
14000'
16000'
18000'
0' 1000' 2000' 3000' 4000' 5000' 6000'...
®
© MapR Technologies
®
© MapR Technologies
" 
" 
" 
" 
" 
''
''
''
''
''
''
''
''
''
''
''
''
''
''
''
''
®
© MapR Technologies
! 
! 
! 
! 
! 
File'File'File'
®
© MapR Technologies
$"mount"maprnode:/mapr"/mapr"
$"cd"/mapr/default/user/dave"
$"pwd"
/mapr/default/user/dave"
"
$"ls"
...
®
© MapR Technologies
MapR%Data%Pla*orm%(MDP)
MapR%Control%System%(MCS)
HBase&API
HDFS%API
NFS%interface
MapReduce
Apache%...
®
© MapR Technologies
®
© MapR Technologies
®
© MapR Technologies
" 
" 
'
'
®
© MapR Technologies
" 
– 
'
'
®
© MapR Technologies
" 
– 
– 
– 
®
© MapR Technologies
" 
– 
– 
– 
" 
– 
– 
– 
®
© MapR Technologies
! 
! 
! 
! 
! 
© MapR Technologies
®
© MapR Technologies
®
®
© MapR Technologies
" 
– 
– 
– 
– 
– 
" 
– 
– 
– 
" 
– 
– 
© MapR Technologies
®
• 
• 
• 
• 
• 
• 
© MapR Technologies
®
• 
SELECT cf1.month, cf1.year, FROM hbase.table1!
•  !
!SELECT!
!c.name, c.address, COUNT(c.children...
© MapR Technologies
®
• 
SELECT table_name, table_type FROM
information_schema.tables WHERE
table_schema=‘MyDatabase’ ORDE...
®
© 2014 MapR Technologies 32
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
®
© MapR Technologies
! 
! 
! 
! 
! 
®
© MapR Technologies
®
© MapR Technologies
®
© MapR Technologies
CDH
MapR'
© MapR Technologies
®
®
© MapR Technologies
®
© MapR Technologies
© MapR Technologies
®
© MapR Technologies ®
Upcoming SlideShare
Loading in …5
×

エンタープライズ NoSQL/HBase プラットフォーム – MapR M7 エディション - db tech showcase 大阪 2014 2014/06/19

2,031 views

Published on

Apache HBaseはHadoopドメインにおいてメジャーなNoSQLのひとつです。しかし、多くのユーザがその運用性、安定性、パフォーマンスにおいて様々な問題を抱えています。MapR M7エディションはエンタープライズ向けHadoopディストリビューションという価値に加え、HBaseアプリケーションをより容易に安定的かつ高速に実行するプラットフォームを提供します。2014年6月18〜20日に開催されたdb tech showcase 大阪 2014での講演資料です。

0 Comments
4 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
2,031
On SlideShare
0
From Embeds
0
Number of Embeds
66
Actions
Shares
0
Downloads
26
Comments
0
Likes
4
Embeds 0
No embeds

No notes for slide

エンタープライズ NoSQL/HBase プラットフォーム – MapR M7 エディション - db tech showcase 大阪 2014 2014/06/19

  1. 1. © MapR Technologies ® © MapR Technologies, confidential ® © MapR Technologies
  2. 2. ® © MapR Technologies
  3. 3. ® © MapR Technologies
  4. 4. ® © MapR Technologies !  !  !  !  ! 
  5. 5. ® © MapR Technologies JVM Data'Node JVM RegionServer JVM Name'Node JVM ZooKeeper JVM ZooKeeper JVM ZooKeeper JVM HBaseMaster JVM Data'Node JVM RegionServer JVM Data'Node JVM RegionServer JVM Data'Node JVM RegionServer
  6. 6. ® © MapR Technologies JVM Data'Node JVM RegionServer JVM Data'Node JVM RegionServer JVM Data'Node JVM RegionServer JVM Data'Node JVM RegionServer HDFS
  7. 7. ® © MapR Technologies
  8. 8. ® © MapR Technologies
  9. 9. ® © MapR Technologies !  !  !  !  ! 
  10. 10. ® © MapR Technologies File'File' JVM File'File'File' File'File'File'
  11. 11. ® © MapR Technologies •  •  •  •  •  •  •  •  •  •  •  • 
  12. 12. ® © MapR Technologies
  13. 13. ® © MapR Technologies 0' 2000' 4000' 6000' 8000' 10000' 12000' 14000' 16000' 18000' 0' 1000' 2000' 3000' 4000' 5000' 6000' /' ' 0'''''''''''''100''''''''''''200''''''''''''400''''''''''''600''''''''''''800'''''''''''1000''''''''''' MapR' ' Benchmark:'File'creates'(100B)' Hardware:'10'nodes,'2'x'4'cores,'24'GB' RAM,'12'x'1'TB'7200'RPM' ' 0' 50' 100' 150' 200' 250' 300' 350' 400' 0' 0.5' 1' 1.5' /' ' 'MapR% % Advantage% Rate'(creates/s)' 14T16K' 335T360' 40x% Scale'(files)' 6B' 1.3M' 4615x%
  14. 14. ® © MapR Technologies
  15. 15. ® © MapR Technologies "  "  "  "  "  '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' ''
  16. 16. ® © MapR Technologies !  !  !  !  !  File'File'File'
  17. 17. ® © MapR Technologies $"mount"maprnode:/mapr"/mapr" $"cd"/mapr/default/user/dave" $"pwd" /mapr/default/user/dave" " $"ls" file1""file2""table1""table2" " $"hbase"shell" hbase(main):003:0>"create"'/user/dave/table3',"'cf1',"'cf2',"'cf3'" 0"row(s)"in"0.1570"seconds" " $"ls" file1""file2""table1""table2""table3" " $"hadoop"fs"Dls"/user/dave" Found"5"items" DrwDrDDrDD"""3"mapr"mapr"""""""""16"2012D09D28"08:34"/user/dave/file1" DrwDrDDrDD"""3"mapr"mapr"""""""""22"2012D09D28"08:34"/user/dave/file2" trwxrDxrDx"""3"mapr"mapr""""""""""2"2012D09D28"08:32"/user/dave/table1" trwxrDxrDx"""3"mapr"mapr""""""""""2"2012D09D28"08:33"/user/dave/table2" trwxrDxrDx"""3"mapr"mapr""""""""""2"2012D09D28"08:38"/user/dave/table3" NFS' Hadoop'API
  18. 18. ® © MapR Technologies MapR%Data%Pla*orm%(MDP) MapR%Control%System%(MCS) HBase&API HDFS%API NFS%interface MapReduce Apache% HBase Pig Hive Cascading Flume Oozie Sqoop HCatalog Mahout Whirr MapR%Distribu-on%for Apache%Hadoop
  19. 19. ® © MapR Technologies
  20. 20. ® © MapR Technologies
  21. 21. ® © MapR Technologies "  "  ' '
  22. 22. ® © MapR Technologies "  –  ' '
  23. 23. ® © MapR Technologies "  –  –  – 
  24. 24. ® © MapR Technologies "  –  –  –  "  –  –  – 
  25. 25. ® © MapR Technologies !  !  !  !  ! 
  26. 26. © MapR Technologies ®
  27. 27. © MapR Technologies ®
  28. 28. ® © MapR Technologies "  –  –  –  –  –  "  –  –  –  "  –  – 
  29. 29. © MapR Technologies ® •  •  •  •  •  • 
  30. 30. © MapR Technologies ® •  SELECT cf1.month, cf1.year, FROM hbase.table1! •  ! !SELECT! !c.name, c.address, COUNT(c.children) ! !FROM! ! !SELECT! ! ! !CONVERT_FROM(cf1.user-json-blob, JSON) AS c! FROM! !hbase.table1!
  31. 31. © MapR Technologies ® •  SELECT table_name, table_type FROM information_schema.tables WHERE table_schema=‘MyDatabase’ ORDER BY table_name DESC' •  •  SELECT, GROUP BY, ORDER BY, LIMIT, JOIN, HAVING, UNION, UNION ALL,WITH, IN, EXISTS,DISTINCT, BETWEEN •  •  •  –  CREATE DATABASE, CREATE TABLE/VIEW AS SELET, INSERT INTO!
  32. 32. ® © 2014 MapR Technologies 32 •  •  •  •  •  •  •  •  •  •  •  •  •  •  • 
  33. 33. ® © MapR Technologies !  !  !  !  ! 
  34. 34. ® © MapR Technologies
  35. 35. ® © MapR Technologies
  36. 36. ® © MapR Technologies CDH MapR'
  37. 37. © MapR Technologies ®
  38. 38. ® © MapR Technologies
  39. 39. ® © MapR Technologies
  40. 40. © MapR Technologies ® © MapR Technologies ®

×