Towards Enterprise-Grade Hadoop<br />BigDataCamp 2010Santa Clara, CA<br />www.appistry.com<br />Sam Charrington (@samcharr...
Appistry CloudIQ Platform helps customers deliver scalable systems for data-intensive applications<br />Data Growth Is Acc...
3<br />New<br />CloudIQ Engine<br />CloudIQ Manager<br />CloudIQ Storage<br />Cloud application server built for scale<br ...
Towards Enterprise-Grade Hadoop, Part 1<br />For some Hadoop users, HDFS is insufficient from a reliability, scalability a...
Hadoop/HDFS Challenges<br />Reliability/Availability<br />NN is SPoF<br />Scalability<br />NN holds all blocks locations i...
CloudIQ Storage, Hadoop Edition Provides<br />Reliability/Availability<br />No SPoF<br />Scalability<br />Distributed meta...
Towards Enterprise-Grade Hadoop, Part 2<br />www.appistry.com<br />7<br />
Towards Enterprise-Grade Hadoop, Part 2<br />www.appistry.com<br />8<br />Enterprise-grade Hadoop requires a rich ecosyste...
Towards Enterprise-Grade Hadoop, Part 2<br />Enterprise-grade Hadoop requires a rich ecosystem of partners to complement H...
Towards Enterprise-Grade Hadoop, Part 2<br />Enterprise-grade Hadoop requires a rich ecosystem of partners to complement H...
Towards Enterprise-Grade Hadoop, Part 2<br />Enterprise-grade Hadoop requires a rich ecosystem of partners to complement H...
Appistry Hadoop Partners (Sneak Peek!)<br />Excited to announce the first partners to certify their solutions on top of Cl...
Learn More<br />Workshop this evening presented by Appistry founder & chief architect Michael Groner<br />Appistry.com:<br...
Upcoming SlideShare
Loading in...5
×

Sam Charrington Of Appistry Gives Lighting Talk

1,047

Published on

Sam Charrington Of Appistry Gives Lighting Talk

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
1,047
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Sam Charrington Of Appistry Gives Lighting Talk

  1. 1. Towards Enterprise-Grade Hadoop<br />BigDataCamp 2010Santa Clara, CA<br />www.appistry.com<br />Sam Charrington (@samcharrington)<br />28 June 2010<br />
  2. 2. Appistry CloudIQ Platform helps customers deliver scalable systems for data-intensive applications<br />Data Growth Is Accelerating Out of Control<br />Tapping into Data Creates Huge Opportunities<br />Traditional Systems Can’t Handle Big Data<br />www.appistry.com<br />
  3. 3. 3<br />New<br />CloudIQ Engine<br />CloudIQ Manager<br />CloudIQ Storage<br />Cloud application server built for scale<br />Extensible application deployment and management<br />Scalable, reliable distributed file storage<br />www.appistry.com<br />
  4. 4. Towards Enterprise-Grade Hadoop, Part 1<br />For some Hadoop users, HDFS is insufficient from a reliability, scalability and/or performance perspective<br />Mission-critical applications<br />Persistent data<br />Real-time applications<br />Examples<br />Intelligence & DoD<br />Enterprise<br />HBase<br />www.appistry.com<br />4<br />
  5. 5. Hadoop/HDFS Challenges<br />Reliability/Availability<br />NN is SPoF<br />Scalability<br />NN holds all blocks locations in memory<br />Performance<br />NN is consulted on all reads/writes<br />Complexity<br />NN requires special care/feeding as result<br />HDFS Architecture<br />NameNode<br />Client<br />Data Node<br />Data Node<br />Data Node<br />Data Node<br />…<br />www.appistry.com<br />5<br />
  6. 6. CloudIQ Storage, Hadoop Edition Provides<br />Reliability/Availability<br />No SPoF<br />Scalability<br />Distributed metadata<br />Performance<br />Distributed lookups<br />Complexity<br />Fully symmetrical, easy to deploy<br />6<br />CloudIQ Storage Architecture<br />Client<br />CIQS Node<br />CIQS Node<br />CIQS Node<br />CIQS Node<br />…<br />HDFS Compatibility Means Existing Apps, Tools Work OOB!<br />
  7. 7. Towards Enterprise-Grade Hadoop, Part 2<br />www.appistry.com<br />7<br />
  8. 8. Towards Enterprise-Grade Hadoop, Part 2<br />www.appistry.com<br />8<br />Enterprise-grade Hadoop requires a rich ecosystem of partners to complement Hadoop core.<br />
  9. 9. Towards Enterprise-Grade Hadoop, Part 2<br />Enterprise-grade Hadoop requires a rich ecosystem of partners to complement Hadoop core.<br />www.appistry.com<br />9<br />Hadoop<br />Core<br />
  10. 10. Towards Enterprise-Grade Hadoop, Part 2<br />Enterprise-grade Hadoop requires a rich ecosystem of partners to complement Hadoop core.<br />www.appistry.com<br />10<br />Back-End<br />Hadoop<br />Core<br />Make it easier for users to deploy Hadoop:<br /> - CloudIQ Storage<br /> - CloudIQ Manager<br />
  11. 11. Towards Enterprise-Grade Hadoop, Part 2<br />Enterprise-grade Hadoop requires a rich ecosystem of partners to complement Hadoop core.<br />www.appistry.com<br />11<br />Back-End<br />Hadoop<br />Core<br />Front-End<br />Make it easier for users to develop Hadoop applications<br />Make it easier for users to deploy Hadoop:<br />- CloudIQ Storage<br />- CloudIQ Manager<br />
  12. 12. Appistry Hadoop Partners (Sneak Peek!)<br />Excited to announce the first partners to certify their solutions on top of CloudIQ Storage Hadoop Edition:<br />www.appistry.com<br />12<br />
  13. 13. Learn More<br />Workshop this evening presented by Appistry founder & chief architect Michael Groner<br />Appistry.com:<br />Peer2Peer community(free download)<br />Case studies, webinars, etc.<br />13<br />

×