Sam Charrington Of Appistry Gives Lighting Talk

  • 978 views
Uploaded on

Sam Charrington Of Appistry Gives Lighting Talk

Sam Charrington Of Appistry Gives Lighting Talk

More in: Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
978
On Slideshare
0
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
0
Comments
0
Likes
0

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Towards Enterprise-Grade Hadoop
    BigDataCamp 2010Santa Clara, CA
    www.appistry.com
    Sam Charrington (@samcharrington)
    28 June 2010
  • 2. Appistry CloudIQ Platform helps customers deliver scalable systems for data-intensive applications
    Data Growth Is Accelerating Out of Control
    Tapping into Data Creates Huge Opportunities
    Traditional Systems Can’t Handle Big Data
    www.appistry.com
  • 3. 3
    New
    CloudIQ Engine
    CloudIQ Manager
    CloudIQ Storage
    Cloud application server built for scale
    Extensible application deployment and management
    Scalable, reliable distributed file storage
    www.appistry.com
  • 4. Towards Enterprise-Grade Hadoop, Part 1
    For some Hadoop users, HDFS is insufficient from a reliability, scalability and/or performance perspective
    Mission-critical applications
    Persistent data
    Real-time applications
    Examples
    Intelligence & DoD
    Enterprise
    HBase
    www.appistry.com
    4
  • 5. Hadoop/HDFS Challenges
    Reliability/Availability
    NN is SPoF
    Scalability
    NN holds all blocks locations in memory
    Performance
    NN is consulted on all reads/writes
    Complexity
    NN requires special care/feeding as result
    HDFS Architecture
    NameNode
    Client
    Data Node
    Data Node
    Data Node
    Data Node

    www.appistry.com
    5
  • 6. CloudIQ Storage, Hadoop Edition Provides
    Reliability/Availability
    No SPoF
    Scalability
    Distributed metadata
    Performance
    Distributed lookups
    Complexity
    Fully symmetrical, easy to deploy
    6
    CloudIQ Storage Architecture
    Client
    CIQS Node
    CIQS Node
    CIQS Node
    CIQS Node

    HDFS Compatibility Means Existing Apps, Tools Work OOB!
  • 7. Towards Enterprise-Grade Hadoop, Part 2
    www.appistry.com
    7
  • 8. Towards Enterprise-Grade Hadoop, Part 2
    www.appistry.com
    8
    Enterprise-grade Hadoop requires a rich ecosystem of partners to complement Hadoop core.
  • 9. Towards Enterprise-Grade Hadoop, Part 2
    Enterprise-grade Hadoop requires a rich ecosystem of partners to complement Hadoop core.
    www.appistry.com
    9
    Hadoop
    Core
  • 10. Towards Enterprise-Grade Hadoop, Part 2
    Enterprise-grade Hadoop requires a rich ecosystem of partners to complement Hadoop core.
    www.appistry.com
    10
    Back-End
    Hadoop
    Core
    Make it easier for users to deploy Hadoop:
    - CloudIQ Storage
    - CloudIQ Manager
  • 11. Towards Enterprise-Grade Hadoop, Part 2
    Enterprise-grade Hadoop requires a rich ecosystem of partners to complement Hadoop core.
    www.appistry.com
    11
    Back-End
    Hadoop
    Core
    Front-End
    Make it easier for users to develop Hadoop applications
    Make it easier for users to deploy Hadoop:
    - CloudIQ Storage
    - CloudIQ Manager
  • 12. Appistry Hadoop Partners (Sneak Peek!)
    Excited to announce the first partners to certify their solutions on top of CloudIQ Storage Hadoop Edition:
    www.appistry.com
    12
  • 13. Learn More
    Workshop this evening presented by Appistry founder & chief architect Michael Groner
    Appistry.com:
    Peer2Peer community(free download)
    Case studies, webinars, etc.
    13