Hw09 Production Deep Dive With High Availability

Hadoop at ContextWeb Alex Dorman, VP Engineering Paul George, Sr. Systems Architect October 2009

ContextWeb: Traffic ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

ContextWeb Architecture highlights ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Hadoop Data Set ,[object Object],[object Object],[object Object],[object Object]

Hadoop Cluster ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Hadoop Cluster ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Architectural Challenges ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Partitioned Data Set: Date/Time ,[object Object],[object Object],[object Object],[object Object],[object Object]

Partitioned Data Set: Revisions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Partitioned Data Set: processing flow

Logical Schemas and Headers ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Getting Data in and out ,[object Object],[object Object],[object Object],[object Object]

Getting Data in and out: WebDAV driver ,[object Object],[object Object],[object Object],[object Object],[object Object]

Getting Data in and out: WebDav

QlikView Reporting Application ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

High Availability for NameNode/JobTracker ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Redundant Network Architecture ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Software Packages We Use for HA ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Replication of NameNode Metadata ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

In the Unlikely Event of a Water Landing ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

In the Unlikely Event of a Water Landing ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

In the Unlikely Event of a Water Landing ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

In the Unlikely Event of a Water Landing ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Other Options to Consider ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Hw09 Production Deep Dive With High Availability

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Hw09 Production Deep Dive With High Availability

Similar to Hw09 Production Deep Dive With High Availability (20)

More from Cloudera, Inc.

More from Cloudera, Inc. (20)

Recently uploaded

Recently uploaded (20)

Hw09 Production Deep Dive With High Availability