• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Distro compute
 

Distro compute

on

  • 461 views

Distributed Compute in Windows Azure, prepared for ACCU London

Distributed Compute in Windows Azure, prepared for ACCU London

Statistics

Views

Total Views
461
Views on SlideShare
461
Embed Views
0

Actions

Likes
0
Downloads
0
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

CC Attribution License

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • Developer centres forJavaPHPRubyPython
  • Took 1.9 million compute hoursWould have taken 25 years on an 8 core machine
  • Cost vs recovery time
  • You can’t scale a HPC cluster as it can’t open up new connections
  • Scalable clusters are great but better is a flexible cluster that you can change dynamically at runtime
  • If the system is totally torn down at the end, you lose all sense of logs.

Distro compute Distro compute Presentation Transcript

  • Introduce
  • Workloads Distributed compute in a nutshell (where many nuts > few nuts)
  • Workloads
  • Distributed Compute Developer Big Compute Big Penguin Big Data
  • BIG ANYTHING Hello All Worlds
  • Big Co$t? That’d be like Microsoft, right?
  • Microsoft Research Genomics
  • Inspect Distributed compute in a nutshell (with many little nuts)
  • Inspect
  • HPC Head Node Broker Nodes Compute Nodes Allows on-premises And hybrid option Compare Architectures Big Data Name Node Data Nodes Allows cloud or on-premises no hybrid option
  • Hadoop HPC
  • All distributed compute works on the basis of taking a large JOB and breaking it to many smaller TASKS which are then parallelised
  • Develop
  • Deploy
  • Examples How do you take your compute?
  • OUCH Lessons learned from getting too close to the coalface
  • A broken cluster is no place to be diagnosing
  • Scalability < Elasticity
  • Hybrid HPC is next to useless
  • 95% through a petabyte is a bad place to find a bug
  • Thank you!