Creating a Better Infrastructure
to Manage Big Data
SC’13 Exhibitor Forum
Software for HPC III
Trev Harmon
Principal Solut...
Exascale

??
Let’s Turn Back the Clock

Denver,
Colorado

5

2010

2013

© 2013 ADAPTIVE COMPUTING, INC.
Douglas Parkhill’s Vision

6

© 2013 ADAPTIVE COMPUTING, INC.
7
not	
  exactly	
  
Cloud	
  ?	
  
An Over-simplification

Visualization

HPC

Technical
Computing

Computing
Big Data
Cloud

9

© 2013 ADAPTIVE COMPUTING, I...
Multiple Fields
Multiple Users

10

© 2013 ADAPTIVE COMPUTING, INC.
Computing Workflows

Visualization

HPC

11

© 2013 ADAPTIVE COMPUTING, INC.
Computing Workflows

12

Scientific
Computing

Big Data

Visualization

Cloud

HPC

© 2013 ADAPTIVE COMPUTING, INC.
Really, we’re optimizing…

Job
Needs
Available
Resources
13

© 2013 ADAPTIVE COMPUTING, INC.
Topology and Company

Topology-Awareness
Data-Locality Awareness
Hardware Preferences
14

© 2013 ADAPTIVE COMPUTING, INC.
Another Merger

Cloud

Scientific
Computing

Big Data

HPC
Cloud
Visualization

15

© 2013 ADAPTIVE COMPUTING, INC.

HPC
Defining HPC Cloud

ds…
en
lly.
rea
dep
It
m,
the
l of
ll al
we

16

Cloud-based HPC ?
Cloud-bursting ?
VM-encapsulated Jo...
The Future of Computing
Is Founded on HPC
Principles and Concepts.

17

© 2013 ADAPTIVE COMPUTING, INC.
Douglas Parkhill’s Vision

18

© 2013 ADAPTIVE COMPUTING, INC.
19

© 2013 ADAPTIVE COMPUTING, INC.
20

© 2013 ADAPTIVE COMPUTING, INC.
Attribution & Citation
▪ 
▪ 
▪ 

21

Denver Photo:
http://www.flickr.com/photos/dagpeak/
Douglas Parkhill Photo: http://ww...
Creating a Better Infrastructure to Manage Big Data
Creating a Better Infrastructure to Manage Big Data
Upcoming SlideShare
Loading in …5
×

Creating a Better Infrastructure to Manage Big Data

529 views

Published on

"While traditional HPC is at the core of supercomputing, recent advancements are allowing HPC centers to offer new and exciting compute services to their users and other customers. Adaptive Computing will discuss two such advancements, topology-based scheduling and HPC cloud, and how together they provide an infrastructure that allow HPC centers to provide Big Data and services along with traditional offerings."

Over the course of this talk, Trev Harmon from Adaptive Computing looks back to the utility computing vision of Douglas Parkhill and proposes an application-centric workflow for the future that fulfills that vision across many disciplines of computing.

Watch the presentation video: http://wp.me/p3RLHQ-aX3

Published in: Technology, Education
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
529
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
11
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Creating a Better Infrastructure to Manage Big Data

  1. 1. Creating a Better Infrastructure to Manage Big Data SC’13 Exhibitor Forum Software for HPC III Trev Harmon Principal Solution Strategist Adaptive Computing 1 © 2013 ADAPTIVE COMPUTING, INC. 21 Nov 2013 4:00-4:30pm
  2. 2. Exascale ??
  3. 3. Let’s Turn Back the Clock Denver, Colorado 5 2010 2013 © 2013 ADAPTIVE COMPUTING, INC.
  4. 4. Douglas Parkhill’s Vision 6 © 2013 ADAPTIVE COMPUTING, INC.
  5. 5. 7
  6. 6. not  exactly   Cloud  ?  
  7. 7. An Over-simplification Visualization HPC Technical Computing Computing Big Data Cloud 9 © 2013 ADAPTIVE COMPUTING, INC. Scientific Computing
  8. 8. Multiple Fields Multiple Users 10 © 2013 ADAPTIVE COMPUTING, INC.
  9. 9. Computing Workflows Visualization HPC 11 © 2013 ADAPTIVE COMPUTING, INC.
  10. 10. Computing Workflows 12 Scientific Computing Big Data Visualization Cloud HPC © 2013 ADAPTIVE COMPUTING, INC.
  11. 11. Really, we’re optimizing… Job Needs Available Resources 13 © 2013 ADAPTIVE COMPUTING, INC.
  12. 12. Topology and Company Topology-Awareness Data-Locality Awareness Hardware Preferences 14 © 2013 ADAPTIVE COMPUTING, INC.
  13. 13. Another Merger Cloud Scientific Computing Big Data HPC Cloud Visualization 15 © 2013 ADAPTIVE COMPUTING, INC. HPC
  14. 14. Defining HPC Cloud ds… en lly. rea dep It m, the l of ll al we 16 Cloud-based HPC ? Cloud-bursting ? VM-encapsulated Jobs ? © 2013 ADAPTIVE COMPUTING, INC.
  15. 15. The Future of Computing Is Founded on HPC Principles and Concepts. 17 © 2013 ADAPTIVE COMPUTING, INC.
  16. 16. Douglas Parkhill’s Vision 18 © 2013 ADAPTIVE COMPUTING, INC.
  17. 17. 19 © 2013 ADAPTIVE COMPUTING, INC.
  18. 18. 20 © 2013 ADAPTIVE COMPUTING, INC.
  19. 19. Attribution & Citation ▪  ▪  ▪  21 Denver Photo: http://www.flickr.com/photos/dagpeak/ Douglas Parkhill Photo: http://www.spectralumni.ca/CommExpress_pdf/ cemay84e.pdf Topology Map: US Geological Survey, US Department of the Interior/USGS © 2013 ADAPTIVE COMPUTING, INC.

×