Perumal Kuppuudaiyar's (Intel Lab Europe) talk at NC4 2016 was focussed on the implementation of test bed which had integrated with various state of the art software stacks on top of the heterogeneous resources to provide FT/HA clusters, fined grained resource management and containerised workload orchestration for HPC.

1. PERUMAL KUPPUUDAIYAR
RESEARCH ENGINEER, CLOUD SERVICES LAB.
12- APRIL - 2016
1
Testbed for Heterogeneous Cloud

2. Topics
• Test bed Requirements
• Physical Layout
• Software Stacks
• Integration
• Use case Demo
◦ Interactive 3D Image rendering : Ray Tracing of a 3D Blender model using Intel’s Xeon Phi and
Embree Kernel.
08/04/2015 2

3. Requirements
3
• Managing Heterogeneous Resources
• Fault tolerance and High availability
• Support mixed workloads (MPI, Spark, Storm, etc.)
• Application portability
• Near bare metal performance
• Multi-node orchestration for parallel tasks
• Telemetry and workload characterisation
• …….

4. Physical Layout
4

5. Software Stacks
5
Light weight portable
application container
Minimal Linux OS
- Systemd for running services,
- Etcd for clustering hosts together,
- Fleet for distribution across cluster
Mesos + Marathon +Zookeeper
Resource Management & Scheduling
Telemetry and Monitoring Systems
Weave creates a virtual network to connects Docker containers
deployed across multiple hosts and enables their automatic discovery
Container Cluster Manager
….

6. Integration
08/04/2015 6
StorageMemoryCPU GPUMIC NIC
fleet SDS dockeretcd SDN telemetry mesos
Marathon Kubernetes And other FWs...
PhysicalLayerDCOSFrameworks
Service Orchestration
(Bare Metals, Micro services (containers), KVM and Cloud formation Interface)
Service
Bare metal
(fleet units)
Dockerised
Applications Cloud formation
Clusters of
Containers
(POD)

7. Use Case – Ray Tracing
08/04/2015 TELECONFERENCE 7
• In computer graphics, ray tracing is a technique
for generating an image by tracing the path of
light through pixels in an image plane and
simulating the effects of its encounters with
virtual objects.
• The technique is capable of producing a very
high degree of visual realism, usually higher
than that of typical scanline rendering methods,
but at a greater computational cost.

8. Demo – 3D Image Interactive Rendering
8
Remote Client
Testbed Infrastructure
SSH and
X11 Display
Forwarding
VPN/SSH Tunnel
3D Designer create 3D contents
using CPU node
Interactive Rendering
using Xeon Phi & Embree Kernel
3D Designer create 3D contents
using CPU node
ServiceGateway-FW
Submit Job (2 CPU based blender instance &
1 Xeon Phi Embree pathtracer)
Orchestrator
CPU + Xeon Phi
CPU Node
CPU Node
CPU + GPU Node

9. DEMO
08/04/2015 9

10. Questions?
10
Thank You