1

PERUMAL KUPPUUDAIYAR RESEARCH ENGINEER, CLOUD SERVICES LAB.12- APRIL - 2016

Testbed for Heterogeneous Cloud

2

Topics• Test bed Requirements• Physical Layout• Software Stacks• Integration• Use case Demo

◦ Interactive 3D Image rendering : Ray Tracing of a 3D Blender model using Intel’s Xeon Phi and Embree Kernel.

08/04/2015

3

Requirements• Managing Heterogeneous Resources• Fault tolerance and High availability• Support mixed workloads (MPI, Spark, Storm, etc.)• Application portability • Near bare metal performance• Multi-node orchestration for parallel tasks• Telemetry and workload characterisation• …….

4

Physical Layout

5

Software Stacks

Light weight portable application container

Minimal Linux OS- Systemd for running services, - Etcd for clustering hosts together,- Fleet for distribution across cluster Mesos + Marathon +Zookeeper

Resource Management & Scheduling

Telemetry and Monitoring Systems

Weave creates a virtual network to connects Docker containers deployed across multiple hosts and enables their automatic discovery

Container Cluster Manager

….

6

Integration

08/04/2015

StorageMemoryCPU GPUMIC NIC

fleet SDS dockeretcd SDN telemetry mesos

Marathon Kubernetes And other FWs...

Phys

ical L

ayer

DCO

SFr

amew

orks

Service Orchestration(Bare Metals, Micro services (containers), KVM and Cloud formation Interface)

Serv

ice

Bare metal(fleet units)

Dockerised Applications Cloud formation

Clusters of Containers

(POD)

TELECONFERENCE 7

Use Case – Ray Tracing

08/04/2015

• In computer graphics, ray tracing is a technique for generating an image by tracing the path of light through pixels in an image plane and simulating the effects of its encounters with virtual objects.

• The technique is capable of producing a very high degree of visual realism, usually higher than that of typical scanline rendering methods, but at a greater computational cost.

8

Demo – 3D Image Interactive Rendering

Remote ClientTestbed Infrastructure

SSH and X11 Display Forwarding

VPN/SSH Tunnel3D Designer create 3D contentsusing CPU node

Interactive Renderingusing Xeon Phi & Embree Kernel

3D Designer create 3D contentsusing CPU node Se

rvic

e Ga

tew

ay- F

W

Submit Job (2 CPU based blender instance &1 Xeon Phi Embree pathtracer)

Orc

hest

rato

r

CPU + Xeon Phi

CPU Node

CPU Node

CPU + GPU Node

9

DEMO

08/04/2015

10

Questions?

Thank You