Visualization Linda Fellingham, Ph. D Manager, Visualization and Graphics Sun Microsystems Shared...

19
Visualization Linda Fellingham, Ph. D Manager, Visualization and Graphics Sun Microsystems Shared Visualization 1.1 Software Scalable Visualization 1.1 Solutions

Transcript of Visualization Linda Fellingham, Ph. D Manager, Visualization and Graphics Sun Microsystems Shared...

Page 1: Visualization Linda Fellingham, Ph. D Manager, Visualization and Graphics Sun Microsystems Shared Visualization 1.1 Software Scalable Visualization 1.1.

Visualization

Linda Fellingham, Ph. DManager, Visualization and GraphicsSun Microsystems

Shared Visualization 1.1 Software Scalable Visualization 1.1 Solutions

Page 2: Visualization Linda Fellingham, Ph. D Manager, Visualization and Graphics Sun Microsystems Shared Visualization 1.1 Software Scalable Visualization 1.1.

The Data Tsunami

Visualization is needed to analyze the flood of data

from petascale computers

Page 3: Visualization Linda Fellingham, Ph. D Manager, Visualization and Graphics Sun Microsystems Shared Visualization 1.1 Software Scalable Visualization 1.1.

Big Data, Big Memory, Lots of CPU, Lots of Graphics PowerKeep Heat and Noise in the Server Room, Secure

Huge Data Overwhelms WorkstationsHow do we solve this problem?

Change the model!

Page 4: Visualization Linda Fellingham, Ph. D Manager, Visualization and Graphics Sun Microsystems Shared Visualization 1.1 Software Scalable Visualization 1.1.

Transition Point Has Been ReachedTime to Send Images Rather than Data

Human Visual Acuity

NetworkBandwidth

Display Resolution

Rendering Complexity

Time

Bandw

idth

Page 5: Visualization Linda Fellingham, Ph. D Manager, Visualization and Graphics Sun Microsystems Shared Visualization 1.1 Software Scalable Visualization 1.1.

Visualization Customer Needs• Understand and act upon increasing quantity and complexity of data• More and better utilization of graphics resources• Collaborate with geographically dispersed colleagues• Secure proprietary data and control access

Share Visualization on the Grid over the Network

Page 6: Visualization Linda Fellingham, Ph. D Manager, Visualization and Graphics Sun Microsystems Shared Visualization 1.1 Software Scalable Visualization 1.1.

Sun HPC Visualization Solutions

Graphics

Shared Visualization software provides secure access to 3D apps on a central resource>Transparently accessed from a variety of clients>Better utilization of resources>Access anytime from anywhere>Virtualizes Visualization

Scalable Visualization software to combine multiple devices for>Higher Performance>More resolution>Virtual Reality

Central Visualization Server

WAN

LAN

Directvideo

Page 7: Visualization Linda Fellingham, Ph. D Manager, Visualization and Graphics Sun Microsystems Shared Visualization 1.1 Software Scalable Visualization 1.1.

Sun/UT-TACC Visualization Prototype

TeraGrid

Dedicated IP networkSDSC

PSC

ANLScalable

Distributed

E25KPrototype GridFBPCI-E gfx in a box

Shared Visualization provides allocation of graphics resources and remote visualization services. Reservationsystem allows resources to be shared betweenpower wall and remote users.

U Texas Southwestern Medical CenterChris Gilpin – 3D protein structures

Circa 2004

Page 8: Visualization Linda Fellingham, Ph. D Manager, Visualization and Graphics Sun Microsystems Shared Visualization 1.1 Software Scalable Visualization 1.1.

Sun Scalable Visualization Solutions Supports combination of multiple graphics devices to drive: Higher performance for huge data sets Higher image quality Higher resolution

Sun Fire Servers

Page 9: Visualization Linda Fellingham, Ph. D Manager, Visualization and Graphics Sun Microsystems Shared Visualization 1.1 Software Scalable Visualization 1.1.

• Problem 1> Data too big for a workstation. Servers(with lots of

processors and memory) do not have adequate power or cooling for an ultra-high-performance 3D graphics card

• Solution 1:> Get the graphics card(s) out of the system

Scalable Solutions

Page 10: Visualization Linda Fellingham, Ph. D Manager, Visualization and Graphics Sun Microsystems Shared Visualization 1.1 Software Scalable Visualization 1.1.

Supported Platforms for Quadro Plex and Tesla

Sun SystemUltra24 2 1 2 1 2 2 1Ultra40 M2 2 1 2 1 2 2 1X2200 M2 1 1 1 1 1 1 1X4100 M2 1 1 1 1X4200 M2 1 1 1 1X4150 1 1 1 1 1 1 1X4450 2 1 2 1 2 2 1X4140 1 1 1 1 1 1 1X4240 1 1 1 1 1 1 1X4440 2 1 2 1 2 2 1X4600 M2 2 1 2 1 2 2 1

Quadro Plex 1000 M4

Quadro Plex 2100 S4

Tesla D870

Tesla S870

Coming soon QP 2100 D2

Coming soon Tesla D1070

Coming soon Tesla S1070

Page 11: Visualization Linda Fellingham, Ph. D Manager, Visualization and Graphics Sun Microsystems Shared Visualization 1.1 Software Scalable Visualization 1.1.

Sample Reference Configuration• For single system solution:

> X4600M2 with 2 Nvidia Model 4 Quadro Plexes> Up to 32 cores, 256GB of memory> 8 Displays, 6 GB of total framebuffer memory > Rack mountable (7U total)

Page 12: Visualization Linda Fellingham, Ph. D Manager, Visualization and Graphics Sun Microsystems Shared Visualization 1.1 Software Scalable Visualization 1.1.

Scalable Solutions• Problem 2

> Need to view data across many screens (more than can be supported in a single system) in order to view adequate detail

• Solution 2> Scalable visualization software to distribute the rendering

across many systems clustered with InfiniBand or 10 GigE

Page 13: Visualization Linda Fellingham, Ph. D Manager, Visualization and Graphics Sun Microsystems Shared Visualization 1.1 Software Scalable Visualization 1.1.

Sun Scalable Visualization 1.1 Solution• Supports non-coplanar configurations • First installation: Eight-sided cave (oCtAVE) at

Salford University, U K

Page 14: Visualization Linda Fellingham, Ph. D Manager, Visualization and Graphics Sun Microsystems Shared Visualization 1.1 Software Scalable Visualization 1.1.

Scalable Viz 1.1 Software Details• Scalable Visualization software currently supports:

> Red Hat Linux (RHEL4U2 and later) > SLES 10> Solaris 10 U3

• Complete software stack> Based on open source software (Chromium, MVAPICH2,

OFED, OpenSceneGraph, Paraview)> Sun added value:

> Pre-built binaries> Installation scripts and configuration files> Wrappers for greater ease of use> MPI protocol support added for Chromium interconnect> Supported on Sun hardware

Page 15: Visualization Linda Fellingham, Ph. D Manager, Visualization and Graphics Sun Microsystems Shared Visualization 1.1 Software Scalable Visualization 1.1.

Sun Shared Visualization 1.1 Software• Application transparent – no need to modify code

> Plugs into any Solaris/Linux OpenGL application

• High performance > Redirects 3D rendering into accelerated pixel buffers on the server's graphics

hardware

• Increased efficiency and security > Sends only 2D screen images to client with optimized compression

• Supports many kinds of clients> Solaris SPARC, Solaris x64, Linux , Windows, Sun Ray, Apple OS X (Intel)

• Easy access and management > Central graphics resources managed using Sun Grid Engine software> Automates configuration of VGL server> Automates connecting and using VGL image transport> Integration with Scalable Viz 1.1

Page 16: Visualization Linda Fellingham, Ph. D Manager, Visualization and Graphics Sun Microsystems Shared Visualization 1.1 Software Scalable Visualization 1.1.

Sun Visualization StackShared Visualization software stackShared Visualization software stack - visualization services to a variety of remote clients

SGESGE – open source scheduler extended for graphics resource managementVirtualGLVirtualGL – open source remote access to accelerated 3D via any client over standard IP networksTurboVNCTurboVNC – open source high-performance vncviewer and vncserver

Scalable Visualization software stackScalable Visualization software stack ParaView ParaView - open-source parallel rendering application optimized for SMPs with multiple graphics.OpenSceneGraph -OpenSceneGraph - open-source parallel rendering toolkit for building parallel applications.ChromiumChromium - virtualized graphics devices for Solaris or Linux. Provides transparent parallelization for fill-rate limited applications.MVAPICH2/OpenMPI MVAPICH2/OpenMPI - MPI for Linux/SolarisOFEDOFED – IB for Linux (IB support incl in Solaris)

Quadro PlexQuadro Plex - connects graphics devices to Linux or Solaris servers over a PCI-E cable

SystemsSystems - Sun Fire x64 & SPARC systems provide scalable platforms

OpenGL

Applications

VirtualGL

Sun Grid Engine Graphics Resource Manager

Chromium

Quadro FX /Quadro Plex driver

ParaView

OpenSceneGraph

Systems

OFED

OpenGL MVAPICH2

TurboVNC

Page 17: Visualization Linda Fellingham, Ph. D Manager, Visualization and Graphics Sun Microsystems Shared Visualization 1.1 Software Scalable Visualization 1.1.

Visualization servers come in many flavors

M4000 serving ProE and Catiato Sun Rays

x4600/QP driving a caveand serving workstationand laptop clients

Cluster of x4600s driving a powerwalland serving WAN clients

Page 18: Visualization Linda Fellingham, Ph. D Manager, Visualization and Graphics Sun Microsystems Shared Visualization 1.1 Software Scalable Visualization 1.1.

TACC Ranger Viz System• IB connected thru

Magnum switch• 32 GPUs• 128 cores• > 1TB RAM• Supports up to

128 remote Shared Viz clients

Adaptive Mesh Refinement Galaxy Formation Isotropic Turbulence

Page 19: Visualization Linda Fellingham, Ph. D Manager, Visualization and Graphics Sun Microsystems Shared Visualization 1.1 Software Scalable Visualization 1.1.

Linda [email protected]

THANK YOU.