National Computational Science Alliance Coupling the Leading Edge Site with the Alliance Partners...

National Computational Science Alliance

Coupling the Leading Edge Site with the Alliance Partners

• Talk given to First Annual ITEA Workshop on High Performance Computing in Support of Test and Evaluation at Aberdeen, MD

• July 15, 1998


NCSA is the Leading Edge Site for the National Computational Science Alliance

www.ncsa.uiuc.edu


The Grid Links People with Distributed Resources on a National Scale

Source: NASA http://science.nas.nasa.gov/Groups/Tools/IPG


vBNS Connected Alliance Site

vBNS Alliance Site Scheduled for Connection

NCSANCSA

Assembling the Links in the Gridwith NSF’s vBNS Connections Program

StarTAPStarTAP

27 Alliance sites running...

…16 more in progress.

vBNS Backbone Node

1999: Expansion via Internet2 -- AbilenevBNS & Abilene at 2.4 Gbit/s

Source: Charlie Catlett, Randy Butler, NCSA Grid Team

NCSA Distributed Applications Support Team for vBNS


The Grid Enables Caterpillar’s Collaborative Virtual Prototyping in a Virtual Proving Ground

Source: Caterpillar, NCSA Industrial Partners Program

CAD to VR, Live Rocks, Texture Mapped TerrainReal Time Linked-VR and Audio-Video

Between NCSA and Germany


HPC and Visualization Supporting Anti-Terrorism Explosive Tests

Polly Baker, Randy Heiland and Dave Bock, NCSA; Raju Namburu, Tommy Bevins, Byron Armstrong, Photios Papados, CEWES; Mike Stephens, AHPCRC; Kent Eschenberg, Nichols Research Corp

Visualization Tool Kit (VTK)-From GE Corp. R&DC++ classes for data I/O and mapping data to graphics. Handles unstructured grids as well as rectilinear and structured

DOD Grand Challenge, Raju Namburu, CEWES, PI

CEWES MSRC PET Program


Interactive Visualization for Validation of SensorsData Then Validates HPC Modeling, Simulation, & Visualization for T&E

Visualization Kelly Kirk, NCSA PET www.arl.hpc.mil/VS/

68 Sensors Attached to Truck to

Define Dynamics

HPC Simulation to Match Sensor Readings

Participants:ARL T&E Command

Aberdeen Test CenterTACOM, TARDECARL MSRC-PET

NCSA Sci VizUMN AHPCRC

Clark Atlanta UniversityWest Virginia University

Georgia Tech


The Grid Links Remote Sensors With Supercomputers, Controls, & Digital Archives in Realtime

Starburst Galaxy M82

• Alliance Scientific Instrument Team– Real Time Control and Steering– Collaborative Web Interface– Radio Astronomy and Biomedicine

Alliance Scientific Instrument Applications Team


ProcessProcess

DataData

Process Process ModelModelPlant-wide Control

Measurements andExperimental Design

Parameter Estimation

Process

ControlControlSignalsSignals

Goal - Realtime Linking of Sensors with Modeling, Simulation, and Control

Grid Coupling: SensorsNetworksDataHPC ModelsControls

Alliance Chemical Engineering Applications Team


The Grid Links Multiple Investigators With Sensors, Modeling, Simulation, and Controls

ReactorReactorSimulationSimulationReactorReactor

SimulationSimulation

InteractiveInteractiveDiscussionDiscussionInteractiveInteractiveDiscussionDiscussion

DetailedDetailedVisualizationVisualization

DetailedDetailedVisualizationVisualization

CurrentCurrentparameters parameters in solutionin solution

CurrentCurrentparameters parameters in solutionin solution

Status ofStatus ofSimulationSimulationStatus ofStatus of

SimulationSimulation

Ken Bishop, U Kansas Using NCSA Habanero


Modeling and Simulation Challenges - The Problem of Coupling Multiple Scales

O(km) O(cm) O(nm)O(m)

But: What Are the Effects of Uncertainties on Performance?


The Alliance Chemical Engineer’s Workbench

• Web Interface with Collaboration Software• Provides an Integrated Environment for:

– Process Modeling – Data Analysis– Control– Optimization

• Links – Multiple Scales– Software Tools From Different Vendors

• Utilizes “Best” Computing and Software Tools to Help Solve Practical Applications


The Chemical Engineer’s Workbench-Web Interface to Science and Engineering

CHEMICAL ENGINEER”S WORKBENCH (Collaborative, web-based modeling environment)

Microscopic Computational ChemistryMicroscopic Computational Chemistry

Macroscopic Transport and Reaction ProcessesMacroscopic Transport and Reaction Processes

UncertaintyAnalysis

Algorithmic Scale MatchingFile Transfer

Quantum ChemistryComputations ofThermochemistry

Experimental Data onMechanismsand Rates

Chemical MechanismFormulation

Transition State TheoryEstimates of Rates

Macroscopic ChemicalProcess Models

Momentum,Energy and Mass

Conservation Models

ExperimentalData & Validation

Reactor DesignReactor Design

SpecificationsSpecifications

PredictedPredicted

PerformancePerformance

MolecularModeling

CFDSimulation

ProcessSimulation

UncertaintyAnalysis

ReactionModeling


User Web BrowserOutput to User

User Input

Format Translator, Query Engine and Program Driver

Workbench Server

Results to User

User Instructions and queries

Application Programs

(May have varyinginterfaces and be written in different

languages)Results

Instructions

Information Sources(May be of

varying formats)

Information

Queries

NCSA Computational Biology Group

The NCSA Information Workbench - An Architecture for Web-Based Computing


Bringing Advanced Data Mining Models and Methods to Massive Data Sets

PredictiveModeling

Classification

Value prediction

DatabaseSegmentation

Demographic clustering

Neural clustering

LinkAnalysis

Associations discovery

Sequential pattern discovery

Similar time sequence discovery

DeviationDetection

Visualization

Statistics


NCSA / AllstateNT Cluster Data Refinery

Visualization Stations

Compaq

NT Server

•Data Management Engine

• CORBA/Java Orbs

• High-Speed Interconnect

•Terabyte File System

•Query Capability

•Visualization Tools

•Parallel Rule Construction

External Networks

Source: Allstate & Tilt Thompkins, NCSA

Compaq

NT Server


The University of Illinois NT Supercluster - 256 Intel Pentium II Processors

192 Hewlett Packard 300 MHz

64 Compaq 333 MHz

• Andrew Chien, Computer Science UIUC • Rob Pennington, NCSA

“Supercomputer performance at mail-order prices”-- Jim Gray, Microsoft


NCSA Information Visualization Laboratory

Cave™

ImmersaDesk™

Databases

GraphicsWorkstations

Flat Panel Wall

In3D™ for C++ and JavaVizIt/In3D™

MineSetS-PLUS


Sears Pioneers Massive Data Mining and Information Visualization at NCSA

• 1998 VLDB Survey Program Grand Prize Winner – Largest Database

– 4.7 Terabytes of Data

– 10 Terabyte Total Disk Space Capacity– Storage Provided by EMC

Image Courtesy of Michael Welge, NCSA and Sears


Data Mining - NCSA Industrial Partner Projects

• Caterpillar– Effluent Quality Control– Smart Selling– Warranty Claims Analysis– Customer Value Analysis

• Ford– Product Compatibility– Harshness, Noise, Vibration– Marketing

• Sears– Transaction Management

• Boeing – Post-Flight Diagnostics– Image Databases

• Allstate– Medical Claims

• Financial Impact May Be Greater Than $30 Million


NCSA Prognostics Working Group Is Being Organized

• Technology for Leveraging Information Assets• Public/Private Sector Issues Similar

– Data Collection: Prior and Real-Time– Dynamic Modeling of Components and Vehicles– Real-Time Analysis– Vehicle and Logistics Chain Models– System Optimization

• Cooperative Technology Development– NCSA– Caterpillar– Ford– ARL– ASC


The Continuing Exponential Agent of Change

1985 Cray X-MP

Cost: $8,000,000

60,000 watts of power

No Built in Graphics

56 kbps NSFnet Backbone

1997 Nintendo 64

Cost: $149

5 watts of power

Interactive 3D Graphics

64 kbps ISDN to Home


Growth Rate of the NSF Supercomputer Capacity is 70% Compounded Per Year!

10,000

100,000

1,000,000

10,000,000

100,000,000

1,000,000,000

1986

1988

1990

1992

1994

1996

1998

2000

2002

Fiscal Year

No

rmal

ized

CP

U H

ou

rs

Total NU

70% Annual Growth This Year

Source: Quantum Research; Lex Lane, NCSA

1000 x 1985


The Evolution of Shared Memory Parallel Computing

Vector SMPsto

Microprocessor SMPsto

Microprocessor DSMsto

Clustered Microprocessor DSMs


Large Origin Arrays Give NCSA and DOD Mod Common Computing Environment

NCSA has 6 x 128 processorsASC has 4 x 128ARL has 3 x 128CEWES has 1 x 128NAVO has 1 x 128

Los Alamos Will Have 48 x 128!


Alliance / DOD Mod Origin2000 Repository

http://scv.bu.edu/SCV/Origin2000/

Kadin Tseng, BU, Gary Jensen, NCSA, Chuck Swanson, SGI


How to Find Out More About the Alliance

See also http://alliance.ncsa.uiuc.edu

National Computational Science Alliance Coupling the Leading Edge Site with the Alliance Partners...

Documents

Transcript of National Computational Science Alliance Coupling the Leading Edge Site with the Alliance Partners...