Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast...
Transcript of Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast...
![Page 1: Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast ... POV-Ray animation of periodic ship oscillation ... Engineering Simulation Solutions](https://reader036.fdocuments.net/reader036/viewer/2022062907/5aa28dfc7f8b9ada698d0e73/html5/thumbnails/1.jpg)
© 2007 ANSYS, Inc. All rights reser ved. 1 June 2007 ANSYS, Inc. Proprietar y
Timothy Kwan
Regional Business Manager
CAD-IT Consultants
Engineering Simulation Solutions &
High Performance Computing
![Page 2: Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast ... POV-Ray animation of periodic ship oscillation ... Engineering Simulation Solutions](https://reader036.fdocuments.net/reader036/viewer/2022062907/5aa28dfc7f8b9ada698d0e73/html5/thumbnails/2.jpg)
© 2008 ANSYS, Inc. All rights reser ved. 2 ANSYS, Inc. Pr oprietary
CAD-IT Consultants
• Brief History :
– Formed in 1991 (Singapore)
– Malaysian operations started in 1994
– China offices set up starting 1997
– Thailand representative office opened in 2001
• Regional channel partner for:
– ANSYS simulation solutions: ANSYS Multiphysics, FLUENT, CFX, AUTODYN, Icepak etc
– CEI visualization solutions: Ensight
– SFTC’s metal forming processes simulation solution: DEFORM
– Moldflow’s plastics flow simulation solutions: MPA, MPI etc
– IMC’s problem solving and idea generation solution: Goldfire Innovator
• HP, Microsoft WCCS and ANSYS collaboration partner
![Page 3: Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast ... POV-Ray animation of periodic ship oscillation ... Engineering Simulation Solutions](https://reader036.fdocuments.net/reader036/viewer/2022062907/5aa28dfc7f8b9ada698d0e73/html5/thumbnails/3.jpg)
© 2008 ANSYS, Inc. All rights reser ved. 3 ANSYS, Inc. Pr oprietary
What is CAE?
• Computer-Aided Engineering (often referred to as CAE) is the use of
information technology for supporting engineers in tasks such as
– Analysis
– Simulation
– Design
– Manufacture
– Planning
– Diagnosis
– Repair
• CAE tools, are software that have been developed:
– for providing support to the activities above
– to analyze the robustness and performance of components and
assemblies
– to help support design teams in decision making
![Page 4: Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast ... POV-Ray animation of periodic ship oscillation ... Engineering Simulation Solutions](https://reader036.fdocuments.net/reader036/viewer/2022062907/5aa28dfc7f8b9ada698d0e73/html5/thumbnails/4.jpg)
© 2008 ANSYS, Inc. All rights reser ved. 4 ANSYS, Inc. Pr oprietary
What is CAE?
• CAE areas covered include:
– Structural analysis on components and assemblies using FEA
(Finite Element Analysis)
– Thermal and fluid flow analysis using CFD (Computational Fluid Dynamics)
– Rigid multibody dynamics or mechanical systems motion
simulation
– Analysis tools for process simulation of operations such as
casting, molding, and die press forming
– Optimization of the product or process
![Page 5: Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast ... POV-Ray animation of periodic ship oscillation ... Engineering Simulation Solutions](https://reader036.fdocuments.net/reader036/viewer/2022062907/5aa28dfc7f8b9ada698d0e73/html5/thumbnails/5.jpg)
© 2008 ANSYS, Inc. All rights reser ved. 5 ANSYS, Inc. Pr oprietary
CAE Technology Application Trends:
Need More Fidelity
Where are the hotspots?
• 10 load cases• Fatigue calculations• Known a priori?• Need to submodel?
No M
issed Hot S
pots!
![Page 6: Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast ... POV-Ray animation of periodic ship oscillation ... Engineering Simulation Solutions](https://reader036.fdocuments.net/reader036/viewer/2022062907/5aa28dfc7f8b9ada698d0e73/html5/thumbnails/6.jpg)
© 2008 ANSYS, Inc. All rights reser ved. 6 ANSYS, Inc. Pr oprietary
CAE Technology Application Trends:
Reduce Engineering Time
Direct CAD to Mesh
• No defeaturing• No mid-planing• No shells• No beams• …
No Sim
plifications!
![Page 7: Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast ... POV-Ray animation of periodic ship oscillation ... Engineering Simulation Solutions](https://reader036.fdocuments.net/reader036/viewer/2022062907/5aa28dfc7f8b9ada698d0e73/html5/thumbnails/7.jpg)
© 2008 ANSYS, Inc. All rights reser ved. 7 ANSYS, Inc. Pr oprietary
CAE Technology Application Trends:
Model Complete Assemblies
Model Complete Assembly
• No BC assumptions• All parts CAD-to-mesh• Automatic contact
Work-Years to W
ork-Days!
![Page 8: Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast ... POV-Ray animation of periodic ship oscillation ... Engineering Simulation Solutions](https://reader036.fdocuments.net/reader036/viewer/2022062907/5aa28dfc7f8b9ada698d0e73/html5/thumbnails/8.jpg)
© 2008 ANSYS, Inc. All rights reser ved. 8 ANSYS, Inc. Pr oprietary
CAE Technology Application Trends:
Include All Physics
Include All Physics
• Analyses closely match reality
• Reduced assumptions that question certainty and compromise accuracy
• Lower cost due to R&D process compression
• Lower cost due to fewer analysis software tools to purchase, learn and manage
No Sim
plified B
ehavior!
Nano-sphere accuracy benchmark
Courtesy: Andreas, Hieke
![Page 9: Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast ... POV-Ray animation of periodic ship oscillation ... Engineering Simulation Solutions](https://reader036.fdocuments.net/reader036/viewer/2022062907/5aa28dfc7f8b9ada698d0e73/html5/thumbnails/9.jpg)
© 2008 ANSYS, Inc. All rights reser ved. 9 ANSYS, Inc. Pr oprietary
CAE Technology Application Trends:
More Understanding
Simulation Driven Product Development• Understand Completely• Innovate Consistently• Fail Early and Often
![Page 10: Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast ... POV-Ray animation of periodic ship oscillation ... Engineering Simulation Solutions](https://reader036.fdocuments.net/reader036/viewer/2022062907/5aa28dfc7f8b9ada698d0e73/html5/thumbnails/10.jpg)
© 2008 ANSYS, Inc. All rights reser ved. 10 ANSYS, Inc. Pr oprietary
Why Use Clusters For CAE?
• Clusters enable bigger simulations (more accuracy)
– Typical FEA models require 4-8 GB RAM• Today’s more demanding models might consume 100 GB
– Typical CFD models require 2-10 GB RAM• Today’s more demanding models might consume 50-100 GB
• Clusters deliver turnaround time
– Clusters can yield nearly linear scaling• A typical simulation might run for 8 hours on a single CPU
→Becomes 1 hour on an eight-core cluster• Clusters can scale up with demand
– More simulations (more design options)• Optimization studies might require 50-100 simulations
![Page 11: Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast ... POV-Ray animation of periodic ship oscillation ... Engineering Simulation Solutions](https://reader036.fdocuments.net/reader036/viewer/2022062907/5aa28dfc7f8b9ada698d0e73/html5/thumbnails/11.jpg)
© 2008 ANSYS, Inc. All rights reser ved. 11 ANSYS, Inc. Pr oprietary
ANSYS and HPC
Computer Aided Engineering Software
– for Simulation Driven Product Development
• Deliver superior product designs
– Explore innovations in features, function
• Improve time to market
– Faster and earlier than physical testing
• Lower product development costs
– Virtual prototyping vs. physical testing
![Page 12: Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast ... POV-Ray animation of periodic ship oscillation ... Engineering Simulation Solutions](https://reader036.fdocuments.net/reader036/viewer/2022062907/5aa28dfc7f8b9ada698d0e73/html5/thumbnails/12.jpg)
© 2008 ANSYS, Inc. All rights reser ved. 12 ANSYS, Inc. Pr oprietary
Simulation Drivers for HPC
~ 25 Million DOF Stress
Analysis of a Front Suspension
Modeled on a Desktop
Solved on a Cluster
75291
8,080,601382,492
5,438,0050
24,241,803
Number of Parts Contact PairsNodesCONTACT ElementsSOLID186/187 ElementsCEsNo. of Equations (DOFs)
![Page 13: Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast ... POV-Ray animation of periodic ship oscillation ... Engineering Simulation Solutions](https://reader036.fdocuments.net/reader036/viewer/2022062907/5aa28dfc7f8b9ada698d0e73/html5/thumbnails/13.jpg)
© 2008 ANSYS, Inc. All rights reser ved. 13 ANSYS, Inc. Pr oprietary
Simulation Drivers for HPC
• GE CRD test for parallel scalability…towards full 360°blade row simulations
– One passage mesh• approx. 1 M nodes
– Full annulus of 92 passages• 88M nodes
Number of Passages
Mesh Nodes
Definition File Size
Number of CPUs
True Wall Clock Time
1 1.0M 20Mb 1 7.22 hrs
92 88M 2407Mb 90 7.75 hrs
Courtesy GE Corporate R&D Center
![Page 14: Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast ... POV-Ray animation of periodic ship oscillation ... Engineering Simulation Solutions](https://reader036.fdocuments.net/reader036/viewer/2022062907/5aa28dfc7f8b9ada698d0e73/html5/thumbnails/14.jpg)
© 2008 ANSYS, Inc. All rights reser ved. 14 ANSYS, Inc. Pr oprietary
ANSYS Mechanical HPC
11.0 SP1 Benchmark Suite
![Page 15: Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast ... POV-Ray animation of periodic ship oscillation ... Engineering Simulation Solutions](https://reader036.fdocuments.net/reader036/viewer/2022062907/5aa28dfc7f8b9ada698d0e73/html5/thumbnails/15.jpg)
© 2008 ANSYS, Inc. All rights reser ved. 15 ANSYS, Inc. Pr oprietary
Performance Results - ANSYS
“ANSYS parallel processing has been a key enabler
for our simulation group. We are now tackling jobs
that we simply wouldn’t have before by moving
towards complete system level analysis from single component analysis. The analysis team is now
responding to the design team much faster with
accurate results from ANSYS!”
– Jason Longstaffe, Principal Engineer
![Page 16: Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast ... POV-Ray animation of periodic ship oscillation ... Engineering Simulation Solutions](https://reader036.fdocuments.net/reader036/viewer/2022062907/5aa28dfc7f8b9ada698d0e73/html5/thumbnails/16.jpg)
© 2008 ANSYS, Inc. All rights reser ved. 16 ANSYS, Inc. Pr oprietary
FLUENT 6.3 HPC on WCCS
FLUENT 6.3.26 FLUENT 6.3.26 –– FL5L1 FL5L1 (.86M), (.86M), FL5L2 (FL5L2 (3.6M3.6M))Microsoft Windows CCSMicrosoft Windows CCSHP CP3000 ProLiant BL460cHP CP3000 ProLiant BL460cXeon Dual Core 3.0GHz Voltaire IBXeon Dual Core 3.0GHz Voltaire IB
Over 26x faster on
32 cores
![Page 17: Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast ... POV-Ray animation of periodic ship oscillation ... Engineering Simulation Solutions](https://reader036.fdocuments.net/reader036/viewer/2022062907/5aa28dfc7f8b9ada698d0e73/html5/thumbnails/17.jpg)
© 2008 ANSYS, Inc. All rights reser ved. 17 ANSYS, Inc. Pr oprietary
Performance Results - FLUENT
“The ability to deploy a cluster using Windows Compute Cluster Server was very attractive to us, because it leverages our expertise and fits into our current computing environment. The deployment was quite smooth: we had our cluster up and running FLUENT within two weeks. The integration of FLUENT with the Microsoft Job Scheduler is especially valuable, giving us the ability to manage and monitor multiple simulations on the cluster”.
– Charles Ulrich, IT Manager, Alden Research Laboratory Inc.
![Page 18: Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast ... POV-Ray animation of periodic ship oscillation ... Engineering Simulation Solutions](https://reader036.fdocuments.net/reader036/viewer/2022062907/5aa28dfc7f8b9ada698d0e73/html5/thumbnails/18.jpg)
© 2008 ANSYS, Inc. All rights reser ved. 18 ANSYS, Inc. Pr oprietary
AUTODYN HPC
0
5
10
15
20
25
30
1 2 4 8 16 24
Number of Cores
Re
lati
ve
Pe
rfo
rma
nc
e AUTODYN
Ideal Scaling
Blast Containment Analysis
![Page 19: Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast ... POV-Ray animation of periodic ship oscillation ... Engineering Simulation Solutions](https://reader036.fdocuments.net/reader036/viewer/2022062907/5aa28dfc7f8b9ada698d0e73/html5/thumbnails/19.jpg)
© 2008 ANSYS, Inc. All rights reser ved. 19 ANSYS, Inc. Pr oprietary
Performance Results - AUTODYN
“By conducting these AUTODYN simulations
prior to the physical test, WTD 52 is able to
reduce the number of costly tests and to enhance the quality of the experimental
investigations. As a result, time and cost savings can be achieved in most cases.”
– Michael Klaus, Deputy Director WTD 52
![Page 20: Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast ... POV-Ray animation of periodic ship oscillation ... Engineering Simulation Solutions](https://reader036.fdocuments.net/reader036/viewer/2022062907/5aa28dfc7f8b9ada698d0e73/html5/thumbnails/20.jpg)
DEFORM and HPC
♦ Metal forming involves very complex nonlinear processes
♦ DEFORM is used to:• Predict process behaviour before it’s tried on the shop floor
• Identify root cause of defects which occur in production
• Investigate alternatives
♦ Example:• Hot forging with flash of steering link
• About 50,000 elements
• Single stroke pressing
![Page 21: Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast ... POV-Ray animation of periodic ship oscillation ... Engineering Simulation Solutions](https://reader036.fdocuments.net/reader036/viewer/2022062907/5aa28dfc7f8b9ada698d0e73/html5/thumbnails/21.jpg)
Link Time Test Results
2 proc: 7:31About $3000 (5 years ago)
Dell 1.7 GHz Dual Xeon processor
(about 6 years old)
2 proc: 3:03$6000 (2 years ago)
HP xw9400 AMD Opteron \
Dual Processor (about 3 years old)
2 proc: 2:50$700HP a6130 AMD Athlon64 X2 5000+
Dual core processor 3 GB RAM
2 proc: 1:55
4 proc: 1:11
8 proc: 0:57
$40,000-$60,000
(custom ordered)
HP XC Cluster – 4 nodes
Each node 1 Xeon dual core
Infiniband networking
2 proc: 2:33
4 proc: 2:08
8 proc: 2:22
Quad core chips are
currently not recommended
HP DL 360 Intel Xeon 2 x Quad core
(18 month old computer)
4 proc: 1:24$5500Hp xw8400 Intel 3.00GB 2x dual core Xeon. 8GB Ram
Run Time
hr:min
Approx CostComputer
Best affordable
performance
Great performance under $1000
![Page 22: Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast ... POV-Ray animation of periodic ship oscillation ... Engineering Simulation Solutions](https://reader036.fdocuments.net/reader036/viewer/2022062907/5aa28dfc7f8b9ada698d0e73/html5/thumbnails/22.jpg)
Weld Yoke forgingCG-Direct Rigid Plastic w/pNon-isothermal
- 600K tet
Cluster Performance –Large Model
8 processors
CG FEM 15h 48m Remesh 8h 50m (#56)Total Time 24h 38m
HP Linux Cluster, 4 nodes, 8 processors, 3.0GHz 5160 Xeon, 4GB memory
Weld Yoke courtesy American Axle and Manufacturing
![Page 23: Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast ... POV-Ray animation of periodic ship oscillation ... Engineering Simulation Solutions](https://reader036.fdocuments.net/reader036/viewer/2022062907/5aa28dfc7f8b9ada698d0e73/html5/thumbnails/23.jpg)
Ensight and HPC
• Extreme post-processing and visualization solutions for CFD/FEA/CAE systems
• Ensight takes full advantage of parallel processing and cluster based rendering for analyzing, visualizing and communicating high-end scientific and engineering datasets
![Page 24: Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast ... POV-Ray animation of periodic ship oscillation ... Engineering Simulation Solutions](https://reader036.fdocuments.net/reader036/viewer/2022062907/5aa28dfc7f8b9ada698d0e73/html5/thumbnails/24.jpg)
Ensight and HPC
EnSight images courtesy of
Sauber Petronas F1
“Using EnSight as a communication tool is as important as the FEA
analysis itself”
Kumar Kulkarni, Lead FEA Analysis, VISTEON
“The more realistic my analysis results look, the better my customers
understand them, and the larger my budget grows.”
Jim Johnson, CFD Technical Lead, GM
![Page 25: Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast ... POV-Ray animation of periodic ship oscillation ... Engineering Simulation Solutions](https://reader036.fdocuments.net/reader036/viewer/2022062907/5aa28dfc7f8b9ada698d0e73/html5/thumbnails/25.jpg)
Ensight DR
Render client 1
Composite
4 servers sending data to 4 clients
Render client 3 Render client 4
Render client 3
Distributed Rendering with Vis Clusters
![Page 26: Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast ... POV-Ray animation of periodic ship oscillation ... Engineering Simulation Solutions](https://reader036.fdocuments.net/reader036/viewer/2022062907/5aa28dfc7f8b9ada698d0e73/html5/thumbnails/26.jpg)
Ensight Animation
EnSight animation by Advantage CFD for
Honda F1 team
![Page 27: Engineering Simulation Solutions and HPC - Open Grid · PDF fileAUTODYN Ideal Scaling Blast ... POV-Ray animation of periodic ship oscillation ... Engineering Simulation Solutions](https://reader036.fdocuments.net/reader036/viewer/2022062907/5aa28dfc7f8b9ada698d0e73/html5/thumbnails/27.jpg)
Ensight Animation
POV-Ray animation of periodic ship oscillation
Courtesy of Dr. Kenji Takizawa, Tokyo Institute of Technology