Cluster High Performance Computing on Open Source · Cluster computing is a technology related to...
Transcript of Cluster High Performance Computing on Open Source · Cluster computing is a technology related to...
![Page 1: Cluster High Performance Computing on Open Source · Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small](https://reader036.fdocuments.net/reader036/viewer/2022070805/5f0383a57e708231d4096f9a/html5/thumbnails/1.jpg)
Cluster High Performance Computing on Open Source
กิตติรักษ ์ม่วงมิ่งสขุ(Kittirak Moungmingsuk)
Feb 22, 12. EGAT Admin Seminar.
![Page 2: Cluster High Performance Computing on Open Source · Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small](https://reader036.fdocuments.net/reader036/viewer/2022070805/5f0383a57e708231d4096f9a/html5/thumbnails/2.jpg)
2
ThaiGrid (Tera Cluster)800 Cores, Linux Cluster
133 Cores, Win Cluster
Sila Cluster @Ramkhamhaeng U. 286 Cores BIOTEC (Eclipse Cluster) 704 Cores Virgin Radio Thailand
7 nodes, Web Cluster
Geo-Informatics and Space Technology Development Agency (GISTDA)
10 nodes, Web Cluster
HAII (HAII Cluster I, II) 480 Cores
About Cluster Kit
![Page 3: Cluster High Performance Computing on Open Source · Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small](https://reader036.fdocuments.net/reader036/viewer/2022070805/5f0383a57e708231d4096f9a/html5/thumbnails/3.jpg)
3
Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small computing system and high speed interconnection network
What is Cluster ?
Compute Node
InterconnectionNetwork
Frontend Node
![Page 4: Cluster High Performance Computing on Open Source · Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small](https://reader036.fdocuments.net/reader036/viewer/2022070805/5f0383a57e708231d4096f9a/html5/thumbnails/4.jpg)
4
![Page 5: Cluster High Performance Computing on Open Source · Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small](https://reader036.fdocuments.net/reader036/viewer/2022070805/5f0383a57e708231d4096f9a/html5/thumbnails/5.jpg)
5
Avatar Movie
http://www.thesun.co.uk/sol/homepage/showbiz/film/2760950/Avatar-week-in-The-Sun-3D-secrets-behind-the-300m-movie.html
![Page 6: Cluster High Performance Computing on Open Source · Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small](https://reader036.fdocuments.net/reader036/viewer/2022070805/5f0383a57e708231d4096f9a/html5/thumbnails/6.jpg)
6
Challenge of Avatar Movie
One frame of certain shots, it's 24 frames per second, took 100 computer hours to render. Just one second was 2,400 hours.
Weta operates a 10,000-square-foot facility that uses HP BL2x220c blades to process the effects for AVATAR and other films. The computing core contains some 40,000 processors and 104 terabytes of RAM.
![Page 7: Cluster High Performance Computing on Open Source · Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small](https://reader036.fdocuments.net/reader036/viewer/2022070805/5f0383a57e708231d4096f9a/html5/thumbnails/7.jpg)
7
http://www.datacenterknowledge.com/archives/2009/12/22/the-data-crunching-powerhouse-behind-avatar/
![Page 8: Cluster High Performance Computing on Open Source · Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small](https://reader036.fdocuments.net/reader036/viewer/2022070805/5f0383a57e708231d4096f9a/html5/thumbnails/8.jpg)
8
Type of Execution Job
![Page 9: Cluster High Performance Computing on Open Source · Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small](https://reader036.fdocuments.net/reader036/viewer/2022070805/5f0383a57e708231d4096f9a/html5/thumbnails/9.jpg)
9
High Performance Computing
Sub task 1 Sub task 2
Sub task 3 Sub task 4
Big job
![Page 10: Cluster High Performance Computing on Open Source · Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small](https://reader036.fdocuments.net/reader036/viewer/2022070805/5f0383a57e708231d4096f9a/html5/thumbnails/10.jpg)
10
High Throughput Computing
Jobs Queue
![Page 11: Cluster High Performance Computing on Open Source · Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small](https://reader036.fdocuments.net/reader036/viewer/2022070805/5f0383a57e708231d4096f9a/html5/thumbnails/11.jpg)
11
HPC in the World.
![Page 12: Cluster High Performance Computing on Open Source · Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small](https://reader036.fdocuments.net/reader036/viewer/2022070805/5f0383a57e708231d4096f9a/html5/thumbnails/12.jpg)
12
Top 5 Site for Nov 2011
* http://www.top500.org/lists/2011/06
![Page 13: Cluster High Performance Computing on Open Source · Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small](https://reader036.fdocuments.net/reader036/viewer/2022070805/5f0383a57e708231d4096f9a/html5/thumbnails/13.jpg)
13
Top500 Application Area
![Page 14: Cluster High Performance Computing on Open Source · Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small](https://reader036.fdocuments.net/reader036/viewer/2022070805/5f0383a57e708231d4096f9a/html5/thumbnails/14.jpg)
14
Top500 Architecture Share
![Page 15: Cluster High Performance Computing on Open Source · Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small](https://reader036.fdocuments.net/reader036/viewer/2022070805/5f0383a57e708231d4096f9a/html5/thumbnails/15.jpg)
15
OS Share on Nov. 2011
![Page 16: Cluster High Performance Computing on Open Source · Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small](https://reader036.fdocuments.net/reader036/viewer/2022070805/5f0383a57e708231d4096f9a/html5/thumbnails/16.jpg)
16
Top500 Countries System Share
![Page 17: Cluster High Performance Computing on Open Source · Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small](https://reader036.fdocuments.net/reader036/viewer/2022070805/5f0383a57e708231d4096f9a/html5/thumbnails/17.jpg)
17
Selected Site in Energy Field.
Data from www.top500.org on November 2011.
Rank Site Cores RMax
66 EDF R&D 16320 168.8
70 Vestas Wind Systems 15672 162.1
304 Saudi Aramco 6144 63.4
![Page 18: Cluster High Performance Computing on Open Source · Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small](https://reader036.fdocuments.net/reader036/viewer/2022070805/5f0383a57e708231d4096f9a/html5/thumbnails/18.jpg)
18
Source: http://www.isgtw.org/feature/feature-hpc-adds-spark-edfs-computing-capacities
![Page 19: Cluster High Performance Computing on Open Source · Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small](https://reader036.fdocuments.net/reader036/viewer/2022070805/5f0383a57e708231d4096f9a/html5/thumbnails/19.jpg)
19
Case Study: Hydro and Agro Informatics Institute (HAII)
สถาบันสารสนเทศทรัพยาการนำ้าและการเกษตร (องค์การมหาชน)
รันโมเดลนำ้าและลมซอฟต์แวร์ที่ใช้ WRF, RAMS
http://www.haii.or.th/
ข้อมูลรูปภาพจากhttp://dpm.haii.or.th/wrf_image/
![Page 20: Cluster High Performance Computing on Open Source · Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small](https://reader036.fdocuments.net/reader036/viewer/2022070805/5f0383a57e708231d4096f9a/html5/thumbnails/20.jpg)
20
Hardware Configuration
HAII Cluster1,2
HP SL390 G7
32 nodes (380 Cores)
Total 480 Cores
Interconnect
Gigabit Ethernet
Infiniband 40 Gbps
OS: Rocks 5.4 x86_64
Application: WRF, RAMS
![Page 21: Cluster High Performance Computing on Open Source · Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small](https://reader036.fdocuments.net/reader036/viewer/2022070805/5f0383a57e708231d4096f9a/html5/thumbnails/21.jpg)
21
Ganglia Monitoring at HAII Cluster
![Page 22: Cluster High Performance Computing on Open Source · Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small](https://reader036.fdocuments.net/reader036/viewer/2022070805/5f0383a57e708231d4096f9a/html5/thumbnails/22.jpg)
22
“คอมพิวเตอร์มือสอง เพื่อน้องในชนบท”
![Page 23: Cluster High Performance Computing on Open Source · Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small](https://reader036.fdocuments.net/reader036/viewer/2022070805/5f0383a57e708231d4096f9a/html5/thumbnails/23.jpg)
23
เกี่ยวกับโครงการ
กิจกรรมทำาอะไร ?รับบริจาคเครื่องคอมพิวเตอร์และอะไหล่ต่าง ๆ มาประกอบเป็น
เครื่องที่สมบูรณ์ ติดตั้งระบบปฏิบัติการลีนุกซ์เพื่อการศึกษา Edubuntu แล้วนำาไปส่งมอบให้โรงเรียน พร้อมทำาให้ทุกเครื่องเชื่อมต่ออินเทอร์เน็ตได้ ด้วยการวางระบบเครือข่ายให้กับทางโรงเรียน
ทำาในรูปแบบไหน ?เป็นกิจกรรมที่รวมตัวกันทำาในกลุ่มเพื่อน ๆ คนคอมพิวเตอร์ที่
อยากไปเที่ยว อยากทำาดี
![Page 24: Cluster High Performance Computing on Open Source · Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small](https://reader036.fdocuments.net/reader036/viewer/2022070805/5f0383a57e708231d4096f9a/html5/thumbnails/24.jpg)
24
เกี่ยวกับโครงการ (ต่อ)
ทำามาแล้วกี่ครั้งจัดกิจกรรมมาแล้วทั้งหมด 4 ครั้ง รวมส่งมอบไปสี่สิบกว่า
เครื่อง ติดตั้งระบบเครือข่ายให้ 3 โรงเรียน เครื่องที่บริจาคสเปกแรงแค่ไหน
เครื่องที่ส่งไป เมื่อก่อนใช้เกณฑ์ แรม 384 ขั้นตำ่า แต่ตอนนี้กำาหนดขั้นตำ่าที่ 512 MB. ฮาร์ดดิสก์รวมกันให้ได้ 6 GB. ก็เอาละ ก็ตามคุณสมบัติขั้นตำ่าที่ลง Edubuntu ได้ครับ (เราจัดกว่าตำ่าหน้าเวบ็เขาเขียนอีก แต่ใช้ได้)
![Page 25: Cluster High Performance Computing on Open Source · Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small](https://reader036.fdocuments.net/reader036/viewer/2022070805/5f0383a57e708231d4096f9a/html5/thumbnails/25.jpg)
25
![Page 26: Cluster High Performance Computing on Open Source · Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small](https://reader036.fdocuments.net/reader036/viewer/2022070805/5f0383a57e708231d4096f9a/html5/thumbnails/26.jpg)
26
![Page 27: Cluster High Performance Computing on Open Source · Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small](https://reader036.fdocuments.net/reader036/viewer/2022070805/5f0383a57e708231d4096f9a/html5/thumbnails/27.jpg)
27
![Page 28: Cluster High Performance Computing on Open Source · Cluster computing is a technology related to the building of high performance scalable computing system from a collection of small](https://reader036.fdocuments.net/reader036/viewer/2022070805/5f0383a57e708231d4096f9a/html5/thumbnails/28.jpg)
Thank you.
Tweet to me at @kittirak
Download this presentation at http://www.clusterkit.co.th/pdf/HPC-Intro-EGAT.pdf