Parallel Computing

About the Course Ondřej Jakl

Institute of Geonics, Academy of Sci. of the CR

TUL 28. 5. 2010

• Today the first part of a two-part course on Parallel Computing• “Parallel newcomers” as the supposed audience• Prerequisites: basic skills in (sequential) programming (C lang.)• Fact: No chance to learn parallel programming in one day• Goals: To provide some orientation in the field, to show directions

for self-study• Material motivated from numerous textbooks and information

sources– [Foster 1995] the most important one

• Based on a parallel programming course given at VSB-TUO, but major update

• Not certain if able to keep the schedule• Second part (September?) – more advanced topics

(suggestions?), some practical training?

About the course

• Lecture 1: Motivation & Contexts• Lecture 2: The Hardware Story• Lecture 3: Models of Parallel Computations • Lecture 4: Message Passing Interface I • Lecture 5: Parallel Application Design • Lecture 6: Performance Analysis

Outline of the course part 1

[Foster 1995] Ian Foster:Designing and Building Parallel Programs. Addison-Wesley, 1995http://www-unix.mcs.anl.gov/dbpp

Literature (1)

[Quinn 2004] Michael J. Quinn: Parallel Programming in C with MPI and OpenMP. McGraw-Hill, 2004

[Lin 2009] Calvin Lin, Larry Snyder: Principles of Parallel Programming.

Addison-Wesley, 2009

[Wilkinson 1999] Barry Wilkinson, Michael Allen:Parallel Programming: Techniques and Applications Using Networked Workstations... Prentice-Hall 1999

Literature (2)

[Grama 2003] Ananth Grama et al.: Introduction to Parallel Computing, 2 edition. Addison Wesley, 2003

[Andrews 2000] Gregory R. Andrews : Foundations of Multithreaded, Parallel, and Distributed Programming.

Addison Wesley, 2000

[Hughes 2004] Cameron Hughes, Tracey Hughes:Parallel And Distributed Programming Using C++. Addison Wesley, 2004

Literature (3)

[Dowd 1998] Kevin Dowd, Charles Severance: High Performance Computing, Second Edition. O'Reilly Media, 1998

[Gropp 1999] William Gropp, Ewing Lusk, Anthony Skjellum: Using MPI, 2nd Edition.

The MIT Press, 1999

[Jaja 1992] Joseph Jaja:Introduction to Parallel Algorithms. Addison Wesley, 1992

Literature (4)

[Ježek 1999] Karel Ježek et al.: Paralelní architektury a programy. ZČU, 1999

[Tvrdík 2000] Pavel Tvrdík: Paralelní systémy a algoritmy.ČVUT, 2000

• High Performance Computing NGSSC Summer school at PDC materials, August 1998, KTH, Stockholm

• TRACS HPC course materials, EPCC, Edinburgh, 2000 • LLNL High Performance Computing Training materials

https://computing.llnl.gov/?set=training&page=index#training_materials

• Cyberinfrastructure Tutor materialshttp://ci-tutor.ncsa.illinois.edu/login.php

• Wikipedia• ...

Acknowledgements