Lesson 12 Date: 4/16/2014

High Performance Computing (part I)

Linux for Engineering and IT applications

References LLNL Introduction to Parallel Computing LLNL OpenMP tutorial LinuxPRO magazine 9/2008: Parallel Programming with OpenMP LLNL MPI Tutorial Open MPI web site

Parallel Computing HPC paradigms Amdahl's law OpenMP Parallel regions and loops Parallel sections Synchronization Constructs Message Passing Interface (MPI) General MPI Program Structure Point to Point Communication MPI Standard Data Types MPI Send/Receive example MPI Collective Communications Collective Communication Example Master-Slave Task Farming Computing Partial Sums VM for MPI cluster OpenMPI installation MPI code compilation and run in OpenMPI References Take me to the Course Website