Lesson 12 Date: 4/16/2014

High Performance Computing (part I)

Linux for Engineering and IT applications

Master-Slave Task Farming A process with rank=0 forms tasks for slaves (rank > 0), sends it to them then receives computed results. The slaves receive the tasks, compute them and send the results to the master.

Parallel Computing HPC paradigms Amdahl's law OpenMP Parallel regions and loops Parallel sections Synchronization Constructs Message Passing Interface (MPI) General MPI Program Structure Point to Point Communication MPI Standard Data Types MPI Send/Receive example MPI Collective Communications Collective Communication Example Master-Slave Task Farming Computing Partial Sums VM for MPI cluster OpenMPI installation MPI code compilation and run in OpenMPI References Take me to the Course Website