•In addition to the point to point routines discussed so far,
MPI has many routines for collective
communications.
•These are typically of the type one – to –many , many – to – one and many – to
– many .
•All the collective
routines are blocking .
•Most frequently used routines are BCAST, REDUCE, SCATTER, ALLTOALL .