Collective Routines
•In addition to the point to point routines discussed so far, MPI has many routines for collective communications.
•These are typically of the type one – to –many , many – to – one and many – to – many .
•All the collective routines are blocking .
•Most frequently used routines are BCAST, REDUCE, SCATTER, ALLTOALL .