Collective Routines
In addition to the point to point routines
discussed so far, MPI has many routines
for collective communications.
These are typically of the type one – to –
many , many – to – one and many – to –
many .
All the collective routines are blocking .
Most frequently used routines are BCAST,
REDUCE, SCATTER, ALLTOALL .