CLUSTER COMMUNICATIONS

Today high percentage HPC cluster communication is comprised physically of 1 Gb, 10 Gb and Infiniband interconnects. Each interconnect has its own merits.
1 Gb or Gigabit is the least expensive used for workloads not sensitive to interconnect latency or high bandwidth requirements. 10 Gb or 10GE is more expensive than 1 Gb, but it provides significantly more bandwidth and is mostly used in uplink aggregation and file transfer. Infiniband or IB is an extremely low latent, high bandwidth interconnect that can scale to 1000s of nodes. Most applications that rely on Messaging Passing Interface (MPI) communication use Infiniband.
