catching up: IB in the ZFS Storage Appliance
By user12611518 on Mar 21, 2011
It's well known that the ZFS Storage Appliance uses Solaris under the covers. I am not the expert in this area, but I do know that Solaris InfiniBand content has been steadily increasing with each new release. Folks like Cindi are the real experts in this area. For full details, go to the FishWorks Software Updates wiki.
InfiniBand support first came in the 2009.Q3 release with support for IPoIB, which of course allows any supported IP based protocol (e.g. NFS or iSCSI) to be run over IB links. This release also had support for NFS over RDMA, which uses IB's RDMA capabilities with NFS.
In the 2010.Q1 release, iSER (iSCSI version with RDMA) and SRP (SCSI RDMA Protocol) were added. Also in 2010, the 2010.Q3 version added Connected Mode for IPoIB to boost performance and a new IPoIB administrative model, which parallels the dladm improvements in the "Nevada" development train.
Of course that isn't the end of the story, so stay tuned to see what happens in future releases.
As always, this blog should only be regarded as my personal opinion. If some official statement contradicts me, I am probably wrong.