(12-03-2012, 11:35 PM)tatgdi Wrote: What brand/model of Infinibad HBA adapter is used within each system?(X4 SDR interconnect)
What brand/model of Infinibad switch did you acquire?
What type of cabling is used from each adapter to the switch?(Fibre or cx-4 attached copper)
What version of Linux/Ubuntu did you test with?(12.04 or 12.04.1x64) Was ther native supprot for adapter drivers?
Was there any draw-baks interms of speeds based on the infiband x4 SDR technology that you used vs. x4ddr/x4qdr?
I'm using old Mellanox MHEA28-XT HCAs and a Cisco SFS7000P / Topspin 120 switch. But it doesn't really matter what you get, the open drivers will support any Infiniband hardware from what I understand. This specific setup uses all copper/CX4 cabling.
All nodes are running amd64 Ubuntu 12.04 LTS. Everything works out of the box after loading the right modules and bringing up ib0.
4x SDR is plenty of bandwidth for what I have. I'm actually not breaking 1 Gbps at the moment. But Infiniband mitigates latency.