11 x GTX 970 System
#1
Wink 
hi all! like to know what you guys think about the following configuration.


MB-X9DRXFB https://superbiiz.com/detail.php?name=MB-X9DRXFB
2x Xeon E5-2620V3, 2.4 GHz Six-core
11 x GeForce GTX 970 
[Image: 9855169_sd.jpg;canvasHeight=452;canvasWidth=1000]
32gb RAM kingston
2x 1500 watt power supplies and daisy chain them safely with a little module 
[Image: adaptor.png]
11x PCI-Express PCI-E 16X Risers
120g ssd kingston hyperx
ubuntu 14.04 LTS
frame would be some ALUMINUM similar to this one: 
[Image: s-l400.jpg]


let me know what you guys think
#2
Historically, there has been a 8 card limit due to non 64bit BIOS support, so that may be an issue. I would contact SuperMicro and confirm you will not run into that issue. Otherwise, should be fine with everything else.
#3
(06-11-2016, 11:09 PM)radix Wrote: Historically, there has been a 8 card limit due to non 64bit BIOS support, so that may be an issue.  I would contact SuperMicro and confirm you will not run into that issue.  Otherwise, should be fine with everything else.

that is a grate idle i will email them before purchase the MB 
THANKS

if there is a 8 card limitation i will go with  GTX 980 Ti for sure

any specific type of cooling you can recommend for the cpus?
#4
also note that with 8 gpus you will have 8x 100% cpu load because of shitty nvidia opencl runtime. make sure you have enough cpu power
#5
(06-11-2016, 10:57 PM)john38 Wrote: hi all! like to know what you guys think about the following configuration.



let me know what you guys think

are u not afraid of it to get really hot for the cards?

it does not look like the cards will have lots of space between them.
#6
(06-11-2016, 11:42 PM)atom Wrote: also note that with 8 gpus you will have 8x 100% cpu load because of shitty nvidia opencl runtime. make sure you have enough cpu power
whats considering enough ?  i checked the brutalist it has  2x Intel Xeon E5-2600V3 series processors also 
thats why i tough this should be enough 
#7
(06-12-2016, 01:06 AM)kiara Wrote:
(06-11-2016, 10:57 PM)john38 Wrote: hi all! like to know what you guys think about the following configuration.



let me know what you guys think

are u not afraid of it to get really hot for the cards?

it does not look like the cards will have lots of space between them.

i will make the case to have 1.5 inches between
i think that should be good 
isn't it ?
#8
(06-12-2016, 01:12 AM)john38 Wrote: i will make the case to have 1.5 inches between
i think that should be good 
isn't it ?

i think thats enough.

why would u use linux instead of windows?
in windows u could also use Hash manager which works only on windows.. and support over 400 algorithim, i think u will have less problem with drivers on a windows machine to..

about the cpu, that should be ok i think, each cpu support up to 40 pci lanes
Quote:Max # of PCI Express Lanes

40


meaning the cards wont use x8 or x16. it will use only x4 (if i am not wrong)
with 2 of ur cpu u will have up to 80.


11x16=176
11x8=88
11x4=44

most of the xeon family support up to 40 pci lanes
please some one correct me if i am wrong.
#9
(06-12-2016, 03:34 PM)kiara Wrote:
(06-12-2016, 01:12 AM)john38 Wrote: i will make the case to have 1.5 inches between
i think that should be good 
isn't it ?

i think thats enough.

why would u use linux instead of windows?
in windows u could also use Hash manager which works only on windows.. and support over 400 algorithim, i think u will have less problem with drivers on a windows machine to..

about the cpu, that should be ok i think, each cpu support up to 40 pci lanes
Quote:Max # of PCI Express Lanes

40


meaning the cards wont use x8 or x16. it will use only x4 (if i am not wrong)
with 2 of ur cpu u will have up to 80.


11x16=176
11x8=88
11x4=44

most of the xeon family support up to 40 pci lanes
please some one correct me if i am wrong.

I actually think Nvidia cards can't run with only 4 lanes, not sure if that's just in SLI or what but I recall seeing something about that. Might be helpful to double check especially if you have other stuff running through PCI.
#10
I checked my system (1cpu xeon, 2 x gtx1080),
I took the card1 x16 slot and second card is x8 slot then check the benhmark same speed ~417kh ~414kh.
I took the card1 x16 slot and second card is x16 slot then check the benhmark same speed ~417kh ~414kh.