Posts: 20
	Threads: 7
	Joined: Dec 2012
	
	
 
	
	
		Does anybody know how those GFX cards were interjoined, in that massive rig that was recently displayed?(
http://securityledger.com/wp-content/upl...ng_HPC.jpg)
I'm not a hardware guy, but don't they all need to be plugged into a motherboard? Is he using a mobo that has 8 pcie slots?
Thanks.
	
 
	
	
	
	
 
 
	
	
	
		
	Posts: 2,935
	Threads: 12
	Joined: May 2012
	
	
 
	
	
		I'm probably not very qualified to answer questions on this, but the large rig is a TYAN FT77B7015 barebones, and the other systems in the cluster are Chenbro RM41300-FS81 + Gigabyte GA-990FXA-UD7. The servers are linked via InfiniBand, and clustered via Virtual OpenCL.
What makes you think they aren't plugged into a motherboard?
	
	
	
	
	
 
 
	
	
	
		
	Posts: 20
	Threads: 7
	Joined: Dec 2012
	
	
 
	
	
		 (12-11-2012, 08:41 PM)epixoip Wrote:  I'm probably not very qualified to answer questions on this, but the large rig is a TYAN FT77B7015 barebones, and the other systems in the cluster are Chenbro RM41300-FS81 + Gigabyte GA-990FXA-UD7. The servers are linked via InfiniBand, and clustered via Virtual OpenCL.
What makes you think they aren't plugged into a motherboard?
Okay then.
What does "InfiniBand" do? How does it 'link' them?  A method to communicate to each other, I guess?(Instead of interwebs)
Reading 
http://hashcat.net/wiki/doku.php?id=vcl_cluster_howto ,  did the guy just use any old plain computer for the "master node"?, then the TYAZN and Chenbro's as the slaves?
"What makes you think they aren't plugged into a motherboard?"
Don't know, just didn't think it did. But that motherboard shows enough slots, so I guess it's that!
Thanks
	
 
	
	
	
	
 
 
	
	
	
		
	Posts: 2,935
	Threads: 12
	Joined: May 2012
	
	
 
	
	
		You can read about InfiniBand on Wikipedia: 
http://en.wikipedia.org/wiki/Infiniband
From what I hear, there is no master node; the guy runs the broker on a compute node. You can see more in the slidedeck from his presentation: 
http://passwords12.at.ifi.uio.no/Jeremi_...ords12.pdf
The TYAN chassis has enough slots, yes. It, and the Chenbro case as well, are designed for GPGPU.
	
 
	
	
	
	
 
 
	
	
	
		
	Posts: 344
	Threads: 2
	Joined: Aug 2011
	
	
 
	
	
		You can ask Jeremi more about these nodes 
	 
	
	
	
	
 
 
	
	
	
		
	Posts: 2,301
	Threads: 11
	Joined: Jul 2010
	
	
 
	
	
		 (12-11-2012, 09:47 PM)KT819GM Wrote:  You can ask Jeremi more about these nodes 
hell, that guy is hard to catch