hashcat Forum
Building a multi GPU rackmount server - Printable Version

+- hashcat Forum (https://hashcat.net/forum)
+-- Forum: Misc (https://hashcat.net/forum/forum-15.html)
+--- Forum: Hardware (https://hashcat.net/forum/forum-13.html)
+--- Thread: Building a multi GPU rackmount server (/thread-11027.html)



Building a multi GPU rackmount server - lpha3ch0 - 09-26-2022

I want to build a multi GPU (3 to 4 GPU) rackmount server to support cracking NTLM (-m 1000) hashes for my team of pentesters. My budget is 20k max. Any suggestions on hardware selection? I've been looking at Gigabyte servers and I think I need a 4U profile to mount the cards vertically. 

Going down this rabbit hole and googling this is starting to create more questions than answers. For example, I'm reading about FE cards with radial fans and heat, and it looks like the RTX 3080 Ti cards I had in my shopping cart will have one of two fans blowing hot air back into the case.

Heat dissipation and power supply are a big concern so I can avoid burning down the data center or shortening the life of the system due to heat.

Thanks in advance.


RE: Building a multi GPU rackmount server - marc1n - 09-27-2022

https://www.pentestpartners.com/security-blog/how-to-build-a-password-cracking-rig-during-a-worldwide-chip-shortage/


RE: Building a multi GPU rackmount server - slyexe - 09-28-2022

As mentioned in the article, blower style fans were not deployed on 3000 series cards and they are all equipped with oversized heatsinks with cooling fans. The best solution is to use an open air chassis much how mining rigs are setup to allow all hot air to be pushed away from the cards. Otherwise, I think the issue is that blower style fans cannot keep up adequately for how much wattage the higher end cards are consuming, I could be incorrect but having a single fan moving airflow across such a large heatsink wouldn't have enough CFM to keep up is just my opinion.


RE: Building a multi GPU rackmount server - dfns - 10-02-2022

(09-26-2022, 10:09 PM)lpha3ch0 Wrote: I want to build a multi GPU (3 to 4 GPU) rackmount server to support cracking NTLM (-m 1000) hashes for my team of pentesters. My budget is 20k max. Any suggestions on hardware selection? I've been looking at Gigabyte servers and I think I need a 4U profile to mount the cards vertically. 

Going down this rabbit hole and googling this is starting to create more questions than answers. For example, I'm reading about FE cards with radial fans and heat, and it looks like the RTX 3080 Ti cards I had in my shopping cart will have one of two fans blowing hot air back into the case.

Heat dissipation and power supply are a big concern so I can avoid burning down the data center or shortening the life of the system due to heat.

Thanks in advance.
The only RTX30xx blower style cards are from Gigabyte (3080 Turbo and 3090 Turbo) and Asus (3070 Turbo, 3080 Turbo, 3080TI Turbo, 3090 Turbo). The sweetspot are 3080 cards, they deliver about 100GH/s and costs about 800€, the 3080Ti (1200€) makes 117GH/s and 3090 (2000€) makes 125GH/s. For 4x3080 (4*320=1280W) you need at least a 1400W power supply. With 3x3080 Turbo in big tower (Meshify 2 XL) the cards runs stable over weeks with about 88-89°C, that wouldn't be possible in closed case with axial fans.


RE: Building a multi GPU rackmount server - cybhashcat - 11-05-2022

(10-02-2022, 12:37 PM)dfns Wrote:
(09-26-2022, 10:09 PM)lpha3ch0 Wrote: I want to build a multi GPU (3 to 4 GPU) rackmount server to support cracking NTLM (-m 1000) hashes for my team of pentesters. My budget is 20k max. Any suggestions on hardware selection? I've been looking at Gigabyte servers and I think I need a 4U profile to mount the cards vertically. 

Going down this rabbit hole and googling this is starting to create more questions than answers. For example, I'm reading about FE cards with radial fans and heat, and it looks like the RTX 3080 Ti cards I had in my shopping cart will have one of two fans blowing hot air back into the case.

Heat dissipation and power supply are a big concern so I can avoid burning down the data center or shortening the life of the system due to heat.

Thanks in advance.
The only RTX30xx blower style cards are from Gigabyte (3080 Turbo and 3090 Turbo) and Asus (3070 Turbo, 3080 Turbo, 3080TI Turbo, 3090 Turbo). The sweetspot are 3080 cards, they deliver about 100GH/s and costs about 800€, the 3080Ti (1200€) makes 117GH/s and 3090 (2000€) makes 125GH/s. For 4x3080 (4*320=1280W) you need at least a 1400W power supply. With 3x3080 Turbo in big tower (Meshify 2 XL) the cards runs stable over weeks with about 88-89°C, that wouldn't be possible in closed case with axial fans.

we actually own 8 INNO3D RTX3090 N30901-246X-16261960 BLOWER GPUs
I couldn't find them anywhere else online (still can't) but once they were provided I saw them in person, so somehow there are some blowers out there.