hashcat Forum
Building 8GPU cracking station question - Printable Version

+- hashcat Forum (https://hashcat.net/forum)
+-- Forum: Misc (https://hashcat.net/forum/forum-15.html)
+--- Forum: Hardware (https://hashcat.net/forum/forum-13.html)
+--- Thread: Building 8GPU cracking station question (/thread-8430.html)

Pages: 1 2


Building 8GPU cracking station question - RealEnder - 06-18-2019

Hi all,
I need an advice on current 8GPU build. I'm based in EU so don't have many choices on HW, eg. no availability for 1080ti FE anywhere near, also those tend to be a bit dated already.

The current build list includes:
http://www.pny.eu/en/professional/explore-all-products/pny-gpu-servers/982-dual-root-complex-purley-4u-gpu-server-for-deep-learning--hpc-and-render-farm-applications
Of course, dual CPU, 256 GB RAM
8 GPU:
https://www.pny.eu/en/consumer/explore-all-products/graphics-cards/1024-geforce-rtx-2080-ti-blower-design

Does anyone have experience with those GPUs? They are not FE but Blower Design by PNY.
Also saw this from epixoip https://twitter.com/jmgosney/status/1139163927466729473
Can we expect ugly meltdown in server room? :)


RE: Building 8GPU cracking station question - undeath - 06-18-2019

The 2080ti you linked looks like a Nvidia reference design card. There is no PNY logo on it and the PCB has the Nvidia logo.


RE: Building 8GPU cracking station question - RealEnder - 06-18-2019

(06-18-2019, 03:14 PM)undeath Wrote: The 2080ti you linked looks like a Nvidia reference design card. There is no PNY logo on it and the PCB has the Nvidia logo.

Yeah, that's why I liked those. PNY logo is on the box (the third picture).


RE: Building 8GPU cracking station question - epixoip - 06-18-2019

For some reason I'm unable to resolve pny.eu but is this the card you're planning to use?

http://www3.pny.com/GeForce-RTX-2080-Ti-11GB-Blower

If so, that card will not work in that chassis. It will suffocate as it will be unable to draw in air from the rear of the card, only from the side.


RE: Building 8GPU cracking station question - cybhashcat - 06-19-2019

(06-18-2019, 02:56 PM)RealEnder Wrote: Hi all,
I need an advice on current 8GPU build. I'm based in EU so don't have many choices on HW, eg. no availability for 1080ti FE anywhere near, also those tend to be a bit dated already.

The current build list includes:
http://www.pny.eu/en/professional/explore-all-products/pny-gpu-servers/982-dual-root-complex-purley-4u-gpu-server-for-deep-learning--hpc-and-render-farm-applications
Of course, dual CPU, 256 GB RAM
8 GPU:
https://www.pny.eu/en/consumer/explore-all-products/graphics-cards/1024-geforce-rtx-2080-ti-blower-design

Does anyone have experience with those GPUs? They are not FE but Blower Design by PNY.
Also saw this from epixoip https://twitter.com/jmgosney/status/1139163927466729473
Can we expect ugly meltdown in server room? Smile

if i may ask - why do you need so much ram? and if you can get a mobo with PLX can't you stick with 1 CPU?


RE: Building 8GPU cracking station question - epixoip - 06-19-2019

(06-19-2019, 12:45 AM)cybhashcat Wrote: if i may ask - why do you need so much ram? and if you can get a mobo with PLX can't you stick with 1 CPU?

8X 2080 Ti can allocate up to 88GB of host buffers, so he would need a realistic minimum of 128GB of RAM for this system. 256GB gives him a bit more headroom. It's not at all overkill.

That's a dual root complex board. If he only installed one CPU, he'd only see 4 GPUs - despite the fact that it has 4x PLX chips.

I see on another thread that you're considering building your own 8 GPU system, but from these comments it seems like maybe you lack the experience necessary to do so.


RE: Building 8GPU cracking station question - RealEnder - 06-19-2019

(06-18-2019, 08:21 PM)epixoip Wrote: For some reason I'm unable to resolve pny.eu but is this the card you're planning to use?

http://www3.pny.com/GeForce-RTX-2080-Ti-11GB-Blower

If so, that card will not work in that chassis. It will suffocate as it will be unable to draw in air from the rear of the card, only from the side.
The card is the same. On .eu site it's under different name, but part no matches. Site access issue must be some GDPR nonsense.

Thanks for the heads up on the airflow. I can't see the back of the card on the pictures and the chassis design(alternative link by part no: https://crg.co.il/dual-root-complex-purley-4u-gpu/ ) looks very close to "reference" TYAN one (eg. https://www.tyan.com/Barebones_FT77CB7079_B7079F77CV10HR-N )

Since I can't see the HW live I have to rely on pictures and advicesSmile So what should I change:
GPUs with different airflow design (unlikely, I can't see any better alternatives), or
The chassis. Other PNY option is 10GPU (http://www.pny.eu/en/consumer/explore-all-products/pny-gpu-servers/1177-purley-4u-dual-root-10gpu-server-for-hpc-and-scientific-applications-using-nvidia-gpus , part no PNYSRA4X000000-000) which have different layout but no good pictures of it and looks a bit overkill.


RE: Building 8GPU cracking station question - cybhashcat - 06-19-2019

(06-19-2019, 05:50 AM)epixoip Wrote:
(06-19-2019, 12:45 AM)cybhashcat Wrote: if i may ask - why do you need so much ram? and if you can get a mobo with PLX can't you stick with 1 CPU?

8X 2080 Ti can allocate up to 88GB of host buffers, so he would need a realistic minimum of 128GB of RAM for this system. 256GB gives him a bit more headroom. It's not at all overkill.

That's a dual root complex board. If he only installed one CPU, he'd only see 4 GPUs - despite the fact that it has 4x PLX chips.

I see on another thread that you're considering building your own 8 GPU system, but from these comments it seems like maybe you lack the experience necessary to do so.

That's a very accurate assessment, and you are wise to notice. However, i am unsure where to acquire the experience, aside from bothering the good people of this forum.


RE: Building 8GPU cracking station question - undeath - 06-19-2019

(06-19-2019, 02:13 PM)cybhashcat Wrote: i am unsure where to acquire the experience, aside from bothering the good people of this forum.

If you or your company are not absolutely set on engineering the system yourself your could also buy a preconfigured machine from eg https://terahash.com/


RE: Building 8GPU cracking station question - epixoip - 06-19-2019

(06-19-2019, 07:55 AM)RealEnder Wrote: ince I can't see the HW live I have to rely on pictures and advicesundefined So what should I change: GPUs with different airflow design (unlikely, I can't see any better alternatives)

Yes, you need to change the GPU. EVGA currently makes the best OEM blower card: https://videocardz.net/evga-geforce-rtx-2080-ti-11gb/