10-24-2020, 12:11 PM
(This post was last modified: 10-24-2020, 01:03 PM by Longtail.
Edit Reason: font size
)
I do not think that you are doing right...
The Barebone GPGPU Server you chose will not work with the CPUs that you chose. Supermicro SYS-4028GR-TRT2 has LGA 2011 sockets which are compatible with Xeon E5-2600v4 series of processors.
Either change your CPUs to Xeon E5-2600v4 Series OR change your barebone to Supermicro SYS-4029GP-TRT2 which has LGA 3647 sockets and which will work with Xeon Scalable Series.
By the way, I am very surprised that your vendor didn't warn you about this incompatibility.
I would go for Supermicro SYS-4029GP-TRT2 because it is a newer model, and stick to the Xeon Scalable Series processors. (I mentioned Supermicro models only, thinking that it is the brand of your choice. Otherwise, I would suggest that you check models from TYAN or other manufacturers, as well.)
Secondly, your RAM choice is incorrect. Xeon E5-2600v4 series support 4 channels of RAM, and Xeon Scalable Series support 6 channels of RAM. In order to get maximum RAM speed, you should be using 4 or 6 pieces of RAM modules per CPU, respectively. You are only getting two pieces, 1 per CPU! So if you go for Xeon E5-2600v4 you need at least 8 pieces of RAM and if you go for the Xeon Scalable Series you need at least 12 pieces of RAM. 64 GB of RAM is not enough, either. Get at least 128GB for Xeon E5-2600v4 Series (that is 8X 16GB) or get at least 192GB for Xeon Scalable Series (12X 16GB).
E5-2600v4 Series support 2400MHz ECC RDIMM memory and Xeon Scalable Series support 2666MHz ECC RDIMM memory. However the Silver models of Scalable Series, the CPU of your choice, support max 2400MHz. (You can buy 2933MHz RAMs, but they will work at a lower frequency. Nowadays, price wise they are same as 2666MHz RAMs, and 2400MHz RAMs are slightly cheaper.) Just make sure that the RAMs that you will order will be compatible with the barebone you will choose.
Thirdly, your SSD... If you go for the SYS-4029GP-TRT2, it supports NVME SSDs which will definitely be a better choice because they are much faster than SATA SSDs. If you choose SYS-4028GR-TRT2, it won't support NVME so you can stick to the SATA SSDs.
Your GPU choice is also wrong in my opinion. Both of these barebones support 10 GPUs. Currently, the 2 Slot wide Turbo models are not in the market yet, so you can use up to 5 GPUs with either of the barebones with a 4 slot spacing. In the future, when the turbo models are released, you can sell the initial GPUs that you bought, and upgrade to 10 GPUs.
I see that you are ordering 4X 3090s. I would instead get 5X 3080s. 4X 3090s and 5X 3080s will give you similar hashrates, but you will pay much much less for the 3080s... (Approximately USD3750 for 5X 3080s vs approximately USD7000 for 4X 3090s) I believe 8 of the PCIE power cables already come with the barebones, you should check that with your vendor, or even better from Supermicro web site. I think you should order 2 more to make it 10. In all cases, make sure you have enough PCIE power cables for 10 GPUs for your future upgrades.
Also, do not forget to limit your GPU Watts to 300 Watts max, because all of the current GPGPU Servers allow max 300 watts per GPU, and both the RTX 3080 and RTX 3090 draw more than 300 Watts. This 300 Watts limitation will not change your hashrates, because the RTX cards have Tensor Cores and RT Cores which are not being used by Hashcat. 300 Watts will be enough for the cores that will be used. How to change the max power draw of Nvidia GPUs was already covered in Hashcat forums.
SLI is useless with Hashcat and is not required.
I would suggest that you use Ubuntu 20.04 OS.
Having said all of these, if I were you, I would reconsider switching back to Terahash (or any other vendor with a better understanding of password cracking systems, or GPGPU systems), as well. Obviously you lack the basic hardware knowledge. In the long run, you can of course, study and learn all of these, but if you are not willing to do that, it may be a better choice for you to be able to get professional support on these matters. Do not forget that these companies will add a premium (uplift) to the prices, which is understandable and acceptable. If you are only buying a single system, I suggest you just to pay the premium. If you are intending to buy multiple systems (a cluster), then calculate the total premium that you will be paying over the market prices, and compare that amount with the fees of professional IT Systems consultancy that you might get, and choose whichever is more beneficial for you.
Before you order anything, if you post the quoted prices here, people can warn you if you are paying more than you should. Prices may change from region to region so it would be best to mention which country you are from.
Lastly, keep in mind that that these systems are very very noisy. You cannot use them in your regular workspace. You will need a separate room for these systems, ideally a data center environment, or just a separate room with adequate cooling, and an adequate power infrastructure.
Please do not hesitate to ask if you have further questions...
The Barebone GPGPU Server you chose will not work with the CPUs that you chose. Supermicro SYS-4028GR-TRT2 has LGA 2011 sockets which are compatible with Xeon E5-2600v4 series of processors.
Either change your CPUs to Xeon E5-2600v4 Series OR change your barebone to Supermicro SYS-4029GP-TRT2 which has LGA 3647 sockets and which will work with Xeon Scalable Series.
By the way, I am very surprised that your vendor didn't warn you about this incompatibility.
I would go for Supermicro SYS-4029GP-TRT2 because it is a newer model, and stick to the Xeon Scalable Series processors. (I mentioned Supermicro models only, thinking that it is the brand of your choice. Otherwise, I would suggest that you check models from TYAN or other manufacturers, as well.)
Secondly, your RAM choice is incorrect. Xeon E5-2600v4 series support 4 channels of RAM, and Xeon Scalable Series support 6 channels of RAM. In order to get maximum RAM speed, you should be using 4 or 6 pieces of RAM modules per CPU, respectively. You are only getting two pieces, 1 per CPU! So if you go for Xeon E5-2600v4 you need at least 8 pieces of RAM and if you go for the Xeon Scalable Series you need at least 12 pieces of RAM. 64 GB of RAM is not enough, either. Get at least 128GB for Xeon E5-2600v4 Series (that is 8X 16GB) or get at least 192GB for Xeon Scalable Series (12X 16GB).
E5-2600v4 Series support 2400MHz ECC RDIMM memory and Xeon Scalable Series support 2666MHz ECC RDIMM memory. However the Silver models of Scalable Series, the CPU of your choice, support max 2400MHz. (You can buy 2933MHz RAMs, but they will work at a lower frequency. Nowadays, price wise they are same as 2666MHz RAMs, and 2400MHz RAMs are slightly cheaper.) Just make sure that the RAMs that you will order will be compatible with the barebone you will choose.
Thirdly, your SSD... If you go for the SYS-4029GP-TRT2, it supports NVME SSDs which will definitely be a better choice because they are much faster than SATA SSDs. If you choose SYS-4028GR-TRT2, it won't support NVME so you can stick to the SATA SSDs.
Your GPU choice is also wrong in my opinion. Both of these barebones support 10 GPUs. Currently, the 2 Slot wide Turbo models are not in the market yet, so you can use up to 5 GPUs with either of the barebones with a 4 slot spacing. In the future, when the turbo models are released, you can sell the initial GPUs that you bought, and upgrade to 10 GPUs.
I see that you are ordering 4X 3090s. I would instead get 5X 3080s. 4X 3090s and 5X 3080s will give you similar hashrates, but you will pay much much less for the 3080s... (Approximately USD3750 for 5X 3080s vs approximately USD7000 for 4X 3090s) I believe 8 of the PCIE power cables already come with the barebones, you should check that with your vendor, or even better from Supermicro web site. I think you should order 2 more to make it 10. In all cases, make sure you have enough PCIE power cables for 10 GPUs for your future upgrades.
Also, do not forget to limit your GPU Watts to 300 Watts max, because all of the current GPGPU Servers allow max 300 watts per GPU, and both the RTX 3080 and RTX 3090 draw more than 300 Watts. This 300 Watts limitation will not change your hashrates, because the RTX cards have Tensor Cores and RT Cores which are not being used by Hashcat. 300 Watts will be enough for the cores that will be used. How to change the max power draw of Nvidia GPUs was already covered in Hashcat forums.
SLI is useless with Hashcat and is not required.
I would suggest that you use Ubuntu 20.04 OS.
Having said all of these, if I were you, I would reconsider switching back to Terahash (or any other vendor with a better understanding of password cracking systems, or GPGPU systems), as well. Obviously you lack the basic hardware knowledge. In the long run, you can of course, study and learn all of these, but if you are not willing to do that, it may be a better choice for you to be able to get professional support on these matters. Do not forget that these companies will add a premium (uplift) to the prices, which is understandable and acceptable. If you are only buying a single system, I suggest you just to pay the premium. If you are intending to buy multiple systems (a cluster), then calculate the total premium that you will be paying over the market prices, and compare that amount with the fees of professional IT Systems consultancy that you might get, and choose whichever is more beneficial for you.
Before you order anything, if you post the quoted prices here, people can warn you if you are paying more than you should. Prices may change from region to region so it would be best to mention which country you are from.
Lastly, keep in mind that that these systems are very very noisy. You cannot use them in your regular workspace. You will need a separate room for these systems, ideally a data center environment, or just a separate room with adequate cooling, and an adequate power infrastructure.
Please do not hesitate to ask if you have further questions...