03-14-2022, 11:40 PM
(03-14-2022, 07:39 PM)Snoopy Wrote: EDIT: was missing this part - Any of 7 cards works stable. The problem start with 8th device
-> did you used -D 2 -d 1,2,3,4,5,6,7 to use only 7 cards?
Yes, I tried to explain that any combination with 7 CUDA devices works good and the problem is not with one of my devices.
-D 2 -d 1,2,3,4,5,6,7 and -D 2 -d 4,5,6,7,8,9,10 lead to the same result (it works). But even if I add another one CUDA device it will crash in 10-15 minutes of work.
Hashcat -I output:
CUDA Info:
==========
CUDA.Version.: 11.5
Backend Device ID #1 (Alias: #11)
Name...........: NVIDIA GeForce RTX 3080 Ti
Processor(s)...: 80
Clock..........: 1800
Memory.Total...: 12287 MB
Memory.Free....: 10054 MB
Local.Memory...: 99 KB
PCI.Addr.BDFe..: 0000:01:00.0
Backend Device ID #2 (Alias: #12)
Name...........: NVIDIA GeForce RTX 3080 Ti
Processor(s)...: 80
Clock..........: 1800
Memory.Total...: 12287 MB
Memory.Free....: 10054 MB
Local.Memory...: 99 KB
PCI.Addr.BDFe..: 0000:02:00.0
Backend Device ID #3 (Alias: #13)
Name...........: NVIDIA GeForce RTX 3080 Ti
Processor(s)...: 80
Clock..........: 1800
Memory.Total...: 12287 MB
Memory.Free....: 10054 MB
Local.Memory...: 99 KB
PCI.Addr.BDFe..: 0000:03:00.0
Backend Device ID #4 (Alias: #14)
Name...........: NVIDIA GeForce RTX 3080 Ti
Processor(s)...: 80
Clock..........: 1800
Memory.Total...: 12287 MB
Memory.Free....: 10054 MB
Local.Memory...: 99 KB
PCI.Addr.BDFe..: 0000:04:00.0
Backend Device ID #5 (Alias: #15)
Name...........: NVIDIA GeForce RTX 3080 Ti
Processor(s)...: 80
Clock..........: 1800
Memory.Total...: 12287 MB
Memory.Free....: 10054 MB
Local.Memory...: 99 KB
PCI.Addr.BDFe..: 0000:08:00.0
Backend Device ID #6 (Alias: #16)
Name...........: NVIDIA GeForce RTX 3080 Ti
Processor(s)...: 80
Clock..........: 1800
Memory.Total...: 12287 MB
Memory.Free....: 10054 MB
Local.Memory...: 99 KB
PCI.Addr.BDFe..: 0000:09:00.0
Backend Device ID #7 (Alias: #17)
Name...........: NVIDIA GeForce RTX 3080 Ti
Processor(s)...: 80
Clock..........: 1800
Memory.Total...: 12287 MB
Memory.Free....: 10054 MB
Local.Memory...: 99 KB
PCI.Addr.BDFe..: 0000:0b:00.0
Backend Device ID #8 (Alias: #18)
Name...........: NVIDIA GeForce RTX 3080 Ti
Processor(s)...: 80
Clock..........: 1800
Memory.Total...: 12287 MB
Memory.Free....: 10054 MB
Local.Memory...: 99 KB
PCI.Addr.BDFe..: 0000:0c:00.0
Backend Device ID #9 (Alias: #19)
Name...........: NVIDIA GeForce RTX 3080 Ti
Processor(s)...: 80
Clock..........: 1800
Memory.Total...: 12287 MB
Memory.Free....: 10054 MB
Local.Memory...: 99 KB
PCI.Addr.BDFe..: 0000:0d:00.0
Backend Device ID #10 (Alias: #20)
Name...........: NVIDIA GeForce RTX 3080 Ti
Processor(s)...: 80
Clock..........: 1800
Memory.Total...: 12287 MB
Memory.Free....: 10054 MB
Local.Memory...: 99 KB
PCI.Addr.BDFe..: 0000:0e:00.0
OpenCL Info:
============
OpenCL Platform ID #1
Vendor..: NVIDIA Corporation
Name....: NVIDIA CUDA
Version.: OpenCL 3.0 CUDA 11.5.56
Backend Device ID #11 (Alias: #1)
Type...........: GPU
Vendor.ID......: 32
Vendor.........: NVIDIA Corporation
Name...........: NVIDIA GeForce RTX 3080 Ti
Version........: OpenCL 3.0 CUDA
Processor(s)...: 80
Clock..........: 1800
Memory.Total...: 12287 MB (limited to 3071 MB allocatable in one block)
Memory.Free....: 10624 MB
Local.Memory...: 48 KB
OpenCL.Version.: OpenCL C 1.2
Driver.Version.: 496.13
PCI.Addr.BDF...: 01:00.0
Backend Device ID #12 (Alias: #2)
Type...........: GPU
Vendor.ID......: 32
Vendor.........: NVIDIA Corporation
Name...........: NVIDIA GeForce RTX 3080 Ti
Version........: OpenCL 3.0 CUDA
Processor(s)...: 80
Clock..........: 1800
Memory.Total...: 12287 MB (limited to 3071 MB allocatable in one block)
Memory.Free....: 10624 MB
Local.Memory...: 48 KB
OpenCL.Version.: OpenCL C 1.2
Driver.Version.: 496.13
PCI.Addr.BDF...: 02:00.0
Backend Device ID #13 (Alias: #3)
Type...........: GPU
Vendor.ID......: 32
Vendor.........: NVIDIA Corporation
Name...........: NVIDIA GeForce RTX 3080 Ti
Version........: OpenCL 3.0 CUDA
Processor(s)...: 80
Clock..........: 1800
Memory.Total...: 12287 MB (limited to 3071 MB allocatable in one block)
Memory.Free....: 10624 MB
Local.Memory...: 48 KB
OpenCL.Version.: OpenCL C 1.2
Driver.Version.: 496.13
PCI.Addr.BDF...: 03:00.0
Backend Device ID #14 (Alias: #4)
Type...........: GPU
Vendor.ID......: 32
Vendor.........: NVIDIA Corporation
Name...........: NVIDIA GeForce RTX 3080 Ti
Version........: OpenCL 3.0 CUDA
Processor(s)...: 80
Clock..........: 1800
Memory.Total...: 12287 MB (limited to 3071 MB allocatable in one block)
Memory.Free....: 10624 MB
Local.Memory...: 48 KB
OpenCL.Version.: OpenCL C 1.2
Driver.Version.: 496.13
PCI.Addr.BDF...: 04:00.0
Backend Device ID #15 (Alias: #5)
Type...........: GPU
Vendor.ID......: 32
Vendor.........: NVIDIA Corporation
Name...........: NVIDIA GeForce RTX 3080 Ti
Version........: OpenCL 3.0 CUDA
Processor(s)...: 80
Clock..........: 1800
Memory.Total...: 12287 MB (limited to 3071 MB allocatable in one block)
Memory.Free....: 10624 MB
Local.Memory...: 48 KB
OpenCL.Version.: OpenCL C 1.2
Driver.Version.: 496.13
PCI.Addr.BDF...: 08:00.0
Backend Device ID #16 (Alias: #6)
Type...........: GPU
Vendor.ID......: 32
Vendor.........: NVIDIA Corporation
Name...........: NVIDIA GeForce RTX 3080 Ti
Version........: OpenCL 3.0 CUDA
Processor(s)...: 80
Clock..........: 1800
Memory.Total...: 12287 MB (limited to 3071 MB allocatable in one block)
Memory.Free....: 10624 MB
Local.Memory...: 48 KB
OpenCL.Version.: OpenCL C 1.2
Driver.Version.: 496.13
PCI.Addr.BDF...: 09:00.0
Backend Device ID #17 (Alias: #7)
Type...........: GPU
Vendor.ID......: 32
Vendor.........: NVIDIA Corporation
Name...........: NVIDIA GeForce RTX 3080 Ti
Version........: OpenCL 3.0 CUDA
Processor(s)...: 80
Clock..........: 1800
Memory.Total...: 12287 MB (limited to 3071 MB allocatable in one block)
Memory.Free....: 10624 MB
Local.Memory...: 48 KB
OpenCL.Version.: OpenCL C 1.2
Driver.Version.: 496.13
PCI.Addr.BDF...: 0b:00.0
Backend Device ID #18 (Alias: #8)
Type...........: GPU
Vendor.ID......: 32
Vendor.........: NVIDIA Corporation
Name...........: NVIDIA GeForce RTX 3080 Ti
Version........: OpenCL 3.0 CUDA
Processor(s)...: 80
Clock..........: 1800
Memory.Total...: 12287 MB (limited to 3071 MB allocatable in one block)
Memory.Free....: 10624 MB
Local.Memory...: 48 KB
OpenCL.Version.: OpenCL C 1.2
Driver.Version.: 496.13
PCI.Addr.BDF...: 0c:00.0
Backend Device ID #19 (Alias: #9)
Type...........: GPU
Vendor.ID......: 32
Vendor.........: NVIDIA Corporation
Name...........: NVIDIA GeForce RTX 3080 Ti
Version........: OpenCL 3.0 CUDA
Processor(s)...: 80
Clock..........: 1800
Memory.Total...: 12287 MB (limited to 3071 MB allocatable in one block)
Memory.Free....: 10624 MB
Local.Memory...: 48 KB
OpenCL.Version.: OpenCL C 1.2
Driver.Version.: 496.13
PCI.Addr.BDF...: 0d:00.0
Backend Device ID #20 (Alias: #10)
Type...........: GPU
Vendor.ID......: 32
Vendor.........: NVIDIA Corporation
Name...........: NVIDIA GeForce RTX 3080 Ti
Version........: OpenCL 3.0 CUDA
Processor(s)...: 80
Clock..........: 1800
Memory.Total...: 12287 MB (limited to 3071 MB allocatable in one block)
Memory.Free....: 10624 MB
Local.Memory...: 48 KB
OpenCL.Version.: OpenCL C 1.2
Driver.Version.: 496.13
PCI.Addr.BDF...: 0e:00.0
OpenCL Platform ID #2
Vendor..: Intel(R) Corporation
Name....: Intel(R) OpenCL
Version.: OpenCL 2.1
Backend Device ID #21
Type...........: GPU
Vendor.ID......: 8
Vendor.........: Intel(R) Corporation
Name...........: Intel(R) HD Graphics 630
Version........: OpenCL 2.1
Processor(s)...: 24
Clock..........: 1150
Memory.Total...: 26082 MB (limited to 1023 MB allocatable in one block)
Memory.Free....: 12992 MB
Local.Memory...: 64 KB
OpenCL.Version.: OpenCL C 2.0
Driver.Version.: 21.20.16.4534
Backend Device ID #22
Type...........: CPU
Vendor.ID......: 8
Vendor.........: Intel(R) Corporation
Name...........: Intel(R) Core(TM) i7-7700K CPU @ 4.20GHz
Version........: OpenCL 2.1 (Build 359)
Processor(s)...: 8
Clock..........: 4200
Memory.Total...: 65227 MB (limited to 8153 MB allocatable in one block)
Memory.Free....: 32581 MB
Local.Memory...: 32 KB
OpenCL.Version.: OpenCL C 2.0
Driver.Version.: 6.6.0.359