hashcat Forum › Misc › Hardware v
AWS P3.16xlarge benchmarks

Threaded Mode
AWS P3.16xlarge benchmarks
K4fffYndWBe8F033 Offline
Junior Member
**
Posts: 4
Threads: 1
Joined: Jul 2020
#1
07-14-2020, 10:25 AM
I'm a noob to both hashcat and AWS (and linux for that matter) so I'd really appreciate any thoughts on whether these benchmarks I got running on the AWS P3.16xlarge, which uses the Tesla V100, seem ok.

Thanks!

~/hashcat-6.0.0$ ./hashcat.bin -b
hashcat (v6.0.0) starting in benchmark mode...
 
Benchmarking uses hand-optimized kernel code by default.
You can use it in your cracking session by setting the -O option.
Note: Using optimized kernel code limits the maximum supported password length.
To disable the optimized kernel code in benchmark mode, use the -w option.
 
nvmlDeviceGetFanSpeed(): Not Supported
 
nvmlDeviceGetFanSpeed(): Not Supported
 
nvmlDeviceGetFanSpeed(): Not Supported
 
nvmlDeviceGetFanSpeed(): Not Supported
 
nvmlDeviceGetFanSpeed(): Not Supported
 
nvmlDeviceGetFanSpeed(): Not Supported
 
nvmlDeviceGetFanSpeed(): Not Supported
 
nvmlDeviceGetFanSpeed(): Not Supported
 
CUDA API (CUDA 11.0)
====================
* Device #1: Tesla V100-SXM2-16GB, 15851/16160 MB, 80MCU
* Device #2: Tesla V100-SXM2-16GB, 15851/16160 MB, 80MCU
* Device #3: Tesla V100-SXM2-16GB, 15851/16160 MB, 80MCU
* Device #4: Tesla V100-SXM2-16GB, 15851/16160 MB, 80MCU
* Device #5: Tesla V100-SXM2-16GB, 15851/16160 MB, 80MCU
* Device #6: Tesla V100-SXM2-16GB, 15851/16160 MB, 80MCU
* Device #7: Tesla V100-SXM2-16GB, 15851/16160 MB, 80MCU
* Device #8: Tesla V100-SXM2-16GB, 15851/16160 MB, 80MCU
 
OpenCL API (OpenCL 1.2 CUDA 11.0.197) - Platform #1 [NVIDIA Corporation]
========================================================================
* Device #9: Tesla V100-SXM2-16GB, skipped
* Device #10: Tesla V100-SXM2-16GB, skipped
* Device #11: Tesla V100-SXM2-16GB, skipped
* Device #12: Tesla V100-SXM2-16GB, skipped
* Device #13: Tesla V100-SXM2-16GB, skipped
* Device #14: Tesla V100-SXM2-16GB, skipped
* Device #15: Tesla V100-SXM2-16GB, skipped
* Device #16: Tesla V100-SXM2-16GB, skipped
 
Benchmark relevant options:
===========================
* --optimized-kernel-enable
 
Hashmode: 0 - MD5
 
Speed.#1.........: 56137.6 MH/s (47.67ms) @ Accel:32 Loops:1024 Thr:1024 Vec:8
Speed.#2.........: 56167.8 MH/s (47.67ms) @ Accel:32 Loops:1024 Thr:1024 Vec:8
Speed.#3.........: 56106.8 MH/s (47.72ms) @ Accel:32 Loops:1024 Thr:1024 Vec:8
Speed.#4.........: 56006.8 MH/s (47.81ms) @ Accel:32 Loops:1024 Thr:1024 Vec:8
Speed.#5.........: 56181.4 MH/s (47.67ms) @ Accel:32 Loops:1024 Thr:1024 Vec:8
Speed.#6.........: 56177.8 MH/s (47.67ms) @ Accel:32 Loops:1024 Thr:1024 Vec:8
Speed.#7.........: 56163.4 MH/s (47.67ms) @ Accel:32 Loops:1024 Thr:1024 Vec:8
Speed.#8.........: 56165.6 MH/s (47.67ms) @ Accel:32 Loops:1024 Thr:1024 Vec:8
Speed.#*.........:   449.1 GH/s
 
Hashmode: 100 - SHA1
 
Speed.#1.........: 17748.9 MH/s (75.51ms) @ Accel:16 Loops:1024 Thr:1024 Vec:1
Speed.#2.........: 17738.1 MH/s (75.57ms) @ Accel:16 Loops:1024 Thr:1024 Vec:1
Speed.#3.........: 17694.9 MH/s (75.73ms) @ Accel:16 Loops:1024 Thr:1024 Vec:1
Speed.#4.........: 17669.4 MH/s (75.84ms) @ Accel:16 Loops:1024 Thr:1024 Vec:1
Speed.#5.........: 17747.7 MH/s (75.50ms) @ Accel:16 Loops:1024 Thr:1024 Vec:1
Speed.#6.........: 17747.1 MH/s (75.50ms) @ Accel:16 Loops:1024 Thr:1024 Vec:1
Speed.#7.........: 17745.7 MH/s (75.52ms) @ Accel:16 Loops:1024 Thr:1024 Vec:1
Speed.#8.........: 17718.7 MH/s (75.63ms) @ Accel:16 Loops:1024 Thr:1024 Vec:1
Speed.#*.........:   141.8 GH/s
 
Hashmode: 1400 - SHA2-256
 
Speed.#1.........:  7706.4 MH/s (86.97ms) @ Accel:8 Loops:1024 Thr:1024 Vec:1
Speed.#2.........:  7703.6 MH/s (86.98ms) @ Accel:8 Loops:1024 Thr:1024 Vec:1
Speed.#3.........:  7687.4 MH/s (87.17ms) @ Accel:8 Loops:1024 Thr:1024 Vec:1
Speed.#4.........:  7671.5 MH/s (87.35ms) @ Accel:8 Loops:1024 Thr:1024 Vec:1
Speed.#5.........:  7708.7 MH/s (86.94ms) @ Accel:8 Loops:1024 Thr:1024 Vec:1
Speed.#6.........:  7706.7 MH/s (86.95ms) @ Accel:8 Loops:1024 Thr:1024 Vec:1
Speed.#7.........:  7669.5 MH/s (87.38ms) @ Accel:8 Loops:1024 Thr:1024 Vec:1
Speed.#8.........:  7685.1 MH/s (87.20ms) @ Accel:8 Loops:1024 Thr:1024 Vec:1
Speed.#*.........: 61538.9 MH/s
 
Hashmode: 1700 - SHA2-512
 
Speed.#1.........:  2403.2 MH/s (69.69ms) @ Accel:8 Loops:256 Thr:1024 Vec:1
Speed.#2.........:  2404.1 MH/s (69.66ms) @ Accel:8 Loops:256 Thr:1024 Vec:1
Speed.#3.........:  2402.0 MH/s (69.72ms) @ Accel:8 Loops:256 Thr:1024 Vec:1
Speed.#4.........:  2396.5 MH/s (69.89ms) @ Accel:8 Loops:256 Thr:1024 Vec:1
Speed.#5.........:  2403.4 MH/s (69.70ms) @ Accel:8 Loops:256 Thr:1024 Vec:1
Speed.#6.........:  2403.9 MH/s (69.67ms) @ Accel:8 Loops:256 Thr:1024 Vec:1
Speed.#7.........:  2403.2 MH/s (69.70ms) @ Accel:8 Loops:256 Thr:1024 Vec:1
Speed.#8.........:  2402.0 MH/s (69.70ms) @ Accel:8 Loops:256 Thr:1024 Vec:1
Speed.#*.........: 19218.3 MH/s
 
Hashmode: 22000 - WPA-PBKDF2-PMKID+EAPOL (Iterations: 4095)
 
Speed.#1.........:   867.8 kH/s (94.16ms) @ Accel:8 Loops:512 Thr:1024 Vec:1
Speed.#2.........:   868.2 kH/s (94.12ms) @ Accel:8 Loops:512 Thr:1024 Vec:1
Speed.#3.........:   867.6 kH/s (94.19ms) @ Accel:8 Loops:512 Thr:1024 Vec:1
Speed.#4.........:   865.5 kH/s (94.42ms) @ Accel:8 Loops:512 Thr:1024 Vec:1
Speed.#5.........:   867.4 kH/s (94.21ms) @ Accel:8 Loops:512 Thr:1024 Vec:1
Speed.#6.........:   867.8 kH/s (94.12ms) @ Accel:8 Loops:512 Thr:1024 Vec:1
Speed.#7.........:   867.9 kH/s (94.16ms) @ Accel:8 Loops:512 Thr:1024 Vec:1
Speed.#8.........:   868.0 kH/s (94.15ms) @ Accel:8 Loops:512 Thr:1024 Vec:1
Speed.#*.........:  6940.2 kH/s
 
Hashmode: 1000 - NTLM
 
Speed.#1.........:   102.2 GH/s (26.16ms) @ Accel:32 Loops:1024 Thr:1024 Vec:8
Speed.#2.........:   102.3 GH/s (26.12ms) @ Accel:32 Loops:1024 Thr:1024 Vec:8
Speed.#3.........:   102.3 GH/s (26.13ms) @ Accel:32 Loops:1024 Thr:1024 Vec:8
Speed.#4.........:   102.3 GH/s (26.13ms) @ Accel:32 Loops:1024 Thr:1024 Vec:8
Speed.#5.........:   102.3 GH/s (26.12ms) @ Accel:32 Loops:1024 Thr:1024 Vec:8
Speed.#6.........:   102.3 GH/s (26.13ms) @ Accel:32 Loops:1024 Thr:1024 Vec:8
Speed.#7.........:   102.3 GH/s (26.12ms) @ Accel:32 Loops:1024 Thr:1024 Vec:8
Speed.#8.........:   102.2 GH/s (26.12ms) @ Accel:32 Loops:1024 Thr:1024 Vec:8
Speed.#*.........:   818.2 GH/s
 
Hashmode: 3000 - LM
 
Speed.#1.........: 39754.4 MH/s (67.26ms) @ Accel:512 Loops:1024 Thr:64 Vec:1
Speed.#2.........: 40757.5 MH/s (65.59ms) @ Accel:512 Loops:1024 Thr:64 Vec:1
Speed.#3.........: 41003.7 MH/s (64.84ms) @ Accel:512 Loops:1024 Thr:64 Vec:1
Speed.#4.........: 39720.3 MH/s (67.23ms) @ Accel:512 Loops:1024 Thr:64 Vec:1
Speed.#5.........: 39971.7 MH/s (66.88ms) @ Accel:512 Loops:1024 Thr:64 Vec:1
Speed.#6.........: 41957.6 MH/s (63.68ms) @ Accel:512 Loops:1024 Thr:64 Vec:1
Speed.#7.........: 40799.8 MH/s (65.36ms) @ Accel:512 Loops:1024 Thr:64 Vec:1
Speed.#8.........: 41263.8 MH/s (64.77ms) @ Accel:512 Loops:1024 Thr:64 Vec:1
Speed.#*.........:   325.2 GH/s
 
Hashmode: 5500 - NetNTLMv1 / NetNTLMv1+ESS
 
Speed.#1.........: 55968.4 MH/s (47.85ms) @ Accel:32 Loops:1024 Thr:1024 Vec:2
Speed.#2.........: 56093.0 MH/s (47.74ms) @ Accel:32 Loops:1024 Thr:1024 Vec:2
Speed.#3.........: 55964.7 MH/s (47.70ms) @ Accel:32 Loops:1024 Thr:1024 Vec:2
Speed.#4.........: 55993.2 MH/s (47.85ms) @ Accel:32 Loops:1024 Thr:1024 Vec:2
Speed.#5.........: 55991.7 MH/s (47.83ms) @ Accel:32 Loops:1024 Thr:1024 Vec:2
Speed.#6.........: 56001.4 MH/s (47.82ms) @ Accel:32 Loops:1024 Thr:1024 Vec:2
Speed.#7.........: 56014.9 MH/s (47.80ms) @ Accel:32 Loops:1024 Thr:1024 Vec:2
Speed.#8.........: 56026.4 MH/s (47.80ms) @ Accel:32 Loops:1024 Thr:1024 Vec:2
Speed.#*.........:   448.1 GH/s
 
Hashmode: 5600 - NetNTLMv2
 
Speed.#1.........:  3793.7 MH/s (88.33ms) @ Accel:4 Loops:1024 Thr:1024 Vec:1
Speed.#2.........:  3806.2 MH/s (88.05ms) @ Accel:4 Loops:1024 Thr:1024 Vec:1
Speed.#3.........:  3807.7 MH/s (88.01ms) @ Accel:4 Loops:1024 Thr:1024 Vec:1
Speed.#4.........:  3796.3 MH/s (88.30ms) @ Accel:4 Loops:1024 Thr:1024 Vec:1
Speed.#5.........:  3810.8 MH/s (87.94ms) @ Accel:4 Loops:1024 Thr:1024 Vec:1
Speed.#6.........:  3791.4 MH/s (88.28ms) @ Accel:4 Loops:1024 Thr:1024 Vec:1
Speed.#7.........:  3792.8 MH/s (88.35ms) @ Accel:4 Loops:1024 Thr:1024 Vec:1
Speed.#8.........:  3793.8 MH/s (88.32ms) @ Accel:4 Loops:1024 Thr:1024 Vec:1
Speed.#*.........: 30392.7 MH/s
 
Hashmode: 1500 - descrypt, DES (Unix), Traditional DES
 
Speed.#1.........:  1753.0 MH/s (95.43ms) @ Accel:32 Loops:1024 Thr:64 Vec:1
Speed.#2.........:  1784.5 MH/s (93.72ms) @ Accel:32 Loops:1024 Thr:64 Vec:1
Speed.#3.........:  1723.7 MH/s (97.07ms) @ Accel:32 Loops:1024 Thr:64 Vec:1
Speed.#4.........:  1751.6 MH/s (95.52ms) @ Accel:32 Loops:1024 Thr:64 Vec:1
Speed.#5.........:  1723.6 MH/s (96.98ms) @ Accel:32 Loops:1024 Thr:64 Vec:1
Speed.#6.........:  1789.8 MH/s (93.42ms) @ Accel:32 Loops:1024 Thr:64 Vec:1
Speed.#7.........:  1739.9 MH/s (96.17ms) @ Accel:32 Loops:1024 Thr:64 Vec:1
Speed.#8.........:  1741.9 MH/s (96.04ms) @ Accel:32 Loops:1024 Thr:64 Vec:1
Speed.#*.........: 14008.0 MH/s
 
Hashmode: 500 - md5crypt, MD5 (Unix), Cisco-IOS $1$ (MD5) (Iterations: 1000)
 
Speed.#1.........: 24935.1 kH/s (50.62ms) @ Accel:16 Loops:1000 Thr:1024 Vec:1
Speed.#2.........: 24905.5 kH/s (50.69ms) @ Accel:16 Loops:1000 Thr:1024 Vec:1
Speed.#3.........: 24916.5 kH/s (50.77ms) @ Accel:16 Loops:1000 Thr:1024 Vec:1
Speed.#4.........: 24876.6 kH/s (50.84ms) @ Accel:16 Loops:1000 Thr:1024 Vec:1
Speed.#5.........: 24886.1 kH/s (50.77ms) @ Accel:16 Loops:1000 Thr:1024 Vec:1
Speed.#6.........: 24818.6 kH/s (50.84ms) @ Accel:16 Loops:1000 Thr:1024 Vec:1
Speed.#7.........: 25001.8 kH/s (50.60ms) @ Accel:16 Loops:1000 Thr:1024 Vec:1
Speed.#8.........: 24913.0 kH/s (50.70ms) @ Accel:16 Loops:1000 Thr:1024 Vec:1
Speed.#*.........:   199.3 MH/s
 
Hashmode: 3200 - bcrypt $2*$, Blowfish (Unix) (Iterations: 32)
 
Speed.#1.........:    79001 H/s (23.42ms) @ Accel:2 Loops:32 Thr:12 Vec:1
Speed.#2.........:    79185 H/s (23.43ms) @ Accel:2 Loops:32 Thr:12 Vec:1
Speed.#3.........:    79556 H/s (23.28ms) @ Accel:2 Loops:32 Thr:12 Vec:1
Speed.#4.........:    79159 H/s (23.43ms) @ Accel:2 Loops:32 Thr:12 Vec:1
Speed.#5.........:    79202 H/s (23.39ms) @ Accel:2 Loops:32 Thr:12 Vec:1
Speed.#6.........:    79394 H/s (23.31ms) @ Accel:2 Loops:32 Thr:12 Vec:1
Speed.#7.........:    79659 H/s (23.28ms) @ Accel:2 Loops:32 Thr:12 Vec:1
Speed.#8.........:    79199 H/s (23.44ms) @ Accel:2 Loops:32 Thr:12 Vec:1
Speed.#*.........:   634.4 kH/s
 
Hashmode: 1800 - sha512crypt $6$, SHA512 (Unix) (Iterations: 5000)
 
Speed.#1.........:   371.4 kH/s (87.55ms) @ Accel:8 Loops:256 Thr:1024 Vec:1
Speed.#2.........:   369.3 kH/s (88.02ms) @ Accel:8 Loops:256 Thr:1024 Vec:1
Speed.#3.........:   369.1 kH/s (88.10ms) @ Accel:8 Loops:256 Thr:1024 Vec:1
Speed.#4.........:   368.1 kH/s (88.19ms) @ Accel:8 Loops:256 Thr:1024 Vec:1
Speed.#5.........:   363.9 kH/s (89.36ms) @ Accel:8 Loops:256 Thr:1024 Vec:1
Speed.#6.........:   366.7 kH/s (88.67ms) @ Accel:8 Loops:256 Thr:1024 Vec:1
Speed.#7.........:   365.8 kH/s (88.89ms) @ Accel:8 Loops:256 Thr:1024 Vec:1
Speed.#8.........:   371.3 kH/s (87.57ms) @ Accel:8 Loops:256 Thr:1024 Vec:1
Speed.#*.........:  2945.4 kH/s
 
Hashmode: 7500 - Kerberos 5, etype 23, AS-REQ Pre-Auth
 
Speed.#1.........:  1039.7 MH/s (80.55ms) @ Accel:256 Loops:64 Thr:64 Vec:1
Speed.#2.........:  1041.0 MH/s (80.46ms) @ Accel:256 Loops:64 Thr:64 Vec:1
Speed.#3.........:  1041.4 MH/s (80.43ms) @ Accel:256 Loops:64 Thr:64 Vec:1
Speed.#4.........:  1042.0 MH/s (80.38ms) @ Accel:256 Loops:64 Thr:64 Vec:1
Speed.#5.........:  1043.1 MH/s (80.32ms) @ Accel:256 Loops:64 Thr:64 Vec:1
Speed.#6.........:  1036.6 MH/s (80.71ms) @ Accel:256 Loops:64 Thr:64 Vec:1
Speed.#7.........:  1038.1 MH/s (80.67ms) @ Accel:256 Loops:64 Thr:64 Vec:1
Speed.#8.........:  1039.6 MH/s (80.59ms) @ Accel:256 Loops:64 Thr:64 Vec:1
Speed.#*.........:  8321.4 MH/s
 
Hashmode: 13100 - Kerberos 5, etype 23, TGS-REP
 
Speed.#1.........:  1000.6 MH/s (83.72ms) @ Accel:256 Loops:64 Thr:64 Vec:1
Speed.#2.........:  1005.8 MH/s (83.29ms) @ Accel:256 Loops:64 Thr:64 Vec:1
Speed.#3.........:  1004.9 MH/s (83.36ms) @ Accel:256 Loops:64 Thr:64 Vec:1
Speed.#4.........:  1000.6 MH/s (83.73ms) @ Accel:256 Loops:64 Thr:64 Vec:1
Speed.#5.........:  1005.5 MH/s (83.30ms) @ Accel:256 Loops:64 Thr:64 Vec:1
Speed.#6.........:  1003.9 MH/s (83.44ms) @ Accel:256 Loops:64 Thr:64 Vec:1
Speed.#7.........:  1000.9 MH/s (83.69ms) @ Accel:256 Loops:64 Thr:64 Vec:1
Speed.#8.........:  1005.0 MH/s (83.33ms) @ Accel:256 Loops:64 Thr:64 Vec:1
Speed.#*.........:  8027.3 MH/s
 
Hashmode: 15300 - DPAPI masterkey file v1 (Iterations: 23999)
 
Speed.#1.........:   148.2 kH/s (94.26ms) @ Accel:8 Loops:512 Thr:1024 Vec:1
Speed.#2.........:   148.5 kH/s (94.06ms) @ Accel:8 Loops:512 Thr:1024 Vec:1
Speed.#3.........:   148.0 kH/s (94.36ms) @ Accel:8 Loops:512 Thr:1024 Vec:1
Speed.#4.........:   148.5 kH/s (94.07ms) @ Accel:8 Loops:512 Thr:1024 Vec:1
Speed.#5.........:   148.6 kH/s (93.99ms) @ Accel:8 Loops:512 Thr:1024 Vec:1
Speed.#6.........:   148.5 kH/s (94.09ms) @ Accel:8 Loops:512 Thr:1024 Vec:1
Speed.#7.........:   148.2 kH/s (94.28ms) @ Accel:8 Loops:512 Thr:1024 Vec:1
Speed.#8.........:   148.1 kH/s (94.30ms) @ Accel:8 Loops:512 Thr:1024 Vec:1
Speed.#*.........:  1186.7 kH/s
 
Hashmode: 15900 - DPAPI masterkey file v2 (Iterations: 12899)
 
Speed.#1.........:    79712 H/s (81.48ms) @ Accel:4 Loops:256 Thr:1024 Vec:1
Speed.#2.........:    79929 H/s (81.26ms) @ Accel:4 Loops:256 Thr:1024 Vec:1
Speed.#3.........:    79689 H/s (81.51ms) @ Accel:4 Loops:256 Thr:1024 Vec:1
Speed.#4.........:    79802 H/s (81.39ms) @ Accel:4 Loops:256 Thr:1024 Vec:1
Speed.#5.........:    80024 H/s (81.16ms) @ Accel:4 Loops:256 Thr:1024 Vec:1
Speed.#6.........:    79799 H/s (81.40ms) @ Accel:4 Loops:256 Thr:1024 Vec:1
Speed.#7.........:    79655 H/s (81.54ms) @ Accel:4 Loops:256 Thr:1024 Vec:1
Speed.#8.........:    79637 H/s (81.52ms) @ Accel:4 Loops:256 Thr:1024 Vec:1
Speed.#*.........:   638.2 kH/s
 
Hashmode: 7100 - macOS v10.8+ (PBKDF2-SHA512) (Iterations: 1023)
 
Speed.#1.........:   992.1 kH/s (79.52ms) @ Accel:32 Loops:31 Thr:1024 Vec:1
Speed.#2.........:   995.0 kH/s (79.28ms) @ Accel:32 Loops:31 Thr:1024 Vec:1
Speed.#3.........:   992.8 kH/s (79.46ms) @ Accel:32 Loops:31 Thr:1024 Vec:1
Speed.#4.........:   992.2 kH/s (79.47ms) @ Accel:32 Loops:31 Thr:1024 Vec:1
Speed.#5.........:   996.2 kH/s (79.19ms) @ Accel:32 Loops:31 Thr:1024 Vec:1
Speed.#6.........:   993.4 kH/s (79.42ms) @ Accel:32 Loops:31 Thr:1024 Vec:1
Speed.#7.........:   991.7 kH/s (79.55ms) @ Accel:32 Loops:31 Thr:1024 Vec:1
Speed.#8.........:   991.9 kH/s (79.53ms) @ Accel:32 Loops:31 Thr:1024 Vec:1
Speed.#*.........:  7945.3 kH/s
 
Hashmode: 11600 - 7-Zip (Iterations: 16384)
 
Speed.#1.........:   851.8 kH/s (82.71ms) @ Accel:4 Loops:4096 Thr:1024 Vec:1
Speed.#2.........:   868.5 kH/s (82.74ms) @ Accel:4 Loops:4096 Thr:1024 Vec:1
Speed.#3.........:   896.5 kH/s (82.52ms) @ Accel:4 Loops:4096 Thr:1024 Vec:1
Speed.#4.........:   866.8 kH/s (82.70ms) @ Accel:4 Loops:4096 Thr:1024 Vec:1
Speed.#5.........:   848.1 kH/s (83.93ms) @ Accel:4 Loops:4096 Thr:1024 Vec:1
Speed.#6.........:   868.0 kH/s (82.82ms) @ Accel:4 Loops:4096 Thr:1024 Vec:1
Speed.#7.........:   848.2 kH/s (83.36ms) @ Accel:4 Loops:4096 Thr:1024 Vec:1
Speed.#8.........:   849.2 kH/s (82.38ms) @ Accel:4 Loops:4096 Thr:1024 Vec:1
Speed.#*.........:  6897.0 kH/s
 
Hashmode: 12500 - RAR3-hp (Iterations: 262144)
 
Speed.#1.........:   102.0 kH/s (50.14ms) @ Accel:1 Loops:16384 Thr:1024 Vec:1
Speed.#2.........:   102.3 kH/s (49.97ms) @ Accel:1 Loops:16384 Thr:1024 Vec:1
Speed.#3.........:   102.2 kH/s (50.01ms) @ Accel:1 Loops:16384 Thr:1024 Vec:1
Speed.#4.........:   101.8 kH/s (50.20ms) @ Accel:1 Loops:16384 Thr:1024 Vec:1
Speed.#5.........:   102.4 kH/s (49.94ms) @ Accel:1 Loops:16384 Thr:1024 Vec:1
Speed.#6.........:   102.3 kH/s (49.99ms) @ Accel:1 Loops:16384 Thr:1024 Vec:1
Speed.#7.........:   102.3 kH/s (49.97ms) @ Accel:1 Loops:16384 Thr:1024 Vec:1
Speed.#8.........:   102.2 kH/s (50.00ms) @ Accel:1 Loops:16384 Thr:1024 Vec:1
Speed.#*.........:   817.5 kH/s
 
Hashmode: 13000 - RAR5 (Iterations: 32799)
 
Speed.#1.........:    93086 H/s (54.88ms) @ Accel:16 Loops:128 Thr:1024 Vec:1
Speed.#2.........:    93177 H/s (54.82ms) @ Accel:16 Loops:128 Thr:1024 Vec:1
Speed.#3.........:    93052 H/s (54.90ms) @ Accel:16 Loops:128 Thr:1024 Vec:1
Speed.#4.........:    93160 H/s (54.83ms) @ Accel:16 Loops:128 Thr:1024 Vec:1
Speed.#5.........:    93264 H/s (54.77ms) @ Accel:16 Loops:128 Thr:1024 Vec:1
Speed.#6.........:    93140 H/s (54.84ms) @ Accel:16 Loops:128 Thr:1024 Vec:1
Speed.#7.........:    92908 H/s (54.93ms) @ Accel:16 Loops:128 Thr:1024 Vec:1
Speed.#8.........:    93041 H/s (54.89ms) @ Accel:16 Loops:128 Thr:1024 Vec:1
Speed.#*.........:   744.8 kH/s
 
Hashmode: 6211 - TrueCrypt RIPEMD160 + XTS 512 bit (Iterations: 1999)
 
Speed.#1.........:   671.4 kH/s (55.46ms) @ Accel:16 Loops:64 Thr:1024 Vec:1
Speed.#2.........:   671.5 kH/s (55.46ms) @ Accel:16 Loops:64 Thr:1024 Vec:1
Speed.#3.........:   670.2 kH/s (55.51ms) @ Accel:16 Loops:64 Thr:1024 Vec:1
Speed.#4.........:   671.6 kH/s (55.45ms) @ Accel:16 Loops:64 Thr:1024 Vec:1
Speed.#5.........:   672.3 kH/s (55.40ms) @ Accel:16 Loops:64 Thr:1024 Vec:1
Speed.#6.........:   671.1 kH/s (55.44ms) @ Accel:16 Loops:64 Thr:1024 Vec:1
Speed.#7.........:   670.9 kH/s (55.51ms) @ Accel:16 Loops:64 Thr:1024 Vec:1
Speed.#8.........:   670.9 kH/s (55.51ms) @ Accel:16 Loops:64 Thr:1024 Vec:1
Speed.#*.........:  5370.0 kH/s
 
Hashmode: 13400 - KeePass 1 (AES/Twofish) and KeePass 2 (AES) (Iterations: 24569)
 
Speed.#1.........:   110.9 kH/s (123.00ms) @ Accel:32 Loops:128 Thr:1024 Vec:1
Speed.#2.........:   111.2 kH/s (122.68ms) @ Accel:32 Loops:128 Thr:1024 Vec:1
Speed.#3.........:   110.9 kH/s (123.03ms) @ Accel:32 Loops:128 Thr:1024 Vec:1
Speed.#4.........:   111.2 kH/s (122.55ms) @ Accel:32 Loops:128 Thr:1024 Vec:1
Speed.#5.........:   111.2 kH/s (122.69ms) @ Accel:32 Loops:128 Thr:1024 Vec:1
Speed.#6.........:   111.1 kH/s (122.78ms) @ Accel:32 Loops:128 Thr:1024 Vec:1
Speed.#7.........:   110.8 kH/s (123.04ms) @ Accel:32 Loops:128 Thr:1024 Vec:1
Speed.#8.........:   110.9 kH/s (122.97ms) @ Accel:32 Loops:128 Thr:1024 Vec:1
Speed.#*.........:   888.1 kH/s
 
Hashmode: 6800 - LastPass + LastPass sniffed (Iterations: 499)
 
Speed.#1.........:  5939.4 kH/s (43.07ms) @ Accel:16 Loops:124 Thr:1024 Vec:1
Speed.#2.........:  5970.7 kH/s (42.85ms) @ Accel:16 Loops:124 Thr:1024 Vec:1
Speed.#3.........:  5959.5 kH/s (42.91ms) @ Accel:16 Loops:124 Thr:1024 Vec:1
Speed.#4.........:  5967.5 kH/s (42.88ms) @ Accel:16 Loops:124 Thr:1024 Vec:1
Speed.#5.........:  5950.9 kH/s (42.98ms) @ Accel:16 Loops:124 Thr:1024 Vec:1
Speed.#6.........:  5941.9 kH/s (43.06ms) @ Accel:16 Loops:124 Thr:1024 Vec:1
Speed.#7.........:  5959.9 kH/s (42.92ms) @ Accel:16 Loops:124 Thr:1024 Vec:1
Speed.#8.........:  5935.1 kH/s (43.11ms) @ Accel:16 Loops:124 Thr:1024 Vec:1
Speed.#*.........: 47625.0 kH/s
 
Hashmode: 11300 - Bitcoin/Litecoin wallet.dat (Iterations: 200459)
 
Speed.#1.........:    11374 H/s (73.55ms) @ Accel:2 Loops:1024 Thr:1024 Vec:1
Speed.#2.........:    11376 H/s (73.54ms) @ Accel:2 Loops:1024 Thr:1024 Vec:1
Speed.#3.........:    11360 H/s (73.64ms) @ Accel:2 Loops:1024 Thr:1024 Vec:1
Speed.#4.........:    11420 H/s (73.26ms) @ Accel:2 Loops:1024 Thr:1024 Vec:1
Speed.#5.........:    11385 H/s (73.48ms) @ Accel:2 Loops:1024 Thr:1024 Vec:1
Speed.#6.........:    11410 H/s (73.32ms) @ Accel:2 Loops:1024 Thr:1024 Vec:1
Speed.#7.........:    11391 H/s (73.44ms) @ Accel:2 Loops:1024 Thr:1024 Vec:1
Speed.#8.........:    11389 H/s (73.45ms) @ Accel:2 Loops:1024 Thr:1024 Vec:1
Speed.#*.........:    91104 H/s
 
Started: Mon Jul 13 05:32:46 2020
Stopped: Mon Jul 13 05:39:34 2020
Find
Reply
Mem5 Offline
Posting Freak
*****
Posts: 803
Threads: 135
Joined: Feb 2011
#2
07-15-2020, 12:16 AM
You can have better results with:
./hashcat.bin -b -O -w 4
Let us know.
Find
Reply
K4fffYndWBe8F033 Offline
Junior Member
**
Posts: 4
Threads: 1
Joined: Jul 2020
#3
07-15-2020, 04:13 AM
(07-15-2020, 12:16 AM)Mem5 Wrote: You can have better results with:
./hashcat.bin -b -O -w 4
Let us know.

Thanks for the suggestion, it improved the benchmarks very slightly, about 1%.  (Am I missing a trick by not getting the AWS CPUs to run as well?  There are 32 Xeon cores in this vm)

Here's the M 9600 benchmark, which was  the same under the regular -b.  (I also ran a dictionary attack on an m 9600 hash, just in case the workload setting didn't work in benchmark mode, and that worked at the same 180k p/s)


$ ./hashcat.bin -b -O -w 4 -m 9600

hashcat (v6.0.0) starting in benchmark mode...


Kernel /home/ubuntu/hashcat-6.0.0/OpenCL/m09600-optimized.cl:

Optimized kernel requested but not needed - falling back to pure kernel

CUDA API (CUDA 11.0)

====================

* Device #1: Tesla V100-SXM2-16GB, 15851/16160 MB, 80MCU

* Device #2: Tesla V100-SXM2-16GB, 15851/16160 MB, 80MCU

* Device #3: Tesla V100-SXM2-16GB, 15851/16160 MB, 80MCU

* Device #4: Tesla V100-SXM2-16GB, 15851/16160 MB, 80MCU

* Device #5: Tesla V100-SXM2-16GB, 15851/16160 MB, 80MCU

* Device #6: Tesla V100-SXM2-16GB, 15851/16160 MB, 80MCU

* Device #7: Tesla V100-SXM2-16GB, 15851/16160 MB, 80MCU

* Device #8: Tesla V100-SXM2-16GB, 15851/16160 MB, 80MCU


OpenCL API (OpenCL 1.2 CUDA 11.0.197) - Platform #1 [NVIDIA Corporation]

========================================================================

* Device #9: Tesla V100-SXM2-16GB, skipped

* Device #10: Tesla V100-SXM2-16GB, skipped

* Device #11: Tesla V100-SXM2-16GB, skipped

* Device #12: Tesla V100-SXM2-16GB, skipped

* Device #13: Tesla V100-SXM2-16GB, skipped

* Device #14: Tesla V100-SXM2-16GB, skipped

* Device #15: Tesla V100-SXM2-16GB, skipped

* Device #16: Tesla V100-SXM2-16GB, skipped


Benchmark relevant options:

===========================

* --optimized-kernel-enable

* --workload-profile=4


Hashmode: 9600 - MS Office 2013 (Iterations: 100000)


Speed.#1.........:    22552 H/s (297.40ms) @ Accel:8 Loops:1024 Thr:1024 Vec:1

Speed.#2.........:    22550 H/s (297.42ms) @ Accel:8 Loops:1024 Thr:1024 Vec:1

Speed.#3.........:    22509 H/s (297.96ms) @ Accel:8 Loops:1024 Thr:1024 Vec:1

Speed.#4.........:    22623 H/s (296.45ms) @ Accel:8 Loops:1024 Thr:1024 Vec:1

Speed.#5.........:    22592 H/s (296.87ms) @ Accel:8 Loops:1024 Thr:1024 Vec:1

Speed.#6.........:    22612 H/s (296.60ms) @ Accel:8 Loops:1024 Thr:1024 Vec:1

Speed.#7.........:    22572 H/s (297.12ms) @ Accel:8 Loops:1024 Thr:1024 Vec:1

Speed.#8.........:    22575 H/s (297.09ms) @ Accel:8 Loops:1024 Thr:1024 Vec:1

Speed.#*.........:  180.6 kH/s


Started: Wed Jul 15 01:51:03 2020

Stopped: Wed Jul 15 01:51:34 2020
Find
Reply
philsmd Offline
I'm phil
******
Posts: 2,267
Threads: 16
Joined: Feb 2013
#4
07-15-2020, 06:49 AM (This post was last modified: 07-15-2020, 06:50 AM by philsmd.)
Code:
-D 1,2

can be used to enable both CPU and GPU (the Intel OpenCL Runtime for Core or Xeon processors need to be installed, in general), but note that it doesn't always increase speed by a lot because of 2 main reasons:
1. CPUs are often much slower than GPUs (much less cores etc)
2. the fact that the CPUs are now much more busy is often counter-productive, i.e. they can't provide the GPUs with enough work if they themself are busy cracking

This of course depends a lot on many factors, e.g. hash types and number of CPUs vs GPUs etc etc etc. It's something you could test and just not use if you see it's not significantly faser or doesn't help.
Find
Reply
K4fffYndWBe8F033 Offline
Junior Member
**
Posts: 4
Threads: 1
Joined: Jul 2020
#5
07-15-2020, 10:53 AM
(07-15-2020, 06:49 AM)philsmd Wrote:
Code:
-D 1,2
can be used to enable both CPU and GPU (the Intel OpenCL Runtime for Core or Xeon processors need to be installed, in general)

Thanks Phil, I tried -D 1,2 on the AWS vm but it didn't seem to make any difference, it still only ran with the 8 V100s and ignored the Xeon cores, or at least it seemed that way per the benchmarks above.
Find
Reply
philsmd Offline
I'm phil
******
Posts: 2,267
Threads: 16
Joined: Feb 2013
#6
07-15-2020, 10:48 PM
That statement doesn't make sense without the full context.

Does hashcat even list all the OpenCL-supported CPU devices at the start ? Did you install the driver that I mentioned and which is also mentioned here (https://hashcat.net/hashcat/) ? Does the tool "clinfo" list all the CPUs ?

of course a VM makes it even more complicated with the correct driver installation etc, but I think I already saw some guys running benchmarks of hashcat with CPUs hosted on a AWS server. so probably not impossible, but maybe a little bit more complicated to install the OpenCL Runtime in an VM.

next time please don't forget to state exactly what you did try so far (including mentioning what CPU drivers you installed etc). This is crucial information. Thx
Find
Reply
K4fffYndWBe8F033 Offline
Junior Member
**
Posts: 4
Threads: 1
Joined: Jul 2020
#7
07-16-2020, 01:33 AM
Thanks Phil, I appreciate your comments.  My level of knowledge in all of this stuff is very basic, I know nothing about Cuda or OpenCL, so I think I need to do a lot more research and learning.

Thanks.
Find
Reply