Possible issue with charset and multi gpu system

[mrleau]

Hi,

I'm getting different behaviour when running on two different computers with the following command:

Code:

cudaHashcat-lite64.exe -o out.txt -s 0 -l 65610000 --pw-min 4 --pw-max 4 -m 1400 F6F2EA8F45D8A057C9566A33F99474DA2E5C6A6604D736121650E2730C6FB0A3 -1 "1234567890qwertyuiopasdfghjklzxcvbnmQWERTYUIOPASDFGHJKLZXCVBNM~@#$%^&*()_+{}:|<>,./;'[]\-=" ?1?1?1?1

Computer 1: Win7 64b with GT 430 driver ver nvidia 285.62
Works fine

Computer 2: Win7 64b with 8x GTX580 driver ver nvidia 285.27
It will write the plaintext to out.txt but will keep running

Below is the console output:

Code:

C:\ProgramData\BOINC\slots\0 - Copy\oclHashcat-lite-0.09>cudaHashcat-lite32.exe
-o out.txt --pw-min 4 --pw-max 4 -m 1400 F6F2EA8F45D8A057C9566A33F99474DA2E5C6A6
604D736121650E2730C6FB0A3 -1 "1234567890qwertyuiopasdfghjklzxcvbnmQWERTYUIOPASDF
GHJKLZXCVBNM~@#$%^&*()_+{}:|<>,./;'[]\-=" ?1?1?1?1
cudaHashcat-lite v0.9 by atom starting...

GPU-Loops: 64
GPU-Accel: 80
Password lengths range: 4 - 4
Platform: NVidia compatible platform found
Watchdog: Temperature limit set to 90c
Device #1: GeForce GTX 580, 1536MB, 1544Mhz, 16MCU
Device #2: GeForce GTX 580, 1536MB, 1544Mhz, 16MCU
Device #3: GeForce GTX 580, 1536MB, 1544Mhz, 16MCU
Device #4: GeForce GTX 580, 1536MB, 1544Mhz, 16MCU
Device #5: GeForce GTX 580, 1536MB, 1544Mhz, 16MCU
Device #6: GeForce GTX 580, 1536MB, 1544Mhz, 16MCU
Device #7: GeForce GTX 580, 1536MB, 1544Mhz, 16MCU
Device #8: GeForce GTX 580, 1536MB, 1544Mhz, 16MCU
[s]tatus [p]ause [r]esume [q]uit => s
Status.......: Cracked
Hash.Target..: f6f2ea8f45d8a057c9566a33f99474da2e5c6a6604d736121650e2730c6fb0a3
Hash.Type....: SHA256
Time.Running.: 3 secs
Time.Left....: 0 secs
Plain.Mask...: ?1?1?1?1
Plain.Text...: *a90
Plain.Length.: 4
Progress.....: 27599120/65610000 (42.07%)
Speed.GPU.#1.:   285.1M/s
Speed.GPU.#2.:        0/s
Speed.GPU.#3.:   264.0M/s
Speed.GPU.#4.:        0/s
Speed.GPU.#5.:        0/s
Speed.GPU.#6.:        0/s
Speed.GPU.#7.:        0/s
Speed.GPU.#8.:        0/s
Speed.GPU.#*.:  2237.6M/s
HWMon.GPU.#1.:  0% GPU, 45c Temp
HWMon.GPU.#2.:  0% GPU, 46c Temp
HWMon.GPU.#3.:  0% GPU, 40c Temp
HWMon.GPU.#4.:  0% GPU, 43c Temp
HWMon.GPU.#5.:  0% GPU, 40c Temp
HWMon.GPU.#6.:  0% GPU, 42c Temp
HWMon.GPU.#7.:  0% GPU, 43c Temp
HWMon.GPU.#8.:  0% GPU, 43c Temp
^C

It gets stuck at the last line or if I don't press s it will keep running for ever.

After playing with the parameters I discovered that removing -= from charset made it work on both computers but it doesn't make sense to me.

Code:

cudaHashcat-lite64.exe -o out.txt -s 0 -l 65610000 --pw-min 4 --pw-max 4 -m 1400 F6F2EA8F45D8A057C9566A33F99474DA2E5C6A6604D736121650E2730C6FB0A3 -1 "1234567890qwertyuiopasdfghjklzxcvbnmQWERTYUIOPASDFGHJKLZXCVBNM~@#$%^&*()_+{}:|<>,./;'[]\" ?1?1?1?1

I don't have these issues with version 0.08

BTW if you wonder I'm playing with distributed hashing and trying to make it cracker independent that's why the parameters are like that.

leau

[atom]

This is because 65610000 > 59969536 which is 88 (nr of chars in your charset) ^ 4 (pw-min/pw-max).

[mrleau]

This is because 65610000 > 59969536 which is 88 (nr of chars in your charset) ^ 4 (pw-min/pw-max).

Oh my mistake I pasted the wrong version of the command line. I remove the -s -l during testing because I didn't want to have to recalculate it. BTW I always get an error when the -l value is too great.

That would be the correct version

Code:

cudaHashcat-lite64.exe -o out.txt --pw-min 4 --pw-max 4 -m 1400 F6F2EA8F45D8A057C9566A33F99474DA2E5C6A6604D736121650E2730C6FB0A3 -1 "1234567890qwertyuiopasdfghjklzxcvbnmQWERTYUIOPASDFGHJKLZXCVBNM~@#$%^&*()_+{}:|<>,./;'[]\-=" ?1?1?1?1

and if I remove the --pw-min and --pw-max I get the same behavior

Code:

cudaHashcat-lite64.exe -o out.txt -m 1400 F6F2EA8F45D8A057C9566A33F99474DA2E5C6A6604D736121650E2730C6FB0A3 -1 "1234567890qwertyuiopasdfghjklzxcvbnmQWERTYUIOPASDFGHJKLZXCVBNM~@#$%^&*()_+{}:|<>,./;'[]\-=" ?1?1?1?1

[atom]

I guess there is also something wrong with the escaping in your cmdline. For example, you must escape the ^ char with ^ - but you dont do it?

I recommend to convert the charset to hex and use the --hex-charset parameter.

[mrleau]

I guess there is also something wrong with the escaping in your cmdline. For example, you must escape the ^ char with ^ - but you dont do it?

I recommend to convert the charset to hex and use the --hex-charset parameter.

Tried using --hex-charset and it works on the computer with 1 GPU but not 8.
Also I tried running with one card (-d1) and it works without changing the charset (to hex or removing characters) for both computers.

If I don't specify a charset it works on both computers also.

[atom]

what exactly is the problem? if you are doing --pw-min 4 --pw-max 4 then it can not use all gpus but one. you need a keyspace that is big enough to feed all gpus with work. try again with --pw-min 8 and --pw-max 8

[mrleau]

what exactly is the problem? if you are doing --pw-min 4 --pw-max 4 then it can not use all gpus but one. you need a keyspace that is big enough to feed all gpus with work. try again with --pw-min 8 and --pw-max 8

It looks like it might be hardware or OS related. It runs on 6 of the 8 GPU. I used -d1 to -d8 for testing and I can also run it using -d1,2,3,... excluding the two faulty GPU. I tried it on other computers and it seems to be running fine.

FYI It didn't matter what I used (--pw-max 4, --pw-max 8, no --pw-max) as soon as I used that charset oclhashcat-lite would start but never terminate, typing s would render status info and freeze and typing q would also freeze. I had to CRTL-C to get back to the prompt.

[atom]

faulty hardware can generate irritating errors.

do i understand this correct: if you exclude the faulty hardware everything works fine?

[mrleau]

faulty hardware can generate irritating errors.

do i understand this correct: if you exclude the faulty hardware everything works fine?

Yes that's correct.

Thanks for the help and the great software