+- hashcat Forum (https://hashcat.net/forum)
+-- Forum: Deprecated; Ancient Versions (https://hashcat.net/forum/forum-46.html)
+--- Forum: Very old oclHashcat-plus Support (https://hashcat.net/forum/forum-23.html)
+--- Thread: Wrong number of total hashes ? (/thread-2180.html)
Wrong number of total hashes ? - Mem5 - 03-29-2013
Hi,
I have downloaded a list of hashes at http://dazzlepod.com/site_media/txt/hashes.txt, which contains 551638 md5 hashes.
Quote:cat md5.txt|sort|uniq|wc -l
551638
Hashcat also sees 551638 ("Hashes: 551638 total").
But at the end, it says :
Recovered......: 83818/426429 (19.66%) Digests, 0/1 (0.00%) Salts
Where does "426429" come from ?
I would be waiting for 83818/551638, no ?
Thank you.
Quote:oclHashcat-plus-0.14\oclHashcat-plus64.exe -m 0 --username -o res.txt md5.txt passwords.txt(if needed, passwords.txt can be foudn here http://dazzlepod.com/site_media/txt/passwords.txt)
oclHashcat-plus v0.14 by atom starting...
Hashes: 551638 total, 1 unique salts, 426429 unique digests
Bitmaps: 21 bits, 1048576 entries, 0x000fffff mask, 4194304 bytes
Rules: 1
Workload: 1024 loops, 32 accel
Watchdog: Temperature abort trigger disabled
Watchdog: Temperature retain trigger disabled
Device #1: Cypress, 1024MB, 850Mhz, 20MCU
Device #1: Kernel C:\H\oclHashcat-plus-0.14/kernels/4098/m0000_a0.Cypress_1084.4_1084.4 (VM).kernel (1109768 bytes)
Cache-hit dictionary stats passwords.txt: 20163421 bytes, 2144233 words, 2144233 keyspace
Session.Name...: oclHashcat-plus
Status.........: Exhausted
Input.Mode.....: File (passwords.txt)
Hash.Target....: File (md5.txt)
Hash.Type......: MD5
Time.Started...: Fri Mar 29 11:51:04 2013 (22 secs)
Time.Estimated.: 0 secs
Speed.GPU.#1...: 105.1k/s
Recovered......: 83818/426429 (19.66%) Digests, 0/1 (0.00%) Salts
Progress.......: 2144233/2144233 (100.00%)
Rejected.......: 0/2144233 (0.00%)
RE: Wrong number of total hashes ? - philsmd - 03-29-2013
Are you sure about the format of the hash.txt list.
It seems to be number[8 digit]:hash[md5 32byte]
Therefore, a command like:
cut -b 8- hashes.txt|sort -u|wc -l
gives a MUCH smaller number than your 551638... so the hashes are *not* uniq (only the lines, since "numbered")
Furthermore, the answer is already in your question: *426429 unique digests*
Ps. it would be better to split the two parts w/ cut -d ":" -f 2
and test also cut .....|uniq -d which gives a lot of duplicates.
BTW (the output of the split):
$ cut -d: -f2 hashes.txt|sort -u|wc -l
426429
Hope this solves your problem
RE: Wrong number of total hashes ? - Mem5 - 03-29-2013
Oh yes I confirm thanks
cat hashes.txt|cut -d: -f2|sort|wc -l
551638
cat hashes.txt|cut -d: -f2|sort|uniq|wc -l
426429
(I wonder why the owner of the list did not do that, anyway.)
Thread closed
RE: Wrong number of total hashes ? - philsmd - 03-29-2013
Good to know that it worked!
BTW, I know that we all love *cat here but there are times you shouldn't use the cat commands...hehe
Why are people using cat to grep stuff, cat to sort stuff, cat to cut stuff etc... it needs to create another pipe etc etc etc. You can definitely skip it!
RE: Wrong number of total hashes ? - Mem5 - 03-29-2013
You're right, it's a bad habit
RE: Wrong number of total hashes ? - epixoip - 03-29-2013
Quote:cat md5.txt|sort|uniq|wc -l
i will stab you.
Quote:sort -u md5.txt | wc -l
RE: Wrong number of total hashes ? - philsmd - 03-29-2013
@epixoip
That command(s) do *not* solve the problem that we had: unique lines vs unique hashes! (we need to eliminate the strings before the colon)
BTW, nobody would use an extra pipe between *TWO* commands to count just unique lines if you don't need to, e.g:
$ awk '{i[$0]++}END{print length(i)}' hashes.txt
$ # or many others w/o pipe!
RE: Wrong number of total hashes ? - epixoip - 03-30-2013
it solves the problem of stringing together a ton of redundant commands.
that awk one-liner is hideous.