Several potfiles - is it possible to omit hashes already cracked in next job?

[MariuszPoz]

Hello. I have several potfile files with "recovered" passwords. Is it possible to compare all files when starting new job in order to skip cracking those hashes that are already cracked? I mean:

for example i have a file not_cracked.txt where are stored 300 hashes
I have another files:
cracked1.txt and cracked2.txt where are cracked hashes from other jobs (other not_cracked files) (some are duplicated, available in not_cracked, but not all).

Is it possible for hashcat to look inside crackedX.txt if there are cracked hashes available in not_cracked.txt to speed up cracking process? Or is it possible only in potfile that already results are saved in current job?

Thanks.

[drsnooker]

Not sure if there's a better way, but you could put all the different found passwords in a small dictionary, then run all the hashes against this dictionary. It'll re-crack those hashes and update the pot-file. Shouldn't take more than a few seconds!

[Xanadrel]

You can probably use --outfile-check-dir

[MariuszPoz]

Ok. So far i wrote a script in python that allow me to:

a) remove duplicated hashes from single file (leaving only one). 

Few days ago i downloaded Badoo database from RaidForum, extracted with another python script only hashes (md5) stripping all other data and saved hashes in file. Size: 3,9gb. Using my script i removed those duplicated hashes (leaving one - of course - if there are more than one same hash). After removing duplicated hashes file size was decreased to 2.6gb

b) sorting hashes alphabetically 

Just for fun. Who ever would need that?

Code:

0000002ea676c95829d321fe683f5c9c
000000360646e71eb6c1d8d1b39a9cac
00000047ea2398bdb37d8655ae7461f4
00000072c9c3ff458b55de42054450ba
0000008d7d2edca5a96dd14b8f3e8a39
000000e73d0c2b27e031892c332c931d
000000fb71046e59893414ded016042f
0000013040c947e160d4398abfccf26a
000001636b57b3403d0e02039f6e198f
000001de8c7be1d7a3b8b4b614a66581
000002529600dbe65bb5910988c6d2a6
0000027b96f6d3bef66f15a5851da4d3
000002e51c066e0f2b6fe8314627f777
000002f265d724bbf1a1487515587966
0000031e2bc3d42bd8819333b6f55315
0000032e70b881bf4ed2a94fcadce68a
0000036817217deb319aca8c2938ec34
00000397f948cf0b56aa43df21d3aa84
0000039dfed85e91bab5c8716d271bb5
000003be26484dcbaf6e6a96acb5185b
000003c33d7e4f64686fa93550b8711c
0000041f578282f42ea09756f592c266
0000043346badd41dee1747309e45427
0000046f8700a3c268619435910de576
000004d4cc027155bce7a963eeefb164
000005040933c33d69716decb25e4773
0000050f9e265c6003f258d3fced8fc2
00000555ccb8320a4843b1a17fd70576
000005cc004e3edb976d825bb398992e
00000603dd487483ead1a033c4049368
000006455cacd1f5d0c46630a5b8c757
000006e07251e76894a416908f157cc3
0000077b03b93914476e0cdc5886dce7
0000077df1dcae29fa48a2c7044b7177
000007d57ceb70ae96e2a5ffeeca7770

c) delete hashes or passwords from potfile and save result in other file

This allows me to create a dictionary using words from potfile.
Also saving cracked hashes in other file will let me remove them from potfile with not cracked hashes (see below)



And this:

Code:

8e6fb808cdea51895a5ffda80657767c:Maexikaner
c2ced853db31a0864df306b35cb68404:Travailler
ed8d7bbda4be44d0f6e1f5854586e82f:Eleadecker
cf0d16a613a72ccb3fb61320d88f1ba6:Painkiller
03ef86477d45ee237239f8e7207231c9:Beigbedere
ebcbf95e2affcec468a4a577733bfd58:Swissphone
9a355fdb23e36ef03619e44cb534ae15:Salvaytere
4ccb1048dde4b2f7f8dd009e02c39f2d:Ilovepiter
b00a7d27100cfe1af816f3c45dda5a94:Amigokater
317532540adceb07d5e2ec62d5eacac2:Manchester

becomes this:

Code:

Maexikaner
Travailler
Eleadecker
Painkiller
Beigbedere
Swissphone
Salvaytere
Ilovepiter
Amigokater
Manchester

d) remove duplicated lines from two files

Lets say i have a file all_hashes.txt with hashes that are cracked and not yet cracked. Using script from point "C" i created a file with cracked hashes (but removed password), compared it with file all_hashes.txt and i saved to other file NOT cracked hashes.

Took some time to write it, but.. it works.