Several potfiles - is it possible to omit hashes already cracked in next job?

[MariuszPoz]

Hello. I have several potfile files with "recovered" passwords. Is it possible to compare all files when starting new job in order to skip cracking those hashes that are already cracked? I mean:

for example i have a file not_cracked.txt where are stored 300 hashes
I have another files:
cracked1.txt and cracked2.txt where are cracked hashes from other jobs (other not_cracked files) (some are duplicated, available in not_cracked, but not all).

Is it possible for hashcat to look inside crackedX.txt if there are cracked hashes available in not_cracked.txt to speed up cracking process? Or is it possible only in potfile that already results are saved in current job?

Thanks.

[drsnooker]

Not sure if there's a better way, but you could put all the different found passwords in a small dictionary, then run all the hashes against this dictionary. It'll re-crack those hashes and update the pot-file. Shouldn't take more than a few seconds!

[Xanadrel]

You can probably use --outfile-check-dir

[MariuszPoz]

Ok. So far i wrote a script in python that allow me to:

a) remove duplicated hashes from single file (leaving only one). 

Few days ago i downloaded Badoo database from RaidForum, extracted with another python script only hashes (md5) stripping all other data and saved hashes in file. Size: 3,9gb. Using my script i removed those duplicated hashes (leaving one - of course - if there are more than one same hash). After removing duplicated hashes file size was decreased to 2.6gb

b) sorting hashes alphabetically 

Just for fun. Who ever would need that?

Code:

0000002ea676c95829d321fe683f5c9c 000000360646e71eb6c1d8d1b39a9cac 00000047ea2398bdb37d8655ae7461f4 00000072c9c3ff458b55de42054450ba 0000008d7d2edca5a96dd14b8f3e8a39 000000e73d0c2b27e031892c332c931d 000000fb71046e59893414ded016042f 0000013040c947e160d4398abfccf26a 000001636b57b3403d0e02039f6e198f 000001de8c7be1d7a3b8b4b614a66581 000002529600dbe65bb5910988c6d2a6 0000027b96f6d3bef66f15a5851da4d3 000002e51c066e0f2b6fe8314627f777 000002f265d724bbf1a1487515587966 0000031e2bc3d42bd8819333b6f55315 0000032e70b881bf4ed2a94fcadce68a 0000036817217deb319aca8c2938ec34 00000397f948cf0b56aa43df21d3aa84 0000039dfed85e91bab5c8716d271bb5 000003be26484dcbaf6e6a96acb5185b 000003c33d7e4f64686fa93550b8711c 0000041f578282f42ea09756f592c266 0000043346badd41dee1747309e45427 0000046f8700a3c268619435910de576 000004d4cc027155bce7a963eeefb164 000005040933c33d69716decb25e4773 0000050f9e265c6003f258d3fced8fc2 00000555ccb8320a4843b1a17fd70576 000005cc004e3edb976d825bb398992e 00000603dd487483ead1a033c4049368 000006455cacd1f5d0c46630a5b8c757 000006e07251e76894a416908f157cc3 0000077b03b93914476e0cdc5886dce7 0000077df1dcae29fa48a2c7044b7177 000007d57ceb70ae96e2a5ffeeca7770

c) delete hashes or passwords from potfile and save result in other file

This allows me to create a dictionary using words from potfile.
Also saving cracked hashes in other file will let me remove them from potfile with not cracked hashes (see below)



And this:

Code:

8e6fb808cdea51895a5ffda80657767c:Maexikaner c2ced853db31a0864df306b35cb68404:Travailler ed8d7bbda4be44d0f6e1f5854586e82f:Eleadecker cf0d16a613a72ccb3fb61320d88f1ba6:Painkiller 03ef86477d45ee237239f8e7207231c9:Beigbedere ebcbf95e2affcec468a4a577733bfd58:Swissphone 9a355fdb23e36ef03619e44cb534ae15:Salvaytere 4ccb1048dde4b2f7f8dd009e02c39f2d:Ilovepiter b00a7d27100cfe1af816f3c45dda5a94:Amigokater 317532540adceb07d5e2ec62d5eacac2:Manchester

becomes this:

Code:

Maexikaner Travailler Eleadecker Painkiller Beigbedere Swissphone Salvaytere Ilovepiter Amigokater Manchester

d) remove duplicated lines from two files

Lets say i have a file all_hashes.txt with hashes that are cracked and not yet cracked. Using script from point "C" i created a file with cracked hashes (but removed password), compared it with file all_hashes.txt and i saved to other file NOT cracked hashes.

Took some time to write it, but.. it works.