hashcat Forum
Sort and de-dupe without merging together? - Printable Version

+- hashcat Forum (https://hashcat.net/forum)
+-- Forum: Support (https://hashcat.net/forum/forum-3.html)
+--- Forum: hashcat (https://hashcat.net/forum/forum-45.html)
+--- Thread: Sort and de-dupe without merging together? (/thread-6886.html)



Sort and de-dupe without merging together? - DDNK - 09-22-2017

Is there anyway to "sort and de-dupe" the entirety of my Wordlist folder without merging them together?

It's hard to explain what I exactly mean, hopefully someone understands, lol.


RE: Sort and de-dupe without merging together? - rsberzerker - 09-23-2017

Hashcat utilities rli and rli2 might do what you want, although it will take several passes if you have multiple dictionary files.


RE: Sort and de-dupe without merging together? - atom - 10-01-2017

Yes, rli2 is the way to go.

Make sure to

LC_ALL=C sort -u

before