Hashcat utilties - remove duplicate pwds

[pops21]

'sort -u' usually does the trick.

Is there such a program that runs through your dictionary and removes all duplicate files

Many thanks in advanced.

Many thanks for your help...