how do i remove all duplicate words from a txt file?

[cityscab]

I found a script to do this online in my browser but was wondering if hashcat had a build in function for it

http://www.tracemyip.org/tools/remove-du...s-in-text/

[Mem5]

You just want to remove duplicates ?!

Code:

sort file.txt | uniq

[Xanadrel]

or just sort -u

[kiara]

or
https://forum.hashkiller.co.uk/topic-vie...t=5512&p=0

[epixoip]

''LC_ALL=C sort -u''

You can also ''man sort'' and look at the --parallel and -S switches to improve performance.

[cityscab]

ah, i see, its a unix command.
you had me thinking you were a wizard there for a second.

[cityscab]

This was driving me nuts.  I came back to this post later and installed cygwin and finally got it to work.  Funny how sometimes you get a wild hair up your ass about something and can't let it go.

[Mem5]

You can have sort & uniq & other *nix tools under windows without the cygwin sh** : http://gnuwin32.sourceforge.net

[epixoip]

You can also use WSL and run Ubuntu under Windows 10

[atom]

I'd go Msys2