I found a script to do this online in my browser but was wondering if hashcat had a build in function for it
http://www.tracemyip.org/tools/remove-du...s-in-text/
http://www.tracemyip.org/tools/remove-du...s-in-text/
how do i remove all duplicate words from a txt file?
|
I found a script to do this online in my browser but was wondering if hashcat had a build in function for it
http://www.tracemyip.org/tools/remove-du...s-in-text/
You just want to remove duplicates ?!
Code: sort file.txt | uniq
12-22-2016, 11:01 PM
or just sort -u
12-23-2016, 03:59 AM
12-24-2016, 02:22 AM
''LC_ALL=C sort -u''
You can also ''man sort'' and look at the --parallel and -S switches to improve performance.
ah, i see, its a unix command.
you had me thinking you were a wizard there for a second.
12-24-2016, 04:15 PM
This was driving me nuts. I came back to this post later and installed cygwin and finally got it to work. Funny how sometimes you get a wild hair up your ass about something and can't let it go.
You can have sort & uniq & other *nix tools under windows without the cygwin sh** : http://gnuwin32.sourceforge.net
12-25-2016, 02:44 AM
You can also use WSL and run Ubuntu under Windows 10
12-25-2016, 03:59 PM
I'd go Msys2
|
« Next Oldest | Next Newest »
|