text editor to delete duplicates from pool of large files

[blaster666]

as i mentioned you can process files one by one or merging some more with

cat 1.txt 2.txt ... | sort | uniq >> uniq.uniq
or with for loop
for file in *.txt; do cat $file | sort | uniq >> uniq.uniq; done

you can do this file by file with the shown for loop but anyway you will need another last run for the resulting uniq.uniq, as this is quick n dirty and the uniq.uniq can or will have still dups as different input files are not compared to each other, just the content of the file itself (but this way its just a oneliner for bash)

depending on input this uniq.uniq can still get very large, maybe you will need to split the work to 10-20 text files, make a uniq.uniq for this 10-20, run cat sort uniq on this result file, store it and move to the next batch of files, at the end merge the uniq files a last time and run cat sort uniq

Thank you so much. Cat is working for me. I am checking for duplicates first half(s) of 2 different files, which are 16 GB total. 
My RAM is 64GB 
PC is working hard, as i could hear the fan sound, and Git Bash window is responding and everything seems  ok, 
uniq.uniq file is 0 kb, after 10 minutes of progress

My question is : is there any possibility to add "Loading" % Bar, to track the progress status?