How to Merge 2 Big Wordlists in Windows
#1
My intention is to combine 2 large wordlists, remove all duplicate entries, remove everything under 7 characters and over 40 characters and sort the list randomly, at best remove all entries that contain only letters and are not combined.

I work with Windows and have tried PowerShell and The-Distribution-Which-Does-Not-Handle-OpenCL-Well (Kali) Linux.

Via Powershell I have managed the following so far (but works only with small txt files)
Code:
Select-String -Path "D:\test\*.txt" -Pattern "^.{7,40}$" | Select -Unique -Expand Line | Sort-Object -Unique | Set-Content "D:\output.txt"

I have also tried with hashcat-utils via The-Distribution-Which-Does-Not-Handle-OpenCL-Well (Kali) linux via the command:
Code:
./mli2.bin 1.txt 2.txt > out.txt
or via powershell with:
Code:
./mli2.exe 1.txt 2.txt > out.txt

it also creates an out.txt but after 3 hours nothing happens, PowerShell aborts at some point and says that the file is already accessed.

can you help me?
Reply


Messages In This Thread
How to Merge 2 Big Wordlists in Windows - by marcusx - 06-15-2023, 03:28 PM