Hashcat rules generate duplicates
#1
I'm using the following command to redirect the words generated by hashcat with the best64 rule to a file. The file 'test' contains only the word test.

hashcat -r /usr/share/hashcat/rules/best64.rule test --stdout >> best64.txt

The command creates a file with 201 words.

wc -l best64.txt
201

But it contains duplicates!

..
t3st
tet
te
tes
tes
te
t
tt
..
..

I did
sort -u best64.txt | wc -l
188

So it created 13 duplicates!

i'm probably doing something wrong, anyone able to help? Thanks guys!
#2
different rules can result in the same plaintext candidate under certain conditions, while under normal conditions they would result in different candidates.

for example, the following rules would all transform "test" into "tes":

]
D4
'3

whereas if they were each applied to "password" would result in:

passwor
passord
pass

hope that helps.
#3
Oh, now i see! Very good explanation ! So it's a "tradeoff" if I want to have a more complete ruleset or duplicate words.
For slow algorithms every bit help and these duplicates will grow on me for sure... Need a more powerful hardware i guess Tongue I'm still salivating at your VCL rigs !

Quick edit: quick question, if i want to leetify the whole word, how do I do?
so0
si1
se3
This results in
l33tify
leet1fy

I want it to result in
l33t1fy
(Both rules applied to the same word)
Thanks again!
#4
the frequency of this occurring depends entirely on the wordlist and the ruleset. don't sweat it.
#5
if you want to leetify the whole word, use the leetspeak rules and/or tables.
#6
Shouldn't this rule be enough to do it?
sa@sc<se3si1so0ss$
(found in leetspeak rules)
I tried it but hashcat doesn't show any output.

edit:
Oh i see, the word either matches the whole patter or it doesn't apply it at all.
So
sa@so0
works for 'dollar' but doesn't work for 'doe'.
Any way to make 1 pattern work for all words?
edit:
i've found this thread http://hashcat.net/forum/thread-1158.html
So i have to pipe hashcat to hascat plus and use lookup tables. Oh well : ((

Thanks epixoip for your patience. I'm an hashcat noobie : P