Limiting the consecutive occurrence

[M@LIK]

Anyone has idea to generate the first half then use rule via OCLplus (GPU) to reverse it to form the missing half?

Disagree.

So, how would sed delete all lines that don't have at least one or more duplicate character any where in the whole line?

This can be done using the command below, add it, slow it, love it xD:

Code:

/\(.\).*\1/!d

I over looked this, well spotted ntk. We should include this.

Code:

/\(DCBA\|EDCB\|FEDC\|GFED\|HGFE\|IHGF\|JIHG\|KJIH\|LKJI\|MLKJ\|NMLK\|ONML\|PONM\|QPON\|RQPO\|SRQP\|TSRQ\|UTSR\|VUTS\|WVUT\|XWVU\|YXWV\|ZYXW\)/d

also it this the right command?

These kind of command slow it the most! That's why I said I can't do it in the first place (When you asked for alphabetical order rule).

I am generating Z at the moment and it has been running for 14 hours or so, the output file is only 3.76MB !!!!!!!!

I don’t think SED is fast enough, this needs to be on GPU.

According to this : "AMD dual core 3GHz" It's your CPU : (
I'm on i7 2.4, I can generate 1GB within couple of hours.

Another interesting thing to consider is I used ULM’s regular expressions to do some of this filtering on a text file and it does it much faster. I am purely guessing it would be done in 5 hours or so.

I think filtering an existing list may be faster than generating one then pushing it through SED.

I'll check that.

I think none of us should seriously get into generating these lists yet until we are all happy that the filter is ok and we have heard from atom. Think about it, it takes many hours to generate possibly days, we will then have to upload / download all the lists and then find somewhere to store them. Unless you have a huge empty drive they will have to be stored zipped which will mean unzipping them every time you need a character then move on to the next.

Agree!


Here are all the commands for Regular Expression:

Code:

(.)\1\1
(.).*\1.*\1
(.).*\1.*(.).*\2
(.).*(.).*\1.*\2
(.).*(.).*\2.*\1
(ABCD|BCDE|CDEF|DEFG|EFGH|FGHI|GHIJ|HIJK|IJKL|JKLM|KLMN|LMNO|MNOP|NOPQ|OPQR|PQRS|QRST|RSTU|STUV|TUVW|UVWX|VWXY|WXYZ)

All the rules so far.