Copy and reuse dictionary cache
#10
It's unfortunate the rli2 doesn't support multiple files. A script needs to be made then.

Regarding the topic of this thread, I found that there's an option:

Code:
--markov-hcstat2 | File | Specify hcstat2 file to use | --markov-hcstat2=my.hcstat2

I don't understand what does this option do and if it's related to caching the dictionary.

------------------------------------------

Also, one question regarding split please.
I use the following command to split without breaking lines but it still breaks lines and files are even not equal or close in size.

Code:
# split file into 3 chunks

split -d -n l/3 wpa.txt wpa


I'm using debian 10 and the docs says:
Code:
l/N    split into N files without splitting lines/records


Code:
Usage: split [OPTION]... [FILE [PREFIX]]
Output pieces of FILE to PREFIXaa, PREFIXab, ...;
default size is 1000 lines, and default PREFIX is 'x'.

With no FILE, or when FILE is -, read standard input.

Mandatory arguments to long options are mandatory for short options too.
  -a, --suffix-length=N  generate suffixes of length N (default 2)
      --additional-suffix=SUFFIX  append an additional SUFFIX to file names
  -b, --bytes=SIZE        put SIZE bytes per output file
  -C, --line-bytes=SIZE  put at most SIZE bytes of records per output file
  -d                      use numeric suffixes starting at 0, not alphabetic
      --numeric-suffixes[=FROM]  same as -d, but allow setting the start value
  -x                      use hex suffixes starting at 0, not alphabetic
      --hex-suffixes[=FROM]  same as -x, but allow setting the start value
  -e, --elide-empty-files  do not generate empty output files with '-n'
      --filter=COMMAND    write to shell COMMAND; file name is $FILE
  -l, --lines=NUMBER      put NUMBER lines/records per output file
  -n, --number=CHUNKS    generate CHUNKS output files; see explanation below
  -t, --separator=SEP    use SEP instead of newline as the record separator;
                            '\0' (zero) specifies the NUL character
  -u, --unbuffered        immediately copy input to output with '-n r/...'
      --verbose          print a diagnostic just before each
                            output file is opened
      --help    display this help and exit
      --version  output version information and exit

The SIZE argument is an integer and optional unit (example: 10K is 10*1024).
Units are K,M,G,T,P,E,Z,Y (powers of 1024) or KB,MB,... (powers of 1000).

CHUNKS may be:
  N      split into N files based on size of input
  K/N    output Kth of N to stdout
  l/N    split into N files without splitting lines/records
  l/K/N  output Kth of N to stdout without splitting lines/records
  r/N    like 'l' but use round robin distribution
  r/K/N  likewise but only output Kth of N to stdout
Reply


Messages In This Thread
Copy and reuse dictionary cache - by fa1rid - 07-10-2020, 01:56 AM
RE: Copy and reuse dictionary cache - by royce - 07-10-2020, 01:59 AM
RE: Copy and reuse dictionary cache - by fa1rid - 07-10-2020, 02:13 AM
RE: Copy and reuse dictionary cache - by royce - 07-10-2020, 03:18 AM
RE: Copy and reuse dictionary cache - by fa1rid - 07-10-2020, 08:06 AM
RE: Copy and reuse dictionary cache - by fa1rid - 07-10-2020, 08:10 AM
RE: Copy and reuse dictionary cache - by royce - 07-10-2020, 05:50 PM
RE: Copy and reuse dictionary cache - by fa1rid - 08-01-2020, 08:36 PM
RE: Copy and reuse dictionary cache - by royce - 08-01-2020, 08:44 PM
RE: Copy and reuse dictionary cache - by fa1rid - 08-01-2020, 09:49 PM
RE: Copy and reuse dictionary cache - by fa1rid - 08-01-2020, 09:50 PM
RE: Copy and reuse dictionary cache - by royce - 08-01-2020, 09:53 PM
RE: Copy and reuse dictionary cache - by fa1rid - 08-01-2020, 11:37 PM
RE: Copy and reuse dictionary cache - by fa1rid - 08-06-2020, 05:30 AM
RE: Copy and reuse dictionary cache - by royce - 08-06-2020, 05:49 AM
RE: Copy and reuse dictionary cache - by fa1rid - 08-06-2020, 06:00 AM
RE: Copy and reuse dictionary cache - by fa1rid - 08-11-2020, 01:38 PM
RE: Copy and reuse dictionary cache - by royce - 08-11-2020, 05:59 PM
RE: Copy and reuse dictionary cache - by fa1rid - 08-11-2020, 09:26 PM
RE: Copy and reuse dictionary cache - by pdoctor - 08-12-2020, 11:50 AM
RE: Copy and reuse dictionary cache - by fa1rid - 08-16-2020, 12:58 AM
RE: Copy and reuse dictionary cache - by royce - 08-16-2020, 01:26 AM
RE: Copy and reuse dictionary cache - by undeath - 08-16-2020, 12:43 PM
RE: Copy and reuse dictionary cache - by fa1rid - 08-16-2020, 09:43 PM