hcstatgen not making 32.1MB files

[epixoip]

yeah, that's it. what you sent me in pm was \x95\x66\x1a so it looks like you were just missing the fourth byte there. 0x0a is the newline character.

[epixoip]

i wonder if it's actually supposed to be \u9566\u1A0D

edit: yes, i do believe that's what it is, two chinese or thai or some asiany characters encoded as utf16le.

printf '\x95\x66\x1A\x0D' | iconv -f utf16le
æš•à´š

[Hash-IT]

I hope you are not asking me because I have no idea about anything beyond my first post on this thread !

[epixoip]

naw, just trying to get all the information necessary to reproduce.

[Hash-IT]

naw, just trying to get all the information necessary to reproduce.

If you want to reproduce it better I would use the latest beta as it tells you which line that character is on. The current hcstatgen.exe 0.9 just finishes quickly.

[atom]

Please add a ticket for this

[Hash-IT]

Please add a ticket for this

Done, with link back to this thread.

epixoip have you been able to reproduce it ?

[undeath]

æš•à´š

that does not look like it is meant to be utf16. While the first character is chinese the second is not. Looks more like arabic.

[epixoip]

it may not be utf16, but the second character is definitely not arabic. unicode table states that it's a buginese character. the first character is listed as C/J/K (chinese, japanese, korean) since a lot of asian languages use chinese characters for words, even if they do not speak chinese. the bugis are very closely related to the chinese, so it's not implausible that some bugis use chinese characters as well.

[epixoip]

note that none of this is strictly relevant to reproducing the bug since we have the byte stream