coffee/uchardet
1
0
Fork 0
mirror of https://gitlab.freedesktop.org/uchardet/uchardet.git synced 2025-12-12 06:30:05 +08:00
Code Issues Packages Projects Releases Wiki Activity
285 Commits 5 Branches 7 Tags 1.7 MiB
Commit Graph

3 Commits

Author SHA1 Message Date
Jehan
fb3c47a073 LangModels: add ISO-8859-11 and regenerate TIS-620 Thai models. 
ISO-8859-11 is basically exactly identical to TIS-620, with the added
non-breaking space character.
Basically our detection will always return TIS-620 except for
exceptional cases when a text has a non-breaking space.
 2015-12-04 03:14:52 +01:00
Jehan
f303a41735 Add Thai test file for UTF-8. 
Text from Thai Wikipedia:
https://th.wikipedia.org/wiki/ยูนิโคด
 2015-11-18 03:26:34 +01:00
Jehan
0efcdfa546 Reorganize test files in language subdirectories. 
I realize that the language information a text has been written in is
very important since it would completely change the character
distribution. Our test files should take this into account, and we
should create several test files in different languages for encoding
used in various languages.
 2015-11-17 21:12:39 +01:00