coffee/uchardet
1
0
Fork 0
mirror of https://gitlab.freedesktop.org/uchardet/uchardet.git synced 2025-12-07 01:06:40 +08:00
Code Issues Packages Projects Releases Wiki Activity
317 Commits 5 Branches 7 Tags 1.7 MiB
Commit Graph

3 Commits

Author SHA1 Message Date
Jehan
5c3a2e8037 src, script: regenerate all existing language models. 
Now making sure that we have a generic language model working with UTF-8
for all 26 supported models which had single-byte encoding support until
now.
 2021-03-17 02:07:17 +01:00
Jehan
b7aebfdfda LangModels: add support for Latvian | Lithuanian / ISO-8859-4 | ISO-8859-10. 
Just realizing that these 2 language can also be encoded with these
charsets (even though ISO-8859-13 would appear to be more common…
maybe?). Anyway now the models are updated and can recognize texts
using these encoding for these languages.
Added some test files as well, which work great.
 2016-09-21 00:27:16 +02:00
Jehan
7cb3dd9ddd LangModels: add support for Lithuanian / ISO-8859-13. 
Test text extracted from https://lt.wikipedia.org/wiki/Vincent_van_Gogh.
 2016-09-20 23:09:24 +02:00