coffee/uchardet
1
0
Fork 0
mirror of https://gitlab.freedesktop.org/uchardet/uchardet.git synced 2025-12-07 01:06:40 +08:00
Code Issues Packages Projects Releases Wiki Activity
317 Commits 5 Branches 7 Tags 1.7 MiB
Commit Graph

3 Commits

Author SHA1 Message Date
Jehan
5c3a2e8037 src, script: regenerate all existing language models. 
Now making sure that we have a generic language model working with UTF-8
for all 26 supported models which had single-byte encoding support until
now.
 2021-03-17 02:07:17 +01:00
Jehan
b7aebfdfda LangModels: add support for Latvian | Lithuanian / ISO-8859-4 | ISO-8859-10. 
Just realizing that these 2 language can also be encoded with these
charsets (even though ISO-8859-13 would appear to be more common…
maybe?). Anyway now the models are updated and can recognize texts
using these encoding for these languages.
Added some test files as well, which work great.
 2016-09-21 00:27:16 +02:00
Jehan
ea2f4dd40f LangModels: new support for Latvian / ISO-8859-13. 
Test text extracted from: https://lv.wikipedia.org/wiki/Vinsents_van_Gogs
 2016-09-20 23:29:53 +02:00