coffee/uchardet
1
0
Fork 0
mirror of https://gitlab.freedesktop.org/uchardet/uchardet.git synced 2025-12-10 19:06:42 +08:00
Code Issues Packages Projects Releases Wiki Activity
289 Commits 5 Branches 7 Tags 1.7 MiB
Commit Graph

3 Commits

Author SHA1 Message Date
Jehan
5c3a2e8037 src, script: regenerate all existing language models. 
Now making sure that we have a generic language model working with UTF-8
for all 26 supported models which had single-byte encoding support until
now.
 2021-03-17 02:07:17 +01:00
Jehan
98b5e52252 LangModels: add VISCII encoding support and retrain Vietnamese model. 2016-02-13 03:51:18 +01:00
Jehan
178c6119b8 LangModels: add Windows-1258 support for Vietnamese. 
I was planning on adding VISCII support as well, but Python encode()
method does not have any support for it apparently, so I cannot generate
the proper statistics data with the current version of the string.
 2016-02-13 02:32:57 +01:00