uchardet/script/BuildLangModelLogs
Jehan 41d309e8a2 script, src: regenerate Russian models and add UTF-8/Russian support.
This fixes the broken Russian test in Windows-1251 which once again gets
a much better score with Russian. Also this adds UTF-8 support.

Same as Bulgarian, I wonder why I had not regenerated this earlier.

The new UTF-8 test comes from the 'Сурки' page of Wikipedia in Russian.

Note that now this broke the test zh:gb18030 (the score for KOI8-R / ru
(0.766388) beats GB18030 / zh (0.700000)). I think I'll have to look a
bit closer at our GB18030 dedicated prober.
2022-12-17 21:41:11 +01:00
..
LangArabicModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangBelarusianModel.log script, src, test: adding Belarusian support. 2022-12-17 19:13:03 +01:00
LangBulgarianModel.log script, src, test: Bulgarian language models added. 2022-12-17 18:41:00 +01:00
LangCroatianModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangCzechModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangDanishModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangEnglishModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangEsperantoModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangEstonianModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangFinnishModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangFrenchModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangGermanModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangGreekModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangHebrewModel.log Issue #22: Hebrew CP862 support. 2022-12-16 23:27:52 +01:00
LangHindiModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangHungarianModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangIrishModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangItalianModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangKoreanModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangLatvianModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangLithuanianModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangMalteseModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangNorwegianModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangPolishModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangPortugueseModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangRomanianModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangRussianModel.log script, src: regenerate Russian models and add UTF-8/Russian support. 2022-12-17 21:41:11 +01:00
LangSlovakModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangSloveneModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangSpanishModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangSwedishModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangThaiModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangTurkishModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00
LangUkrainianModel.log script, src, test: add Ukrainian support. 2022-12-17 21:40:56 +01:00
LangVietnameseModel.log src: all language models now rebuilt after the fix. 2022-12-15 14:31:55 +01:00