mirror of
https://gitlab.freedesktop.org/uchardet/uchardet.git
synced 2025-12-12 14:40:06 +08:00
f8752f2b56
This allows to handle cases where some characters are actually alternative/variants of another. For instance, a same word can be written with both variants, while both are considered correct and equivalent. Browsing a bit Slovenian Wikipedia, it looks like they only use them for titles there. I use this the first time on characters with diacritics in Slovene. Indeed these are so rarely used that they would hardly show in the stats and worse, any sequence using these in tested text would likely show as negative sequences hence drop the confidence in Slovenian. As a consequence, various Slovene text would show up as Slovak as it's close enough and contains the same character with diacritics in a common way. |
||
|---|---|---|
| .. | ||
| LangArabicModel.cpp | ||
| LangBulgarianModel.cpp | ||
| LangCroatianModel.cpp | ||
| LangCzechModel.cpp | ||
| LangDanishModel.cpp | ||
| LangEsperantoModel.cpp | ||
| LangEstonianModel.cpp | ||
| LangFinnishModel.cpp | ||
| LangFrenchModel.cpp | ||
| LangGermanModel.cpp | ||
| LangGreekModel.cpp | ||
| LangHebrewModel.cpp | ||
| LangHindiModel.cpp | ||
| LangHungarianModel.cpp | ||
| LangIrishModel.cpp | ||
| LangItalianModel.cpp | ||
| LangLatvianModel.cpp | ||
| LangLithuanianModel.cpp | ||
| LangMalteseModel.cpp | ||
| LangPolishModel.cpp | ||
| LangPortugueseModel.cpp | ||
| LangRomanianModel.cpp | ||
| LangRussianModel.cpp | ||
| LangSlovakModel.cpp | ||
| LangSloveneModel.cpp | ||
| LangSpanishModel.cpp | ||
| LangSwedishModel.cpp | ||
| LangThaiModel.cpp | ||
| LangTurkishModel.cpp | ||
| LangVietnameseModel.cpp | ||