Jehan
|
ba7d72e3b0
|
script: regenerate Slovak and Slovene with better alphabet support.
I was missing some characters, especially in the Slovak alphabet.
Oppositely the Slovene alphabet does not use 4 of the common ASCII
alphabet.
|
2022-12-14 00:24:53 +01:00 |
|
Jehan
|
eb8308d50a
|
src, script: regenerate all existing language models.
Now making sure that we have a generic language model working with UTF-8
for all 26 supported models which had single-byte encoding support until
now.
|
2022-12-14 00:23:13 +01:00 |
|
Jehan
|
d62154bd6e
|
LangModels: add Slovene support.
Encodings: ISO-8859-2, ISO-8859-16, Windows-1250, IBM852 and
MAC-CENTRALEUROPE.
Test text from https://sl.wikipedia.org/wiki/Naseljivi_planet
|
2016-09-28 22:13:17 +02:00 |
|