mirror of
https://gitlab.freedesktop.org/uchardet/uchardet.git
synced 2025-12-06 16:56:40 +08:00
ded948ce15
The Hebrew Model had never been regenerated by my scripts. I now added the base generation files. Note that I added 2 charsets: ISO-8859-8 and WINDOWS-1255 but they are nearly identical. One of the difference is that the generic currency sign is replaced by the sheqel sign (Israel currency) in Windows-1255. And though this one lost the "double low line", apparently some Yiddish characters were added. Basically it looks like most Hebrew text would work fine with the same confidence on both charsets and detecting both is likely irrelevant. So I keep the charset file for ISO-8859-8, but won't actually use it. The good part is now that Hebrew is also recognized in UTF-8 text thanks to the new code and newly generated language model. |
||
|---|---|---|
| .. | ||
| codepoints.py | ||
| db.py | ||
| ibm852.py | ||
| ibm865.py | ||
| iso-8859-1.py | ||
| iso-8859-2.py | ||
| iso-8859-3.py | ||
| iso-8859-4.py | ||
| iso-8859-6.py | ||
| iso-8859-7.py | ||
| iso-8859-8.py | ||
| iso-8859-9.py | ||
| iso-8859-10.py | ||
| iso-8859-11.py | ||
| iso-8859-13.py | ||
| iso-8859-15.py | ||
| iso-8859-16.py | ||
| mac-centraleurope.py | ||
| tis-620.py | ||
| viscii.py | ||
| windows-1250.py | ||
| windows-1252.py | ||
| windows-1253.py | ||
| windows-1255.py | ||
| windows-1256.py | ||
| windows-1257.py | ||
| windows-1258.py | ||