coffee/uchardet
1
0
Fork 0
mirror of https://gitlab.freedesktop.org/uchardet/uchardet.git synced 2025-12-24 12:44:46 +08:00
Code Issues Packages Projects Releases Wiki Activity
uchardet/src
History
Jehan 911695f682 src: new API to get the detected language. 
This doesn't work for all probers yet, in particular not for the most
generic probers (such as UTF-8) or WINDOWS-1252. These will return NULL.
It's still a good first step.

Right now, it returns the 2-character language code from ISO 639-1. A
using project could easily get the English language name from the
XML/json files provided by the iso-codes project. This project will also
allow to easily localize the language name in other languages through
gettext (this is what we do in GIMP for instance). I don't add any
dependency though and leave it to downstream projects to implement this.

I was also wondering if we want to support region information for cases
when it would make sense. I especially wondered about it for Chinese
encodings as some of them seem quite specific to a region (according to
Wikipedia at least). For the time being though, these just return "zh".
We'll see later if it makes sense to be more accurate (maybe depending
on reports?).
2021-03-14 00:12:30 +01:00
..
LangModels src: new API to get the detected language. 2021-03-14 00:12:30 +01:00
tools src: new option --verbose|-V in the uchardet CLI tool. 2021-03-14 00:12:30 +01:00
Big5Freq.tab Initial release. 2011-07-10 15:04:42 +08:00
CharDistribution.cpp Update code from upstream. 2011-07-11 14:42:50 +08:00
CharDistribution.h uchardet_get_charset() must return iconv-compatible names. 2015-11-17 16:15:21 +01:00
CMakeLists.txt Add dllexport to interface functions 2020-04-22 18:54:07 +00:00
EUCKRFreq.tab Initial release. 2011-07-10 15:04:42 +08:00
EUCTWFreq.tab Fix global-buffer-overflow due EUCTW_TABLE_SIZE 2020-04-22 17:06:40 +00:00
GB2312Freq.tab Initial release. 2011-07-10 15:04:42 +08:00
JISFreq.tab Initial release. 2011-07-10 15:04:42 +08:00
JpCntx.cpp Fixes boolean operation precedence warnings... 2015-11-18 19:38:12 +01:00
JpCntx.h Update code from upstream. 2011-07-11 14:42:50 +08:00
nsBig5Prober.cpp Bug 101032 - assignments to nsSMState in nsCodingStateMachine result... 2017-05-28 20:01:06 +02:00
nsBig5Prober.h src: new API to get the detected language. 2021-03-14 00:12:30 +01:00
nsCharSetProber.cpp src: cast value to its proper type. 2017-08-27 13:01:30 +02:00
nsCharSetProber.h src: new API to get the detected language. 2021-03-14 00:12:30 +01:00
nsCodingStateMachine.h Bug 101032 - assignments to nsSMState in nsCodingStateMachine result... 2017-05-28 20:01:06 +02:00
nscore.h Update code from upstream. 2011-07-11 14:42:50 +08:00
nsEscCharsetProber.cpp Bug 101032 - assignments to nsSMState in nsCodingStateMachine result... 2017-05-28 20:01:06 +02:00
nsEscCharsetProber.h src: new API to get the detected language. 2021-03-14 00:12:30 +01:00
nsEscSM.cpp Bug 101030 - Buffer overflow related to ISO2022JP detection in... 2017-05-14 19:49:01 +02:00
nsEUCJPProber.cpp Bug 101032 - assignments to nsSMState in nsCodingStateMachine result... 2017-05-28 20:01:06 +02:00
nsEUCJPProber.h src: new API to get the detected language. 2021-03-14 00:12:30 +01:00
nsEUCKRProber.cpp Bug 101032 - assignments to nsSMState in nsCodingStateMachine result... 2017-05-28 20:01:06 +02:00
nsEUCKRProber.h src: new API to get the detected language. 2021-03-14 00:12:30 +01:00
nsEUCTWProber.cpp Bug 101032 - assignments to nsSMState in nsCodingStateMachine result... 2017-05-28 20:01:06 +02:00
nsEUCTWProber.h src: new API to get the detected language. 2021-03-14 00:12:30 +01:00
nsGB2312Prober.cpp Bug 101032 - assignments to nsSMState in nsCodingStateMachine result... 2017-05-28 20:01:06 +02:00
nsGB2312Prober.h src: new API to get the detected language. 2021-03-14 00:12:30 +01:00
nsHebrewProber.cpp s/windows-1255/WINDOWS-1255/ to follow iconv uppercase naming. 2015-11-18 03:21:34 +01:00
nsHebrewProber.h src: new API to get the detected language. 2021-03-14 00:12:30 +01:00
nsLatin1Prober.cpp Update code from upstream. 2011-07-11 14:42:50 +08:00
nsLatin1Prober.h src: new API to get the detected language. 2021-03-14 00:12:30 +01:00
nsMBCSGroupProber.cpp src: new API to get the detected language. 2021-03-14 00:12:30 +01:00
nsMBCSGroupProber.h src: new API to get the detected language. 2021-03-14 00:12:30 +01:00
nsMBCSSM.cpp uchardet_get_charset() must return iconv-compatible names. 2015-11-17 16:15:21 +01:00
nsPkgInt.h Update code from upstream. 2011-07-11 14:42:50 +08:00
nsSBCharSetProber.cpp src: new API to get the detected language. 2021-03-14 00:12:30 +01:00
nsSBCharSetProber.h src: new API to get the detected language. 2021-03-14 00:12:30 +01:00
nsSBCSGroupProber.cpp src: new API to get the detected language. 2021-03-14 00:12:30 +01:00
nsSBCSGroupProber.h src: new API to get the detected language. 2021-03-14 00:12:30 +01:00
nsSJISProber.cpp Bug 101032 - assignments to nsSMState in nsCodingStateMachine result... 2017-05-28 20:01:06 +02:00
nsSJISProber.h src: new API to get the detected language. 2021-03-14 00:12:30 +01:00
nsUniversalDetector.cpp src: new API to get the detected language. 2021-03-14 00:12:30 +01:00
nsUniversalDetector.h src: new API to get the detected language. 2021-03-14 00:12:30 +01:00
nsUTF8Prober.cpp Bug 101032 - assignments to nsSMState in nsCodingStateMachine result... 2017-05-28 20:01:06 +02:00
nsUTF8Prober.h src: new API to get the detected language. 2021-03-14 00:12:30 +01:00
prmem.h Initial release. 2011-07-10 15:04:42 +08:00
symbols.cmake src: new API to get the detected language. 2021-03-14 00:12:30 +01:00
uchardet.cpp src: new API to get the detected language. 2021-03-14 00:12:30 +01:00
uchardet.h src: new API to get the detected language. 2021-03-14 00:12:30 +01:00