coffee/uchardet
1
0
Fork 0
mirror of https://gitlab.freedesktop.org/uchardet/uchardet.git synced 2025-12-08 01:36:41 +08:00
Code Issues Packages Projects Releases Wiki Activity
47 Commits 5 Branches 7 Tags 1.7 MiB
C++ 71.8%
Python 24.6%
C 2.4%
CMake 1%
Berry 0.2%
Go to file
Jehan 0efcdfa546 Reorganize test files in language subdirectories. 
I realize that the language information a text has been written in is
very important since it would completely change the character
distribution. Our test files should take this into account, and we
should create several test files in different languages for encoding
used in various languages.
2015-11-17 21:12:39 +01:00
build-mac Added shared scheme 2014-10-26 00:24:03 -07:00
doc Fix a wrong spell in manpage. 2011-07-11 18:15:58 +08:00
script Add authors. 2011-07-13 20:16:23 +08:00
src Some more encoding names changed to be iconv-compatible. 2015-11-17 18:51:45 +01:00
test Reorganize test files in language subdirectories. 2015-11-17 21:12:39 +01:00
AUTHORS Add authors. 2011-07-13 20:16:23 +08:00
CMakeLists.txt Add a BUILD_STATIC CMake option to optionally build a static library. 2015-11-17 18:14:51 +01:00
COPYING Add authors. 2011-07-13 20:16:23 +08:00
INSTALL Add description of installation. 2011-07-11 23:14:57 +08:00
README.md Add TIS-620 in README (Thai language) and a test file. 2015-11-17 17:39:45 +01:00
uchardet.pc.in Refine Description in pkgconfig file 2015-09-21 09:37:36 +08:00

README.md

uchardet

uchardet is a C language binding of the original C++ implementation of the universal charset detection library by Mozilla.

uchardet is an encoding detector library, which takes a sequence of bytes in an unknown character encoding without any additional information, and attempts to determine the encoding of the text. Returned encoding names are iconv-compatible.

The original code of universalchardet is available at http://lxr.mozilla.org/seamonkey/source/extensions/universalchardet/

Techniques used by universalchardet are described at http://www.mozilla.org/projects/intl/UniversalCharsetDetection.html

Supported Encodings

  • Unicode
    • UTF-8
    • UTF-16BE / UTF-16LE
    • UTF-32BE / UTF-32LE / X-ISO-10646-UCS-4-34121 / X-ISO-10646-UCS-4-21431
  • Chinese
    • ISO-2022-CN
    • BIG5
    • EUC-TW
    • GB18030
    • HZ-GB-2312
  • Japanese
    • ISO-2022-JP
    • SHIFT_JIS
    • EUC-JP
  • Korean
    • ISO-2022-KR
    • EUC-KR
  • Cyrillic
    • ISO-8859-5
    • KOI8-R
    • WINDOWS-1251
    • MACCYRILLIC
    • IBM866
    • IBM855
  • Greek
    • ISO-8859-7
    • WINDOWS-1253
  • Hebrew
    • ISO-8859-8
    • WINDOWS-1255
  • Thai
    • TIS-620
  • Others
    • WINDOWS-1252

Installation

Ubuntu/Debian

apt-get install uchardet libuchardet-dev

Mac

brew install uchardet

Build from source

cmake .
make
make install

Usage

Command Line

uchardet Command Line Tool
Version 0.0.2

Author: BYVoid
Bug Report: http://code.google.com/p/uchardet/issues/entry

Usage:
 uchardet [Options] [File]

Options:
 -v, --version         Print version and build information.
 -h, --help            Print this help.

Library

See uchardet.h

Related Projects

License

Mozilla Public License Version 1.1