coffee/uchardet
1
0
Fork 0
mirror of https://gitlab.freedesktop.org/uchardet/uchardet.git synced 2025-12-06 16:56:40 +08:00
Code Issues Packages Projects Releases Wiki Activity

test: adding 2 tests for Hebrew/IBM862 recognition.

Browse Source 
This is the same text, taken from this Wikipedia page, which was today's
page of honor on Wikipedia in Hebrew:
https://he.wikipedia.org/wiki/שתי מסכתות על ממשל מדיני

I put it in 2 variants, since IBM862 can be used in logical and visual
variants. The visual variant is just about inverting orders of letters
(per lines, while lines stay in proper order), so that's what I did.
Though note that the English title quoted in the text should likely not
have been reverted, but it doesn't matter too much since anyway these
are off-Hebrew alphabet and would trigger bad sequence score, whichever
their order. So I didn't bother fixing these.
This commit is contained in:
Jehan 2022-12-16 23:28:28 +01:00
parent 0974920bdd
commit 6d31689632
2 changed files with 2 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
test/he/ibm862.logical.txt Normal file
View File

@ -0,0 +1 @@
™š‰ Ž‘‹š…š ’Œ ŽŽ™Œ Žƒ‰<C692>‰ (<28>€<EFBFBD>‚Œ‰š: Two Treatises of Government) „…€ ‡‰<E280A1>…˜ ”‰Œ…‘…”‰-”…Œ‰ˆ‰ Ž€š „„…‚„ „€<E2809E>‚Œ‰ ‚'…<> Œ…—, ™”…˜‘<CB9C> <20>’‰Œ…<C592> ™<> <20>-1689.[1] „‡‰<E280A1>…˜ Ž…˜‹<CB9C> Ž™<C5BD>‰ ‡Œ—‰<E28094> (Ž‘‹š…š). <20>Ž‘‹š „˜€™…<E284A2>„ Œ…— Ž<>—™ Œ„”˜‰Š €š „ˆ‰’…<E28099> ™„–‰‚ ˜…<CB9C>˜ˆ ”‰ŒŽ˜ <20>‘”˜… "”ˆ˜‰€˜‹„". Œ…— Ž<>—˜ <20>Ž‘‹š †… €š ˆ‰’…<E28099>‰… ™Œ ”‰ŒŽ˜ Œ‚<C592>‰ „Œ‚‰ˆ‰…Ž‰…š ™Œ ŽŒ…‹„ €<>‘…Œ…ˆ‰š, €š ˜’‰…<E280B0> †‹…š<E280A6> „€Œ…„‰š ™Œ ŽŒ‹‰<E280B9> …€š „‚‰™„ Œ”‰„ —‰‰Žš „Ž™‹‰…š <20>‰<EFBFBD> ™Œˆ…<CB86> „€<E2809E> <20>Ž™”‡„ Œ<>‰<EFBFBD> ™Œˆ…<CB86> Žƒ‰<C692>‰ „’…<E28099>˜ <20>‰˜…™„. <20>Ž‘‹š „™<E2809E>‰‰„ Ž–‰‚ Œ…— €š ‚‰™š… Œ‚<C592>‰ Ž—…˜ „ŽŽ™Œ „Žƒ‰<C692>‰, š‹Œ‰š… ™Œ ™Œˆ…<CB86> Œ‚‰ˆ‰Ž‰ …‚<E280A6>…Œ…š ‘Ž‹…š….

1
test/he/ibm862.visual.txt Normal file
View File

@ -0,0 +1 @@
.…š…‹Ž‘ š…Œ…<C592>‚… ‰Ž‰ˆ‰‚Œ <20>…ˆŒ™ Œ™ …š‰Œ‹š ,‰<>‰ƒŽ„ Œ™ŽŽ„ ˜…—Ž ‰<>‚Œ …š™‰‚ š€ —…Œ ‚‰–Ž „‰‰<E280B0>™„ š‹‘Ž<E28098> .„™…˜‰<CB9C> ˜<>…’„ ‰<>‰ƒŽ <20>…ˆŒ™ <20>‰<EFBFBD>Œ „‡”™Ž<E284A2> <20>€„ <20>…ˆŒ™ <20>‰<EFBFBD> š…‰‹™Ž„ šŽ‰‰— „‰”Œ „™‰‚„ š€… <20>‰‹ŒŽ Œ™ š‰„…Œ€„ <20>š…‹† <20>…‰’˜ š€ ,š‰ˆ…Œ…‘<E280A6>€ „‹…ŒŽ Œ™ š…‰Ž…‰ˆ‰‚Œ„ ‰<>‚Œ ˜ŽŒ‰” Œ™ …‰<E280A6>…’‰ˆ š€ …† š‹‘Ž<E28098> ˜—<CB9C>Ž —…Œ ."„‹˜€‰˜ˆ”" …˜”‘<E2809D> ˜ŽŒ‰” ˆ˜<CB86>…˜ ‚‰–„™ <20>…’‰ˆ„ š€ Š‰˜”„Œ ™—<E284A2>Ž —…Œ „<>…™€˜„ š‹‘Ž<E28098> .)š…š‹‘Ž( <20>‰—Œ‡ ‰<>™Ž <20>‹˜…Ž ˜…<CB9C>‰‡„ ]1[.9861-<2D> <20>™ <20>…Œ‰’<E280B0> <20>‘˜…”™ ,—…Œ <20>…\'‚ ‰Œ‚<C592>€„ „‚…„„ š€Ž ‰ˆ‰Œ…”-‰”…‘…Œ‰” ˜…<CB9C>‰‡ €…„ )tnemnrevoG fo sesitaerT owT :š‰Œ‚<C592>€<EFBFBD>( ‰<>‰ƒŽ Œ™ŽŽ Œ’ š…š‹‘Ž ‰š™