Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions corpus/generated/ASCII/en/validation/ascii.bin
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
!"#$%&'()*+,-./0123456789:;<=>?@ABCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyz{|}~
2 changes: 2 additions & 0 deletions corpus/generated/Big5/zh/validation/big5.bin
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
�F����T����`�ʿ줽�ǩM�������|�e���|�X��L��ê�����ų\�p���A�Ʊ�z�L�����ĥεL��ê�����]�p�������A���ʧ�h���~�M���c�b������ĥεL��ê�����]�p�A�����|�U���h�]�A�ݯe�H�h���K�a������W��T�M�ϥκ��W�A�ȡC�L��ê�����ų\�p���{����§�N��2013�~4��15���|��A�������|�쪺�u���IT�סv����m���ʤ��@�C�����Ա��A���s���o�̡C
�F���@�V�P�O���ʪ��̦b�ͬ��W��s�x���θ�T��ޡC�F����T����`�ʿ줽�Ǥw�}�i�@������ʹų\�p���u�������̹ų\�p���v�A�����b��`�ͬ����n���ϥθ�T�γq�T��ު����̡A�H���y�L���~��ϥθ�T�γq�T��ޡC�ų\�p���]�����B�ȡB�ɼ��A���̩�S�w�����������w�n�D�A�i��{�عų\�ҮѤμ��P�C�����Ա��A���s���o�̡C
10 changes: 10 additions & 0 deletions corpus/generated/EUC-JP/ja/validation/euc-jp.bin
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
�Ѹ��¾��¿���Υ衼���åѸ��줬���äƤ���̾��γ��Ѳ���ư��ο;��Ѳ��ΤۤȤ�ɤ򼺤ä����ᡢʸ��γʴط���ï��ï�˲���ɤ����뤫�ˤ���˰�¸���Ƥ��ꡢ�������äƸ�礬����Ū�Ǥ����ʸ���פ��Ϥä��ꤷ�Ƥ��롣
���ܤαѸ춵��Ǥ�C��T�����˥��󥺤��󾧤���5ʸ���Ȥ����ͤ������Ѹ�δ���ʸ���Ȥ��ƹ����Ȥ��Ƥ���ʼºݤˤϡ�5�Ĥ�ʸ���ǤϤ��ޤ������Ǥ��ʤ�ʸ��¸�ߤ���Ȥ���5ʸ����Ĵ�������뤳�Ȥ��ѤäƳؽ���˸���ˤʤ롢�Ȥ�����ĥ���������ʤ��ˡ�
5ʸ���ϡ���ʸ���濴��ʤ����Ҹ���ʬ�ˤ����ơ����ֻ�̵���˸���¤٤�������ʸ���Ǥ������äƤ���ʪ��ʬ�ष����Τȸ����롣�����ǻȤ��Ƥ����ϼ��Ȥ��Ƥ�̾�졢¸�ߤ�����Ҹ�Ȥ��Ƥ�beư�졢���Ѥ�����Ҹ�Ȥ��Ƥΰ���ư�졢������������֤�������ƻ졢����ư�����Ū��ˤʤ�̾�졢������Ū����Ф�������Ū�ʽҸ�ˤʤ�ư��θ�����̾�����ƻ�Ǥ��롣���Τ褦��5ʸ���ϼ���ư��ȡ����ֻ�̵�����¤�̾��Ȥ���̾����Ф�������Ū�ʽҸ�Ȥ����¤�ñ��ʷ��Ȥ����¤�줿��ʬ�ˤ����ơ��¤����μ���ˤ�ä�ʬ�ष5�Ĥη��ˤޤȤ᤿ʪ�ȸ����롣�����ˤ�ʸ������ܤǤ�����ȽҸ�˴ޤޤ�Ƥ����̣�ؤιͻ����ʤ���Ƥ��ʤ������Τ����̣�˴�Ť��Ƹ��դ���Ѥ��褦�Ȥ��Ƥ���ؽ��ԤˤϤ����ä�˸���ȤʤäƤ���ΤǤ��롣
����ޤǤϲ�����ʸ�������פ��Ľ��פʤ�ΤǤ���Ȥ��ư����Ƥ�������ʸ�ι�¤��ʬ��ˡ�Ȥ��Ƥ�5ʸ�������ܰʳ��ι�ǤϤ��ޤ����Ū�ǤϤʤ�����ư��θ�ˡ�����������Ǥϡ��ִ���5ʸ���פ�١����Ȥ���ư�췿��ʬ�ब����Ū�˼���������Ƥ��ơ������˥������¼�ŵ��Oxford Advanced Leaner's Dictionary ����¿���θ��Ҥ��뼭��ˤ������Ѷ�Ū�˺��Ѥ���Ƥ��롣
�̾�ʹԷ���ʸ����2ʸ���Ȥϸ��ʤ�����ư����ʬ��ñ���ʤɼ��˹�碌�����ˤ���ʸ����ͤ��롣�ޤ���λ����Ʊ�ͤǤ��롣�ޤ���ư�֤�ʸ��5ʸ�������ƤϤޤ�ʤ�����ư���ޤ�ʸ�Ϸ�ư�����Τ�1�Ĥ�ư��ȹͤ��뤳�Ȥ�¿�����ޤ�����ư��Ͻ�ư�����ư�줬ͻ�礷����ΤǤ���Τǡ����̤ʷ��ν�ư��Ȥ��ư����Ф褤�� ���⤽��5ʸ���Ͻ�ư����������ȽҸ����ʬ�ˤ����Ƹ���¤Ӥ����ˤ�ä�ʬ�ष��ʪ�ʤΤǤ��롣
���ɥ�ա������������ղø�A (Adverbial) ��ä����ͤ������󾧤��Ƥ��롣�ղø�A�Ͻ�����M�Ȥϰۤʤ��ά���뤳�Ȥ��Ǥ��ʤ������ιͤ��ǤϽ����5ʸ����SVA��SVOA�Ȥ���ʸ�����ä�롣�ޤ���2ʸ���Τ���V��beư��ξ������̤˰����ͤ��⤢��ʤĤޤ�S be C�ˡ��ޤ� A��S���ۡ���ӡ�����3ʸ������4ʸ������5ʸ����O��C��������ʬ���ư̾���that��ξ��ʤɤǺ٤���ʬ�ष��ʸ�����󾧤��Ƥ��롣

����ޥ�Ϥ�ñ��Τۤ��ˡ���ƥ�Ϥ�ñ��⺮�����Ƥ��뤬������ϡ��Υ�ޥ󡦥��󥯥����Ȱʹߡ��ե�󥹤����褿��²���餬���ޥ󥹽���Υ������ϤΥΥ�ޥ����ä��Ƥ������Ȥαƶ��Ǥ���ʻ���Ū�ˤ� 11�����ʹߤǡ���Ѹ�ˡ��Ѹ��̾�������ʤ��ܾۤ��Ǥ��ơ������Ѳ���ۤ��Υ衼���åѸ����٤ƤȤƤ⾯�ʤ��ΤϤ��ΥΥ�ޥ󡦥��󥯥����Ȥˤ�äƤǤ��롣���������ʣ���Ǥ��ä������ꥹ�θ��줬�������ꥹ�ε�²����������Ԥ䶵�դ��Υ�ޥ�ͤˤʤ�Ѹ���ä��ʤ��ʤä���̡���̱�δ֤Ǵ�ñ���ä���褦�˴��Dz�����Ƥ��ä�������ȤȤ�˵�²����䥸����ȥ꡼���ե�󥹸�ˤ�ᤤ�Υ�ޥ����ä��������Ԥ���ƥ����ä��褦�ˤʤꤽ�η�̤Ȥ���¿���Υ�ƥ���ե�󥹸����Ѥ���뤳�Ȥˤʤä���

���ʥ��ϸ����ο�̱�ϤǤ��ä��ϰ���������α��ο�̱�Ϥˤ�������ϥ̡��٥�ե�󥹤Ǥ��ꡢ���Ǥ�ե�󥹸줬�Ȥ��³���Ƥ��륱�٥å��������뤳�Ȥ��顢���ʥ����Τθ��Ѹ�Ȥ��ƱѸ�ȥե�󥹸��ξ�������ꤵ��Ƥ��ꡢϢˮ���ܤΥ����Ȥ��Ȥξ��������ʤɤ����Ʊ�ʩξ����ǹԤ��Ƥ��롣����Τι�Ȥ��Ƥϡ����͸����⡢�Ѹ�����Ȥ���ͤγ���58%���㤯���ե�󥹸줬22%�����롣����ϡ���̱������¿�������������Ȥ��ƱѸ����Ѥ��Ƥ���͸�������¿������Ǥ��롣�ޤ�������ꥫ�罰���٤˰��֤��Ƥ��뤳�Ȥ��顢����ΤǤ���ȤϤ������������ȥ�ꥢ�䥤��ɤʤɤۤ��ε���ο�̱�ϤȤϰ㤤����٤�ȥ��ʥ��αѸ�ϥ����ꥹ�Ѹ���⥢��ꥫ�Ѹ�˶ᤤ����ñ����֤�Ȥ��Ƥϥ����ꥹ�Ѹ켰����Ѥ��뤳�Ȥ�¿�������٥å����Ǥϥե�󥹸줬���Ѹ�Ǥ��뤳�Ȥ��顢�Ѹ�����Ȥ����Ѹ챿��ǽ�Ϥ��⤯�ʤ��ͤ⾯�ʤ��ʤ��������٥å����ȥ˥塼�֥�󥺥����å��������󥿥ꥪ���ʳ��ǤϤۤȤ�ɥե�󥹸줬�Ȥ��ʤ����Ȥ⤢�ꡢ���ʥ��Ѹ�ˤ�����ե�󥹸�αƶ��ϳ�̵�˶ᤤ��
13 changes: 13 additions & 0 deletions corpus/generated/EUC-KR/ko/validation/euc-kr.bin
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
�⺻������ ��ǻ�ʹ� ���ڸ� ó���մϴ�. ���ڳ� �ٸ� ���ڿ��� ���ڸ� �����Ͽ� �����մϴ�. �����ڵ尡 ���ߵDZ� ������ �̷��� ���ڸ� �����ϱ� ���� ���� ������ �ٸ� ��ȣȭ �ý����� ����߽��ϴ�. ���� ��ȣȭ ������δ� ��� ���ڸ� ������ �� �������ϴ�. ���� ��� ���� ���տ����� ������ ��� �� ���� �� ó���Ϸ��� ���� ���� �ٸ� ��ȣȭ ����� �ʿ��մϴ�. ����� ���� ���� ����� ��쵵 ���������� ���Ǵ� ��� ����, ���� ��ȣ �� ��ũ���� ��ȣ�� �´� ���� ��ȣȭ ����� ���� ���� ���Ͽ����ϴ�.

�̷��� ��ȣȭ �ý����� ���� �ٸ� ��ȣȭ �ý��۰� �浹�մϴ�. �� �� ���� ��ȣȭ ����� �� ���� �ٸ� ���ڿ� ���� ���� ��ȣ�� ����ϰų� ���� ���ڿ� ���� �ٸ� ��ȣ�� ����� �� �ֽ��ϴ�. �־��� ��� ��ǻ��(Ư�� ����)�� ���� �ٸ� ���� ���� ��ȣȭ ����� �����ؾ� �մϴ�. �׷���, �����͸� ���� �ٸ� ��ȣȭ ����̳� �÷��� ���� ������ ������ �� �����ʹ� �׻� �ջ��� ������ �ް� �˴ϴ�.
�����ڵ�� ��� ���� �ذ��� �� �ֽ��ϴ�!

�����ڵ�� ��� ���� �÷���, ���α׷�, �� ������� ���ڸ��� ������ ���ڸ� �����մϴ�. �����ڵ� ǥ���� Apple, HP, IBM, JustSystem, Microsoft, Oracle, SAP, Sun, Sybase, Unisys �� ��Ÿ ���� ȸ��� ���� ���� �������ڿ� ���� ä�õǾ����ϴ�. �����ڵ�� XML, Java, ECMAScript(JavaScript), LDAP, CORBA 3.0, WML ��� ���� ���� �θ� ���Ǵ� ǥ�ؿ��� �ʿ��ϸ� �̴� ISO/IEC 10646�� �����ϴ� �������� ����Դϴ�. �̴� ���� � ü��, ���� ���Ǵ� ��� ������ �� ��Ÿ ���� ��ǰ���� �����˴ϴ�. �����ڵ� ǥ���� �λ�� �̸� �����ϴ� ������ ���뼺�� �ֱ� �� ���迡 �Ұ� �ִ� ��� ���⿡�� ���� �߿��� �κ��� �����ϰ� �ֽ��ϴ�.

�����ڵ带 Ŭ���̾�Ʈ-���� �Ǵ� ����-���� ���� ���α׷��� �� ����Ʈ�� �����ϸ� ���Ž� ���� ��Ʈ ��뿡 �־ ����� ��� ���� ȿ���� ��Ÿ���ϴ�. �����ڵ带 ���� �������Ͼ ���� ���� �÷���, ��� �� ���� ���� ���� ����Ʈ���� �÷��� �Ǵ� ���� �� ����Ʈ�� ��ǥ�� ���� �� �ֽ��ϴ�. �̸� ����ϸ� �����͸� �ջ� ���� ���� �ý����� ���� ������ �� �ֽ��ϴ�.
�����ڵ� �ܼҽþ��� ����

�����ڵ� �ܼҽþ��� �񿵸� �������μ� ���� ����Ʈ���� ��ǰ�� ǥ�ؿ��� �ؽ�Ʈ�� ǥ���� �����ϴ� �����ڵ� ǥ���� ����� �����ϰ� Ȯ���ϸ� ����ϱ� ���� ���������ϴ�. �ܼҽþ� ������� ��ǻ�Ϳ� ���� ó�� ����� �����ϰ� �ִ� �������� ȸ�� �� ������ ������ ��Ÿ���ϴ�. �ܼҽþ��� ������ �������� ȸ�� ���� ���˴ϴ�. �����ڵ� ���ҽþ������� ������� �� ���� ��� �������� �����ڵ� ǥ���� �����ϰ� �� Ȯ��� ������ �����ϰ����ϴ� ������ ���ο��� ����Ǿ� �ֽ��ϴ�.

�� �ڼ��� ������ �����, ���� �����ڵ� ��� ���� ��ǰ, ��� ���� �� ��Ÿ ������ ������ �����Ͻʽÿ�.
13 changes: 13 additions & 0 deletions corpus/generated/GB18030/zh/validation/gb18030.bin
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
�����ϣ������ֻ�Ǵ������֡�����ָ��һ�����֣���������ĸ�������ַ����ڴ���Unicode֮ǰ����������ָ����Щ���ֵı���ϵͳ��û��һ��������԰����㹻���ַ������磬����ŷ�ݹ�ͬ�����Ҫ�ü��ֲ�ͬ�ı������������е����ԡ���ʹ�ǵ�һ�����ԣ�����Ӣ�Ҳû����һ������������������е���ĸ�������ţ��ͳ��õļ������š�

��Щ����ϵͳҲ�ụ���ͻ��Ҳ����˵�����ֱ������ʹ����ͬ�����ִ���������ͬ���ַ�����ʹ�ò�ͬ�����ִ�����ͬ���ַ����κ�һ̨�ض��ļ����(�ر��Ƿ�����)����Ҫ֧�����಻ͬ�ı��룬���ǣ�����ʲôʱ������ͨ����ͬ�ı����ƽ̨֮�䣬��Щ�����ܻ����𻵵�Σ�ա�
Unicode���ڸı�������һ�У�

Unicode��ÿ���ַ��ṩ��һ��Ψһ�����֣�������ʲôƽ̨��������ʲô���򣬲���ʲô���ԡ�Unicode��׼�Ѿ�����Щ��ҵ����쵼�������ã����磺Apple, HP, IBM, JustSystem, Microsoft, Oracle, SAP, Sun, Sybase, Unisys���������๫˾�����µı�׼����ҪUnicode������XML, Java, ECMAScript (JavaScript), LDAP, CORBA 3.0, WML�ȵȣ����ң�Unicode��ʵ��ISO/IEC 10646�����淽ʽ���������ϵͳ���������µ������������������Ʒ��֧������Unicode��׼�ij��ֺ�֧�������ߵĴ��ڣ��ǽ���ȫ��������������Ҫ�ķ�չ���ơ�

��Unicode��ͻ�����������Ӧ�ó������վ��ϣ���ʹ�ô�ͳ�ַ�����ʡ���á�Unicodeʹ��һ������Ʒ��һ��վ�ܹ��ᴩ���ƽ̨�����Ժ͹��ң�������Ҫ�ؽ������ɽ����ݴ��䵽���಻ͬ��ϵͳ�������𻵡�
����Unicodeѧ��ѧ��

Unicodeѧ��ѧ����һ����ӯ������֯����Ϊ��չ����չ���ƹ�ʹ��Unicode��׼�������ģ�Unicodeѧ��ѧ���������ִ�������Ʒ�ͱ�׼�ı��ı�ʾ����ѧ��ѧ��Ļ�Ա�����˹㷺����ļ��������Ѷ��ҵ�Ĺ�˾����֯��ѧ��ѧ��ֻ�ɻ�Ա�ṩ�ʽ�Unicodeѧ��ѧ��Ļ�Ա�ʸ񿪷Ÿ��������κ�֧��Unicode��׼��ϣ��Э������չ��ִ�е���֯�����ˡ�

��֪������Ϣ�����������ʻ����Unicode��Ʒ�������������Ͳο����ϡ�
13 changes: 13 additions & 0 deletions corpus/generated/ISO-2022-CN/zh/validation/iso2022cn.bin
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
$)A;y1>IO#,<FKc;zV;JG4&@mJ}WV!#K|CGV86(R;8vJ}WV#,@44"4fWVD8;rFdK{WV7{!#TZ44TlUnicodeV.G0#,SPJ}0YVVV86(UbP)J}WV5D1`BkO5M3!#C;SPR;8v1`Bk?IRT0|:,Wc9;5DWV7{#:@}Hg#,5%5%E7V]92M,Le>MPhR*:C<8VV2;M,5D1`Bk@40|@(KySP5DSoQT!#<4J9JG5%R;VVSoQT#,@}HgS"So#,R2C;SPDDR;8v1`Bk?IRTJJSCSZKySP5DWVD8#,1j5c7{:E#,:M3#SC5D<<Ju7{:E!#

$)AUbP)1`BkO5M3R2;a;%O`3eM;!#R2>MJGK5#,A=VV1`Bk?ID\J9SCO`M,5DJ}WV4z1mA=8v2;M,5DWV7{#,;rJ9SC2;M,5DJ}WV4z1mO`M,5DWV7{!#HN:NR;L(LX6(5D<FKc;z(LX1pJG7~NqFw)6<PhR*V'3VPm6`2;M,5D1`Bk#,5+JG#,2;B[J2C4J1:rJ}>]M(9}2;M,5D1`Bk;rF=L(V.<d#,DGP)J}>]W\;aSPKp;55DN#OU!#
Unicode$)AU}TZ8D1dKySPUbR;GP#!

Unicode$)A8xC?8vWV7{La9)AKR;8vN(R;5DJ}WV#,2;B[JGJ2C4F=L(#,2;B[JGJ2C43LPr#,2;B[J2C4SoQT!#Unicode1jW<RQ>-1;UbP)9$R5=g5DAl5<CGKy2ISC#,@}Hg#:Apple, HP, IBM, JustSystem, Microsoft, Oracle, SAP, Sun, Sybase, Unisys:MFdK|Pm6`9+K>!#WnPB5D1jW<6<PhR*Unicode#,@}HgXML, Java, ECMAScript (JavaScript), LDAP, CORBA 3.0, WML5H5H#,2"GR#,UnicodeJGJ5OVISO/IEC 106465DU}9f7=J=!#Pm6`2YWwO5M3#,KySPWnPB5Dd/@@Fw:MPm6`FdK{2zF76<V'3VK|!#Unicode1jW<5D3vOV:MV'3VK|9$>_5D4fTZ#,JG=|@4H+GrHm<~<<JuWnVXR*5D7"U9GwJF!#

$)A=+UnicodeSk?M;'7~NqFw;r6`2cS&SC3LPr:MMxU>=a:O#,1HJ9SC4+M3WV7{</=ZJ!7QSC!#UnicodeJ95%R;Hm<~2zF7;r5%R;MxU>D\9;9a4)6`8vF=L(#,SoQT:M9z<R#,6x2;PhR*VX=(!#K|?I=+J}>]4+Jd5=Pm6`2;M,5DO5M3#,6xN^Kp;5!#
$)A9XSZUnicodeQ'JuQ';a

Unicode$)AQ'JuQ';aJGR;8v7GS/@{5DWiV/#,JGN*7"U9#,@)U9:MMF9cJ9SCUnicode1jW<6x=(A"5D#,UnicodeQ'JuQ';aIhA"AKOV4zHm<~2zF7:M1jW<ND1>5D1mJ>7(!#Q'JuQ';a5D;aT14z1mAK9c7:AlSr5D<FKc;z:MWJQ69$R55D9+K>:MWiV/!#Q'JuQ';aV;SI;aT1La9)WJ=p!#UnicodeQ'JuQ';a5D;aT1WJ8q?*7E8xJ@=gIOHN:NV'3VUnicode1jW<:MO#M{P-VzFd@)U9:MV4PP5DWiV/<08vHK!#

$)AS{V*8|6`PEO"#,Gk2NTDJuSo4J;c1m#,Unicode2zF7Qy1>#,<<Ju<r=i:M2N?<WJAO!#
13 changes: 13 additions & 0 deletions corpus/generated/ISO-2022-JP/ja/validation/iso2022jp.bin
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
$B%3%s%T%e!<%?!<$O!"K\<AE*$K$O?t;z$7$+07$&$3$H$,$G$-$^$;$s!#%3%s%T%e!<%?!<$O!"J8;z$d5-9f$J$I$N$=$l$>$l$KHV9f$r3d$j?6$k$3$H$K$h$C$F07$($k$h$&$K$7$^$9!#%f%K%3!<%I$,=PMh$k$^$G$O!"$3$l$i$NHV9f$r3d$j?6$k;EAH$_$,2?I4<oN`$bB8:_$7$^$7$?!#$I$N0l$D$r$H$C$F$b!"==J,$JJ8;z$r4^$s$G$O$$$^$;$s$G$7$?!#Nc$($P!"2$=#O"9g0l$D$r8+$F$b!"$=$N$9$Y$F$N8@8l$r%+%P!<$9$k$?$a$K$O!"$$$/$D$+$N0[$J$kId9f2=$N;EAH$_$,I,MW$G$7$?!#1Q8l$N$h$&$J0l$D$N8@8l$K8B$C$F$b!"0l$D$@$1$NId9f2=$N;EAH$_$G$O!"0lHLE*$K;H$o$l$k$9$Y$F$NJ8;z!"6gFIE@!"5;=QE*$J5-9f$J$I$r07$&$K$OIT==J,$G$7$?!#(B

$B$3$l$i$NId9f2=$N;EAH$_$O!"Aj8_$KL7=b$9$k$b$N$G$b$"$j$^$7$?!#Fs$D$N0[$J$kId9f2=$N;EAH$_$,!"Fs$D$N0[$J$kJ8;z$KF10l$NHV9f$rIU$1$k$3$H$b$G$-$k$7!"F1$8J8;z$K0[$J$kHV9f$rIU$1$k$3$H$b$G$-$k$N$G$9!#$I$N$h$&$J%3%s%T%e!<%?!<$b!JFC$K%5!<%P!<$O!KB?$/$N0[$J$C$?Id9f2=$N;EAH$_$r%5%]!<%H$9$kI,MW$,$"$j$^$9!#$?$H$(%G!<%?$,0[$J$kId9f2=$N;EAH$_$d%W%i%C%H%U%)!<%`$rDL2a$7$F$b!"$$$D$I$3$G%G!<%?$,Mp$l$k$+J,$+$i$J$$4m81$rKA$9$3$H$N$J$k$N$G$9!#(B
$B%f%K%3!<%I$O$9$Y$F$rJQ$($^$9(B

$B%f%K%3!<%I$O!"%W%i%C%H%U%)!<%`$K78$o$i$:!"%W%m%0%i%`$K78$o$i$:!"8@8l$K78$o$i$:!"$9$Y$F$NJ8;z$KFHN)$7$?HV9f$rM?$($^$9!#%f%K%3!<%II8=`$O!"%"%C%W%k!"%R%e!<%l%C%H%Q%C%+!<%I!"(BIBM$B!"%8%c%9%H%7%9%F%`!"%^%$%/%m%=%U%H!"%*%i%/%k!"(BSAP$B!"%5%s!"%5%$%Y!<%9$J$I$N;:6H3&$N<gF3E*4k6H$HB>$NB?$/$N4k6H$K:NMQ$5$l$F$$$^$9!#%f%K%3!<%I$O!"(BXML$B!"(BJava$B!"(BECMAScript(JavaScript)$B!"(BLDAP$B!"(BCORBA 3.0$B$J$I$N:G@hC<$NI8=`$NA0Ds$H$J$C$F$*$j!"%f%K%3!<%I$r<BAu$9$l$P!"(BISO/IEC 10646$B$KE,9g$9$k$3$H$K$J$j$^$9!#%f%K%3!<%I$O!"B?$/$N%*%Z%l!<%F%#%s%0%7%9%F%`$H$9$Y$F$N:G?7$N%V%i%&%6!<$HB>$NB?$/$N@=IJ$G%5%]!<%H$5$l$F$$$^$9!#%f%K%3!<%II8=`$N=P8=$H%f%K%3!<%I$r%5%]!<%H$9$k%D!<%kN`$O!":r:#82Cx$K$J$C$F$$$k%=%U%H%&%(%"5;=Q$N%0%m!<%P%k2=$NN.$l$KBP$7$F!"FC$KLr$KN)$C$F$$$^$9!#(B

$B%f%K%3!<%I$r%/%i%$%"%s%H%5!<%P!<7?$N%"%W%j%1!<%7%g%s$d!"B?AX9=B$$r;}$D%"%W%j%1!<%7%g%s!"%&%'%V%5%$%H$J$I$K$KAH$_9~$`$3$H$G!"=>Mh$NJ8;z%3!<%I%;%C%H$rMQ$$$k$h$j$bL@$i$+$J%3%9%H:o8:$,2DG=$G$9!#%f%K%3!<%I$O!"C10l$N%=%U%H%&%(%"@=IJ!"C10l$N%&%'%V%5%$%H$K!"2?$i<j$r2C$($k$3$H$J$/!"J#?t$N%W%i%C%H%U%)!<%`!"J#?t$N8@8l!"J#?t$N9q$r%+%P!<$9$k$3$H$,=PMh$k$N$G$9!#%f%K%3!<%I$O!"%G!<%?$,B?$/$N0[$J$k%7%9%F%`$N4V$r!"2?$NMp$l$b$J$7$KE>Aw$9$k$3$H$r2DG=$H$9$k$N$G$9!#(B
$B%f%K%3!<%I%3%s%=!<%7%"%`$K$D$$$F(B

$B%f%K%3!<%I%3%s%=!<%7%"%`$O!":G?7$N%=%U%H%&%(%"@=IJ$HI8=`$K$*$$$F%F%-%9%H$rI=8=$9$k$3$H$r0UL#$9$k!H%f%K%3!<%II8=`!I$N9=C[!"H/E8!"Ia5Z!"MxMQB%?J$rL\E*$H$7$F@_N)$5$l$?Hs1DMxAH?%$G$9!#F1%3%s%=!<%7%"%`$N2q0w$O!"%3%s%T%e!<%?!<$H>pJs=hM}$K78$o$k9-HF$J4k6H$dAH?%$+$i9=@.$5$l$F$$$^$9!#F1%3%s%=!<%7%"%`$O!":b@/E*$K$O!"=c?h$K2qHq$N$_$K$h$C$F1?1D$5$l$F$$$^$9!#%f%K%3!<%II8=`$r;Y;}$7!"$=$N3HD%$H<BAu$r;Y1g$9$k@$3&Cf$NAH?%$d8D?M$O!"$@$l$b$,%f%K%3!<%I%3%s%=!<%7%"%`$N2q0w$J$k$3$H$,$G$-$^$9!#(B

$B$h$j>\$7$$$3$H$r$*CN$j$K$J$j$?$$J}$O!"(BGlossary, Unicode-Enabled Products, Technical Introduction $B$*$h$S(B Useful Resources$B$r$4;2>H$/$@$5$$!#(B
13 changes: 13 additions & 0 deletions corpus/generated/ISO-2022-KR/ko/validation/iso2022kr.bin
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
$)C1b:;@{@87N DDG;EM4B <}@Z88 C38.GU4O4Y. 1[@Z3* 4Y8% 9.@Z?!55 <}@Z8& AvA$GO?) @z@eGU4O4Y. @/4ODZ5e0! 039_5G1b @|?!4B @L7/GQ <}@Z8& AvA$GO1b @'GX <v9i 0!Av@G 4Y8% 1bH#H- =C=:E[@; ;g?kG_=@4O4Y. 4\@O 1bH#H- 9f9}@87N4B 8p5g 9.@Z8& FwGTGR <v >x>z=@4O4Y. ?98& 5i>n @/74 ?,GU?!<-88 :84u6s55 8p5g 0" 3*6s:0 >p>n8& C38.GO7A8i ?)7/ 03@G 4Y8% 1bH#H- 9f9}@L GJ?dGU4O4Y. ?5>n?M 00@: 4\@O >p>n@G 0f?l55 0xEk@{@87N ;g?k5G4B 8p5g 1[@Z, 9.@e :NH# 9W EWE)4ODC 1bH#?! 8B4B 4\@O 1bH#H- 9f9}@; 0.0m @VAv 8xGO?4=@4O4Y.

$)C@L7/GQ 1bH#H- =C=:E[@: 6GGQ 4Y8% 1bH#H- =C=:E[0z Cf59GU4O4Y. Ao 5N 0!Av 1bH#H- 9f9}@L 5N 03@G 4Y8% 9.@Z?! 4kGX 00@: 9xH#8& ;g?kGO0E3* 00@: 9.@Z?! 4kGX 4Y8% 9xH#8& ;g?kGR <v @V=@4O4Y. AV>nAx 8p5g DDG;EM(F/Hw <-9v)4B <-7N 4Y8% ?)7/ 0!Av 1bH#H- 9f9}@; Av?xGX>_ GU4O4Y. 1W7/3*, 5%@LEM8& <-7N 4Y8% 1bH#H- 9f9}@L3* GC7'F{ 0#?! @|4^GR 6'864Y 1W 5%@LEM4B GW;s <U;s@G @'Gh@; 0^0T 5K4O4Y.
$)C@/4ODZ5e7N 8p5g 0M@; GX0aGR <v @V=@4O4Y!

$)C@/4ODZ5e4B ;g?k A_@N GC7'F{, GA7N1W7%, >p>n?! 0|0h>x@L 9.@Z864Y 0m@/GQ <}@Z8& A&0xGU4O4Y. @/4ODZ5e G%AX@: Apple, HP, IBM, JustSystem, Microsoft, Oracle, SAP, Sun, Sybase, Unisys 9W 1bE8 ?)7/ H8;g?M 00@: >w0h <15NAV@Z?! @GGX C$EC5G>z=@4O4Y. @/4ODZ5e4B XML, Java, ECMAScript(JavaScript), LDAP, CORBA 3.0, WML 5n0z 00@L Gv@g 3N8. ;g?k5G4B G%AX?!<- GJ?dGO8g @L4B ISO/IEC 10646@; 18GvGO4B 0x=D@{@N 9f9}@T4O4Y. @L4B 89@: ?n?5 C<A&, ?dAr ;g?k5G4B 8p5g :j6s?l@z 9W 1bE8 89@: A&G0?!<- Av?x5K4O4Y. @/4ODZ5e G%AX@G :N;s0z @L8& Av?xGO4B 5518@G 0!?k<:@: CV1Y @| <<0h?! :R0m @V4B 1b<z 0fGb?!<- 0!@e A_?dGQ :N:P@; BwAvGO0m @V=@4O4Y.

$)C@/4ODZ5e8& E,6s@L>pF.-<-9v 6G4B 4YA_-?,0a @@?k GA7N1W7%0z @% ;g@LF.?! EkGUGO8i 790E=C 9.@Z <<F. ;g?k?! @V>n<- ;s4gGQ :q?k @}0( H?0z0! 3*E8334O4Y. @/4ODZ5e8& EkGX 8.?#Av4O>n85 >x@L 4YA_ GC7'F{, >p>n 9W 190! 0#?! 4\@O <RGAF.?~>n GC7'F{ 6G4B 4\@O @% ;g@LF.8& 8qG%7N ;o@; <v @V=@4O4Y. @L8& ;g?kGO8i 5%@LEM8& <U;s >x@L ?)7/ =C=:E[@; EkGX @|<[GR <v @V=@4O4Y.
$)C@/4ODZ5e D\<R=C>v?! 4kGX

$)C@/4ODZ5e D\<R=C>v@: :q?58. A6Aw@87N<- Gv4k <RGAF.?~>n A&G00z G%AX?!<- EX=:F.@G G%Gv@; AvA$GO4B @/4ODZ5e G%AX@G ;g?k@; 039_GO0m H.@eGO8g @e7AGO1b @'GX <<?vA3=@4O4Y. D\<R=C>v 8b9v=1@: DDG;EM?M A$:8 C38. ;j>w?! A>;gGO0m @V4B 1$9|@'GQ H8;g 9W A6Aw@G 9|@'8& 3*E83@4O4Y. D\<R=C>v@G @gA$@: @|@{@87N H8:q?! @GGX Cf4g5K4O4Y. @/4ODZ5e DA<R=C>v?!<-@G 8b9v=1@: @| <<0h >n4@ 0w?!<-3* @/4ODZ5e G%AX@; Av?xGO0m 1W H.@e0z 18Gv@; Av?xGO0m@ZGO4B A6Aw0z 03@N?!0T 039f5G>n @V=@4O4Y.

$)C4u @Z<<GQ 3;?k@: ?k>nA}, ?9A& @/4ODZ5e ;g?k 0!4I A&G0, 1b<z A$:8 9W 1bE8 @/?kGQ A$:88& B|A6GO=J=C?@.
20 changes: 20 additions & 0 deletions corpus/generated/ISO-8859-1/en/validation/iso88591-en.bin
Original file line number Diff line number Diff line change
@@ -0,0 +1,20 @@
What is Unicode?

Unicode provides a unique number for every character,
no matter what the platform,
no matter what the program,
no matter what the language.

Fundamentally, computers just deal with numbers. They store letters and other characters by assigning a number for each one. Before Unicode was invented, there were hundreds of different encoding systems for assigning these numbers. No single encoding could contain enough characters: for example, the European Union alone requires several different encodings to cover all its languages. Even for a single language like English no single encoding was adequate for all the letters, punctuation, and technical symbols in common use.

These encoding systems also conflict with one another. That is, two encodings can use the same number for two different characters, or use different numbers for the same character. Any given computer (especially servers) needs to support many different encodings; yet whenever data is passed between different encodings or platforms, that data always runs the risk of corruption.
Unicode is changing all that!

Unicode provides a unique number for every character, no matter what the platform, no matter what the program, no matter what the language. The Unicode Standard has been adopted by such industry leaders as Apple, HP, IBM, JustSystem, Microsoft, Oracle, SAP, Sun, Sybase, Unisys and many others. Unicode is required by modern standards such as XML, Java, ECMAScript (JavaScript), LDAP, CORBA 3.0, WML, etc., and is the official way to implement ISO/IEC 10646. It is supported in many operating systems, all modern browsers, and many other products. The emergence of the Unicode Standard, and the availability of tools supporting it, are among the most significant recent global software technology trends.

Incorporating Unicode into client-server or multi-tiered applications and websites offers significant cost savings over the use of legacy character sets. Unicode enables a single software product or a single website to be targeted across multiple platforms, languages and countries without re-engineering. It allows data to be transported through many different systems without corruption.
About the Unicode Consortium

The Unicode Consortium is a non-profit organization founded to develop, extend and promote use of the Unicode Standard, which specifies the representation of text in modern software products and standards. The membership of the consortium represents a broad spectrum of corporations and organizations in the computer and information processing industry. The consortium is supported financially solely through membership dues. Membership in the Unicode Consortium is open to organizations and individuals anywhere in the world who support the Unicode Standard and wish to assist in its extension and implementation.

For more information, see the Glossary, Unicode Enabled Products, Technical Introduction and Useful Resources.
Loading