Geodesic
The Unreasonable Effectiveness of Pattern Generation
Zpravodaj Československého sdružení uživatelů TeXu, Tome 29 (2019) no. 1-4, pp. 73-86.

Voir la notice de l'article provenant de la source Czech Digital Mathematics Library

Languages are constantly evolving, and so are their hyphenation rules and needs. The effectiveness and utility of TeX's hyphenation have been proven by its usage in almost all typesetting systems in use today. The current Czech hyphenation patterns were generated in 1995, and no hyphenated word database was freely available. We have developed a new Czech word database and have used the patgen program to generate new effective Czech hyphenation patterns efficiently and evaluated their generalization qualities. We have achieved full coverage on the training dataset of 3,000,000 words, and developed a validation procedure of new patterns for Czech based on the testing database of 105,000 words approved by the Czech Academy of Science linguists. Our pattern generation case study exemplifies a practical solution to the widespread dictionary problem. The study has proven the versatility, effectiveness, and extensibility of Liang's approach to hyphenation developed for TeX. The unreasonable effectiveness of the pattern technology has led to applications that are and will be used, even more widely now, nearly 40 years after its inception.
DOI : 10.5300/2019-1-4/73
Keywords: hyphenation patterns; patgen; unreasonable effectiveness; Czech; patgen; vzory dělení slov; nepochopitelná efektivita; čeština 
@article{10_5300_2019_1_4_73,
     author = {Sojka, Petr and Sojka, Ond\v{r}ej},
     title = {The {Unreasonable} {Effectiveness} of {Pattern} {Generation}},
     journal = {Zpravodaj \v{C}eskoslovensk\'eho sdru\v{z}en{\'\i} u\v{z}ivatel\r{u} TeXu},
     pages = {73--86},
     publisher = {mathdoc},
     volume = {29},
     number = {1-4},
     year = {2019},
     doi = {10.5300/2019-1-4/73},
     language = {en},
     url = {http://geodesic.mathdoc.fr/articles/10.5300/2019-1-4/73/}
}
TY  - JOUR
AU  - Sojka, Petr
AU  - Sojka, Ondřej
TI  - The Unreasonable Effectiveness of Pattern Generation
JO  - Zpravodaj Československého sdružení uživatelů TeXu
PY  - 2019
SP  - 73
EP  - 86
VL  - 29
IS  - 1-4
PB  - mathdoc
UR  - http://geodesic.mathdoc.fr/articles/10.5300/2019-1-4/73/
DO  - 10.5300/2019-1-4/73
LA  - en
ID  - 10_5300_2019_1_4_73
ER  - 
%0 Journal Article
%A Sojka, Petr
%A Sojka, Ondřej
%T The Unreasonable Effectiveness of Pattern Generation
%J Zpravodaj Československého sdružení uživatelů TeXu
%D 2019
%P 73-86
%V 29
%N 1-4
%I mathdoc
%U http://geodesic.mathdoc.fr/articles/10.5300/2019-1-4/73/
%R 10.5300/2019-1-4/73
%G en
%F 10_5300_2019_1_4_73
Sojka, Petr; Sojka, Ondřej. The Unreasonable Effectiveness of Pattern Generation. Zpravodaj Československého sdružení uživatelů TeXu, Tome 29 (2019) no. 1-4, pp. 73-86. doi : 10.5300/2019-1-4/73. http://geodesic.mathdoc.fr/articles/10.5300/2019-1-4/73/

Cité par Sources :