Skip to main content
19 events
when toggle format what by license comment
Feb 11, 2019 at 12:27 comment added Peter Shor @user0: the way I read the description of what they did, Liang first got all the hyphenations in Webster's pocket dictionary right, and then tested his algorithm on the hyphenations in a larger dictionary, They then decided not to worry about many of the rarer and more technical words it got wrong from the larger dictionary, although they fixed some of them.
Feb 11, 2019 at 12:13 comment added Peter Shor Googling Maximal Onset Principle yields a bunch of results, including this one.
Feb 11, 2019 at 5:43 history edited herisson CC BY-SA 4.0
added 99 characters in body
Feb 11, 2019 at 4:39 comment added user318469 Could you provide us with a reference to 'the widely recognized principle of "maximizing onsets" in syllabification'?
Feb 11, 2019 at 3:47 comment added user318469 @PeterShor Not "exactly", but "nearly". The paper you cited and Liang's thesis said that they decided not to worry about specialized technical terms.
Feb 11, 2019 at 3:45 history edited herisson CC BY-SA 4.0
added 63 characters in body
Feb 11, 2019 at 3:44 comment added Peter Shor @sumelic—you're right. Reading more carefully, Knuth and Liang came up with a hyphenation algorithm, and then Liang improved it so that it got nearly all the words correct.
Feb 11, 2019 at 3:42 history edited herisson CC BY-SA 4.0
added 63 characters in body
Feb 11, 2019 at 3:40 comment added herisson @PeterShor: That dictionary seems to have been used to make the TEX82 hyphenation algorithm that Liang worked on.
Feb 11, 2019 at 3:39 comment added Peter Shor @user0: DEK's goal for his algorithm, was that, when combined with his exception list, it would reproduce the hyphenations in Webster's pocket dictionary exactly.
Feb 11, 2019 at 3:34 comment added Peter Shor @sumelic: This paper says Knuth started with the hyphenations in the 1966 edition of Webster's pocket dictionary.
Feb 11, 2019 at 3:33 history edited herisson CC BY-SA 4.0
added 185 characters in body
Feb 11, 2019 at 3:31 comment added herisson @PeterShor: That makes sense, and corresponds with what is said here, but can you point me to a source so that I can verify that the hyphenation table is based on Webster's dictionary?
Feb 11, 2019 at 3:31 comment added user318469 @PeterShor IMHO, that's also not fully true. DEK created patterns from a dictionary automatically, and then allowed for an exception list to keep the number of patterns low.
Feb 11, 2019 at 3:28 comment added Peter Shor I'm saying that Donald Knuth did not come up with the hyphenations; he took them from Webster's dictionary.
Feb 11, 2019 at 3:24 comment added herisson @user0: The exceptions list is supposed to be from "Tugboat", whatever that means. I think this is the GitHub source page: github.com/hunspell/hyphen
Feb 11, 2019 at 3:22 comment added Peter Shor The American English hyphenation has nothing to do with TeX—TeX's hyphenation tables are based on Webster's dictionary, which decided how to hyphenate the words in the 19th century, back when we pronounced them differently. If they went back and re-hyphenated it today, they would probably keep the "or" together, because together they make up an r-influenced vowel.
Feb 11, 2019 at 3:21 comment added user318469 Thx! Regarding "Plain TeX hyphenation tables": taking the exception list known as ushyphex into consideration or not?
Feb 11, 2019 at 3:17 history answered herisson CC BY-SA 4.0