You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I have run a comparison of the voikko-based speller with the hfst-ospell-office speller. The result is visible here (first 7 diffs, available for a month):
As can be seen in the seventh diff, the same suggestion is given twice. This is caused by two suggestions that are underlyingly different only in their initial case (but thus still different), but which are made identical because the input has initial uppercase, and so both suggestions will have initial upper case, which makes them identical.
There needs to be a check for uniqueness within the final suggestion list, and if two identical suggestions are found, only the first/best one is returned.
The text was updated successfully, but these errors were encountered:
snomos
changed the title
Duplicate suggestions with initial upper case when both a name and a regular noun
Duplicate suggestions when input has initial upper case, suggestion can be both a name and a regular noun
Dec 8, 2015
I have run a comparison of the voikko-based speller with the hfst-ospell-office speller. The result is visible here (first 7 diffs, available for a month):
https://www.diffnow.com/?report=5m6dx
As can be seen in the seventh diff, the same suggestion is given twice. This is caused by two suggestions that are underlyingly different only in their initial case (but thus still different), but which are made identical because the input has initial uppercase, and so both suggestions will have initial upper case, which makes them identical.
There needs to be a check for uniqueness within the final suggestion list, and if two identical suggestions are found, only the first/best one is returned.
The text was updated successfully, but these errors were encountered: