Skip to content

Commit 3e26549

Browse files
authored
Merge pull request #55 from ilo-token/master
0.4.0
2 parents cef561b + 4d707a7 commit 3e26549

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

68 files changed

+8267
-4543
lines changed

.gitignore

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,4 @@
11
.vscode/
22
dictionary/dictionary.ts
33
dist/main.js
4-
telo-misikeke/rules.js
5-
telo-misikeke/Parser.js
4+
dist/main.js.map

CHANGELOG.md

Lines changed: 135 additions & 33 deletions
Original file line numberDiff line numberDiff line change
@@ -1,53 +1,120 @@
11
# Changelog
22

3-
<!-- <details>
3+
<!--
4+
NOTE: Before publishing:
5+
- run `deno task update` to update all dependencies including telo misikeke
6+
- set parameters on `project-data.json`
7+
-->
8+
9+
<details>
10+
411
<summary>On development changelog</summary>
5-
The latest on-development version can be accessed by building the source code. On this on-development version, things can be broken.
6-
</details> -->
12+
13+
## 0.4.0 (On development)
14+
15+
The latest on-development version can be accessed by building the source code.
16+
On this on-development version, things can be broken.
17+
18+
ilo Token can now translate into verbs! This means it can translate sentences!
19+
It still can't do the following however:
20+
21+
- Preverb
22+
- Preposition
23+
- "o" imperative sentence
24+
25+
[Check the limitations](https://github.com/ilo-token/ilo-token.github.io/wiki/Limitations).
26+
27+
ilo Token now has custom dictionary editor! This allows users to customize the
28+
dictionary to their liking. Users can customize existing words and also extend
29+
ilo Token with more non-pu words. It comes with limitations however.
30+
[Read the guidelines for using custom dictionary editor](https://github.com/ilo-token/ilo-token.github.io/wiki/Guidelines-for-editing-dictionary).
31+
32+
Some of the settings may reset. Please reconfigure it again to your preferred
33+
settings. Sorry for the inconvenience. We've decided to reset some of the
34+
settings after refactoring to make the code easier to work with.
35+
36+
- Implement translation to verbs.
37+
- Implement custom dictionary editor.
38+
- Fixed "la" translation.
39+
- Output translations are now capitalized.
40+
- "X lili" can be translated into "piece of X" or "part of X".
41+
- Consecutive adverbs are now not shown to avoid ambiguity.
42+
- Sentences ending with long string of punctuation such as "…" and "!?" are now
43+
recognized.
44+
- Interpunct or middle dot (·) and ideographic period (。) are now recognized as
45+
sentence separator.
46+
- Recognize multiline text. Newlines are either ignored or treated as sentence
47+
terminator.
48+
- New setting called multiline input mode. This enables users to insert newline
49+
on the text box. Ctrl + Enter is used to start translation.
50+
- Fixed UCSUR rendering.
51+
- Fixed ordering issue in Firefox. Thanks akesi Ale!
52+
- Implement advanced parsing settings.
53+
- Long texts (>500) are no longer recognized.
54+
55+
</details>
756

857
## 0.3.0
958

10-
This is a huge update now with better quality translations, configurable settings, UCSUR support, and expanded vocabulary!
59+
Released 15 Aug 2024
60+
61+
This is a huge update now with better quality translations, configurable
62+
settings, UCSUR support, and expanded vocabulary!
1163

1264
- Reimplement the word "a". This were dropped due to parser rewrite.
1365
- The vocabulary has been expanded to _nimi ku suli_ plus _nimi su!_.
14-
- New "dictionary mode", just enter a single word and ilo Token will output all definition from its own dictionary. This also works for particles. To bypass this and translate the word as if it is the whole sentence, just add a period.
15-
- Reimplement the "a" particle.
66+
- New "dictionary mode", just enter a single word and ilo Token will output all
67+
definition from its own dictionary. This also works for particles. To bypass
68+
this and translate the word as if it is the whole sentence, just add a period.
1669
- Implement UCSUR support! It supports:
1770
- Cartouche with nasin sitelen kalama
1871
- Combined glyphs
1972
- Long glyphs
2073
- (Deprecated characters and combiners are not supported)
2174
- Implement [nasin nanpa pona](https://sona.pona.la/wiki/nasin_nanpa_pona).
22-
- Implement settings dialog. [More info](https://github.com/ilo-token/ilo-token.github.io/wiki/Settings-Help).
75+
- Implement
76+
[settings dialog](https://github.com/ilo-token/ilo-token.github.io/wiki/Settings-Help).
2377
- Changes in error messages:
2478
- All possible errors will now be listed.
25-
- ilo Token now uses telo misikeke for error messages. This can be disabled from the settings.
79+
- ilo Token now uses telo misikeke for error messages. This can be disabled
80+
from the settings.
2681
- Multiline text will no longer be recognized.
2782
- Add icons.
2883

29-
You may not notice this, we take good grammar for granted, but ilo Token now has generally better quality translations thanks to the following:
84+
You may not notice this, we take good grammar for granted, but ilo Token now has
85+
generally better quality translations thanks to the following:
3086

31-
- It is now aware determiners are separate from adjectives. So you won't see adjectives like "nicely my", since adverbs can't modify determiners.
32-
- It tries to ensure adjectives are in proper order. Yes this matters, it's "big red fruit" and not "red big fruit".
33-
- Just like adjectives, determiners are also ordered, but unlike adjectives, they're also filtered (some combinations are not shown). You won't see "my your animal".
87+
- It is now aware determiners are separate from adjectives. So you won't see
88+
adjectives like "nicely my", since adverbs can't modify determiners.
89+
- It tries to ensure adjectives are in proper order. Yes this matters, it's "big
90+
red fruit" and not "red big fruit".
91+
- Just like adjectives, determiners are also ordered, but unlike adjectives,
92+
they're also filtered (some combinations are not shown). You won't see "my
93+
your animal".
3494
- It is aware of grammatical numbers. So you won't see "2 stick" or "1 sticks".
3595

3696
Inside update (intended for developers):
3797

3898
- Implement lexer and english AST.
39-
- Overhaul dictionary: It is now a separate file with nicer syntax as opposed to written inside the code.
99+
- Overhaul dictionary: It is now a separate file with nicer syntax as opposed to
100+
written inside the code.
40101

41102
## 0.2.2
42103

104+
Released 24 Jan 2024
105+
43106
Update missed links.
44107

45108
## 0.2.1
46109

47-
The project has been renamed to ilo Token. The definition list has been given a huge overhaul.
110+
Released 24 Jan 2024
111+
112+
The project has been renamed to ilo Token. The definition list has been given a
113+
huge overhaul.
48114

49115
- Change name to ilo Token.
50-
- Remove unintended commas, these were found when translating "en" with more than 3 phrases.
116+
- Remove unintended commas, these were found when translating "en" with more
117+
than 3 phrases.
51118
- Remove copyright and license footer.
52119
- Update definition list:
53120
- It now uses latest Linku definition as the base.
@@ -56,7 +123,11 @@ The project has been renamed to ilo Token. The definition list has been given a
56123

57124
## 0.2.0
58125

59-
For this version. The whole code has been rewritten. The translator can now translate few more things! Although it's still not capable of translating full sentences.
126+
Released 24 Jan 2024
127+
128+
For this version. The whole code has been rewritten. The translator can now
129+
translate few more things! Although it's still not capable of translating full
130+
sentences.
60131

61132
- Implement translator for:
62133
- Extended numbering system
@@ -70,61 +141,81 @@ For this version. The whole code has been rewritten. The translator can now tran
70141
- (Downgrade) Translator is somewhat slower.
71142
- Remove Discord DM as contact option.
72143
- Update translation list:
73-
- _tonsi_ &ndash; change nouns "transgender", "transgenders", "non-binary", and "non-binaries" into "transgender person", "transgender people", "non-binary person", and "non-binary people" (I DIDN'T MEAN TO OBJECTIFY THEM OMFG I'M SO SORRY 😭😭😭)
144+
- _tonsi_ &ndash; change nouns "transgender", "transgenders", "non-binary",
145+
and "non-binaries" into "transgender person", "transgender people",
146+
"non-binary person", and "non-binary people" (I DIDN'T MEAN TO OBJECTIFY
147+
THEM OMFG I'M SO SORRY 😭😭😭)
74148

75149
Inside update (intended for developers):
76150

77151
- Rewritten whole code to use TypeScript, module, and functional programming.
78152
- Rewritten parser to use parser combinator.
79153
- Add language codes to html.
80154
- New wiki for contributors and thinkerers.
81-
- Overhaul `README.md`, only including build instruction. Information about the translator is now moved to wiki.
155+
- Overhaul `README.md`, only including build instruction. Information about the
156+
translator is now moved to wiki.
82157

83158
## 0.1.1
84159

160+
Released 11 Jan 2024
161+
85162
- Update copyright notice.
86163
- Update version number on the page.
87164
- Update contacts to Discord. (from `neverRare#1517` to `never_rare`)
88165

89166
## 0.1.0
90167

168+
Released 11 Jan 2024
169+
91170
- Add "(adjective) in (adjective) way" translation.
92171
- Handle complicated phrase as error.
93172
- Rearrange output to make adjective phrase appear first.
94173
- Add basic "la" translation: "given X, Y" and "if X, then Y".
95174
- Fix multiple _o_ error being triggered when there's only one _o_.
96175
- Update translation list:
97-
- _ante_ &ndash; change "other" into "different", "different" have broader meaning than "other".
176+
- _ante_ &ndash; change "other" into "different", "different" have broader
177+
meaning than "other".
98178

99179
## 0.0.2
100180

101-
For this version. Major bugs related to phrase translation has been fixed. The translation lists has been updated as well.
181+
Released 23 Dec 2022
102182

103-
You may need to force restart the webpage: shift + click the restart button; or ctrl + shift + R.
183+
For this version. Major bugs related to phrase translation has been fixed. The
184+
translation lists has been updated as well.
185+
186+
You may need to force restart the webpage: shift + click the restart button; or
187+
ctrl + shift + R.
104188

105189
- Translator can now put emphasis on whole phrases.
106190
- Fix "(content word) a" not being parsed properly.
107191
- Fix "a (words)" not being parsed properly.
108-
- Proper name now can't modify adjective translations &ndash; translations like "good named Nimi" are now removed.
192+
- Proper name now can't modify adjective translations &ndash; translations like
193+
"good named Nimi" are now removed.
109194
- Untranslatable phrases now handled as untranslatable error.
110195
- New kind of error where the sentence can't be translated but it should be
111196
- Replaced "whoops" error with untranslatable error.
112197
- Having at most one modifier after "pi" is now considered unrecognized error.
113198
- Multiple "pi" is now considered unrecognized error.
114199
- Fix adverbs and adjective not being translated properly.
115-
- Handle multiple proper word as error &ndash; phrases like "jan Sonja pona Lang" will be unrecognizable.
200+
- Handle multiple proper word as error &ndash; phrases like "jan Sonja pona
201+
Lang" will be unrecognizable.
116202
- Simplify translation lists:
117203
- _toki_ &ndash; merge adjectives "speaking" and "writing" as "communicating".
118-
- _mun_ &ndash; merge "moon", "moons", "star", "stars", "planet" and "planets" into "celestial object" and "celestial objects".
119-
- _pilin_ &ndash; remove "feeling" and "feelings", "emotion" and "emotions" seems enough
120-
- _sona_ &ndash; remove "knowledgeably", doesn't seems to match the definition of _sona_.
204+
- _mun_ &ndash; merge "moon", "moons", "star", "stars", "planet" and "planets"
205+
into "celestial object" and "celestial objects".
206+
- _pilin_ &ndash; remove "feeling" and "feelings", "emotion" and "emotions"
207+
seems enough
208+
- _sona_ &ndash; remove "knowledgeably", doesn't seems to match the definition
209+
of _sona_.
121210
- Replace translation words:
122211
- _ante_ &ndash; replace nouns "change" and "changes" with noun "changing".
123212
- _jan_ &ndash; replace "humanly" with "person-like".
124213
- _kama_ &ndash; replace "arrival" and "arrivals" with noun "arriving".
125214
- _pona_ &ndash; replace "properly" with "nicely".
126-
- _toki_ &ndash; replace "speech" and "speeches" with "communication" and "communications".
127-
- _selo_ &ndash; replace "shape" and "shapes" with "outer form", "boundary", and "boundaries".
215+
- _toki_ &ndash; replace "speech" and "speeches" with "communication" and
216+
"communications".
217+
- _selo_ &ndash; replace "shape" and "shapes" with "outer form", "boundary",
218+
and "boundaries".
128219
- _sewi_ &ndash; replace "up" with "above".
129220
- Add translation words:
130221
- _anpa_ &ndash; add "under".
@@ -142,12 +233,21 @@ You may need to force restart the webpage: shift + click the restart button; or
142233

143234
## 0.0.1
144235

145-
For this version, the word list and translations have been updated. Few words that have been missed has been added. Translation lists has been updated. This includes simplifying translation lists such as deduplicating translation words that have mostly the same meaning, as well as adding more translation words.
236+
Released 19 Dec 2022
237+
238+
For this version, the word list and translations have been updated. Few words
239+
that have been missed has been added. Translation lists has been updated. This
240+
includes simplifying translation lists such as deduplicating translation words
241+
that have mostly the same meaning, as well as adding more translation words.
146242

147-
The webpage has been updated as well. The color contrast has been updated to be accessible. The discord link has been updated so it points to the dedicated channel.
243+
The webpage has been updated as well. The color contrast has been updated to be
244+
accessible. The discord link has been updated so it points to the dedicated
245+
channel.
148246

149247
- Start versioning
150-
- Add Nimi Ku Suli custom dictionary for [Code Spell Checker](https://marketplace.visualstudio.com/items?itemName=streetsidesoftware.code-spell-checker) user
248+
- Add Nimi Ku Suli custom dictionary for
249+
[Code Spell Checker](https://marketplace.visualstudio.com/items?itemName=streetsidesoftware.code-spell-checker)
250+
user
151251
- Change color of hyperlinks and error message to conform to WCAG 2.0 AAA
152252
- Update discord links
153253
- Add footnote
@@ -166,14 +266,16 @@ The webpage has been updated as well. The color contrast has been updated to be
166266
- _linja_ &ndash; deduplicate "long flexible"
167267
- _mama_ &ndash; remove "caring" as noun
168268
- _ni_ &ndash; remove "these" and "those", "this" and "that" seems enough
169-
- _pana_ &ndash; remove "emission" and "emissions", these doesn't makes sense (smh my head, why did I added these)
269+
- _pana_ &ndash; remove "emission" and "emissions", these doesn't makes sense
270+
(smh my head, why did I added these)
170271
- _pimeja_ &ndash; remove "grey", "gray" is kept
171272
- _sama_ &ndash; remove "likeness", "similarity" seems enough
172273
- _sewi_ &ndash; remove "divinities", "divinity" seems enough
173274
- _sona_ &ndash; remove "knowledges", "knowledge" seems enough
174275
- _utala_ &ndash; remove "fight", "conflict" seems enough
175276
- _utala_ &ndash; remove "fighting", conflicting" seems enough
176-
- _wan_ &ndash; remove "lonliness". remove "single" as adjective, "one" seems enough
277+
- _wan_ &ndash; remove "lonliness". remove "single" as adjective, "one" seems
278+
enough
177279
- Change translations:
178280
- _wan_ &ndash; change noun "single" to "one"
179281
- _pona_ &ndash; change "goodly" to "properly"

CODE_OF_CONDUCT.md

Lines changed: 26 additions & 25 deletions
Original file line numberDiff line numberDiff line change
@@ -6,8 +6,8 @@ We as members, contributors, and leaders pledge to make participation in our
66
community a harassment-free experience for everyone, regardless of age, body
77
size, visible or invisible disability, ethnicity, sex characteristics, gender
88
identity and expression, level of experience, education, socio-economic status,
9-
nationality, personal appearance, race, religion, or sexual identity
10-
and orientation.
9+
nationality, personal appearance, race, religion, or sexual identity and
10+
orientation.
1111

1212
We pledge to act and interact in ways that contribute to an open, welcoming,
1313
diverse, inclusive, and healthy community.
@@ -17,23 +17,23 @@ diverse, inclusive, and healthy community.
1717
Examples of behavior that contributes to a positive environment for our
1818
community include:
1919

20-
* Demonstrating empathy and kindness toward other people
21-
* Being respectful of differing opinions, viewpoints, and experiences
22-
* Giving and gracefully accepting constructive feedback
23-
* Accepting responsibility and apologizing to those affected by our mistakes,
20+
- Demonstrating empathy and kindness toward other people
21+
- Being respectful of differing opinions, viewpoints, and experiences
22+
- Giving and gracefully accepting constructive feedback
23+
- Accepting responsibility and apologizing to those affected by our mistakes,
2424
and learning from the experience
25-
* Focusing on what is best not just for us as individuals, but for the
26-
overall community
25+
- Focusing on what is best not just for us as individuals, but for the overall
26+
community
2727

2828
Examples of unacceptable behavior include:
2929

30-
* The use of sexualized language or imagery, and sexual attention or
31-
advances of any kind
32-
* Trolling, insulting or derogatory comments, and personal or political attacks
33-
* Public or private harassment
34-
* Publishing others' private information, such as a physical or email
35-
address, without their explicit permission
36-
* Other conduct which could reasonably be considered inappropriate in a
30+
- The use of sexualized language or imagery, and sexual attention or advances of
31+
any kind
32+
- Trolling, insulting or derogatory comments, and personal or political attacks
33+
- Public or private harassment
34+
- Publishing others' private information, such as a physical or email address,
35+
without their explicit permission
36+
- Other conduct which could reasonably be considered inappropriate in a
3737
professional setting
3838

3939
## Enforcement Responsibilities
@@ -60,8 +60,8 @@ representative at an online or offline event.
6060

6161
Instances of abusive, harassing, or otherwise unacceptable behavior may be
6262
reported to the community leaders responsible for enforcement at
63-
64-
All complaints will be reviewed and investigated promptly and fairly.
63+
[email protected]. All complaints will be reviewed and investigated promptly
64+
and fairly.
6565

6666
All community leaders are obligated to respect the privacy and security of the
6767
reporter of any incident.
@@ -82,15 +82,15 @@ behavior was inappropriate. A public apology may be requested.
8282

8383
### 2. Warning
8484

85-
**Community Impact**: A violation through a single incident or series
86-
of actions.
85+
**Community Impact**: A violation through a single incident or series of
86+
actions.
8787

8888
**Consequence**: A warning with consequences for continued behavior. No
8989
interaction with the people involved, including unsolicited interaction with
9090
those enforcing the Code of Conduct, for a specified period of time. This
9191
includes avoiding interactions in community spaces as well as external channels
92-
like social media. Violating these terms may lead to a temporary or
93-
permanent ban.
92+
like social media. Violating these terms may lead to a temporary or permanent
93+
ban.
9494

9595
### 3. Temporary Ban
9696

@@ -106,19 +106,20 @@ Violating these terms may lead to a permanent ban.
106106
### 4. Permanent Ban
107107

108108
**Community Impact**: Demonstrating a pattern of violation of community
109-
standards, including sustained inappropriate behavior, harassment of an
109+
standards, including sustained inappropriate behavior, harassment of an
110110
individual, or aggression toward or disparagement of classes of individuals.
111111

112-
**Consequence**: A permanent ban from any sort of public interaction within
113-
the community.
112+
**Consequence**: A permanent ban from any sort of public interaction within the
113+
community.
114114

115115
## Attribution
116116

117117
This Code of Conduct is adapted from the [Contributor Covenant][homepage],
118118
version 2.0, available at
119119
https://www.contributor-covenant.org/version/2/0/code_of_conduct.html.
120120

121-
Community Impact Guidelines were inspired by [Mozilla's code of conduct
121+
Community Impact Guidelines were inspired by
122+
[Mozilla's code of conduct
122123
enforcement ladder](https://github.com/mozilla/diversity).
123124

124125
[homepage]: https://www.contributor-covenant.org

0 commit comments

Comments
 (0)