This repository was archived by the owner on Mar 12, 2025. It is now read-only.
Top words for early 2022 are all Vietnamese? #78
Assignees
Milestone
Comments
pgulley
added
bug
|
No Vietnamese stopwords might be part of the issue, but probably doesn't cover this |
|
It may just be because I run queries against all stories when looking at progress running historical backfills, and we have some REALLY spammy .vn sources!! |
|
Was traipsing thru mc-providers and noticed that there is no vi_stop_words.txt file in https://github.com/mediacloud/mc-providers/tree/main/mc_providers/language/ |
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
@philbudne Noted, in investigating the status of re-indexing data from 2022, that the top-terms for a query from 2022-01-01 to 2022-12-31 seems to be entirely populated with Vietnamese words- despite vietnamese not being in the top 10 languages represented!
The text was updated successfully, but these errors were encountered: