Adding credibility signals feature #562

rosannamilner · 2024-08-05T13:50:05Z

This new feature adds six credibility signal classifiers:

news framing (topic)
news genre
persuasion techniques
subjectivity
previous fact checks
machine generated text

Related to AFP-Medialab/InVID-Translations#93

Add assistant text classifier UI with html formatting first commit added new sagas starting to add accordion display Displaying gcloud cred signals tidied up list of genre, topic, persuasion added typography machince generated text service added fixed subjectivity displaying subjective sentences displaying correct subjective sentences tidied display of credibillity signals using stored secrets for kinit services removed classifiers from URL test box added code for checking logged in for pfc preventing pfc from being called if not logged in removing unnnecessary imports adding subj tooltip and pfc limit refactored credibility signals added messages for after logging in login message and passing text to semantic search as variable captialised genres added assistant.json text moved tooltips out to cardheader pfc and mgt sagas work after login typos added comments added embedding message moved credsignals grid to correct card removed console.log message removed unnecessary tooltip log moved text to assistant.json tidied code counting categories in wrapfunc counting categories in wrapfunc change

Add assistant text classifier UI with html formatting first commit added new sagas starting to add accordion display Displaying gcloud cred signals tidied up list of genre, topic, persuasion added typography machince generated text service added fixed subjectivity displaying subjective sentences displaying correct subjective sentences tidied display of credibillity signals using stored secrets for kinit services removed classifiers from URL test box added code for checking logged in for pfc preventing pfc from being called if not logged in removing unnnecessary imports adding subj tooltip and pfc limit refactored credibility signals added messages for after logging in login message and passing text to semantic search as variable captialised genres added assistant.json text moved tooltips out to cardheader pfc and mgt sagas work after login typos added comments added embedding message moved credsignals grid to correct card removed console.log message removed unnecessary tooltip log moved text to assistant.json tidied code counting categories in wrapfunc counting categories in wrapfunc change counting categories in wrapfunc change Subjectivty confidence colour blue refactoring pertech code refactor for correct persuasion techniques added/removed comments updated tooltip text remove console.log fixes for persuasion techniques fixes for subjectivity edited keyword for semantic search changed mgt.pred to use keyword

twinkarma

A few minor suggestion for changes but overall looking really good! Great work!

src/components/NavItems/Assistant/AssistantScrapeResults/AssistantTextSpanClassification.jsx

src/components/NavItems/Assistant/AssistantScrapeResults/AssistantTextClassification.jsx

src/components/NavItems/Assistant/AssistantApiHandlers/useAssistantApi.jsx

...components/NavItems/Assistant/AssistantCheckResults/ExtractedSourceCredibilityDBKFDialog.jsx

twinkarma

LGTM!

…ab/verification-plugin into assistant/credibility-signals

Sallaa

Just a check for Arabic (and LTR languages) but the rest looks good to me 👍

Please merge beta-master into your branch to also fix the conflicts

src/components/NavItems/tools/SemanticSearch/components/ResultDisplayItem.jsx

rosannamilner · 2024-08-12T09:51:13Z

Just a check for Arabic (and LTR languages) but the rest looks good to me 👍

Please merge beta-master into your branch to also fix the conflicts

Thanks Valentin - noticing I don't have the languages drop down menu at the top, it appears empty and I'm struggling to work out why it's not appearing. (Checked for this branch and same on beta-master). Do you have any ideas why this could be happening?

Looking into components/Navitems/languages/languages.jsx, storeLanguage prints out as "en" but languageList is empty.

Sallaa · 2024-08-12T10:14:50Z

@rosannamilner this usually happens when you are pointing to the wrong branch or when you are offline (no internet connection)

Can you try the following troubleshooting?

Merge beta-master into your branch to get the latest code (this will also allow you to fix remaining conflicts)
Make sure your .env config uses REACT_APP_TRANSLATION_TAG=v0.82
If you changed your .env configuration, run npm run dev again
Uninstall / reinstall the plugin on Chrome or do a hard reload and clear the cache (open the Chrome inspector, then hold the refresh button in chrome to see the Empty Cache and Hard Reload option)
Double check your internet connection just in case

Let me know if you still face the issue after this

Sallaa · 2024-08-12T10:16:02Z

Also, let me know if you see error messages in the console. They could indicate where the problem is coming from

rosannamilner · 2024-08-12T11:02:58Z

Also, let me know if you see error messages in the console. They could indicate where the problem is coming from

I have done the above with no luck, but I do see these errors in the console:

Failed to load resource: net::ERR_FILE_NOT_FOUND    undefined/dictionaries/components/NavItems/defaultLanguage.tsv?lang=en&tag=v0.82:1
Failed to load resource: net::ERR_FILE_NOT_FOUND    undefined/languages?tag=v0.82:1

rosannamilner · 2024-08-12T12:11:43Z

Also, let me know if you see error messages in the console. They could indicate where the problem is coming from

I have done the above with no luck, but I do see these errors in the console:
Failed to load resource: net::ERR_FILE_NOT_FOUND    undefined/dictionaries/components/NavItems/defaultLanguage.tsv?lang=en&tag=v0.82:1
Failed to load resource: net::ERR_FILE_NOT_FOUND    undefined/languages?tag=v0.82:1    

@Sallaa I'm missing REACT_APP_TRANSLATION_URL from my .env - can you let me know what that should be please?

rosannamilner added 13 commits July 23, 2024 16:08

counting categories in wrapfunc change

405e575

Subjectivty confidence colour blue

d4bc942

refactoring pertech code

f0bf706

refactor for correct persuasion techniques

cedfadb

added/removed comments

41d26e4

updated tooltip text

eda948f

remove console.log

c2be123

fixes for persuasion techniques

6915331

fixes for subjectivity

5a15f26

edited keyword for semantic search

596ed86

changed mgt.pred to use keyword

0360b0f

rosannamilner requested review from twinkarma and Sallaa August 5, 2024 13:50

rosannamilner added 2 commits August 5, 2024 15:07

Update assistantUtils.jsx

11760b6

Update assistantUtils.jsx

335fcfa

twinkarma requested changes Aug 5, 2024

View reviewed changes

rosannamilner and others added 6 commits August 5, 2024 16:26

added retries for subjectivity service

7ef056e

Update AssistantTextSpanClassification.jsx

18238ff

remove importance value

b6dace8

edits for PR

2be7cd6

changes requested

dcbfedc

removed HpDetails

e1934cb

rosannamilner requested a review from twinkarma August 6, 2024 08:39

twinkarma approved these changes Aug 6, 2024

View reviewed changes

rosannamilner and others added 3 commits August 6, 2024 14:43

Merge branch 'beta-master' into assistant/credibility-signals

d7d3160

added code for when no persuasion techniques returned

86febec

Merge branch 'assistant/credibility-signals' of github.com:AFP-Medial…

d30eb98

…ab/verification-plugin into assistant/credibility-signals

Sallaa requested changes Aug 9, 2024

View reviewed changes

src/components/NavItems/tools/SemanticSearch/components/ResultDisplayItem.jsx Outdated Show resolved Hide resolved

src/components/NavItems/tools/SemanticSearch/components/ResultDisplayItem.jsx Outdated Show resolved Hide resolved

changed typography and bug in subjectivity

58f28b8

Merge branch 'beta-master' into assistant/credibility-signals

8ddbca6

Sallaa approved these changes Aug 12, 2024

View reviewed changes

rosannamilner added 13 commits August 13, 2024 08:56

fixed prevfactcheck auto searching

4e32d11

changing align to start in typography

7e2c787

added translations for all genres, topics and persuasion

97c5987

corrected Assistant.json

1e544f4

offline translations

0e5e636

offline translations

2023bb4

fixed child needs key react error

4610d1f

changed typography component to div

ccc8ba5

fixed MUI span error

85e62cb

fixed unique key error in AssistantTestResult

89b7df1

fixed more unique key errors

a66fdfd

fix a unique key error for persuasion

24aa84e

fixed issue with no subjectivite sentences detected

fed1d7b

Sallaa approved these changes Aug 26, 2024

View reviewed changes

Sallaa merged commit f982c06 into beta-master Aug 26, 2024
1 check passed

rosannamilner deleted the assistant/credibility-signals branch September 9, 2024 14:25

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Adding credibility signals feature #562

Adding credibility signals feature #562

rosannamilner commented Aug 5, 2024 •

edited

Loading

twinkarma left a comment

twinkarma left a comment

Sallaa left a comment

rosannamilner commented Aug 12, 2024

Sallaa commented Aug 12, 2024

Sallaa commented Aug 12, 2024

rosannamilner commented Aug 12, 2024

rosannamilner commented Aug 12, 2024 •

edited

Loading

Adding credibility signals feature #562

Adding credibility signals feature #562

Conversation

rosannamilner commented Aug 5, 2024 • edited Loading

twinkarma left a comment

Choose a reason for hiding this comment

twinkarma left a comment

Choose a reason for hiding this comment

Sallaa left a comment

Choose a reason for hiding this comment

rosannamilner commented Aug 12, 2024

Sallaa commented Aug 12, 2024

Sallaa commented Aug 12, 2024

rosannamilner commented Aug 12, 2024

rosannamilner commented Aug 12, 2024 • edited Loading

rosannamilner commented Aug 5, 2024 •

edited

Loading

rosannamilner commented Aug 12, 2024 •

edited

Loading