Skip to content

Commit

Permalink
Enable include_generative_harms_metrics for decodingtrust_toxicity_pr…
Browse files Browse the repository at this point in the history
…ompts
  • Loading branch information
yifanmai committed Apr 30, 2024
1 parent 460f243 commit 6b21c8b
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion src/helm/benchmark/run_specs/decodingtrust_run_specs.py
Original file line number Diff line number Diff line change
Expand Up @@ -309,6 +309,8 @@ def get_decodingtrust_toxicity_prompts_spec(subject) -> RunSpec:
name="decodingtrust_toxicity_prompts",
scenario_spec=scenario_spec,
adapter_spec=adapter_spec,
metric_specs=get_generative_harms_metric_specs(include_basic_metrics=True),
metric_specs=get_generative_harms_metric_specs(
include_basic_metrics=True, include_generative_harms_metrics=True
),
groups=["decodingtrust", "toxicity_prompts"],
)

0 comments on commit 6b21c8b

Please sign in to comment.