Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

MuTox Scenario #3343

Merged
merged 29 commits into from
Feb 17, 2025
Merged

MuTox Scenario #3343

merged 29 commits into from
Feb 17, 2025

Conversation

teetone
Copy link
Member

@teetone teetone commented Feb 14, 2025

No description provided.

teetone and others added 21 commits January 27, 2025 23:55
@teetone
added size in the model name
7cf2d17
@teetone
rename metric
4672d3e
@teetone
Merge branch 'main' of https://github.com/stanford-crfm/helm into aud…
1969b10 
…iohelm
@teetone
removed
bd54b27
@teetone
air bench chat to schema
138ac38
@teetone
v0
f49a752
@teetone
rename
b399256
@teetone
handle server errors
4bc0007
@teetone
sanity check
c17c18b
@teetone
schema
fae4660
@ImKeTT
Remove empty files in the Vocal Sound audio scenario (#3313)
a4f5e39
@teetone
Merge branch 'main' of https://github.com/stanford-crfm/helm into aud…
c7f166e 
…iohelm
@teetone
Merge branch 'audiohelm' of https://github.com/stanford-crfm/helm int…
b5ed1ba 
…o audiohelm
@teetone
invalid audio file logic
574b040
@teetone
invalid audio file logic
c013845
@teetone
Merge branch 'main' of https://github.com/stanford-crfm/helm into aud…
221296a 
…iohelm
@teetone
show win rates
742a9c2
@teetone
Merge branch 'main' of https://github.com/stanford-crfm/helm into aud…
d05983b 
…iohelm
@teetone
fix throat clearing
02b84ca
@teetone
rename to audio
b50eeaf
@teetone
mutox scenario
bb654b4
@teetone teetone requested a review from ImKeTT February 14, 2025 03:44
@teetone teetone changed the title MuTox MuTox Scenario Feb 14, 2025
ImKeTT
ImKeTT approved these changes Feb 14, 2025
View reviewed changes
Copy link
Collaborator

@ImKeTT ImKeTT left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just left one minor comment, overall it looks good to me!

src/helm/benchmark/run_specs/audio_run_specs.py Outdated Show resolved Hide resolved
@teetone teetone merged commit 6552e67 into main Feb 17, 2025
8 checks passed
@teetone teetone deleted the audiohelm branch February 17, 2025 01:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ImKeTT ImKeTT ImKeTT approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@teetone @ImKeTT