Skip to content

Conversation

astappiev
Copy link

Issue

When using Zephyr from RankLLM, it returns a list of results (because it calls rerank_batch with a single item).

Naturally, it's not expected behaviour, and the rerankers crash with an error

list does not have attribute 'candidates'

Changes

We check if we got a list, and if so, unwrap it.

Sending a PR to upstream might be more difficult because it will be a breaking change there.

Testing

Zephyr reranker from RankLLM works after fixing this issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant