fix: add fms-recommender wrapper #644
Open
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description of the change
The PR adds tuning-config-recommender functionality to fms-hf-tuning simplifying the fine-tuning experience for the end user.
This contributes
fms-recommender.pyscript which simplifies the tuning experience for the user and helps them avoid minor/major pitfalls which can hinder their tuning experience..With the help of
tuning-config-recommendernow we can correct erroneous launch commands or get the recommender to provide suggestions for various flags used while fine-tuning.The
fms-recommender.pyscript has a--previewflag which would preview the suggested command and not execute it..Note: by default without the
--previewflag the suggested command is executed !Following is a sample of running the command in preview mode:
Preview command:
Generates a valid
data_configfile with the datasets, chat-template, data_handlers, etc.Generates a valid
accelerate_configNote:
Currently the tuning-config-recommender is undergoing review cycles before its first release and hence the pyproject.yaml is not linked to a release version..
for now the pyproject would install via
due to pending essential PR's for FMSAdapter at : PR's are undergoing review!mainbranch which might not work the same way as shown aboveThe above commands can be replicated via installing recommender from the
mainbranchRelated issue number
How to verify the PR
Was the PR tested