-
Notifications
You must be signed in to change notification settings - Fork 2
feat: add adapter for fms-hf-tuning #4
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: add adapter for fms-hf-tuning #4
Conversation
Signed-off-by: yashasvi <[email protected]>
4b26e3e to
be24bb1
Compare
Signed-off-by: yashasvi <[email protected]>
Signed-off-by: yashasvi <[email protected]>
c9e16d3 to
e1235bc
Compare
Signed-off-by: yashasvi <[email protected]>
e1235bc to
4a43163
Compare
|
Will soon add Fixes for Error Handling with Datasets and ChatData.. |
|
Can you paste the corresponding PR and design on how you are planning to use this adapter with fms-hf-tuning? |
|
Attached the PR for fms-recommender.py script which used |
|
why is that PR foundation-model-stack/fms-hf-tuning#644 in draft? |
|
Its open for review now ! |
|
Once the fms-hf-tuning PR is merged. Please add one example on e2e usage using fms-hf-tuning in this repo and then refer that in README.md of this repo. |
Addresses Issue: #2
This PR introduces the FMS-HF Adapter, that converts model, compute, and data configs to fms-hf-tuning ready training configs.
The
FMSAdapterextends theVanillaAdapterto convert the processed Intermediate Representation (IR) into runnable fms-hf training configurations.data_config.yamlderived directly from the IR’sdata_preprocessorsection.dist_configdata_config.