Initialize a load weights from a checkpoint into a LightningModule
w/o loading in training state
#20688
Unanswered
EthanMarx
asked this question in
Lightning Trainer API: Trainer, LightningModule, LightningDataModule
Replies: 1 comment 1 reply
-
I suppose you would need to add an optional parameter to your module and implement this logic. I don't know if there is any other way to do that. |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I am trying to initialize a training run using a
LightningCLI
, where I want myLightningModule
to only load in the weights from a lightning checkpoint.I don't want the saved training state (e.g. scheduler / optimizer state) to be initialized from the checkpoint. It's my understanding that using the
--ckpt_path
flag will load in scheduler / optimizer state.How can I initialize a training run from pre-trained weights w/o loading in this additional state?
Beta Was this translation helpful? Give feedback.
All reactions