Schedulers
#643
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
{{ message }}
-
Hello, I need some help on LR schedulers. I tried polynomial, but I don't really understand how LR decrease over time and how to set a Min Learning rate. Same for cosine, how can I tell the training to don't go under a learning rate of 1e-6 for example ? In the same way, how work the scale learning rate ?
I you have any good resource, please share.
thanks
Beta Was this translation helpful? Give feedback.
All reactions