Training tips for transformer models

[parth4594]

Supposing we are using a custom dataset to train our transformer model (a dataset with more features up to 13), we certainly would make relevant changes to our training parameters. To obtain the best results, how should we optimize those parameters. Please share some tips or some document that can help understand as to how should one select training parameters?

Thanks