Transfer learning for a pretrained transformer to another dataset

[Oussamab21]

thanks for sharing this great peice of art, I am trying to use pretrained transformers with my own dataset I was wondering what should I change beside the number of outputs(number of my own dataset classes), be cause I saw that most of vision transformers follow the same training setup used in DeiT ?
thanks in advance