[FEATURE] Swin Transformer for large image

[CuongNN218]

I want to train Swin Transformer for larger image for example 768 x 768 with pretrained models. How can I deal with it ?

[achilleess]

Do you mean your HappyWhale LB score has been achieved without transformers? :)

[CuongNN218]

@achilleess I'm trying to make our model more diverse :)) Using Swin or transformer-based models is a good idea

[rwightman]

@CuongNN218 unless you have a cluster of A100's you'd like to donate, not going to happen. Moving to discussion.