what's meaning of checkpoint name suffixed with ra1/ra2/a1h1?

[lippman1125]

I found so many pretrained weights suffixed with ra1/a1h1 ? what do those abbreviations stand for?

[rwightman]

ra = rand-augment, so ra/ra2/ra3 are different hparam schemes involving rand-augment, generally adding more goodies / more aug + reg as the number increases. ra2/ra3 would roughly correspond to the 'B' hparams in https://arxiv.org/abs/2110.00476, so they're RMSProp based

a1 corresponds to the LAMB based A1 hparams in RSB paper. h means more augmentation + reg that the hparams in the paper, esp higher dropout/stochastic depth.