pretrain

[liuchaoheshi]

Hello author, how did you do pre-training on ImageNet? Is it the ImageNet-1k dataset? Can you tell me the specific configuration?

[YXB-NKU]

https://github.com/huggingface/pytorch-image-models , we use timm to pretrain our model on imagenet-1k dataset, batchsize=1024, learning rate = 1e-3