Checkpoints of Villa models to run on validation set

[JurijsNazarovs]

Hello,

Thanks for your work and available code. I have downloaded your checkpoints using
download_pretrained.sh

It downloaded several VILLA models, where one of them is villa-base.pt. Then I would like to run the validation on the checkpoint model as

python train_vqa_adv.py --config config/train-vqa-base-1gpu-adv.json --checkpoint saved_data/pretrained/villa-base.pt  --valid_steps 1

However, I noticed that when model is loaded from the checkpoint, weights of self.vqa_output are not updated. What would be your suggestion if I want to take your best model and use it to run on a validation set?