Issue about num_depth_candidates while fine-tuning from the released weights

[Selena1105]

Hi! Thank you for sharing this great job.

I am trying to fine-tune from the released re10k.ckpt. It works well with the original config, but raises the error below when I change the value of num_depth_candidates (128 -> 64). I wonder whether I could use different values of num_depth_candidates when fine-tuning, or should follow the setting of 128 ?

Thank you for your help!