Hi, regarding the EMA functionality of the model, I noticed that the _EMA model in the code doesn't participate in model inference, training, or model saving (only non-EMA models participate). The EMA model only participates in recording within the ema_step function, essentially playing no role. Is that correct?
Hi, regarding the EMA functionality of the model, I noticed that the _EMA model in the code doesn't participate in model inference, training, or model saving (only non-EMA models participate). The EMA model only participates in recording within the ema_step function, essentially playing no role. Is that correct?