hi, I looked up a lot of information. but I still don't understand the difference between zero-3 and megatron with zero-2. they all split the model.
hi, I looked up a lot of information.
but I still don't understand the difference between zero-3 and megatron with zero-2.
they all split the model.