First of all I want to thank you this great project, but I've found a litle improvement. The thing is that if I create a model using CRD, I delete it and then create one diferent model, all models are served by the new POD (new ones and old ones). Same happens if I create two models: all PODs serves all models.
So, my suggestion is to have one serving PODs set managed by a Replica Set, and applying models would be just a job that download model to the model store. It will be served by the serving PODs.
I don't know if it would be possible (or how is it done) to delete models when delete the CRD resource.
Sorry muy poor english :-)
First of all I want to thank you this great project, but I've found a litle improvement. The thing is that if I create a model using CRD, I delete it and then create one diferent model, all models are served by the new POD (new ones and old ones). Same happens if I create two models: all PODs serves all models.
So, my suggestion is to have one serving PODs set managed by a Replica Set, and applying models would be just a job that download model to the model store. It will be served by the serving PODs.
I don't know if it would be possible (or how is it done) to delete models when delete the CRD resource.
Sorry muy poor english :-)