[Feature] the new flux/bonsai model

[dfgdrfgyhfgfvtg]

Feature Summary

bonsai addition to te reppo

Detailed Description

is there any chance you can add the new light weight flux/bonsai model because its good quality to for the computation and time of generation

Alternatives you considered

No response

Additional context

No response

[Green-Sky]

bonsai-image is just flux2 klein 4b.

I made compatible ggufs for the binary release here https://huggingface.co/Green-Sky/bonsai-image-binary-4B-GGUF

For ternay there is missing quant support in ggml/llama.cpp. See #331

[dfgdrfgyhfgfvtg]

so i just have to use that and it will work?

[dfgdrfgyhfgfvtg]

im really sorry i just want to use it so please any help is appreciated

[Green-Sky]

Just check the sd.cpp docs on how to use flux2 klein 4b, and sub in this gguf as the diffusion model.
https://huggingface.co/Green-Sky/bonsai-image-binary-4B-GGUF/blob/main/bonsai_image_4b-mod_q8_0-q1_0.gguf

[dfgdrfgyhfgfvtg]

im really sorry for the bother but im new to tis so even if i read it i cant really do anytthing