Commit 2d66deb
committed
Add Qwen3.6-27B (dense) to tested models (#4)
Qwen3.6-27B is a dense Mamba+attention hybrid. It runs in BF16 on gfx1151 —
loads and serves chat completions end to end. Weights are ~52 GB, so on a
64 GB-GTT box it needs cache-fit flags; it's comfortable on 96 GB+ GTT.
4-bit doesn't help yet: the compressed-tensors wNa16 quant calls the
NVIDIA-only gptq_marlin_repack and won't load on ROCm. Noted as a failing
row so others skip the dead end.1 parent 4e0e260 commit 2d66deb
1 file changed
Lines changed: 2 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
23 | 23 | | |
24 | 24 | | |
25 | 25 | | |
| 26 | + | |
| 27 | + | |
26 | 28 | | |
27 | 29 | | |
28 | 30 | | |
| |||
0 commit comments