ggml-hrx: kernels for ZAYA's router and grouped conv; ZAYA1-8B decodes entirely on HRX (25.5 → 47.9 tok/s) - #24

ggml-hrx: kernels for ZAYA's router and grouped conv; ZAYA1-8B decodes entirely on HRX (25.5 → 47.9 tok/s)#24

bong-water-water-bong merged 2 commits into

1bit/hrx-vulkan-patched1bit-MONSTER/llama.cpp:1bit/hrx-vulkan-patchedfrom

1bit/hrx-zaya-kernels1bit-MONSTER/llama.cpp:1bit/hrx-zaya-kernelsCopy head branch name to clipboard