llama: enable K-shift for quantized KV cache It will fail on unsupported backends or quant types. |
||
---|---|---|
.. | ||
cmake | ||
include | ||
src | ||
.gitignore | ||
CMakeLists.txt | ||
ggml_vk_generate_shaders.py |
llama: enable K-shift for quantized KV cache It will fail on unsupported backends or quant types. |
||
---|---|---|
.. | ||
cmake | ||
include | ||
src | ||
.gitignore | ||
CMakeLists.txt | ||
ggml_vk_generate_shaders.py |