mirror/whisper.cpp
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
86506b0c5c
whisper.cpp/ggml/src/ggml-cuda
History
Jeroen Mostert 86506b0c5c Allow all RDNA2 archs to use sdot4 intrinsic (llama/8629) 
The check gating the use of `__builtin_amdgc_sdot4` specifically checks for gfx1030. This causes a severe perf regression for anything gfx103? that's not gfx1030 and not using `HSA_OVERRIDE_GFX_VERSION` (if you've built ROCm to support it). We already have a generic RDNA2 define, let's use it.
2024-08-08 22:48:46 +03:00
..
template-instances CUDA: MMQ code deduplication + iquant support (llama/8495) 2024-08-08 22:48:46 +03:00
acc.cu whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
acc.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
arange.cu whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
arange.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
argsort.cu whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
argsort.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
binbcast.cu whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
binbcast.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
clamp.cu whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
clamp.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
common.cuh Allow all RDNA2 archs to use sdot4 intrinsic (llama/8629) 2024-08-08 22:48:46 +03:00
concat.cu whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
concat.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
conv-transpose-1d.cu feat: cuda implementation for ggml_conv_transpose_1d (ggml/854) 2024-07-08 14:53:55 +03:00
conv-transpose-1d.cuh feat: cuda implementation for ggml_conv_transpose_1d (ggml/854) 2024-07-08 14:53:55 +03:00
convert.cu whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
convert.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
cpy.cu Removes multiple newlines at the end of files that is breaking the editorconfig step of CI. (llama/8258) 2024-07-08 14:53:55 +03:00
cpy.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
dequantize.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
diagmask.cu whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
diagmask.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
dmmv.cu whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
dmmv.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
fattn-common.cuh CUDA: MMQ support for iq4_nl, iq4_xs (llama/8278) 2024-07-08 14:53:55 +03:00
fattn-tile-f16.cu whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
fattn-tile-f16.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
fattn-tile-f32.cu whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
fattn-tile-f32.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
fattn-vec-f16.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
fattn-vec-f32.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
fattn-wmma-f16.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
fattn.cu whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
fattn.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
getrows.cu whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
getrows.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
im2col.cu whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
im2col.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
mma.cuh CUDA: optimize and refactor MMQ (llama/8416) 2024-08-08 22:48:46 +03:00
mmq.cu CUDA: MMQ code deduplication + iquant support (llama/8495) 2024-08-08 22:48:46 +03:00
mmq.cuh CUDA: MMQ code deduplication + iquant support (llama/8495) 2024-08-08 22:48:46 +03:00
mmvq.cu CUDA: refactor and optimize IQ MMVQ (llama/8215) 2024-07-08 14:53:55 +03:00
mmvq.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
norm.cu whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
norm.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
pad.cu whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
pad.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
pool2d.cu whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
pool2d.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
quantize.cu CUDA: optimize and refactor MMQ (llama/8416) 2024-08-08 22:48:46 +03:00
quantize.cuh CUDA: optimize and refactor MMQ (llama/8416) 2024-08-08 22:48:46 +03:00
rope.cu whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
rope.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
scale.cu whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
scale.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
softmax.cu whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
softmax.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
sumrows.cu whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
sumrows.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
tsembd.cu whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
tsembd.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
unary.cu whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
unary.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
upscale.cu whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
upscale.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
vecdotq.cuh CUDA: MMQ code deduplication + iquant support (llama/8495) 2024-08-08 22:48:46 +03:00