CUDA/HIP: refractor mmqv to unify the calculation of nwarps and rows per block between host and device code.#12177

Merged

IMbackK merged 5 commits intoggml-org:masterfrom IMbackK:refactor_mmqv

Mar 11, 2025

Commits on Mar 4, 2025

refractor mmqv to unify the calculation of nwarps and rows per block between host and device code.
IMbackK
committed
make cuda happy, as it dosent support calling host constexpr functions in device code, even though that should not be a problem.
IMbackK
committed

Commits on Mar 6, 2025

Commits on Mar 7, 2025

Update ggml/src/ggml-cuda/mmvq.cu

IMbackK
and
JohannesGaessler
authored