#llm-inference

llama.cpp speeds AMD RDNA3/4 inference with Vulkan int8 coopmat

A new cooperative-matrix matmul path in the Vulkan backend lifts prompt and token throughput on Radeon RX 7900-class GPUs.