zlacker

>>mfigui+(OP)
As I understand, Vulkan allows to run custom code on GPU, including the code to multiply matrices. Can one simply use Vulkan and ignore CUDA, PyTorch and ROCm?

>>codedo+pF1
there's a pretty cool Vulkan LLM engine here for example:

https://github.com/mlc-ai/mlc-llm