zlacker

there's a pretty cool Vulkan LLM engine here for example:

https://github.com/mlc-ai/mlc-llm