Vulkan backend much easier on the CPU and GPU memory than CUDA.

Explore the performance benefits of Vulkan-based LLM inference over CUDA for heterogenous computing environments. Developers can create a performance comparison library to help users choose the right backend based on their specific hardware configuration.

Suggested repo: vulk-bench

"Why Vulkan might be the secret weapon for your local AI performance."

Estimated effort: 20h