Maybe helpful for those running this on AMD: A fork from [**🍋 llamacpp-rocm**](https://github.com/lemonade-sdk/llamacpp-rocm) but based on [TheTom/llama-cpp-turboquant](https://github.com/TheTom/llama-cpp-turboquant) to get regular builds for AMD ROCm boards. https://github.com/stefan1000/llamacpp-rocmcpp-turboquant/releases
Maybe helpful for those running this on AMD:
A fork from 🍋 llamacpp-rocm but based on TheTom/llama-cpp-turboquant to get regular builds for AMD ROCm boards.
https://github.com/stefan1000/llamacpp-rocmcpp-turboquant/releases