AMD GPU Linux bitsandbytes installation - step by step guide for 8-bit functions

Описание

Bitsandbytes use quantitizations to save VRAM so you can run larger models ?ⓢⓤⓑⓢⓒⓡⓘⓑⓔ Thank you for watching! please consider to subscribe. thank you!

For Linux Ubuntu install, please see https://youtu.be/2H321xb2jA8
For Linux ROCm install, see https://youtu.be/coGVsROvMC4

The AMD GPU model is 6700XT. Should work for other 6000 series AMD GPUs.
The repo url is: https://git.ecker.tech/mrq/bitsandbytes-rocm

Please join the discord server at https://discord.gg/SgmBydQ2Mn where you can ask questions and also try out my recently developed free chatgpt bot and stable diffusion bot!
If you would like to support me, here is my Kofi link: https://ko-fi.com/techpractice and Patreon page: https://www.patreon.com/user?u=89548519
Thank you for watching!