Dual 3060Ti system to run large language model using Exllama. Upcoming videos will try dual AMD GPU. Subscribe to stay tuned!
The github repo link is: [ Ссылка ]
👉ⓢⓤⓑⓢⓒⓡⓘⓑⓔ Thank you for watching! please consider to subscribe. thank you!

For Linux Ubuntu install, please see [ Ссылка ]
For Linux ROCm install, see [ Ссылка ]
For Pytorch Install, see [ Ссылка ]

Affiliate links: buy on Amazon
4600G [ Ссылка ]
5600G: [ Ссылка ] (same iGPU, better CPU)
5700G: [ Ссылка ] (better iGPU, and better CPU)
ssd drive: [ Ссылка ]
DDR4 drive: [ Ссылка ]
AM4 motherboard: [ Ссылка ]
PSU (power supply unit): [ Ссылка ]
PC Case: [ Ссылка ]
if you are interested in discrete GPU: [ Ссылка ]

0:6 Intro
0:15 showcase of the dual gpu system
2:30 list the gpu available in the system
4:20 Running exllama powered chat app

Please join the discord server at [ Ссылка ] where you can ask questions and also try out my recently developed free chatgpt bot and stable diffusion bot!
If you would like to support me, here is my Kofi link: [ Ссылка ] and Patreon page: [ Ссылка ]
Thank you for watching!

свернуть