ExLLAMA is a real breakthrough in the LLM community! This innovative update for the text-generation LLM webui not only can increase the TOKENS capacity of a LLAMA model to 8K+, it also significantly REDUCES the VRAM usage, and gives a MAJOR SPEED BOOST to text generation and in this video, I'll show you how to use it.
What do you think of ExLLAMA? Let me know in the comments!
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
SOCIAL MEDIA LINKS!
✨ Support my work on Patreon: [ Ссылка ]
⚔️ Join the Discord server: [ Ссылка ]
🧠 My Second Channel THE MAKER LAIR: [ Ссылка ]
📧 Business Contact: theaitrepreneur@gmail.com
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
JOIN MY DISCORD SERVER : [ Ссылка ]
Watch my Oobabooga Webui install guide: [ Ссылка ]
ExLlama: [ Ссылка ]
KaioKendev discovery: [ Ссылка ]
TheBloke's 8K models: [ Ссылка ]
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
►► My PC & Favorite Gear:
i9-12900K: [ Ссылка ]
RTX 3090 Gigabyte Vision OC : [ Ссылка ]
SAMSUNG 980 PRO SSD 2TB PCIe NVMe: [ Ссылка ]
Kingston FURY Beast 64GB 3200MHz DDR4 : [ Ссылка ]
iCUE 4000X - White: [ Ссылка ]
ASRock Z690 DDR4 : [ Ссылка ]
Corsair RM850 - White : [ Ссылка ]
Corsair iCUE SP120 : [ Ссылка ]
Noctua NH-D15 chromax.Black : [ Ссылка ]
EDUP PCIe WiFi 6E Card Bluetooth : [ Ссылка ]
Recording Gear:
Rode PodMic : [ Ссылка ]
Rode AI-1 USB Audio Interface : [ Ссылка ]
Rode WS2 Microphone Pop Filter : [ Ссылка ]
Elgato Wave Mic Arm : [ Ссылка ]
Stagg XLR Cable - Black - 6M : [ Ссылка ]
FetHead Microphone Preamp : [ Ссылка ]
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Special thanks to Royal Emperor:
- Totoro
- TNSEE
- RARE - beacons.ai/mcookisuki
- Judi Godvliet
Thank you so much for your support on Patreon! You are truly a glory to behold! Your generosity is immense, and it means the world to me. Thank you for helping me keep the lights on and the content flowing. Thank you very much!
#GPT4 #GPT3 #ChatGPT #ExLLAMA
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
WATCH MY MOST POPULAR VIDEOS:
RECOMMENDED WATCHING - All LLM & ChatGPT Video:
►► [ Ссылка ]
RECOMMENDED WATCHING - My "Tutorial" Playlist:
►► [ Ссылка ]
Disclosure: Bear in mind that some of the links in this post are affiliate links and if you go through them to make a purchase I will earn a commission. Keep in mind that I link these companies and their products because of their quality and not because of the commission I receive from your purchases. The decision is yours, and whether or not you decide to buy something is completely up to you.
