Oobabooga WebUI had a HUGE update adding ExLlama and ExLlama_HF model loaders that use LESS VRAM and have HUGE speed increases, and even 8K tokens to play around with compared to the previous limit of 2K! This is insanely powerful and will be a huge timesaver for creators, and may even help users with less powerful graphics cards use LLMs!

OpenAI Tokenizer: [ Ссылка ]

Timestamps:
0:00 - What's new (It's CRAZY!)
0:44 - Open Oobabooga install directory
1:02 - Update Oobabooga WebUI
1:18 - VRAM usage & speed before update (4.3 tokens/s)
1:56 - Fix missing option or update errors
2:33 - Choosing new ExLlama model locader
2:52 - Downloading new model types (8k models)
4:25 - New VRAM & Speed (20 tokens/s! INSANE!)
5:25 - Raise token limit from 2,000 to 8,000+!
7:17 - How many tokens is your text?
7:50 - How long is 8k tokens?
8:45 - EVEN LESS VRAM with ExLlama_HF

#Oobabooga #AI #LLM
-----------------------------
💸 Found this useful? Help me make more! Support me by becoming a member: [ Ссылка ]
-----------------------------
💸 Support me on Patreon: [ Ссылка ]
💸 Direct donations via Ko-Fi: [ Ссылка ]
💬 Discuss the video & Suggest (Discord): [ Ссылка ]
👉 Game guides & Simple tips: [ Ссылка ]
🌐 Website: [ Ссылка ]
📧 Need voiceovers done? Business query? Contact my business email: TroubleChute (at) tcno.co
-----------------------------
🎨 My Themes & Windows Skins: [ Ссылка ]
👨💻 Software I use: [ Ссылка ]
➡️ My Setup: [ Ссылка ]
🖥️ My Current Hardware (Links here are affiliate links. If you click one, I'll receive a small commission at no extra cost to you):
Intel i9-13900k - [ Ссылка ]
GIGABYTE Z790 AORUS Master - [ Ссылка ]
G.Skill RipJaws 2x(2x32G) [128GB] - [ Ссылка ]
Corsair H150i 360mm AIO - [ Ссылка ]
MSI 3080Ti Gaming X Trio - [ Ссылка ]
Corsair 1000W RM1000i - [ Ссылка ]
Corsair MP600 PRO XT 2TB - [ Ссылка ]
🎙️ My Current Mic/Recording Gear:
Shure SM7B - [ Ссылка ]
Audient iD14 - [ Ссылка ]
dbx 286s - [ Ссылка ]
Triton Audio FetHead - [ Ссылка ]

Everything in this video is my personal opinion and experience and should not be considered professional advice. Always do your own research and ensure what you're doing is safe.

свернуть