Watch the video:
Timestamps:
0:00 - Intro/Explanation
0:14 - What is Open Assistant
0:56 - License
1:26 - What we're downloading
2:00 - Requirements
2:20 - Install Open Assistant and Oobabooga WebUI
5:30 - VRAM & RAM usage and info
6:30 - Using Open Assistant in Oobabooga WebUI
8:46 - Using smaller Open Assistant models
This is one of the larger models but one of the best. Community sourced, licensed under terms that let you use it far more freely, constantly improving and free for use online should you not meet its ~24GB RAM/VRAM requirement. This guide shows you a one-click install script I made to make life easier. Oobabooga WebUI is set up, as well as the model downloaded. Ready to use in minutes (it’s mainly the download).
Use Open Assistant online: https://open-assistant.io/
Install one-liner: iex (irm oasst.tc.ht)