Watch the video:
Timestamps:
0:00 - Explanation
0:30 - Check if extensions are installed/compatible
1:05 - DeepSpeed Wiki
1:28 - Install DeepSpeed with optional extensions
3:30 - Checking optional extensions installed
3:40 - Fix GCC errors when installing DeepSpeed
Looking to use Adam with DeepSpeed, or another extension? This video shows you how to install DeepSpeed with optional extensions. By the end, you should know how to customise your installation and get everything you want to set up.
DeepSpeed install guide: https://www.deepspeed.ai/tutorials/advanced-install/
GCC levels for CUDA versions: https://stackoverflow.com/a/46380601