VRAM usage? #185
fullstackwebdev
started this conversation in
General
VRAM usage?
#185
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
What's the typical VRAM usage? Will 20B NeoX train on a 3090 given it might be possible to do so in 8bit? Or how much VRAM is needed for various models? Curious, what about GPTJ6b?
Beta Was this translation helpful? Give feedback.
All reactions