Simple question, can I load this model in 8bit mode?
#13
by
nmitchko - opened
Very simple question, I have been working in 8bit mode on GPT-j-6B (the original) and was wondering if I can load this model in 8bit mode?
Sure, but it wasn't answered in discussion 12
@vilimus
nmitchko changed discussion status to
closed