So which version should i use?
#1
by shivshankar - opened
So which version should i use?
I am still finding that out, the txt attn layers affect the text conditioning following of the model. The real loss, I cant say as I have not done enough testing. I would say it more depends on your needs and if the task needs the precision of those layers at bf16.