zlacker

The plan was to do it in-house. And buying 8xA100 is a bit too much ;)

>>indeye+(OP)
I'm in the exactly same boat. Targeting to fine tune llama 2 70b on 2xA100, with the hope of having one A100 run an 8bit quantized 70b model 24/7.

If you have an experiences to share, successes or failures, please do.