- 000
Hello!
I am using a p3.8xlarge ec2 instance with GPU mem of 64gb
(https://aws.amazon.com/ec2/instance-types/p3/)
I have reduced batch-size and max-inference-batch-size to 1
and also installed:
pip install git+https://github.com/Sleepychord/Image-Local-Attention
however I am still getting this OOM, w...