out of memory even with multi-card training

[YuanbinLiu]

Describe the bug
My attempt to train MACE with multiple 4090 cards was unsuccessful.

Expected behavior
I wish to train MACE in parallel using multiple graphics cards.

Screenshots

[davkovacs]

We are working on multi-GPU training in this PR: #105
I recommend you either wait a little longer until we merge it, or you can have a go trying it by checking out the fork in the PR. A few people have started testing it and it seems to work.

[ilyes319]

Closing this as duplicate of #10, please use the PR #105 for now. For now you can either use a larger GPU or switch to a smaller model/batch size. Reducing the number of channels significantly helps with memory.