How large memory is required for the experiment

[amiltonwong]

Hi, @lucidrains ,

Thanks you a lot for releasing the prototype so quickly. How large memory is required for the experiment?

THX!

[lucidrains]

@amiltonwong thanks for your interest! I'll be trying it out next week in some generative models

have you tried it and found it to be memory intensive?

[PistonY]

I try out LambdaResnet50 with 64 batch_size about cost 9-10GB gpu memory in FP32 precision,it's much larger than Resnet50

[jason90330]

Thanks you for your Implementation so efficientcy, but I have the similar problems to @PistonY .
I use the lambda layer before I feed my image to the efficientNet-b4, and I would like to move my model into GPU but it took 18.76GB.

Here is the parameters in my lambda layer.

[VuHoangvn]

You should specify r

[jason90330]

@VuHoangvn Thank a lot, I have revised the question I asked before, but I am still wondering if I can use the lambda layer into other SOTA model such as efficientnet. just like the image I post, can I insert this layer in front of my model directly? thank you.
BTW, I have tested the score of the question I asked, but I got a lower score than without the lambda layer.