errer: tramsform Model to Torch Script

[huangzhenjie]

when I want to save the trained Model as .pt. The error is (RuntimeError:
Could not export Python function call 'SwishImplementation'. Remove calls to Python functions before export. Did you forget add @script or @script_method annotation? If this is a nn.ModuleList, add it to constants:) . How could I solve it? thanks!!!

[lukemelas]

Hello! Yes, the latest update to the swish implementation saves memory but broke torchscript. An update to fix this is coming.

[lukemelas]

Done -- check the latest update!

[huangzhenjie]

thanks!! let me try.

[xiaoliumi]

thanks!! let me try.

Do you get it done on this issue? I am precisely in the same trouble. My pytorch version is 1.3.1.

[ne-bo]

Hi Luke!
Thanks a ton for this wonderful repo!

I have problems with scripting your implementation:
Getting attributes of tuples is not supported:
Getting attributes of tuples is not supported:
at /home/pavlovskaya/anaconda3/envs/antispoofing/lib/python3.7/site-packages/efficientnet_pytorch/model.py:76:11
def forward(self, inputs, drop_connect_rate=None):
"""
:param inputs: input tensor
:param drop_connect_rate: drop connect rate (float, between 0 and 1)
:return: output of block
"""

    # Expansion and Depthwise Convolution
    x = inputs
    if self._block_args.expand_ratio != 1:
       ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ <--- HERE
        x = self._swish(self._bn0(self._expand_conv(inputs)))
    x = self._swish(self._bn1(self._depthwise_conv(x)))

And with tracing:
torch.jit.frontend.NotSupportedError: Compiled functions can't take variable number of arguments or use keyword-only arguments with defaults:

So, unfortunately, can't use the EN((((

[jesford]

I am having the same issue as @ne-bo, has there been any progress on this? Thanks so much!

[Daonancai]

I am having the same issue too

[Podidiving]

0.7.0 version has the same issue

[mzuzic]

A workaround is to set model.set_swish(memory_efficient=False) before saving.

[medric49]

Hi !
Thanks a lot for this repo !

I have encountered the same problem stated at the beginning of this issue. When I try to get the torch script of my efficientnet model I get this error

RuntimeError:
Python builtin <built-in method apply of FunctionMeta object at 0x9145330> is currently not supported in Torchscript:
File "/home/xxx/.local/lib/python3.8/site-packages/efficientnet_pytorch/utils.py", line 76
def forward(self, x):
return SwishImplementation.apply(x)
~~~~~~~~~~~~~~~~~~~~~~~~~ <--- HERE

This is my code

model = EfficientNet.from_pretrained('efficientnet-b2', num_classes=10)
torch.jit.script(model).save('model.ptc')

My pytorch version is 1.7.1
And my efficientnet_pytorch version is 0.7.0

Thanks

[mikel-brostrom]

Than you @mzuzic for #89 (comment)
Any news regarding export with memory efficient swish?