Crossing computer vision boundaries

[TheodoreGalanos]

Hello!

First of all thanks for sharing the code! It's amazing!

I wanted to ask a (noobish perhaps) question, apologize my ignorance if this is smth obvious.

Do you see any relevance or advantage for using the attention transfer techniques to other areas apart from computer vision. I was mainly thinking of NLP. Could smth like this help it in cases where specific important parts of the text are to be identified or in cases of text summarization?

Thanks in advance for the great work!

Kind regards,
Theodore.

[szagoruyko]

Thanks!
It should be indeed possible to apply attention transfer to NLP, we're actually thinking about training RNN with activation-based AT. Will update the paper and comment here when we get something.