Compile Grounding DINO

[pspdada]

Feature request

I found that the Gounding DINO model IDEA-Research/grounding-dino-base cann't be compiled.
When I use torch.comple(<The model>), it raises many error, such as TypeError: unhashable type: 'dict'.
can this be implemented?

Motivation

It's very slow for Grounding DINO to perform batch inference, so I want some way to speed it up.

Your contribution

Not sure.

[zucchini-nlp]

maybe cc @yonigozlan who is working on compile for with a few vision models

[yonigozlan]

Yes! I'll get to it once I have a bit more bandwidth, but in the meantime if you want to have a go at it, part of the solution should be similar to what was done in #33600