Add VideoMAE#17821

Merged

NielsRogge merged 42 commits intohuggingface:mainfrom

NielsRogge:add_videomae

Aug 4, 2022

Commits on Aug 2, 2022

First draft

NielsRogge
authored and
Niels Rogge
committed
Add VideoMAEForVideoClassification

Niels Rogge
authored and
Niels Rogge
committed
Improve conversion script

Niels Rogge
authored and
Niels Rogge
committed
Add VideoMAEForPreTraining

Niels Rogge
authored and
Niels Rogge
committed
Add VideoMAEFeatureExtractor

Niels Rogge
authored and
Niels Rogge
committed
Improve VideoMAEFeatureExtractor

Niels Rogge
authored and
Niels Rogge
committed
Improve docs

Niels Rogge
authored and
Niels Rogge
committed
Add first draft of model tests

Niels Rogge
authored and
Niels Rogge
committed
Improve VideoMAEForPreTraining

Niels Rogge
authored and
Niels Rogge
committed
Fix base_model_prefix

Niels Rogge
authored and
Niels Rogge
committed
Make model take pixel_values of shape (B, T, C, H, W)

Niels Rogge
authored and
Niels Rogge
committed
Add loss computation of VideoMAEForPreTraining

Niels Rogge
authored and
Niels Rogge
committed
Improve tests

Niels Rogge
authored and
Niels Rogge
committed
Improve model testsé

Niels Rogge
authored and
Niels Rogge
committed
Make all tests pass

Niels Rogge
authored and
Niels Rogge
committed
Add VideoMAE to main README

Niels Rogge
authored and
Niels Rogge
committed
Add tests for VideoMAEFeatureExtractor

Niels Rogge
authored and
Niels Rogge
committed
Add integration test

Niels Rogge
authored and
Niels Rogge
committed
Improve conversion script

Niels Rogge
authored and
Niels Rogge
committed
Rename patch embedding class

Niels Rogge
authored and
Niels Rogge
committed
Remove VideoMAELayer from init

Niels Rogge
authored and
Niels Rogge
committed
Update design of patch embeddings

Niels Rogge
authored and
Niels Rogge
committed
Improve comments

Niels Rogge
authored and
Niels Rogge
committed
Improve conversion script

Niels Rogge
authored and
Niels Rogge
committed
Improve conversion script

Niels Rogge
authored and
Niels Rogge
committed
Add conversion of pretrained model

Niels Rogge
authored and
Niels Rogge
committed
Add loss verification of pretrained model

Niels Rogge
authored and
Niels Rogge
committed
Add loss verification of unnormalized targets

Niels Rogge
authored and
Niels Rogge
committed
Add integration test for pretraining model

Niels Rogge
authored and
Niels Rogge
committed
Apply suggestions from code review

Niels Rogge
authored and
Niels Rogge
committed
Fix bug to make feature extractor resize only shorter edge

Niels Rogge
authored and
Niels Rogge
committed
Address more comments

Niels Rogge
authored and
Niels Rogge
committed
Improve normalization of videos

Niels Rogge
authored and
Niels Rogge
committed
Add doc examples

Niels Rogge
authored and
Niels Rogge
committed
Move constants to dedicated script

Niels Rogge
authored and
Niels Rogge
committed
Remove scripts

Niels Rogge
authored and
Niels Rogge
committed
Transfer checkpoints, fix docs

Niels Rogge
authored and
Niels Rogge
committed
Update script

Niels Rogge
authored and
Niels Rogge
committed

Commits on Aug 3, 2022

Update image mean and std

Niels Rogge
authored and
Niels Rogge
committed
Fix doc tests

Niels Rogge
authored and
Niels Rogge
committed
Set return_tensors to NumPy by default

Niels Rogge
authored and
Niels Rogge
committed

Commits on Aug 4, 2022

Revert the previous change

Niels Rogge
authored and
Niels Rogge
committed