[WIP] Add DINO DETR Model to HuggingFace Transformers#36711

Open

konstantinos-p wants to merge 104 commits intohuggingface:mainfrom

konstantinos-p:dino_detr_model

Commits on Dec 10, 2025

First commit for DINO - DETR. Copy-paste files from Deformable DETR and original DINO repo. Substitute Deformable for DINO where needed.
Konstantinos Pitas
committed
Add dino detr loss
Konstantinos Pitas
committed
First implementation of dino detr post processor
Konstantinos Pitas
committed
Add misc functions to dino modeling, make config first version
Konstantinos Pitas
committed
Restructure dino detr modeling code, major changes are now required only in the DINO class
Konstantinos Pitas
committed
Match config to source code in modeling dino detr, defaults in config are still missing
Konstantinos Pitas
committed
Clean up dino_detr_config
Konstantinos Pitas
committed
Fixed import errors, code can now be executed
Konstantinos Pitas
committed
Model now can be instantiated with random weights
Konstantinos Pitas
committed
Forward pass for randomly initialized model now executes without errors
Konstantinos Pitas
committed
Forward pass works for DINO model with pretrained weights and matches original repo
Konstantinos Pitas
committed
Add dino detr conversion to pytorch script
Konstantinos Pitas
committed
Ensure model outputs for single COCO image are within 1e-3 error of reference
Konstantinos Pitas
committed
Add draft unit tests
Konstantinos Pitas
committed
Apply make style
Konstantinos Pitas
committed
Modeling integration test passes
Konstantinos Pitas
committed
Add integration and unit tests
Konstantinos Pitas
committed
Remove unnecessary dependency on pretrained model class from some classes
Konstantinos Pitas
committed
All image processing tests pass
Konstantinos Pitas
committed
Consistently start module names with DinoDetr
Konstantinos Pitas
committed
Pass test_hidden_states_output test
Konstantinos Pitas
committed
Dino detr doesn't support gradient checkpointing
Konstantinos Pitas
committed
Pass test_model_is_small test
Konstantinos Pitas
committed
Pass test_model_outputs_equivalence test
Konstantinos Pitas
committed
Pass test_attention_outputs
Konstantinos Pitas
committed
Pass test_retain_grad_hidden_states_attentions
Konstantinos Pitas
committed
Pass safetensor tests
Konstantinos Pitas
committed
All tests pass for the first model draft
Konstantinos Pitas
committed
Convert weights to hf using a single key mapping and regex
Konstantinos Pitas
committed
Add some missing copied_from comments, these work with the huggingface compiler
Konstantinos Pitas
committed
Move all asserts to the config
Konstantinos Pitas
committed
Remove some unused config parameters
Konstantinos Pitas
committed
Remove unused config parameters, simplify inits
Konstantinos Pitas
committed
Clean up decoder code
Konstantinos Pitas
committed
Clean up deformable transformer code
Konstantinos Pitas
committed
Clean DinoDetrModel code
Konstantinos Pitas
committed
Clean up DinoDetrForObjectDetection class
Konstantinos Pitas
committed
Add type hints
Konstantinos Pitas
committed
Add a model checkpoint to hub
Konstantinos Pitas
committed
Fix copied from in image_processing_dino_detr
Konstantinos Pitas
committed
Some changes to make copied from mechanism work
Konstantinos Pitas
committed
Fix more code quality errors
Konstantinos Pitas
committed
Fill missing values config docstring
Konstantinos Pitas
committed
Add dino detr to models/__init__.py file
Konstantinos Pitas
committed
DinoDetrDeformableTransformer is recognized as a model, attempt a fix
Konstantinos Pitas
committed
Attempt fix for DinoDetrDeformableTransformer getting classified as a model
Konstantinos Pitas
committed
Add docs template
Konstantinos Pitas
committed
Add missing model type to the constant
Konstantinos Pitas
committed
Remove config from loss function definition
Konstantinos Pitas
committed
Remove unused config parameters
Konstantinos Pitas
committed
DinoDetr docs first complete draft
Konstantinos Pitas
committed
Clean docstrings
Konstantinos Pitas
committed
Add docs to toctree.yml
Konstantinos Pitas
committed
Fix some errors after rebase
Konstantinos Pitas
committed
Update deformable attention definition
Konstantinos Pitas
committed
Implement using modular
Konstantinos Pitas
committed
Apply conditions on some imports
Konstantinos Pitas
committed
Remove asserts from postprocessing method
Konstantinos Pitas
committed
Sort imports
Konstantinos Pitas
committed
Small fixes
Konstantinos Pitas
committed
Style changes from make fixup
Konstantinos Pitas
committed
Small fixes
Konstantinos Pitas
committed
Address reviewer comments
Konstantinos Pitas
committed
Clean up dino_loss import from detection_loss when possible
Konstantinos Pitas
committed
Clean up configuration_dino_detr.py
Konstantinos Pitas
committed
Clean up convert_dino_detr_to_pytorch.py
Konstantinos Pitas
committed
Remove feature extraction file
Konstantinos Pitas
committed
Address reviewer comments
Konstantinos Pitas
committed
Replace _get_activation_fn with ACT2FN
Konstantinos Pitas
committed
Use get_contrastive_denoising_training_group from rt_detr
Konstantinos Pitas
committed
Reuse deformable_detr image_processor
Konstantinos Pitas
committed
Simplify config
Konstantinos Pitas
committed
Clean up modular code, add comments
Konstantinos Pitas
committed
Cleanup of embeddings
Konstantinos Pitas
committed
Cleanup embeddings
Konstantinos Pitas
committed
Cleanup: remove layer dropout, two_stage options, ref_token, etc
Konstantinos Pitas
committed
Clean modeling code
Konstantinos Pitas
committed
Add DinoDetrImageProcessor to __all__
Konstantinos Pitas
committed
Make fix copies
Konstantinos Pitas
committed
Revert changes to test modeling deformable detr
Konstantinos Pitas
committed
Small fix
Konstantinos Pitas
committed
Fix docstring
Konstantinos Pitas
committed
Ignore docstring consistency, it throws misleading errors
Konstantinos Pitas
committed
Add architecture link to config docstring
Konstantinos Pitas
committed
Replace return_dict with can_return_tuple
Konstantinos Pitas
committed
Use _can_record_outputs instead of output_attentions output_hidden_states
Konstantinos Pitas
committed
Simplify code
Konstantinos Pitas
committed
Simplify layer share
Konstantinos Pitas
committed
Make code simpler
Konstantinos Pitas
committed
Rename cardinality loss to cardinality error
Konstantinos Pitas
committed
Remove redundant imports from modular
Konstantinos Pitas
committed
Improve docs
Konstantinos Pitas
committed
Fix failing tests after rebase
Konstantinos Pitas
committed
Fix most tests apart from test_can_use_safetensors and test_load_save_without_tied_weights
Konstantinos Pitas
committed
Remove tied weights
Konstantinos Pitas
committed
Simplify code
Konstantinos Pitas
committed
Simplify _can_record_outputs
Konstantinos Pitas
committed
Add auto_docstring
Konstantinos Pitas
committed
Simplify EmbeddingSineHW
Konstantinos Pitas
committed
Simplify code
Konstantinos Pitas
committed
Simplify decoder layer
Konstantinos Pitas
committed
Remove get_clones completely
Konstantinos Pitas
committed
Fix auto_docstring
Konstantinos Pitas
committed
Fix ini_weights
Konstantinos Pitas
committed