Code and models for Out of Distribution Detection with Neural Network Anchoring, in ACML 2022.
This package was built and tested using
- Python
3.7.9 - Pytorch
1.13.1 - Torchvision
0.12.0 - Numpy
1.19.2
For logging and Config files we use yaml (5.4.1) and logging (0.5.1.2).
All of these can be installed (recommend a custom environment) using pip install -r requirements.txt.
Pre-trained (cifar10/100: ResNet34, WRN) to reproduce experiments from the paper can be downloaded from the Google Drive Link. The code assumes checkpoints are placed as follows: ckpt_save/in_dataset/modeltype_seed/model_name so for example, ckpts/cifar100/WideResNet_seed_1/ckpt-199.pth.
The tarball containing checkpoints already preserves this directory structure, and its location must be specified in the config.yml before evaluating. Please get in touch if you are interested in the ImageNet checkpoints!
Converting an existing network to work with anchoring is very easy and can be done as follows:
from lib.utils.models import ResNet34 #import any CNN model to train
from lib.AnchoringModel import ANT
net = ResNet34(nc=6,num_classes=10) #only modification is input has 2x channels as usual, so nc = 6.
anchored_net = ANT(net) #everything else remains unchanged
...
preds = anchored_net(images)
loss = criterion(labels,preds)
loss.backward()
It is recommended to use consistency during training, this can be easily done by obtaining predictions as preds = anchored_net(images,corrupt=True). For optimal performance, we use a schedule for corruption as
corrupt = batch_idx%5==0
outputs = anchored_net(inputs,corrupt=corrupt)
We provide a new benchmark to test OOD robutness to resizing artifacts. This can be found in resize_ood/resize_benchmark.tar.gz. To use it, extract the dataset from the tarball and point to them in the config.yml file, before executing the main.py.
We provide easy bash scripts to reproduce different tables/figures in the paper. These can be found and executed in reproducibility/. These depend on the pre-trained checkpoints provided, so they must first be downloaded. We also provide a separate config file with the exact settings used for our experiments.
If you use this code, please consider citing our paper as follows:
@inproceedings{anirudh2022out,
title={Out of Distribution Detection via Neural Network Anchoring},
author={Anirudh, Rushil and Thiagarajan, Jayaraman J},
booktitle={Asian Conference on Machine Learning (ACML)},
year={2022},
organization={PMLR}
}
This code is distributed under the terms of the GPL-2.0 license. All new contributions must be made under this license. LLNL-CODE-838619 SPDX-License-Identifier: GPL-2.0