A new fast approach is now available. Here is the PyTorch implementation. Here is the link to the project page.
Please refer to our paper.
Please install Caffe first. I think you may find a great number of tutorials talking about how to install it.
cd <caffe_root>/examples
git clone https://github.com/Andrew-Qibin/DSS.git
Before you start, you also need our pretrained model.
wget http://mftp.mmcheng.net/Andrew/dss_model_released.caffemodel
You can also download it from here (google drive). The results produced by this model are slightly different from the ones we reported in our paper (with higher F-measure score and also higher MAE score).
If you want to train the model, please prepare your own training dataset first. The data layer we used here is similar to the one used in HED. You can also refer to the data layer used in Deeplab or write your own one.
You may also find our data layer here. Notice that if you use caffe, please cite their paper.
Then, run
python run_saliency.py
If you want to test the model, you can run
ipython notebook DSS-tutorial.ipynb
About the CRF code we used, you can find it here. Notice that please provide a link to the original code as a footnote or a citation if you plan to use it.
From left to right: Source, Groundtruth, Ours, DCL, DHS, RFCN, DS, MDF, ELD, MC, DRFI, DSR.
- MSRAB: including 2500 training, 500 validation, and 2000 test images. (This is also our training set.) The source images can be found here.
- MSRA10K: You can also use this dataset for training as some works did.
- Evaluation Code (Windows): The cold is based on MS Visual Studio.
- Evaluation Code (Ubuntu): This code is based on C++ and with a python wrapper for python users.
We add the resnet version of our model into this repo. Also, a larger set of training data can be found in the lists dir. ResNet version caffemodel can be found here (google drive).
If you want to compare your results with ours, you may download them from here (Baidu Drive) or (Google Drive).
@article{HouPami19Dss,
title={Deeply Supervised Salient Object Detection with Short Connections},
author={Hou, Qibin and Cheng, Ming-Ming and Hu, Xiaowei and Borji, Ali and Tu, Zhuowen and Torr, Philip},
year = {2019},
volume={41},
number={4},
pages={815-828},
journal={IEEE Transactions on Pattern Analysis and Machine Intelligence}
}