Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Without the BN layer can performance well #29

Open
chaoyueziji opened this issue Mar 22, 2018 · 3 comments
Open

Without the BN layer can performance well #29

chaoyueziji opened this issue Mar 22, 2018 · 3 comments

Comments

@chaoyueziji
Copy link

Hello,When I was training the network, I did not add the BN layer, and the other structures were the same as the original. The training set used is only BSD40, and patch size is 40*40. In the test set12 on the PSNR is higher than the original, and the results from the loss convergence is also faster convergence than the BN layer.

@wbhu
Copy link
Owner

wbhu commented Apr 26, 2018

You could put the quantitative results and the trained model for evaluation.

@xiaojuan123
Copy link

but my network does not converge when I remove BN,what's your resolution?please

@chaoyueziji
Copy link
Author

but my network does not converge when I remove BN,what's your resolution?please

Hmm, my network structure is Conv + relu + bn, so when I remove BN, I find it convergent and has similar performance. So at first I thought BN was an unnecessary module. My experiment result is to remove BN module and optimize it by Adam. When the noise level is 25, the result can reach 29.15.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants