Skip to content
This repository has been archived by the owner on Nov 17, 2023. It is now read-only.

[Pull Requests] Hide gamma, beta, var, mean in graph visualization #6524

Closed
Lyken17 opened this issue Jun 1, 2017 · 1 comment
Closed

[Pull Requests] Hide gamma, beta, var, mean in graph visualization #6524

Lyken17 opened this issue Jun 1, 2017 · 1 comment

Comments

@Lyken17
Copy link
Contributor

Lyken17 commented Jun 1, 2017

Hi all

After ResNet, Batch Normalization becomes quite popular and is widely used recently. However, for visualization, I found parameters bn_gamma, bn_beta, bn_var, bn_mean occupy a lot of space while providing little information. plot_complex.pdf And it also made visualization of some large networks totally unreadable plot_complex_resnet.pdf

During my experiments, BN is always treated as a normal layer (like a convolution). Designers usually does not focus on beta/gamma/mean/var, especially on visualization. I suggest to hide these parameters during visualization.

Examples after modification
plot_clean.pdf
plot_clean_resnet.pdf

I have submitted a pull request for this issue.

@piiswrong
Copy link
Contributor

Thanks for PR.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants