New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Batch Normalization 관련 #7

Open

jonghyuk0605 opened this issue Oct 15, 2015 · 0 comments

Collaborator

jonghyuk0605 commented Oct 15, 2015

현재 기본적인 사항은 구현 완료

수정해야될 점

Moving average에 사용할 적합한 alpha 검증
Moving standard deviation은 현재 수학적으로는 맞지 않은 식이라(moving average처럼 그냥 더하면 안되는 것으로 생각되는데 상관없나요?) 계산해서 새로운 식 고려
진행상황 봐가며 어느정도 수렴하면 training시에도 global statistics를 한 batch를 training할때도 적용

추가로 고려해야 될 사항 있으면 댓글 부탁..

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment