Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

#12253: Batch Norm support for training mode #16592

Open
wants to merge 9 commits into
base: main
Choose a base branch
from

Conversation

VirdhatchaniKN
Copy link
Contributor

@VirdhatchaniKN VirdhatchaniKN commented Jan 10, 2025

List of Github issues

Problem description

To implement batch normalization as device op

What's changed

Work done :

  • Provided support for Training mode

Checklist

All test have passed

@VirdhatchaniKN VirdhatchaniKN force-pushed the virdhatchani/bn_training_impl branch from b1bc734 to 3040c55 Compare January 10, 2025 05:35
@VirdhatchaniKN VirdhatchaniKN changed the title Virdhatchani/bn training impl #0: Batch Norm support for training mode Jan 10, 2025
@VirdhatchaniKN VirdhatchaniKN force-pushed the virdhatchani/bn_training_impl branch from 3040c55 to 931471a Compare January 10, 2025 05:57
@VirdhatchaniKN VirdhatchaniKN force-pushed the virdhatchani/batch_norm_impl branch from 84c1940 to ad3e284 Compare January 10, 2025 06:26
@VirdhatchaniKN VirdhatchaniKN force-pushed the virdhatchani/bn_training_impl branch 6 times, most recently from ec8c29a to 9544031 Compare January 10, 2025 11:23
@VirdhatchaniKN VirdhatchaniKN force-pushed the virdhatchani/batch_norm_impl branch 2 times, most recently from 5bfb6be to 82af08f Compare January 11, 2025 13:28
@VirdhatchaniKN VirdhatchaniKN force-pushed the virdhatchani/bn_training_impl branch 3 times, most recently from c06805d to ef0ab21 Compare January 11, 2025 13:59
@VirdhatchaniKN VirdhatchaniKN changed the title #0: Batch Norm support for training mode #12253: Batch Norm support for training mode Jan 11, 2025
@VirdhatchaniKN VirdhatchaniKN force-pushed the virdhatchani/bn_training_impl branch 6 times, most recently from 1fb2d75 to aafada0 Compare January 11, 2025 18:40
@VirdhatchaniKN VirdhatchaniKN force-pushed the virdhatchani/batch_norm_impl branch 2 times, most recently from c19ce6f to 8d1f48b Compare January 12, 2025 02:54
@VirdhatchaniKN VirdhatchaniKN force-pushed the virdhatchani/bn_training_impl branch from aafada0 to 258ea9b Compare January 12, 2025 02:59
@VirdhatchaniKN VirdhatchaniKN force-pushed the virdhatchani/batch_norm_impl branch from 8d1f48b to 052177f Compare January 12, 2025 10:24
Base automatically changed from virdhatchani/batch_norm_impl to main January 12, 2025 12:11
@VirdhatchaniKN VirdhatchaniKN force-pushed the virdhatchani/bn_training_impl branch 3 times, most recently from 35247ad to 32e1325 Compare January 13, 2025 11:57
#include <cmath>

namespace {
namespace CMAKE_UNIQUE_NAMESPACE {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why do you want to use it?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is a namespace set in Unity's CMake configuration and is included across all program factories.

@VirdhatchaniKN VirdhatchaniKN force-pushed the virdhatchani/bn_training_impl branch 2 times, most recently from 10bebff to a0aa222 Compare January 24, 2025 04:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Running statistics updates in batch normalization
10 participants