New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Division by input in tutorial #61

Open

lynn opened this issue Jul 27, 2018 · 0 comments

lynn commented Jul 27, 2018

Hi Steven, I don't know where else to ask so I'm asking here--

I'm following your useful XOR network tutorial and I'm confused by this step:

Once we get the delta hidden sum, we calculate the change in weights between the input and hidden layer by dividing it with the input data, (1, 1).

What if the input is (1, 0) or (0, 0)? We would be dividing by zero. How should I handle this case?

Later in part 2 you write

Since we’re dealing with matrices, we handle the division by multiplying the delta output sum with the hidden results matrices’ transpose.

But then you're just multiplying the results! No division happens at all. What's going on?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment