Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hash table second derivitive with respect to the input #185

Closed
Mehdishishehbor opened this issue Nov 1, 2022 · 1 comment
Closed

Hash table second derivitive with respect to the input #185

Mehdishishehbor opened this issue Nov 1, 2022 · 1 comment

Comments

@Mehdishishehbor
Copy link

Hi,

Thanks for your great research. Does hash table work for second derivative with respect to x (input)? or it only works for weights?

for example, let say we have this sequence of passing info:
x -> hash table -> neural network -> y

Now I want to get the second partial derivative of y with respect to x (d2y/dx2).

Please let me know.

Thanks,
Mehdi

@Tom94
Copy link
Collaborator

Tom94 commented Nov 29, 2022

Hi, yes, this should be supported out of the box.

Importantly, you need to use

"interpolation": "Smoothstep",

when configuring the encoding. When using the default linear interpolation, the second derivative is always zero and hence not very useful.

Please feel free to re-open the issue if you discover a bug in this function.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants