Update KL Divergence formula (apache#16170)

* Update KL Divergence formula Errors fix. * remove initial error
larroy · Sep 28, 2019 · 395c365 · 395c365
1 parent 34d98e3
commit 395c365
Showing 1 changed file with 1 addition and 1 deletion.
diff --git a/python/mxnet/gluon/loss.py b/python/mxnet/gluon/loss.py
@@ -424,7 +424,7 @@ class KLDivLoss(Loss):
 
         prob = \softmax({pred})
 
-        L = \sum_i {label}_i * \big[\log({label}_i) - log({pred}_i)\big]
+        L = \sum_i {label}_i * \big[\log({label}_i) - \log({prob}_i)\big]
 
 
     `label` and `pred` can have arbitrary shape as long as they have the same