A function to calculate decay on epochs
update learning rate by config table and state table
update learning rate by config table and state table
init optiMethod.
Warm up dealta value applied to warm up iteration
Warm up iteration number
(Since version 0.2.0) Please input SGD instead of Table
Learning rate schedule based on warm up Iterations
Warm up iteration number
Warm up dealta value applied to warm up iteration
A function to calculate decay on epochs