com.intel.analytics.bigdl.optim.SGD
It is the default learning rate schedule. For each iteration, the learning rate would update with the following formula:
l_{n + 1} = l / (1 + n * learning_rate_decay)
where l is the initial learning rate
l
update learning rate by config table and state table
init optiMethod.
It is the default learning rate schedule. For each iteration, the learning rate would update with the following formula:
l_{n + 1} = l / (1 + n * learning_rate_decay)
where
l
is the initial learning rate