coefficient of decay, refer to calculation formula
      
    
      
      
    
      
      
    
      
      
    
      
      
    
      
      
    
      the inteval for lr decay
      
    
      
      
    
      update learning rate by config table and state table
update learning rate by config table and state table
init optiMethod.
      
    
      
      
    
      
      
    
      
      
    
      
A learning rate decay policy, where the effective learning rate is calculated as base_lr * gamma
^(floor(iter / stepSize))the inteval for lr decay
coefficient of decay, refer to calculation formula