increase amount after each iteration
      
    
      
      
    
      
      
    
      
      
    
      
      
    
      
      
    
      
      
    
      
      
    
      
      
    
      update learning rate by config table and state table
update learning rate by config table and state table
init optiMethod.
      
    
      
      
    
      
      
    
      
      
    
      
A learning rate gradual increase policy, where the effective learning rate increase delta after each iteration. Calculation: base_lr + delta * iteration
increase amount after each iteration