A function to calculate decay on epochs
      
    
      
      
    
      
      
    
      
      
    
      
      
    
      
      
    
      
      
    
      
      
    
      
      
    
      update learning rate by config table and state table
update learning rate by config table and state table
init optiMethod.
      
    
      
      
    
      
      
    
      
      
    
      Warm up dealta value applied to warm up iteration
      
    
      Warm up iteration number
      
    
      (Since version 0.2.0) Please input SGD instead of Table
Learning rate schedule based on warm up Iterations
Warm up iteration number
Warm up dealta value applied to warm up iteration
A function to calculate decay on epochs