com.intel.analytics.bigdl.optim.SGD

Exponential

case class Exponential(decayStep: Int, decayRate: Double, stairCase: Boolean = false) extends LearningRateSchedule with Product with Serializable

Exponential is a learning rate schedule, which rescale the learning rate by lr_{n + 1} = lr * decayRate ^ (iter / decayStep)

decayStep

the inteval for lr decay

decayRate

decay rate

stairCase

if true, iter / decayStep is an integer division and the decayed learning rate follows a staircase function.

Linear Supertypes
Serializable, Serializable, Product, Equals, LearningRateSchedule, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. Exponential
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. LearningRateSchedule
  7. AnyRef
  8. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new Exponential(decayStep: Int, decayRate: Double, stairCase: Boolean = false)

    decayStep

    the inteval for lr decay

    decayRate

    decay rate

    stairCase

    if true, iter / decayStep is an integer division and the decayed learning rate follows a staircase function.

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any

  3. final def ##(): Int

    Definition Classes
    AnyRef → Any

  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any

  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  7. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  8. var currentRate: Double

    Definition Classes
    LearningRateSchedule

  9. val decayRate: Double

    decay rate

  10. val decayStep: Int

    the inteval for lr decay

  11. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  12. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  13. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  14. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  15. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  16. final def notify(): Unit

    Definition Classes
    AnyRef

  17. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  18. val stairCase: Boolean

    if true, iter / decayStep is an integer division and the decayed learning rate follows a staircase function.

  19. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  20. def updateHyperParameter[T](optimMethod: SGD[T]): Unit

    update learning rate by config table and state table

    update learning rate by config table and state table

    optimMethod

    init optiMethod.

    Definition Classes
    Exponential → LearningRateSchedule

  21. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  22. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  23. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Deprecated Value Members

  1. def updateHyperParameter(config: Table, state: Table): Unit

    Definition Classes
    LearningRateSchedule
    Annotations
    @deprecated
    Deprecated

    (Since version 0.2.0) Please input SGD instead of Table

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from LearningRateSchedule

Inherited from AnyRef

Inherited from Any

Ungrouped