PredictionService

Value Members

1. final def !=(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

2. final def !=(arg0: Any): Boolean

   Definition Classes

   Any

3. final def ##(): Int

   Definition Classes

   AnyRef → Any

4. final def ==(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

5. final def ==(arg0: Any): Boolean

   Definition Classes

   Any

6. def apply[T](model: Module[T], numThreads: Int)(implicit arg0: ClassTag[T], ev: TensorNumeric[T]): PredictionService[T]

   In this service, concurrency is kept not greater than numThreads by a BlockingQueue, which contains available model instances.

   Thread-safe Prediction Service for Concurrent Calls

   In this service, concurrency is kept not greater than numThreads by a BlockingQueue, which contains available model instances.
   
   If exceptions caught during predict, a scalar Tensor[String] will be returned with thrown message.

   model

   BigDL model used to do predictions

   numThreads

   max concurrency

   returns

   a PredictionService instance

7. final def asInstanceOf[T0]: T0

   Definition Classes

   Any

8. def clone(): AnyRef

   Attributes

   protected[java.lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... )

9. def deSerializeActivity(bytes: Array[Byte]): Activity

   For now, Tensor and Table[primitive|Tensor, Tensor] are supported.

   Deserialize Array[Byte] to activities according to Bigdl.proto.

   For now, Tensor and Table[primitive|Tensor, Tensor] are supported. It will convert AttrValue(Array(BigdlTensor)) to a Table. It will convert AttrValue(BigdlTensor) to a Tensor.

   bytes

   bytes data for Activity to be deserialized

10. final def eq(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

11. def equals(arg0: Any): Boolean

    Definition Classes

    AnyRef → Any

12. def finalize(): Unit

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

13. final def getClass(): Class[_]

    Definition Classes

    AnyRef → Any

14. def hashCode(): Int

    Definition Classes

    AnyRef → Any

15. final def isInstanceOf[T0]: Boolean

    Definition Classes

    Any

16. final def ne(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

17. final def notify(): Unit

    Definition Classes

    AnyRef

18. final def notifyAll(): Unit

    Definition Classes

    AnyRef

19. def serializeActivity(activity: Activity): Array[Byte]

    For now, Tensor and Table[primitive|Tensor, Tensor] are supported.

    Serialize activities to Array[Byte] according to Bigdl.proto.

    For now, Tensor and Table[primitive|Tensor, Tensor] are supported.

    activity

    activity to be serialized

20. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes

    AnyRef

21. def toString(): String

    Definition Classes

    AnyRef → Any

22. final def wait(): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

23. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

24. final def wait(arg0: Long): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )