PredictionService

Value Members

1. final def !=(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

2. final def ##(): Int

   

   Definition Classes

   AnyRef → Any

3. final def ==(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

4. def apply[T](model: Module[T], numThreads: Int)(implicit arg0: ClassTag[T], ev: TensorNumeric[T]): PredictionService[T]

   

   In this service, concurrency is kept not greater than numThreads by a BlockingQueue, which contains available model instances.

   Thread-safe Prediction Service for Concurrent Calls

   In this service, concurrency is kept not greater than numThreads by a BlockingQueue, which contains available model instances.
   
   If exceptions caught during predict, a scalar Tensor[String] will be returned with thrown message.

   model

   BigDL model used to do predictions

   numThreads

   max concurrency

   returns

   a PredictionService instance

5. final def asInstanceOf[T0]: T0

   

   Definition Classes

   Any

6. def clone(): AnyRef

   

   Attributes

   protected[java.lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... )

7. def deSerializeActivity(bytes: Array[Byte]): Activity

   

   For now, Tensor and Table[primitive|Tensor, Tensor] are supported.

   Deserialize Array[Byte] to activities according to Bigdl.proto.

   For now, Tensor and Table[primitive|Tensor, Tensor] are supported. It will convert AttrValue(Array(BigdlTensor)) to a Table. It will convert AttrValue(BigdlTensor) to a Tensor.

   bytes

   bytes data for Activity to be deserialized

8. final def eq(arg0: AnyRef): Boolean

   

   Definition Classes

   AnyRef

9. def equals(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

10. def finalize(): Unit

    

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

11. final def getClass(): Class[_]

    

    Definition Classes

    AnyRef → Any

12. def hashCode(): Int

    

    Definition Classes

    AnyRef → Any

13. final def isInstanceOf[T0]: Boolean

    

    Definition Classes

    Any

14. final def ne(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

15. final def notify(): Unit

    

    Definition Classes

    AnyRef

16. final def notifyAll(): Unit

    

    Definition Classes

    AnyRef

17. def serializeActivity(activity: Activity): Array[Byte]

    

    For now, Tensor and Table[primitive|Tensor, Tensor] are supported.

    Serialize activities to Array[Byte] according to Bigdl.proto.

    For now, Tensor and Table[primitive|Tensor, Tensor] are supported.

    activity

    activity to be serialized

18. final def synchronized[T0](arg0: ⇒ T0): T0

    

    Definition Classes

    AnyRef

19. def toString(): String

    

    Definition Classes

    AnyRef → Any

20. final def wait(): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

21. final def wait(arg0: Long, arg1: Int): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

22. final def wait(arg0: Long): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )