CachedDistriDataSet

Value Members

1. final def !=(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

2. final def ##(): Int

   

   Definition Classes

   AnyRef → Any

3. def ->[C](transformer: Transformer[T, C])(implicit arg0: ClassTag[C]): DataSet[C]

   

   Helper function to transform the data type in the data set.

   Helper function to transform the data type in the data set.

   Definition Classes

   AbstractDataSet

4. final def ==(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

5. final def asInstanceOf[T0]: T0

   

   Definition Classes

   Any

6. def cache(): Unit

   

   Trigger the computation of this dataset and cache it in memory.

   Trigger the computation of this dataset and cache it in memory.

   Definition Classes

   CachedDistriDataSet → DistributedDataSet

7. def clone(): AnyRef

   

   Attributes

   protected[java.lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... )

8. lazy val count: Long

   

   Attributes

   protected

9. def data(train: Boolean): RDD[T]

   

   Get a sequence of data

   Get a sequence of data

   train

   if the data is used in train. If yes, the data sequence is a looped endless sequence, or it has a limited length.

   returns

   data sequence

   Definition Classes

   CachedDistriDataSet → AbstractDataSet

10. final def eq(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

11. def equals(arg0: Any): Boolean

    

    Definition Classes

    AnyRef → Any

12. def finalize(): Unit

    

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

13. final def getClass(): Class[_]

    

    Definition Classes

    AnyRef → Any

14. def hashCode(): Int

    

    Definition Classes

    AnyRef → Any

15. var indexes: RDD[Array[Int]]

    

    Attributes

    protected

16. var isCached: Boolean

    

    Check if rdd is cached.

    Check if rdd is cached.

    Definition Classes

    DistributedDataSet

17. final def isInstanceOf[T0]: Boolean

    

    Definition Classes

    Any

18. final def ne(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

19. final def notify(): Unit

    

    Definition Classes

    AnyRef

20. final def notifyAll(): Unit

    

    Definition Classes

    AnyRef

21. def originRDD(): RDD[_]

    

    Get the 'origin' RDD of the dataset.

    Get the 'origin' RDD of the dataset.

    Definition Classes

    CachedDistriDataSet → DistributedDataSet

22. def shuffle(): Unit

    

    Change the order of the data sequence from the data set

    Change the order of the data sequence from the data set

    Definition Classes

    CachedDistriDataSet → AbstractDataSet

23. def size(): Long

    

    Total size of the data set

    Total size of the data set

    Definition Classes

    CachedDistriDataSet → AbstractDataSet

24. final def synchronized[T0](arg0: ⇒ T0): T0

    

    Definition Classes

    AnyRef

25. def toDistributed(): DistributedDataSet[T]

    

    Convert current DataSet to a distributed DataSet, in which we use a RDD to represent the data sequence.

    Convert current DataSet to a distributed DataSet, in which we use a RDD to represent the data sequence.

    Definition Classes

    AbstractDataSet

26. def toLocal(): LocalDataSet[T]

    

    Convert current DataSet to a local DataSet, in which we use an iterator to represent the data sequence.

    Convert current DataSet to a local DataSet, in which we use an iterator to represent the data sequence.

    Definition Classes

    AbstractDataSet

27. def toString(): String

    

    Definition Classes

    AnyRef → Any

28. def transform[C](transformer: Transformer[T, C])(implicit arg0: ClassTag[C]): DataSet[C]

    

    Helper function to transform the data type in the data set.

    Helper function to transform the data type in the data set.

    Definition Classes

    DistributedDataSet → AbstractDataSet

29. def unpersist(): Unit

    

    Unpersist rdd.

    Unpersist rdd.

    Definition Classes

    CachedDistriDataSet → DistributedDataSet

30. final def wait(): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

31. final def wait(arg0: Long, arg1: Int): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

32. final def wait(arg0: Long): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )