CachedDistriDataSet

Value Members

1. final def !=(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

2. final def !=(arg0: Any): Boolean

   Definition Classes

   Any

3. final def ##(): Int

   Definition Classes

   AnyRef → Any

4. def ->[C](transformer: Transformer[T, C])(implicit arg0: ClassTag[C]): DataSet[C]

   Helper function to transform the data type in the data set.

   Helper function to transform the data type in the data set.

   C

   transformer

   returns

   Definition Classes

   AbstractDataSet

5. final def ==(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

6. final def ==(arg0: Any): Boolean

   Definition Classes

   Any

7. final def asInstanceOf[T0]: T0

   Definition Classes

   Any

8. def cache(): Unit

   Trigger the computation of this dataset and cache it in memory.

   Trigger the computation of this dataset and cache it in memory.

   Definition Classes

   CachedDistriDataSet → DistributedDataSet

9. def clone(): AnyRef

   Attributes

   protected[java.lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... )

10. lazy val count: Long

    Attributes

    protected

11. def data(train: Boolean): RDD[T]

    Get a sequence of data

    Get a sequence of data

    train

    if the data is used in train. If yes, the data sequence is a looped endless sequence, or it has a limited length.

    returns

    data sequence

    Definition Classes

    CachedDistriDataSet → AbstractDataSet

12. final def eq(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

13. def equals(arg0: Any): Boolean

    Definition Classes

    AnyRef → Any

14. def finalize(): Unit

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

15. final def getClass(): Class[_]

    Definition Classes

    AnyRef → Any

16. def hashCode(): Int

    Definition Classes

    AnyRef → Any

17. var indexes: RDD[Array[Int]]

    Attributes

    protected

18. var isCached: Boolean

    Check if rdd is cached.

    Check if rdd is cached.

    Definition Classes

    DistributedDataSet

19. final def isInstanceOf[T0]: Boolean

    Definition Classes

    Any

20. final def ne(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

21. final def notify(): Unit

    Definition Classes

    AnyRef

22. final def notifyAll(): Unit

    Definition Classes

    AnyRef

23. def originRDD(): RDD[_]

    Get the 'origin' RDD of the dataset.

    Get the 'origin' RDD of the dataset.

    returns

    Definition Classes

    CachedDistriDataSet → DistributedDataSet

24. def shuffle(): Unit

    Change the order of the data sequence from the data set

    Change the order of the data sequence from the data set

    Definition Classes

    CachedDistriDataSet → AbstractDataSet

25. def size(): Long

    Total size of the data set

    Total size of the data set

    returns

    Definition Classes

    CachedDistriDataSet → AbstractDataSet

26. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes

    AnyRef

27. def toDistributed(): DistributedDataSet[T]

    Convert current DataSet to a distributed DataSet, in which we use a RDD to represent the data sequence.

    Convert current DataSet to a distributed DataSet, in which we use a RDD to represent the data sequence.

    returns

    Definition Classes

    AbstractDataSet

28. def toLocal(): LocalDataSet[T]

    Convert current DataSet to a local DataSet, in which we use an iterator to represent the data sequence.

    Convert current DataSet to a local DataSet, in which we use an iterator to represent the data sequence.

    returns

    Definition Classes

    AbstractDataSet

29. def toString(): String

    Definition Classes

    AnyRef → Any

30. def transform[C](transformer: Transformer[T, C])(implicit arg0: ClassTag[C]): DataSet[C]

    Helper function to transform the data type in the data set.

    Helper function to transform the data type in the data set.

    C

    transformer

    returns

    Definition Classes

    DistributedDataSet → AbstractDataSet

31. def unpersist(): Unit

    Unpersist rdd.

    Unpersist rdd.

    Definition Classes

    CachedDistriDataSet → DistributedDataSet

32. final def wait(): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

33. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

34. final def wait(arg0: Long): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )