dataset

Type Members

1. trait AbstractDataSet[D, DataSequence] extends AnyRef

   A set of data which is used in the model optimization process.

2. case class ByteRecord(data: Array[Byte], label: Float) extends Product with Serializable

   A byte array and a label.

3. class CachedDistriDataSet[T] extends DistributedDataSet[T]

   Wrap a RDD as a DataSet.

4. class ChainedTransformer[A, B, C] extends Transformer[A, C]

   A transformer chain two transformer together.

5. class DefaultPadding extends PaddingStrategy

6. trait DistributedDataSet[T] extends AbstractDataSet[T, RDD[T]]

   Represent a distributed data.

7. case class FixedLength(fixedLength: Array[Int]) extends PaddingStrategy with Product with Serializable

   Set the first dimension's length to fixed length.

8. class Identity[A] extends Transformer[A, A]

   Just transform the input to output.

9. abstract class Image extends Serializable

   Represent an image

10. trait Label[T] extends AnyRef

    Represent a label

11. class LocalArrayDataSet[T] extends LocalDataSet[T]

    Wrap an array as a DataSet.

12. trait LocalDataSet[T] extends AbstractDataSet[T, Iterator[T]]

    Manage some 'local' data, e.

13. class LocalImagePath extends AnyRef

    Represent a local file path of an image file

14. case class LocalSeqFilePath(path: Path) extends Product with Serializable

    Represent a local file path of a hadoop sequence file

15. trait MiniBatch[T] extends Serializable

    A interface for MiniBatch.

16. case class PaddingLongest(paddingLength: Array[Int]) extends PaddingStrategy with Product with Serializable

    Add an constant length to longest feature in the first dimension

17. case class PaddingParam[T](paddingTensor: Option[Array[Tensor[T]]] = scala.None, paddingStrategy: PaddingStrategy = new DefaultPadding())(implicit evidence$14: ClassTag[T]) extends Serializable with Product

    Feature Padding param for MiniBatch.

18. abstract class PaddingStrategy extends Serializable

19. abstract class Sample[T] extends Serializable

    Class that represents the features and labels of a data sample.

20. class SampleToMiniBatch[T] extends Transformer[Sample[T], MiniBatch[T]]

    Convert a sequence of Sample to a sequence of MiniBatch through function toMiniBatch.

21. abstract class Sentence[T] extends Serializable

    Represent a sentence

22. class SparseMiniBatch[T] extends ArrayTensorMiniBatch[T]

    SparseMiniBatch is a MiniBatch type for TensorSample.

23. trait Transformer[A, B] extends Serializable

    Transform a data stream of type A to type B.

24. class SampleToBatch[T] extends Transformer[Sample[T], MiniBatch[T]]

    Convert a sequence of single-feature and single-label Sample to a sequence of MiniBatch, optionally padding all the features (or labels) in the mini-batch to the same length